MarketplaceListingsSnippetHandling Huge Excel by Chunking Logic

Handling Huge Excel by Chunking Logic

Bronze Certified

Snippet

1 reviews

6

Handling Huge Excel by Chunking Logic

Bronze Certified

Snippet

1 reviews

6


Summary

This snippet takes the bulk Excel file as input and converts it into small xml based on the chunk size (total records in chunk).

carouselImage0

Overview

In the schenario of having an Excel file with more than 10 million records and the need to apply some sort of filter condition for each and every record, this component helps to read the huge Excel file and convert each sheet into separate Excel files. Then, based on the chunk size (like 2.5lac Excel records as 1 chunk), loop through each newly created Excel file and convert it into small chunk XML documents.

In general, when UiPath is trying to access and load entire bulk Excel files into a single datatable and performing datatable activities like sorting, merging, filtering, it throws an "out of memory exception" issue, because UiPath is trying to access more RAM (32 bit application can access only 4gb RAM). In this situation, users can benefit from this snippet to process Excel files chunk by chunk.

Benefits

1. Provides logic to handle and process huge Excel files
2. Resolves the "out of memory exception" issue by processing bulk Excel files by chunking logic.

Published: 11 Jan 2022 | Updated: 11 Jan 2022

Trusted Source


License

MIT


Code Language

Visual Basic


Runtime

Windows (.Net 5.0 or higher)


Tags

Handling_Huge_Excel
Excel Automation

Compatibility

Studio: 2021.10.4+


Dependencies

UiPath Excel activities >=2.22.4 UiPath System activities >=21.10.3