Information:

Research developed for AnalyticalWays to implement a process that allows reading and processing large text files (+500MB) in parallel and storing their information in relational databases in the most efficient way.

The consumer-producer pattern was used along with stream reading in the text file for efficient reading and minimal idle times, while three data access mechanisms were proposed, using bulk-insert to save the information as quickly as possible.

Details:

• Client:Analytical Ways
• Technologies:C#, .NET Core, Console Application
• Industry:Productivity
• Date:November 13, 2020
• URL:Data Processor (GitHub)