Project 06

CSV TO DATABASE IMPORTer

This project implements a lightweight ETL pipeline that imports structured data from a CSV file into a relational database using SQLite. The tool focuses on reliably ingesting external data, mapping it to a defined schema, and persisting it in a database while handling validation, performance, and error scenarios common in real-world data workflows.

C# (.NET)

SQL/SQLite

System.IO

Technical

Highlights

  • Read CSV data using StreamReader to safely process rows and columns.

  • Designed and created a corresponding SQLite table schema, including checks to prevent duplicate table creation.

  • Inserted records using parameterized SQL commands to ensure data integrity and protect against SQL injection.

  • Implemented error handling for malformed rows, missing fields, and invalid data types.

  • Used database transactions for bulk inserts to significantly improve performance and ensure atomic operations.

Project

Takeaways

  • Gained hands-on experience with core database operations and relational schema design in C#.

  • Learned the importance of parameterized queries for security and correctness.

  • Developed a practical understanding of ETL workflows: extracting CSV data, transforming it to match a schema, and loading it into a database.