A Senior data engineer will be responsible for designing, developing, and maintaining ETL processes to extract, transform, and load data from various sources into our data warehouse. The ideal candidate should have hands-on experience with ETL tools, strong data analysis skills, and the ability to work with large datasets.
· Lead the design, development, and maintenance of large-scale data systems, including data warehouses, data lakes, and data pipelines.
· Design, develop, and maintain ETL processes using tools like Matillion.
· Design, Develop and maintain optimal data flows in tools like Matillion.
· Develop and Maintain Datawarehouse objects like tables, views and security roles in snowflake database.
· Extract data from various sources, such as databases, flat files, and APIs
· Transform and cleanse data to ensure data quality and integrity
· Load data into the data warehouse, ensuring data consistency and accuracy
· Optimize ETL processes for performance, scalability, and reliability
· Work closely with data architects, analysts, and developers to support data integration initiatives.
· Implement data validation, data quality checks, and data security measures
· Troubleshoot and resolve data issues, performance bottlenecks, and ETL failures.
· Implement best practices for data warehousing, data modeling, and ETL development.
· Document ETL processes, data mappings, and configurations.