Technical Lead-Data Engg

Matillion

We are currently seeking an experienced data engineer to join our dynamic Data & Analytics team. The Data Engineer will design, build, and maintain the data infrastructure and pipelines to meet the data and analytics needs. He or she should be well versed on various programing languages, different databases, data conversion strategies, and optimization strategies to ensure efficient flow of data and information across various business applications throughout the company. The data engineer will also handle common database procedures such as upgrades, backups, recoveries, and migrations, as well as troubleshooting, issue resolutions, and debugging. He or she will collaborate with other team members and stakeholders to ensure database integrity, stability, and performance.

Responsibilities

• Data Pipeline Development: Design, develop, and maintain robust data pipelines that support the efficient collection, transformation, and storage of large datasets.

• ETL / ELT Processes: Knowledge about ETL / ELT processes to integrate and clean data from various sources.

• Database Management: Manage and maintain databases (SQL and NoSQL) to ensure efficient storage and retrieval of data.

• Collaboration: Work closely with Data Analysts, Data Scientists, and business stakeholders to ensure data is available, accessible, clean, and ready for analysis.

 • Data Quality: Ensure data quality by implementing data validation, monitoring, and automation processes.

• Optimization: Optimize the performance of data systems and queries to meet scalability and speed requirements.