Data Engineer

Tasks

• Build ETL pipelines
• Collaborate with stakeholders
• Design data pipelines
• Develop data models and schemas
• Document data pipelines and workflows
• Implement data quality checks
• Integrate data from databases APIs and streaming sources
• Manage data infrastructure
• Monitor data quality
• Optimize data pipelines
• Optimize query performance

Perks/Benefits

• N/A

Skills/Tech-stack

AWS | Amazon Redshift | Apache Flink | Apache Spark | Azure | Azure SQL | Azure SQL Data | Azure SQL Data Warehouse | Caching | Cassandra | Data Lakes | Data Modeling | Data Quality | Data Warehouse | Data Warehousing | Data quality monitoring | Distributed Computing | ETL | Google BigQuery | Google Cloud | Hadoop | Indexing | Java | MongoDB | MySQL | NoSQL | Partitioning | PostgreSQL | Python | Quality monitoring | SQL | SQL Data Warehouse | Scala