Senior Data Engineer

Tasks

• Advocate for best practices in data engineering
• Collaborate with data scientists ML engineers analysts and product owners
• Design, build, and maintain scalable data pipelines
• Develop and maintain ETL/ELT workflows
• Enable real-time and batch data processing
• Ensure data quality, consistency, and governance
• Monitor and troubleshoot data pipelines
• Work with cloud platforms to manage data lakes warehouses and orchestration tools

Perks/Benefits

• Healthcare stipend
• Private healthcare
• Professional development
• Statutory time off

Skills/Tech-stack

AWS | Airflow | Apache Iceberg | Big Data | Big Data Technologies | Dagster | Data Modeling | Data Technologies | Docker | Feature Stores | Flink | GCP | Generative AI | Kafka | Kubernetes | Machine Learning | Machine Learning Workflows | Model Serving | Open Table Formats | Open table | Prefect | Python | SQL | Schema evolution | Spark | Table formats