Senior Data Engineer

Tasks

• Automate end to end pipelines
• Collaborate with Data Science and ML teams
• Design and build cloud data platforms
• Develop batch and streaming data pipelines
• Enable data serving via APIs and endpoints
• Ensure data governance and access control
• Implement data observability and monitoring
• Implement lakehouse architectures
• Integrate and optimize data for performance scalability and cost
• Model data for analytics and operational use cases
• Optimize near real time pipelines
• Orchestrate data workflows

Perks/Benefits

• N/A

Skills/Tech-stack

ABAC | AWS | Airflow | Apache Spark | Azure | CI/CD | Cloud platform | DBT | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Databricks | Delta Lake | Event Driven | Event-driven architecture | Google Cloud | Google Cloud Platform | Infrastructure as Code | Kafka | Lakehouse | Medallion Architecture | Microsoft Fabric | Python | RBAC | SQL | Snowflake | Streaming Architecture | Terraform | “as-code”