Senior Data Engineer - Databricks

Tasks

• Collaborate with cross functional teams on production data solutions
• Contribute to knowledge sharing for junior engineers
• Design scalable data pipelines
• Develop batch and streaming data workflows
• Ensure data quality, governance, and security
• Implement and maintain Databricks lakehouse solutions
• Optimize data processing performance and cost
• Support CI/CD deployment processes

Perks/Benefits

• Continuous learning resources
• Hybrid work options
• Professional development opportunities
• Team events

Skills/Tech-stack

AWS | Ansible | Apache Airflow | Apache Kafka | Apache NiFi | Apache Spark | Azure | CI/CD | Data Governance | Data Modeling | Data Security | Databricks | Databricks Workflows | Delta Lake | Distributed Computing | Git | Google Cloud | PySpark | SQL | Scala | Terraform