Senior Data Engineer

USD 118K-204K (estimate) Senior-level Full Time Found 1d ago

Tasks

• Build data pipelines in Databricks
• Collaborate with stakeholders
• Coordinate workflows with orchestration tools
• Create and manage data marts
• Develop data quality frameworks
• Develop identity resolution pipelines
• Implement CI/CD processes
• Implement feature store solutions
• Manage end-to-end data lifecycle
• Produce technical documentation

Perks/Benefits

• Certifications
• Company equipment
• Flexible working
• Learning opportunities
• Mentorship
• Travel opportunities

Skills/Tech-stack

Airflow | Anomaly monitoring | Big Data | CI/CD | Confluence | Data Marts | Data Quality | Databricks | Delta Lake | Dimensional Modeling | Distributed Systems | Drift Detection | Feature Store | Identity resolution | Jira | Lakehouse Architecture | PySpark | SQL | Schema drift | Schema drift detection | Spark | Unity Catalog