Manager Data Engineer
Tasks
- Architect data platform
- Build enterprise data pipelines
- Design Delta Lake architectures
- Develop semantic data products
- Drive platform modernization
- Enable AI ready datasets
- Ensure observability and monitoring
- Establish engineering standards
- Implement CI/CD pipelines
- Implement data governance with Unity Catalog
- Implement data quality checks
- Lead Databricks Lakehouse platform
- Lead root cause analysis
- Maintain Genie Ontologies
- Maintain Genie Spaces
- Mentor data engineering team
- Optimize Spark workloads
- Perform code reviews
- Set up Automated Testing
Perks/Benefits
Skills/Tech-stack
Adaptive Query | Adaptive query execution | Apache Spark | Auto Loader | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | CI/CD | Data Governance | Data Lake Storage Gen2 | Data Quality | Databricks | Databricks Jobs | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | Entra ID | Git | Infrastructure as Code | Lakeflow | Liquid clustering | MLflow | Medallion Architecture | Metadata Management | Microsoft Azure | Microsoft Entra | Microsoft Entra ID | Observability | Photon | PowerBI | Python | Query Execution | RBAC | SQL | Serverless compute | Tableau | Unity Catalog | “as-code”
Education
Roles
Data Engineer | Data Engineer Manager | Engineer | Engineer Manager | Lead | Lead Data | Lead Data Engineer | Manager
Related jobs
-
Data Engineer ZAR 420K-464KAPI | Artificial Intelligence | DBT | Data Compliance | Data GovernanceCollaborative culture | Employee wellness programs | Hybrid work | Modern tooling | Professional developmentMid-level Full TimeCape Town, South Africa R4h ago
-
Artificial Intelligence | Data Normalization | Data Science | Data Visualization | Data analyticsMulti-vendor environment exposure | Remote workSenior-level ContractRemote R5h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Remote workSenior-level ContractRemote R5h ago
-
AI tools | API Management | Access Control | Azure | Azure APIRemote workSenior-level ContractRemote R5h ago
-
AI Automation | AI automation tools | API Management | Automation tools | AzureRemote workMid-level ContractRemote R5h ago
-
C# | C++ | CI/CD | Containerization | Corporate actionsCross-functional collaboration | Production support ownership | Remote workSenior-level ContractRemote R5h ago
-
AWS | Access Management | Agile | Automated testing | AzureFull time schedule 36 25 hours per week | Occasional travel within Alberta | Remote work | Work performed within CanadaSenior-level ContractEdmonton, Canada R6h ago
-
Computational Scientist USD 85K-139KAlgorithm Optimization | Backend Development | Computational modeling | Computer Vision | Data AnalysisRemote Hybrid eligibleMid-level Full TimeUniversity R6h ago
-
Data Science Lead INR 4000K-5500KBenchmarking | Embeddings | Explainable AI | LLM | Machine LearningComprehensive healthcare | Fully remote working | International projects | Long-term B2B contractSenior-level Full TimeRemote R6h ago
-
Senior Software Engineer - (Backend,AI) INR 3242K-5000KAPI Gateway | AWS | AWS Lambda | Agent Orchestration | Amazon APIFamily well-being benefits | Health benefits | Hybrid work | Paid time off | Wellbeing supportSenior-level Full TimeHyderabad, India R8h ago
-
CVMFS | Docker | Git | GitOps | HelmContract extension possible | Formal training | Health insurance | Hybrid work | Language classesEntry-level Full TimeGeneva, GENEVA, Switzerland R8h ago
-
Senior AI Engineer – AI Platform USD 140K-160KAWS | Agentic AI | Alerting | Alignment | Distributed SystemsDaily meal specials | Dry cleaning | Free shuttle transportation | Gourmet cafeteria | Group fitness classesSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States R8h ago
-
Data Engineer - Data & Technology, SCD SEK 577K-937KAPIs | Data Governance | Data Modeling | Data Privacy | Data QualityContinuous learning | Flexible work from home | Global career development | Mentoring and knowledge sharing | Office-based collaborationMid-level Full TimeÄlmhult, Sweden R9h ago
-
Senior Artificial Intelligence/Machine Learning Engineer UAH 1377K-1549KAWS | Agile | Azure | Deep learning | Embedding ModelsCompany paid medical insurance | Company-paid certifications | Financial consultations | Internal events and workshops | Language coursesSenior-level Full TimeUkraine R10h ago
-
Senior Artificial Intelligence/Machine Learning Engineer UAH 1377K-1549KAWS | Agile | Azure | Deep learning | Embedding ModelsCareer growth opportunities | Company paid medical insurance | Company-paid certifications | Financial and legal consultations | Internal meetups conferences and workshopsSenior-level Full TimeUkraine R10h ago
-
Senior Data Engineer INR 3000K-4000KAI | AWS | Amazon Aurora | Automated reporting | AzureBike to work | Educational assistance | Employee assistance programme | Employee discount | Enhanced maternity/paternity leaveSenior-level Full TimeMumbai, MH, India R11h ago
-
Engineering Team Lead (Triage) USD 177K-235KAgent Orchestration | Context Management | Cybersecurity | Go | LLMAutonomy | Collaborative startup environment | Hands-on role | High ownershipSenior-level Full TimeTel Aviv-Jaffa, Tel Aviv District, IL R11h ago
-
Software Engineer, Machine Learning INR 3242K-4580KClassification Models | Data Mining | Deep learning | Distributed Training | Embedding ModelsFlexible work hybrid work arrangementSenior-level Full TimeBengaluru, KA, India R12h ago
-
Forward Deployed Engineer – GenAI, Prague CZK 1219K-1715KAPI Integration | Agent Development Kit | Agent systems | Agentic Workflows | CI/CDCompany events and team building | Employee referral program | Flexible working hours | Hardware repurchase | Hybrid workSenior-level Full TimePraha 1, Hlavní město Praha, Czechia R12h ago
-
Software Engineer III, Big Data INR 2040K-3465KApache Flink | Apache Hive | Apache Spark | Cloud Composer | Cloud StorageHybrid workSenior-level Full TimeHyderabad, Telangana 500081, India R13h ago
-
3D processing | AWS | CNN | Computer Vision | Convolutional Neural NetworksFlexible remote days | Hybrid work | Professional growth supportMid-level Full TimeHerzliya, Israel R13h ago
-
ANSYS-FLUENT | Azure | CFD | Data analytics | Industrial IoTFlexible working hours | Half-fare card | Modern office facilities | Public transport pass subsidy | Work from homeEntry-level Full TimeZürich, ZH, Switzerland R13h ago
-
Alation | Business glossary | Collibra | Data Compliance | Data GovernanceDeloitte Days | Flexible benefits spending account | Flexible work arrangements | Hybrid work model | Learning daysMid-level Full TimeToronto, ON, CA, M5H 0A9 R14h ago
-
Backend Software Engineer, AI Platform INR 2000K-3000KAPIs | AWS | Agentic AI | Authentication | Auto ScalingMid-level Full TimeBengaluru R15h ago
-
Address Parsing | Data Modeling | Data Normalization | Data Quality | Data StandardizationCareer growth | Continuous learning | Flexible internship schedule | Mentorship | Professional developmentMid-level Full TimeIndia R16h ago