Lead Data Engineer
Tasks
- Automate data pipeline deployments
- Build data products
- Design data pipelines
- Develop ETL processes
- Ensure data governance and compliance
- Evaluate and recommend data tools
- Implement data quality validation
- Integrate data sources
- Manage PII
- Optimize spark performance
- Perform data modeling
- Set up monitoring and alerting
- Support data science and analytics teams
- Troubleshoot pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Airbyte | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Machine Learning | Azure Synapse | Azure Synapse Analytics | CI/CD | DBT | Data Contracts | Data Factory | Data Governance | Data Lineage | Data Management | Data Modeling | Data Quality | Data Validation | Databricks | Delta Lake | ETL | Fabric | Fivetran | GDPR | Kafka | Machine Learning | Monitoring and Alerting | PII data | PII data management | PySpark | Python | SQL | Schema Enforcement | Spark | Sqoop | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Featured Feat. AI Engineer (MTS) USD 160K-300KAPI Development | AWS | Amazon Web Services | Deep learning | FastAPIMentoring | Open source contributions | Remote workMid-levelRemote R20d ago
-
Featured Feat. Data Engineer USD 80K-150KData Monitoring | Data Quality | Data Validation | ELT | ETLRemote workEntry-levelRemote R20d ago
-
Ai算法工程师-汽车专项-实习 CNY 25K-37KAutoml | C# | C++ | Computer Vision | Data ProcessingInternship | Mentorship | Real-world projectsEntry-level Internship南京10h ago
-
AI frameworks | AI-assisted coding | AWS Bedrock | Agentic AI | Agentic AI FrameworksMid-level Full TimeGuatemala, Guatemala (Remote) R11h ago
-
Lead Fraud Data Scientist COP 27600K-240000KA/B | A/B Testing | AWS | Algorithmic Fairness | AzureDental insurance | Health insurance | Hybrid work | Remote work | Stock optionsSenior-level Full TimeBogotá R12h ago
-
Lead Fraud Data Scientist MXN 934K-1300KA/B | A/B Testing | AWS | Algorithmic Fairness | AzureDental insurance | Health insurance | Performance bonus | Remote work | Stock optionsSenior-level Full TimeGuadalajara, Monterrey, Queretaro, CDMX R12h ago
-
AWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3Additional paid leave | Corporate partner discounts | Hybrid work | Learning platform access | Mobile PlanSenior-level Full TimeBarangaroo, NSW, AU12h ago
-
Power Systems Modelling & Analytics Engineer NZD 129K-152KADMS | Analytical modeling | Decision Making | Network Modeling | Network PlanningExtra leave purchase | Hybrid working | KiwiSaver employer contribution | Life insurance | Medical insuranceMid-level Full TimeTauranga, Bay of Plenty Region, NZ12h ago
-
Applied AI Analytics Lead 14 Months FTC GBP 70K-80KAzure Foundry | Copilot Studio | DBT | Microsoft Fabric | Power AutomateHands on production environment | Hybrid work modelSenior-level ContractLondon, England, United Kingdom R13h ago
-
CI/CD | DBT | Data Analysis | Data Modeling | Data NormalizationCharity contribution match | Corporate Volunteering Hours | Dental insurance | Employee discounts | Medical insuranceMid-level Full TimeBengaluru, KA, IN13h ago
-
Azure Machine Learning | CNN | CUDA | DCGAN | DICECross-functional collaboration | Documentation | Team collaborationEntry-level Full TimeAix-en-Provence, Provence-Alpes-Côte d'Azur, France13h ago
-
Machine Learning & AI Engineer CZK 688K-912KAPIs | CI/CD | Cloud platform | Computer Vision | DBTCertification support | Continuous learning | Professional development opportunities | Supportive team cultureMid-level Full TimePraha 1, Hlavní město Praha, Czechia14h ago
-
Lead Fraud Data Scientist USD 140K-199KA/B | A/B Testing | AWS | Algorithmic Fairness | AzureDental insurance | Health insurance | Performance bonus | Remote work | Stock optionsSenior-level Full TimeBuenos Aires, Córdoba R14h ago
-
AI Engineer USD 50K-120KData Analysis | JavaScript | Language Processing | Machine Learning | Natural LanguageHigh-growth environment | Maximum autonomy | Small teamEntry-level Full TimeLondon, England, GB14h ago
-
Computer Vision Engineer CAD 106K-124KAI research | C++ | Camera Calibration | Camera Model | Computer VisionAnnual health checkups | Health insurance | Performance bonuses | Preferential services pricingMid-level Full TimeHa Noi, Viet Nam14h ago
-
Senior/Expert AI Engineer – ADAS USD 184K-322K3D Geometry | C++ | Camera | Computer Vision | Deep learningAnnual bonus | Health checkups | Preferential pricing | Premium healthcareSenior-level Full TimeHanoi, Viet Nam14h ago
-
Lead Data Scientist ZAR 720K-840KAWS | Big Data | Data Mining | Data Standardization | Data TransformationHybrid workSenior-level Full TimeBellville, South Africa14h ago
-
Data Engineer GBP 34K-34KAgile | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure DataCelebration day | Employee discount | Employee sample sales | Paid annual leave | Personalised learningEntry-level Full TimeLondon, England, United Kingdom14h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SynapseMid-level Full TimeMiami, FL, United States14h ago
-
Mid-level Full TimeAbu Dhabi, United Arab Emirates14h ago
-
API Testing | Agile | Airflow | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India14h ago
-
Azure Data Engineer (Telecommunications) USD 135K-165KAzure | CI/CD | DBT | Data Quality | DatabricksSenior-level ContractFrisco, United States15h ago
-
AWS | Agent Orchestration | Agentic Systems | Anthropic | Deep learningMid-level Full TimeTel Aviv, Israel, IL15h ago
-
ACM | API Development | API Gateway | AWS API | AWS API GatewaySenior-level ContractPretoria, South Africa15h ago
-
Senior Data Engineer INR 2000K-3000KAI integrations | API Integration | Automation workflows | Azure Data | Azure Data FactoryClient-facing work | Fast-paced environment | Independent ownershipSenior-level Full TimeBangalore North, India15h ago