Lead Data Engineer
Tasks
- Automate data pipeline deployments
- Build data products
- Design data pipelines
- Develop ETL processes
- Ensure data governance and compliance
- Evaluate and recommend data tools
- Implement data quality validation
- Integrate data sources
- Manage PII
- Optimize spark performance
- Perform data modeling
- Set up monitoring and alerting
- Support data science and analytics teams
- Troubleshoot pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Airbyte | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Machine Learning | Azure Synapse | Azure Synapse Analytics | CI/CD | DBT | Data Contracts | Data Factory | Data Governance | Data Lineage | Data Management | Data Modeling | Data Quality | Data Validation | Databricks | Delta Lake | ETL | Fabric | Fivetran | GDPR | Kafka | Machine Learning | Monitoring and Alerting | PII data | PII data management | PySpark | Python | SQL | Schema Enforcement | Spark | Sqoop | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Featured Feat. AI Engineer (MTS) USD 160K-300KAPI Development | AWS | Amazon Web Services | Deep learning | FastAPIMentoring | Open source contributions | Remote workMid-levelRemote R20d ago
-
Featured Feat. Data Engineer USD 80K-150KData Monitoring | Data Quality | Data Validation | ELT | ETLRemote workEntry-levelRemote R20d ago
-
Ai算法工程师-汽车专项-实习 CNY 25K-37KAutoml | C# | C++ | Computer Vision | Data ProcessingInternship | Mentorship | Real-world projectsEntry-level Internship南京9h ago
-
AI frameworks | AI-assisted coding | AWS Bedrock | Agentic AI | Agentic AI FrameworksMid-level Full TimeGuatemala, Guatemala (Remote) R11h ago
-
Lead Fraud Data Scientist COP 27600K-240000KA/B | A/B Testing | AWS | Algorithmic Fairness | AzureDental insurance | Health insurance | Hybrid work | Remote work | Stock optionsSenior-level Full TimeBogotá R11h ago
-
Lead Fraud Data Scientist MXN 934K-1300KA/B | A/B Testing | AWS | Algorithmic Fairness | AzureDental insurance | Health insurance | Performance bonus | Remote work | Stock optionsSenior-level Full TimeGuadalajara, Monterrey, Queretaro, CDMX R11h ago
-
AWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3Additional paid leave | Corporate partner discounts | Hybrid work | Learning platform access | Mobile PlanSenior-level Full TimeBarangaroo, NSW, AU11h ago
-
Power Systems Modelling & Analytics Engineer NZD 129K-152KADMS | Analytical modeling | Decision Making | Network Modeling | Network PlanningExtra leave purchase | Hybrid working | KiwiSaver employer contribution | Life insurance | Medical insuranceMid-level Full TimeTauranga, Bay of Plenty Region, NZ11h ago
-
CI/CD | DBT | Data Analysis | Data Modeling | Data NormalizationCharity contribution match | Corporate Volunteering Hours | Dental insurance | Employee discounts | Medical insuranceMid-level Full TimeBengaluru, KA, IN12h ago
-
Lead Fraud Data Scientist USD 140K-199KA/B | A/B Testing | AWS | Algorithmic Fairness | AzureDental insurance | Health insurance | Performance bonus | Remote work | Stock optionsSenior-level Full TimeBuenos Aires, Córdoba R13h ago
-
AI Engineer USD 50K-120KData Analysis | JavaScript | Language Processing | Machine Learning | Natural LanguageHigh-growth environment | Maximum autonomy | Small teamEntry-level Full TimeLondon, England, GB13h ago
-
Computer Vision Engineer CAD 106K-124KAI research | C++ | Camera Calibration | Camera Model | Computer VisionAnnual health checkups | Health insurance | Performance bonuses | Preferential services pricingMid-level Full TimeHa Noi, Viet Nam13h ago
-
Senior/Expert AI Engineer – ADAS USD 184K-322K3D Geometry | C++ | Camera | Computer Vision | Deep learningAnnual bonus | Health checkups | Preferential pricing | Premium healthcareSenior-level Full TimeHanoi, Viet Nam13h ago
-
Lead Data Scientist ZAR 720K-840KAWS | Big Data | Data Mining | Data Standardization | Data TransformationHybrid workSenior-level Full TimeBellville, South Africa13h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SynapseMid-level Full TimeMiami, FL, United States14h ago
-
Mid-level Full TimeAbu Dhabi, United Arab Emirates14h ago
-
Azure Data Engineer (Telecommunications) USD 135K-165KAzure | CI/CD | DBT | Data Quality | DatabricksSenior-level ContractFrisco, United States14h ago
-
AWS | Agent Orchestration | Agentic Systems | Anthropic | Deep learningMid-level Full TimeTel Aviv, Israel, IL14h ago
-
ACM | API Development | API Gateway | AWS API | AWS API GatewaySenior-level ContractPretoria, South Africa14h ago
-
Senior Data Engineer INR 2000K-3000KAI integrations | API Integration | Automation workflows | Azure Data | Azure Data FactoryClient-facing work | Fast-paced environment | Independent ownershipSenior-level Full TimeBangalore North, India14h ago
-
Data Science INR 2000K-3300KAgentic AI | Apache Airflow | CrewAI | Data Architecture | Data PipelinesSenior-level Full TimeIN-MH-Pune15h ago
-
Data Engineer with Airflow INR 1500K-2400KAmazon Web Services | Apache Airflow | Data Visualization | Data Warehousing | DockerSenior-level Full TimeIN-AP-Hyderabad15h ago
-
Data Engineer- Airflow INR 1500K-2500KAmazon Web Services | Apache Airflow | Data Visualization | Data Warehousing | DockerSenior-level Full TimeIN-AP-Hyderabad15h ago
-
Data Engineer- Airflow INR 1500K-2500KAmazon Web Services | Apache Airflow | Data Visualization | Data Warehousing | DockerSenior-level Full TimeIN-AP-Hyderabad15h ago
-
Senior-level Full TimeIN-TN-Chennai15h ago