Lead Data Engineer
Tasks
- Automate data pipeline deployments
- Build data products
- Design data pipelines
- Develop ETL processes
- Ensure data governance and compliance
- Evaluate and recommend data tools
- Implement data quality validation
- Integrate data sources
- Manage PII
- Optimize spark performance
- Perform data modeling
- Set up monitoring and alerting
- Support data science and analytics teams
- Troubleshoot pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Airbyte | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Machine Learning | Azure Synapse | Azure Synapse Analytics | CI/CD | DBT | Data Contracts | Data Factory | Data Governance | Data Lineage | Data Management | Data Modeling | Data Quality | Data Validation | Databricks | Delta Lake | ETL | Fabric | Fivetran | GDPR | Kafka | Machine Learning | Monitoring and Alerting | PII data | PII data management | PySpark | Python | SQL | Schema Enforcement | Spark | Sqoop | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)24d ago
-
Linguistic Engineer USD 103K-156KBias Mitigation | Ethical AI | Hack | Knowledge graphs | Machine LearningMid-level Full TimeRedmond, WA3h ago
-
Partner Engineer, Generative AI USD 159K-223KAWS | Agent Orchestration | Azure | Bias Mitigation | C++Senior-level Full TimeMenlo Park, CA3h ago
-
Staff Research Engineer, MRS AI USD 146K-208KA/B | A/B Testing | Alignment techniques | B testing | BenchmarkingSenior-level Full TimeBellevue, WA3h ago
-
AWS | Agentic AI | Azure | Cloud Computing | DevOpsCompany pension plan | Flexible working hours | Hybrid remote work | Mobility budget | Relocation supportSenior-level Full TimeFrankfurt am Main, Germany3h ago
-
Senior Software Engineer INR 1500K-2500KAccess Control | Agile | Anomaly Detection | Apache Spark | AzureSenior-level Full TimeBengaluru, KA, IN; Hyderabad, TS, IN3h ago
-
Mid-level Full TimeLondon, United Kingdom4h ago
-
Embedded Software Engineer GBP 45K-60KARM | Agile | Bare Metal | Bitbucket | CANAnnual bonus scheme | Bank holidays | Enhanced maternity pay | Enhanced paternity pay | Flexible working optionsMid-level Full TimeGuildford, United Kingdom5h ago
-
Consultant - AI Engineer with Claude INR 2000K-4800KAWS | Autogen | Azure | Cloud Computing | ContainerizationSenior-level Full TimeBangalore, Karnataka, India5h ago
-
Junior Data Engineer PLN 84K-119KAgile | Apache Spark | Azure | Data Cleansing | Data GovernanceAdditional paid leave | Ergonomic office | Group insurance | Health insurance | Hybrid workEntry-level Full TimeKatowice, PL, 40-2025h ago
-
Junior Data Engineer PLN 87K-109KAgile | Azure | Azure Data | Azure Data Services | Data CleansingAdditional paid time off | Commuting support | Company events | Discount on company products | Ergonomic officeEntry-level Full TimeKatowice, PL, 40-2025h ago
-
Software Engineering Specialist INR 355K-500KAPI Development | CI/CD | Data Engineering | Data Pipelines | Deep learningEntry-level Full TimeBengaluru, IN, 5601035h ago
-
Data Analytics Engineer (w/m/d) EUR 60K-79KAzure Synapse | Azure Synapse Analytics | Data Modeling | Data Pipelines | Data integration30 days annual leave | Company events | Company pension plan | Deutschlandticket discount | Employee developmentMid-level Full TimeHannover - An der Börse 45h ago
-
Lead AI Engineer PLN 309K-309KA/B | A/B Testing | AWS | Agentic Systems | AgileCompany car | Employer supported pension plan | Extra paid holidays | Flexible benefits | Home-office allowanceSenior-level Full TimeWarszawa, Mazowieckie, PL R5h ago
-
APIs | Automated testing | Azure OpenAI | CI/CD | Computer VisionSenior-level Full TimeCarnaxide, PT, 2790-0126h ago
-
(Sr) Cloud & Data Engineer CNY 192K-240KAWS | Automation | CI/CD | Container Security | Data ModelingMid-level Full TimeBeijing, Beijing, CN6h ago
-
Sr Specialist, Data Engineering INR 2400K-3380KApache Airflow | CI/CD | Cloud Build | Cloud Storage | Cloud platformRelocation assistance within countrySenior-level Full TimeMumbai, MH, IN6h ago
-
Sr Specialist, Data Engineering INR 2400K-3380KApache Airflow | CI/CD | Cloud Build | Cloud Storage | Cloud platformRelocation assistanceSenior-level Full TimeMumbai, MH, IN6h ago
-
C++ | CUDA | Deep learning | GDB | GPGPUHealth insurance | Language classes | On-the-job training | Paid time off | Pension fundEntry-level Full TimeGeneva, GENEVA, Switzerland7h ago
-
Python Developer with Gen AI INR 2000K-3500KAPI Development | Data Pipelines | Gemini Enterprise | Google ADK | Google VertexOnsite collaborationSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Databricks - Assistant Manager INR 2000K-2500KApache Spark | Data Modeling | Data Warehousing | Data pipeline | DatabricksSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Software Engineer INR 2000K-3300KAKS | Angular | App Services | Azure | Azure AppEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India7h ago
-
Data Engineer/Power BI PLN 258K-396KApache Airflow | Azure Data | Azure Data Factory | Data Factory | Data ModelingSenior-level Full TimeWarsaw, Poland8h ago
-
Mid-level Full TimeBangkok, Bangkok, Thailand8h ago
-
API Development | AWS | Airflow | Azure | Data ModelingCareer growth | Continuous learning | Flexible work environment | Inclusive culture | Professional developmentSenior-level Full TimeIndia8h ago