Lead Data Engineer
Tasks
- Automate data pipeline deployments
- Build data products
- Design data pipelines
- Develop ETL processes
- Ensure data governance and compliance
- Evaluate and recommend data tools
- Implement data quality validation
- Integrate data sources
- Manage PII
- Optimize spark performance
- Perform data modeling
- Set up monitoring and alerting
- Support data science and analytics teams
- Troubleshoot pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Airbyte | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Machine Learning | Azure Synapse | Azure Synapse Analytics | CI/CD | DBT | Data Contracts | Data Factory | Data Governance | Data Lineage | Data Management | Data Modeling | Data Quality | Data Validation | Databricks | Delta Lake | ETL | Fabric | Fivetran | GDPR | Kafka | Machine Learning | Monitoring and Alerting | PII data | PII data management | PySpark | Python | SQL | Schema Enforcement | Spark | Sqoop | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Senior AI Engineer THB 2400K-3000KAI Observability | API Design | Asynchronous programming | Drift Detection | LLM EvaluationFlexible working hours | Free lunch | Health insurance | Hybrid working policy | International work environmentSenior-level Full TimeBangkok, Thailand1h ago
-
Lead Data Engineer – Azure Databricks USD 150K-180KARIMA | Azure Databricks | Data Processing | Data analytics | Machine LearningOnsite workSenior-level Full TimeTampa, United States2h ago
-
Apache Kafka | Apache Spark | BigQuery | Cloud Data | Cloud Data PlatformsFully remote work | Training and professional development initiativesSenior-level Full TimeRemote R2h ago
-
Gen AI Developer INR 2000K-3000KAPI Integration | Claude API | Context Management | CrewAI | FastAPIMid-level Full TimeIN-MH-Pune2h ago
-
AWS | Analysis Services | Apache Airflow | Azure | Azure DataBuddy onboarding | Exclusive retail discounts | Extra days of leave | Flexible working arrangements | Hybrid working modelEntry-level Full TimeIoannina, Patras, Thessaloniki2h ago
-
HR Analytics & Technology Engineer USD 110K-204KAlteryx | Artificial Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Generous time off | Onsite fitness center | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence2h ago
-
Cause analysis | Cloud Computing | Data Enrichment | Data Monitoring | Data Processing401k match | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeNew York2h ago
-
Senior Data Engineer SEK 360K-450KAgile | Apache Spark | CI/CD | Databricks | GDPRCareer development | Diversity & inclusion initiatives | Inclusive work environment | Workplace flexibilitySenior-level Full TimeSolna, Stockholm County, Sweden3h ago
-
Deloitte Technology - US Associate GenAI Engineer USD 80K-100K.Net Core | AWS | Agile | Angular | AzureMid-level Full TimeHermitage, Tennessee, United States3h ago
-
Senior-level Full TimeDallas, Texas, United States3h ago
-
Lead Analyst - N360 Supplier Analytics GBP 43K-54KBusiness Intelligence | Classification | Clean rooms | Clustering | Data Clean RoomsAnnual holiday allowance | Buy additional holiday | Colleague discount | Cycle to work scheme | Employee assistance programmeSenior-level Full TimeLondon, London, United Kingdom3h ago
-
Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure MLSenior-level Full Timebengaluru, India4h ago
-
Artificial Intelligence | C++ | Colab | Data Structures | Data structures algorithmsSenior-level Full TimeZürich, Switzerland4h ago
-
As-a-Service | C++ | Cloud Functions | Cloud platform | Compute TechnologiesSenior-level Full TimeSunnyvale, CA, USA4h ago
-
Staff Software Engineer, Android Embedded Software INR 2000K-3200KAndroid | C++ | Distributed Systems | Java | Performance optimizationSenior-level Full TimeBengaluru, Karnataka, India4h ago
-
Research Engineer, Gemini Latent Thinking, DeepMind USD 207K-300KAblation Study | Algorithm Development | Deep learning | Experiment design | Language ModelsSenior-level Full TimeCambridge, MA, USA; Mountain View, CA, …4h ago
-
Senior Forward Deployed Developer, Applied AI CAD 182K-187KBigQuery | C++ | CI/CD | Cloud Storage | Data ProcessingBonus | Equity | Health insurance | Paid time off | Professional developmentSenior-level Full TimeWaterloo, ON, Canada4h ago
-
Continuous Learning | Deep Neural Networks | Few-Shot Learning | Few-shot | Generative AIMid-level Full TimeZürich, Switzerland4h ago
-
Manufacturing Test Engineer, Data Center USD 120K-172KBSCAN | Bash | Bring-up | Calibration | Correlation studyMid-level Full TimeAtlanta, GA, USA4h ago
-
Software Engineer, Compiling, Quantum AI USD 147K-211KC++ | Classical coding theory | Coding theory | Compiler architecture | CompilersMid-level Full TimeMountain View, CA, USA; Los Angeles, …4h ago
-
Research Scientist, Robotics, Embodied AI, DeepMind USD 147K-211KDeep learning | Language Models | Machine Learning | Python | Reinforcement LearningSenior-level Full TimeMountain View, CA, USA4h ago
-
Adversarial Machine Learning | C# | C++ | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeZürich, Switzerland4h ago
-
Software Engineer, Decoding, Quantum AI USD 147K-211KC++ | Concurrency | Device Driver Development | Device driver | Driver DevelopmentMid-level Full TimeLos Angeles, CA, USA; Goleta, CA, …4h ago
-
Research Scientist, Biomedical AI, DeepMind USD 147K-211KArtificial Intelligence | Benchmarking | Computational pipeline | Data Analysis | EvaluationMid-level Full TimeMountain View, CA, USA4h ago
-
Research Engineer, Frontier Safety Mitigations, DeepMind GBP 225K-300KAI Coding Agents | AI coding | Adversarial Machine Learning | Anomaly Detection | Coding AgentsMid-level Full TimeLondon, UK4h ago