Lead Data Engineer
Tasks
- Automate data pipeline deployments
- Build data products
- Design data pipelines
- Develop ETL processes
- Ensure data governance and compliance
- Evaluate and recommend data tools
- Implement data quality validation
- Integrate data sources
- Manage PII
- Optimize spark performance
- Perform data modeling
- Set up monitoring and alerting
- Support data science and analytics teams
- Troubleshoot pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Airbyte | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Machine Learning | Azure Synapse | Azure Synapse Analytics | CI/CD | DBT | Data Contracts | Data Factory | Data Governance | Data Lineage | Data Management | Data Modeling | Data Quality | Data Validation | Databricks | Delta Lake | ETL | Fabric | Fivetran | GDPR | Kafka | Machine Learning | Monitoring and Alerting | PII data | PII data management | PySpark | Python | SQL | Schema Enforcement | Spark | Sqoop | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Sr. DevOps Engineer INR 2500K-3500KAIOps | AKS | ARM | Azure Container | Azure Container RegistryRotational on-call supportSenior-level Full TimeHyderabad, India2h ago
-
Integrador de Dados SR BRL 118K-119KAWS CloudWatch | AWS IAM | AWS Lambda | Amazon EC2 | Amazon RDSCloud optimization focus | Remote workSenior-level Full TimeRemote R2h ago
-
Ruby on Rails Developer (AI Focused) USA GBP 70K-90KAPI Integration | Anthropic | Azure | CI/CD | Distributed SystemsIndependent contract environment | Remote workSenior-level ContractCambourne, United Kingdom of Great Britain …2h ago
-
Senior AI Engineer THB 2400K-3000KAI Observability | API Design | Asynchronous programming | Drift Detection | LLM EvaluationFlexible working hours | Free lunch | Health insurance | Hybrid working policy | International work environmentSenior-level Full TimeBangkok, Thailand2h ago
-
Lead Data Engineer – Azure Databricks USD 150K-180KARIMA | Azure Databricks | Data Processing | Data analytics | Machine LearningOnsite workSenior-level Full TimeTampa, United States3h ago
-
Apache Kafka | Apache Spark | BigQuery | Cloud Data | Cloud Data PlatformsFully remote work | Training and professional development initiativesSenior-level Full TimeRemote R3h ago
-
Associate Engineer, Data (FS) USD 119K-165KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure SQLLong-term work from home | Night shift schedule | Remote workMid-level Full TimeRemote R3h ago
-
API Integration | Agentic Workflows | Automation | CRM | Data cleaningMid-level Full TimePetaling Jaya, Malaysia3h ago
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai3h ago
-
Database Engineer INR 1500K-2500KAWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud DatabasesSenior-level Full TimeIN-TN-Chennai3h ago
-
Gen AI Developer INR 2000K-3000KAPI Integration | Claude API | Context Management | CrewAI | FastAPIMid-level Full TimeIN-MH-Pune3h ago
-
AWS | Analysis Services | Apache Airflow | Azure | Azure DataBuddy onboarding | Exclusive retail discounts | Extra days of leave | Flexible working arrangements | Hybrid working modelEntry-level Full TimeIoannina, Patras, Thessaloniki3h ago
-
HR Analytics & Technology Engineer USD 110K-204KAlteryx | Artificial Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Generous time off | Onsite fitness center | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence3h ago
-
Cause analysis | Cloud Computing | Data Enrichment | Data Monitoring | Data Processing401k match | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeNew York3h ago
-
Senior Data Engineer SEK 360K-450KAgile | Apache Spark | CI/CD | Databricks | GDPRCareer development | Diversity & inclusion initiatives | Inclusive work environment | Workplace flexibilitySenior-level Full TimeSolna, Stockholm County, Sweden4h ago
-
Deloitte Technology - US Associate GenAI Engineer USD 80K-100K.Net Core | AWS | Agile | Angular | AzureMid-level Full TimeHermitage, Tennessee, United States4h ago
-
Senior-level Full TimeDallas, Texas, United States4h ago
-
Lead Analyst - N360 Supplier Analytics GBP 43K-54KBusiness Intelligence | Classification | Clean rooms | Clustering | Data Clean RoomsAnnual holiday allowance | Buy additional holiday | Colleague discount | Cycle to work scheme | Employee assistance programmeSenior-level Full TimeLondon, London, United Kingdom4h ago
-
AI Agents | Artificial Intelligence | Generative AI | Language Models | Language ProcessingEntry-level Full TimeSingapore, Singapore4h ago
-
Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure MLSenior-level Full Timebengaluru, India5h ago
-
Artificial Intelligence | C++ | Colab | Data Structures | Data structures algorithmsSenior-level Full TimeZürich, Switzerland5h ago
-
As-a-Service | C++ | Cloud Functions | Cloud platform | Compute TechnologiesSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Staff Software Engineer, Android Embedded Software INR 2000K-3200KAndroid | C++ | Distributed Systems | Java | Performance optimizationSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Research Engineer, Gemini Latent Thinking, DeepMind USD 207K-300KAblation Study | Algorithm Development | Deep learning | Experiment design | Language ModelsSenior-level Full TimeCambridge, MA, USA; Mountain View, CA, …5h ago
-
Senior Forward Deployed Developer, Applied AI CAD 182K-187KBigQuery | C++ | CI/CD | Cloud Storage | Data ProcessingBonus | Equity | Health insurance | Paid time off | Professional developmentSenior-level Full TimeWaterloo, ON, Canada5h ago