Lead Data Engineer
Tasks
- Automate data pipeline deployments
- Build data products
- Design data pipelines
- Develop ETL processes
- Ensure data governance and compliance
- Evaluate and recommend data tools
- Implement data quality validation
- Integrate data sources
- Manage PII
- Optimize spark performance
- Perform data modeling
- Set up monitoring and alerting
- Support data science and analytics teams
- Troubleshoot pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Airbyte | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Machine Learning | Azure Synapse | Azure Synapse Analytics | CI/CD | DBT | Data Contracts | Data Factory | Data Governance | Data Lineage | Data Management | Data Modeling | Data Quality | Data Validation | Databricks | Delta Lake | ETL | Fabric | Fivetran | GDPR | Kafka | Machine Learning | Monitoring and Alerting | PII data | PII data management | PySpark | Python | SQL | Schema Enforcement | Spark | Sqoop | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)26d ago
-
Senior-level Full TimePune City, India3h ago
-
A&R strategy | Analytics | Billing | Business Objects | CPTSenior-level Full TimeMaryland-Silver Spring4h ago
-
AI Engineer USD 141K-236KAzure OpenAI | Azure Security | Azure Security Center | Azure Synapse | DatabricksDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceSenior-level Full TimeUSA-DC-Washington4h ago
-
Senior-level Full TimeAU-NSW-Sydney4h ago
-
Senior Software Engineer – Data Strategy USD 160K-240KAPIs | Algorithms | Apache Flink | Apache Iceberg | Automation401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimeNew York4h ago
-
Pessoa Engenheira de MLOps SR BRL 20K-40KAPIs | Airflow | Apache Spark | Azure | Azure DataChildcare assistance | Dental insurance | Health insurance | Meal benefits | Mental health supportSenior-level Full TimeBelo Horizonte, MG, Brasil4h ago
-
340B | Billing Compliance | Business Intelligence | Business Objects | CPTSenior-level Full TimeMaryland-Silver Spring4h ago
-
AI Engineer – Reliability & Warranty Analytics INR 1800K-3000KBacktesting | BigQuery | CI/CD | Calibration | Cloud RunMid-level Full TimeChennai, Tamil Nadu, India4h ago
-
Cloud Engineer USD 128K-298KAWS | Active Directory | Audit Logging | Azure | Azure DevOpsFlexible-hybrid work | Monday to Friday schedule | Onsite or remote workSenior-level Full TimeFlexible Hybrid R4h ago
-
Cientista de Dados SR BRL 20K-40KCI/CD | DVC | Databricks | Flask | GitHubChildcare support | Dental care | Health care | Meal allowance | Mental health supportSenior-level Full TimeBelo Horizonte, MG, Brasil4h ago
-
Robotics Engineer II USD 88K-167KArtificial Intelligence | Automation engineering | Computer Vision | Control Systems | Control Theory401K Company Funding | Career development and training | Education assistance | Fitness reimbursement | Flexible work schedulesMid-level Full TimeUS-Louisiana-New Orleans4h ago
-
Machine Learning Engineer (Multiple Positions) USD 148K-300KAnalytics | Data Mining | Machine Learning | Machine Learning Infrastructure | Model EvaluationEntry-level Full TimeSeattle, Washington, United States4h ago
-
Distributed Systems | Machine Learning | Model Serving | Monitoring | Online InferenceSenior-level Full TimeSan Jose, California, United States4h ago
-
Senior Machine Learning Engineer - E-Commerce Supply Chain & Logistics (Multiple Positions) USD 224K-387KBig Data | Data Analysis | Deep learning | Experiment design | Feature EngineeringSenior-level Full TimeSan Jose, California, United States4h ago
-
Machine Learning Engineer (Multiple Positions) USD 174K-316KData pipeline | Deep learning | Machine Learning | Machine Learning Infrastructure | Model ServingMid-level Full TimeSan Jose, California, United States4h ago
-
Cross-layer Optimization | Diffusion Models | Distributed Systems | Distributed Training | Heterogeneous computingSenior-level Full TimeSan Jose, California, United States4h ago
-
AI Coding Subject Matter Expert BRL 192K-210KAI Agents | AWS | Application Security | CI/CD | JavaScriptReward & recognition | Volunteering | Wellness | Work-life balanceSenior-level Full TimeSão Carlos, SP, Brazil4h ago
-
Senior Machine Learning Engineer (Multiple Positions) USD 194K-355KBig Data | Data Modeling | Data Processing | Deep learning | Experiment designSenior-level Full TimeSan Jose, California, United States5h ago
-
Lead Machine Learning Engineer (Multiple Positions) USD 194K-355KAlgorithm Optimization | Code review | Data Pipelines | Infrastructure Optimization | MLOpsSenior-level Full TimeSan Jose, California, United States5h ago
-
Senior Machine Learning Engineer (Multiple Positions) USD 194K-355KA/B | A/B Testing | B testing | Data Analysis | Data PipelinesSenior-level Full TimeSan Jose, California, United States5h ago
-
Lead Machine Learning Engineer (Multiple Positions) USD 194K-355KAlgorithm Optimization | Code review | Data Pipelines | Infrastructure Optimization | Machine LearningSenior-level Full TimeSeattle, Washington, United States5h ago
-
Senior Machine Learning Engineer (Multiple Positions) USD 194K-355KApache Spark | Big Data | Data Preparation | Deep learning | Experiment designSenior-level Full TimeSeattle, Washington, United States5h ago
-
A/B | A/B Testing | B testing | Big Data | ClassifiersSenior-level Full TimeSan Jose, California, United States5h ago
-
Machine Learning Engineer (Multiple Positions) USD 145K-250KAnalytics | Classification | Data Mining | Machine Learning | Model EvaluationEntry-level Full TimeSeattle, Washington, United States5h ago