Lead Data Engineer
Tasks
- Automate data pipeline deployments
- Build data products
- Design data pipelines
- Develop ETL processes
- Ensure data governance and compliance
- Evaluate and recommend data tools
- Implement data quality validation
- Integrate data sources
- Manage PII
- Optimize spark performance
- Perform data modeling
- Set up monitoring and alerting
- Support data science and analytics teams
- Troubleshoot pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
Airbyte | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | Azure Machine Learning | Azure Synapse | Azure Synapse Analytics | CI/CD | DBT | Data Contracts | Data Factory | Data Governance | Data Lineage | Data Management | Data Modeling | Data Quality | Data Validation | Databricks | Delta Lake | ETL | Fabric | Fivetran | GDPR | Kafka | Machine Learning | Monitoring and Alerting | PII data | PII data management | PySpark | Python | SQL | Schema Enforcement | Spark | Sqoop | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)24d ago
-
APIs | Azure Data | Azure Data Explorer | Azure Data Factory | Azure DevOpsOnsite workMid-level Full TimeSingapore, Singapore1h ago
-
AI Search | Agile | Angular | Azure AI | Azure AI Search100 percent onsite | Public trust clearance requiredSenior-level ContractWoodlawn, United States1h ago
-
Senior Data Engineer USD 146K-190KAWS Glue | AWS IAM | AWS Redshift | AWS S3 | AirflowInternational conference attendance | Market exposure | Nontechnical training | Nursery reimbursement | Remote workSenior-level Full TimeRemote R2h ago
-
Mid-level Full TimeHyderabad, India2h ago
-
Entry-level Full TimeMaharashtra, Pune, India2h ago
-
Senior Software Engineer - DevOps & Data Engineering USD 140K-190KAgentic Workflows | Automation | CI/CD | Claude | Cloud infrastructureSenior-level ContractChandler, United States2h ago
-
Engenheiro de Dados Pl BRL 21K-24KAPIs | AWS | Agile | Apache Airflow | Apache HadoopGympass | Health insurance | Life insurance | Meal allowance | Transportation allowanceEntry-level Full TimeRio de Janeiro, Brasil2h ago
-
APIs | Agile | Data Modeling | Data Pipelines | Data WarehouseCollaborative culture | Fully remote | High-performance engineering culture | Work from anywhere in Philippines | Work on scalable systemsSenior-level ContractAnywhere in the Philippines, Philippines R2h ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure DevOpsSenior-level ContractToronto, Canada2h ago
-
Azure Databricks Developer USD 125K-198KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeLouisville, Kentucky, United States3h ago
-
Entry-level Full TimeUS-Kansas-Wichita3h ago
-
Senior-level Full TimeIN-KA-Bangalore3h ago
-
Mid-level Full TimeIN-AP-Hyderabad3h ago
-
Data Engineer (PySpark, Database, Python) INR 1500K-2200KAb Initio | CI/CD | Data Governance | DynamoDB | HadoopMid-level Full TimeIN-TN-Chennai3h ago
-
Gen AI INR 1800K-2800KAI Services | AI Studio | Azure AI | Azure AI Services | Azure AI StudioHybrid workMid-level Full TimeIN-AP-Hyderabad3h ago
-
Pyspark Developer INR 2000K-2700KAWS | Apache Flink | Apache Hadoop | Data Modeling | Data analyticsSenior-level Full TimeIN-TN-Chennai3h ago
-
Pyspark Developer INR 2000K-2700KAWS | Apache Flink | Apache Hadoop | Data Modeling | Data analyticsSenior-level Full TimeIN-TN-Chennai3h ago
-
Senior Data Engineer GBP 53K-70KAgile | Apache Airflow | BigQuery | CI/CD | Cloud ComposerBirthday off | Cycle2Work | Dental insurance | Discounts on broadband TV mobile | Electric vehicle leaseSenior-level Full TimeLondon3h ago
-
Mid-level Full TimeUS-Kansas-Wichita3h ago
-
Data Engineer II USD 101K-176KAWS | Agile | Airflow | Azure | Azure DevOps401k matching | Health & dental insurance | Onsite fitness center | Time off | Tuition reimbursementSenior-level Full TimeUS-Rhode Island-Providence3h ago
-
C++ | Cloud Native | Container Orchestration | Deep learning | Distributed SystemsCareer growth | Open Source contribution | World Class CollaborationEntry-level Full TimeSan Jose, California, United States3h ago
-
Computer Vision | Deep learning | Information Retrieval | Language Processing | Machine LearningEntry-level Full TimeSingapore, Singapore3h ago
-
Head of AI Transformation GBP 85K-209KArtificial Intelligence | Automation | Change Management | Data Mapping | Enterprise transformationExecutive-level Full TimeLondon3h ago
-
Data Warehouse Engineer INR 3000K-4000KAPI Integration | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsAccreditations | Annual excellence awards | Bike to work | Career development program | Educational assistanceSenior-level Full TimeNoida, UP, India3h ago