Lead Data Engineer
Tasks
- Advise on distributed storage and computing technologies
- Collaborate with data scientists on scalable implementations
- Define project scope and goals
- Deploy support and operate data pipelines with continuous delivery
- Design modern data architecture
- Develop and operate data processing pipelines
- Ensure on time delivery with cross team collaboration
- Implement data governance
- Implement data models
- Implement data privacy
- Implement data security
- Incorporate data quality into daily work
- Lead data engineering projects from inception to completion
- Write tests using test driven development
Perks/Benefits
Skills/Tech-stack
Cloud platform | Continuous Delivery | Data Architecture | Data Engineering | Data Governance | Data Lake | Data Modeling | Data Privacy | Data Processing | Data Processing Pipelines | Data Quality | Data Security | Distributed Systems | GCP Cloud | Google Cloud | Google Cloud Platform | NoSQL | Processing pipelines | SQL | Test-Driven | Test-Driven Development
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Cloud Engineer - AI-ML Platform INR 2500K-5000KAccess Control | Amazon Web Services | Apache Kafka | Azure DevOps | CloudFormationInclusion and belongingSenior-level Full TimeBangalore, Karnataka, IN, 56010015h ago
-
Data Quality Engineer INR 3000K-4000KAlerting | Apache Airflow | Apache Spark | Automated testing | Cause analysisChildcare services | Employee assistance program | Medical insurance | Paid time offSenior-level Full TimeBangalore, Karnataka, India16h ago
-
AI Assisted Development | Algorithms | Amazon S3 | Apache Iceberg | Cloud ComputingFlexible work schedule | Remote work optionsSenior-level Full TimeHyderabad, India R16h ago
-
Senior Consultant_Python, Java AI / ML Engineer INR 2500K-4500KAPI Gateway | AWS | AgentCore) | Amazon Bedrock | AngularSenior-level Full TimeHyderabad, IN, 500081 R17h ago
-
AWS | Agile | Azure | CI/CD | Cloud platformFully remote | Professional growthSenior-level Full TimeIndia R17h ago
-
Lead Software Engineer - Machine Learning INR 5000K-6000KAPI Design | Data pipeline | Distributed Systems | MLOps | Machine LearningSenior-level Full TimeChennai, TN, India17h ago
-
Senior-level Full TimeHyderabad, IND-TG, India20h ago
-
Analytics Engineer INR 1500K-2500KAzure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryMid-level Full TimeMumbai Central Avenue, India22h ago
-
Data Engineering INR 1500K-2500KAI Search | Access Control | Amazon Redshift | Anomaly Detection | Audit LoggingSenior-level Full TimeBangalore, IN22h ago
-
Senior Software Engineer- Python, Data Engineer INR 1753K-3380KAWS | Agile | Analytics engines | Azure | Azure DevOpsContinuing education program | Continuous learning | Family-friendly perks | Generous time off | Health care coverageSenior-level Full TimeIN - AHMEDABAD, India22h ago
-
Data Engineer INR 1500K-2100KAWS | Agile | Apache Airflow | CI/CD | Data GovernanceHybrid work environment | Work-life flexibilityMid-level Full TimeBengaluru, India R22h ago
-
MTS-2 Machine Learning Engineer INR 3600K-5400KAWS | Apache Flink | Apache Hadoop | Apache Spark | Big DataSenior-level Full TimeBangalore, India22h ago
-
Access Control | Agile Development | Data Ingestion | Data Transformation | Dataset ManagementHybrid work model | Production Release SupportSenior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …22h ago
-
EAI Software Engineer INR 1800K-2800KAPI Gateway | ArgoCD | CI/CD | Cloud Functions | Cloud RunOn-site work 4 days a week | Relocation support (if applicable)Mid-level Full TimeHyderabad, India1d ago
-
Forward Deployed Engineer, Data & AI INR 2000K-2800KCortex Code | Data Engineering | Databricks | ETL | GeminiMid-level Full TimeBangalore1d ago
-
Senior Python Data Engineer INR 3000K-4000KAWS | Apache Airflow | Automated testing | Azure | CI/CDCertification programs | Health insurance | Internal mobility | Internship opportunities | Language coursesSenior-level Full TimeAll Cities, India R1d ago
-
ABAC | Airflow | Audit Logging | BigQuery | CDCFlexible working | Professional developmentMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior-level Full TimeHyderabad, India1d ago
-
Data Engineer II INR 2000K-3000KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamCareer growth opportunities | Complimentary games | Family Leaves | Healthcare coverage | Mental well-being supportSenior-level Full TimeLocations: Hyderabad, Telangana, India1d ago
-
Data Engineer INR 1500K-2500KDashboards | Data Engineering | Incident Management | Information security | ReportingSenior-level Full TimeGurugram, Haryana, India1d ago
-
Senior Software Engineer, AI/ML, Google Cloud INR 2500K-5000KC plus plus | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Principal Silicon Engineer - Storage INR 1163K-3500KAmazon S3 | Azure Blob | Azure Blob Storage | Azure Files | Backup and RecoverySenior-level Full TimeIndia1d ago
-
Lead Software Engineer Java INR 3000K-4500KAI code assistants | AWS | Agile | Apache Spark | Application ResiliencySenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Informatica / Data warehousing Engineer INR 2700K-4000KAgile | BigQuery | Dashboard Design | Dashboard Development | Data GovernanceSenior-level Full TimeIndia1d ago
-
Informatica / Data warehousing Engineer INR 2771K-4000KAccess Controls | Agile | BigQuery | Cloud Storage | Cloud platformSenior-level Full TimeIndia1d ago