Data Engineering Lead (GCP, Bigquery, ETL, Prompt Engineering) Associate Director
Pune, Maharashtra, India
INR 1500K-2200K (estimate) Mid-level Full Time
Tasks
- Coach and develop data engineers
- Define data modelling approaches
- Define non-functional testing strategy
- Design batch and streaming pipelines
- Drive CI/CD and automated testing
- Drive FinOps cost optimization
- Ensure service resilience and recovery objectives
- Establish metadata strategy
- Implement data governance and lineage
- Implement orchestration and scheduling
- Lead ELT/ETL pipeline development
- Lead incident problem management
- Manage encryption access control and auditability
- Manage squad and vendor dependencies
- Optimize analytical query performance
- Own data platform architecture
- Perform code reviews and release governance
- Set up monitoring and alerting
- Track KPIs using DORA metrics
- Translate requirements into delivery plans
Perks/Benefits
Skills/Tech-stack
Access Control | Agile | Alerting | Apache Airflow | Auditability | Automated testing | BigQuery | By Design | CI/CD | Cloud Composer | Cloud KMS | Cloud Run | Cloud Storage | Cloud platform | Code review | DORA Metrics | Data Governance | Data Lineage | Data Quality | Data Vault | Dataflow | Dataproc | Dimensional Modelling | ELT | ETL | Encryption | FinOps | GKE | Google Cloud | Google Cloud Platform | IAM | Lakehouse | Monitoring | Privacy by Design | Private Cloud | PubSub | Release governance | Retention | Virtual Private Cloud
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Agile | BigQuery | CI/CD | Cloud Functions | Cloud RunContinuous professional development | Flexible workingMid-level Full TimeHyderabad, Telangana, India R14h ago
-
Assistant Director Data Analytics & Artificial Intelligence INR 4000K-5199KAdobe Analytics | Cloud platform | Data Governance | Data Modelling | Data QualityExecutive-level Full TimeBangalore, Karnataka, India R16h ago
-
Mid-level Full TimeSaidapet18h ago
-
Senior-level Full TimeBengaluru, Karnataka, India18h ago
-
Senior Software Engineer - Optimization Topics INR 2200K-3465KAWS | AWS QuickSight | Agile | Amazon CloudWatch | AngularSenior-level Full TimePune - Maharashtra - India18h ago
-
Data Engineer(Snowflake + DBT) - Sub-Contractor INR 2040K-3880KDBT | Data Modeling | Data Pipelines | ETL | SQLPaid Holidays | Paid time offSenior-level Contract Full TimeBangalore, KARNATAKA, India19h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India19h ago
-
Software Engineer INR 346K-346KAPI Testing | Agile | Airflow | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimePune, MH, India19h ago
-
Silicon Validation Engineer AI/ML, Google Cloud INR 2500K-4000KC++ | Cloud TPU | Co-design | Computer Architecture | Digital LogicMid-level Full TimeBengaluru, Karnataka, India20h ago
-
Entry-level Full TimePune, ASIA, India20h ago
-
Mid-level Full TimePune, Maharashtra, India21h ago
-
Senior-level Part TimeGurugram, Haryana, India21h ago
-
Manager, Data And Analytics INR 650K-1100KAmazon Redshift | Anomaly Detection | Azure | BigQuery | Business IntelligenceMid-level Full TimeBangalore, KA, IN, 56010321h ago
-
AES - DE - Generative AI Application Developers INR 2500K-5000K.NET | AI Agents | AI Foundry | AI guardrails | ASP.Net CoreSenior-level Full TimePune, Maharashtra, India21h ago
-
Data Integration Specialist INR 1500K-2600KAPI Integration | AWS | Apache Kafka | Azure | Azure DataSenior-level Full TimeBengaluru, IN, 56010322h ago
-
Lead Assistant Manager INR 1500K-2500KApache Airflow | BigQuery | Cloud Composer | Cloud Dataproc | Cloud StorageSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Lead Technical Consultant - Power BI Developer INR 2000K-4512KAI ethics | BI Data modeling | Conversational Analytics | Copilot | DAXHolidays | Paid time offSenior-level Full TimeIndia1d ago
-
Senior Cloud Engineer - AI-ML Platform INR 2500K-5000KAccess Control | Amazon Web Services | Apache Kafka | Azure DevOps | CloudFormationInclusion and belongingSenior-level Full TimeBangalore, Karnataka, IN, 5601001d ago
-
Software Engineer INR 2500K-4200KAI Large Language Models | AWS Glue | Access Management | Amazon Web Services | CloudFormationSenior-level Full TimeBangalore, Karnataka, IN, 5601001d ago
-
Agentic AI Platform Engineer INR 1900K-4000KA2A | API Security | Agent to Agent | Authentication | Azure DevOpsMid-level Full TimeBangalore, Karnataka, IN, 5601001d ago
-
Manager INR 1500K-2500KAcceptance Testing | Azure DevOps | BigQuery | Cloud Storage | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Quality Engineer INR 3000K-4000KAlerting | Apache Airflow | Apache Spark | Automated testing | Cause analysisChildcare services | Employee assistance program | Medical insurance | Paid time offSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Senior Technical Specialist - AWS/AWS Lambda/AWS Glue/AWS SNS INR 1400K-2600KAWS Glue | AWS Lambda | AWS Redshift | AWS SNS | AgileSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
AWS | Agile | Azure | CI/CD | Cloud platformFully remote | Professional growthSenior-level Full TimeIndia R1d ago
-
Lead Software Engineer - Machine Learning INR 5000K-6000KAPI Design | Data pipeline | Distributed Systems | MLOps | Machine LearningSenior-level Full TimeChennai, TN, India1d ago