Data Engineering Lead (GCP, Bigquery, ETL, Prompt Engineering) Associate Director
Tasks
- Conduct code reviews and release governance
- Define and track engineering KPI metrics
- Define metadata and governance strategy
- Design batch and streaming pipelines
- Develop and coach data engineers
- Drive continuous improvement and FinOps
- Ensure service resilience and recovery objectives
- Establish data modeling and performance optimization
- Implement orchestration scheduling and monitoring
- Lead ELT/ETL pipeline development
- Lead incident and problem management
- Leverage AI productivity tools for engineering
- Manage delivery dependencies and blockers
- Own data platform architecture
- Review non functional testing strategy
- Set engineering quality bars CI CD automated testing
Perks/Benefits
Skills/Tech-stack
Access Management | Agile | Alerting | Apache Airflow | Auditability | Automated testing | BigQuery | By Design | CI/CD | Cloud Composer | Cloud KMS | Cloud Run | Cloud Storage | Cloud platform | Code review | DORA Metrics | Data Governance | Data Lineage | Data Quality | Data Vault | Dataflow | Dataproc | Dimensional Modeling | ELT | ETL | Encryption | FinOps | Google Cloud | Google Cloud Platform | Google Cloud Storage | Google Kubernetes | Google Kubernetes Engine | Identity and Access Management | Identity and access | Incident Management | Kubernetes Engine | Lakehouse | Monitoring | Orchestration | Privacy by Design | Problem Management | PubSub | Release Management | Runbooks | VPC
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior Software Development Engineer INR 2500K-4000KAgile | Artificial Intelligence | CI/CD | Data Engineering | Data LakeSenior-level Full TimeIndia7h ago
-
Qualtrics/Tableau - Analytics - Associate INR 4000K-4000KAgile | CI/CD | Dashboard governance | Data Modeling | Data pipelineExecutive-level Full TimeBengaluru, Karnataka, India8h ago
-
Software Engineer -Snowflake Development INR 1000K-1500KAWS | Acceptance Testing | Agile | Azure | CSVFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeChennai, India9h ago
-
Senior Embedded DevOps Engineer INR 2000K-3000KBuild Tools | CI/CD | Change Management | Cloud Computing | Configuration ManagementSenior-level Full TimeBangalore, IN9h ago
-
AI/ML Architect INR 2500K-5000KAmazon Web Services | Anomaly Detection | Azure | Cloud platform | Data IngestionSenior-level Full TimeChennai, TN, India10h ago
-
Data Engineer INR 1500K-2500KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageMid-level Full TimeHyderabad, IN11h ago
-
Member of Technical Staff 4 INR 3242K-4580KAWS | Amazon Redshift | Azure Synapse | Azure Synapse Analytics | Backend architectureFlexible working arrangement | In-office 3 days per weekSenior-level Full TimeHyderabad, India11h ago
-
Senior Data Engineer, BizTech INR 3080K-4400KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch Data ProcessingSenior-level Full TimeBangalore, India12h ago
-
Dashboard & Analytics Lead INR 2475K-3900KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeNew Delhi, IN13h ago
-
Senior-level Full TimeIN-Pune14h ago
-
AI Agents | APIs | AWS | Application Modernization | AutomationCertification support | Employee Wellness Initiatives | Flexible work arrangements | Health insurance | Learning and developmentSenior-level Full TimeIndia14h ago
-
API Development | Access Control | CI/CD | MySQL | Next.jsSenior-level Full TimePAN India, KA, IN19h ago
-
Testing Engineering Specialist Advisor INR 2475K-3380K.NET | AI Search | AWS | Application Insights | AzureSenior-level Full TimeNoida, UP, IN R19h ago
-
AI Solutions Engineer - Mergers & Acquisitions PLN 14K-26KAPI Gateway | AWS ECS | AWS Lambda | Authentication | AuthorizationMid-level Full TimePune DIA, India19h ago
-
Data Engineer III INR 2800K-4000KAWS | AWS CDK | AWS Glue | AWS Glue Workflows | AWS KinesisAccident insurance | Casual leave | Compassionate leave | Employee assistance program | Flexible working arrangementSenior-level Full TimeIndia-Chennai (Ascendas Tech park)19h ago
-
Systems Integration Specialist Advisor_Storage Cloud INR 800K-1099KAWS | Access Control | Automation | Block Storage | CI/CDMid-level Full TimeBangalore, KA, IN R19h ago
-
EYP - DnA - Assistant Manager INR 1500K-2000KAlteryx | Analysis Services | Azure Analysis | Azure Analysis Services | Azure DataClient site travel | Coaching and mentoring | Continuous learning | Inclusive cultureMid-level Full TimeBengaluru, KA, IN, 56001619h ago
-
Entry-level Full TimeBangalore, KA, IN19h ago
-
Mid-level Full TimeBengaluru, BDC6F, India19h ago
-
Packaged/SaaS Application Engineer INR 1000K-2100KAI Search | AI Studio | API Development | API Management | AgileMid-level Full TimeHyderabad, HDC4A, India19h ago
-
Data Engineer INR 100K-1000KData Governance | Data Modeling | Data Pipelines | Data Quality | Data TransformationMid-level Full TimeGurugram, Haryana, India19h ago
-
DE-Azure Cognitive VA And AI Developer-GDSN02 INR 1500K-2800KAI Studio | API Integration | Access Control | Agile | AzureMid-level Full TimeCoimbatore, TN, IN, 64104919h ago
-
Mid-level Full TimeBengaluru, BDC9A, India19h ago
-
AI / ML Engineer INR 1000K-2100KAI Foundry | Azure AI Foundry | Azure Machine Learning | Azure OpenAI Service | CI/CDMid-level Full TimeHyderabad, HDC3B, India19h ago
-
AVP - Cloud Database Automation Engineer INR 2337K-3056KAWS RDS | Ansible | Auto Scaling | Cassandra | Cloud ConfigFlexible work hours | Work from homeExecutive-level Full TimeHyderabad IN, India R19h ago