GCP, Airflow, Bigquery / Consultant Specialist
Pune, Maharashtra, India
R
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Automate operational workflows
- Build Apache Beam pipelines
- Design ETL/ELT pipelines
- Enforce data quality consistency and governance
- Ensure SLA/SLO adherence
- Gather requirements with stakeholders
- Implement monitoring and alerting
- Ingest data into GCP
- Integrate data from databases, APIs, and flat files
- Lead reliability strategy and incident response
- Maintain documentation and compliance
- Optimize BigQuery and Cloud Storage
- Orchestrate workflows with Airflow
- Perform RCA and post mortems
- Troubleshoot data pipeline bottlenecks
Perks/Benefits
Skills/Tech-stack
Alerting | Apache Airflow | Apache Beam | Apache Flink | Apache Spark | BigQuery | Cause analysis | Cloud Composer | Cloud Storage | Cloud platform | DBT | DevOps | GCP Dataflow | Google Cloud | Google Cloud Platform | HBase | Hadoop | Hive | Incident Management | Java | Kafka | Monitoring | Python | Root Cause Analysis | Root cause | SQL | SRE
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Related jobs
-
Engineering Lead,Microservices,Java Springboot /Sr. Associate Director, Technology Management INR 1500K-2400KApache Airflow | Apache Beam | Apache Flink | BigQuery | Cloud StorageMid-level Full TimePune, Maharashtra, India R7h ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API first | API-first design | Access Control | Agent OrchestrationSenior-level Full TimeRemote, India R11h ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API Design | Access Control | Artificial Intelligence | Batch inferenceSenior-level Full TimeRemote, India R11h ago
-
GCP, Airflow/CONSULTANT SPECIALIST INR 1500K-2500KAccess Control | Apache Airflow | Audit Logging | CI/CD | Cloud ComposerContinuous professional development | Flexible workingSenior-level Full TimePune, Maharashtra, India R15h ago
-
GCP, Airflow, Bigquery/Senior Consultant Specialist INR 1500K-2500KApache Airflow | Apache NiFi | CI/CD | Cloud Composer | Cloud DataflowContinuous professional development | Flexible workingSenior-level Full TimePune, Maharashtra, India R16h ago
-
Manager , Decision Systems Data INR 700K-1200KAgile | Apache Airflow | BigQuery | Bigtable | CI/CDCareer development | Supportive work environmentMid-level Full TimeBangalore, Karnataka, India R18h ago
-
Principal Engineer, Sitecore Architect (Optimizely) INR 4000K-6500KA/B | A/B Testing | A/B Testing Tools | ASP.NET MVC | ASP.Net CoreSenior-level Full TimeRemote, India R18h ago
-
Senior-level Full TimeBangalore, India R23h ago
-
Principal Data Engineer INR 2500K-4200KAnnotation Pipeline | Azure | CI/CD | Cloud Data | Cloud Data EngineeringSenior-level Full TimeRemote (India) R1d ago
-
Lead Performance Engineer INR 3584K-5000KAWS | Agile | Apache JMeter | Azure | CI/CDFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsSenior-level Full TimeHyderabad, India R1d ago
-
AKS | AWS | ArangoDB | Authentication | AzureFully remoteMid-level Full TimeIndia R1d ago
-
Sub Value Stream Technology Delivery Lead/Senior Associate Director, Data and Analytics INR 700K-2000KAgile methodologies | CI/CD | Cloud platform | Data Engineering | Data QualityMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior Software Engineer, (Python, GenAI, MCP) INR 3080K-4400KAPIs | AWS | Data Streaming | Databases | DockerSenior-level Full TimeRemote - Bangalore, India R1d ago
-
Senior Data Engineer PHP 384K-456KAPI Gateway | API Integration | AWS | AWS QuickSight | BoxBonuses | Ongoing education and training | Unlimited vacationSenior-level Full TimeManila, PH / Mumbai, IN - … R1d ago
-
Director, Data Architecture/Engineering INR 3600K-5000KAPI Integration | Agile | Automated testing | CI/CD | Container OrchestrationComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Tuition reimbursementSenior-level Full TimeM11 - Commers III, 43, 44 … R1d ago
-
Senior Data Engineer INR 3600K-4580KApache Airflow | Batch Processing | Billing integration | CRM Integration | DBTCommunity involvement | Employee wellbeing programs | Hybrid work | Remote work | Work-life balanceSenior-level Full TimeRemote (IND), India R1d ago
-
AWS | Autogen | Embedding Models | GenAI | GoSenior-level Full TimeBangalore - Carina, India R1d ago
-
Data Engineer INR 3000K-4200KAWS | AWS Glue | Amazon Athena | Amazon S3 | Apache AirflowFlexible location | Remote workSenior-level ContractIndia - Remote R1d ago
-
Senior-level Full TimeBangalore, India R1d ago
-
Principal Data Engineer / Architect - Individual Contributor INR 3200K-4580KAI Agent framework | AWS | Agent Framework | Airbyte | AlertingSenior-level Full TimeBangalore, INDIA R2d ago
-
Senior Analytics Engineer (Contract) INR 3600K-5400KAmazon Redshift | Apache Airflow | CI/CD | DBT | DagsterSenior-level ContractIndia - Remote R2d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Databricks | Distributed SystemsHybrid work model | Learning and development programs | Mentorship and coaching | Remote workSenior-level Full TimeBangalore, India R2d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Cloud platform | DatabricksHybrid work model | Learning and development programs | Mentoring and coaching culture | Remote work opportunitySenior-level Full TimeBangalore, India R2d ago
-
Ansible, Jira, Confluence, Hadoop / Consultant Specialist INR 800K-1700KAmazon S3 | Ansible | CI/CD | Confluence | DevSecOpsContinuous professional development | Flexible working | Inclusive work environment | Opportunities to growMid-level Full TimeHyderabad, Telangana, India R2d ago
-
Senior Consultant Specialist INR 3000K-5000KAWS | Apache Spark | Artificial Intelligence | Cloud platform | Data LakesSenior-level Full TimeBangalore, Karnataka, India R2d ago