GCP, Airflow, Bigquery/Senior Consultant Specialist
Pune, Maharashtra, India
R
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Architect end to end data workflows with Apache Airflow
- Automate deployment and versioning with Terraform and Git
- Build and optimize BigQuery data models
- Build event driven data workflows with GCP services
- Build monitoring for pipeline health and data quality
- Collaborate with data analysts, data scientists, and business teams
- Design and develop scalable data pipelines
- Develop and maintain ETL/ELT pipelines
- Ensure data governance access control and audit logging
- Implement CI/CD for data pipelines
- Implement partitioning, clustering, and materialized views
- Migrate and re engineer services to GCP
- Troubleshoot pipeline failures
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache NiFi | CI/CD | Cloud Composer | Cloud Dataflow | Cloud Functions | Cloud Monitoring | Cloud Storage | Cloud platform | Data Warehousing | ELT | ETL | Git | Google BigQuery | Google Cloud | Google Cloud Dataflow | Google Cloud Platform | Informatica | Kafka | PL/SQL | Pub/Sub | Python | Stackdriver | Terraform
Education
N/A
Related jobs
-
Engineering Lead,Microservices,Java Springboot /Sr. Associate Director, Technology Management INR 1500K-2400KApache Airflow | Apache Beam | Apache Flink | BigQuery | Cloud StorageMid-level Full TimePune, Maharashtra, India R6h ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API first | API-first design | Access Control | Agent OrchestrationSenior-level Full TimeRemote, India R11h ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API Design | Access Control | Artificial Intelligence | Batch inferenceSenior-level Full TimeRemote, India R11h ago
-
GCP, Airflow/CONSULTANT SPECIALIST INR 1500K-2500KAccess Control | Apache Airflow | Audit Logging | CI/CD | Cloud ComposerContinuous professional development | Flexible workingSenior-level Full TimePune, Maharashtra, India R14h ago
-
Manager , Decision Systems Data INR 700K-1200KAgile | Apache Airflow | BigQuery | Bigtable | CI/CDCareer development | Supportive work environmentMid-level Full TimeBangalore, Karnataka, India R17h ago
-
Principal Engineer, Sitecore Architect (Optimizely) INR 4000K-6500KA/B | A/B Testing | A/B Testing Tools | ASP.NET MVC | ASP.Net CoreSenior-level Full TimeRemote, India R18h ago
-
Senior-level Full TimeBangalore, India R23h ago
-
Principal Data Engineer INR 2500K-4200KAnnotation Pipeline | Azure | CI/CD | Cloud Data | Cloud Data EngineeringSenior-level Full TimeRemote (India) R1d ago
-
Lead Performance Engineer INR 3584K-5000KAWS | Agile | Apache JMeter | Azure | CI/CDFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsSenior-level Full TimeHyderabad, India R1d ago
-
AKS | AWS | ArangoDB | Authentication | AzureFully remoteMid-level Full TimeIndia R1d ago
-
Senior Software Engineer, (Python, GenAI, MCP) INR 3080K-4400KAPIs | AWS | Data Streaming | Databases | DockerSenior-level Full TimeRemote - Bangalore, India R1d ago
-
Senior Data Engineer PHP 384K-456KAPI Gateway | API Integration | AWS | AWS QuickSight | BoxBonuses | Ongoing education and training | Unlimited vacationSenior-level Full TimeManila, PH / Mumbai, IN - … R1d ago
-
Senior Data Engineer INR 3600K-4580KApache Airflow | Batch Processing | Billing integration | CRM Integration | DBTCommunity involvement | Employee wellbeing programs | Hybrid work | Remote work | Work-life balanceSenior-level Full TimeRemote (IND), India R1d ago
-
AWS | Autogen | Embedding Models | GenAI | GoSenior-level Full TimeBangalore - Carina, India R1d ago
-
Data Engineer INR 3000K-4200KAWS | AWS Glue | Amazon Athena | Amazon S3 | Apache AirflowFlexible location | Remote workSenior-level ContractIndia - Remote R1d ago
-
Senior-level Full TimeBangalore, India R1d ago
-
Principal Data Engineer / Architect - Individual Contributor INR 3200K-4580KAI Agent framework | AWS | Agent Framework | Airbyte | AlertingSenior-level Full TimeBangalore, INDIA R2d ago
-
Senior Analytics Engineer (Contract) INR 3600K-5400KAmazon Redshift | Apache Airflow | CI/CD | DBT | DagsterSenior-level ContractIndia - Remote R2d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Databricks | Distributed SystemsHybrid work model | Learning and development programs | Mentorship and coaching | Remote workSenior-level Full TimeBangalore, India R2d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Cloud platform | DatabricksHybrid work model | Learning and development programs | Mentoring and coaching culture | Remote work opportunitySenior-level Full TimeBangalore, India R2d ago
-
Ansible, Jira, Confluence, Hadoop / Consultant Specialist INR 800K-1700KAmazon S3 | Ansible | CI/CD | Confluence | DevSecOpsContinuous professional development | Flexible working | Inclusive work environment | Opportunities to growMid-level Full TimeHyderabad, Telangana, India R2d ago
-
Senior Consultant Specialist INR 3000K-5000KAWS | Apache Spark | Artificial Intelligence | Cloud platform | Data LakesSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
Data Engineer - Global Team (India) INR 1500K-2500KApache Spark | Data Modeling | Databricks | Delta Lake | ETLLearning reimbursement | Parental leave | Team events | Vacation timeMid-level Full TimeIndia Remote R2d ago
-
Airflow | Apache Beam | Apache Flink | BigQuery | CI/CDCareer development | Flexible working | Inclusive work environmentMid-level Full TimePune, Maharashtra, India R2d ago
-
API Design | AWS | Amazon SageMaker | Automated retraining | CI/CDAutonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional developmentSenior-level Full TimeIndia R2d ago