GCP, Airflow/CONSULTANT SPECIALIST
Pune, Maharashtra, India
R
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Architect data workflows with Apache Airflow
- Automate deployments with Terraform
- Build and optimize BigQuery data models
- Collaborate with stakeholders to deliver data products
- Develop ETL/ELT pipelines
- Ensure data governance and security
- Implement event driven data workflows on GCP
- Migrate services to GCP
- Monitor pipeline health and data quality
- Set up CI CD for data pipelines
- Troubleshoot pipeline failures
Perks/Benefits
Skills/Tech-stack
Access Control | Apache Airflow | Apache NiFi | Audit Logging | BigQuery | CI/CD | Cloud Composer | Cloud Dataflow | Cloud Functions | Cloud Monitoring | Cloud Storage | Cloud platform | Data Governance | Data Processing | DataStage | ETL | ETL Tools | Git | Google Cloud | Google Cloud Dataflow | Google Cloud Platform | Informatica | Kafka | PL/SQL | Pub/Sub | Python | Real Time | Real-time Data | Real-time Data Processing | SQL | Stackdriver | Terraform
Education
N/A
Roles
Cloud Data Engineer | Cloud) | Data Engineer | Developer | ETL Developer | Engineer
Related jobs
-
Associate Distinguished Engineer (Data Governance Framework, Data Catalog Implementation) INR 1300K-2000KBusiness glossary | Compliance | Data Architecture | Data Cataloging | Data ClassificationAwareness sessions | Continuous learning opportunities | Training programsMid-level Full TimeRemote, India R11h ago
-
GCP, Bigquery, Airflow/Consultant Specialist INR 1500K-2500KAgile | Airflow | Apache Kafka | Apache NiFi | BigQuerySenior-level Full TimeHyderabad, Telangana, India R11h ago
-
AWS SageMaker | Airflow | Amazon EC2 | Amazon EKS | Computer VisionContinuous learning and development | Flexible schedule | Fully remote | Mentorship opportunitiesMid-level Full TimeIndia R16h ago
-
API Development | Autogen | C# | C++ | Cloud PlatformsLong-term engagement | Paid Holidays | Remote work | Training and professional growthMid-level Full TimeIndia Gate, New Delhi, India - … R22h ago
-
Principal Data Engineer INR 3740K-5876KAirflow | Amazon Athena | Amazon EMR | Amazon Redshift | Apache FlinkHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R22h ago
-
Senior Data Engineer INR 3715K-5449KAirflow | Batch Processing | Bitbucket | CICD | Data LakesHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R22h ago
-
Senior Data Engineer INR 3715K-5449KAirflow | Batch Processing | Bitbucket | CICD | Data LakeHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R22h ago
-
Databricks Data Engineer - Bengaluru INR 1500K-2500KAWS Glue | Alation | Amazon Athena | Amazon EMR | Amazon S3Career growth opportunities | Flexible schedule | Work from anywhereMid-level Full TimeIndia-Bangalore-Office-Kalyani Vista R22h ago
-
Azure Bicep | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data FactoryCareer development | Inclusive culture | Technical trainingSenior-level Full TimeIND-Hyderabad-Hybrid, India R22h ago
-
AI workflows | API Integration | Big Data | Big Data Technologies | Cloud ComputingFlexible work environment | Hybrid work | Professional development opportunities | Supportive leadershipSenior-level Full TimeMumbai - Hiranandani, India R22h ago
-
Power BI Developer INR 1628K-2700KAzure Synapse | BI Desktop | BigQuery | DAX | Data GovernanceHealth insurance | Hybrid work model | Life insurance | Paid time off | Pension/retirement benefitsSenior-level Full TimeHyderabad, India R1d ago
-
Associate AI-ML Engineer INR 3200K-4500KCI/CD | CrewAI | Databases | Docker | Generative AILearning and growth | Mentorship | Mentorship from technology leadersMid-level Full TimeBengaluru East, Karnataka, India R1d ago
-
AI Engineer II (Remote) USD 39K-72KAPIs | AWS | CI/CD | Data workflows | Distributed SystemsFull-time employment | Remote workMid-level Full TimeIndia, Remote R1d ago
-
Data Warehouse, ETL, Cloud / Consultant Specialist INR 3000K-4000KAWS | Agile | Ansible | Cloud platform | Confluent KafkaFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimePune, Maharashtra, India R1d ago
-
Associate AI-ML Engineer INR 3200K-4500KCI/CD | CrewAI | Data Preparation | Databases | DockerCareer growth opportunities | MentorshipMid-level Full TimeBengaluru South, Karnataka, India R1d ago
-
Python Developer (Data Eng.) INR 1500K-2200KAWS | Dashboards | Data Engineering | Data Monitoring | Data PipelinesCommunity volunteering | Financial advisory services | Health insurance | Holidays | Learning and developmentMid-level Full TimeBangalore R1d ago
-
GCP, Digital Analytics, Bigquery/Senior Consultant Specialist INR 2500K-3900KAttribution Modeling | Batch Processing | BigQuery | Cloud platform | Customer AnalyticsCareer growth | Flexible working | Inclusive workplace | Opportunities for professional developmentSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
GCP Data Engineer- Senior Consultant INR 1500K-2500KAirflow | Apache Spark | BigQuery | Cloud Functions | Cloud Storage100 percent remote | Autonomy | Buddy from day 1 | Certificate training programs | Community webinarsSenior-level Full TimeIndia R1d ago
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R1d ago
-
Agile | C# | C++ | CI/CD | Case designDisability programs | Flexible working hours | Life insurance | Private medical care | Remote workSenior-level Full TimeIN-KA-BANGALORE-NEON BUILDING WEST TOWER, India R1d ago
-
Sr. Computer Scientist (Data Platform Engineer) INR 3264K-4200KAerospike | Algorithms | Amazon Web Services | Apache Spark | CassandraSenior-level Full TimeBangalore, India R1d ago
-
Senior-level Full TimeBangalore, India R1d ago
-
Power BI Developer – Healthcare INR 1632K-2443KAzure | Business Intelligence | DAX | Data Modeling | Data WarehousingSenior-level Full TimeIND - Remote, India R1d ago
-
Senior Software Engineer (India) INR 3500K-5000KAWS | AWS CDK | Async API | Asyncio | AuthenticationRemote work | Work from homeSenior-level Full TimeIndia - Remote R1d ago
-
Artificial Intelligence | Backend integration | Embeddings | Entity Extraction | EvaluationFlexible time off | Healthcare | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeHA4 - DLF Building Tower B, … R1d ago