GCP, Airflow/CONSULTANT SPECIALIST
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Automate deployment with Terraform
- Build and optimize data models in BigQuery
- Collaborate with Data Science and Business teams
- Design scalable data pipelines
- Develop ETL and ELT pipelines
- Develop data governance and security controls
- Implement GCP event driven workflows
- Implement monitoring and alerting
- Integrate data sources and sinks
- Migrate on prem services to GCP
- Orchestrate workflows with Apache Airflow
- Set up CI CD for data pipelines
- Troubleshoot pipeline health and data quality
Perks/Benefits
Skills/Tech-stack
Access Control | Apache Airflow | Audit Logging | CI/CD | Cloud Composer | Cloud Functions | Cloud Monitoring | Cloud Storage | Cloud platform | Clustering | Data Governance | Dataflow | ELT | ETL | Git | Google BigQuery | Google Cloud | Google Cloud Platform | Kafka | Materialized views | Nifi | PLSQL | Partitioning | PubSub | Python | Stackdriver | Terraform
Education
N/A
Roles
Cloud Data Engineer | Cloud) | Data Engineer | ETL Engineer | Engineer
Related jobs
-
Engineering Lead,Microservices,Java Springboot /Sr. Associate Director, Technology Management INR 1500K-2400KApache Airflow | Apache Beam | Apache Flink | BigQuery | Cloud StorageMid-level Full TimePune, Maharashtra, India R7h ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API first | API-first design | Access Control | Agent OrchestrationSenior-level Full TimeRemote, India R11h ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API Design | Access Control | Artificial Intelligence | Batch inferenceSenior-level Full TimeRemote, India R12h ago
-
GCP, Airflow, Bigquery/Senior Consultant Specialist INR 1500K-2500KApache Airflow | Apache NiFi | CI/CD | Cloud Composer | Cloud DataflowContinuous professional development | Flexible workingSenior-level Full TimePune, Maharashtra, India R17h ago
-
Manager , Decision Systems Data INR 700K-1200KAgile | Apache Airflow | BigQuery | Bigtable | CI/CDCareer development | Supportive work environmentMid-level Full TimeBangalore, Karnataka, India R18h ago
-
Principal Engineer, Sitecore Architect (Optimizely) INR 4000K-6500KA/B | A/B Testing | A/B Testing Tools | ASP.NET MVC | ASP.Net CoreSenior-level Full TimeRemote, India R19h ago
-
Senior-level Full TimeBangalore, India R23h ago
-
Principal Data Engineer INR 2500K-4200KAnnotation Pipeline | Azure | CI/CD | Cloud Data | Cloud Data EngineeringSenior-level Full TimeRemote (India) R1d ago
-
Lead Performance Engineer INR 3584K-5000KAWS | Agile | Apache JMeter | Azure | CI/CDFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsSenior-level Full TimeHyderabad, India R1d ago
-
AKS | AWS | ArangoDB | Authentication | AzureFully remoteMid-level Full TimeIndia R1d ago
-
Senior Software Engineer, (Python, GenAI, MCP) INR 3080K-4400KAPIs | AWS | Data Streaming | Databases | DockerSenior-level Full TimeRemote - Bangalore, India R1d ago
-
Ardoq | Bird | Collibra | Data Architecture | Data GovernanceSenior-level Full TimeRemote, India R1d ago
-
Associate Principal Engineer, Data Engineer (Enterprise Data Architect-Banking Domain) INR 1524K-2541KAgile | Ardoq | Bird | Collibra | Data ArchitectureMid-level Full TimeRemote, India R1d ago
-
Senior Data Engineer PHP 384K-456KAPI Gateway | API Integration | AWS | AWS QuickSight | BoxBonuses | Ongoing education and training | Unlimited vacationSenior-level Full TimeManila, PH / Mumbai, IN - … R1d ago
-
Senior Data Engineer INR 3600K-4580KApache Airflow | Batch Processing | Billing integration | CRM Integration | DBTCommunity involvement | Employee wellbeing programs | Hybrid work | Remote work | Work-life balanceSenior-level Full TimeRemote (IND), India R1d ago
-
AWS | Autogen | Embedding Models | GenAI | GoSenior-level Full TimeBangalore - Carina, India R1d ago
-
Data Engineer INR 3000K-4200KAWS | AWS Glue | Amazon Athena | Amazon S3 | Apache AirflowFlexible location | Remote workSenior-level ContractIndia - Remote R1d ago
-
Senior-level Full TimeBangalore, India R1d ago
-
Principal Data Engineer / Architect - Individual Contributor INR 3200K-4580KAI Agent framework | AWS | Agent Framework | Airbyte | AlertingSenior-level Full TimeBangalore, INDIA R2d ago
-
Senior Analytics Engineer (Contract) INR 3600K-5400KAmazon Redshift | Apache Airflow | CI/CD | DBT | DagsterSenior-level ContractIndia - Remote R2d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Databricks | Distributed SystemsHybrid work model | Learning and development programs | Mentorship and coaching | Remote workSenior-level Full TimeBangalore, India R2d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Cloud platform | DatabricksHybrid work model | Learning and development programs | Mentoring and coaching culture | Remote work opportunitySenior-level Full TimeBangalore, India R2d ago
-
Ansible, Jira, Confluence, Hadoop / Consultant Specialist INR 800K-1700KAmazon S3 | Ansible | CI/CD | Confluence | DevSecOpsContinuous professional development | Flexible working | Inclusive work environment | Opportunities to growMid-level Full TimeHyderabad, Telangana, India R2d ago
-
Senior Consultant Specialist INR 3000K-5000KAWS | Apache Spark | Artificial Intelligence | Cloud platform | Data LakesSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
Data Engineer - Global Team (India) INR 1500K-2500KApache Spark | Data Modeling | Databricks | Delta Lake | ETLLearning reimbursement | Parental leave | Team events | Vacation timeMid-level Full TimeIndia Remote R2d ago