GCP, Bigquery, Airflow/Consultant Specialist
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Design develop test and deploy data integration pipelines
- Develop Python and shell scripts to automate operations
- Interface with stakeholders to translate requirements
- Maintain documentation and configuration management
- Migrate on premises services to cloud platforms
- Provide technical leadership and mentorship
- Run load and performance testing
- Use Git Jira and Confluence in agile delivery
Perks/Benefits
Skills/Tech-stack
Airflow | BigQuery | Cloud Composer | Cloud SDK | Cloud SQL | Cloud platform | Confluence | Dataflow | GCS | Git | Google Cloud | Google Cloud Platform | Google Cloud SDK | Hadoop | Infrastructure as Code | Jira | Kafka | Load Testing | MySQL | Nifi | Oracle | Performance Testing | PostgreSQL | PubSub | Python | SQL | SQL Server | Shell Scripting | Terraform | “as-code”
Education
N/A
Roles
Big Data Engineer | Cloud Data Engineer | Cloud) | Data Engineer | Engineer
Related jobs
-
Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Data Pipeline Performance TuningMid-level Full TimePune, Maharashtra, India R12h ago
-
Lead Engineer INR 4000K-5500KC++ | Deep learning | Ethics | Hadoop | Language ModelsDiscretionary bonuses or commissions | Equity awards | Family medical vision and dental coverage | Hybrid workSenior-level Full TimeBengaluru, Karnataka, India R15h ago
-
Alerting | Anomaly Detection | Azure DevOps | Bash | CI/CDMid-level Full TimePune, Maharashtra, India R20h ago
-
Data Governance Engineer INR 980K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsAgile career development | Comprehensive benefits dependent on location | Inclusive workplace | Remote work flexibilityMid-level Full TimeIN - Hyderabad, India R23h ago
-
Senior Gen AI Developer INR 1000K-5000KAPI Integration | Azure OpenAI | CNN | Deep learning | Embedding ModelsRemote work | Work from homeSenior-level Full TimeIndia - Remote R23h ago
-
Software Engineering Associate - Snowflake INR 1000K-2000KAWS | Azure | Batch Processing | Data Governance | Data ModelingFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R1d ago
-
Apache Spark | Azure Data | Azure Data Services | CI/CD | ClickHouseCareer development | Collaborative engineering culture | Exposure to AI powered data platforms | Financial benefits | Fully remote work environmentSenior-level Full TimeIndia R1d ago
-
Staff Data Scientist INR 2000K-4500KAlgorithms | Data Lakes | Data Structures | Deep learning | DockerSenior-level Full TimeBangalore, India Office (BANGALORE) R1d ago
-
Agile | Apache Airflow | Apache Kafka | Apache NiFi | BigQueryFlexible working | Inclusive workplace | Opportunities for growth | Professional developmentMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQLGenerous leave policy | Health and medical insurance | Recognition and rewards initiatives | Remote work | Team offsitesSenior-level Full TimeIndia R1d ago
-
AWS | Azure | CI/CD | Cloud Native | Data PipelinesFlexible work environment | Fully remote | Global collaboration | Learning cultureSenior-level Full TimeIndia R1d ago
-
AWS Glue | AWS Kinesis | AWS Lambda | AWS SQS | Amazon AthenaCommute support | Employee well-being | Fully remote | Global collaboration | Health coverageSenior-level Full TimeIndia R1d ago
-
.NET Web | .NET Web API | AI Safety | AJAX | API DevelopmentGlobal team collaboration | Minimal office visits | Remote-first cultureEntry-level Full TimeIndia - Remote R1d ago
-
Gen AI Engineer (Data science) INR 2000K-4500KAWS | Angular | Apache Spark | Azure | Computer VisionFully remote | Minimal travelSenior-level Full TimeBangalore, KA, IN, 560100 R1d ago
-
Sr Data Engineer (Bangalore candidates only) INR 2040K-3380KAgile methodology | Apache Spark | Azure Data | Azure Data Explorer | Azure Data FactorySenior-level Full TimeIN Virtual, India R1d ago
-
Lead Specialist - Data Analytics & Insight INR 3000K-4000KAmazon Web Services | Azure | Data Modeling | Data Visualization | Data WarehousingFlexible remote work options | Hybrid work flexibility | Inclusive work culture | Professional development opportunities | Supportive leadershipSenior-level Full TimeMumbai - Hiranandani, India R1d ago
-
Junior GenAI Developer INR 400K-480KAgentic Workflows | Embeddings | Git | Hybrid search | LLM integrationHealth insurance | Language courses | Mentorship | Professional development opportunities | Relocation programEntry-level Full TimeAll Cities, India R2d ago
-
Junior GenAI Developer INR 400K-480KAgentic Workflows | Embeddings | Git | Hybrid search | LLM APIHealth insurance | Language courses | Mentorship | Professional development opportunities | Relocation programEntry-level Full TimeAll Cities, India R2d ago
-
API Integration | Azure Data | Azure Data Factory | Cloud Data | Cloud Data PlatformsFlexible remote work model | Remote workSenior-level Contract Full TimeIndia R2d ago
-
Staff Machine Learning Engineer INR 4000K-5000KC# | C++ | Deep learning | Fine Tuning | HadoopDental insurance | Equity awards | Health insurance | Hybrid work | Vision insuranceSenior-level Full TimeBengaluru, Karnataka, India R2d ago
-
AI Safety | Agent Orchestration | Alerting | Asynchronous programming | Cloudflare WorkersAccess to modern AI tooling | Global collaboration | High ownership | Inclusive culture | Learning opportunitiesSenior-level Full TimeIndia R2d ago
-
Junior GenAI Developer INR 400K-480KAgent workflows | Embeddings | Evaluation metrics | Git | Hybrid searchCertification programs | Global team | Health insurance | Inclusive culture | Internship opportunitiesEntry-level Full TimeAll Cities, India R2d ago
-
Senior Data Engineer INR 3715K-5876KApache Spark | Azure Data | Azure Data Services | CI/CD | ClickHouseFull remote work | Health benefits | Wealth benefits | Wellbeing benefitsSenior-level Full TimeIndia R2d ago
-
Engineering Lead,Microservices,Java Springboot /Sr. Associate Director, Technology Management INR 1300K-2200KApache Airflow | Apache Beam | Apache Flink | BigQuery | ClickHouseMid-level Full TimePune, Maharashtra, India R2d ago
-
AWS | Adversarial Machine Learning | Amazon SageMaker | Anonymization | AzureCutting-edge AI security work | Flexible working hours | Fully remote | Global cross-functional collaboration | Opportunity to shape AI security best practicesSenior-level Full TimeIndia R2d ago