GCP, Bigquery, Airflow/Consultant Specialist
Hyderabad, Telangana, India
R
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Collaborate using Git JIRA and Confluence and follow agile methodologies
- Conduct load and performance testing for pipelines
- Design develop test and deploy scalable data integration pipelines
- Develop Python and shell scripts to automate infrastructure operations and server management
- Maintain documentation configuration management and operational procedures
- Migrate on premises services to cloud platforms
- Provide technical leadership and mentorship to engineering teams
- Translate business and customer requirements into technical solutions
Perks/Benefits
Skills/Tech-stack
Agile | Apache Airflow | Apache Kafka | Apache NiFi | BigQuery | Cloud Composer | Cloud SQL | Cloud platform | Confluence | Dataflow | Git | Google Cloud | Google Cloud Platform | Hadoop | Infrastructure as Code | Jira | MySQL | Oracle | PostgreSQL | PubSub | Python | SQL | SQL Server | Shell Scripting | Terraform | “as-code”
Education
N/A
Related jobs
-
Agile | Airflow | Automated testing | BigQuery | CI/CDContinuous professional development | Flexible working | Inclusive and diverse environment | Opportunities to growMid-level Full TimeHyderabad, Telangana, India R14h ago
-
Apache Airflow | Apache Beam | Apache Flink | Asynchronous Messaging | BigQueryCareer growth opportunities | Continuous professional development | Flexible workingMid-level Full TimePune, Maharashtra, India R15h ago
-
Computer Scientist 2 ( Full Stack Frontend Heavy ) INR 2000K-3500KAWS | Docker | DynamoDB | Java | KubernetesSenior-level Full TimeBangalore, India R22h ago
-
Senior-level Full TimeNoida, India R22h ago
-
Senior BI & AI Engineer INR 3000K-4064KClaude | DAX | Data Lineage | Data Modeling | Data QualityAccess to Headspace app | Career Development Programs | Employee incentive programs | Flexible vacation | Flexible work-life balanceSenior-level Full TimeIndia, Hyderabad, Telangana R22h ago
-
API Integrations | AWS | Automation & Integration | Azure | Cloud infrastructureCollaborative environment | Fully remote work | International projects | Professional growth opportunities | Work-life balanceMid-level Full TimeIndia R1d ago
-
Junior Software Engineer INR 480K-800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | Azure Synapse AnalyticsClient facing communication experience | Night shift rotation | Remote workEntry-level Full TimeHyderabad/Remote, India R1d ago
-
Forward Deployed Engineer INR 2400K-3900KAWS | Apache Spark | Azure | CI/CD | DatabricksCustomer-facing work | Travel 20 percent timeSenior-level Full TimeRemote - India R1d ago
-
Testing Senior Associate - Power BI Tester INR 1300K-2000KCase design | Data Reconciliation | Data Validation | Data traceability | Defect ManagementFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Professional development supportMid-level Full TimeHyderabad, India R1d ago
-
Lead Consultant - AI Architect INR 3584K-5000KAWS | Agent Orchestration | Agentic AI | Amazon Bedrock | Amazon QSenior-level Full TimeIndia - Bangalore R1d ago
-
Senior Principal Data Engineer INR 3715K-5876KAWS | Airflow | Amazon Athena | Amazon EMR | Amazon RedshiftHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R1d ago
-
Machine Learning Engineer 4 INR 3584K-5400KAWS | BERT | Computer Vision | Deep learning | Distributed ComputingSenior-level Full TimeNoida, India R1d ago
-
API Development | Boosting | Clustering | Data Mining | Data VisualizationHybrid work flexibility | Professional development opportunities | Supportive leadershipSenior-level Full TimeMumbai - Hiranandani, India R1d ago
-
Software Engineer, Data Foundation INR 3600K-4200KAlerting | Batch Processing | Big Table | Data Modeling | Data ObservabilityHybrid work flexibility | Remote work optionSenior-level Full TimeRemote (IND), India R1d ago
-
Senior-level Full TimeBangalore, India R1d ago
-
Senior-level Full TimeNoida, India R1d ago
-
Senior-level Full TimeBangalore, India R1d ago
-
Senior Data Engineer INR 3600K-4995KAmazon Redshift | Amazon Web Services | Apache Airflow | Batch Processing | DBTSenior-level Full TimeIndia R2d ago
-
Senior Machine Learning (ML) Ops Engineer INR 3715K-5449KAWS | Airflow | Amazon SageMaker | Azure | CI/CDEquity compensation | Fully remote | Global & diverse team | Innovation culture | Part-timeSenior-level Full TimeMumbai, Maharashtra, India R4d ago
-
Assistant Director,Data and Analytics INR 3000K-5199KAnomaly Detection | Azure | Cloud platform | Data Visualization | Fraud analyticsExecutive-level Full TimeBangalore, Karnataka, India R4d ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 2400K-3900KAWS | Agent systems | Apache Spark | Azure | Deep learningConference participation | Remote work | Travel as neededSenior-level Full TimeRemote - India R4d ago
-
Senior Software Engineer - Product Data Gateway INR 3584K-4680KAPI | CI/CD | Code review | Fault Tolerance | GoSenior-level Full TimeHybrid - Bangalore, India R4d ago
-
API Development | Access Control | Artificial Intelligence | Automation | CI/CDCareer growth | Fully remote work | Paid time off | Professional developmentMid-level Full TimeIndia R4d ago
-
Senior Data Platform Support Engineer -GCP Certified INR 2771K-4064KAirflow | Artifact Registry | Bash | BigQuery | CI/CDHybrid work model | On-call rotaSenior-level Full TimePune, India R4d ago
-
Staff Software Engineer - (Identity & Data Engineering Focus) INR 3000K-4000KAPI Gateway | AWS API | AWS API Gateway | AWS Cognito | AWS Cognito TriggersSenior-level Full TimeIndia - Pune - Hybrid R4d ago