GCP, Bigquery, Airflow/Consultant Specialist
Hyderabad, Telangana, India
R
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Design build test and deploy data integration pipelines
- Develop Python and shell automation scripts
- Maintain documentation and configuration management
- Migrate on premises services to cloud platforms
- Provide technical leadership and mentorship
- Run load and performance testing for pipelines
- Translate business requirements into technical solutions
- Use Git JIRA and Confluence with agile methodologies
Perks/Benefits
- Continuous professional development
- Flexible working
- Inclusive work environment
- Opportunity for growth
Skills/Tech-stack
Agile | Apache Airflow | Apache Hadoop | Apache Kafka | Apache NiFi | BigQuery | Cloud Composer | Cloud SDK | Cloud SQL | Cloud platform | Confluence | Dataflow | GCS | Git | Google Cloud | Google Cloud Platform | Google Cloud SDK | Infrastructure as Code | Jira | Load Testing | Performance Testing | PubSub | Python | SQL | Shell Scripting | Terraform | “as-code”
Education
N/A
Related jobs
-
Manager Data and Analytics INR 1400K-2000KAmazon Redshift | Azure | BigQuery | Business Intelligence | Cloud platformMid-level Full TimeBangalore, Karnataka, India R4h ago
-
Knowledge Graph, Graph DB, Python/Senior Consultant Specialist INR 3000K-4200KAgile | Amazon Neptune | Data Governance | Data Lineage | Data ModelingContinuous professional development | Flexible working | Inclusive work environmentSenior-level Full TimeHyderabad, Telangana, India R12h ago
-
Assistant Director,Data and Analytics INR 3000K-5199KAnomaly Detection | Azure | Cloud platform | Data Visualization | Fraud analyticsExecutive-level Full TimeBangalore, Karnataka, India R13h ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 2400K-3900KAWS | Agent systems | Apache Spark | Azure | Deep learningConference participation | Remote work | Travel as neededSenior-level Full TimeRemote - India R13h ago
-
API Development | Access Control | Artificial Intelligence | Automation | CI/CDCareer growth | Fully remote work | Paid time off | Professional developmentMid-level Full TimeIndia R15h ago
-
Machine Learning Engineer INR 4408K-4408KAWS Bedrock | Deep learning | Google ADK | Information Retrieval | LLM orchestrationRemote first quarterly surgesMid-level Full TimeRemote - India R1d ago
-
Specialist Cloud Database Engineer (SQL, DevOps, AWS) INR 2156K-2500KAlwaysOn Availability | AlwaysOn availability groups | Amazon Aurora | Amazon CloudFormation | Amazon RDSHybrid work model | Office collaboration days | Remote work flexibilitySenior-level Full TimeIndia - Pune R1d ago
-
Principal AI-ML Engineer INR 3264K-5876KAgentic AI | Amazon Web Services | Apache Airflow | Artificial Intelligence | AzureSenior-level Full TimeBengaluru East, Karnataka, India R1d ago
-
Senior Data Engineer INR 3740K-5876KApache Spark | Azure Data | Azure Data Services | CI/CD | ClickHouseFully remote | Health benefits | Paid time off | Wellbeing benefitsSenior-level Full TimeIndia R1d ago
-
AWS | Alteryx | Amazon Redshift | Azure Synapse | Azure Synapse AnalyticsContinuous learning opportunities | Fully remote work | Professional growthSenior-level Full TimeIndia R1d ago
-
Apache Kafka | Apache Spark | Batch Processing | BigQuery | Cloud DataFully remote work opportunity | International team collaboration | Regular training and professional development opportunitiesSenior-level Full TimeIndia R1d ago
-
Apache Hadoop | Apache Spark | Azure Blob | Azure Blob Storage | Azure DataMid-level Full TimeHyderabad, Telangana, India - Remote R1d ago
-
Sr Computer Scientist 2 INR 3470K-4680KAWS | Apache Kafka | Apache Spark | Apache Storm | ElasticsearchSenior-level Full TimeNoida, India R1d ago
-
Senior Data Engineer - AdTech (6-Month Contract) INR 2475K-3380KApache Spark | Cloud Storage | Data Processing | Data Quality | Data pipelineContinuous learning | High-impact work | Proximity talksSenior-level ContractIndia - Remote R1d ago
-
Data Engineer INR 1500K-3500KApplication Insights | Azure Data | Azure Data Factory | Azure RBAC | Azure StorageFully remote | Runbooks and Documentation Focus | Video Screen Interview Required for Remote PositionsSenior-level Full TimeIndia, India R2d ago
-
Senior Data Operations Engineer INR 2475K-4064KAirflow | Control-M | ETL | Python | SQL24x7 support availability | Hybrid work modelSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
AWS | AWS S3 | Amazon IAM | Amazon RDS | Amazon RDS PostgreSQLContinuous learning | Fully remote | Professional growthSenior-level Full TimeIndia R2d ago
-
AWS | Azure | Cloud platform | Data Analysis | Data ManagementAutonomy | Collaborative team environment | Continuous learning | Exposure to modern machine learning technologies | Flexible work scheduleMid-level Full TimeIndia R2d ago
-
Senior-level Full TimeRemote, India R2d ago
-
Computer Scientist ( Full Stack - Frontend Heavy ) INR 2000K-3500KAWS | Data Structures | Docker | DynamoDB | JavaSenior-level Full TimeBangalore, India R2d ago
-
Computer Scientist 2 – Fullstack (Frontend Heavy) INR 3242K-4580KAccessibility | Babel | CI/CD | CSS | Cloud servicesSenior-level Full TimeNoida, India R2d ago
-
Quantitative Analytics Engineer, Vice President INR 4000K-5000KAPI | Automated testing | Calculus | Enterprise Software | Enterprise Software DevelopmentComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeMU8-South (A) Wing, 7-10 Floor, Nesco … R2d ago
-
Analyst, AI Engineer INR 4000K-5000KAgile | Artificial Intelligence | Azure DevOps | Cassandra | DockerComprehensive healthcare | Flexible time off | Retirement plan | Tuition reimbursementExecutive-level Full TimeMU8-South (A) Wing, 7-10 Floor, Nesco … R2d ago
-
Associate , Data Analytics INR 1000K-2000KAI-enabled | AI-enabled analytics | Analytics engineering | Analytics modeling | AzureComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsMid-level Full TimeMU8-South (A) Wing, 7-10 Floor, Nesco … R2d ago
-
Database Engineering Associate INR 1500K-2000KAWS | Alerting | Cause analysis | Disaster Recovery | ETLFlexible onsite remote schedule | Health and life insurance | Hybrid work model | Paid time off | Pension and retirement benefitsMid-level Full TimeHyderabad, India R2d ago