GCP, Bigquery, Airflow/Consultant Specialist
Hyderabad, Telangana, India
R
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Collaborate using Git JIRA and Confluence and follow agile methodologies
- Conduct load and performance testing for pipelines
- Design develop test and deploy scalable data integration pipelines
- Develop Python and shell scripts to automate infrastructure operations and server management
- Maintain documentation configuration management and operational procedures
- Migrate on premises services to cloud platforms
- Provide technical leadership and mentorship to engineering teams
- Translate business and customer requirements into technical solutions
Perks/Benefits
Skills/Tech-stack
Agile | Apache Airflow | Apache Kafka | Apache NiFi | BigQuery | Cloud Composer | Cloud SQL | Cloud platform | Confluence | Dataflow | Git | Google Cloud | Google Cloud Platform | Hadoop | Infrastructure as Code | Jira | MySQL | Oracle | PostgreSQL | PubSub | Python | SQL | SQL Server | Shell Scripting | Terraform | “as-code”
Education
N/A
Language: en
Views: 1
Clicks: 0
Saves: 0
Related jobs
-
Lead - Data Scientist INR 2500K-4720KAnomaly Detection | Cloud Computing | Data Governance | Deep learning | DevSecOpsCareer development opportunities | Inclusive workplace | Mentoring and team developmentSenior-level Full TimeNoida,Uttar Pradesh,India R15h ago
-
Software Engineer INR 1500K-2100KAWS | Agile | Bash | CI/CD | CloudWatchFamily wellbeing benefits | Health and wellbeing benefits | Hybrid work | Paid time off | Work-life balance benefitsMid-level Full TimeHyderabad, India R19h ago
-
AWS | Artificial Intelligence | Azure | CI/CD | Computer VisionCareer development | Inclusive culture | Professional learning | Remote workSenior-level Full TimeIndia R23h ago
-
Data / Retrieval Engineer INR 3200K-4720KAPIs | Access Control | Attribute-Based Access Control | Attribute-based access | ChunkingSenior-level Full TimeNoida/Gurgaon, UP, IN R1d ago
-
AI Orchestration / Platform Engineer INR 2500K-4680KAlerting | Authentication | Authorization | CI/CD | CachingSenior-level Full TimeNoida/Gurgaon, HR, IN R1d ago
-
Principal Agentic AI Engineer / Hands-on Technical Lead INR 3600K-5000KAI tracing | Agent patterns | Authentication | Authorization | AutogenSenior-level Full TimeNoida/Gurgaon, HR, IN R1d ago
-
Machine Learning Engineer 3 ( Firefly ) INR 3264K-5000KCUDA | Diffusion Models | Distributed Systems | GANs | GPU resource managementSenior-level Full TimeNoida, India R1d ago
-
AI Services | Azure AI | Azure AI Services | Azure OpenAI | Azure SpeechHybrid work | Onsite work | Travel 10 percentSenior-level Full TimeKarnataka, Bengaluru Old No 62, Plot … R1d ago
-
Databricks Data Engineer - Manager INR 1500K-2100KApache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryEducational support | Employee networks | Flexible work programs | Hybrid work environment | InsuranceMid-level Full TimeBangalore, India R1d ago
-
Databricks Data Engineer - Senior Manager INR 2771K-4064KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHybrid work environment | Paid volunteer daysSenior-level Full TimeHyderabad, India R1d ago
-
Principal Data Engineer- Databricks & AI platform INR 3715K-5400KAWS | Airflow | Apache Spark | Asset bundles | AzureEmployee assistance program | Employee resource groups | Health benefits | Learning programs | No meeting daysSenior-level Full Time3010 - Bangalore Office, India R1d ago
-
Audit Analytics Specialist INR 1500K-2600KACL | AI | Automation | Dashboards | Data CleansingHybrid workMid-level Full TimeIN-KA-BANGALORE-NEON BUILDING WEST TOWER, India R1d ago
-
Specialist, Data Engineering INR 1000K-2000KAWS Glue | AWS Secrets | AWS Secrets Manager | Access Control | Active DirectoryMid-level Full TimeIND - Telangana - Hyderabad (Hitec … R1d ago
-
AWS | ArgoCD | Autogen | Azure | CI/CDHybrid workSenior-level Full TimeBengaluru, India R1d ago
-
Principal Software Engineer INR 3264K-5876KAWS | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingSenior-level Full TimeHyderabad, TG, India R2d ago
-
Staff Machine Learning Engineer INR 3600K-5000KA/B | A/B Testing | AWS | Agentic Workflows | AzureHybrid work | Onsite collaborationSenior-level Full TimeIndia - Pune - Office R3d ago
-
Senior Embedded Software Engineer INR 1716K-2500KAUTOSAR | Artifactory | Automotive SPICE | C plus plus | C#BusinessBike bicycle leasing | Continuing education programs | Corporate volunteering | End-of-year bonuses | Flexible working hoursSenior-level Full TimePune, MH, IN, 411057 R3d ago
-
Mid-level Full TimeHaryana, India R3d ago
-
Continuous integration | Development Lifecycle | Git | JavaScript | LaravelCo-working space | Mentorship | Modern equipment | Training programs | Trial dayMid-level Full TimeChennai, Hybrid R3d ago
-
Principal Data Engineer Data Technology INR 3000K-4000KAPIs | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimePune, Maharashtra, India R3d ago
-
Data Engineer _ ALM - MTCR INR 1500K-3000KApache Hive | Apache Spark | Apache YARN | Bitbucket | CDEHybrid workSenior-level Full TimeIndia - Pune R3d ago
-
Senior Software Engineer INR 1492K-3000KAutomated testing | Azure Data | Azure Data Factory | Azure Databricks | Azure Machine LearningGrowth mindset culture | Hybrid work modelSenior-level Full TimeIndia, Telangana, Hyderabad R3d ago
-
Java Big Data Developer - Experienced INR 1500K-3000KApache Hadoop | Apache Kafka | Apache Spark | Design Patterns | DockerSenior-level Full TimePune, IN R3d ago
-
Staff Software Engineer - India INR 4000K-5000KAPI Development | AWS | Agentic AI | Azure | Cloud infrastructureCareer growth | High visibility and impact | Open Source contributionSenior-level Full TimeBengaluru R3d ago
-
Mid-level Full TimePune, Maharashtra, India R3d ago