Senior Gcp Data Engineer/Senior Consultant Specialist
Pune, Maharashtra, India
R
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Architect end to end data workflows
- Automate deployment and versioning with infrastructure as code
- Build and optimize BigQuery data models
- Build event driven workflows using GCP services
- Collaborate with data analysts and data scientists
- Design and develop scalable data pipelines
- Develop and maintain ETL/ELT pipelines
- Enforce data governance access control and audit logging
- Ensure data quality, reliability, and availability
- Implement CI/CD for data pipelines
- Implement data partitioning clustering and materialized views
- Migrate and re engineer services to GCP
- Set up monitoring for pipeline health and data quality
- Troubleshoot pipeline and data issues
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Apache Airflow | Apache Kafka | Apache NiFi | Audit Logging | BigQuery | CI/CD | Cloud Composer | Cloud Dataflow | Cloud Functions | Cloud Monitoring | Cloud Storage | Cloud platform | Data Governance | ELT | ETL | Git | Google Cloud | Google Cloud Platform | Infrastructure as Code | PLSQL | PubSub | Python | Stackdriver | Terraform | “as-code”
Education
N/A
Related jobs
-
Senior Full-Stack AI Engineer- 3185 (Remote) INR 2000K-4500KAI Foundry | AWS Bedrock | Agile | Anthropic | Azure AIFlexible working hours | Learning and development programs | Recognition rewards | Remote workSenior-level Full TimeChennai, India R9h ago
-
Full-Stack AI Engineer - 3184 (Remote) INR 2000K-4500K.NET | AI Foundry | Agile | Azure AI | Azure AI FoundryFlexible working hours | L and D programs | Professional development | Remote work | Rewards and recognitionSenior-level Full TimeChennai, India R9h ago
-
Data Platform Engineer/Consultant Specialist INR 1500K-2500KAmazon S3 | Ansible | Atlassian Confluence | Atlassian Jira | AutomationFlexible workingMid-level Full TimeHyderabad, Telangana, India R9h ago
-
AWS | Agile | Amazon Web Services | Authentication | AuthorizationFlexible working | Inclusive work culture | Opportunities for growth | Professional developmentMid-level Full TimeHyderabad, Telangana, India R11h ago
-
JAVA Data Engineering/Associate Director Software Engineering INR 1400K-2000KApache Beam | Apache Flink | Apache Kafka | Apache Spark | Data WarehousingContinuous professional development | Flexible workingMid-level Full TimePune, Maharashtra, India R14h ago
-
Senior Software Engineer INR 2800K-4000KAI | Access Control | Airflow | Artificial Intelligence | AstronomerSenior-level Full TimePune, India R23h ago
-
AI Data Engineer INR 2500K-3380KAPI | AWS | Agile | DBT | Data EnrichmentEmployee incentive programs | Flex my way policies | Headspace app access | Hybrid work model | Mental health daysMid-level Full TimeIndia, Hyderabad, Telangana R23h ago
-
Data Quality Governance and Strategy Associate Engineer INR 2000K-3000KAI | Collibra | Data Controls | Data Governance | Data LineageFlexible hybrid model | Health insurance | Life insurance | Paid time off | Personal/family careMid-level Full TimeHyderabad, India R1d ago
-
Sr Principal Data Scientist INR 3000K-4000KAgentic AI | Causal Inference | Causal ML | Contextual Bandits | DatabricksSenior-level Full TimeBangalore, INDIA R1d ago
-
Machine Learning Engineer INR 1800K-3000KAWS SageMaker | Albumentations | Audio classification | Azure Machine Learning | CI/CDLeadership development programs | Learning and development programs | Multicultural experience | Open minded collaborative culture | Professional growthMid-level Full TimeIndia R1d ago
-
Machine Learning Engineer INR 1800K-3000KAWS SageMaker | Albumentations | Audio classification | Azure Machine Learning | CI/CDCollaborative culture | Learning and development programs | Multicultural team | Professional growthMid-level Full TimeIndia R1d ago
-
Machine Learning Engineer (Remote) INR 2500K-4500KAutomated testing | CI/CD | Git | Machine Learning | NumPyRemote work | Scrum team collaborationSenior-level Full TimeMaharashtra, Pune, India R1d ago
-
GenAI LLM Python/Sr. Associate Director, Software Engineering INR 1500K-2500KAgent Orchestration | Agent systems | Amazon Web Services | Cloud platform | ComplianceFlexible workingMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior-level Full TimeKarnataka, India R1d ago
-
Lead Data Engineer INR 2000K-3000KAWS | Amazon S3 | Apache Airflow | Apache Kafka | Apache NiFiBroadband reimbursement | Medical insurance | Paid certifications | Personal accident insurance | Professional development allowanceSenior-level Full TimeIndia - Remote R1d ago
-
Agentic AI | Airflow | Apache Kafka | Audit compliance | BigQueryMid-level Full TimeHyderabad, Telangana, India R1d ago
-
AI Engineer(Remote, IND) INR 2475K-5000KAWS Bedrock | CI/CD | DAST | DevSecOps | DockerCompetitive vacation and holidays | Comprehensive wellness programs | Employee networks and volunteer opportunities | Great Place to Work certified | Paid parental and adoption leavesSenior-level Full TimeIND MH Remote, India R1d ago
-
Senior Software Engineer (GenAI) - Parametric INR 2817K-4132KA/B | A/B Testing | AWS | Agile | B testingSenior-level Full TimeCOMMERZ III, OBEROI GARDEN CITY, India R1d ago
-
Software Engineer - AI/ML INR 2500K-4000KAPI Development | AWS | Azure | Distributed Computing | Fine TuningMid-level Full TimeHyderabad, India R1d ago
-
AI Engineer (Fresher / Entry-Level) INR 180K-300KContinuous Deployment | Continuous integration | Continuous integration Continuous deployment | Docker | EmbeddingsHybrid work | Paid time off | Worker s insuranceEntry-level Full TimePune, Maharashtra, India R1d ago
-
AWS | AWS Glue | AWS Glue Data Catalog | AWS Lake Formation | AWS LambdaAutonomy and ownership | Career growth | Collaborative global environment | Flexible work culture | Fully remote workSenior-level Full TimeIndia R4d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Collaborative work environment | Continuous learning and skill development | Flexible work setup | Fully remote workSenior-level Full TimeIndia R4d ago
-
API Integration | Agentic Workflows | Conversational AI | Dialogue Management | Distributed SystemsCareer growth in AI systems | Flexible work location | Fully remote | High ownership role | Technical autonomySenior-level Full TimeIndia R4d ago
-
GCP Data Engineer/Consultant Specialist INR 1500K-2500KAgile | Airflow | Apache Kafka | Apache NiFi | BigQueryFlexible working | Opportunities for growth | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R4d ago
-
AWS Data Engineer (Senior) (Freelancer) INR 2040K-3000KAmazon Athena | Amazon EMR | Amazon Glue | Amazon Redshift | Apache AirflowSenior-level FreelanceMumbai, MH R4d ago