EY - GDS Consulting - AI And DATA - GCP - Senior
Bengaluru, KA, IN, 560016
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Apply security best practices encryption and access control
- Build and maintain data ingestion and transformation frameworks
- Collaborate with business architecture and development teams
- Create and maintain orchestration workflows
- Create dashboards reports and analytics solutions
- Design and develop scalable ETL/ELT pipelines
- Develop Cloud Functions and automation scripts
- Implement CI/CD pipelines for data applications
- Implement data reconciliation validation and quality controls
- Manage code repositories and version control
- Manage data lakes and data warehouses
- Optimize data processing performance and costs
- Support migration from on premises to GCP
- Troubleshoot pipeline failures and performance issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Beam | Authentication | BigQuery | CI/CD | Cloud Build | Cloud Composer | Cloud Functions | Cloud Monitoring | Cloud logging | Cloud platform | Data Lakes | Data Quality | Data Reconciliation | Data Warehousing | Dataflow | Dataproc | Docker | ELT | ETL | Encryption | FinOps | GDPR | GitHub | GitLab | Google Cloud | Google Cloud Platform | Jenkins | PySpark | Python | SQL | Scala | Secret Manager | Service accounts | Spark
Roles
Data Engineer | Engineer | GCP Data Engineer | Senior Data Engineer
Related jobs
-
Genetics Data Engineer 1 INR 3000K-4600KAPI Development | AWS | Agentic AI | Azure | BcftoolsCareer development opportunities | Flexible work culture | Inclusive workplaceSenior-level Full TimeBangalore, Karnataka, IN, 5600372h ago
-
Node JS Developer - Senior Consultant INR 2200K-3500KAWS OpenSearch | Agile | Apache Kafka | Bull queue | CI/CDSenior-level Full TimeBangalore, IN, 5600663h ago
-
Tech Lead - Java (Java, React, Kong) INR 1500K-3000KAPI Development | API Gateway | API Management | API Security | AgileSenior-level Full TimePune, IN, 4110573h ago
-
Senior-level Full TimeHyderabad, IN, 5000813h ago
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R3h ago
-
Data Analytics/Engineer (Python and MS Fabric exp) INR 2500K-4720KAWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseCross-functional collaboration | Mentorship | Professional developmentSenior-level Full TimeIND-Pune-Smartworks, India8h ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami17h ago
-
AWS | Autogen | Azure | BERT | Computer VisionCollaborative team environment | Continuous learning | Professional growthMid-level Full TimeIndia17h ago
-
Member of Technical Staff - AI/ML Engineer INR 2500K-4500KAnomaly Detection | BM25 | Computer Vision | Document Understanding | Entity ResolutionEquity | Professional developmentSenior-level Full TimeHyderabad, TS, IN18h ago
-
Machine Learning Engineer - IV (Computer Vision) INR 1000K-1800KANN search | Airflow | Approximate Nearest Neighbor | CoreML | Data IngestionMid-level Full TimeIndia (remote) R18h ago
-
AI-Native Software Developer INR 2500K-4000K.NET | AI Evaluation | AI Orchestration Framework | AI guardrails | AI orchestrationMid-level Full TimeBangalore - Karnataka - India18h ago
-
Senior-level Full TimeMaharashtra, Pune, India19h ago
-
Mid-level Full TimeIN-AP-Hyderabad19h ago
-
Senior-level Full TimeIN-AP-Hyderabad19h ago
-
Senior-level Full TimeIN-AP-Hyderabad19h ago
-
Senior-level Full TimeIN-AP-Hyderabad19h ago
-
Senior-level Full TimeIN-TN-Chennai19h ago
-
Senior-level Full TimeIN-HR-Gurgaon19h ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Data Science | DatabricksLearning and development programs | Mentorship culture | Remote workSenior-level Full TimeBangalore, India R20h ago
-
Senior Machine Learning Engineer INR 3584K-4580KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Employee development programs | Learning and development programs | Remote work flexibilitySenior-level Full TimeBangalore, India R20h ago
-
Apache Kafka | Distributed Systems | Java | Kafka Connect | Kafka ProducersCollaborative environment | Long term role | Mission-driven work | Remote workMid-level Full TimeIndia20h ago
-
Mid-level Full TimeBangalore, Karnataka, India20h ago
-
AI Data Engineer III INR 3000K-4000KAgile | Amazon Web Services | Apache Airflow | CI/CD | DBTComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Staff Engineer_SAP Analytics Data Management INR 1500K-2700KABAP | ADSO | Analytics Cloud | CompositeProvider | Data ModelingOnsite 5 days per week | Production rollout support | UAT supportSenior-level Full TimeNoida, India21h ago
-
Staff Data Engineer INR 3000K-4132KAWS | Agile | Amazon Redshift | Amazon S3 | Apache AirflowEducation assistance | Fitness benefits | Flexible working hours | Health checkups | Health insuranceSenior-level Full TimeBengaluru, Karnataka, India21h ago