EY - GDS Consulting - AI And DATA - GCP - Senior
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Apply security best practices encryption and access control
- Build and maintain data ingestion and transformation frameworks
- Collaborate with business architecture and development teams
- Create and maintain orchestration workflows
- Create dashboards reports and analytics solutions
- Design and develop scalable ETL/ELT pipelines
- Develop Cloud Functions and automation scripts
- Implement CI/CD pipelines for data applications
- Implement data reconciliation validation and quality controls
- Manage code repositories and version control
- Manage data lakes and data warehouses
- Optimize data processing performance and costs
- Support migration from on premises to GCP
- Troubleshoot pipeline failures and performance issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Beam | Authentication | BigQuery | CI/CD | Cloud Build | Cloud Composer | Cloud Functions | Cloud Monitoring | Cloud logging | Cloud platform | Data Lakes | Data Quality | Data Reconciliation | Data Warehousing | Dataflow | Dataproc | Docker | ELT | ETL | Encryption | FinOps | GDPR | GitHub | GitLab | Google Cloud | Google Cloud Platform | Jenkins | PySpark | Python | SQL | Scala | Secret Manager | Service accounts | Spark
Roles
Data Engineer | Engineer | GCP Data Engineer | Senior Data Engineer
Related jobs
-
Member of Technical Staff - AI/ML Engineer INR 2500K-4500KAnomaly Detection | BM25 | Computer Vision | Document Understanding | Entity ResolutionEquity | Professional developmentSenior-level Full TimeHyderabad, TS, IN10h ago
-
AI-Native Software Developer INR 2500K-4000K.NET | AI Evaluation | AI Orchestration Framework | AI guardrails | AI orchestrationMid-level Full TimeBangalore - Karnataka - India10h ago
-
Senior-level Full TimeMaharashtra, Pune, India11h ago
-
Mid-level Full TimeIN-AP-Hyderabad11h ago
-
Senior-level Full TimeIN-AP-Hyderabad11h ago
-
Senior-level Full TimeIN-AP-Hyderabad11h ago
-
Senior-level Full TimeIN-AP-Hyderabad11h ago
-
Senior-level Full TimeIN-TN-Chennai11h ago
-
Senior-level Full TimeIN-HR-Gurgaon11h ago
-
Mid-level Full TimeBangalore, Karnataka, India12h ago
-
AI Data Engineer III INR 3000K-4000KAgile | Amazon Web Services | Apache Airflow | CI/CD | DBTComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Staff Engineer_SAP Analytics Data Management INR 1500K-2700KABAP | ADSO | Analytics Cloud | CompositeProvider | Data ModelingOnsite 5 days per week | Production rollout support | UAT supportSenior-level Full TimeNoida, India12h ago
-
Staff Data Engineer INR 3000K-4132KAWS | Agile | Amazon Redshift | Amazon S3 | Apache AirflowEducation assistance | Fitness benefits | Flexible working hours | Health checkups | Health insuranceSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Mid-level Full TimeBangalore, Karnataka, India12h ago
-
Power BI Fabric Engineer INR 2000K-2700KAzure Data | Azure Data Factory | CI/CD | DAX | Data FactoryAnnual excellence awards | Bike to work | Career mentorship | Educational assistance | Employee assistance programmeMid-level Full TimeBengaluru, KA, India13h ago
-
Mid-level Full TimeBangalore, Karnataka, India13h ago
-
Mid-level Full TimeBangalore, Karnataka, India13h ago
-
Big Data Lead INR 1500K-2500KAWS S3 | Amazon ECS | Amazon IAM | Apache Airflow | CI/CDClient facing communication | Team collaborationSenior-level Full TimeIndia13h ago
-
Big Data Lead INR 1500K-2500KData Architecture | Data Governance | Data Management | Data Management Cloud | Data WarehouseSenior-level Full TimeIndia14h ago
-
Lead Software Engineer -Python or Java, big data INR 3000K-4500KAWS | AWS Lambda | Agile | Amazon EMR | Amazon Elastic Compute ServiceSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
LAM-MTS-AWS+PySparks INR 1200K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeNoida, Uttar Pradesh, India14h ago
-
Senior-level Full TimeBengaluru, KA, India14h ago
-
Senior-level Full TimeBengaluru, KA, India14h ago
-
Senior Engineer, Data Engineering INR 1500K-2500KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeBengaluru, KA, India14h ago
-
Solution Integrator (Agentic AI Developer) INR 2475K-4580KAWS | Anthropic Claude | Azure | Chroma | CrewAIEntry-level Full TimeNoida,Uttar Pradesh,India14h ago