EY - GDS Consulting - AI And DATA - Data Engineer Solution Architect - Manager
Bengaluru, KA, IN, 560048
INR 2040K-4000K (estimate) Senior-level Full Time
Tasks
- Architect and build production data pipelines
- Build and maintain Python analytics workflows
- Define architecture standards and governance
- Deliver curated datasets for Power BI
- Design batch and real time processing
- Design enterprise data architecture
- Develop Jupyter notebooks
- Develop data storage and modeling for analytics
- Enable advanced analytics and AI capabilities
- Ensure secure data handling and access control
- Establish data lineage and auditing
- Implement CI/CD pipelines for data workloads
- Implement data quality validation
- Lead data platform modernization
- Monitor and troubleshoot pipeline failures
- Track experiments and manage model lifecycle with MLflow
Perks/Benefits
Skills/Tech-stack
Access Control | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure SQL | Azure Synapse | Azure Synapse Analytics | Batch Processing | CI/CD | Data Factory | Data Governance | Data Lake | Data Lineage | Data Modeling | Data Processing | Data Quality | Jupyter Notebook | MLflow | Power BI | Python | Real Time | Real-time Data | Real-time Data Processing | Snowflake Schema | Star Schema | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AI Observability | AWS | Azure | CI/CD | DockerCareer advancement | Flexible work environment | Fully remote | Professional development | Work-life balanceSenior-level Full TimeIndia R18h ago
-
Senior-level Full TimeIN-TN-Chennai19h ago
-
Senior-level Full TimeIndia - Bengaluru; India - Chennai …20h ago
-
Senior Data Engineer INR 1500K-2500KAlerting | Apache Pinot | BigQuery | Cloud platform | Cost OptimizationSenior-level Full TimeBangalore, India21h ago
-
Senior Manager - C2 INR 3000K-5000KAI Observability | Docker | Embedding Models | Evaluation | Generative AISenior-level Full TimeGurugram, Haryana, India21h ago
-
Executive-level Full TimeMumbai, Maharashtra, India21h ago
-
GenAI Engineer INR 1200K-2500KAWS | Artificial neural networks | Azure | Data Structures | DatabricksMid-level Full TimeIndia23h ago
-
Bootloader | C# | CAN | Configuration Management | DebuggingFlexi benefits | Health insurance | Hybrid working model | Internal job rotation | Life insuranceEntry-level Full TimeBangalore, IN23h ago
-
Assistant Manager INR 1200K-2000KAPI Integration | CI/CD | Data Engineering | Data Governance | Data QualityMid-level Full TimeGurugram, Haryana, India1d ago
-
Business Intelligence Data Analytics Engineer INR 1500K-2500KData Modeling | Data Transformation | Data pipeline | Fivetran | GitSenior-level Full TimeHyderabad India1d ago
-
Executive-level Full TimeBangalore, Karnataka, India1d ago
-
Senior Data Tester INR 1632K-2800KApache Spark | Bitbucket | CI/CD | Checkmarx | ClouderaHybrid work environmentSenior-level Full TimeIndia - Pune1d ago
-
AI Engineer II INR 3000K-5000KAWS | Agile | Apache Hive | Apache Kafka | Apache SparkCareer growth | Holistic well-being support | Learning opportunities | Supportive leadership cultureSenior-level Full TimeBengaluru, KA, India1d ago
-
Lead Data Quality Governance and Strategy Engineer INR 2520K-3380KBI tools | Data Governance | Data Management | Data Modeling | Data QualityFlexible hybrid work model | Health and life insurance | Paid time offSenior-level Full TimeHyderabad, India R1d ago
-
Senior Data Integration Engineer I INR 3264K-4401KAWS IAM | Airflow | Amazon VPC | Apache Flink | Apache SparkSenior-level Full TimeBengaluru1d ago
-
API Development | Agent systems | Backend Development | CI/CD | Cloud PlatformsAI experimentation focus | Career growth | Exposure to global enterprise clients | Inclusive collaborative culture | Innovation and learningSenior-level Full TimeIndia1d ago
-
Senior Data Engineer I INR 2500K-3380KAgile | Apache Airflow | Apache Hadoop | Apache Hive | Apache KafkaInclusive culture | Professional development time | Supportive team environment | Work-life balanceSenior-level Full TimeGurugram, HR, India1d ago
-
Analytics Engineer INR 1500K-3000KDBT | Data Governance | Data Modeling | Git | MetaplaneCareer developmentMid-level Full TimeIndia1d ago
-
Data Engineer INR 1340K-1680KAWS | Azure | ClickHouse | DBT | Data ArchitectureDonation matching | Flexible PTO | Flexible schedule | Health insurance | Lunch stipendMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Analyst-Data Science INR 2500K-4400KA/B | A/B Testing | B testing | Causal Inference | Data PreparationSenior-level Full TimeGurugram, HR, India1d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Career growth opportunities | Friendly work environment | Impactful product | Remote/distributed workMid-level Full TimeHyderabad, India1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Diverse and inclusive workplace | Laid-back atmosphere | Opportunity to make impact | Remote first 100 percent distributed environmentMid-level Full TimeChennai, India1d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Friendly laid-back atmosphere | Inclusive workplace | Opportunity to build impactful productMid-level Full TimeKochi, India1d ago
-
IN_Associate_AI Engineer_GCC_Advisory_Hyderabad INR 2500K-4800KAPI Development | Anthropic API | Async Programming | Autogen | CI/CDFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeHyderabad - Salarpuria, India1d ago
-
Data Engineer (SQL + Python/Java) INR 700K-1500KAWS EMR | Agile Scrum | Amazon Web Services | Apache Spark | Continuous DeliveryHybrid work flexibility | Remote work supportMid-level Full TimeGurgaon - Cyber Park, India1d ago