EY - GDS Consulting - AI And DATA - Data Engineer Solution Architect - Manager
Bengaluru, KA, IN, 560048
INR 2040K-4000K (estimate) Senior-level Full Time
Tasks
- Architect and build production data pipelines
- Build and maintain Python analytics workflows
- Define architecture standards and governance
- Deliver curated datasets for Power BI
- Design batch and real time processing
- Design enterprise data architecture
- Develop Jupyter notebooks
- Develop data storage and modeling for analytics
- Enable advanced analytics and AI capabilities
- Ensure secure data handling and access control
- Establish data lineage and auditing
- Implement CI/CD pipelines for data workloads
- Implement data quality validation
- Lead data platform modernization
- Monitor and troubleshoot pipeline failures
- Track experiments and manage model lifecycle with MLflow
Perks/Benefits
Skills/Tech-stack
Access Control | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure SQL | Azure Synapse | Azure Synapse Analytics | Batch Processing | CI/CD | Data Factory | Data Governance | Data Lake | Data Lineage | Data Modeling | Data Processing | Data Quality | Jupyter Notebook | MLflow | Power BI | Python | Real Time | Real-time Data | Real-time Data Processing | Snowflake Schema | Star Schema | Synapse Analytics
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Staff - Software Engineering INR 2515K-3500KAWS | AWS Glue | AWS Lambda | Amazon Kinesis | Amazon SNSCareer growth and development | Flexible workSenior-level Full TimePune5h ago
-
Principal Engineer - Data Engineering INR 1500K-5800KApache Iceberg | Apache Spark | Change Data Capture | Cloud Architecture | Data CaptureExecutive-level Full TimeHyderabad, India6h ago
-
Staff Software Engineer (Python) INR 3000K-5000KAPIs | Alerting | Amazon Web Services | Authentication | Cloud platformCollaborative team environment | Diverse projects | Global consulting environment | Leadership development | Training sessionsSenior-level Full TimeMumbai, MH, India7h ago
-
Senior Software Engineer INR 2500K-3465KAPIs | Amazon Web Services | CI/CD | Cloud platform | Distributed SystemsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India7h ago
-
(Services) Data Engineer INR 1500K-2400KAPI Integration | Apache Spark | Azure | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad8h ago
-
FinOps Engineer INR 1500K-3500KAWS | Amazon QuickSight | Amazon Redshift | Azure | Cloud billingCross-functional collaboration | Hybrid work | Mandatory office days 3 per weekSenior-level Full TimeBangalore8h ago
-
Principal Solutions Architect - Data Engineering INR 3000K-3880KADLS | AWS | Agile | Airflow | Apache FlinkBonuses for approved content | Broadband reimbursement | Medical insurance | Paid certifications | Professional development allowanceSenior-level Full TimeIndia - Remote R9h ago
-
DE-Legacy Modernization-Gen AI Developer-UC-GDSF02 INR 1850K-3550K.NET | AI Foundry | API Gateway | AS400 | AWSMid-level Full TimeHyderabad, TG, IN, 50008111h ago
-
Apprentice - Data Ops Engineer INR 360K-400KNumPy | Power BI | Python | SQL | SciPyApprenticeship | MentorshipEntry-level ApprenticeshipNoida, Uttar Pradesh, India13h ago
-
Senior Data Engineer (SSIS/SSRS) INR 2000K-2500KData Modeling | Data Pipelines | Data Warehousing | Data integration | ETLSenior-level Full TimeIN KA Bengaluru, India13h ago
-
Data Test Engineer (ETL Testing) INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCross-functional team collaboration | Hybrid work | Remote workMid-level Full TimeNCR Region, DL, IN13h ago
-
DBT/Snowflake Engineer INR 1200K-2000KAzure DevOps | CI/CD | DBT | Data Modeling | Dimensional ModelingSenior-level Full TimeBangalore, KA, IN13h ago
-
Senior-level Full TimeBangalore, KA, IN13h ago
-
Agile methodology | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India13h ago
-
DBT/Snowflake Engineer INR 1200K-2000KAzure DevOps | CI/CD | DBT | Data Warehousing | Dimensional ModelingSenior-level Full TimeBangalore, KA, IN13h ago
-
Airframe Data Scientist - Robust AI/ML INR 2000K-3500KAWS | Computer Aided Design | Computer Vision | Data extraction | Deep learningSenior-level Full TimeBangalore (Airbus), India R13h ago
-
Gen AI -Architect -GR - 39330-68617-JR182517 INR 2475K-3500KA/B | A/B Testing | Authentication & Authorization | B testing | CI/CDSenior-level Full TimeIND-KA-Bengaluru, Bagmane Solarium City, India13h ago
-
Lead Software Engineer - Full Stack Developer and Gen AI INR 2755K-3500KAPI Integration | Agent Orchestration | Angular | Asynchronous programming | Azure DevOpsSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India13h ago
-
A/B | A/B Testing | AWS Glue | AWS Lambda | AWS Model RegistrySenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …13h ago
-
A/B | A/B Testing | AUC-ROC | AWS Lambda | AWS S3Career growth opportunities | Flexible career development | MentorshipSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …13h ago
-
AWS | CI/CD | Databricks | Delta Lake | Feature StoreMid-level Full TimeHyderabad - Phoenix Equinox Tower 2, …13h ago
-
A/B | A/B Testing | AUC-ROC | Amazon Web Services | B testingCareer development | Collaborative work environment | Flexible growth opportunities | MentoringSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …13h ago
-
Machine Learning Engineer, Specialist INR 2500K-4800KAWS Glue | AWS Lambda | Amazon S3 | Amazon SageMaker | CI/CDFinancial wellness programs | Hybrid work model | Personal wellness resources | Physical wellness benefits | Wellness supportSenior-level Full TimeHyderabad, India13h ago
-
Senior Software Engineer with Python & Gen AI experience INR 2000K-2829KAWS | Agile Scrum | Azure | CI/CD | DevOpsEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India17h ago
-
Software Engineer - Infra + Data INR 2200K-3465KAWS Glue | Alerting | Amazon EKS | Apache Iceberg | Apache KafkaEntry-level Full TimeBangalore22h ago