EY - GDS Consulting - AI and DATA - AWS Databricks - Senior
Bengaluru, KA, IN, 560016
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Build data lakehouse solutions
- Collaborate with data analytics and BI teams
- Deploy data pipelines
- Develop ETL/ELT pipelines
- Ensure end-to-end data quality
- Implement medallion architecture
- Implement metadata-driven ingestion
- Manage Databricks lakehouse
- Migrate on premises ETL to AWS
- Model data warehouse schemas
- Optimize ETL/ELT pipelines
- Orchestrate data workflows
- Perform code reviews
- Troubleshoot data pipeline issues
Perks/Benefits
- Coaching and learning programs
- Flexible work arrangements
- Global knowledge exchange
- Inclusive & Supportive Culture
- Personalized growth plan
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | AWS Step Functions | Amazon S3 | Apache Airflow | Astronomer | Azure DevOps | CI/CD | CSV | CloudWatch | Databricks | Dimensional Modeling | ELT | ETL | GitHub | Iceberg | JSON | Jenkins | Parquet | PySpark | Python | SQL | Scala | Snowflake Schema | Star Schema | Step Functions | Unity Catalog | Unix/Linux | XML
Education
Roles
Related jobs
-
Senior-level Full TimeIN-KA-Bangalore23h ago
-
Mid-level Full TimeIN-KA-Bangalore23h ago
-
Software Engineer - Data Engineer INR 2617K-3465KAWS | Amazon Redshift | Apache Kafka | Apache Spark | AzureAccess to cutting-edge technologies | BeBrilliant recognition | Collaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
Associate Engineer - Embedded AI & Data Analytics INR 1000K-1141KC++ | Classification | Data Modeling | Data Preprocessing | Data ValidationMid-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
API Development | AWS | Azure | Azure Cognitive | Azure Cognitive ServicesClient-facing exposure | Mentorship and coaching | Travel opportunitiesMid-level Full TimeNew Delhi, India1d ago
-
Java - Senior Developers INR 1500K-3000KAPI Design | AWS | CI/CD | Design Patterns | DevSecOpsContinuous improvement | Cross-functional collaboration | MentorshipSenior-level Full TimeIndia1d ago
-
Senior-level Full TimeNoida, UTTAR PRADESH, India1d ago
-
AI/ML | API | Airflow | CI/CD | Cloud TestingEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai/Pune, India1d ago
-
A/B | A/B Testing | Attention | B testing | CI/CDSenior-level Full TimeIndia1d ago
-
Associate III Software Engineering-SUPPORT SERVICES-Data & Analytics - In House Engineering INR 1300K-2500KAWS | Apache Kafka | Azure | Docker | GCPImmediate joiningMid-level Full TimeHyderabad, Telangana, India1d ago
-
Associate III Software Engineering-SUPPORT SERVICES-Data & Analytics - In House Engineering INR 1300K-2500KAWS | Azure | CI/CD | Docker | GCPMid-level Full TimeHyderabad, Telangana, India1d ago
-
Associate III Software Engineering-SUPPORT SERVICES-Data & Analytics - In House Engineering INR 1300K-2500KAWS | Agile | Algorithms | Azure | CI/CDMid-level Full TimeHyderabad, Telangana, India1d ago
-
Data Quality Engineer, Enterprise Data Platform - Data Quality & Data governance) , AWS , SQL & Python , Cloud, Power BI INR 1500K-2000KAWS Glue | AWS Glue Catalog | Amazon Athena | Amazon EMR | Amazon RedshiftMid-level Full TimeBengaluru, KA, India1d ago
-
Senior-level Full TimeBengaluru, India1d ago
-
AWS | Azure | CD pipelines | CI/CD | CI/CD pipelinesCareer growth | Flexible engagement | Fully remoteSenior-level Full TimeIndia R1d ago
-
Mid-level Full TimeBengaluru, India1d ago
-
Data Governance | Data Modeling | Data Quality | Data Security | Data WarehousingCareer growth | Collaborative environment | Continuous learning | Flexible day shift | Fully remote workSenior-level Full TimeIndia R1d ago
-
Mid-level Full TimeBengaluru, India1d ago
-
Software Engineer - Machine Learning, Trust and Safety INR 2500K-4000KA/B | A/B Testing | B testing | Cloud Computing | Content ModerationFlexible work hours | Flextime | Hybrid workstyleSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Software Development Engineer 4 INR 1500K-2800KAI Foundry | API Gateway | AWS Step Functions | Airflow | Amazon EventBridgeSenior-level Full TimeBangalore, India R1d ago
-
Sr. Data Engineer INR 2800K-4000KAgile | Apache Airflow | Apache Hive | Apache Spark | Batch ProcessingAnnual leave | Contributory pension scheme | Diversity forums | Hybrid work | Mindfulness app accessSenior-level Full TimePune, India R1d ago
-
Data Engineering Operations Lead INR 3000K-4000KAgile | Apache Airflow | Apache Hive | Apache Spark | BigQueryAnnual leave | Away from keyboard time | Contributory pension scheme | Diversity forums and networking groups | Fitness Wellbeing ProgrammesSenior-level Full TimePune, India R1d ago
-
Senior Enterprise Cloud Software Engineer (Cloud Operations, AI Engineering, Azure & AWS) INR 2500K-4000KAKS | APM | ARM | AWS SDK | Access ManagementSenior-level Full TimeIND - Chennai, Neville Towers, India1d ago
-
Senior-level Full TimeBengaluru, KA, IN, 5600161d ago
-
Senior Computer Scientist 1 INR 2475K-3800KAI orchestration | CI/CD | Cloud Platforms | Docker | Integration TestingSenior-level Full TimeNoida, India R1d ago