EY - GDS Consulting - AI And DATA - Azure Data Engineer - Senior
Hyderabad, TG, IN, 500081
INR 2520K-3500K (estimate) Senior-level Full Time
Tasks
- Build and deploy data pipelines
- Coordinate with business stakeholders
- Design and develop ETL
- Design and optimize model code
- Design data pipelines and workflows
- Develop and optimize PySpark code
- Implement Delta Table formats
- Migrate on prem ETL to cloud
- Optimize SparkSQL queries
- Support big data solution lifecycle
Perks/Benefits
Skills/Tech-stack
Agile | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Functions | Azure SQL | Azure SQL Data | Azure SQL Data Warehouse | Azure Synapse | Azure Synapse Analytics | Blob Storage | Data Factory | Data Lake Storage | Data Warehouse | Databricks | Delta Lake | Delta table | ETL | Logic Apps | PySpark | SQL | SQL Data Warehouse | SparkSQL | Synapse Analytics
Education
N/A
Roles
Related jobs
-
SR. DEVOPS ENGINEER and MLOps Engineer INR 2500K-3880KAI Agents | AWS | Alerting | CI/CD | ChatbotsCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600768h ago
-
Engineer AI/ML INR 1800K-2500KCloud Computing | Data Pipelines | Generative AI | Machine Learning | Model DeploymentFlexible work environment | Internal mobility | Remote or hybrid work option | Volunteering opportunities | Well-beingMid-level Full TimeKA Bangalore, India14h ago
-
Data Engineer II - Hyderabad (Hybrid) INR 1500K-1890KAPI Design | Azure Data | Azure Data Factory | Azure Databricks | CI/CDMid-level Full TimeIND-Hyderabad-Hybrid, India R14h ago
-
Data Engineer I -Hyderabad (Hybrid) INR 1500K-1500KAzure Data | Azure Data Factory | Azure Databricks | CI/CD | Data FactoryMid-level Full TimeIND-Hyderabad-Hybrid, India R14h ago
-
WFS Analytics 168231 INR 1500K-2400KAgile | Architectural patterns | Design Patterns | Java | JavaScriptMid-level Full TimeHyderabad, IND-TG, India20h ago
-
Senior Data Engineer INR 2520K-4000KAWS | Business Intelligence | Cloud platform | Data Modeling | Data QualityHybrid work | Professional development | Remote workSenior-level Full TimeDelhi NCR/Remote R23h ago
-
Senior Data Engineer INR 3000K-4000KAWS | AWS Data | AWS Data Services | Amazon Aurora | Apache SparkAccreditations | Bike to work | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeMumbai, MH, India1d ago
-
Lead Data Engineer INR 2520K-3880KAPI Integration | APIs | Airflow | Alerting | Attribution ModelsDay off on third Friday monthly | Monthly office commute reimbursement | Monthly wellness reimbursement | Paid Maternity Leave | Paid paternity leaveSenior-level Full TimeMumbai, MH, India1d ago
-
Senior Data Engineer INR 2400K-3500KAPI Integration | AWS | ETL | NumPy | PandasHybrid work | Professional development | Remote workSenior-level Full TimeGreater Delhi Area R1d ago
-
Lead Consultant, ETL Data Engineer and Python INR 2520K-4000KData Governance | Data Modeling | Data Quality | Data Warehousing | Data integrationSenior-level Full TimeIndia-Bangalore1d ago
-
Gen AI INR 2500K-4512KAPI Development | Chroma | Data Engineering | Faiss | JavaFull-time employmentSenior-level Full TimeIN-TN-Chennai1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Data Engineer INR 1200K-2040KAWS CDK | AWS Glue | AWS Glue Data Catalog | AWS Lambda | Amazon AthenaSenior-level Full TimeIN-TN-Chennai1d ago
-
Senior Data Engineer (R-19107) INR 2400K-3356KData Analysis | Data Modeling | Data Quality | Data Visualization | Data integrationSenior-level Full TimeHyderabad - India1d ago
-
Data Engineer (R-19111) INR 1500K-2000KData Analysis | Data Quality | Data Transformation | Data Visualization | Data cleaningMid-level Full TimeHyderabad - India1d ago
-
Core Data Platform - Software Engineering-Associate-Bengaluru INR 2500K-3500KAWS | AWS Lambda | Agile | CloudFormation | Data ModelingGlobal networks | Mindfulness programs | Personal finance offerings | Training and development | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Mid-level Full TimeGurgaon, Haryana, India1d ago
-
Software Engineer (Scala and Spark) INR 2516K-3356KAgile | Apache Spark | Azure | CI/CD | Cause analysisEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India1d ago
-
Software Engineer, Cloud Infrastructure Engineering INR 1000K-1500KAPIs | Capacity Planning | Compute Technologies | Data Structures | Data Structures and AlgorithmsMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Azure Data & Fabric Developer -Deputy Manager - RNA INR 1500K-2000KApache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryMid-level Full TimeMumbai, MH, India1d ago
-
Mid-level Full TimeGurgaon, HR, India1d ago
-
Assistant Manager - Data Engineering INR 1500K-2000KAPIs | Angular | Apache Airflow | BigQuery | CSSMid-level Full TimeGurgaon, HR, India1d ago
-
Quant Analytics Associate Senior INR 500K-1039KAgile | Alteryx | Data Mapping | Data Modeling | Data ReconciliationMid-level Full TimeMumbai, Maharashtra, India1d ago
-
Azure Databricks INR 1800K-2250KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Database Engineer II INR 2092K-3487KAgile Scrum | Cause analysis | Data Modeling | Database Indexing | Database functionsGrowth opportunities | Inclusive work culture | Mentorship | Professional development programsEntry-level Full TimeIndia1d ago