EY - GDS Consulting - AI And DATA - Azure Data Engineer - Senior
Hyderabad, TG, IN, 500081
INR 2520K-3500K (estimate) Senior-level Full Time
Tasks
- Build and deploy data pipelines
- Coordinate with business stakeholders
- Design and develop ETL
- Design and optimize model code
- Design data pipelines and workflows
- Develop and optimize PySpark code
- Implement Delta Table formats
- Migrate on prem ETL to cloud
- Optimize SparkSQL queries
- Support big data solution lifecycle
Perks/Benefits
Skills/Tech-stack
Agile | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Functions | Azure SQL | Azure SQL Data | Azure SQL Data Warehouse | Azure Synapse | Azure Synapse Analytics | Blob Storage | Data Factory | Data Lake Storage | Data Warehouse | Databricks | Delta Lake | Delta table | ETL | Logic Apps | PySpark | SQL | SQL Data Warehouse | SparkSQL | Synapse Analytics
Education
N/A
Roles
Related jobs
-
API | Apache Airflow | Automation Framework | Bitbucket | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India10h ago
-
Associate Machine Learning Data Engineer INR 1800K-3000KAPI Integration | Agent Orchestration | Apache Superset | Data Processing | Data cleaningChildcare support | Equipment allowance | Flexible work schedule | Gratuity payments | HolidaysMid-level Full TimeBangalore, Karnataka, India11h ago
-
Data Engineer INR 3000K-3880KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Data | Azure Data FactoryFlexible work arrangements | Health checkup | Long service awards | Medical insurance | Mobile Phone ReimbursementSenior-level Full TimePune, India12h ago
-
Lead Data Integration Engineer (SQL, Snowflake, Python) INR 3200K-4000KAgile | Airflow | Autosys JIL | Bitbucket | CI/CDHealth and life insurance | Hybrid work model | Paid time off | Professional development | Retirement Pension BenefitsSenior-level Full TimeHyderabad, India R12h ago
-
Quality Automation Engineer - Data (India)(Remote) INR 1500K-2000KAmazon Web Services | Azure | Azure Data | Azure Data Factory | Azure DevOpsCross-functional collaboration | Professional growth | Remote workMid-level Full TimeMaharashtra, Pune, India R13h ago
-
Senior - Azure Data Platform INR 3000K-4000KAPI Management | App Configuration | Azure API | Azure API Management | Azure AppSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Senior - Azure Data Platform INR 3000K-4000KAPI Management | Agile Scrum | App Configuration | Azure API | Azure API ManagementSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Senior-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior - Azure Data Platform INR 3000K-4000KAPI Management | Agile Scrum | App Configuration | Azure API | Azure API ManagementSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Senior - Azure Data Platform INR 3000K-4000KAPI Management | App Configuration | Azure App | Azure App Configuration | Azure ContainerSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Senior - Azure Data Platform INR 3000K-4000KAPI Management | App Configuration | Azure API | Azure API Management | Azure AppSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Assistant Manager - Azure Data Platform INR 1400K-1800KAPI Management | Access Control | Agile | App Configuration | Azure APIMid-level Full TimeBangalore, Karnataka, India13h ago
-
Assistant Manager - Azure Data Platform INR 1500K-2500KAPI Management | Agile Scrum | App Configuration | Azure API | Azure API ManagementMid-level Full TimeBangalore, Karnataka, India13h ago
-
Assistant Manager - Azure Data Platform INR 1400K-1800KAPI Management | Agile | App Configuration | Azure Container | Azure Container AppsMid-level Full TimeBangalore, Karnataka, India13h ago
-
Agile | Algorithms | Apache NiFi | Apache Spark | Data StructuresMid-level Full TimeBengaluru, Karnataka, India13h ago
-
Consultant - Gen AI INR 2800K-4000KAPIs | AWS | AWS SageMaker | Apache Airflow | Apache SparkAccess to AI research labs | Access to cloud innovation platforms | Certification support | MentorshipSenior-level Full TimeBangalore, Karnataka, India14h ago
-
Azure Data Platform Lead(India) (Remote) INR 2000K-3500KAlerting | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsCollaboration culture | Growth opportunities | Learning opportunities | Remote workSenior-level Full TimeMaharashtra, Pune, India R15h ago
-
Fullstack Data Engineer (India) (Remote) INR 1500K-2000KADLS | API | Amazon Kinesis | Amazon S3 | AngularMid-level Full TimeMaharashtra, Pune, India R16h ago
-
Senior Director of Software Engineering - Data Governance, AWS Data Analytics, Data Platform Architectures INR 1500K-2000KAWS Glue | AWS Lake Formation | AWS Redshift | Amazon Athena | Amazon EMRSenior-level Full TimeMumbai, Maharashtra, India17h ago
-
AI Engineer INR 2000K-3465KAKS | App Service | Azure App | Azure App Service | Azure CloudEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai/Pune, India17h ago
-
Machine Learning Engineer INR 1000K-1890KAWS | Agile | Algorithms | Apache Airflow | CI/CDEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai/Pune, India18h ago
-
Data Engineering INR 2829K-3380KApache Airflow | Apache Spark | Azure | Bitbucket | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai/Pune, India18h ago
-
Senior AI Engineer INR 1890K-2700KAWS | Agile Development | Artificial Intelligence | Automl | AzureAccidental insurance | Medical coverage | Paid annual leave | Paternity leave | Term insuranceSenior-level Full TimeAsia, Noida, India18h ago
-
Senior GenAI Engineers INR 2040K-3465KAgent Orchestration | Autogen | CI/CD | Classification | CrewAISenior-level Full TimePune, MH, IN22h ago
-
Mid level GenAI Engineers INR 1800K-3000KAgent Orchestration | Amazon Web Services | Autogen | Azure | ClassificationMid-level Full TimeBangalore, KA, IN22h ago