EY - GDS Consulting - AI And DATA - Databricks - Senior
Noida, UP, IN, 201301
INR 2040K-2461K (estimate) Senior-level Full Time
Tasks
- Build data quality rules and transformations
- Design and optimize code for faster execution
- Design, develop, and deploy ETL pipelines
- Develop and deploy Azure Databricks in cloud environment
- Implement data governance and security measures
- Implement data migration and processing using Azure services
- Maintain documentation for data pipelines and workflows
- Optimize data pipelines for performance and scalability
Perks/Benefits
Skills/Tech-stack
Agile | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Functions | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | Big Data | Data Factory | Data Governance | Data Lake Storage | Data Migration | Data Quality | Data Security | Data Warehousing | ETL | PySpark | Python | SQL | SQL Database | Synapse Analytics
Education
Roles
Related jobs
-
Lead Consultant - Data Engineer INR 2500K-3380KData Governance | Data Integrity | Data Modeling | Databricks | ETLSenior-level Full TimeIndia-Bangalore4h ago
-
Senior Consultant INR 2500K-4000K.Net Core | ASP.Net Core | Azure AI | Azure Machine Learning | Azure OpenAISenior-level Full TimeIN-AP-Hyderabad4h ago
-
AIML Python with AI INR 2500K-3500KAPIs | Computer Vision | Deep learning | Language Processing | MLOpsSenior-level Full TimeIN-AP-Hyderabad4h ago
-
AIML Python with AI Architect INR 2500K-4500KComputer Vision | Deep learning | Feature Engineering | Language Processing | MLOpsSenior-level Full TimeIN-AP-Hyderabad4h ago
-
AI Solutions Lead INR 2500K-4000KAWS | Data Lake | Data Pipelines | Data Warehousing | Deep learningSenior-level Full TimePune, MAHĀRĀSHTRA, India5h ago
-
Executive-level Full TimeBangalore, Karnataka, India6h ago
-
AI Lead - Gen AI Solution INR 2500K-4500KControlNet | Cosmos DB | DETR | Docker | FP8Full-time employment | Hybrid work | Permanent roleSenior-level Full TimeKochi, Kerala, India6h ago
-
Senior-level Full TimeKochi, Kerala, India6h ago
-
Manager - Analytic Engineering INR 2000K-2400KAWS Glue | Airflow | Amazon Athena | Amazon Redshift | Apache SparkSenior-level Full TimeThane, Maharashtra, India6h ago
-
Senior-level Full TimeBengaluru, Karnataka, India6h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 2500K-4500KAPIs | Batch Processing | BigQuery | CI/CD | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India; Gurgaon, Haryana, India6h ago
-
Entry-level Full TimePune, India6h ago
-
Software Engineer II - AI/ML INR 1400K-2000KAWS | Apache Hadoop | Apache Spark | Azure | Computer VisionAgile team | Career growth | Diversity inclusion respectMid-level Full TimeMumbai, Maharashtra, India6h ago
-
Applied AI/ML Senior Associate INR 2500K-4000KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Applied AI/ML Lead INR 2500K-3000KApache Hive | Apache Spark | Keras | Language Models | Language ProcessingSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Business Intelligence Engineer INR 1400K-1700KAgile | Jira | SQL | SnowflakeFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R7h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1400K-2000KAutogen | Claude | Cloud Computing | CrewAI | FastAPIMid-level Full TimePune, Maharashtra, India7h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1400K-2000KAgent Frameworks | Autogen | Claude | Cloud Computing | CrewAIMid-level Full TimeBangalore, Karnataka, India7h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1400K-2000KAgent Frameworks | Autogen | Claude | Cloud Computing | CrewAIMid-level Full TimePune, Maharashtra, India7h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1400K-2000KAutogen | Claude | CrewAI | FastAPI | FlaskMid-level Full TimeBangalore, Karnataka, India7h ago
-
Mid-level Full TimeBengaluru, KA, IN7h ago
-
Manager INR 300K-370KApache Airflow | Data Modeling | Data Pipeline Architecture | Data Processing | Data pipelineSenior-level Full TimeIndia8h ago
-
Staff Software Engineer - Machine Learning INR 2500K-3800KAgentic AI | Anthropic | Cost Optimization | Evaluation | Inference OptimizationSenior-level Full TimeHyderabad, India8h ago
-
Senior Big Data Engineer INR 800K-1500KAmazon EMR | Amazon Kinesis | Amazon S3 | Apache Airflow | Apache FlinkSenior-level Full TimeChennai, India8h ago
-
Graduate Engineer Data -Analyst - MFT - KGS CH INR 400K-700KBusiness Intelligence | Cloud | Containers | Data Governance | Data ModelingEntry-level Full TimeBangalore, Karnataka, India8h ago