EY - GDS Consulting - AI And DATA -Azure Databricks - Senior
Bengaluru, KA, IN, 560016
INR 2040K-2400K (estimate) Senior-level Full Time
Tasks
- Design and deploy ETL pipelines
- Develop and deploy Azure Databricks in Azure
- Implement data governance and security
- Implement data quality rules
- Integrate and orchestrate data from multiple sources
- Maintain documentation of data pipelines and workflows
- Optimize data pipeline performance and scalability
- Participate in solution delivery lifecycle
- Perform data ingestion and data processing
Perks/Benefits
Skills/Tech-stack
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Functions | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | Big Data | Data Factory | Data Governance | Data Lake Storage | Data Quality | Data Security | Data Warehousing | ETL | NoSQL | PySpark | Python | Relational databases | SQL | SQL Database | Synapse Analytics
Education
Roles
Related jobs
-
Senior Software Engineer, Google Cloud Storage INR 2500K-3500KBenchmarking | C++ | Connectors | Debugging | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India1h ago
-
Staff Software Engineer, Machine Learning INR 2520K-3880KA/B | A/B Testing | Alerting | B testing | BackpressureEqual opportunity workplace | Health and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India6h ago
-
Sr. Staff Software Engineer, Machine Learning INR 3200K-4725KC++ | Data Pipelines | Deep learning | Experimentation | Generative AIHealth and wellness programs | Time away from workSenior-level Full TimeBengaluru, KA, India6h ago
-
Principal Staff Software Engineer, Systems Infrastructure INR 2100K-4500KAPI Design | Apache Hadoop | Apache Kafka | Apache Spark | Big DataHealth and wellness programs | Time away from workExecutive-level Full TimeBengaluru, KA, India6h ago
-
Principal Staff Software Engineer, Machine Learning INR 1800K-4000KA/B | A/B Testing | B testing | Backpressure Control | CachingHealth and wellness programs | Time awayExecutive-level Full TimeBengaluru, KA, India6h ago
-
Data Scientist I INR 2520K-4500KAWS | Amazon Bedrock | Amazon SageMaker | Autogen | BERTCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600666h ago
-
Senior-level Full TimePune, India8h ago
-
Senior-level Full TimeBangalore, INDIA R13h ago
-
AI Solutions Architect INR 2500K-4500KAWS | Convolutional Neural Networks | Data Governance | Distributed Systems | DockerSenior-level Full TimeIndia - Remote R13h ago
-
Senior Azure Fabric Data Engineer INR 1500K-2000KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote work | Work from homeSenior-level Full TimeIndia - Remote R13h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India13h ago
-
Data Engineer - Manager INR 2000K-2146KApache Kafka | Apache Spark | Azure | Azure Databricks | Data WarehousingEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India13h ago
-
Fraud Data Engineer, Assistant Vice President INR 600K-2000KAgile | Big Data | Confluence | Data Governance | Data QualityConfidential counseling | Employee Learning and Development | Paid parental leave | Paid time off | Telehealth accessExecutive-level Full TimeG-BLOCK, BANDRA-KURLA COMPLEX BANDRA EAST MUMBAI, …13h ago
-
Backend Engineer INR 2200K-3500KAKS | API documentation | Alerting | Asynchronous programming | AzureSenior-level Full TimeIND Bengaluru - Technology Campus, India13h ago
-
Senior-level Full TimeGurugram, India20h ago
-
Mid-level Full TimeGurugram, India20h ago
-
Software Engineer III - Data INR 2520K-3380KAWS | Apache Airflow | Apache Flink | Apache Spark | AzureERG events | Equipment provided | Health coverage | Learning and development | Paid HolidaysSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Senior Data & Analytics Systems Engineer INR 2520K-3380KApache Airflow | Apache Spark | Cloud Functions | Cloud Storage | Cloud platformSenior-level Full TimeGurugram, India21h ago
-
Mid-level Full TimeGurugram, India21h ago
-
FinOps Data Engineer INR 2520K-3380KAPI Gateway | AWS Glue | Agile | Amazon Athena | Amazon RedshiftSenior-level Full TimeGurugram, India21h ago
-
Senior Data Engineer INR 2520K-3380KAirflow | Apache Dataproc | CI/CD | Databricks | DataformDiversity & inclusion culture | Growth opportunitiesSenior-level Full TimeGurugram, India21h ago
-
Senior-level Full TimeGurugram, India21h ago
-
Senior Data Governance Engineer INR 2520K-3356KCloud platform | Collibra | Data Catalog | Data Governance | Data LineageSenior-level Full TimeGurugram, India21h ago
-
Data & Analytics Systems Engineer INR 2700K-3880KApache Airflow | Apache Spark | BigQuery | Cloud Functions | Cloud StorageMid-level Full TimeGurugram, India22h ago
-
Analytics Engineer INR 2520K-3380KBigQuery | Cloud platform | Data Modeling | Data Warehousing | Enterprise Performance ManagementEntry-level Full TimeGurugram, India22h ago