Azure Big Data Specialist
Bengaluru, KA, India
INR 1500K-2125K (estimate) Senior-level Full Time
Tasks
- Attach Azure Data Factory and Databricks to Azure DevOps
- Build ETL workflows using Azure Data Factory
- Create and manage Azure infrastructure with Bicep
- Create data storage solutions
- Design data pipelines in Azure
- Develop transformations with Databricks
- Execute Databricks notebooks
- Implement Delta Lake
- Implement data ingestion processing and transformation
- Implement medallion architecture
- Improve scalability efficiency and cost of pipelines
- Monitor and resolve pipeline issues
- Orchestrate end to end data transformations with ADF
- Set up CI/CD pipelines with Azure DevOps
- Use serverless SQL pool and dedicated SQL pool
- Validate and cleanse data
Perks/Benefits
- N/A
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure DevOps | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Data Cleansing | Data Factory | Data Lake | Data Validation | Databricks | Dedicated SQL Pool | Delta Lake | ETL | Medallion Architecture | Power Automate | Power BI | SQL Database | SQL Pool | Serverless SQL | Serverless SQL Pool | Synapse Analytics | Unit Testing
Education
N/A
Roles
Azure Data Engineer | Big Data Engineer | Data Engineer | Engineer
Related jobs
-
Senior-level Full TimePune City, India3h ago
-
AI Engineer – Reliability & Warranty Analytics INR 1800K-3000KBacktesting | BigQuery | CI/CD | Calibration | Cloud RunMid-level Full TimeChennai, Tamil Nadu, India5h ago
-
Associate III Business Intelligence-SUPPORT SERVICES-Data & Analytics - In House Engineering INR 800K-1800KBig Data | Big data concepts | C++ | Data Visualization | Data conceptsMid-level Full TimeBangalore, Karnataka, India6h ago
-
AI Engineer – Retail/CPG Domain INR 1800K-2500KAWS | Azure | Data Governance | Data Modeling | Data SecurityMid-level Full TimeGurugram, Haryana, India6h ago
-
Associate Principal Engineer (India Office) INR 1500K-2000KADLS | Azure Data | Azure Data Factory | Azure DevOps | CDCMid-level Full TimeBangalore, Karnataka, India7h ago
-
Senior-level Full TimePune, Maharashtra, India7h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India8h ago
-
Applied AI ML Lead INR 2500K-4800KAI Agents | AWS Lambda | AWS S3 | AWS Step Functions | Agentic AISenior-level Full TimeHyderabad, Telangana, India8h ago
-
Agentic AI | Agile | DAX | Data Governance | Data ModelingSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Lead Software Engineer - Java/Python, LLM, AWS INR 3000K-5000KA/B | A/B Testing | AWS | Agile | Amazon AuroraSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Platform Engineering Professional - Data Engineer INR 2200K-3500KAWS | Amazon Kinesis | Apache NiFi | Apache Spark | CI/CDMid-level Full TimeBengaluru, IN, 5601038h ago
-
AWS Data Engineer INR 1500K-6000KAWS | Automation | Cloud Architecture | Data Governance | Data IngestionExecutive-level Full TimeHyderabad, Telangana, India9h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India10h ago
-
SDET- India (Chennai/Bangalore) INR 1500K-2000KAWS S3 | Apache Airflow | Apache Superset | BDD | Big DataMid-level Full TimeIndia11h ago
-
Amazon Web Services | Cloud platform | Data Modeling | Databricks | Distributed SystemsBroadband reimbursement | Continuous learning support | Global enterprise client exposure | Health insurance | Paid certificationsSenior-level Full TimeIndia12h ago
-
Analytics Engineer - Associate INR 1800K-2800KAirflow | Alerting | Azure Data | Azure Data Factory | DagsterSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Mid-level Full TimeBengaluru, Karnataka, India17h ago
-
EY - GDS Consulting - AIA - Agentic AI Engineer - Manager INR 1850K-3300KAWS | Async | Autogen | Azure | CelonisContinuous learning | Diverse and inclusive culture | Transformative leadershipMid-level Full TimeKolkata, WB, IN, 70009117h ago
-
EY - GDS Consulting - AI And DATA - Data Engineer-Staff INR 1500K-2500KAWS | AWS Glue | AWS Lambda | AWS Secrets | AWS Secrets ManagerSenior-level Full TimeTrivandrum, KL, IN, 69558117h ago
-
EY-GDS Consulting-AI And DATA-Data Engineer-Senior INR 3000K-4000KAWS | AWS Glue | AWS Lambda | AWS Secrets | AWS Secrets ManagerSenior-level Full TimeTrivandrum, KL, IN, 69558117h ago
-
IN_Associate _Agentic + Gen AI__AI-50_ Advisory_ Bangalore INR 1500K-2500KAcceptance Test | Acceptance Test-Driven Development | Agentic AI | AutoGPT | CI/CDMid-level Full TimeBengaluru Millenia, India17h ago
-
API Management | Agentic AI | AutoGPT | CI/CD | Code reviewFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India17h ago
-
API Management | CI/CD | Dspy | Fine Tuning | Generative AIFlexible working arrangements | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India17h ago
-
IN_Associate_AI Engineer_GCC_Advisory_Bangalore INR 2000K-4800KAPI Development | Async Programming | CI/CD | Docker | Embedding ModelsSenior-level Full TimeBengaluru Millenia, India17h ago
-
Apache Spark | CI/CD | Data Governance | Data Modeling | Data QualityFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India17h ago