Azure Big Data Specialist
INR 1500K-2125K (estimate) Senior-level Full Time
Tasks
- Attach Azure Data Factory and Databricks to Azure DevOps
- Build ETL workflows using Azure Data Factory
- Create and manage Azure infrastructure with Bicep
- Create data storage solutions
- Design data pipelines in Azure
- Develop transformations with Databricks
- Execute Databricks notebooks
- Implement Delta Lake
- Implement data ingestion processing and transformation
- Implement medallion architecture
- Improve scalability efficiency and cost of pipelines
- Monitor and resolve pipeline issues
- Orchestrate end to end data transformations with ADF
- Set up CI/CD pipelines with Azure DevOps
- Use serverless SQL pool and dedicated SQL pool
- Validate and cleanse data
Perks/Benefits
- N/A
Skills/Tech-stack
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure DevOps | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | Bicep | CI/CD | Data Cleansing | Data Factory | Data Lake | Data Validation | Databricks | Dedicated SQL Pool | Delta Lake | ETL | Medallion Architecture | Power Automate | Power BI | SQL Database | SQL Pool | Serverless SQL | Serverless SQL Pool | Synapse Analytics | Unit Testing
Education
N/A
Roles
Azure Data Engineer | Big Data Engineer | Data Engineer | Engineer
Related jobs
-
Senior-level Full TimeBengaluru, KA, IN5h ago
-
Sr SDE (Java + AI) INR 3000K-5000KAI orchestration | AWS | Alerting | Automated testing | AzureDesign review leadership | MentorshipSenior-level Full TimePune City, India7h ago
-
Staff Software Engineer - Data Platform INR 3000K-4000KAWS | Azure | Bazel | BigQuery | BuildkiteCell phone stipend | Free food | Holidays | In-office collaboration | Medical insuranceSenior-level Full TimeBengaluru, Karnataka, India, APAC15h ago
-
Senior AI Engineer – Data Science & Generative AI INR 2000K-5000KAPI Development | AWS | Agentic AI | Asynchronous programming | AutogenSenior-level Full TimeBengaluru, KA, IN18h ago
-
Lead Data Engineer INR 1500K-2500KApache Airflow | Apache Kafka | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIndia1d ago
-
Senior-level Full TimeHyderabad, IND-TG, India1d ago
-
Planview Administration 169576 INR 1500K-2500KData Governance | Data Modeling | Data Pipelines | Data Validation | ELTSenior-level Full TimeHyderabad, IND-TG, India1d ago
-
Senior-level Full TimeChennai, Tamil Nādu, India1d ago
-
AI / ML Developer / Engineer INR 2000K-3000KAI Agent | AI agent orchestration | Agent Orchestration | Artifact Registry | Backup and Disaster RecoveryMid-level Full TimeIndia1d ago
-
GCP Backend Developer / Engineer INR 3000K-5000KAgile | BigQuery | CI/CD | Cloud Functions | Cloud RunSenior-level Full TimeIndia1d ago
-
Sr.DataOPS Developer INR 2000K-3000KAWS Greengrass | Airflow | Apache Flink | Apache Kafka | Apache Kafka StreamsSenior-level Full TimeBangalore, India1d ago
-
DevOps Track Sr.Engineer INR 3000K-4200KAccess Control | Access Control Lists | Azure | Azure Dashboards | Azure DataSenior-level Full TimeIndia1d ago
-
Data Scientist INR 3000K-5000KAWS | Airflow | Amazon SageMaker | Apache Spark | Azure Machine LearningSenior-level Full TimeIN-MH-Pune1d ago
-
Net Core Azure Cosmos DB Gen AI INR 1800K-3300K.NET | API Management | ASP.Net Core | App Service | Application InsightsMid-level Full TimeIN-KA-Bangalore1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Data Platform Engineer- Azure Databricks INR 2000K-3900KAccess Management | Ansible | Apache Ranger | Azure Data | Azure Data LakeSenior-level Full TimeNoida, Uttar Pradesh, UTTAR PRADESH, India1d ago
-
DE&A - Core - Advanced Data Engineering - Ab Initio INR 3000K-4200KAb Initio | Checkpointing | Data Lineage | Data Manipulation | Data Manipulation LanguageSenior-level Full TimeIndia1d ago
-
Mid-level Full TimeHyderabad, India1d ago
-
Senior-level Full TimeBangalore, Karnataka, India1d ago
-
Database Engineering Associate - Snowflake Developer INR 1500K-2000KAPI Integration | AWS | Access Management | Agile | Batch ProcessingFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R1d ago
-
ETL, Data Modeler, Advanced SQL/Senior Consultant Specialist INR 3000K-4000KA/B | A/B Testing | APIs | Airflow | AlationContinuous professional development | Flexible working | Inclusive and diverse environmentSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Data Engineer (.NET Specialist) INR 2400K-3380K.Net Core | ASP.NET | Angular | App Service | Azure AppCustomer-facing role | On call support rewardsSenior-level Full TimePune, MH, India1d ago
-
Business Intelligence Engineer - Snowflake Developer INR 2500K-4132KAgile | Airflow | Bitbucket | CI/CD | Common table expressionsFlexible remote days | Health insurance | Hybrid work model | Life insurance | Paid time offSenior-level Full TimeHyderabad, India R1d ago
-
Mid-level Full TimeChennai, Tamil Nadu, India1d ago
-
Mid-level Full TimeHyderabad, Telangana, India1d ago