Azure Big Data Engineer | 4 to 8 Yrs | WFO | SOW 2024 2579
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Apply Medallion Architecture
- Build data storage solutions in Azure
- Deploy infrastructure with Bicep
- Design data pipelines in Azure
- Execute Azure Databricks notebooks
- Implement CI/CD pipelines with Azure DevOps
- Implement ETL using Azure Data Factory
- Implement incremental delta loads
- Monitor and resolve data pipeline issues
- Orchestrate ADF pipelines
- Set up data validation and cleansing
- Use Azure Synapse for SQL workloads
Perks/Benefits
Skills/Tech-stack
API Management | Azure API | Azure API Management | Azure Data | Azure Data Explorer | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure DevOps | Azure Functions | Azure Integration | Azure Integration Services | Azure SQL | Azure SQL Database | Azure Synapse | Bicep | CI/CD | Data Explorer | Data Factory | Data Lake | Data Lineage | Dedicated SQL Pool | Delta Lake | ETL Pipelines | Integration Services | Medallion Architecture | Netezza | Powershell | SQL | SQL Database | SQL Pool | Serverless SQL | Serverless SQL Pool | Spark Structured Streaming | Structured Streaming | Unity Catalog
Education
N/A
Related jobs
-
Senior-level Full TimeIN-HR-Gurgaon7h ago
-
Mid-level Full TimeIN-HR-Gurgaon7h ago
-
AI/ML Expert – Agentic AI Solutions INR 2500K-5000KAPI Development | Agentic AI | Artificial Intelligence | Automated testing | CI/CDSenior-level Full TimeIndia11h ago
-
Senior-level Full Timebengaluru, India12h ago
-
AI Engineer (M/F/D) INR 2500K-4000KAgents SDK | Azure | CI/CD | Docker | FastAPICareer development | Flexible working models | International networking | Learning opportunitiesMid-level Full TimeHyderabad, IN13h ago
-
Architect Data Products(M/F/D) INR 2000K-2800KAPIs | Automation | Azure | Azure Data | Azure Data FactoryCareer development | Flexible working models | Inclusive work environment | International networking | Learning opportunitiesSenior-level Full TimeHyderabad, IN13h ago
-
Cloud Data Engineer(M/F/D) INR 1500K-2000KAPIs | Automation | Azure | Azure Data | Azure Data FactoryCareer development | Flexible working hours | Inclusive work environment | International networking | Learning opportunitiesMid-level Full TimeHyderabad, IN13h ago
-
Senior Agentic AI Engineer (M/F/D) INR 2500K-5000KAI Foundry | Asyncio | Azure | Azure AI | Azure AI FoundryCareer development | Flexible working models | International networking | Learning opportunitiesSenior-level Full TimeHyderabad, IN13h ago
-
Assistant Forward Deployment Data Engineer INR 2200K-3500KAWS | Backup and Recovery | Bash | CI/CD | Configuration ManagementFrequent travel | On-site work | Temporary RelocationEntry-level Full TimeNew Delhi, Delhi, India21h ago
-
IN|KDN KRC|Nordics|Digital Audit -Tech Executive - NOI INR 4000K-5000KAlteryx | Data Cleansing | Data Governance | Data Transformation | Data ValidationExecutive-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Database Engineer MYSQL . INR 2000K-2500KAWS DocumentDB | AWS RDS | Alerting | Automation | AvailabilitySenior-level Full TimeBengaluru, India1d ago
-
Entry-level Full TimePune City, India1d ago
-
Lead Software Engineer - Pyspark, AWS, Databricks INR 3000K-5000KAWS | Agile | Apache Kafka | Application Resiliency | Automated testingSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Engineer INR 1500K-2500KAmazon Web Services | Apache Spark | Azure | Cloud platform | Data GovernanceEntry-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Sr Lead Software Engineer - Agentic AI INR 3500K-5000KA2A SDK | APIs | AWS Lambda | Amazon EKS | Amazon S3Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Engineer INR 1500K-2500KAmazon Web Services | Apache Spark | Azure | Cloud platform | Data GovernanceExposure to cloud data platforms | Hands-on learning environment | MentorshipEntry-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Data & Analytics Engineer - AM INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India1d ago
-
AWS DE- Gen AI INR 2000K-3300KAWS Glue | AWS Identity | AWS Identity and Access Management | AWS Identity and Access Management IAM | AWS LambdaSenior-level Full TimeIN-TN-Chennai1d ago
-
Senior DevOps Engineer - Storage Platforms | India INR 3000K-4000KAnsible | Bash | Block Storage | CI/CD | CentOSSenior-level Full TimeIndia, Bengaluru (Hybrid) R1d ago
-
Senior-level Full TimeIndia - Mumbai1d ago
-
Data Engineering / Sr. Associate Director, Software Engineering INR 1000K-2000KAPIs | Apache Airflow | Apache Beam | Auditability | Batch ProcessingMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Apache Airflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior-level Full TimeIndia - Mumbai1d ago
-
Lead Software Engineer - Lead Data Architect INR 3000K-5000KAWS | CI/CD | Cassandra | Data Governance | Data LineageSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Lead Data Engineer - Strategic Data Provisioning Data Engineer INR 3845K-5000KAI for Data | AI/ML | AWS | Agile | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India1d ago