Azure Big Data Engineer | 4 to 8 Yrs | WFO | SOW 2024 2579
Bangalore, Karnataka, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Apply Medallion Architecture
- Build data storage solutions in Azure
- Deploy infrastructure with Bicep
- Design data pipelines in Azure
- Execute Azure Databricks notebooks
- Implement CI/CD pipelines with Azure DevOps
- Implement ETL using Azure Data Factory
- Implement incremental delta loads
- Monitor and resolve data pipeline issues
- Orchestrate ADF pipelines
- Set up data validation and cleansing
- Use Azure Synapse for SQL workloads
Perks/Benefits
Skills/Tech-stack
API Management | Azure API | Azure API Management | Azure Data | Azure Data Explorer | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure DevOps | Azure Functions | Azure Integration | Azure Integration Services | Azure SQL | Azure SQL Database | Azure Synapse | Bicep | CI/CD | Data Explorer | Data Factory | Data Lake | Data Lineage | Dedicated SQL Pool | Delta Lake | ETL Pipelines | Integration Services | Medallion Architecture | Netezza | Powershell | SQL | SQL Database | SQL Pool | Serverless SQL | Serverless SQL Pool | Spark Structured Streaming | Structured Streaming | Unity Catalog
Education
N/A
Related jobs
-
Senior-level Full TimeHyderabad, India1d ago
-
Embedded Developer - IOT Connectivity INR 1000K-1800KAWS IoT | AWS IoT Core | Automated testing | Azure IoT | Azure IoT HubFlexible hours | Health insurance | On-demand training | Paid volunteering leave | Parental supportMid-level Full TimeChennai, TN, IN, 6000971d ago
-
Senior ML Engineer INR 3000K-4000KAzure | Azure DevOps | Change Management | Classification | ClusteringAnnual leave | Employee assistance programme | Employee wellbeing platform Unmind | Flexible working | Learning and development opportunitiesSenior-level Full TimeChennai, IN1d ago
-
Data Engineer Platform and Tools – Google Cloud Platform (GCP) INR 1500K-2500KAirflow | BigQuery | CI/CD | Cloud Build | Cloud ComposerSenior-level Full TimeHyderabad, India2d ago
-
Senior-level Full TimeHyderabad India - Block B2d ago
-
Staff Database Platform Engineer INR 2500K-4200KAWS IAM | AWS RDS | Amazon EC2 | Amazon S3 | AnsibleSenior-level Full TimeIN - India - Bangalore2d ago
-
Apache Beam | Apache Cassandra | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeBangalore, India2d ago
-
Agentic AI Engineer - Senior Manager INR 3000K-5000KAgent Orchestration | Agent systems | Agile methodology | Amazon Web Services | C++Employee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India2d ago
-
Agentic AI Engineer - Senior Manager INR 3000K-5000KAWS | Agent systems | Agile | Azure | C++Employee networks | Flexible work/life support | Paid volunteer daysSenior-level Full TimeHyderabad, India2d ago
-
Agentic AI Engineer - Assistant Manager INR 2000K-5000KAWS | Azure | C++ | CI/CD | DockerEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India2d ago
-
Agentic AI Engineer - Senior Manager INR 3000K-5000KA2A protocol | AWS | Agent Orchestration | Agent systems | Agile DevelopmentEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India2d ago
-
Agentic AI Engineer - Assistant Manager INR 2000K-5000KAWS | Azure | C++ | CI/CD | DockerEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India2d ago
-
AI Data & Knowledge Engineer - Assistant Vice President INR 4000K-6000KAirflow | Big Data | Big data architecture | CI/CD | Data ArchitectureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysExecutive-level Full TimeHyderabad, India2d ago
-
Spclst , Data Engineering INR 1163K-2558KAWS EMR | AWS Glue | AWS IAM | AWS Lake | AWS Lake FormationMid-level Full TimeIND - Telangana - Hyderabad (Hitec …2d ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India2d ago
-
Senior Manager INR 2000K-5000KAWS | Agents SDK | Anthropic Claude | Anthropic Claude API | AuthenticationSenior-level Full TimeNoida, Uttar Pradesh, India2d ago
-
Mid-level Full TimeHaryana, India R2d ago
-
Continuous integration | Development Lifecycle | Git | JavaScript | LaravelCo-working space | Mentorship | Modern equipment | Training programs | Trial dayMid-level Full TimeChennai, Hybrid R2d ago
-
Associate - Analytics Solution INR 1000K-1500KAgile | Alteryx | Artificial Intelligence | Confluence | Data GovernanceMid-level Full TimeBengaluru, Karnataka, India2d ago
-
AI Developer INR 346K-360KAWS | Agile | Amazon EventBridge | CI/CD | Cloud ComputingMedical benefits | Paid time off | Wellbeing benefits | Work-life balanceEntry-level Full TimeHyderabad, India2d ago
-
Principal Data Engineer Data Technology INR 3000K-4000KAPIs | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimePune, Maharashtra, India R2d ago
-
Senior Data Scientist - AI Engineering INR 3264K-5000KAWS | AWS Bedrock | Agentic AI | Anthropic Claude | Automated RegressionCareer growth | Company-sponsored certifications | Innovation time | Mentorship | SnacksSenior-level Full TimeHyderabad, TS, India2d ago
-
Advanced Engineer - Data Engineer INR 2475K-3465KAWS | Amazon Redshift | Apache Hadoop | Apache Spark | AzureAccess to cutting-edge technologies | Collaborative work environment | Professional growth and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …2d ago
-
Data Engineer _ ALM - MTCR INR 1500K-3000KApache Hive | Apache Spark | Apache YARN | Bitbucket | CDEHybrid workSenior-level Full TimeIndia - Pune R2d ago
-
Senior Analytics Engineer INR 3600K-5000KAI Agents | AI Evaluation | AI Foundry | API Development | Agent OrchestrationSenior-level Full TimeIndia2d ago