Azure Big Data Engineer | 4 to 8 Yrs | WFO | SOW 2024 2579
Bangalore, Karnataka, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Apply Medallion Architecture
- Build data storage solutions in Azure
- Deploy infrastructure with Bicep
- Design data pipelines in Azure
- Execute Azure Databricks notebooks
- Implement CI/CD pipelines with Azure DevOps
- Implement ETL using Azure Data Factory
- Implement incremental delta loads
- Monitor and resolve data pipeline issues
- Orchestrate ADF pipelines
- Set up data validation and cleansing
- Use Azure Synapse for SQL workloads
Perks/Benefits
Skills/Tech-stack
API Management | Azure API | Azure API Management | Azure Data | Azure Data Explorer | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure DevOps | Azure Functions | Azure Integration | Azure Integration Services | Azure SQL | Azure SQL Database | Azure Synapse | Bicep | CI/CD | Data Explorer | Data Factory | Data Lake | Data Lineage | Dedicated SQL Pool | Delta Lake | ETL Pipelines | Integration Services | Medallion Architecture | Netezza | Powershell | SQL | SQL Database | SQL Pool | Serverless SQL | Serverless SQL Pool | Spark Structured Streaming | Structured Streaming | Unity Catalog
Education
N/A
Related jobs
-
Senior Solutions Engineer INR 2000K-4131KApache Spark | Big Data | Big data analytics | Cloud Computing | Data EngineeringSenior-level Full TimeIndia20h ago
-
AI Agents | AI Governance | API Security | Auditability | Cloud SecurityHybrid work | Onsite supportMid-level Full TimeBengaluru, Karnataka, India R1d ago
-
Machine Learning Engineer - APAC INR 3000K-4408KA/B | A/B Testing | B testing | CI/CD | ClassificationBenefits for family | Flexible working arrangements | Learning and development resources | Sabbaticals | Study assistanceMid-level Full TimeIndia-Bengaluru (Helios Business Park)1d ago
-
26-2292: Databricks Engineer- India, Hyderabad INR 1000K-2000KAIOps | Access Control | Amazon S3 | Anonymization | Apache KafkaMid-level Full TimeHyderabad/Vijayawada1d ago
-
Lead Software Engineer - Workday INR 1800K-2600KAPI Gateway | AWS CloudWatch | AWS Elastic Load Balancing | AWS Lambda | AWS VPCSenior-level Full TimeOff Embassy Golf Links Business Park, …1d ago
-
Value Data Engineer INR 1800K-2400KAPI | AWS | Agile | Azure | Data EnrichmentCab drop | Cab pickup | Flexible working hours | Subsidized mealsMid-level Full TimeBHUBANESWAR, India1d ago
-
Senior AI Engineer (m/f/d) INR 3242K-5000KAPIs | AWS | Agents | Angular | AzureHome office setup budget | Learning and development budget | Relocation support | Visa support | Work from homeSenior-level Full TimeRemote EMEA, Remote India R1d ago
-
Senior Data Engineer INR 1500K-2500KAirflow | Apache Spark | Confluence | Data Warehousing | DatabricksSenior-level Full TimeBengaluru, KA, IN1d ago
-
Senior II Data Engineer INR 3600K-4995KData Intelligence | Data Modeling | Fusion Data Intelligence | Oracle Cloud | Oracle DatabaseFlexible workingSenior-level Full TimeIndia1d ago
-
Senior-level Full TimeBengaluru, India1d ago
-
Senior Software Engineer, Google Cloud INR 2000K-3300KAgentic AI | CI/CD | Cloud Computing | Code review | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
BigQuery | CI/CD | Cloud Functions | Cloud Run | Cloud StorageContinuous professional development | Flexible workingMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Mid-level Full TimeIndia1d ago
-
Lead Software Engineer - (SRE principles , AI tools, AWS) INR 3000K-6000KAIOps | API Gateway | AWS ECS | AWS Lambda | Amazon APISenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior-level Full TimeMADURAI, TAMIL NADU, India1d ago
-
Analytics Engineer INR 2800K-4200KCI/CD | DBT | Dashboards | Data Quality | DatabricksHealth insurance | Hybrid work model | Mental health support | Paid time off | Transport allowanceSenior-level Full TimeBangalore (Hybrid) R1d ago
-
Snowflake + Python + SQL Developer INR 1500K-2500KAWS | Azure | DBT | Data Governance | Data ModelingSenior-level Full TimeBangalore, Karnataka, India1d ago
-
API | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid workSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
API | Agile | Apache Hadoop | Apache Kafka | Apache SparkHybrid work | Technical research opportunities | Training supportSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid work | Training opportunitiesSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Senior AI Engineer INR 3264K-5000KAI Foundry | Access Control | Agent Frameworks | Authentication | AzureSenior-level Full TimeIndia1d ago
-
Entry-level Full TimeBangalore, Karnataka, India1d ago
-
Platform Engineer INR 1500K-3900KADLS Gen2 | Azure | Azure Databricks | Azure Networking | Azure StorageSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
AI Engineer (Manager level) INR 1200K-2500KApache Spark | Azure AI | Azure CI | Azure CI/CD | Azure CognitiveMid-level Full TimeHyderabad, India1d ago
-
Senior Data Engineer | Offshore INR 1500K-2500KCI/CD | DBT | Data Dictionary | Data Quality | Dimensional ModelingSenior-level Full TimeIndia1d ago