Azure Subcontractor
INDIA - HYDERABAD - BIRLASOFT OFFICE, IN
INR 1500K-2500K (estimate) Senior-level Contract
Tasks
- Build batch and streaming data pipelines
- Collaborate with stakeholders on data requirements
- Create reusable Databricks notebooks workflows and jobs
- Design ETL pipelines using Databricks
- Develop Apache Spark data processing frameworks
- Develop Delta Lake tables
- Follow coding standards version control and CI CD best practices
- Integrate data from databases APIs and cloud storage
- Monitor and troubleshoot pipeline failures
- Optimize data storage with partitioning and Z ordering
- Perform code reviews and technical design discussions
- Transform cleanse and validate data
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | Amazon EMR | Amazon S3 | Apache Airflow | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Cloud Storage | Data Factory | Data Lake Storage Gen2 | Data Modeling | Data Warehousing | Databricks | Delta Lake | ELT | ETL | Git | Google BigQuery | Google Cloud | Google Cloud Storage | Partitioning | PySpark | Python | SQL | Spark Structured Streaming | Structured Streaming | Unity Catalog | Z-Order
Education
N/A
Roles
Related jobs
-
Advanced Engineer - Data Engineer INR 2475K-3465KAWS | Amazon Redshift | Apache Hadoop | Apache Spark | AzureAccess to cutting-edge technologies | Collaborative work environment | Professional growth and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …5h ago
-
Data Engineer INR 302K-480KAgile | Apache Airflow | Cloud Composer | Cloud Storage | Cloud platformEntry-level Full TimeIN-MH-Pune5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
AI & ML Development Lead INR 2500K-5000KAPI Development | AWS | Agent systems | Azure | Cloud PlatformsSenior-level Full TimeGurugram, Haryana, India6h ago
-
Senior Data Management Professional – Process Automation & Data Operations, Company Financials Data , Pune INR 2800K-4000KCI/CD | Cause analysis | Data Governance | Data Monitoring | Data ObservabilityPlatinum customer supportSenior-level Full TimePune6h ago
-
CDP,Snowflake,SQL,Java, API, AWS - (6-9 Yrs) - CHN INR 2000K-3000KAPI Integration | AWS | Audience Management | Customer Data | Customer Data PlatformSenior-level Full TimeIndia6h ago
-
Data Engineer ((SSIS, SQL and Azure Data Factory) INR 1000K-1700KAzure Data | Azure Data Factory | Data Factory | Databricks | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India7h ago
-
API Integration | AWS | Anomaly Detection | Azure | Data LineageSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Data Engineer INR 1500K-2500KAmazon Web Services | Data Governance | Data Modeling | Data Quality | Data ResiliencyDiversity inclusion and respectMid-level Full TimeHyderabad, Telangana, India7h ago
-
Robotics Engineer Fresher INR 240K-360KArduino | Automation | C plus plus | C# | ElectronicsCareer growth in EdTech and robotics | Exposure to robotics competitions | Opportunity to mentor students globallyEntry-level Full TimeBangalore, Karnataka, India8h ago
-
Lead - Agentic AI Engineer INR 2500K-5000KAgent Development Kit | Anomaly Detection | CI/CD | Cloud Computing | Data PreprocessingSenior-level Full TimeChennai, Tamil Nadu, India8h ago
-
Mid-level Full TimePune, Maharashtra, India R8h ago
-
Senior Software Engineer, Data Engineering INR 2000K-3000K.Net Core | ASP.NET MVC | ASP.Net Core | Agile | Automated testingSenior-level Full TimePune, Maharashtra, India8h ago
-
Data Engineer (.NET Specialist) INR 2400K-3465K.Net Core | ASP.NET | Angular | App Service | Azure AppSenior-level Full TimePune, MH, India9h ago
-
Mid-level Full TimeGurgaon, Haryana, India10h ago
-
Lead Software Engineer - AI-Augmented Full Stack Development INR 3000K-5000KAI Assisted Development | API Design | AWS | Agile methodologies | AngularSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Bitbucket | C# | Clock | DMA | DebuggingEntry-level Full TimeBengaluru, KA, India11h ago
-
Technical Solutions Engineer INR 500K-700KAPI Integration | Agentic AI | Automation Anywhere | Excel | Incident ManagementEntry-level Full TimeHyderabad, India12h ago
-
Data Engineer - Databricks & Microsoft FabricData Engineer - Databricks & Microsoft Fabric INR 1500K-2800KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeChennai, IN, 60003212h ago
-
Mid-level Full TimeBengaluru, Karnataka, India13h ago
-
Lead Data Engineer INR 1500K-2700KApache Kafka | Apache Spark | Automated testing | CI/CD | Data ModelingSenior-level Full TimeBengaluru, KA, India13h ago
-
ASR | AWS | Audio Processing | Cloud platform | ContainerizationFlexible working hours | Fully remote | Mentorship | Professional growthSenior-level Full TimeIndia R14h ago
-
Junior SQL/ETL Developer INR 400K-500KAWS | Azure | Data Modeling | Data Pipeline Monitoring | Data QualityEntry-level Full TimeMumbai, Maharashtra, India14h ago
-
GenAI LLM Python/Senior Associate Director, Software Engineering INR 2000K-4000KAWS | Agent systems | Azure | Docker | Function CallingFlexible working | Professional developmentMid-level Full TimePune, MH, IN, 41100616h ago
-
Data Analyst - Power BI Job INR 1000K-2000KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure SQLFlexible work arrangements | Training and knowledge-sharing sessionsMid-level Full TimeBangalore, KA, IN18h ago