Azure Subcontractor
INDIA - HYDERABAD - BIRLASOFT OFFICE, IN
INR 1500K-2500K (estimate) Senior-level Contract
Tasks
- Build batch and streaming data pipelines
- Collaborate with stakeholders on data requirements
- Create Databricks notebooks workflows and jobs
- Design ETL and ELT pipelines
- Develop Apache Spark processing frameworks
- Develop Delta Lake tables and optimize storage
- Follow coding standards and version control with CI CD
- Implement data transformation cleansing and validation
- Integrate data from multiple sources
- Monitor and troubleshoot pipeline failures and performance issues
- Perform code reviews and technical design discussions
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | AWS Glue | Amazon EMR | Amazon S3 | Apache Airflow | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Databricks | CI/CD | Cloud Storage | Cost Optimization | Data Factory | Data Governance | Data Warehousing | Databricks | Delta Lake | ELT | ETL | Git | Google BigQuery | Medallion Architecture | Performance Tuning | PySpark | Python | SQL | Spark Structured Streaming | Structured Streaming | Unity Catalog
Education
N/A
Roles
Related jobs
-
Storage 170374 INR 2000K-4000KAWS | Automation | Azure | Backup and Recovery | Brocade SAN24x7 operations participation | Cross-functional collaboration | Global team collaborationSenior-level Full TimeHyderabad, IND-TG, India1h ago
-
Principal Data Engineer Data Technology INR 3000K-4000KAPIs | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimePune, Maharashtra, India R5h ago
-
Advanced Engineer - Data Engineer INR 2475K-3465KAWS | Amazon Redshift | Apache Hadoop | Apache Spark | AzureAccess to cutting-edge technologies | Collaborative work environment | Professional growth and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …6h ago
-
Data Engineer INR 302K-480KAgile | Apache Airflow | Cloud Composer | Cloud Storage | Cloud platformEntry-level Full TimeIN-MH-Pune6h ago
-
Senior-level Full TimeIN-TN-Chennai6h ago
-
AI & ML Development Lead INR 2500K-5000KAPI Development | AWS | Agent systems | Azure | Cloud PlatformsSenior-level Full TimeGurugram, Haryana, India7h ago
-
Senior Data Management Professional – Process Automation & Data Operations, Company Financials Data , Pune INR 2800K-4000KCI/CD | Cause analysis | Data Governance | Data Monitoring | Data ObservabilityPlatinum customer supportSenior-level Full TimePune7h ago
-
CDP,Snowflake,SQL,Java, API, AWS - (6-9 Yrs) - CHN INR 2000K-3000KAPI Integration | AWS | Audience Management | Customer Data | Customer Data PlatformSenior-level Full TimeIndia7h ago
-
Data Engineer ((SSIS, SQL and Azure Data Factory) INR 1000K-1700KAzure Data | Azure Data Factory | Data Factory | Databricks | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India8h ago
-
API Integration | AWS | Anomaly Detection | Azure | Data LineageSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Data Engineer INR 1500K-2500KAmazon Web Services | Data Governance | Data Modeling | Data Quality | Data ResiliencyDiversity inclusion and respectMid-level Full TimeHyderabad, Telangana, India8h ago
-
Robotics Engineer Fresher INR 240K-360KArduino | Automation | C plus plus | C# | ElectronicsCareer growth in EdTech and robotics | Exposure to robotics competitions | Opportunity to mentor students globallyEntry-level Full TimeBangalore, Karnataka, India9h ago
-
Lead - Agentic AI Engineer INR 2500K-5000KAgent Development Kit | Anomaly Detection | CI/CD | Cloud Computing | Data PreprocessingSenior-level Full TimeChennai, Tamil Nadu, India9h ago
-
Mid-level Full TimePune, Maharashtra, India R9h ago
-
Senior Software Engineer, Data Engineering INR 2000K-3000K.Net Core | ASP.NET MVC | ASP.Net Core | Agile | Automated testingSenior-level Full TimePune, Maharashtra, India9h ago
-
Data Engineer (.NET Specialist) INR 2400K-3465K.Net Core | ASP.NET | Angular | App Service | Azure AppSenior-level Full TimePune, MH, India10h ago
-
Mid-level Full TimeGurgaon, Haryana, India11h ago
-
Lead Software Engineer - AI-Augmented Full Stack Development INR 3000K-5000KAI Assisted Development | API Design | AWS | Agile methodologies | AngularSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Bitbucket | C# | Clock | DMA | DebuggingEntry-level Full TimeBengaluru, KA, India12h ago
-
Technical Solutions Engineer INR 500K-700KAPI Integration | Agentic AI | Automation Anywhere | Excel | Incident ManagementEntry-level Full TimeHyderabad, India13h ago
-
Data Engineer - Databricks & Microsoft FabricData Engineer - Databricks & Microsoft Fabric INR 1500K-2800KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeChennai, IN, 60003213h ago
-
Mid-level Full TimeBengaluru, Karnataka, India14h ago
-
Lead Data Engineer INR 1500K-2700KApache Kafka | Apache Spark | Automated testing | CI/CD | Data ModelingSenior-level Full TimeBengaluru, KA, India14h ago
-
ASR | AWS | Audio Processing | Cloud platform | ContainerizationFlexible working hours | Fully remote | Mentorship | Professional growthSenior-level Full TimeIndia R15h ago
-
Junior SQL/ETL Developer INR 400K-500KAWS | Azure | Data Modeling | Data Pipeline Monitoring | Data QualityEntry-level Full TimeMumbai, Maharashtra, India15h ago