Azure Subcontractor
INDIA - HYDERABAD - BIRLASOFT OFFICE, IN
INR 1500K-2500K (estimate) Senior-level Contract
Tasks
- Build batch data pipelines
- Build streaming data pipelines
- Collaborate with stakeholders on data requirements
- Create reusable Databricks notebooks workflows jobs
- Design ETL/ELT pipelines
- Develop Apache Spark data processing frameworks
- Develop Delta Lake tables
- Follow coding standards version control CI CD best practices
- Integrate data from multiple sources
- Monitor troubleshoot pipeline failures
- Optimize data storage with partitioning and Z ordering
- Participate in code reviews technical design discussions
- Perform data transformation, cleansing, validation
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | AWS Glue | Agile Scrum | Airflow | Amazon EMR | Amazon S3 | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Databricks | BigQuery | CI/CD | Cloud Storage | Cost Optimization | Data Factory | Data Governance | Data Modeling | Data Security | Databricks | Delta Lake | DevOps | ELT | ETL | Git | Medallion Architecture | Performance Tuning | PySpark | Python | SQL | Spark Structured Streaming | Structured Streaming | Unity Catalog
Education
N/A
Roles
Related jobs
-
Senior IT Project Manager/ Prompt Engineer INR 2500K-3600KAgile | CI/CD | Case Routing | Copado | Data ArchitectureSenior-level Full TimeBangalore, Karnataka, IN, 5601001h ago
-
Senior Machine Learning Engineer, Content Platform INR 3264K-5000KAmazon EMR | Amazon S3 | Apache Airflow | BERT | Big Data401k retirement plan | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India3h ago
-
Senior-level Full TimeChennai, India10h ago
-
Senior Staff Data Analytics Engineer INR 3242K-4500KAI Operations | AI gateway | API Management | Agentic Frameworks | AutomationSenior-level Full TimeBengaluru, KA, India12h ago
-
Senior-level Full TimePune, India14h ago
-
Senior-level Full TimeMumbai, Maharashtra, India15h ago
-
Staff Software Engineer (Python) INR 3500K-5000KAWS | Authentication | Batch Processing | Data Pipelines | Distributed SystemsCollaborative team environment | Leadership development programs | Training sessionsSenior-level Full TimeMumbai, MH, India15h ago
-
Compute-Hyd 169229 INR 2000K-3000KAI Agents | API Development | Embeddings | LLM orchestration | Language ModelsMid-level Full TimeHyderabad, IND-TG, India15h ago
-
Lead Data Engineer - CDP INR 2500K-4500KAPI Gateway | Analytics.js | CCPA | CI/CD | CPRAArchitecture workshops | Client stakeholder management | Technical mentorshipSenior-level Full TimeHyderabad, TS, India16h ago
-
Senior Data Engineer - AWS INR 1500K-4000KAWS Glue | AWS Lambda | AWS S3 | Amazon EMR | Amazon RedshiftSenior-level Full TimeBangalore, India17h ago
-
Mid-level Full TimeBangalore - Karnataka - India Pune …18h ago
-
Mid-level Full TimeHyderabad, TS, 500032, IN18h ago
-
Senior Analyst INR 1500K-2500KData Factory | Data Governance | Data Quality | Data Security | Database DesignSenior-level Full TimeMumbai, Maharashtra, India18h ago
-
Principal Data Engineer INR 1500K-2500KAgile | Apache Airflow | Apache Kafka | Automated testing | CI/CDSenior-level Full TimeIN-MH-Pune18h ago
-
Senior-level Full TimeIN-MH-Pune18h ago
-
Network Data Scientist INR 2500K-4500KApplication Traffic Analysis | CI/CD | DNS | Data Pipelines | GitLab CISenior-level Full TimePune, IN19h ago
-
Algorithm Development | Automated trading | C++ | Electronic Trading | Financial MathematicsMid-level Full TimeHyderabad, Telangana, India19h ago
-
API Design | Anthropic | Automation | CRM Integrations | CrewAIDistributed work flexibility | Fully remote | High ownership roleMid-level Full TimeIndia R19h ago
-
Agentic AI Engineer INR 1200K-2500KAgentic architecture | Distributed Systems | Docker | LLM | LanggraphMid-level Full TimeKarnataka, Bengaluru, India19h ago
-
Entry-level Full Timehosur road bangalore, India20h ago
-
Senior-level Full TimeBengaluru, India20h ago
-
[T] Senior Software Engineer, AI/ML, Google Cloud INR 3000K-5000KC++ | Data Processing | Data Structures | Data structures algorithms | DebuggingSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Senior-level Full TimeBengaluru, India20h ago
-
Associate Software Engineer INR 1200K-2800KAgile | C# | Cloud Development | Containerization | DHTMLMid-level Full TimeKolkata, India20h ago
-
Senior-level Full TimeBengaluru, India20h ago