Azure Subcontractor
INDIA - HYDERABAD - BIRLASOFT OFFICE, IN
INR 1500K-2500K (estimate) Senior-level Contract
Tasks
- Apply coding standards
- Build batch data pipelines
- Build streaming data pipelines
- Collaborate with business analysts and architects
- Create Databricks Jobs
- Create Databricks workflows
- Create reusable notebooks
- Design ETL/ELT pipelines
- Develop Delta Lake tables
- Develop data processing frameworks with Apache Spark
- Ensure data quality and validation
- Implement CI/CD best practices
- Implement data transformations
- Integrate data from multiple sources
- Monitor pipeline failures
- Optimize data storage with Z Ordering
- Optimize data storage with partitioning
- Participate in technical design discussions
- Perform code reviews
- Troubleshoot pipeline performance issues
- Use version control
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | Agile | Amazon EMR | Amazon S3 | Apache Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | CI/CD | Cloud Storage | Cost Optimization | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Modeling | Data Security | Data Warehousing | Databricks | Delta Lake | ELT | ETL | Git | Google BigQuery | Google Cloud | Google Cloud Storage | Medallion Architecture | Microsoft Azure | Performance Tuning | PySpark | Python | SQL | Scrum | Spark Structured Streaming | Structured Streaming | Unity Catalog | Z-ordering
Education
N/A
Roles
Related jobs
-
Senior Analytics Engineer – Data Applications INR 2771K-4000KAirflow | Anomaly Detection | CI/CD | DBT | DashHybrid work modelSenior-level Full TimeBengaluru, INDIA, India12h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Entrepreneurial-minded team | Friendly team atmosphere | Hands-off management | Opportunity to impact millionsMid-level Full TimeHyderabad, India13h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Opportunity for impact | Remote-friendly, distributed teamMid-level Full TimePune, India13h ago
-
EY - GDS Consulting - AIA - Gen AI - Senior INR 3000K-5000KAWS | Azure | Azure DevOps | Batch Prediction | BedrockCoaching and mentoring | Continuous learning | Flexible work options | Inclusive cultureSenior-level Full TimeChennai, TN, IN, 60003213h ago
-
Applied AI Engineer II INR 1500K-3000KAWS | Azure | CI/CD | CUDA | Data PipelinesAccidental insurance | Employee referral program | Flexible working hours | Hybrid work | Life insuranceMid-level Full TimeIndia - Remote R16h ago
-
Applied AI Engineer II INR 1500K-3000KAWS | Azure | CI/CD | Docker | GCPEmployee referral program | Hybrid and remote working | Life and accidental insurance | Maternity and parental leave | Medical coverageMid-level Full TimeIndia - Remote R16h ago
-
Forward Deployed Engineer INR 2040K-2800KAPI Integration | AWS | Apache Spark | Application development | AzureCustomer-facing role | Travel 20 percentSenior-level Full TimeRemote - India R20h ago
-
Machine Learning Engineer - IV (Fraud) INR 3000K-5000KAWS SageMaker | Agile | Computer Vision | Deep learning | Image dataSenior-level Full TimeBangalore21h ago
-
Quantum Prod Support INR 2755K-3500KBatch monitoring | Cron | ITIL | Incident Management | JiraHybrid work | Rotational shiftsSenior-level Full TimeIndia - Bengaluru; India - Hyderabad; …23h ago
-
Oracle PL/SQL PostgreSQL Developer INR 1200K-2400KAgile | ETL | EXPLAIN ANALYZE | EXplain | Execution PlansSenior-level Full TimeIN-AP-Hyderabad1d ago
-
Database Engineer INR 500K-1500KCI/CD | DB2 | Data Warehousing | Database performance | Database performance tuningMid-level Full TimePune, MH, India1d ago
-
Senior AI Engineer I INR 3264K-5876KArtificial Intelligence | BigQuery | Cloud Composer | Cloud platform | Data ProcessingSenior-level Full TimeBengaluru, KA, India1d ago
-
Principal Engineer, Data Analytics Engineering [ 8+ years ] INR 2500K-3584KAWS | Algorithms | Azure | Big Data | CI/CDSenior-level Full TimeBengaluru, KA, India1d ago
-
Senior-level Full TimeIndia - Hyderabad1d ago
-
Senior Software Engineer - Full Stack & GenAI INR 3264K-5876KAWS | Angular | CI/CD | Docker | Event DrivenHybrid workSenior-level Full TimeBengaluru, KA, India1d ago
-
Agent Development | Agent Development Kit | Angular | Backend Development | C++Mid-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Engineer - Data Analyst INR 3000K-5012KAPI | Automation | Big Data | Big data analytics | CI/CDSenior-level Full TimeHadapsar, Pune, Maharashtra, IND, 4110131d ago
-
Senior Applied Scientist - Knowledge Graphs & AI INR 3100K-4800KCoreference resolution | Cypher | Dialogue Systems | Entity Resolution | Event DetectionHealth insurance | Life insurance | Maternity leave | Paid time off | Paternity leaveSenior-level Full TimeHyderabad1d ago
-
Machine Learning Engineer (MLE-3) INR 3000K-5000KAnomaly Detection | Apache Airflow | Boosting | Classification | Data VisualizationSenior-level Full TimeBengaluru, India1d ago
-
AWS | Advanced Excel | Agile Development | Apache Spark | AzureExecutive-level Full TimeKolkata, West Bengal, India R1d ago
-
Lead Software Engineer - Java and AI/ML INR 3500K-5000KAI Agents | Agile | Automated testing | CI/CD | Code modernizationSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
AI Engineer I INR 2500K-5000KAWS | Azure | Azure OpenAI | Docker | FastAPIWork from office 5 days per weekSenior-level Full TimeMumbai, India1d ago
-
Python, React, LLM/Consultant Specialist INR 2800K-4000KBigQuery | CI/CD | Cloud Functions | Cloud Run | Cloud StorageSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
Mid-level Full TimePune, Maharashtra, India1d ago
-
Databricks Developer INR 1500K-2400KACID | Batch Processing | CI/CD | Cluster management | Data IngestionWork from office 5 days per weekMid-level Full TimeGurugram, Haryana, India1d ago