Azure Bigdata Specialist
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT pipelines
- Develop feature engineering processes
- Implement infrastructure-as-code
- Manage real-time data streaming
- Monitor and control data costs
- Optimize data processing performance
- Orchestrate ELT workflows
- Perform data transformations
- Set up CI/CD pipelines
- Use version control for data pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Agile methodology | Apache Airflow | Apache Kafka | Apache Spark | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure IoT | Azure IoT Hub | Azure SQL | Azure SQL Database | Blob Storage | CI/CD | Data Factory | Data Lake Storage | Delta Lake | Docker | Event Hubs | GitHub | IoT Hub | Kubernetes | PySpark | Python | SQL | SQL Database | Scala | Spark SQL | Stream Analytics | Structured Streaming | Terraform
Education
Bachelor of Engineering | MCA | Master of Science | Master of Technology
Roles
Related jobs
-
Specialist - Gen AI Development INR 3000K-4800KAPI Development | AWS | AWS Lambda | Amazon Bedrock | Amazon SageMakerMid-level Full TimeSun Life Global Solutions Private Limited, …4h ago
-
Entry-level Full TimeBengaluru, Karnataka, India5h ago
-
Assistant Manager- AI Engineer with Claude INR 1200K-2500KAWS | Autogen | Azure | Containerization | CrewAIMid-level Full TimeBangalore, Karnataka, India7h ago
-
Senior-level Full TimeBengaluru, KA, India9h ago
-
API Integration | AWS | Azure | Claude | Cloud platformFounding Team Access | Mentorship opportunities | Technical leadership growthSenior-level ContractHyderabad, India10h ago
-
CDP Specialist (Treasure Data) INR 1500K-2000KAI machine learning | API Integration | Amazon Web Services | Big Data | CassandraMid-level Full TimeIN-KA-Bangalore12h ago
-
Data Engineer - AIML Data modeling INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | ElasticsearchMid-level Full TimeIN-AP-Hyderabad12h ago
-
Data Engineering - AIML Data Modeling - SSE INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | Dependency InjectionMid-level Full TimeIN-AP-Hyderabad12h ago
-
AI Engineer - MDM INR 3000K-4720KAPI Integration | Access Control | Automation | Cybersecurity | Data AnalysisSenior-level Full TimePune, Maharashtra, IND, 41101312h ago
-
Data Engineering / Sr. Associate Director, Software Engineering INR 1400K-2000KApache Airflow | Apache Beam | Auditability | Batch Processing | CI/CDMid-level Full TimeHyderabad, Telangana, India R12h ago
-
Senior-level Full TimeKolkata,West Bengal,India13h ago
-
Delivery Lead - AI Engineer INR 4000K-5500KAWS | Apache Spark | Automation | Azure | Cloud platformSenior-level Full TimePune, Maharashtra, India13h ago
-
Mid-level Full TimePune, MAHĀRĀSHTRA, India13h ago
-
AI Software Engineer INR 1500K-2500KAPI Development | AWS | Access Control | Agentic patterns | AuditabilityCompany bonus/profit share | Flexible work arrangements | Long service awards | Medical benefits | Mobile Phone ReimbursementMid-level Full TimeChennai, India13h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1500K-2800KAI Model Deployment | AI model | APIs | Agent Frameworks | AzureMid-level Full TimeBangalore, Karnataka, India13h ago
-
Accelerator hardware | C++ | Compiler Internals | Compiler optimization | Custom KernelsSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior Data Engineer - Delivery INR 3000K-3900KAnalytics services | App Service | Azure Analytics | Azure Analytics Services | Azure AppSenior-level Full TimePune, MH, India13h ago
-
Team Member - IP, CE Data & Conv Core INR 2000K-2500KGenerative AI | HTML | Jira | Power BI | PythonSenior-level Full TimeNavi Mumbai, Maharashtra, India14h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India14h ago
-
Mid-level Full TimeBangalore, Karnataka, India14h ago
-
Software Engineer II INR 2500K-3500KAWS | Alerting | Asynchronous processing | Azure | Backend DevelopmentHybrid work up to 50 percent work from homeMid-level Full TimeIndia, Karnataka, Bangalore14h ago
-
Data & Analytics Engineer - Consultant INR 1500K-2500KApache Spark | Azure | Azure Data | Azure Data Factory | Azure SynapseSenior-level Full TimeBangalore, Karnataka, India14h ago
-
AVP - QA Automation Engineer - IB Tech & CRM/ Analytics INR 3000K-4000KAWS | AWS Lambda | AWS RDS | Amazon Redshift | Amazon S3Executive-level Full TimePune, India14h ago
-
Product Engineering Specialist INR 2500K-5000KAI Foundry | AI Governance | AI Solution | AI Solution Architecture | AI platformsSenior-level Full TimePune, Maharashtra, India15h ago
-
Software Engineer III - Bigdata, Spark, AWS - (Data Engineering) INR 3500K-4720KAWS | Agile | Apache Spark | Application Resiliency | Automated testingSenior-level Full TimeHyderabad, Telangana, India15h ago