Azure Bigdata Specialist
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT pipelines
- Develop feature engineering processes
- Implement infrastructure-as-code
- Manage real-time data streaming
- Monitor and control data costs
- Optimize data processing performance
- Orchestrate ELT workflows
- Perform data transformations
- Set up CI/CD pipelines
- Use version control for data pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Agile methodology | Apache Airflow | Apache Kafka | Apache Spark | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure IoT | Azure IoT Hub | Azure SQL | Azure SQL Database | Blob Storage | CI/CD | Data Factory | Data Lake Storage | Delta Lake | Docker | Event Hubs | GitHub | IoT Hub | Kubernetes | PySpark | Python | SQL | SQL Database | Scala | Spark SQL | Stream Analytics | Structured Streaming | Terraform
Education
Bachelor of Engineering | MCA | Master of Science | Master of Technology
Roles
Related jobs
-
Senior-level Full TimeBengaluru, Karnataka, India R5h ago
-
Senior ML Operations Engineer INR 2500K-5000KAI Governance | AWS | Automated retraining | Azure | Azure MLSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Software Development Specialist INR 940K-940KAmazon CloudWatch | Amazon DynamoDB | Amazon S3 | Amazon Web Services | Azure DevOpsMid-level Full TimeBangalore, KA, IN R9h ago
-
Senior Manager INR 1500K-2800KAWS Glue | AWS Secrets | AWS Secrets Manager | Adaptive Query | Adaptive query executionHybrid work modeSenior-level Full TimePune, Maharashtra, India R10h ago
-
Senior Consultant - Data Engineering- INR 2000K-3500KApache Kafka | Apache Spark | Cloud Computing | Data Modeling | Data PipelinesSenior-level Full TimeMumbai, Maharashtra, India10h ago
-
Mid-level Full TimeBengaluru, Pune10h ago
-
Mid-level Full TimeIndia, Telangana, Hyderabad10h ago
-
Senior Data Engineer INR 3000K-4200KAPI Management | AWS | Application Architecture | Azure API | Azure API ManagementSenior-level Full TimeIndia10h ago
-
Data Science Chief Expert - Finance INR 3000K-4000KAWS | Azure | Cloud platform | Cypher | Data PreprocessingExecutive-level Full TimeBangalore, IN, 56006617h ago
-
IN_Manager_Agentic + Gen AI__ AI 50_ Advisory_Hyderabad INR 1000K-2500KAgentic AI | C plus plus | C# | CI/CD | DspyFlexibility programmes | MentorshipMid-level Full TimeHyderabad - Salarpuria, India17h ago
-
Sr Technical Lead-BI INR 1500K-3000KAgile | BI Data modeling | DAX | Data Modeling | Data WarehousingSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …17h ago
-
Senior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …17h ago
-
Technical Lead-BI INR 1500K-2700KDAX | Data Modeling | Data Warehousing | Dimensional Modeling | ETLSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …17h ago
-
Senior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …17h ago
-
IN_Sr Associate_Java Full Stack Engineer_D&A_Advisory_Bangalore INR 1200K-2500KAngular | Apache Kafka | App Service | Azure | Azure AppFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India17h ago
-
IN_Senior Associate_ Data Scientist_D&A_Advisory_Bangalore INR 3000K-4000KBig Data | Causal Inference | Data Manipulation | Data Modeling | Data VisualizationSenior-level Full TimeBengaluru Millenia, India17h ago
-
EY - GDS Consulting - AIA - AI Engineer- Senior INR 2500K-5000KAI Foundry | AI Observability | AWS Bedrock | Access Controls | Asynchronous programmingCoaching and confidence | Continuous learning | Diverse and inclusive culture | Flexible tools and supportSenior-level Full TimeChennai, TN, IN, 60003217h ago
-
API Integration | Access Control | Agent Orchestration | CI/CD | Change ManagementContinuous professional development | Flexible working | Inclusive workplaceMid-level Full TimeHyderabad, TG, IN, 50003217h ago
-
ESP Security Data Engineer INR 2000K-2700KAccess Controls | Automation | Cloud Platforms | Continuous Improvement | Data ArchitectureMid-level Full TimeBengaluru, KA, IN, 56004817h ago
-
APM | AWS | Ansible | Asynchronous programming | AzureSenior-level Full TimeIND - Chennai, Neville Towers, India17h ago
-
Java API & Microservices Engineer / Architect INR 2500K-3500KAPI Testing | Azure | CI/CD | Cassandra | DatadogSenior-level Full TimeBangalore, KA, IN R17h ago
-
EY - GDS Consulting - AIA - AI Platform Engineer- Senior INR 3000K-5449KAI Search | AI Services | Agent SDK | Autogen | Azure AISenior-level Full TimeBengaluru, KA, IN, 56004817h ago
-
Senior-level Full TimeBangalore, KA, IN R17h ago
-
Cloud AI / Agentic AI Developer - Manager INR 1860K-2500KAPI Gateway | AWS Lambda | Amazon API | Amazon API Gateway | Amazon BedrockEmployee networks | Flexible work/life support | Paid volunteer daysMid-level Full TimeHyderabad, India17h ago
-
AWS | Artifact versioning | Automation | CI/CD | DevOpsMid-level Full TimeBangalore (SDC) - Bagmane Tech Park, …17h ago