Azure Bigdata Specialist
Bengaluru, Karnataka, India
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT pipelines
- Develop feature engineering processes
- Implement infrastructure-as-code
- Manage real-time data streaming
- Monitor and control data costs
- Optimize data processing performance
- Orchestrate ELT workflows
- Perform data transformations
- Set up CI/CD pipelines
- Use version control for data pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Agile methodology | Apache Airflow | Apache Kafka | Apache Spark | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure IoT | Azure IoT Hub | Azure SQL | Azure SQL Database | Blob Storage | CI/CD | Data Factory | Data Lake Storage | Delta Lake | Docker | Event Hubs | GitHub | IoT Hub | Kubernetes | PySpark | Python | SQL | SQL Database | Scala | Spark SQL | Stream Analytics | Structured Streaming | Terraform
Education
Bachelor of Engineering | MCA | Master of Science | Master of Technology
Roles
Related jobs
-
Senior-level Full TimeBengaluru, KA, India8h ago
-
API Integration | AWS | Azure | Claude | Cloud platformFounding Team Access | Mentorship opportunities | Technical leadership growthSenior-level ContractHyderabad, India9h ago
-
CDP Specialist (Treasure Data) INR 1500K-2000KAI machine learning | API Integration | Amazon Web Services | Big Data | CassandraMid-level Full TimeIN-KA-Bangalore10h ago
-
Data Engineer - AIML Data modeling INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | ElasticsearchMid-level Full TimeIN-AP-Hyderabad10h ago
-
Data Engineering - AIML Data Modeling - SSE INR 1500K-2000KAirflow | Apache Beam | Apache Spark | Containerization | Dependency InjectionMid-level Full TimeIN-AP-Hyderabad10h ago
-
Delivery Lead - AI Engineer INR 4000K-5500KAWS | Apache Spark | Automation | Azure | Cloud platformSenior-level Full TimePune, Maharashtra, India11h ago
-
Mid-level Full TimePune, MAHĀRĀSHTRA, India12h ago
-
AI Software Engineer INR 1500K-2500KAPI Development | AWS | Access Control | Agentic patterns | AuditabilityCompany bonus/profit share | Flexible work arrangements | Long service awards | Medical benefits | Mobile Phone ReimbursementMid-level Full TimeChennai, India12h ago
-
Accelerator hardware | C++ | Compiler Internals | Compiler optimization | Custom KernelsSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior Data Engineer - Delivery INR 3000K-3900KAnalytics services | App Service | Azure Analytics | Azure Analytics Services | Azure AppSenior-level Full TimePune, MH, India12h ago
-
Team Member - IP, CE Data & Conv Core INR 2000K-2500KGenerative AI | HTML | Jira | Power BI | PythonSenior-level Full TimeNavi Mumbai, Maharashtra, India12h ago
-
Software Engineer II INR 2500K-3500KAWS | Alerting | Asynchronous processing | Azure | Backend DevelopmentHybrid work up to 50 percent work from homeMid-level Full TimeIndia, Karnataka, Bangalore12h ago
-
AVP - QA Automation Engineer - IB Tech & CRM/ Analytics INR 3000K-4000KAWS | AWS Lambda | AWS RDS | Amazon Redshift | Amazon S3Executive-level Full TimePune, India13h ago
-
Product Engineering Specialist INR 2500K-5000KAI Foundry | AI Governance | AI Solution | AI Solution Architecture | AI platformsSenior-level Full TimePune, Maharashtra, India13h ago
-
Software Engineer III - Bigdata, Spark, AWS - (Data Engineering) INR 3500K-4720KAWS | Agile | Apache Spark | Application Resiliency | Automated testingSenior-level Full TimeHyderabad, Telangana, India14h ago
-
Senior-level Full TimeMumbai, India14h ago
-
Staff Engineer, AJO,RTCDP INR 2520K-3880KAPI Integration | Adobe Campaign | Adobe Campaign Classic | Adobe Campaign Classic v8 | Adobe ExperienceSenior-level Full TimeRemote, India R15h ago
-
Applied AI ML Associate Senior INR 1200K-2500KAI Agents | AWS Lambda | AWS Step Functions | Agentic AI | Amazon AthenaMid-level Full TimeHyderabad, Telangana, India16h ago
-
D&T Lead - Data Science INR 3000K-5000KAgentic AI | AlloyDB | Apache Airflow | Artificial Intelligence | CI/CDSenior-level Full TimePune, IN16h ago
-
DE&A - Core - Cloud Data Engineering - AWS Data Engineering INR 3000K-4000KAWS | AWS Data | AWS Data Governance | AWS EC2 | Data GovernanceSenior-level Full TimePune, Maharashtra, India16h ago
-
Intermediate Backend Engineer - Analytics Instrumentation INR 2000K-3370KAt-Scale | Backend Development | ClickHouse | Cloud Native | Data QualityEquity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote workMid-level Full TimeRemote, India R17h ago
-
Senior-level Full TimeBengaluru, Karnataka, India17h ago
-
Dir, Machine Learning Engrg Mgmt INR 3242K-4200KAlgorithms | Code optimization | Design Patterns | Java | Machine LearningFlexible work options | In-office work options | Remote work optionsSenior-level Full TimeHyderabad, India17h ago
-
Apprentice INR 300K-400KAPI | Automation | Data Quality | Generative AI | Language ModelsCareer development opportunities | Structured trainingEntry-level Apprenticeship Full TimeGurugram, HR, India17h ago
-
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000KAWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon AthenaContract-to-hire | Remote workSenior-level Full TimeBangalore, India17h ago