Senior Data Engineer(Azure/Apache Kafka)
Tasks
- Build real-time and batch processing with Kafka, Spark, Python
- Collaborate with teams on data solutions
- Design Snowflake data models and queries
- Design data pipelines on Azure
- Develop and optimize ETL/ELT workflows using Azure Data Factory
- Ensure data quality, reliability, performance, scalability
- Follow best practices for cloud infrastructure security and performance
- Process structured and semi-structured data like XML and JSON
- Work with Databricks for large-scale processing
- Write SQL for data transformation
Perks/Benefits
- Career growth support
- Certification opportunities
- Flexible remote working
- Mentorship and buddy schemes
- Performance bonus
- Referral bonus
- Team events
Skills/Tech-stack
Apache Kafka | Apache Spark | Azure | Azure Data | Azure Data Factory | Data Factory | Databricks | JSON | Python | SQL | Scala | Snowflake | XML
Education
N/A
Roles
Related jobs
-
Azure | Csharp | Data Ingestion | Data cleaning | Machine LearningCommunity forums | Laptop provided | Medical insurance | Mentorship | No weekend workSenior-level Full TimeIndia R1d ago
-
Senior Machine Learning Engineer INR 3500K-5000KAWS | Azure | CI/CD | Cloud platform | DatabricksHybrid work | Learning and development programs | Mentorship | Remote workSenior-level Full TimeBangalore, India R1d ago
-
Senior Machine Learning Engineer (Job Location: Mahadevapura) INR 3384K-4725KAWS | Azure | CI/CD | Databricks | Distributed SystemsHybrid work model | Learning and development programs | Mentoring | Remote work optionsSenior-level Full TimeBangalore, India R1d ago
-
Senior Software Engineer INR 3200K-4225KAccess Control | Airflow | Artificial Intelligence | Astronomer | CI/CDSenior-level Full TimePune, India R1d ago
-
Data Engineer (Data Application Developer) INR 2516K-3356KAWS | Amazon Kinesis | Amazon SQS | DBT | Data ModelingCommunity involvement support | Employee support programs | Hybrid work options | In-person work options | Remote work optionsSenior-level Full TimeRemote (IND), India R1d ago
-
Senior-level Full TimeBangalore, INDIA R2d ago
-
Senior Azure Fabric Data Engineer INR 1500K-2000KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote work | Work from homeSenior-level Full TimeIndia - Remote R2d ago
-
Senior Software Engineer INR 1800K-2400KAWS | Apache Atlas | Google Cloud | JUnit | JavaCareer development | Employee resource groups | Flexible WFH policy | Generous PTO | Internet reimbursementSenior-level Full TimeIndia-Bangalore-Remote R2d ago
-
Senior-level Full TimeRemote, India R3d ago
-
Senior Staff Engineer, Generative AI INR 2500K-4500KAPI Development | AWS | Airflow | Artificial Intelligence | Azure MLContinuous learning opportunities | Flexible work hours | Remote work optionsSenior-level Full TimeRemote, India R3d ago
-
Senior Staff Engineer, Generative AI INR 2500K-4500KAI Deployment | AI/ML | AI/ML cloud services | API Development | AirflowFlexible work hours | Health benefits | Learning and development opportunities | Remote workSenior-level Full TimeRemote, India R3d ago
-
Senior Staff Engineer, Generative Ai INR 2500K-4500KAPI Development | AWS SageMaker | Azure ML | BERT | BicepSenior-level Full TimeRemote, India R3d ago
-
Senior Staff Engineer, Generative Ai INR 2500K-4500KAI/ML | AI/ML libraries | AWS | Agentic AI | AirflowSenior-level Full TimeRemote, India R3d ago
-
Sr. Data Engineer INR 2500K-3380KAWS | Azure | C# | Data Governance | Data ModelingHybrid work environmentSenior-level Full TimeIndia - Remote R3d ago
-
Software Engineer, Backend - Remote (US or International) INR 1500K-2000KApache Cassandra | Apache Druid | Apache Kafka | Apache Pinot | Apache SparkRemote workEntry-level Full TimeRemote (India) R3d ago
-
Bash | C# | C++ | Docker | GoFlexible schedule | Global community | Project-based collaboration | Remote workSenior-level Full TimeIndia - Remote R3d ago
-
Data Product Lead INR 1500K-1900KAccount Segmentation | Apache Solr | Artificial Intelligence | CI/CD | CRM systemsSenior-level Full TimeIndia - Pune - Remote R3d ago
-
Mid-level Full TimeIndia - Remote R3d ago
-
Data Exploration | Data Ingestion | Data Validation | Data cleaning | Feature EngineeringFlexible schedule | Part-time freelance | Remote workMid-level FreelanceIndia - Remote R3d ago
-
AI Software Engineer (Python/Java) - India INR 2535K-4225KAPIDesign | AWS | Azure | CI/CD | CloudFormationFlexible hours | Remote workSenior-level Full TimeIndia (Remote) R3d ago
-
Senior QA Engineer – Data / Analytics INR 2520K-3380KAPI Testing | AWS Athena | AWS Glue | AWS Kinesis | AWS LambdaCareer growth opportunities | Diverse team | Flexible work environmentSenior-level Full TimeBengaluru, India- Hybrid R3d ago
-
Senior Database Engineer-#3084 (Remote) INR 300K-370KAWS Aurora | AWS RDS | Automation | Backup & Recovery | BashSenior-level Full TimeChennai, India R4d ago
-
Senior Data Engineer | Bengaluru, IN INR 2520K-3380KAirflow | Code review | DBT | Data Architecture | Data ModelingFlexible work arrangements | Health benefits | Professional development supportSenior-level Full TimeBengaluru, Karnataka, India | Hybrid R4d ago
-
AI Engineer I (Remote) USD 30K-39KAI Development | AWS | CI/CD | Code review | ContainerizationRemote work | Team growth opportunitiesEntry-level Full TimeIndia, Remote R4d ago
-
Principal Engineer, AI/ML - Pune INR 2535K-4500KAWS | C++ | Cloud infrastructure | Data Pipelines | Deep learningSenior-level Full TimeIndia-Hybrid R4d ago