AVP - Data engineer
Pune, Gera Commerzone SEZ, India
INR 3000K-5800K (estimate) Executive-level Full Time
Tasks
- Build data pipelines
- Build data products with Databricks
- Collaborate with data scientists on machine learning models
- Design data warehouse and data lake solutions
- Develop processing and analysis algorithms
- Develop real time event processing applications
- Flatten hierarchical messages into Avro schemas
- Implement message format parsers
- Implement stateful transformations
- Integrate with IBM MQ and Kafka topics
- Participate in scrum ceremonies
- Perform code reviews
- Troubleshoot issues using ELK stack
- Write unit tests and integration tests
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Flink | Apache Kafka | Avro | Databricks | ELK Stack | Elasticsearch | Git | IBM MQ | ISO 20022 | JMS | JSON | JUnit 5 | Kafka Streams | Kibana | Logstash | Mockito | SWIFT MT | Snowflake | Spring Boot | Spring Framework | Spring Kafka
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeMitratech India8h ago
-
Genetics Data Engineer 1 INR 3000K-4600KAPI Development | AWS | Agentic AI | Azure | BcftoolsCareer development opportunities | Flexible work culture | Inclusive workplaceSenior-level Full TimeBangalore, Karnataka, IN, 5600378h ago
-
APIs | Airflow | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru8h ago
-
Software Engineer II INR 2475K-4000KAWS | Alerting | Asynchronous workloads | Azure | Backend ServicesHybrid work environment | Work from homeMid-level Full TimeIndia, Karnataka, Bangalore; India, Telangana, Hyderabad9h ago
-
Node JS Developer - Senior Consultant INR 2200K-3500KAWS OpenSearch | Agile | Apache Kafka | Bull queue | CI/CDSenior-level Full TimeBangalore, IN, 5600669h ago
-
Tech Lead - Java (Java, React, Kong) INR 1500K-3000KAPI Development | API Gateway | API Management | API Security | AgileSenior-level Full TimePune, IN, 4110579h ago
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R9h ago
-
Data Analytics/Engineer (Python and MS Fabric exp) INR 2500K-4720KAWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseCross-functional collaboration | Mentorship | Professional developmentSenior-level Full TimeIND-Pune-Smartworks, India14h ago
-
AWS S3 | Amazon Redshift | Amazon Web Services | Apache Spark | Azure DataSenior-level Full TimeBengaluru Millenia, India14h ago
-
Snowflake Data Engineer INR 2000K-2600KAmazon Web Services | Apache Spark | Bitbucket | CI/CD | Cloud platformSenior-level Full TimeBangalore, KA, IN14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
Senior-level Full TimeBengaluru, KA, IN14h ago
-
EY - GDS Consulting - AI And DATA - Databricks - Senior INR 2400K-4000KAPI | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeTrivandrum, KL, IN, 69558114h ago
-
TTT-.NET-Angular-Full Stack with Gen AI-Staff INR 2000K-3500K.NET | AI Agent | AI Agent Frameworks | AI Search | Agent FrameworkSenior-level Full TimeKolkata, WB, IN, 70009114h ago
-
TTT - .NET - Angular-Full Stack with Gen AI - Senior INR 2000K-4500K.NET | AI Foundry | AI Search | App Service | Azure AISenior-level Full TimeKolkata, WB, IN, 70009114h ago
-
Senior Data Engineer - PySpark & Python INR 1500K-2500KApache Airflow | Apache Spark | CI/CD | Data Cleansing | Data LinkingSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
A/B | A/B Testing | AWS | Azure | B testingGrowth opportunities | Learning and development | Mentorship | Well-beingSenior-level Full TimeIND-KA-Bengaluru, Bagmane Solarium City, India14h ago
-
Staff Solutions Architect - AI/ML INR 3000K-4580KAI Governance | APIs | AWS | Azure | Computer VisionSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …14h ago
-
AWS | Autogen | Azure | BERT | Computer VisionCollaborative team environment | Continuous learning | Professional growthMid-level Full TimeIndia23h ago
-
Senior-level Full TimeMaharashtra, Pune, India1d ago
-
Software Engineer, BizTech(Python, LLM, GenAI, MCP) INR 2380K-3400KAI Agents | AI Assisted Development | API Design | AWS | ClaudeMid-level Full TimeBangalore, India1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Data Science | DatabricksLearning and development programs | Mentorship culture | Remote workSenior-level Full TimeBangalore, India R1d ago