AVP - Data engineer
Pune, Gera Commerzone SEZ, India
INR 3000K-5800K (estimate) Executive-level Full Time
Tasks
- Build data pipelines
- Build data products with Databricks
- Collaborate with data scientists on machine learning models
- Design data warehouse and data lake solutions
- Develop processing and analysis algorithms
- Develop real time event processing applications
- Flatten hierarchical messages into Avro schemas
- Implement message format parsers
- Implement stateful transformations
- Integrate with IBM MQ and Kafka topics
- Participate in scrum ceremonies
- Perform code reviews
- Troubleshoot issues using ELK stack
- Write unit tests and integration tests
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Flink | Apache Kafka | Avro | Databricks | ELK Stack | Elasticsearch | Git | IBM MQ | ISO 20022 | JMS | JSON | JUnit 5 | Kafka Streams | Kibana | Logstash | Mockito | SWIFT MT | Snowflake | Spring Boot | Spring Framework | Spring Kafka
Education
N/A
Roles
Related jobs
-
Gen AI INR 2000K-3500KAI Agent | AI Governance | AI agent evaluation | AWS CodePipeline | Agent OrchestrationMid-level Full TimeIN-AP-Hyderabad15h ago
-
Senior Data Engineer INR 3264K-4995KAWS | Agile | DBT | Data Governance | Data ModelingFlexible work options | Life leave days | Professional development days | Retirement savings options | Vacation timeSenior-level Full TimePune, MH, India15h ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE)15h ago
-
Senior-level Full TimeBangalore, India Office (BANGALORE)16h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India17h ago
-
Senior Specialist, Business Data Architecture INR 1500K-2500KAzure Data | Azure Data Factory | CI/CD | Cloud Data | Cloud Data PlatformsSenior-level Full TimePune, MH, India17h ago
-
Software Engineer I INR 1500K-2210KAlgorithms | Amazon Web Services | Cloud platform | Data Structures | Distributed SystemsCareer growth | Comprehensive support for holistic well being | Opportunities to learn new skillsEntry-level Full TimeGurugram, HR, India17h ago
-
AI Builder | AWS | Agile | Amazon Redshift | AzureMid-level Full TimeBangalore, Karnataka, India19h ago
-
Senior-level Full TimeBengaluru North, Karnataka, India R19h ago
-
Senior Data Engineer INR 3264K-5012KAWS | Agile | Airflow | Alerting | CSVFlexible work options | Life leave days | Professional development days | Vacation time | Volunteer daysSenior-level Full TimePune, MH, India19h ago
-
Senior Engineer (India Office) INR 1500K-2500KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore, Karnataka, India20h ago
-
Semantic Data Engineer INR 3000K-3500KAPI Integration | Apache Airflow | Apache Superset | BigQuery | Cube.devSenior-level Full TimeNoida,Uttar Pradesh,India20h ago
-
DE&A - Core - Big Data Engineering - Hadoop Ecosystem INR 3000K-4000KACID transactions | Apache Airflow | Apache Hive | Apache Iceberg | Apache OzoneSenior-level Full TimeIndia21h ago
-
DevOps Engineer INR 1600K-2525KAWS | Azure | Azure DevOps | Bash | CI/CDGlobal diverse environment | Hybrid work flexibility | Inclusive workplace | Sustainability focused teamMid-level Full TimePune, Maharashtra, India22h ago
-
Snowflake Engineer INR 1500K-3000KAutomated testing | Azure | CI/CD | Cost Optimization | Data SharingSenior-level Full TimeIndia23h ago
-
Senior-level Full Timecoimbatore, India23h ago
-
Asynchronous processing | Backend architecture | CI/CD | Caching | Computer VisionCareer growth opportunities | Collaborative and inclusive culture | High ownership and autonomy | Opportunity to work on cutting-edge AISenior-level Full TimeIndia23h ago
-
Senior-level Full TimeHyderabad, India1d ago
-
Software Engineer III - Python INR 3000K-5000KAWS | Artificial Intelligence | Code review | Computer Vision | Data EngineeringSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Data Engineer - Senior Manager INR 2000K-3380KAWS | Amazon Redshift | Amazon S3 | Apache Spark | Batch ProcessingFlexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India1d ago
-
Senior Software Engineer(AI/ML Platform) INR 2500K-4500KAWS | Access Control | Audit Logging | Azure | CI/CDSenior-level Full TimeAPAC - India - Pune1d ago
-
Data Engineer INR 2000K-2800KCost Optimization | Data Pipelines | Data Quality | Data Warehousing | Data integrationSenior-level Full TimeChennai, CDC2A, India1d ago
-
Data Engineer INR 1500K-2000KCloud services | Data Pipeline Architecture | Data Processing | Data Quality | Data StorageMid-level Full TimeBengaluru, BDC11A, India1d ago
-
Data Engineer INR 1500K-2000KCloud Data | Cloud Data Storage | Data Pipelines | Data Processing | Data QualityMid-level Full TimeHyderabad, HDC3C, India1d ago
-
Senior-level Full TimeHyderabad (Office), India1d ago