Associate Staff Engineer (Data Engineer -Apache Kafka, Flink, Java)
Tasks
- Build low latency high throughput streaming solutions
- Collaborate with architects and stakeholders on data requirements
- Design scalable real-time data pipelines
- Develop and maintain Apache Kafka and Apache Flink streaming applications
- Evaluate and adopt modern real time data engineering practices
- Implement data quality security governance best practices
- Implement event driven workflows for real time analytics
- Monitor troubleshoot and enhance streaming applications
- Optimize Kafka and Flink for performance resilience fault tolerance
- Participate in code reviews and design discussions
- Support production deployments and resolve streaming issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Flink | Apache Kafka | Cloud Platforms | Consumer groups | Containerization | Data Ingestion | Data Transformation | Distributed Systems | Event Driven | Event-driven architecture | Fault-tolerant | Fault-tolerant systems | High Throughput | Java | Kafka Connect | Low Latency | Messaging Patterns | Microservices | REST APIs | Real Time | Real-time analytics | Stateful Computations | Windowing
Education
Related jobs
-
Machine Learning Engineer IV INR 4443K-7998KAPIs | Batch Processing | Cost Optimization | Distributed Systems | EmbeddingsBonuses | Disability insurance | Health insurance | Life insurance | Paid parental leaveSenior-level Full TimePune, India R10h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAWS | Agentic AI | Azure | CI/CD | Cloud SecurityChallenging projects | Collaborative culture | Flexible hours | Internal TechTalks | Learning budgetSenior-level Full TimeBangalore North, India14h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAWS | Agentic Models | Azure | CI/CD | Cloud SecurityAutonomy | Challenging projects | Collaborative culture | Flexible hours | Internal TechTalksSenior-level Full TimeChennai, India14h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAWS S3 | Agentic AI | Amazon Web Services | Anthropic | AzureFlexible hours | Learning budget | Mentorship | People focused support | Performance and compensation reviewsSenior-level Full TimeJalalabad, India14h ago
-
Senior AI Engineer ID80139 INR 2000K-4500KAnthropic | Automated testing | CI/CD | DNS | FirewallsAnnual learning budget | Flexible hours | Mentorship | Remote work | Well-being programsSenior-level Full TimeAhmedabad, India14h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAgentic AI | CI/CD | Cloud Security | Cloud infrastructure | Distributed SystemsFlexible hours | Internal TechTalks | Learning budget | Mentorship | Remote workSenior-level Full TimeGurgaon Kty., India14h ago
-
Staff Data Analytics Engineer INR 2500K-4500KAPI | Agent Orchestration | Agentic Workflows | Cost Optimization | EmbeddingsSenior-level Full TimeBengaluru, KA, India15h ago
-
Generative AI Application Developers INR 1800K-4500KC++ | Computer Vision | Debugging | Generative AI | JavaSenior-level Full TimePune, Maharashtra, India17h ago
-
Staff Software Engineer, Knowledge Catalog, Core Data INR 2500K-5000KDistributed Databases | Distributed Systems | High Throughput | High-Throughput Systems | Indexing pipelinesSenior-level Full TimeBengaluru, Karnataka, India R18h ago
-
Data Engineer INR 1500K-2500KAPI Integration | Access Control | Apache Airflow | Astronomer | BigQuerySenior-level Full TimeIndia19h ago
-
Software Engineer III - Tableau SRE & Automation INR 2500K-4000KChange Management | DNS | Dynatrace | Firewall | GrafanaSenior-level Full TimeHyderabad, Telangana, India19h ago
-
Mid-level Full TimeHyderabad, TS, India21h ago
-
MongoDB, Python, MSA/Consultant Specialist INR 1000K-2000KAWS | Aggregation Pipeline | Azure | CI/CD | DockerFlexible working | Inclusive work environment | Professional development opportunitiesSenior-level Full TimeHyderabad, Telangana, India R21h ago
-
Software Engineer II INR 1500K-4000KBest practices | C# | Data Pipelines | Debugging | Distributed SystemsMid-level Full TimeIndia, Karnataka, Bangalore22h ago
-
(Senior) AI Engineer - Data & AI Organisation (all genders) 1 INR 2500K-5000KAPI Development | Amazon Web Services | Apache Spark | CI/CD | DBTSenior-level Full TimeBangalore, Karnataka, IN, 56010023h ago
-
Software Engr II INR 2500K-4800KAlerting | Azure Data | Azure Data Lake | Azure IoT | Azure IoT EdgeSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
AI Engineer (India, China) INR 2500K-4064KAPIs | AWS | Airflow | Apache Spark | AutogenAnnual leave | Flexible working | Life insurance | Medical insurance | Parental leaveMid-level Full TimeBangalore, IN1d ago
-
Senior Quality Assurance Engineer INR 1600K-2500KAPI Testing | Agile Scrum | Alation | CI/CD | CollibraSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Databricks Platform Engineer (AWS) INR 1500K-3500KAWS | AWS Cloud | AWS Cloud Database | Amazon Virtual Private Cloud | Asset bundlesFlexible work arrangement | Hybrid working model | Wellness supportSenior-level Full TimeHyderabad, India R1d ago
-
API Testing | AWS | Azure | BLEU | Bias TestingOnsite workSenior-level Full TimeBengaluru, India1d ago
-
Senior Developer - Java/LLMs/RAG/AI Agents (7-12 years) INR 1900K-3000KAI Agents | AI Core | Benchmarking | CAP | Cloud loggingConstant learning | Flexible working models | Great benefits | Health and well-being | Skill growthSenior-level Full TimeBangalore, IN, 5600661d ago
-
Senior-level Full TimeChennai, Chennai-MRV-AD, IN1d ago
-
Senior-level Full TimeBengaluru, BDC7C, India1d ago
-
Mid-level Full TimeBengaluru, BDC6F, India1d ago
-
Data Engineer INR 1500K-2500KArchitecture Principles | Cloud Data | Cloud Data Storage | Data Architecture | Data MigrationSenior-level Full TimeMumbai, MDC2B, India1d ago