Senior Data Engineer - (Flink/Kafka/PySpark)
Bengaluru, Karnataka, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Build event-driven architectures
- Collaborate on technical and application architecture
- Design real-time streaming data pipelines
- Develop and maintain Apache Flink pipelines
- Develop and maintain Apache Kafka streaming platforms
- Develop and optimize distributed data processing applications
- Ensure production monitoring and troubleshooting
- Implement CI/CD and DevOps best practices
- Implement performance tuning and fault tolerance
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Anonymization | Apache Flink | Apache Kafka | CI/CD | Data Integrity | Data Security | Data Streaming | Distributed Systems | Docker | Encryption | Event Driven | Event-driven architecture | GitHub | JDBC | Java | Jenkins | Kubernetes | Linux | NoSQL | ODBC | PII protection | PySpark | Real Time | Real-Time Data Streaming | Real-time Data | SQL | Scala | Secure Logging | Shell Scripting
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeBengaluru, KA, IN3h ago
-
Sr. Data Engineer INR 3000K-4000KApache Kafka | Apache Spark | Data Modeling | Data Pipelines | Data integrationSenior-level Full TimeBangalore, Karnataka, IN4h ago
-
Senior-level Full TimeHyderabad, TS, India4h ago
-
AWS | AWS Kinesis | Agile | Apache Kafka | Cloud platformCloud certification support | Collaborative innovation environment | Inclusive diverse workplace | Mentoring and thought leadership opportunities | Professional developmentSenior-level Full TimeIndia7h ago
-
Senior Storage Engineer INR 2000K-3500KAnsible | CMDB | Cloud Insight | Firewalls | ITILLimited travel | Mentoring opportunitySenior-level Full TimeHyderabad, India8h ago
-
ML & AI Engineer II INR 1860K-3000KAPIs | Classification | Cloud Platforms | Computer Vision | Data PipelinesCareer growth opportunities | Continuous learning and development | Flexible work arrangements | Hybrid work arrangements | Inclusive work environmentMid-level Full TimeNavi Mumbai, India8h ago
-
API Development | Access Control | Artificial Intelligence | Automation | CI/CDCareer growth | Fully remote work | Paid time off | Professional developmentMid-level Full TimeIndia R8h ago
-
Cloud Database Platform Engineer INR 1500K-4000KAWS RDS | Amazon Aurora | Amazon CloudWatch | Amazon EC2 | Amazon IAMEducation support | Generous time-off policies | Wellness and lifestyle supportSenior-level Full TimeBangalore9h ago
-
Cloud Engineer, Specialist CDAO Data Mgmt. & Analytics Platforms INR 2000K-3000KAWS | Agile | Automation | CI/CD | Capacity PlanningFinancial wellness programs | Hybrid working model | Personal wellness resources | Physical wellness benefits | Wellness supportMid-level Full TimeHyderabad, India12h ago
-
Palantir Foundry Developer INR 1300K-2500KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksMid-level Full TimePune, Maharashtra, India12h ago
-
Senior Fullstack Engineer INR 3500K-4500KCI/CD | Cloud Platforms | Distributed Systems | Docker | FastAPIMid-level Full TimeBengaluru, Karnataka, India12h ago
-
Mid-level Full TimeBangalore, Prestige Technology Park, India12h ago
-
Sr. Data Engineer Ops Data Analytics INR 1500K-2500KAzure Data | Azure Data Factory | Data Clustering | Data Factory | Data ModelingSenior-level Full TimeGurgaon Sector 59, India12h ago
-
EY - GDS Consulting - AI And DATA - Databricks - Senior INR 2400K-4000KAPIs | Apache Spark | Azure | Azure Data | Azure Data FactoryGlobal scale | Inclusive culture | Supportive team environmentSenior-level Full TimeTrivandrum, KL, IN, 69558112h ago
-
Specialist in Voice and Speech technologies INR 2475K-3500KContext Management | Distributed Systems | Entity Extraction | GenAI | GoSenior-level Full TimeChennai, TN, IN12h ago
-
Application Engineer - Data Analyst INR 1000K-2000KAgile | Application Support | Data Analysis | Development Lifecycle | Enterprise ApplicationMid-level Full TimeIN-KA-Bangalore, India (SKAV Seethalakshmi) GESC12h ago
-
Sr. Data Engineer - (RealTime Streaming) INR 1500K-2500KACL | Apache Flink | Apache Kafka | Cloud Native | Cloud-native applicationsSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior Manager - Data Engineer- Methodology & Assumption (M&A) Actuarial Policyholder Data Team INR 2817K-4064KApache Spark | Azure Databricks | Data Governance | Data Modeling | Data PipelinesSenior-level Full TimeMumbai Central Avenue, India12h ago
-
Senior Data Engineer - Customer Success INR 3000K-4000KApache Airflow | Automation | Batch Processing | Data Lake | ETLHealthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeIND-BLR-Divyasree Technopolis, India15h ago
-
Senior Data Engineer INR 3000K-4000KAPIs | Algorithms | Amazon Kinesis | Amazon Redshift | Amazon Web ServicesDiscounted gym memberships | Flexible working | Life assurance | Medical insurance | Pension schemeSenior-level Full TimeHyderabad, India16h ago
-
Specialist Cloud Database Engineer (SQL, DevOps, AWS) INR 2156K-2500KAlwaysOn Availability | AlwaysOn availability groups | Amazon Aurora | Amazon CloudFormation | Amazon RDSHybrid work model | Office collaboration days | Remote work flexibilitySenior-level Full TimeIndia - Pune R21h ago
-
Senior-level Full TimeHyderabad, India21h ago
-
Member of Technical Staff, Production Engineering Lead INR 3584K-5000KAnthropic | Asynchronous Architecture | Concurrency systems | Custom Controllers | DockerCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeBangalore, India22h ago
-
AI Integration Engineer INR 1500K-2500KAWS S3 | Amazon Redshift | Anthropic Claude | Google Gemini | JSONCareer growth opportunities | Health insurance coverage | Hybrid work culture | Mentorship | Paid time offMid-level Full TimeHyderabad, India22h ago
-
Senior-level Full TimeBengaluru East, Karnataka, India22h ago