Senior Data Engineer - Real-Time Streaming
Chennai, Tamil Nadu, India
INR 400K-1200K (estimate) Senior-level Full Time
Tasks
- Build event driven data architectures
- Design real-time streaming pipelines
- Ensure data quality governance compliance
- Integrate data into data lake lakehouse
- Monitor and troubleshoot streaming jobs and pipelines
- Optimize pipeline performance scalability cost
- Process high volume streaming data
- Translate business requirements into technical solutions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Flink | Apache Kafka | Azure | CI/CD | Cloud Platforms | Cloud platform | Data Governance | Data Lake | Data Quality | DevOps | Distributed Systems | ELT | ETL | Event Driven | Event-driven architecture | Google Cloud | Google Cloud Platform | Java | Kafka Streams | PySpark | Python | Risk compliance | Scala | Spark Streaming
Education
N/A
Roles
Related jobs
-
Data Engineer INR 400K-1200KApache Airflow | CI/CD | DBT | Data Quality | Dimensional ModelingOn-call rotationSenior-level Full TimeIN-KA-Bangalore4h ago
-
Python Robot QA INR 1524K-2541KAgile Software Development | Agile software | Azure DevOps | Backup and Recovery | C#Senior-level Full TimeIN-AP-Hyderabad4h ago
-
AI/ML | API Integration | Automation workflows | Chatbot Integration | Document processingEntry-level Full TimeNashik, MH, India5h ago
-
Group Manager - Data Engineering INR 1500K-2000KAPI | Authentication | BeautifulSoup | Data Governance | Data QualityMid-level Full TimeBangalore, KA, India5h ago
-
Machine Learning Engineer INR 2500K-3000KC plus plus | C# | Data Modeling | Data Structures | Deep learningMid-level Full TimeHyderabad, India5h ago
-
Associate Business Intelligence Analyst INR 850K-1200KAgile | Classification | Clustering | Data Analysis | Data PreprocessingMid-level Full TimeHyderabad, Telangana, India5h ago
-
Mid-level Full TimeGurgaon, Haryana, India6h ago
-
Linguistic Engineer INR 2200K-3000KBias Mitigation | Conversational AI | Hack | Knowledge graphs | Language ProcessingMid-level Full TimeHyderabad, India6h ago
-
Assistant Manager - Gen AI INR 1000K-1250KAPIs | AgentOps | Amazon SageMaker | Apache Airflow | Azure MLMid-level Full TimeBangalore, Karnataka, India6h ago
-
Assistant Manager - Gen AI INR 1000K-1250KAPIs | AWS | AWS SageMaker | Airflow | AzureAccess to AI research labs | Access to cloud innovation platforms | Certifications | Opportunity to lead POCsMid-level Full TimeBangalore, Karnataka, India6h ago
-
Assistant Manager - Gen AI INR 1000K-1250KAPI Design | AWS SageMaker | Airflow | Azure Machine Learning | CI/CDAccess to AI research labs | Cloud innovation platforms | Professional certificationsMid-level Full TimeBangalore, Karnataka, India6h ago
-
Assistant Manager - Gen AI INR 1000K-1350KAPIs | Amazon SageMaker | Apache Airflow | Apache Spark | Azure MLAccess to certifications | Access to cloud innovation platforms | Work on AI research labsMid-level Full TimeBangalore, Karnataka, India6h ago
-
Mid-level Full TimeBengaluru, Karnataka, India6h ago
-
Entry-level Full TimeIndia6h ago
-
Senior Lead Software Engineer - Java, Spark, Iceberg INR 1800K-2400KAWS Multi Az | AWS Multi Region | Amazon Web Services | Apache Iceberg | Apache SparkAgile team collaboration | Secure stable scalable deliverySenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior Software Engineer (C, C++ and embedded Linux.) INR 1500K-2200KAgile | Bash | C# | C++ | Cloud ComputingSenior-level Full TimeHyderabad, TS, India7h ago
-
Sr. C++ Embedded Developer with Network INR 1800K-2500KBitbucket | C plus plus | CAN | CANopen | CMakeSenior-level Full Timebangalore, India7h ago
-
Senior-level Full Timebangalore, India7h ago
-
Associate Process Manager INR 1800K-3000KData Preprocessing | Elasticsearch | Embeddings | Faiss | FastAPIMid-level Full TimeMumbai, Maharashtra, India8h ago
-
API Integration | Agile | Alert Correlation | Ansible | ApacheSenior-level Full TimeBengaluru, INDIA, India9h ago
-
Senior AI/ML Engineer I INR 2500K-4000KAgentic AI | BERT | Continuous integration | Decoder Architecture | Distributed SystemsCareer growth opportunities | Certification programs | Continuous learning programs | Corporate NPS | Education reimbursement programsSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Platform Engineering Professional - Data Engineer INR 2800K-4000KAWS | Ab Initio | Apache NiFi | Apache Spark | BigQueryCareer development | Inclusive workplace | Learning opportunitiesMid-level Full TimeBengaluru, IN, 5601039h ago
-
Manager, Data Science and Analytics INR 1500K-2000KClustering | Data Pipelines | Experimentation | Language Processing | Model MonitoringMid-level Full TimeBangalore, India10h ago
-
Staff Data Engineer (Bigdata + Golang/ Java/ Rust/ C/C++) INR 2250K-3500KAmazon Web Services | Azure | C++ | Cloud platform | Data ProcessingHybrid workSenior-level Full TimeBengaluru, INDIA, India10h ago
-
Mid-level Full TimeBengaluru, Karnataka, India12h ago