Data Engineer
Kolkata,West Bengal,India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Build RAG pipelines for network service customer and operational data
- Build large scale high throughput data systems
- Build pipelines for embeddings vector stores and retrieval systems
- Design and optimize distributed data pipelines using Apache Spark
- Develop backend services and REST APIs
- Develop scalable solutions using Python and Java
- Engineer low latency high performance batch and streaming processing
- Ensure performance scalability observability and reliability
- Implement end to end Data MLOps pipelines with Docker Kubernetes Kubeflow and CI CD
- Manage and mitigate open source software vulnerabilities using security scanning and patching
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | Batch Processing | CI/CD | Cassandra | DataOps | Docker | Elasticsearch | Embeddings | GCP | Java | Kubeflow | Kubernetes | LLMs | MLOps | Microservices | NoSQL | Observability | Open Source | Open source security | OpenSearch | PySpark | Python | RAG | REST APIs | Retrieval systems | Scala | Spring Boot | Streaming processing | Vector Databases | Vulnerability Management
Education
N/A
Roles
Language: en
Views: 3
Clicks: 1
Saves: 0
Related jobs
-
Mid-level Full TimeIN-MH-Pune10h ago
-
Mid-level Full TimeIN-MH-Pune10h ago
-
Mid-level Full TimeIN-MH-Pune10h ago
-
Associate Engineer - AI/ML with Python INR 2800K-4000KAWS | Bitbucket | CSS | Celery | DjangoFlexible growth opportunities | In office 5 days per week | Professional development | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …10h ago
-
Microsoft Fabric Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimePune, Maharashtra, India14h ago
-
Mid-level Full TimeBangalore, Karnataka, IN14h ago
-
Senior-level Full TimeBangalore, Karnataka, IN14h ago
-
Senior IT Project Manager/ Prompt Engineer INR 2500K-3600KAgile | CI/CD | Case Routing | Copado | Data ArchitectureSenior-level Full TimeBangalore, Karnataka, IN, 56010016h ago
-
Senior-level Full TimeBangalore, KA, IN,16h ago
-
Senior Machine Learning Engineer, Content Platform INR 3264K-5000KAmazon EMR | Amazon S3 | Apache Airflow | BERT | Big Data401k retirement plan | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India18h ago
-
Sr Software Engineer l Java, AWS, Python, Microservices INR 3242K-4000KAWS | Agile | Architecture | Debugging | DesignSenior-level Full TimeMumbai, India18h ago
-
Application Support and Maintenance - Healthcare Provider(Data Analytics and Middleware) INR 2520K-3465KAPI Integration | Batch Processing | Cause analysis | Centriq | Digital CertificatesSenior-level Full TimeNoida, UP, IN22h ago
-
AI/ML Specialist - Agentic AI & Generative AI INR 2000K-5000KAgentic AI | Agile Scrum | Azure Machine Learning | Data Engineering | Data PipelinesSenior-level Full TimeHyderabad, TG, IN, 50003222h ago
-
Technical Lead-AI/ML, Generative AI & Agentic AI INR 2000K-4680KAgentic AI | Agile | Azure Machine Learning | Data Engineering | Data PipelinesSenior-level Full TimeHyderabad, TG, IN, 50003222h ago
-
Senior System Software Engineer - Local AI Automation INR 2500K-4800KC# | CI/CD | Docker | Git | GrafanaSenior-level Full TimeIndia, Pune22h ago
-
Senior-level Full TimeChennai, India1d ago
-
Senior Staff Data Analytics Engineer INR 3242K-4500KAI Operations | AI gateway | API Management | Agentic Frameworks | AutomationSenior-level Full TimeBengaluru, KA, India1d ago
-
Senior-level Full TimePune, India1d ago
-
Solutions Engineer - Data Engineering INR 2000K-3000KApache Airflow | CI/CD | DAG | Data Transformation | DockerHybrid work model | Office in HyderabadMid-level Full TimeHyderabad1d ago
-
Senior-level Full TimeMumbai, Maharashtra, India1d ago
-
Staff Software Engineer (Python) INR 3500K-5000KAWS | Authentication | Batch Processing | Data Pipelines | Distributed SystemsCollaborative team environment | Leadership development programs | Training sessionsSenior-level Full TimeMumbai, MH, India1d ago
-
Compute-Hyd 169229 INR 2000K-3000KAI Agents | API Development | Embeddings | LLM orchestration | Language ModelsMid-level Full TimeHyderabad, IND-TG, India1d ago
-
Lead Data Engineer - CDP INR 2500K-4500KAPI Gateway | Analytics.js | CCPA | CI/CD | CPRAArchitecture workshops | Client stakeholder management | Technical mentorshipSenior-level Full TimeHyderabad, TS, India1d ago
-
Senior Data Engineer - AWS INR 1500K-4000KAWS Glue | AWS Lambda | AWS S3 | Amazon EMR | Amazon RedshiftSenior-level Full TimeBangalore, India1d ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerAsynchronous culture | Friendly work environment | Opportunity for impactMid-level Full TimeBangalore, India1d ago