Data Engineer
Kolkata,West Bengal,India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Build RAG pipelines for network service customer and operational data
- Build large scale high throughput data systems
- Build pipelines for embeddings vector stores and retrieval systems
- Design and optimize distributed data pipelines using Apache Spark
- Develop backend services and REST APIs
- Develop scalable solutions using Python and Java
- Engineer low latency high performance batch and streaming processing
- Ensure performance scalability observability and reliability
- Implement end to end Data MLOps pipelines with Docker Kubernetes Kubeflow and CI CD
- Manage and mitigate open source software vulnerabilities using security scanning and patching
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Spark | Batch Processing | CI/CD | Cassandra | DataOps | Docker | Elasticsearch | Embeddings | GCP | Java | Kubeflow | Kubernetes | LLMs | MLOps | Microservices | NoSQL | Observability | Open Source | Open source security | OpenSearch | PySpark | Python | RAG | REST APIs | Retrieval systems | Scala | Spring Boot | Streaming processing | Vector Databases | Vulnerability Management
Education
N/A
Roles
Related jobs
-
Data Quality Analyst ( ETL/Data Warehouse ) INR 800K-1600KAgile | Anomaly Detection | Azure Data | Azure Data Factory | CI/CDMid-level Full TimeHome - India (HOMEIND)9h ago
-
Senior Data Engineer - Full Stack (US, Remote) INR 2000K-3000KAPI | AWS | CI/CD | CLI | Data GovernanceCollaborative team | Developer productivity focus | Remote workSenior-level Full TimeMaharashtra, Pune, India R9h ago
-
AWS Cloud Engineer INR 1500K-3000KAWS CloudFormation | AWS Fargate | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeBangalore, India9h ago
-
Senior-level Full TimeBangalore, India9h ago
-
Architect (ATC) INR 1500K-3500KAutomation | Backup Restore Validation | Backup/Restore | CI/CD | Cause analysisSenior-level Full TimeIN-MH-Pune10h ago
-
Senior-level Full TimeIN-AP-Hyderabad10h ago
-
Gen AI INR 2000K-3300KAI Studio | Azure AI | Azure AI Studio | Azure Cognitive | Azure Cognitive SearchMid-level Full TimeIN-AP-Hyderabad10h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India15h ago
-
Mid-level Full TimeHyderabad, IN15h ago
-
Assistant Manager INR 1800K-3000KAI Governance | AI Services | AWS | AWS Infrastructure | Agent systemsMid-level Full TimeNoida, Uttar Pradesh, India16h ago
-
Lead Software Engineer (Cloud Native | Microservices | AWS) INR 3000K-4000K.NET | API | AWS | AWS CDK | Behavior-Driven DevelopmentEnhanced medical benefits | Hybrid work | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India16h ago
-
GenAI Engineer - Database INR 2000K-3465KData Governance | Data Privacy | Data Security | Embeddings | Graph AlgorithmsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India17h ago
-
Architect Data Products(M/F/D) INR 2400K-4000KAPIs | Automation | Azure | Azure Data | Azure Data FactoryCareer development | Flexible working hours | Inclusive work environment | International networking | Learning opportunitiesSenior-level Full TimeHyderabad, IN17h ago
-
Cloud Data Engineer(M/F/D) INR 1500K-2000KAPIs | Agile | Automation | Azure | Azure DataCareer development | Flexible working models | International networking | Learning opportunitiesMid-level Full TimeHyderabad, IN17h ago
-
Senior-level Full TimeBangalore, India17h ago
-
Generative AI Engineers INR 1716K-2500KLanguage Models | Large Language Models | Machine Learning | Prompt engineering | PythonEntry-level Full TimeBangalore, Karnataka, India18h ago
-
Sr Lead Software Engineer INR 3000K-5000KAI assisted code | AI-assisted code review | AI-assisted refactoring | API Versioning | AWSSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Senior AI Engineer I INR 3264K-5572KAPIs | Agentic AI | Backend Development | Cloud infrastructure | Data PipelinesCareer development and training opportunities | Healthy Minds programSenior-level Full TimeGurugram, HR, India19h ago
-
Senior-level Full TimeBangalore,Karnataka,India21h ago
-
Amazon Web Services | Apache Airflow | Apache Hadoop | Azure Data | Azure Data FactoryFlexible work arrangements | Mentorship | Wellbeing supportSenior-level Full TimeChennai - Menon Eternity, India23h ago
-
API Management | Azure Cognitive | Azure Cognitive Search | Azure Databricks | Azure FunctionsSenior-level Full TimeAiroli, India23h ago
-
Data Engineer (Audience Intelligence) INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure DevOps | Azure FunctionsMid-level Full TimeHyderabad, Telangana, India23h ago
-
Python Gen AI consultant INR 3000K-4000KAutogen | Automated testing | CI/CD | Cloud platform | Crew AIMid-level Full Timebangalore, KA, IN23h ago
-
Mid-level Full TimeBangalore, KA, IN23h ago
-
Sr Technical Consultant-Cloud - Java,Microservices,Kafka,Nosql INR 2200K-3500KAKS | ARM Templates | Active Directory | Apache Spark | AzureSenior-level Full TimeBangalore, India23h ago