Sr. Data Engineer - AI ML
Tasks
- Design build and optimize data pipelines for generative AI systems
- Develop and manage knowledge bases vector stores and graph databases
- Document schemas pipelines and data models
- Enforce compliance access control and responsible AI data handling
- Engineer retrieval augmented reasoning and retrieval augmented generation pipelines
- Ensure data quality consistency and traceability with schema validation metadata tagging lineage
- Evaluate new AI data technologies for graph reasoning and embedding architectures
- Implement feedback and reinforcement loops for agent knowledge validation
- Ingest and transform structured and unstructured content into searchable stores
- Integrate monitoring and observability for retrieval performance and model data alignment
Perks/Benefits
- Comprehensive benefits package
- Flexible work options
- Hybrid work model
- Life leave days
- Professional development days
- Remote first work options
- Vacation time increasing with tenure
- Volunteer days
Skills/Tech-stack
AWS ECS | AWS Glue | AWS Lambda | AWS Neptune | AWS Step Functions | Access Control | Airflow | Amazon Redshift | Amazon S3 | ArangoDB | Athena | Data Governance | Data Lineage | Data Modeling | Dspy | Elastic Vector Search | Embeddings | Faiss | Graph Databases | Infrastructure as Code | Knowledge graphs | LLM Prompt | LLM prompt evaluation | LangChain Agents | Langchain | Llamaindex | MCP | Milvus | Model Context Protocol | Monitoring | Neo4j | Observability | Pinecone | Prefect | Prompt evaluation | Python | RAG | RAQ | Retrieval-Augmented Generation | Retrieval-augmented reasoning | SQL | Schema Design | Semantic Kernel | Semantic Search | Step Functions | Terraform | Text Chunking | Vector Databases | Vector Search | Weaviate | “as-code”
Education
N/A
Roles
Related jobs
-
SSE_Analytics Enablement INR 2250K-5000KAI/ML | Alteryx | Analytics engineering | Architecture Review | AutomationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India7h ago
-
SSE_Analytics Enablement INR 2250K-5000KAlteryx | Architecture Review | Artificial Intelligence | CI/CD | Code AutomationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India7h ago
-
Data Engineer INR 1000K-1000KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud BuildEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India8h ago
-
Data Engineer INR 1500K-3000KAPI Development | AWS | Amazon Kinesis | Amazon Redshift | AzureCommunity volunteering opportunities | Discounted gym memberships | Flexible working | Life assurance | Medical insuranceMid-level Full TimeHyderabad, India12h ago
-
ML Engineer (Must have- Python & R), Pune candidates preferred INR 2500K-3356KAWS | Azure | Code Documentation | Confluence | Distributed SystemsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India12h ago
-
Forward Deployed Engineer INR 4500K-7000KAI | APIs | Agentic AI | Developer tools | Enterprise SoftwareHigh-ownership environment | Onsite customer engagement | R and D Collaboration | Structured Product FeedbackSenior-level Full TimeGurugram, Haryana, IN13h ago
-
Entry-level Full TimeBengaluru, India14h ago
-
GCP Data Engineer / Consultant Specialist INR 1500K-2000KAirflow | Alerting | Apache Beam | Automation | BigQueryFlexible working | Inclusive workplace | Opportunities for growth | Professional developmentMid-level Full TimePune, Maharashtra, India R14h ago
-
Senior AI Testing Engineer (Generative AI) INR 2000K-3300KAI Agents | API Testing | AWS | Azure | CI/CDSenior-level Full TimeBangalore North, India14h ago
-
Senior-level Full TimeIN-KA-Bangalore15h ago
-
Senior-level Full TimeIN-KA-Bangalore15h ago
-
Senior-level Full TimeIN-KA-Bangalore15h ago
-
Senior-level Full TimeIN-KA-Bangalore15h ago
-
Senior-level Full TimeIN-KA-Bangalore15h ago
-
Senior-level Full TimeIN-TN-Chennai15h ago
-
Data Science and Tech Lead AMEA INR 2000K-3500KAWS | Agile | Amazon Bedrock | Amazon SageMaker | CI PipelinesSenior-level Full TimePune, ASIA, India15h ago
-
Mid-level Full TimeBangalore, Karnataka, India16h ago
-
Mid-level Full TimeBangalore, Karnataka, India16h ago
-
Mid-level Full TimeBangalore, Karnataka, India16h ago
-
Mid-level Full TimeBangalore, Karnataka, India16h ago
-
Assistant Manager- AI Engineer INR 1500K-2800KAmazon Web Services | Anthropic Claude | Autogen | Azure | Cloud platformMid-level Full TimeBangalore, Karnataka, India16h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2200KAI Search | Agile | Azure | Azure OpenAI | CSSMid-level Full TimeBangalore, Karnataka, India16h ago
-
Practice Customer Engineer, Gen AI, Telecom or FSI INR 1800K-3300KAI Agent Development Kit | API Gateway | Agent Development Kit | Agentic AI | Audit LoggingSenior-level Full TimeMumbai, Maharashtra, India16h ago
-
Senior Software Engineer, AI/ML, AI Garage INR 2500K-4800KApache Beam | BigQuery | Cause analysis | Data Processing | DataflowSenior-level Full TimeHyderabad, Telangana, India16h ago
-
Data Engineer, Play Data Science and Analytics INR 1500K-2500KAI | Automation | C plus plus | Data Infrastructure | Data ModelingMid-level Full TimeBengaluru, Karnataka, India16h ago