Ai / Data Engineer
Tasks
- Build RAG pipelines with agentic workflows prompt engineering and response grounding
- Build hybrid search retrieval for keyword semantic vector and metadata
- Design and implement data ingestion pipelines
- Design semantic chunking strategies
- Develop connectors and ingestion jobs for indexing
- Develop re ranking pipelines to improve relevance
- Extract and convert content to markdown
- Implement metadata extraction enrichment and deduplication
- Implement security controls for access restriction
- Track document versions provenance permissions and deletions
Perks/Benefits
- N/A
Skills/Tech-stack
Agentic Workflows | Data Ingestion | Deduplication | Elasticsearch | Embedding Models | Hybrid search | Indexing | LLM Tool Calling | LLM orchestration | Markdown | Metadata Extraction | OpenSearch | Prompt engineering | Python | RAG | Ranking Profiles | Re-ranking | Relevance Tuning | Reranking models | Semantic Search | Semantic chunking | Tool-Calling | Vector Search
Education
Roles
AI | AI Engineer | Data Engineer | Engineer
Related jobs
-
Expert Data Engineer (Databricks) INR 1500K-2400KAPI Design | API Key | AWS Glue | AWS IAM | AWS LambdaSenior-level Full TimeMaharashtra, Pune, India2h ago
-
Senior Data Engineer (Databricks) INR 2000K-2800KAPI Keys | AWS Glue | AWS IAM | AWS Lambda | AWS S3Senior-level Full TimeMaharashtra, Pune, India2h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureEducation budget | Local connection | Personal growth budget | Remote work | Wellness budgetSenior-level Full TimeMumbai, India2h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureGrowth education budget | Local compliance in India | Remote work | Team meet-ups | Wellness budgetSenior-level Full TimeBangalore North, India2h ago
-
Data Engineer (GCP) ID56375 INR 1500K-2500KApache Airflow | Apache Hadoop | Apache Spark | CI/CD | Change Data CaptureBudgets for personal growth education and wellness | Legal presence in India | Local connection | Periodic meet ups | Remote workSenior-level Full TimePune City, India2h ago
-
Data Engineer INR 1500K-2500KAWS Glue | AWS Step Functions | Amazon Athena | Amazon Kinesis | Amazon Web ServicesSenior-level Full TimeIN-MH-Pune3h ago
-
Software Engineer - ML Ops DevOps INR 2500K-3465KAWS | Argo CD | Azure | CI/CD | Data PipelinesCollaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …3h ago
-
Associate Engineer - Embedded AI & Data Analytics INR 1000K-1141KC plus plus | Classification | Data Modeling | Data Observability | Data PipelinesCollaborative work environment | On-site work schedule | Professional development opportunities | Training opportunitiesMid-level Full TimeBangalore - Karnataka, India - Kalyani …3h ago
-
AI/ML Expert INR 2500K-4500KASR | Agent systems | Conversational AI | Data Analysis | Edge ComputingSenior-level Full Timepune, India6h ago
-
Senior Data Engineer - Big Data & Automation INR 1500K-2500KAgile | Ansible | Apache Hive | Apache Spark | ArgoCDFlexible work policy | Work from homeSenior-level Full TimeIndia6h ago
-
AI Senior Software Engineer INR 1800K-3300KAgent collaboration | Agents SDK | Autogen | CI/CD | EmbeddingsInclusive work environmentSenior-level Full TimeNoida, Uttar Pradesh, India6h ago
-
Lead Database Engineer INR 1800K-3000KASH | AWR | AWS CloudWatch | AWS RDS | Access GovernanceHealth and life insurance | Hybrid schedule | Paid time off | Pension and retirement benefits | Professional development supportSenior-level Full TimeHyderabad, India R6h ago
-
Senior Data Engineer - ETL Framework INR 1500K-2500KApache Doris | Apache Hive | Apache Iceberg | Apache Spark | Apache TezFlexible work policy | Work from homeSenior-level Full TimeIndia6h ago
-
Data Engineer INR 1000K-1200KAzure | Azure Data | Azure Data Factory | Data Bricks | Data FactoryEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India7h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India8h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India8h ago
-
AI Engineer - SAP S/4HANA INR 2000K-4500KA2A protocol | AI Core | AI-Hub | Agent systems | Agent to AgentSenior-level Full TimeBangalore, Karnataka, IN8h ago
-
Lead Software Engineer - Java/Python, AWS, Spark INR 1500K-3000KAWS | AWS CloudFormation | AWS Step Functions | Airflow | Amazon S3Senior-level Full TimePune, Maharashtra, India8h ago
-
Director - AI Engineer INR 2400K-6000KAI Governance | AI Workflow Orchestration | AI workflow | API Development | Agent systemsExecutive-level Full TimeBangalore, Karnataka, India8h ago
-
Consultant INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBangalore, Karnataka, India8h ago
-
Executive-KDNI - Data & Analytics INR 1500K-5199KAWS | Azure | Dashboarding | Data Governance | Data ModelingExecutive-level Full TimeGurgaon, Haryana, India9h ago
-
Analytics Engineer - SQL & Data Visualization INR 1500K-2500KAgile | Cloud Data | Cloud Data Warehouse | Data Interpretation | Data ModelingMid-level Full TimeBengaluru, KA, India9h ago
-
AES - DE - Generative AI Application Developers INR 2500K-4200KAWS | Agent Loops | Anthropic | Asynchronous programming | AutogenSenior-level Full TimePune, Maharashtra, India9h ago
-
Senior-level Full TimePune10h ago
-
Data Visualization | Financial Modeling | MATLAB | Portfolio construction | PythonMid-level Full TimeBengaluru, Karnataka, India10h ago