Sr. Data Engineer - AI ML
Tasks
- Automate workflows for content ingestion
- Collaborate on data ingestion and retrieval strategies
- Design data pipelines for AI systems
- Design feedback loops for AI knowledge refinement
- Develop knowledge bases and vector stores
- Document data schemas and pipelines
- Enforce data governance and security standards
- Engineer RAQ/RAG pipelines
- Ensure data quality and traceability
- Evaluate new AI data technologies
- Implement monitoring and observability
Perks/Benefits
- Bonus program
- Comprehensive benefits
- Flexible work
- Inclusive environment
- Life leave
- Professional development
- Retirement options
- Vacation days
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS Neptune | AWS S3 | Airflow | ArangoDB | Athena | Context chunking | Data Modeling | Dspy | ECS | Elastic Vector Search | Embedding Generation | Faiss | LLM workflows | Langchain | Llamaindex | Milvus | Model Context Protocol | Neo4j | NoSQL | Pinecone | Prefect | Prompt evaluation | Python | Redshift | Retrieval contexts | SQL | Schema Design | Semantic Kernel | Semantic indexing | Step Functions | Vector Search | Weaviate
Related jobs
-
Senior-level Full TimeOff Embassy Golf Links Business Park, …1d ago
-
AWS | Agile | Apache Airflow | Apache Hadoop | AzureFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
AWS | AWS Glue | Access Control | Apache Spark | AzureSenior-level Full TimeHyderabad - Salarpuria, India1d ago
-
Agile | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeBhubaneswar - Ihub, India1d ago
-
Agile | Azure | Azure Data | Azure Data Factory | Azure Data LakeFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBhubaneswar - Ihub, India1d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure SQLFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBhubaneswar - Ihub, India1d ago
-
Amazon Web Services | Apache Airflow | Apache Hadoop | Azure | Azure DataFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
AWS | AWS Glue | Access Control | Apache Spark | AzureSenior-level Full TimeHyderabad - Salarpuria, India1d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure SQLSenior-level Full TimeBhubaneswar - Ihub, India1d ago
-
Agile | Azure Data | Azure Data Factory | Azure SQL | Data ComplianceSenior-level Full TimeBhubaneswar - Ihub, India1d ago
-
PA2026Q1JB031 -Senior Data Engineer INR 1800K-2000KAWS | Access Control | Airflow | Apache Iceberg | Apache KafkaSenior-level Full TimeHyderabad India - Block B1d ago
-
Senior Data Engineer INR 2520K-3380KAWS | Agile | Apache Airflow | CI/CD | ConfluentContinuing education program | Continuous learning | Family-friendly perks | Flexible time off | Health and wellnessSenior-level Full TimeIN - MUMBAI LIGHTBRIDGE IT PARK …1d ago
-
Senior-level Full TimeBangalore, Karnataka, IN India, 5600871d ago
-
Senior Data Engineer INR 2520K-3880KAWS Glue | AWS Step Functions | Amazon Athena | Amazon DynamoDB | Amazon EMRSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Data Engineer INR 2520K-3100KCDC | DBT | Data Lineage | Data Modeling | Data PipelinesOn-call rotationSenior-level Full TimePune, MH, India1d ago
-
Senior Data Engineer INR 2000K-2040KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure DatabricksCareer progression | Company bonus scheme | Comprehensive benefits | Hybrid work model | Inclusive cultureSenior-level Full TimeHyderabad, India2d ago
-
Senior Azure Fabric Data Engineer INR 1500K-2000KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote work | Work from homeSenior-level Full TimeIndia - Remote R2d ago
-
EY - GDS Consulting - AI And DATA -Azure Databricks - Senior INR 2040K-2400KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCoaching and feedback | Flexible working arrangements | Professional development opportunitiesSenior-level Full TimeBengaluru, KA, IN, 5600162d ago
-
API ingestion | Agile | Amazon Web Services | Amazon Web Services (AWS) | Apache AirflowFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India2d ago
-
API Integration | Apache Airflow | Apache Kafka | Apache Spark | App ServiceFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India2d ago
-
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure SQLFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBhubaneswar - Ihub, India2d ago
-
API | Apache Airflow | Apache Hadoop | Apache Spark | App ServiceFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India2d ago
-
Senior-level Full TimeGurugram, India2d ago
-
Senior-level Full TimeGurugram, India2d ago
-
Senior Data Engineer INR 2516K-3356KAirflow | Apache Hive | Azure | CI/CD | Data LakeEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India3d ago