Sr. Data Engineer - AI ML
Tasks
- Automate data ingestion workflows
- Collaborate with AI/ML, Data, Product teams
- Design data pipelines for AI systems
- Develop knowledge bases and knowledge graphs
- Document data schemas and pipelines
- Engineer retrieval-augmented reasoning pipelines
- Ensure data governance and security compliance
- Ensure data quality and traceability
- Evaluate new AI data technologies
- Implement feedback loops for AI knowledge refinement
- Monitor retrieval performance and model-data alignment
Perks/Benefits
- Comprehensive benefits
- Flexible work
- Inclusive culture
- Professional development
- Retirement options
- Vacation increase
- Volunteer days
Skills/Tech-stack
AI architecture | AWS Neptune | Airflow | ArangoDB | Athena | Cloud Data | Cloud Data Platforms | Data Modeling | Data platforms | Dspy | ECS | Elastic Vector Search | Embedding Generation | Faiss | Glue | Graph Databases | Knowledge representation | LLM workflows | Lambda | Langchain | Llamaindex | Milvus | Model Context Protocol | Neo4j | Orchestration frameworks | Pinecone | Prefect | PyTorch | Python | Redshift | S3 | SQL | Schema Design | Semantic Kernel | Step Functions | TensorFlow | Vector Databases | Vector Search | Weaviate
Education
Bachelor's | Master's | PhD
Related jobs
-
Senior Data Engineer INR 2000K-2400KAWS Glue | Amazon Redshift | Amazon S3 | Apache Airflow | Apache SparkSenior-level Full TimeHyderabad, Hyderabad, IN15h ago
-
Sr Data Engineering - GCP INR 1500K-2040KAccess Control | Analytics engineering | BigQuery | CI/CD | Cloud RunSenior-level Full TimeHyderabad, TS, India19h ago
-
Senior Data Engineering (GCP) INR 2000K-2040KAccess Control | Anomaly Detection | BigQuery | CI/CD | Cloud RunSenior-level Full TimeHyderabad, TS, India20h ago
-
Senior Data Engineer INR 2516K-2829KAirflow | Apache Spark | Azure | Azure Data | Azure Data LakeEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India20h ago
-
Data Engineer- AWS+MS Fabric+ Purview INR 1500K-2400K.NET | AWS CloudFormation | AWS Lambda | Amazon EC2 | Amazon RDSSenior-level Full TimeHyderabad, Telangana, India23h ago
-
Sr. Azure Data Engineer INR 1500K-2000KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - BENGALURU - HP, IN1d ago
-
Senior-level Full TimeIndia - Hyderabad1d ago
-
Senior Engineer Data - MDM INR 1628K-2146KAgile | Amazon Web Services | Azure | Cloud Platforms | Cloud platformFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India1d ago
-
Delivery Lead/Senior Data Engineer 3 INR 2400K-3500KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon RedshiftSenior-level Full TimePune, Gera Commerzone SEZ, India1d ago
-
Senior-level Full TimeIndia1d ago
-
Senior Data Engineer INR 1300K-2000KBigQuery | Cloud Composer | Cloud Storage | Cloud platform | Data WarehousingHybrid workSenior-level Full TimeIndia-Telangana-Hyderabad1d ago
-
Senior Data Engineer INR 1200K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Alerting | Amazon EMRSenior-level Full TimeHyderabad, IN1d ago
-
Senior Data Engineer II INR 2520K-3380KAPI Development | AWS | AWS RDS | Amazon Redshift | Apache SparkFlexible working model | Health and parental leave plans | Professional development stipend | Remote work optionSenior-level Full TimeBengaluru - BLR1 R1d ago
-
Senior Data Engineer INR 2829K-3380KAccess Control | Airflow | Amazon Redshift | Apache Beam | Apache FlinkSenior-level Full TimeGurugram, India1d ago
-
Machine Learning Senior Analyst INR 2500K-4225KAPI Gateway | AWS Bedrock | AWS IAM | AWS KMS | AWS LambdaSenior-level Full TimeIND Bengaluru, India2d ago
-
VP Lending Data Engineering & Analytics Technology INR 1500K-6000KAgile | Cassandra | Data Governance | Data Lineage | Data ModelingExecutive-level Full Time1/124, SHIVAJI GARDENS, MOONLI, India2d ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure DevOpsFlexible work arrangements | Mentorship | Travel opportunitiesSenior-level Full TimeBhubaneswar - Ihub, India2d ago
-
API ingestion | Agile | Apache Airflow | Apache Hadoop | Apache KafkaSenior-level Full TimeMumbai Shivaji Park, India2d ago
-
IN_Senior Associate_Azure Data Engineer_OC D&A_Advisory_Kolkata INR 2000K-2146KAWS | Agile | Apache Airflow | Apache Hadoop | Apache SparkFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeKolkata Y-14, India2d ago
-
Senior-level Full TimeBengaluru, KA, IN, 5621222d ago
-
Sr Engineer Data INR 1800K-2300KAWS | Agile methodology | Amazon Aurora | Amazon Redshift | Apache SparkFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India2d ago
-
EY-GDS Consulting-N-AI And DATA-Databricks-Senior INR 2000K-2040KAWS | Apache Spark | Azure | Azure DevOps | CI/CDSenior-level Full TimePune, MH, IN, 4110142d ago
-
Lead Software Engineer Spark, Pyspark ,AWS INR 1200K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon EKS | Amazon S3Senior-level Full TimeHyderabad, Telangana, India2d ago
-
Senior/Expert Data Engineer INR 1500K-2000KApache Pinot | BigQuery | Cloud platform | Cost Optimization | DBTSenior-level Full TimeBangalore, Karnataka, India2d ago
-
Senior Data Engineer, BizTech INR 2940K-4170KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch ProcessingSenior-level Full TimeBangalore, India2d ago