Lead Data Engineer with AI experience
Tasks
- Build agentic data systems with context stores
- Build batch and streaming data pipelines
- Build knowledge graphs and semantic layers
- Configure RBAC and PII handling
- Design and implement retrieval systems
- Develop APIs for autonomous agents
- Develop embedding pipelines
- Evaluate models and track experiments
- Implement Data Governance and Data Quality
- Implement production monitoring
- Implement semantic metadata and data lineage
- Manage dataset curation and feature engineering
- Support machine learning and LLM operations
- Validate schemas and monitor data quality
Perks/Benefits
- Access to modern cloud native technology
- Collaborative engineering culture
- Health insurance
- Hybrid work flexibility
- Learning and development support
- Remote-friendly work
- Wellness benefits
Skills/Tech-stack
AWS | Amazon Bedrock | Apache Kafka | Azure | CI/CD | Chunking | Claude API | Cloud Platforms | Data Lineage | Data Quality | Data quality monitoring | Dataset curation | Delta Lake | Docker | Embeddings | Entity-Mapping | Experiment tracking | FastAPI | Feature Engineering | Hybrid search | Knowledge graphs | Kubernetes | Langchain | Llamaindex | MLOps | MLflow | Metadata Management | Model Evaluation | Ontologies | OpenAI API | PII handling | Production Monitoring | PySpark | Python | Quality monitoring | RBAC | Ranking | Retrieval systems | SQL | Schema Validation | Snowflake | Spark Structured Streaming | Structured Streaming | Vector Databases
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Lead Data Scientist INR 3000K-4000KArtificial Intelligence | Big Data | Classification | Cloud Computing | ClusteringEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India9h ago
-
Associate Software Engineer - Spark/Scala INR 1500K-2000KApache Spark | CI/CD | Databricks | DevSecOps | GitHubEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India9h ago
-
Software Engineer (Python, Pyspark, SQL) INR 1200K-2100KAWS | Azure | CI/CD | GCP | GitEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India9h ago
-
Principal Data Engineer INR 2520K-3380KApp Services | Azure | Azure App | Azure App Services | Azure CognitiveSenior-level Full TimeBengaluru Luxor North Tower, India15h ago
-
API Design | AWS | Agentic AI | C++ | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India15h ago
-
Senior-level Full TimeBengaluru, Karnataka, India15h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India15h ago
-
Associate Engineer INR 1500K-2500KAKS | AWS | App Services | Azure | Azure AppHybrid work model | On-call rotation | Professional office environmentMid-level Full TimeIND-Pune-Smartworks, India15h ago
-
Gen AI Developer - Assistant Vice President INR 2400K-4000KAPI Development | Containerization | Data Privacy | Deep learning | DockerExecutive-level Full TimeIT BUILDING, RAMANUJAN IT SEZ,, India15h ago
-
Entry-level Full TimeBangalore, KA, IN15h ago
-
Senior Data Engineer INR 2600K-3380KAWS Data | AWS Data Services | Apache Iceberg | Data Governance | Data LakehouseSenior-level Full TimeBangalore, KA, IN15h ago
-
Senior AI / Agentic AI Engineer INR 2520K-3500KAWS Bedrock | Agent systems | Generative AI | Knowledge graphs | LangchainSenior-level Full TimeBangalore, KA, IN15h ago
-
Senior Software Engineer INR 2800K-4000KAI | Access Control | Airflow | Artificial Intelligence | AstronomerSenior-level Full TimePune, India R15h ago
-
AI Engineer INR 2000K-3500KAPI Development | CI/CD | Cloud Native | Cloud-native development | ContainersHealth and wellbeing support | Professional developmentMid-level Full TimeFIL Bengaluru Office, India15h ago
-
Lead Engineer (Embedded Platform Software) INR 1753K-3000KARM | Board Bring-up | Bootloader | Bring-up | C#Car lease programme | Contingency leave | Employee scholar programme | Group health insurance | Group personal accident insuranceSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …15h ago
-
Lead Engineer (Embedded Platform Software) INR 1753K-3000KBoard Bringup | Bootloader | C# | C++ | Change ControlCar lease programme | Contingency leave | Employee scholar programme | Group health insurance | Group personal accident insuranceSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …15h ago
-
Lead Engineer (Embedded Platform Software) INR 1753K-3000KARM | Board Bring-up | Bootloader | Bring-up | C#Car lease programme | Contingency leave 12 days | Employee scholar programme | Fuel and maintenance allowance | Group health insuranceSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …15h ago
-
Principal Engineer - (Embedded Platform Software, RTOS) INR 1753K-2372KARM | ARM architecture | Architecture Design | Avionics | Board Bring-upCar lease programme | Contingency leave | Employee scholar programme | Fuel and maintenance driver wages | Group health insuranceSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …15h ago
-
Software Engineering SMTS- Tableau INR 2775K-4500KAWS | Agile | Azure | C# | Cloud deploymentAdoption Assistance | Fertility benefits | On-demand training | Parental leave | Volunteer opportunitiesSenior-level Full TimeIndia - Hyderabad15h ago
-
Digital R&D Physical AI Engineering Expert INR 3000K-4000KActive Learning | Bayesian optimization | C++ | Digital Twins | Isaac LabSenior-level Full TimeHyderabad, India15h ago
-
Data Engineer - People Data, Insights & Analytics INR 1500K-2000KAWS | Apache Spark | Azure | CI/CD | Data ModelingMid-level Full TimePune, Maharashtra, India17h ago
-
Mid-level Full TimeBengaluru22h ago
-
Senior-level Full Timecoimbatore, India23h ago
-
Python Engineer (AI/ML) INR 2500K-3500KCPU | Chroma | Cost Optimization | Data Preprocessing | DockerMid-level Full TimePune, MH, India1d ago
-
Data Analytics AI Specialist INR 15K-20KClassification | Clustering | Data Visualization | Data cleaning | Machine LearningFast-paced startup environment | Growth opportunities | High ownershipEntry-level Full TimeGurugram, HR, IN1d ago