Lead Data Engineer with AI experience
Tasks
- Build data governance security and data quality checks
- Build production data pipelines batch and real time
- Create semantic layer knowledge graphs and feature store
- Develop data APIs tool schemas and memory state stores
- Implement automated evaluation and monitoring pipelines
- Implement vector store and embedding pipelines
- Maintain retrieval infrastructure for RAG
- Support ML and LLMOps data infrastructure
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Attribute-Based Access Control | Attribute-based access | Audit Logging | CI/CD | ChromaDB | Data Governance | Data Quality | Delta Lake | Docker | EKS | Faiss | FastAPI | GitHub Actions | Glue | Kafka | Kinesis | Kubernetes | Langchain | Langgraph | Llamaindex | MLOps | MLflow | Neo4j | OpenSearch | PII Detection | Pinecone | Prompt engineering | PySpark | Python | RBAC | RLHF | Redshift | S3 | SQL | Snowflake | Spark Structured Streaming | Structured Streaming | Terraform | Text-to-SQL
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Entry-level Full TimeBangalore, India; Sunnyvale, CA; San Bruno, …6h ago
-
Apache Spark | Avro | Azure Data | Azure Data Factory | Azure Data LakeRemote work optionMid-level Full TimeDallas / Philadelphia, USA; Bangalore, India; …6h ago
-
AWS | Amazon Aurora | Amazon RDS | Amazon S3 | CI/CDMid-level Full TimeDahisar West, Maharashtra10h ago
-
Data Platform Operations Engineer (Databricks, DBT, Snowflake, AWS, Aurora) - Mumbai, MH - AS A INR 1300K-2000KAmazon Aurora | Amazon S3 | Amazon Web Services | Backup and Recovery | CDCMid-level Full TimeMumbai, MH10h ago
-
DevOps / AWS Data Platform Engineer (Databricks, Snowflake, Aurora, S3, DBT) - Mumbai, MH - AS A INR 1500K-2500KAWS S3 | Alerting | Amazon Aurora | Amazon RDS | Amazon Web ServicesMid-level Full TimeMumbai, MH10h ago
-
Apache Spark | Data Pipelines | Data Validation | Databricks | Feature EngineeringMid-level Full TimeMumbai, MH10h ago
-
Software Engineer III - Python INR 3000K-5000KAlerting | CI/CD | Docker | Infrastructure as Code | KubernetesSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior-level Full TimeBANGALORE, Karnataka, Inde12h ago
-
Agentic AI | Agile | Artificial Intelligence | Docker | Generative AISenior-level ContractShaikpet, India13h ago
-
Senior AI Engineer / Data Scientist (Agentic AI) INR 2000K-5000KAI Search | AI Services | Agentic AI | Azure | Azure AISenior-level Full TimeChennai, India13h ago
-
Senior-level Full TimeIN-KA-Bangalore13h ago
-
GenAI Developer INR 1800K-4500KAPI Development | AWS | Azure | C++ | Cloud platformFull-time work | Work from OfficeSenior-level Full TimeIN-TN-Chennai13h ago
-
Expert Data Engineer INR 3500K-4200KAPI Integration | Access Control | Attribute-Based Access Control | Attribute-based access | Audit LoggingHybrid workSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Data Analytics and Reporting Lead INR 3200K-4500KAmazon Web Services | Azure | DAX | Data Modeling | Data WarehousingEmployee assistance program | Flexible work options | Paid time off | Service recognition awards | Training and development programsSenior-level Full TimeBengaluru, KA, India14h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India14h ago
-
Amazon S3 | Apache Iceberg | Cloud Computing | Concurrency | Data ModelingCareer development | Health benefits | Paid time off | Remote work flexibilitySenior-level Full TimeHyderabad, India15h ago
-
Agile | Apache Airflow | Azure Data | Azure Data Factory | Azure DevOpsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India15h ago
-
Software Engineer (Full Stack Developer, Node JS & React JS)) INR 2000K-4500KAI Agents | AI orchestration | API Design | Agile | CI/CDSenior-level Full TimeBangalore, India Office (BANGALORE) R15h ago
-
Data Science Manager I, AI/ML INR 2500K-5000KAdverse impact analysis | Agent Development | Applied Mathematics | Data Modeling | Database queryingSenior-level Full TimeHyderabad, Telangana, India15h ago
-
Application Engineer, Master Data Governance INR 1000K-1500KABAP | Data Governance | Data Management | Fiori | Master DataMid-level Full TimeHyderabad, Telangana, India15h ago
-
GCP, Bigquery, Airflow/Consultant Specialist INR 1500K-2500KAgile | Apache Airflow | Apache Kafka | Apache NiFi | BigQueryFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimeHyderabad, Telangana, India R15h ago
-
Expert Data & AI Engineer INR 3000K-4000KAWS | Apache Spark | Automation | Azure | Azure DevOpsCareer development opportunities | Collaborative culture | Learning opportunities | Team leadership opportunitiesSenior-level Full TimeHyderabad, India16h ago
-
Staff Software Engineer, Machine Learning INR 3000K-4680KC++ | Cross-Functional Collaboration | Cross-functional | Data Pipelines | Fine TuningHealth and wellness programs | Time awaySenior-level Full TimeBengaluru, KA, India16h ago
-
Mid-level Full TimeBangalore, Karnataka, IN16h ago
-
Senior AI Engineer INR 2500K-5000KAPI Design | Agile | Azure | Azure AI | Azure ArcHybrid work | On-call supportSenior-level Full TimeBangalore, Karnataka, IN16h ago