Lead Data Engineer with AI experience
Tasks
- Build data governance security and data quality checks
- Build production data pipelines batch and real time
- Create semantic layer knowledge graphs and feature store
- Develop data APIs tool schemas and memory state stores
- Implement automated evaluation and monitoring pipelines
- Implement vector store and embedding pipelines
- Maintain retrieval infrastructure for RAG
- Support ML and LLMOps data infrastructure
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Attribute-Based Access Control | Attribute-based access | Audit Logging | CI/CD | ChromaDB | Data Governance | Data Quality | Delta Lake | Docker | EKS | Faiss | FastAPI | GitHub Actions | Glue | Kafka | Kinesis | Kubernetes | Langchain | Langgraph | Llamaindex | MLOps | MLflow | Neo4j | OpenSearch | PII Detection | Pinecone | Prompt engineering | PySpark | Python | RBAC | RLHF | Redshift | S3 | SQL | Snowflake | Spark Structured Streaming | Structured Streaming | Terraform | Text-to-SQL
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Staff Software Engineer, AI Garage INR 2000K-4800KAgentic AI | Artificial Intelligence | C# | C++ | Distributed SystemsSenior-level Full TimeHyderabad, Telangana, India17h ago
-
Senior Staff Engineer (AI Developer - AppSec) INR 2000K-4500KAPI Security | API Security Top 10 | API security testing | Agentic Workflows | Azure DevOpsSenior-level Full TimeMumbai, India18h ago
-
Senior Staff Engineer (AI Developer - DevSecOps Tools) INR 3000K-5000KAKS | ARM Templates | AWS EventBridge | Aqua Security | ArgoCDSenior-level Full TimeMumbai, India19h ago
-
Associate Principal, SOX Analytics INR 2940K-4200KAI | API Integration | Audit Methodology | Coso | Data AnalysisBonus incentives | Employee travel credits | Equity programs | Inclusion and belongingMid-level Full TimeIndia22h ago
-
Senior Data Engineer INR 2520K-3380KApache Airflow | Apache Iceberg | Azure Data | Azure Data Lake | Azure DevOpsSenior-level Full TimePune, MH, IN1d ago
-
Principal Engineer Software INR 1500K-3000KAWS | Amazon Redshift | Analytics engineering | Apache Spark | BusinessObjects Data ServicesFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India1d ago
-
Software Engineer II-Continous Learning INR 2000K-3500KAsynchronous programming | Containerization | Distributed Systems | Docker | Event StreamingConference reimbursement | Employee assistance program | Employee stock purchase program | Flexible time off | LinkedIn LearningMid-level Full TimeHyderabad1d ago
-
Software Engineer I-Continuous Learning INR 700K-800KAsynchronous programming | C++ | Containerization | Distributed Systems | DockerConference reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time offEntry-level Full TimeHyderabad1d ago
-
Staff Software Engineer-AI INR 2000K-4500KAsynchronous Architecture | Autogen | Backpressure | CrewAI | Data GenerationEmployee assistance program | Flexible time off | LinkedIn Learning subscription | Local Employee Meetups | Training and education reimbursementSenior-level Full TimeHyderabad1d ago
-
Mid-level Full TimeGurgaon, Haryana, India1d ago
-
ETL Test Engineer (3-6 yrs) (Pune/Chennai) - (Must Have- ETL Testing, Python, Pyspark, Azure Databricks) INR 900K-1500KAPI Testing | Apache Airflow | Azure Databricks | Bitbucket | DockerEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai/Pune, India1d ago
-
Senior Data Engineer INR 1500K-2500KACID | AWS S3 | Amazon Redshift | Apache Kafka | Azure DataWork from office 5 days per weekSenior-level Full TimeGurugram, Haryana, India1d ago
-
Senior Data Engineer INR 1500K-2800KApache Spark | Data Governance | Data Pipelines | Data Privacy | Data SecurityLocal presence requiredSenior-level Full TimeOntario Centre (Queensville), India1d ago
-
AWS | AWS Glue | AWS Glue Data Catalog | AWS Lake Formation | AWS LambdaAutonomy and ownership | Career growth | Collaborative global environment | Flexible work culture | Fully remote workSenior-level Full TimeIndia R1d ago
-
Data Engineer - HR Analytics & Workday Prism INR 1500K-2000KAPI Integrations | AWS SageMaker | Agile | Apache Spark | AzureMid-level Full TimePune, Maharashtra, India1d ago
-
Data Bricks Engineer INR 1500K-2400KDatabricks | Databricks SQL | Delta Lake | JSON-RPC | MLflowWork from office 5 days per weekSenior-level Full TimeGurugram, Haryana, India1d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Collaborative work environment | Continuous learning and skill development | Flexible work setup | Fully remote workSenior-level Full TimeIndia R1d ago
-
Staff Engineer ( Meshing, C++ / C#, GenAI ) INR 1753K-2800KC# | C++ | CUDA | Computational Geometry | DebuggingHealth insurance | Wellness benefitsSenior-level Full TimeIndia Off-Site, India1d ago
-
Adobe Campaign | Braze | CDP | Census | Consent ManagementCareer growth opportunities | Cross functional autonomy | Flexible location in India | Learning opportunities | Remote-first work modelSenior-level Full TimeIndia1d ago
-
Mid-level Full TimeChennai, Tamil Nadu, India1d ago
-
AI/ML Silicon Validation Lead, Google Cloud, TPU INR 3200K-5000KAXI | Board Schematic | Board Schematic Analysis | Bring-up | DDRSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Sub Value Stream Technology Delivery Lead/Sr. Associate Director, Data and Analytics INR 1400K-2100KAgile | CI/CD | Cloud Native | Cloud platform | ComplianceMid-level Full TimePune, Maharashtra, India R1d ago
-
Engineer - Embedded Automation QA INR 480K-1050KAPI Testing | Azure DevOps | BACNet IP | C plus plus | CI/CDMid-level Full TimeHadapsar, Pune, Maharashtra, IND, 4110131d ago
-
Team Leader - Data Management INR 1500K-2700KCRP | Cause analysis | Cloudera | Data Governance | Data ManagementSenior-level Full TimePondicherry, Puducherry, IND, 6051111d ago
-
Data Analytics Professional INR 1500K-2700KAPIs | Agile | Cloud Data | Cloud Data Platforms | ConfluenceMid-level Full TimeBengaluru, IN, 5601031d ago