Data Engineering Lead
Bangalore, Karnataka
INR 2500K-4000K (estimate) Senior-level Full Time
Tasks
- Build data pipelines
- Develop retrieval-augmented generation pipelines
- Guide team problem solving
- Integrate data systems across the organization
- Manage healthcare data compliance with FHIR and HL7
- Maximize GenAI accuracy and minimize latency
- Optimize data extraction transformation loading
- Orchestrate data workflows with Airflow
- Orchestrate workflows with Temporal
- Support RAG and GraphRAG search retrieval and aggregation
- Validate and assess GenAI data systems
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Azure | Azure OpenAI | CI/CD | ClickHouse | Data Lake | Data Validation | ETL | Embeddings | FHIR | GraphRAG | HIPAA | HL7 | Langchain | Llamaindex | Milvus | Model Monitoring | MongoDB | NLP | OLAP | PII | Phi | PostgreSQL | Prompt Optimization | Prompt Tuning | Prompt engineering | Python | RAG | REST API | Snowflake | Starburst | Temporal | Vector Database | Weaviate
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Lead AI Software Engineer INR 2000K-4500KAI Agents | AWS | Azure | CI/CD | Cloud platformCareer growth | Career growth in technology domain | Continuous learningSenior-level Full TimePune City, India11h ago
-
Senior-level Full TimeIndia14h ago
-
Data Integration Lead INR 1500K-2500KCICD | Control-M | IBM InfoSphere | IBM Infosphere DataStage | InfoSphere-DataStageClient facing communication | Production support experienceSenior-level Full TimeIndia14h ago
-
Amaze - Cloud Data Architect INR 1200K-2000KApache Airflow | Azure | Integration Services | Java | Power BISenior-level Full TimeIndia14h ago
-
CLOUD AMAZE - DW Lead (Practice) INR 1500K-2500KAzure | Azure Databricks | Cloud Computing | Data Architecture | Data EngineeringSenior-level Full TimeIndia14h ago
-
Data Integration Lead INR 1500K-3000KData Standardization | Data Validation | Data extraction | HTML | IXBRLSenior-level Full TimeIndia14h ago
-
Senior-level Full TimeIndia14h ago
-
Senior-level Full TimeIndia16h ago
-
Lead Data Scientist INR 3000K-4000KAWS | Azure | Classification | Clustering | Experiment designFlexibility | Health benefitsSenior-level Full TimePune City,India R17h ago
-
Lead Data Scientist-Digital Banking Kotak 811-Regional Sales INR 3000K-4000KCI/CD | Data Analysis | Deep learning | Experiment design | Exploratory Data AnalysisSenior-level Full TimeBangalore, Karnataka, India18h ago
-
Lead Data Architect INR 1500K-2500KAWS | Agile | Amazon Redshift | Apache Spark | BigQueryRelocationSenior-level Full TimeIND - Bangalore, India1d ago
-
Lead AI Engineer INR 2500K-3500KAgent Development | Debugging | Incident Response | LLM API | Language ModelGrowth and innovation | Hybrid work policy | Inclusive company culture | Remote work option | Self-directionSenior-level Full TimeNoida, India R1d ago
-
IN_Manager_Data Analyst_Digital Integration_Advisory_Kolkata INR 1400K-2300KAlation | Azure Data | Azure Data Services | Azure Purview | CollibraFlexible working | Inclusive benefits programs | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India1d ago
-
Director Data Engineering INR 3000K-6000KAPI Management | APIs | Azure API | Azure API Management | Azure DataExecutive-level Full TimeBangalore, India1d ago
-
Lead Data Science Consultant INR 1880K-2436KAWS | Agile | Azure | Cloud Computing | Credit RiskEqual opportunity workplace | Onsite 3 days per weekSenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India1d ago
-
Senior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Lead Software Engineer - Full Stack Developer and Gen AI INR 2500K-3465KAngular | Azure DevOps | C# | CI/CD | ContainerizationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Lead Consultant - Bespoke Engineering & AI Innovation INR 2475K-4800KAWS | Autogen | Azure | Bicep | CI/CDSenior-level Full TimeIndia - Chennai1d ago
-
IN-Manager_Scrum Master_Data and Analytics_Advisory_Hyderabad INR 1500K-2000KAWS | Agile | Azure | Azure DevOps | Daily standupMid-level Full TimeHyderabad - Salarpuria, India1d ago
-
IN_Manager_Data Analyst_Digital Integration_Advisory_Kolkata INR 1400K-2300KAlation | Azure Purview | Collibra | DBT | Data ModelingEmployee wellbeing support | Flexibility programs | Inclusive benefits | MentorshipMid-level Full TimeKolkata DN 57, India1d ago
-
Data Platforms and AI Access Control Lead INR 2475K-3380KAI Security | API Security | Access Control | Access Management | Access deprovisioningSenior-level Full TimeBengaluru Campus 31, India1d ago
-
Global Data Quality Assurance Lead INR 2040K-2800KAI | AWS | Amazon Web Services | Data Analysis | Data GovernanceFlexible work schedule | In office minimum three days per weekSenior-level Full TimeIndia - Chennai1d ago
-
Lead Data Scientist INR 3000K-4000KAWS | Amazon Redshift | Azure | Decision Science | Discrete choiceAnnual leave | Employer pension contribution | Flexible benefits | Health cash plan | Income protectionSenior-level Full TimeHyderabad, International Tech Park, India1d ago
-
Lead Software Engineer INR 1500K-2500KABAC | Auditing | BigQuery | CD pipelines | CI/CDOnsite work five days a week | Relocation availableSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Lead Software Engineer INR 2200K-4500KBigQuery | CI/CD | Cloud platform | Docker | Document AIFlexible working options | Hybrid workingSenior-level Full TimeHyderabad Knowledge Park Tower 2, India1d ago