Data Engineering Lead
Bangalore, Karnataka
INR 2500K-4000K (estimate) Senior-level Full Time
Tasks
- Build data pipelines
- Develop retrieval-augmented generation pipelines
- Guide team problem solving
- Integrate data systems across the organization
- Manage healthcare data compliance with FHIR and HL7
- Maximize GenAI accuracy and minimize latency
- Optimize data extraction transformation loading
- Orchestrate data workflows with Airflow
- Orchestrate workflows with Temporal
- Support RAG and GraphRAG search retrieval and aggregation
- Validate and assess GenAI data systems
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Azure | Azure OpenAI | CI/CD | ClickHouse | Data Lake | Data Validation | ETL | Embeddings | FHIR | GraphRAG | HIPAA | HL7 | Langchain | Llamaindex | Milvus | Model Monitoring | MongoDB | NLP | OLAP | PII | Phi | PostgreSQL | Prompt Optimization | Prompt Tuning | Prompt engineering | Python | RAG | REST API | Snowflake | Starburst | Temporal | Vector Database | Weaviate
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Technology
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Lead Data Scientist INR 2516K-3356KArtificial Intelligence | Big Data | Classification | Cloud Computing | ClusteringEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeMumbai, MH, India19h ago
-
Tech Lead INR 2000K-3285KAPI Integration | Caching | Data leakage | Databases | Distributed SystemsSenior-level Full TimeIN-KA-Bangalore19h ago
-
Lead Software Engineer - Java, Streaming, AWS INR 2000K-3500KAWS | Agile | Amazon EKS | Amazon EMR | Amazon KinesisSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Sr. Data Engineer USD 127K-164KAgentic AI | DBT | Data Governance | Data Quality | Data SecurityComprehensive benefits | Extensive training initiatives | Group insurance | Growth opportunities | Hospitalization insuranceSenior-level Full TimeBangalore, FL, US, 5600761d ago
-
Lead Developer- AI/ML INR 2500K-4500KArtificial Intelligence | Cloud Run | Cloud platform | Debugging | DeploymentSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Data Scientist IV INR 2500K-3380KA/B | A/B Testing | Apache Spark | B testing | Convolutional Neural NetworksGenerous leave policies | Learning and development assistance | Medical insurance | Parental support | Relocation assistanceSenior-level Full TimeBangalore, Karnataka1d ago
-
Sr. Manager, AI FDE INR 2755K-3900KAI transformation | AWS | Azure | Cloud Computing | Cloud platformMonthly travel | Remote work option | Travel Once a MonthSenior-level Full TimeRemote - India R1d ago
-
Manager, Professional Services INR 2400K-3900KAWS | Apache Spark | Azure | Cloud Native | Data ArchitectureTravel for onsite engagementsSenior-level Full TimeRemote - India R1d ago
-
Data Modeler Sr Technical Lead-Data Engg INR 800K-1500KAccess Control | Complex SQL | Complex SQL Queries | Conceptual modeling | Conformed DimensionsSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …1d ago
-
Data Moduler Sr Technical Lead-Data Engg INR 1200K-2000KAccess Control | Cloud ERP | Conformed Dimensions | Data Lake | Data MartSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …1d ago
-
Tech Lead - Data Bricks Job INR 2040K-3500KAgile | Azure | Azure Data | Azure Data Factory | Azure DatabricksContinuous learning | Flexible work arrangementsSenior-level Full TimeHyderabad, TG, IN1d ago
-
Lead/Senior Software Engineer – User Foundations Platform INR 2500K-3500KAWS | Azure | CI/CD | Databases | Distributed SystemsSenior-level Full TimeIND - Bangalore - Ecoworld 6B …1d ago
-
Intern for Data and Analytics INR 346K-346KArtificial Intelligence | Data Governance | Data Modeling | Data Quality | Data VisualizationCareer development and growth | Employee assistance programs | Flexible work arrangements | Hybrid work model | Mental health daysEntry-level Full Time InternshipIndia, Bengaluru, Karnataka R1d ago
-
AI | AWS | Ab Initio | Agentic Automation | Apache SparkMid-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Manager, Data Platform INR 1200K-1200KAPI Design | API Gateway | AWS | Access policies | CI/CDCareer development and growth | Flexible vacation | Headspace access | Hybrid work model | Mental health daysMid-level Full TimeIndia, Bengaluru, Karnataka R1d ago
-
Lead AI Engineer INR 2500K-4500KArtificial Intelligence | AutoGPT | Automated testing | CI/CD | Cloud NativeSenior-level Full TimeIndia1d ago
-
Agentic AI | Airbyte | CI/CD | DVC | DockerAgile team collaboration | Cross-functional collaboration | Flexible work hours | Performance based RSUs | Remote workSenior-level Full TimeMaharashtra, Pune, India R1d ago
-
Senior-level Full TimeMumbai, Maharashtra, India1d ago
-
AWS | Apache Airflow | Azure | Azure DevOps | CI/CDSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Lead Data Engineer INR 1500K-2040KApache Spark | Data Governance | Data Lake | Data Migration | Data ModelingSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Associate Manager - Data Engineering-Data Engineering INR 800K-1050KData Engineering | Data Pipelines | Data Quality | ELT | ETLMid-level Full TimePune, Maharashtra, India1d ago
-
Senior-level Full TimeBangalore, India1d ago
-
Deputy Manager-Data Engineering INR 1500K-2000KApache Airflow | Azure | Azure Data | Azure Data Factory | Azure DatabricksMid-level Full TimeGurgaon, HR, India1d ago
-
Lead Data Scientist INR 2516K-2829KAzure | Bias reduction | Cloud Computing | Data Modeling | Data PreparationEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India2d ago
-
Lead Software Engineer - AWS, PySpark, BigData INR 2000K-3300KAWS | AWS CDK | Agile | Airflow | BackfillSenior-level Full TimeHyderabad, Telangana, India2d ago