Senior Data Engineering Lead
Primary location: Gurgaon, Haryana
INR 2520K-3500K (estimate) Senior-level Full Time
Tasks
- Build and optimize LLM RAG data pipelines including vector ingestion embeddings metadata enrichment
- Create data transformations for business requirements
- Detect data quality issues and implement root cause fixes
- Drive data governance security and responsible AI practices
- Implement ETL and ELT pipelines for relational and dimensional data
- Implement data integration for improved efficiency reliability value
- Implement modern data framework for business intelligence and advanced analytics
- Lead AI data engineering strategy and adoption observability and reusable datasets across domains
- Lead data acquisition from structured and semi structured source systems
- Load data marts and reporting aggregates
- Maintain data definitions documentation for governance and security
- Manage data audits and data quality remediation
- Monitor data pipelines for integrity and data quality issues
- Operationalize machine learning pipelines for scalable data workflows
- Prepare high level and detailed technical design documents
- Recommend data platform architecture changes with analytics teams
- Reduce technical debt and improve processes
- Support data engineering lifecycle research proof of concept design development testing deployment maintenance
- Troubleshoot and optimize production data systems
- Use DevOps tools for code versioning and deployment
- Utilize data management technologies for data engineering projects
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Apache Spark | Azure Data | Azure Data Factory | Azure Databricks | Data Drift | Data Factory | Data Governance | Data Observability | Data Privacy | Data Quality | DataStage | Embeddings | GenAI | Informatica | LLM | Microsoft Azure | PLSQL | Prompt engineering | Python | RAG | REST API | SQL | SSIS | Scala | Semantic Search | TSQL | Vector Database
Education
N/A
Related jobs
-
Agentic Data Delivery Lead INR 3000K-5000KAI Governance | AWS | Access Control | Agent systems | Apache HadoopSenior-level Full TimePune, Maharashtra, India12h ago
-
Lead Software Engineer - Java, Spring boot, AWS Cloud & AI/ML (REST APIs, System Design, SDLC) INR 3500K-5000KAI Assisted Development | API Gateway | AWS Athena | AWS Glue | AWS KinesisSenior-level Full TimeBengaluru, Karnataka, India17h ago
-
Senior-level Full TimeGurgaon, Haryāna, India22h ago
-
Senior-level Full TimeBangalore, Karnātaka, India22h ago
-
Data Engineering Associate INR 1500K-2000KAzure | Big Data | CI/CD | ELT | GitClient interaction | High responsibilityMid-level Full TimeBangalore, Karnātaka, India22h ago
-
Manager, Enterprise Data & Analytics Products INR 3000K-4000KAI machine learning | Agile | Analytics engineering | Azure | Cloud ComputingHybrid work | Learning and development opportunities | Onsite work | Paid Company Holidays | Paid vacationSenior-level Full TimeIN025 Embassy Manyata Business Park, India1d ago
-
Senior Principal Lead AI Solution Architect INR 2755K-3500KAI Governance | Artificial Intelligence | Bias detection | Cost modeling | CybersecurityCar lease programme | Contingency leave | Employee scholar programme | Group health insurance | Group personal accident insuranceSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …1d ago
-
Lead Data Engineer INR 2000K-3000KAnalysis Services | Apache Spark | Azure | Azure Analysis | Azure Analysis ServicesSenior-level Full TimeIND-Pune-Smartworks, India1d ago
-
Lead Data Scientist MSAT GCC INR 2300K-3000KArtificial Intelligence | Batch Quality Assessment | Cause analysis | Data Integrity | Data QualityHybrid work | Occasional travel | Onsite collaboration | Remote workSenior-level Full TimeBengaluru Luxor North Tower, India1d ago
-
Senior-level Full TimeIndia GCC-Puppalaguda Village1d ago
-
Spclst , Data Engineering INR 980K-2168KAWS Glue | AWS Lake Formation | AWS Lambda | AWS Step Functions | Access ControlMid-level Full TimeIND - Telangana - Hyderabad, India1d ago
-
Lead AI/ML Engineer INR 3799K-6000KAPI Gateway | API Management | AWS | Agent to Agent | AuditabilityCareer development opportunities | Comprehensive benefitsSenior-level Full TimePrimary location: Bengaluru, Karnataka1d ago
-
Associate Director – Cyber Threat Analytics INR 700K-900KAI Governance | AI RMF | AI/ML | Anomaly Detection | Artificial IntelligenceMid-level Full TimeHyderabad, India1d ago
-
Senior-level Full TimePrimary location: Gurgaon, Haryana1d ago
-
Senior Manager, Data Stewardship and Analysis INR 2817K-4000KAgile | Backlog Management | Data Governance | Data Lineage | Data MiningSenior-level Full TimeIN - GURUGRAM DLF DOWNTOWN BLOCK …1d ago
-
Amazon Bedrock | Artificial Intelligence | Batch Processing | CCPA | Cloud ArchitectureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India1d ago
-
Lead AI Data Engineer INR 4000K-5500KAI Search | Azure AI | Azure AI Search | Azure Databricks | Azure OpenAISenior-level Full TimeGurugram, Haryana, India1d ago
-
Senior-level Full TimeAhmedabad, Gujarat, India1d ago
-
Data & Analytics Engineer - AM INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Lead Data Scientist INR 3000K-4000KData Analysis | Databricks | Exploratory Data Analysis | Feature Engineering | Generalized Linear ModelsCar lease benefits | Career advancement programs | Certification programs | Dental insurance | Education reimbursement programSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Lead Software Engineer INR 4000K-5000KAWS | Agent Development | Agent systems | Amazon ECS | Amazon EKSSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Access Control | Alteryx | BigQuery | Cloud platform | Data ModelingSenior-level Full TimeChennai, Tamil Nadu, India1d ago
-
Applied AI ML Lead INR 3264K-5000KAI Libraries | API Development | AWS | Agentic AI | Agentic AI librariesSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Mid-level Full TimePune, Maharashtra, India1d ago
-
Automation and AI Developer INR 3264K-4408KAWS Bedrock | Agent systems | Amazon AgentCore | Async Programming | Automated RegressionFlexible vacation | Headspace access | Hybrid work model | Mental health days | Paid volunteer days offMid-level Full TimeIndia, Hyderabad, Telangana R2d ago