Technical Lead-Data Engg
INDIA - NOIDA- BIRLASOFT OFFICE, IN
INR 2000K-4500K (estimate) Senior-level Full Time
Tasks
- Build LLM powered use cases
- Design and build scalable data pipelines
- Design and implement GenAI and agentic AI solutions
- Develop and fine-tune LLMs and ML models
- Develop enterprise ontologies and semantic data models
- Ensure data quality, reliability, and observability
- Implement Delta Lake and Unity Catalog
- Implement prompt engineering model evaluation and guardrails
- Ingest transform and enrich data from multiple sources
- Integrate AI solutions with enterprise data and business workflows
- Optimize Spark jobs performance and cost
- Prepare feature ready datasets for AI and ML workloads
Perks/Benefits
- N/A
Skills/Tech-stack
Agent Bricks | Agentic AI | Apache Spark | Data Ingestion | Data Modeling | Data Quality | Data Transformation | Data models | Databricks | Databricks Agent Bricks | Databricks Genie | Delta Lake | Feature Engineering | GenAI | LLM | MLflow | Machine Learning | Medallion Architecture | Model Evaluation | Mosaic AI | Observability | Ontology Design | Prompt engineering | PySpark | RAG | Retrieval-Augmented Generation | SQL | Semantic data | Semantic data models | Spark optimization | Taxonomies | Unity Catalog | Vocabularies
Education
N/A
Related jobs
-
D&T Lead - Data Engineer INR 1500K-2500KBatch Processing | CI/CD | Cloud Data | Cloud data warehousing | ConfluenceSenior-level Full TimePune, IN2h ago
-
Senior-level Full TimePune, India3h ago
-
Senior Data Engineer, BizTech INR 3080K-4400KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch ProcessingSenior-level Full TimeBangalore, India6h ago
-
AWS | Automation | Data Governance | Data Modeling | Data PipelinesContinuous technical learning | Hands-on leadership | Professional developmentSenior-level Full TimeIndia8h ago
-
Data Quality Controls Oversight Lead INR 2771K-4000KAWS | Cloud Computing | Controls governance | Data Architecture | Data GovernanceSenior-level Full TimePune, Gera Commerzone SEZ, India11h ago
-
Engineering Team Lead (ETL) INR 2800K-5000KAI Agentic | AI Agentic frameworks | AI tools | Agentic Frameworks | AgileSenior-level Full TimeHyderabad19h ago
-
Lead AI Engineer ID80141 INR 2500K-5000KAWS S3 | Amazon Web Services | Azure | CI/CD | Cloud SecurityAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimeBengaluru, India21h ago
-
Senior Member Technical Staff INR 3242K-4800KAPI Development | AWS | Amazon SageMaker | CI/CD | Computer VisionAutonomy | Mentorship opportunities | Remote-friendly work environmentSenior-level Full TimeBengaluru, India23h ago
-
Data Engineering Lead INR 2000K-4580KAWS | Apache Airflow | Apache Spark | CI/CD | DBTBike to work | Career progression | Educational assistance | Employee assistance programme | Employee discountSenior-level Full TimeMumbai, MH, India R23h ago
-
SDE IV - Data Engineer INR 3242K-4580KAerospike | Apache Airflow | Apache Flink | Apache Hudi | Apache IcebergSenior-level Full TimeLucknow1d ago
-
Data Engineer Manager - AWS Databricks INR 1500K-2600KAWS | Apache Spark | Automation | CI/CD | Data GovernanceSenior-level Full TimeHyderabad, TS, India1d ago
-
Senior / Lead Data Engineer - Azure Databricks INR 1500K-3000KAzure Databricks | Azure DevOps | CI/CD | Cloud Security | Conformed DimensionsSenior-level Full TimeHyderabad, TS, India1d ago
-
Lead Software Engineer - Java/Python, Data Engineering INR 3000K-4200KAPI Design | AWS | Airflow | Apache Iceberg | AzureSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Lead Software Engineer - Java/Python, Data Engineering INR 3000K-4200KAPI Design | AWS | AWS Bedrock | Airflow | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Lead Software Engineer - Java/Python, Data Engineering INR 3000K-4200KAPI Design | AWS | AWS Bedrock | Apache Airflow | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Sr Lead Software Engineer - Java/Python, Data Engineering INR 2500K-4300KAPI Design | AWS | Airflow | Apache Iceberg | Apache KafkaSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Dir. Data Engineering INR 3000K-4500KAI machine learning | Analytics | Cloud Data | Cloud data platform | Cost OptimizationSenior-level Full TimeBangalore,INKA,India R1d ago
-
Lead Associate - Data / AI INR 1500K-2500KAzure Data | Azure Data Factory | Big Data | Cause analysis | Data FactoryMid-level Full TimePune1d ago
-
IN|KDN KRC|Nordics|Digital Audit -Tech Senior - BLR INR 2400K-4000KAlteryx | Data Governance | Data Hygiene | Data Modeling | Data ValidationSenior-level Full TimeBangalore, Karnataka, India1d ago
-
AI Data | AI Data Lineage | AWS | Alation | Apache SparkEducation support | Flexible work environment | Hybrid work | Leadership development | Learning programsSenior-level Full TimeIndia1d ago
-
ABAC | API Gateway | AWS CloudFormation | AWS Glue | AWS LakeSenior-level Full TimeHyderabad, TG, IN, 5000811d ago
-
Data Engineer Sr. Consultant INR 3000K-4000KAPI | Business Rules | Compensation Management | Data Transformation | Data ValidationSenior-level Full TimeBangalore, KA, IN R1d ago
-
Lead Data Scientist INR 3000K-5500KAI Agents | AWS | Azure | CI/CD | CrawlingHealthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeIND-Bangalore-TowerE,RMZ Infin, India1d ago
-
Lead Data Scientist INR 3000K-5000KAWS | Azure | CI/CD | Data Processing | Data QualityHealthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeIND-Bangalore-TowerE,RMZ Infin, India1d ago
-
Senior-level Full TimeBangalore, India1d ago