Lead Data Engineer (GenAI / LLM Applications)
Tasks
- Build LLM powered RAG pipelines
- Collaborate on requirements and reporting
- Create orchestration workflows with Airflow
- Create technical documentation
- Deploy and support AWS solutions
- Design scalable data pipelines
- Develop and maintain Python services
- Establish data quality governance
- Implement ETL pipelines
- Manage source to target mappings
- Model structured and unstructured data
- Troubleshoot production issues
- Write and optimize complex SQL
Perks/Benefits
- Company holidays
- Health and wellness benefits
- Paid time off
- Professional development
- Remote work flexibility
Skills/Tech-stack
AWS Bedrock | AWS EC2 | AWS Lambda | AWS S3 | AWS Secrets | AWS Secrets Manager | Apache Airflow | CI/CD | CSS3 | Confluence | Data Governance | Data Modeling | Data Quality | Django | ETL | Flask | Git | GitHub Copilot | HTML5 | JavaScript | Jira | Langchain | Microsoft SQL | Microsoft SQL Server | NumPy | Oracle Database | Pandas | Plotly | PostgreSQL | Power BI | Python | Retrieval-Augmented Generation | SQL | SQL Server | Secrets Manager | Snowflake
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Principal AI Engineer INR 2000K-4500KAPI Integration | AWS Bedrock | Agent Orchestration | CI/CD | Deep learningSenior-level Full TimeBangalore, KA, IN7h ago
-
Mid-level Full TimeBengaluru, KA, India15h ago
-
AI Engineer / AI Developer INR 1800K-3300KAI Agents | Alerting | Amazon SQS | Async Programming | CI/CDSenior-level Full TimeBangalore, India Office (BANGALORE) R16h ago
-
Mid-level Full TimeBangalore, India Office (BANGALORE) R16h ago
-
AI Engineer – Python & Snowflake INR 1800K-2700KAPI Development | AWS | Airflow | Azure | Data ModelingMid-level Full TimeHyderabad, Hyderabad, IN16h ago
-
Senior AI Engineer (Full-Stack) (Remote) INR 2500K-5000KAWS | Active Directory | Anthropic | ArcGIS REST | ArcGIS REST APIClient facing ownership | Remote workSenior-level Full TimeMaharashtra, Pune, India R16h ago
-
Staff Artificial Intelligence & Machine Learning Engineer INR 2500K-4500KAPIs | Agentic Workflows | Chunking | Compliance | Cost OptimizationSenior-level Full TimeBengaluru, KA, India16h ago
-
Senior Database Engineer - #3180 (Remote) INR 1500K-2700KAWS CDK | AWS IAM | AWS KMS | Amazon Aurora | Amazon CloudFormationSenior-level Full TimeChennai, India R16h ago
-
Lead AI Software Engineer INR 2000K-4500KAI Agents | AWS | Azure | CI/CD | Cloud platformCareer growth | Career growth in technology domain | Continuous learningSenior-level Full TimePune City, India17h ago
-
GCP Data Engineer INR 1500K-2500KAirflow | BigQuery | Cloud Composer | Cloud Functions | Cloud platformSenior-level Full TimeIndia - Pune17h ago
-
Entry-level Full TimeCoimbatore, India17h ago
-
Senior-level Full TimeHyderabad, India17h ago
-
Entry-level Full TimeCoimbatore, India17h ago
-
Senior-level Full TimeIN-HR-Gurgaon18h ago
-
Senior-level Full TimeIN-KA-Bangalore18h ago
-
Senior Engineer - Embedded QA INR 1500K-2094KAgile | CI/CD | Continuous Deployment | Continuous integration | Data Driven TestingSenior-level Full TimeHadapsar, Pune, Maharashtra, IND, 411013 R18h ago
-
Senior-level Full TimeBengaluru, Karnataka, India19h ago
-
AI Engineer - AI, Data & Platforms INR 3000K-4200KAgentic Workflows | Apache Airflow | Apache Spark | DBT | Dagster4 day in office 1 day flexible work arrangement | Flexible work arrangementSenior-level Full TimeGurugram19h ago
-
Senior Software Engineer (AI,Java/Python) INR 2475K-3500KAPI Development | AWS | Agent Frameworks | Agent systems | Amazon SQSFamily wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Wellness supportSenior-level Full TimeHyderabad, India20h ago
-
Access Control | Autogen | CI/CD | Chroma | Continuous MonitoringEntry-level Full TimeHyderabad, Telangana, India20h ago
-
Senior-level Full TimeIndia20h ago
-
Data Integration Lead INR 1500K-2500KCICD | Control-M | IBM InfoSphere | IBM Infosphere DataStage | InfoSphere-DataStageClient facing communication | Production support experienceSenior-level Full TimeIndia20h ago
-
DevOps Track Sr.Engineer INR 2229K-4000KAPI Gateway | APM | AWS CloudWatch | AWS Systems Manager | AWS systemsSenior-level Full TimeIndia20h ago
-
Database Track Sr.Engineer INR 2000K-3000KData Architecture | Database Schemas | Database performance | Database performance tuning | Disaster RecoverySenior-level Full TimeIndia20h ago
-
Big Data Engineer INR 1500K-2400KApache Spark | Azure Data | Azure Data Factory | Data Factory | Data IngestionSenior-level Full TimeIndia20h ago