GenAI Data ETL Engineer
Tasks
- Build ETL ELT pipelines for LLM context
- Design semantic data models for RAG
- Ensure secure auditable and compliant access controls
- Implement PII redaction and normalization
- Implement data quality checks for GenAI retrieval
- Implement observability for data and retrieval
- Implement prompt response logging and retrieval traces
- Ingest structured and unstructured data sources
- Integrate SaaS and enterprise systems into data pipelines
- Maintain documentation lineage schemas and runbooks
- Optimize pipelines for reliability performance and cost
- Perform root cause analysis for pipeline failures
- Set up scheduling orchestration and workflow management
- Transform documents and records with chunking and enrichment
- Wire pipelines into LLM orchestration flows
Perks/Benefits
- Employee wellness programs
- Flexible work arrangements
- Health insurance
- Inclusive culture
- Learning and development opportunities
- Paid time off
- Retirement benefits
Skills/Tech-stack
AWS Glue | Airflow | Amazon Redshift | Azure Data | Azure Data Factory | Azure Synapse | BigQuery | CDC | CI/CD | CSV | Cloud Data | Cloud data platform | DBT | Dagster | Data Factory | Data Modeling | Data platform | ELT | ETL | Elasticsearch | Event Driven | Event-driven architecture | Git | JSON | Log Based Ingestion | Machine Learning | OpenSearch | PGVector | PII Redaction | Pinecone | Prefect | Python | RAG | REST API | SQL | Search index | Semantic Search | Snowflake | Vector Database | Weaviate | Webhooks
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Roles
Related jobs
-
Software Engineering Professional - GEN AI INR 2500K-4800KAI Search | AWS Bedrock | Analytics Cloud | Anaplan | Azure AISenior-level Full TimeBengaluru, IN, 5601032d ago
-
Senior-level Full TimeHadapsar, Pune, Maharashtra, IND, 4110132d ago
-
Mid-level Full TimeChennai, IN, 6000322d ago
-
Mid-level Full TimeChennai, IN, 6000322d ago
-
Cloud Platform & AI Engineer INR 2200K-3500KAWS Bedrock | AWS Security | Amazon SageMaker | Amazon Web Services | Artificial IntelligenceHybrid work transition | Remote work flexibilityMid-level Full TimeRemote- India- Gurugram R2d ago
-
IN_Senior Associate _Agentic + Gen AI__AI-50_ Advisory_ Mumbai INR 1500K-2500KAPI Management | Acceptance Test | Acceptance Test-Driven Development | Agentic AI | AutoGPTFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeMumbai Goregaon, India2d ago
-
IN_Senior Associate _Agentic + Gen AI__AI-50_ Advisory_ Mumbai INR 1500K-2500KAPI Management | Agentic AI | AutoGPT | CI/CD | DspyFlexible work programs | Inclusive benefits | Mentorship | Training and development | Wellbeing supportMid-level Full TimeMumbai Goregaon, India2d ago
-
Staff Software Engineer - Data engineer INR 2040K-3100KAWS Glue | Amazon Athena | Amazon EMR | Amazon Kinesis | Amazon S3Senior-level Full TimeBengaluru, Karnataka, India2d ago
-
Senior Software Engineer - Data Engineer INR 2040K-3100KAWS EMR | AWS Glue | Airflow | Amazon Athena | Amazon KinesisSenior-level Full TimeBengaluru, Karnataka, India2d ago
-
Cloud Data Engineer INR 1500K-2000KAutomation | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksAgile delivery | Cross-functional collaboration | Professional developmentMid-level Full TimeGurugram, Haryana, India2d ago
-
Sr Cloud Data Engineer INR 1500K-2500KApache Spark | Auto Loader | Azure | Azure Data | Azure Data FactorySenior-level Full TimeGurugram, Haryana, India2d ago
-
Lead Cloud Data Engineer INR 2000K-3000KABAC | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeGurugram, Haryana, India2d ago
-
Senior-level Full TimeBengaluru, KA, India2d ago
-
AI Data Engineer III INR 3000K-4000KAgile | Amazon Redshift | Amazon Web Services | Apache Airflow | CI/CDContinuous learning opportunities | Generous leave policies | Health insurance | Hybrid work policies | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India2d ago
-
Senior AI Engineer INR 2000K-3465KAPI Development | Agentic Workflows | Amazon Web Services | Azure | CI/CDSenior-level Full TimeIndia2d ago
-
Senior-level Full TimeAnywhere in India R2d ago
-
Automation Engineer – Analytics and Automation INR 1075K-1250KAI | APIs | CMDB | Cloud Integration | Cloud platformMid-level Full TimeIndia2d ago
-
Cloud Devops Specialist INR 2200K-3200KAWS CloudWatch | AWS Config | AWS EC2 | AWS EKS | AWS GuardDuty24 7 on call hybrid support | Continuous supportSenior-level Full TimeIndia2d ago
-
AI-powered automation | Automated testing | CI/CD | Cloud Native | Continuous DeploymentLaptop provided | Long-term career growth | Medical insurance | Mentorship community and forums | No weekend workSenior-level Full TimeIndia R2d ago
-
Revenue Operations Data Engineer( Hybrid- Bangalore) INR 1000K-2000KAWS | Data Governance | Data Integrity | Data Modeling | Data QualityMid-level Full TimeBangalore, INDIA R2d ago
-
Senior-level Full TimeIndia2d ago
-
Senior-level Full TimePakistan2d ago
-
Staff Software Engineer -ML/AI INR 2500K-5000KAPI Development | API Services | AWS | CI/CD | Deep learningMentorship | On-call dutiesSenior-level Full TimeHyderabad, India2d ago
-
Staff Software Engineer -ML/AI INR 2500K-5000KAWS | Classification | Clustering | Docker | ECSCareer growth | Continuous learning | Mentorship opportunities | On-call dutiesSenior-level Full TimeHyderabad, India2d ago
-
Staff Software Engineer -ML/AI INR 2500K-5000KAPI Development | AWS | Artificial Intelligence | Classification | ClusteringSenior-level Full TimeBengaluru, India2d ago