Data & GenAI Engineer
Tasks
- Build backend APIs and microservices for data products and AI capabilities
- Build batch and streaming data pipelines
- Build embedding pipelines and indexing for retrieval
- Build scalable Spark transformations with performance tuning
- Create data validation and monitoring frameworks
- Define evaluation metrics for retrieval quality and hallucination reduction
- Design and improve production RAG systems
- Design and own ETL ELT pipelines
- Implement Medallion architecture with data contracts and quality checks
- Implement idempotency and orchestration patterns
- Integrate APIs with frontend applications
- Manage schema evolution and incremental loads
- Optimize vector search with filtering hybrid search and ranking
- Ship observable secure scalable services
- Tune prompt templates for grounding and structured outputs
- Work with authentication and API gateways
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | Apache Spark | Authentication | CI/CD | Data Contracts | Data Validation | Databricks | Delta Lake | Docker | ELT | ETL | Embeddings | FastAPI | Git | Hybrid search | Idempotency | Incremental loading | Lineage | Microservices | Monitoring | Observability | Orchestration | Prompt engineering | Python | Query Tuning | RAG | REST APIs | Retrieval-Augmented Generation | SQL | Schema evolution | System design | Vector Search
Education
N/A
Roles
Backend | Backend Developer | Data Engineer | Developer | Engineer | GenAI Engineer
Related jobs
-
Senior .NET AI Engineer- 3188 (Remote) INR 2500K-4500K.NET | Azure | C# | Distributed Systems | Event DrivenFlexible working hours | L and D programs | Remote work | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India R4h ago
-
ETL Tester INR 1500K-2500KData Mapping | Data Quality | Data Reconciliation | Data Transformation | Data WarehouseSenior-level Full TimeChennai, India5h ago
-
Mid-level Full TimeIN-KA-Bangalore6h ago
-
AI Engineer with RAG / MCP INR 1500K-2500KDocument processing | LLMs | Microservices | Prompt engineering | PythonMid-level Full TimeIN-AP-Hyderabad6h ago
-
GenAI Developer INR 2000K-4500KAmazon Lex | Amazon Polly | Amazon SageMaker | CI/CD | Data VisualizationWork from OfficeSenior-level Full TimeIN-TN-Chennai6h ago
-
Senior-level Full TimeIN-TN-Chennai6h ago
-
Data Engineer INR 1500K-2500KApache Hive | Apache Kafka | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeIN-KA-Bangalore6h ago
-
Data Bricks Infra Engineer INR 1500K-2500KAccess Control | Caching | Data Governance | Databricks | Databricks SQLWork from office 5 days per weekSenior-level Full TimeGurugram, Haryana, India7h ago
-
Software Engineer INR 2000K-3300KAKS | Angular | App Service | Azure | Azure AppEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India8h ago
-
Senior-level Full TimeBangalore, Karnataka, India8h ago
-
Associate Software Engineer - Scala and spark INR 1500K-2000KAgile | Apache Spark | CI/CD | Databricks | GitHubEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India8h ago
-
Sr. Data Engineer INR 1500K-2500KACID | Amazon Redshift | Amazon S3 | Apache Kafka | Azure DataWork from office 5 days per weekSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
AI/ML Developer INR 1500K-2500KAzure | Cloud Computing | Cloud platform | Data Preprocessing | Deep learningMid-level Full Timebangalore, India8h ago
-
Principal Software Engineer - AI Platform INR 2515K-3500KAgile | Apache Airflow | CI/CD | Cloud Native | Data AnalysisFlexible medical benefits | Life insurance | Retirement options | Volunteer programsSenior-level Full TimeIndia8h ago
-
Senior Software Engineer (Java/Python) INR 2200K-4000KAPI Gateway | AWS CLI | AWS Lambda | Amazon CloudWatch | Amazon DynamoDBSenior-level Full TimeHyderabad, India9h ago
-
Consultant - Python Developer with Gen AI and AI Foundry INR 2000K-4500KAWS | Autogen | Azure | Azure OpenAI | ClaudeSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Lead Assistant Manager INR 2500K-5000KAPI Integration | Cloud Native | Cloud Native Architecture | Document Question Answering | EmbeddingsSenior-level Full TimeIndia10h ago
-
Senior Azure Data Engineer INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimePune, Maharashtra, India10h ago
-
Mid-level Full TimeBengaluru, India10h ago
-
Senior-level Full TimeBengaluru, India10h ago
-
Data Engineer II INR 1500K-2500KAWS | Apache Airflow | Astronomer | BigQuery | CI/CDCareer growth | Holistic well-being support | Learning opportunitiesSenior-level Full TimeBengaluru, KA, India11h ago
-
Software Development Lead INR 1500K-2700KAPIs | Agile | BigQuery | Continuous Delivery | Continuous integrationSenior-level Full TimeChennai, Tamil Nadu, India11h ago
-
Staff - Software Engineering INR 2515K-3500KAWS | AWS Glue | AWS Lambda | Amazon Kinesis | Amazon SNSCareer growth and development | Flexible workSenior-level Full TimePune11h ago
-
Executive-level Full TimeBangalore, Karnataka, India12h ago
-
DAX | DBT | Data Lineage | Data Modeling | Data WarehousingSenior-level Full TimePune, Maharashtra, India12h ago