Data engineer
Tasks
- Build RAG frameworks
- Containerize data processing jobs with Docker
- Deploy and orchestrate services with AWS ECR and EC2
- Design ETL pipelines
- Evaluate agent performance
- Implement data quality checks
- Implement semantic search and vector database workflows
- Maintain data ingestion transformation and loading
- Manage AWS data lake and warehouse pipelines
- Model data for NoSQL databases
- Model data for SQL databases
- Monitor data pipeline performance
- Optimize vector database performance
- Store and retrieve vector embeddings
- Support data science prototypes in production
- Troubleshoot data flow issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Lambda | AWS S3 | Amazon Athena | Amazon ECR | Amazon EMR | Amazon Kinesis | Amazon Redshift | Apache Spark | CI/CD | Dask | Data Modeling | Data Warehousing | Dense retrieval | Docker | DynamoDB | EC2 | ELT | ETL | Few-Shot Learning | Few-shot | GitLab | Graph Databases | Hadoop | Jenkins | Kafka | Knowledge graphs | Kubernetes | MLOps | Prompt engineering | Python | RAG | RDS | Ray | Redshift | SQL | Semantic Search | Vector Databases | Vector embeddings
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Azure DevOps | Business Intelligence | CI/CD | Data Assurance | Data ManagementSenior-level Full TimeKolkata DN 57, India-1d ago
-
Data Scientist INR 1950K-2250KCloud Computing | Data Streaming | Data Visualization | Deep learning | ExcelMid-level Full TimeGurgaon, IND-HR, India6h ago
-
Assistant Manager Machine Learning INR 1500K-1809KA/B | A/B Testing | AWS Glue | AWS Lambda | AWS SageMakerMid-level Full TimeIndia-Gurugram9h ago
-
Senior-level Full TimeKochi, India9h ago
-
Senior-level Full TimeIN-TN-Chennai9h ago
-
Data Scientist Associate INR 1050K-1500KAlteryx | Big Data | Data Analysis | Data Mining | Data QueryingMid-level Full TimeBengaluru, Karnataka, India10h ago
-
Associate Process Manager INR 1800K-2800KAgentic AI | Agile methodologies | Causal Inference | Cypher | Experimental DesignMid-level Full TimeMumbai, Maharashtra, India10h ago
-
Partner Engineer, Generative AI INR 2500K-3000KAI infrastructure | AWS | Azure | C plus plus | Cloud platformSenior-level Full TimeBangalore, India | Mumbai, India11h ago
-
Entry-level Full TimePune, India11h ago
-
Product Senior Data Scientist, Google Play INR 2516K-3250KA/B | A/B Testing | B testing | Classification | Data InfrastructureSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Principal Consultant - Data & AI INR 2500K-3200KAI Services | Agile | Apache Kafka | Apache Spark | Artificial IntelligenceSenior-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN; …11h ago
-
AI Engineer INR 1340K-2400KAI Safety | AWS | AWS Lambda | Adversarial AI | Amazon BedrockDedicated learning week | Employee Share Savings Plan | Hybrid work | Learning and mentoring | Paid volunteer dayMid-level Full TimeBengaluru11h ago
-
Agentic AI/ Prompt Engineer INR 1800K-3000KCloud Platforms | Embeddings | LLMs | Langchain | LlamaindexMid-level Full TimeNoida, Uttar Pradesh, India11h ago
-
AWS | Automated testing | Azure | CI/CD | Data PipelinesMid-level Full TimeMumbai, Maharashtra, India12h ago
-
Senior Data Engineer INR 2500K-2829KApache Airflow | Apache Spark | Azure | Azure Data | Azure Data LakeEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India12h ago
-
Assistant Manager- Python Gen AI with GCP- Bangalore INR 1200K-1700KAI Agents | API Development | Agile methodologies | Application Performance Optimization | Application performanceWork from client office 5 days per weekMid-level Full TimeBangalore, Karnataka, India12h ago
-
Senior Data Scientist-Digital Banking Kotak 811-Regional Sales INR 2000K-2400KA/B | A/B Testing | B testing | Customer Segmentation | HadoopSenior-level Full TimeBangalore, Karnataka, India12h ago
-
Software Engineer III - Data Engineer INR 1200K-2000KAWS | Apache Airflow | Azure | Big Data | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India12h ago
-
Senior Associate -Applied AI ML -Digital INR 1050K-1496KAlgorithms | Apache Spark | Big Data | Classification | CompilersMid-level Full TimeBengaluru, Karnataka, India12h ago
-
Sr. SW Engineer - SDET - Automation, GenAI tooling, API Testing INR 2156K-3000KAI | AI Agents | API Testing | CI/CD | Cloud NativeHybrid workSenior-level Full TimeBengaluru, INDIA, India13h ago
-
IT Support Specialist 1 (Regional) INR 2000K-2000KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure DevOpsSenior-level Full TimeBengaluru, KA, IN13h ago
-
Staff Software Engineer - Python, AI/ML, Cloud, GenAI INR 2000K-5000KAWS | Agent Orchestration | Azure | CI/CD | ContainerizationSenior-level Full TimeBengaluru, INDIA, India13h ago
-
AI Engineer- Associate Consultant INR 1500K-2000KAWS | Agent Orchestration | Autonomous Agents | Azure | ClassificationCareer growth | Collaborative work environment | Continuous learning | Inclusive work environmentMid-level Full TimeBangalore, Karnataka, India13h ago
-
Data Scientist Consultant INR 2500K-3000KAgent Orchestration | Agentic AI | Azure | Classification | ClusteringSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Software Engineer III - AIML Platform Reliability INR 2500K-3500KAI Operations | AI Ops | AWS | Automation | Cloud ComputingSenior-level Full TimeBengaluru, Karnataka, India13h ago