Data Engineering
Tasks
- Build data engineering solutions
- Collaborate with cross-functional teams to deliver solutions
- Design data models and curated datasets
- Design scalable ETL/ELT pipelines
- Develop and optimize Databricks notebooks jobs workflows
- Develop backend services and APIs for data access
- Implement data quality checks and monitoring
- Ingest transform validate and load data from sources
- Integrate enterprise data with LLM applications
- Participate in CI CD and production support
- Support RAG and LangChain based workflows
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS EMR | AWS Glue | AWS Lambda | AWS RDS | Airflow | Amazon EC2 | Amazon ECS | Amazon Redshift | Amazon S3 | Amazon SQS | Apache Spark | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Lake | Azure Data Lake Storage | Blob Storage | CodePipeline | DBT | Data Lake Storage | Databricks | Delta Lake | Docker | ELT | ETL | Embeddings | FastAPI | Flask | Git | Jenkins | Langchain | Matillion | MySQL | OpenSearch | Oracle | PostgreSQL | PySpark | Python | RAG | REST APIs | SQL | SQL Server | Snowflake | Vector Databases
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Jr Data Engineer INR 360K-420KAWS Glue | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkEntry-level Full TimeBangalore North, India6h ago
-
Senior-level Full TimeIN-KA-Bangalore7h ago
-
Monitoring-Operations Support-Analytics and Reporting INR 938K-1300KAWS | Excel | ITIL | Incident Management | Microsoft PowerPointFlexible hoursEntry-level Full TimeHyderabad, Telangana, India8h ago
-
Mid-level Full TimeBangalore, Karnataka, India9h ago
-
DE&A - AI Engineer INR 2000K-3300KAPI Keys | AWS | Agent systems | Agentic Workflows | Anthropic APIMid-level Full TimeBangalore, Karnataka, India9h ago
-
Mid-level Full TimeBangalore, Karnataka, India9h ago
-
AI Data Engineer III INR 3000K-4000KAWS | Agile | Apache Airflow | CI/CD | DBTContinuous learning | Generous leave policies | Health insurance | Hybrid work policies | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior Production Support Engineer - LoanIQ - Bangalore INR 3000K-5000KAPIs | Automation | Cause analysis | Incident Management | JavaSenior-level Full TimeIndia9h ago
-
Senior Data Systems Software Engineer INR 3264K-5572KAPI Integration | APIs | Agentic AI | C# | C++Senior-level Full TimeBENGALURU, KARNATAKA, India10h ago
-
Senior Data & Analytics Engineer INR 3000K-4000KAWS | Apache Spark | Azure | CI/CD | Cloud platformSenior-level Full TimeBangalore, Karnataka, IN11h ago
-
Senior AI Solutions Engineer INR 2500K-4500KAPI Integration | Agent Orchestration | Autonomous Agents | Data Pipelines | Database ConnectionsRelocation assistanceSenior-level Full TimeMumbai, MH, IN11h ago
-
Sr. Specialist , Data Engineering INR 2520K-3380KAgile | Airflow | BigQuery | CI/CD | Cloud FunctionsRelocation assistanceSenior-level Full TimeMumbai, MH, IN11h ago
-
Consultant - AI Engineer INR 2500K-5000KAutogen | CI/CD | Cloud infrastructure | Containerization | CrewAISenior-level Full TimeBangalore, Karnataka, India12h ago
-
Senior-level Full TimePune, Maharashtra, India13h ago
-
Lead Infrastructure Engineer - GenAI & CloudFormation INR 3000K-5000KAWS | Agentic AI | Automation | Bitbucket | ConfluenceSenior-level Full TimeHyderabad, Telangana, India13h ago
-
Analytics Modeler INR 1500K-2800KARIMA | Data Visualization | Generative AI | GitHub Copilot | Hypothesis TestingMid-level Full TimeChennai, Tamil Nadu, India13h ago
-
Lead Infrastructure Engineer - GenAI & CloudFormation INR 3000K-5000KAWS Lambda | Agentic AI | Amazon EC2 | Amazon ECS | Amazon Web ServicesSenior-level Full TimeHyderabad, Telangana, India13h ago
-
Software Development Engineer INR 1430K-2200KAPIs | Agile | Anonymization | Batch Job Scheduling | Batch jobMid-level Full TimeChennai, Tamil Nadu, India13h ago
-
Gen AI Engineer INR 2500K-4500KAWS Textract | Document processing | Generative AI | Langchain | Language ModelsSenior-level Full TimeHyderabad, Telangana, India13h ago
-
Airflow | BigQuery | Cloud Composer | Cloud Functions | Cloud RunCareer growth opportunities | Collaborative cross-functional environment | Continuous learning | Flexible or hybrid work arrangements | Health and wellness supportSenior-level Full TimeIndia14h ago
-
Consultant - Python Developer with Gen AI using GCP INR 2500K-4800KAPI Development | Cloud platform | Containerization | Gemini Enterprise | Google ADKSenior-level Full TimeBangalore, Karnataka, India14h ago
-
Senior Machine Learning Operations Engineer INR 2500K-3500KAWS | AWS Glue | AWS Lambda | Amazon SageMaker | AzureSenior-level Full TimeBangalore, INDIA R14h ago
-
Principal Engineer, SQL DBA INR 1500K-2700KADO.NET | Audit Logging | Azure | CI/CD | Change ManagementSenior-level Full TimeRemote, India R14h ago
-
Senior Data Engineer - Advertising Engineering INR 3000K-3880KAWS | Apache Airflow | Apache Spark | Azure | CI/CD401k retirement plan | Financial wellness support | Flexible remote work Fridays | Healthcare benefits | Hybrid work scheduleSenior-level Full TimeBengaluru, India16h ago
-
Lead Consultant - AI Architect INR 3000K-5000KAgent Orchestration | Agentic AI | Amazon Bedrock | Amazon Q | Amazon SageMakerSenior-level Full TimeIndia - Bangalore R20h ago