Python Data Engineering with AI
INR 1300K-2500K (estimate) Mid-level Full Time
Tasks
- Build real-time data processing solutions
- Build scalable data platforms
- Design data lakes and data warehouses
- Design distributed systems
- Develop AI agents in data workflows
- Develop and tune SQL and PL/SQL queries
- Develop data pipelines and ETL processes
- Ensure data quality and data lineage
- Implement data virtualization solutions
- Integrate retrieval augmented generation with vector databases
- Optimize and scale data processing and analytics
- Perform data modeling and warehousing
- Set up and configure MCP servers for agent tooling
- Use large language models for data engineering use cases
Perks/Benefits
- N/A
Skills/Tech-stack
AI Agents | Ab Initio | Amazon Redshift | Apache Airflow | Apache Spark | Data Lake | Data Lineage | Data Modeling | Data Pipelines | Data Quality | Data Store | Data Warehousing | Data mesh | Data virtualization | Databricks | Distributed Systems | ELT | ETL | Flink | Hadoop | Java | LLM | Language Models | Large Language Models | MCP | Model Context Protocol | MongoDB | OLTP | Operational data | Operational data store | Oracle | PL/SQL | Python | RAG | Real Time | Real-time Processing | Retrieval-Augmented Generation | SQL | Scala | Snowflake | Starburst | Talend | Time processing | Unix Shell | Vector Databases
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeHyderabad, IND-TG, India8h ago
-
Associate Data Engineer INR 1500K-2500KAgile | Apache NiFi | Azure DevOps | C plus plus | Database systemsMid-level Full TimePune, India11h ago
-
Senior-level Full TimeBANGALORE, Karnataka, Inde11h ago
-
Advanced Engineer-AI/ML INR 3264K-4800KAPI Integration | ASR | AUTOSAR | AWS | Audio ProcessingEmployee discounts | Recognition rewards program | Training opportunities | Tuition reimbursement | Wellness benefitsSenior-level Full TimeBangalore - Karnataka, India - Kalyani …11h ago
-
Senior Software Engineer - Data License Analytics, Pune INR 3000K-4720KAWS S3 | Agent to Agent | Agent to Agent A2A | Apache Airflow | Apache IcebergSenior-level Full TimePune11h ago
-
Spark, Scala, Hadoop & Quantexa/Senior Consultant Specialist INR 2000K-2800KApache Airflow | Apache Spark | CI/CD | DevOps | ElasticsearchFlexible working hours | On-call support | Shift workSenior-level Full TimeBangalore, Karnataka, India R12h ago
-
Mid-level Full TimeIN-KA-Bangalore12h ago
-
AI Lead and Automation Tester - Document Intelligence INR 2500K-5000KAI Workflow Orchestration | AI workflow | Automation Testing | Clinical Trial Compliance | Clinical trialSenior-level Full TimeIN-TN-Chennai12h ago
-
Senior Consultant INR 2000K-4500KAPI Testing | Adversarial Testing | Amazon SageMaker | Azure Machine Learning | Bias detectionSenior-level Full TimeIN-AP-Hyderabad12h ago
-
Assistant Director - Insights And Analytics INR 3000K-5199KCode reuse | Data Governance | Data Quality | Data Wrangling | Machine LearningExecutive-level Full TimeBangalore, Karnataka, India R12h ago
-
Senior-level Full TimeBangalore - Karnataka - India12h ago
-
Java Full Stack Engineer - Professional INR 1200K-3000KAngular | Apache Airflow | Apache Spark | Azure Kubernetes | Azure Kubernetes ServiceSenior-level Full TimeIndia13h ago
-
Senior-level Full Timebengaluru, India13h ago
-
Senior-level Full Timebengaluru, India13h ago
-
Lead Data Platform Engineer INR 2040K-3900KAPI Integration | AWS | AWS CloudWatch | AWS DataZone | AWS GlueEnhanced medical benefits | Family well-being benefits | Hybrid work | Paid time off | Wellbeing programsSenior-level Full TimeHyderabad, India13h ago
-
Anomaly Detection | Autoencoders | Bayesian optimization | Classification | ClusteringOnsite workEntry-level Full TimeHyderabad, India14h ago
-
AI Agent Development Kit | API Gateway | Agent Development Kit | Agentic AI | Audit LoggingSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
AI/ML Infrastructure Software Engineer INR 3000K-5000KC++ | JAX | Keras | Machine Learning | Machine Learning FairnessSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Data Engineer INR 1300K-2000KAPI Integration | Data Modeling | Data Transformation | Data pipeline | Power BIMid-level Full TimeHyderabad, Telangana, India14h ago
-
Senior Software Engineer INR 3000K-4000KALB | API Gateway | AWS ECS | AWS Glue | AWS LambdaFamily well-being benefits | Health benefits | Hybrid work | Paid time offSenior-level Full TimeHyderabad, India14h ago
-
Senior QA Engineer (Data Platform Testing) INR 2500K-3000KAPI Gateway | API Testing | AWS Lambda | CI/CD | CloudWatchSenior-level Full TimeHyderabad, India14h ago
-
Consultant - Cloud Data Engineer INR 1500K-2500KApache Airflow | Apache Kafka | Apache Spark | Azure | Azure DataMid-level Full TimeGurgaon, Haryana, India14h ago
-
Generative AI Lead INR 3264K-5876KAI Governance | APIs | Cloud Architecture | Cloud infrastructure | Data LakeHybrid workSenior-level Full TimeHyderabad, India14h ago
-
Mid-level Full TimePune, Maharashtra, India14h ago
-
Senior-level Full TimeHyderabad, India15h ago