Data Engineering Consultant - Python, SQL, ETL, AWS/Azure
Primary location: Chennai, India
INR 2500K-3500K (estimate) Senior-level Full Time
Tasks
- Build automated CI/CD pipelines
- Build production backend services for data workflows
- Collaborate to deliver AI driven automation opportunities
- Deploy and operate data systems on cloud
- Design and build data pipelines
- Develop and deploy AI agents and LLM workflows
- Develop data ingestion and transformation systems
- Develop data services and APIs
- Ensure high availability low latency and resilience
- Implement RAG for data enrichment
- Implement data models and storage patterns
- Implement error handling retries monitoring and alerting
- Implement infrastructure-as-code
- Maintain fault tolerant data platforms
- Mentor junior engineers
- Monitor and optimize AI agent performance reliability and governance
- Optimize cloud resources for performance cost and efficiency
- Participate in system design reviews
- Schedule and monitor workflow orchestration
- Troubleshoot performance, scalability, and reliability issues
- Write clean, maintainable, and well-tested code
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Alerting | Azure | CI/CD | Cloud Native | Data Modeling | Data Pipelines | Data Warehouse | Docker | ELT | ETL | Error Handling | Git | Infrastructure as Code | LLM integration | Language Models | Large Language Models | Monitoring | Prompt engineering | Python | RAG | Relational databases | Retries | SQL | Shell | Step Functions | Terraform | Workflow Orchestration | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior Machine Learning Engineer INR 4000K-6000KA/B | A/B Testing | Apache Airflow | Apache Flink | Apache SparkSenior-level Full TimeBengaluru18h ago
-
Senior-level Full TimeIndia - Remote R23h ago
-
AI Solutions Engineer INR 2000K-4500KAgile methodology | Algorithms | Amazon Web Services | Apache Spark | Artificial IntelligenceMid-level Full TimePSR01 - Bengaluru, Pritech Park- SEZ …23h ago
-
AI Solutions Engineer INR 2000K-4500KAgile methodology | Algorithms | Amazon Web Services | Apache Spark | Big DataMid-level Full TimePSR01 - Bengaluru, Pritech Park- SEZ …23h ago
-
GDT Assistant Media Manager(MLOps/DevOps Engineer) INR 1500K-3158KAWS | Agent Orchestration | Argo CD | ArgoCD | AutogenMid-level Full TimeMumbai, Maharashtra23h ago
-
Sr Developer Software INR 2000K-4000KAWS | AWS Glue | AWS Lambda | Amazon ECS | Amazon EMRFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India1d ago
-
Mid-level Full TimeIndia1d ago
-
Mid-level Full TimePune, India1d ago
-
Data Architect INR 1500K-2600KApache Kafka | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore North, India1d ago
-
AI Consultant-GenAI, LLMs, Agentic AI INR 2500K-5000KAgentic AI | Artificial Intelligence | Business case | Business case development | Case DevelopmentSenior-level Full TimeKarnataka, India1d ago
-
VP, Salesforce Engineer - IB Tech & CRM/ Analytics INR 2337K-3056KAgile | Apex | Asynchronous processing | Batch Apex | BulkificationExecutive-level Full TimePune, India1d ago
-
Senior AI/ML Engineer INR 3799K-5572KAI Security | AI Services | AWS | Agentic AI | AirflowAccident Coverage | Career growth | Group term life insurance | Health insurance | Hybrid work supportSenior-level Full TimeIQEQ Hyderabad, Tower 2, 7th floor, … R1d ago
-
AI Engineer INR 1800K-5000KAPI Integration | Asynchronous programming | Autogen | Azure | CrewAICollaborative work culture | Flexible work environment | Generous PTO | Inclusive work culture | Medical insuranceMid-level Full TimeBangalore, Karnataka, India (Hybrid) R1d ago
-
Mid-level Full TimeIndia1d ago
-
AIML Engineer Digital & AI INR 3242K-5000KAWS | Azure | CI/CD | Deep learning | DockerAccident Coverage | Career growth | Group term life insurance | Internet allowance | Medical insuranceSenior-level Full TimeIQEQ Hyderabad, Tower 2, 7th floor, … R1d ago
-
Lead Database Engineer INR 1500K-3000KAudit Logging | Azure Data | Azure Data Factory | Azure Database | Azure Database MigrationSenior-level Full TimePune City, India1d ago
-
Computational Software Specialist (Turbomachinery R&D Team) INR 1753K-2700K.NET | Application Architecture | C# | Debugging | GitInternational and multidisciplinary working environment | Long-term career development opportunities | Supportive team culture focused on quality innovation and continuous improvementSenior-level Full TimeGurugram - Haryana - India1d ago
-
Data Scientist INR 2500K-4500KAdvanced Statistics | Apache Spark | Azure Data | Azure Data Factory | Azure KubernetesEquity and inclusion focus | Mentorship opportunities | Travel to other locations in India and globally | Work on global projectsSenior-level Full TimeBangalore - Karnataka - India1d ago
-
Lead AI Engineer - Agentic Engineering INR 2500K-5000KAPI Design | Agent Orchestration | Agent systems | Autogen | Automated RegressionSenior-level Full TimeHyderabad, TS, India1d ago
-
MongoDB, Python, MSA/Consultant Specialist INR 1200K-2000KAWS | Aggregation Pipeline | Azure | CI/CD | Data ModelingContinuous professional development | Flexible working | Inclusive workplace cultureSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
Senior-level Full Timebengaluru, India1d ago
-
Senior-level Full Timebengaluru, India1d ago
-
Senior-level Full Timebengaluru, India1d ago
-
Senior-level Full Timebengaluru, India1d ago
-
Sr.Data Engineering INR 1500K-2500KAzure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event HubsSenior-level Full Timebengaluru, India1d ago