Data Engg Consultant- Python, SQL, ETL, AWS/Azure
Tasks
- Apply Infrastructure as Code for deployments
- Build and expose data services and APIs
- Build data ingestion, processing, and transformation systems
- Collaborate with cross-functional teams
- Contribute to architecture decisions
- Deploy and operate data systems on cloud
- Design and operate workflow orchestration for data workloads
- Design scalable data pipelines
- Develop and deploy AI agents and LLM powered workflows
- Develop production backend services for data workflows
- Ensure high availability low latency and resilience
- Implement RAG for data enrichment
- Implement data models and storage patterns
- Implement error handling retries monitoring and alerting
- Manage containers and automated CI CD pipelines
- Mentor junior engineers
- Monitor and optimize AI agent performance reliability and governance
- Optimize cloud resources for cost and performance
- Participate in system design reviews
- Troubleshoot performance, scalability, and reliability issues
- Write clean, maintainable, well-tested code
Perks/Benefits
Skills/Tech-stack
AWS | Agentic AI | Azure | CI/CD | Data Modeling | Data Warehousing | Data pipeline | Docker | ELT | ETL | Git | Infrastructure as Code | LLM integration | Prompt engineering | Python | RAG | Relational databases | SQL | Shell | Step Functions | Terraform | Workflow Orchestration | “as-code”
Education
N/A
Related jobs
-
Entry-level Full TimeHyderabad, India11h ago
-
Data Science - Senior Architect (Healthcare & Life Sciences) INR 2500K-5000KAWS | Amazon SageMaker | CI/CD | Containerization | Data ModelingSenior-level Full TimeChennai, India11h ago
-
Sr. Data Engineer INR 1500K-2500KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimePune City, India11h ago
-
Lead Data Engineer - Fabric INR 1400K-2700KAPI Integration | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure SynapseEmployee referral bonuses | Flexible work options | In-house technology training | Learning and development programs | Medical insuranceSenior-level Full TimePune City, India11h ago
-
Senior-level Full TimeIndia13h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 2500K-4800KAWS | Agile | Deep learning | Embedding Models | Hugging FaceCompany-paid certifications | Financial consultations | Internal training workshops conferences meetups | Language courses | Legal consultationsSenior-level Full TimeIndia13h ago
-
Lead Integration Engineer INR 1500K-3000KAWS EC2 | AWS IAM | AWS VPC | Amazon CloudWatch | Amazon MSKSenior-level Full TimePune - Maharashtra - India13h ago
-
Mid-level Full TimeBangalore - Karnataka - India13h ago
-
Senior-level Full TimeBangalore - Karnataka - India13h ago
-
Senior-level Full TimeBangalore - Karnataka - India13h ago
-
Senior GenAI Engineer — Claude INR 2000K-5000KAPI Development | AWS | Embeddings | Function Calling | GuardrailsSenior-level Full TimeNoida, Uttar Pradesh, India14h ago
-
Senior GenAI Developer — OpenAI INR 2000K-5000KAssistants API | Azure | Azure OpenAI | Azure OpenAI API | CI/CDSenior-level Full TimeNoida, Uttar Pradesh, India14h ago
-
Senior Software Engineer - (Backend,AI) INR 3242K-5000KAPI Gateway | AWS | AWS Lambda | Agent Orchestration | Amazon APIFamily well-being benefits | Health benefits | Hybrid work | Paid time off | Wellbeing supportSenior-level Full TimeHyderabad, India R14h ago
-
Mid-level Full TimePune, Maharashtra, India14h ago
-
GCP Data Engineer INR 2800K-4000KAirflow | Apache Spark | BigQuery | Cloud Composer | Cloud FunctionsSenior-level Full TimeIndia15h ago
-
Senior-level Full TimeIndia15h ago
-
GCP Data Engineer / Associate Director, Data and Analytics INR 1000K-2000KAgile | Artificial Intelligence | As-a-Service | Automated testing | CI/CDFlexible working | Inclusive work environment | Professional developmentMid-level Full TimeHyderabad, Telangana, India R16h ago
-
Database Engineer - PostGreSQL / MySQL INR 500K-1500KAutomation | Cassandra | Failover | High Availability | Incident ManagementExposure to modern database technologies | On-call rotation | SLA based operationsMid-level Full TimeNoida,Uttar Pradesh,India16h ago
-
Data Engineering Specialist INR 1500K-2200KApache Kafka | BigQuery | CI/CD | Cloud platform | ClusteringMid-level Full TimeKolkata, IN, 70015617h ago
-
Senior Data Engineer INR 3000K-4000KAI | AWS | Amazon Aurora | Automated reporting | AzureBike to work | Educational assistance | Employee assistance programme | Employee discount | Enhanced maternity/paternity leaveSenior-level Full TimeMumbai, MH, India R17h ago
-
Senior Data Engineer INR 1500K-2700KApache Airflow | Apache Hadoop | Apache Iceberg | Apache Spark | DBTSenior-level Full TimeHyderabad, TS, India17h ago
-
Databricks Engineer INR 1500K-2800KADLS Gen2 | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeHyderabad, TS, India17h ago
-
Sr Generative AI Engineer (Agentic AI & RAG) INR 3264K-5000KAI Agent Builder | Agent Builder | Agent Orchestration | Apex | BigQuerySenior-level Full TimePune, MH, India18h ago
-
Software Engineer, Machine Learning INR 3242K-4580KClassification Models | Data Mining | Deep learning | Distributed Training | Embedding ModelsFlexible work hybrid work arrangementSenior-level Full TimeBengaluru, KA, India R18h ago
-
Robotics Engineer Fresher INR 300K-400KArduino | Artificial Intelligence | Automation | C plus plus | C#Career growth in EdTech and robotics | Exposure to robotics competitions | Mentorship opportunities globallyEntry-level Full TimeBangalore, Karnataka, India18h ago