Data/AI Engineer
Pune, Maharashtra, India
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Build SSE endpoints for real time delivery
- Build data ingestion workflows
- Build knowledge graph models
- Create NLP based insight pipelines
- Decompose legacy systems into microservices
- Deploy microservices on Azure Kubernetes Service
- Design ETL pipelines
- Design JSON payload schemas for inter service communication
- Design and manage database schemas for large datasets
- Develop data pipelines from Salesforce and NetSuite
- Develop web APIs and microservices
- Implement CI CD pipelines using Azure DevOps YAML
- Implement asynchronous streaming backends using asyncio
- Implement distributed tracing structured logging and metrics
- Implement reconnection logic and heartbeats for streaming
- Integrate SSE with Kafka Redis Pub Sub or RabbitMQ
- Maintain data governance and privacy compliance
- Manage infrastructure setup and monitoring on AKS
- Model lakehouse tables using Delta Lake
- Optimize data pipelines for performance and cost
- Participate in architecture and code reviews
- Perform root cause analysis on data issues
- Populate data warehouse for reporting and analytics
- Provide technical documentation and mentor engineers
- Track event IDs and manage graceful shutdowns
- Use Docker and Kubernetes for service deployment
- Write unit, integration, and load tests
Perks/Benefits
Skills/Tech-stack
AKS | Aiohttp | Asyncio | Azure Databricks | Azure DevOps | Azure Kubernetes | Azure Kubernetes Service | CI/CD | Compliance | Data Governance | Data Privacy | Datadog | Delta Lake | Distributed tracing | Django | Docker | FastAPI | Flask | Helm | Integration Testing | Kafka | Knowledge graph | Kubernetes | Kubernetes Service | Language Processing | Load Testing | Microservices | Natural Language | Natural Language Processing | NoSQL | OpenTelemetry | Prometheus | Python | RabbitMQ | Redis | SQL | SSE | Server-Sent Events | Spark | Structured Logging | Unit Testing
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Related jobs
-
Systems Integration Senior Specialist INR 2800K-4000KAirflow | Batch Processing | Change Data Capture | Clustering | DBTFlexible shift schedule | Hybrid work | Onsite work as neededSenior-level Full TimeBangalore, KA, IN3h ago
-
Staff Engineer, .Net Core (Optimizely CMS 12, and React) INR 1500K-2400K.NET | .Net Framework | ASP.Net Core | Agile | AuthenticationSenior-level Full TimeRemote, India R4h ago
-
AI/ML Engineer INR 2500K-4500KAI Foundry | AI Search | AWS Bedrock | Agent Engine | Amazon QuickSightSenior-level Full Timetelengana, India4h ago
-
Azure Data & Fabric Developer / ETL pipeline & SQL ( 5 + yrs Assistant Manager - RNA INR 1500K-2200KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeMumbai, MH, India5h ago
-
Data Engineer (Python & SQL) INR 2000K-2400KApache Airflow | Apache Beam | Apache Spark | Batch Processing | BigQueryCareer growth | Healthcare package | Hybrid work | Online learning platform | Paid time offMid-level Full TimeIND-Pune-Equifax Analytics-PEC, India10h ago
-
Mid-level Full TimeIT Centre Bengaluru GDTC, India10h ago
-
AI Software Engineer INR 1340K-1680KAgile | Automation Testing | C# | C++ | Distributed ComputingHealth and wellbeing benefits | Professional development programsSenior-level Full TimeBengaluru, Karnātaka, India10h ago
-
Advanced AI Solution Architect INR 2500K-4500KAI Governance | API Design | AWS | Agentic AI | AzureHybrid work | Relocation supportSenior-level Full TimeIT Centre Bengaluru GDTC, India10h ago
-
Senior Software Engineer/ Gen AI & Python INR 2250K-2829KAI content safety | AI gateway | API Management | Azure AI | Azure AI Content SafetySenior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …10h ago
-
Head of World Models (Universal Robots, India) INR 3000K-6000KAI orchestration | Actor-critic | Agent Frameworks | Autogen | DPOExecutive-level Full TimeBangalore, IN10h ago
-
Head of Simulation (Universal Robots, India) INR 3000K-6000KAI orchestration | Actor-Critic methods | Actor-critic | Agent Frameworks | AutogenExecutive-level Full TimeBangalore, IN10h ago
-
Senior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …10h ago
-
Software Engineer INR 1068K-1910KAgile | Angular | Azure | CI/CD | DatabricksCareer development opportunities | Employee Assistance Program (EAP) | Financial wellness tools | Flexible working environment | LinkedIn LearningMid-level Full TimePune, MH, India15h ago
-
Software Engineer II, Data Engineer INR 2520K-3380KAWS | Algorithms | Apache Airflow | Apache Spark | AzureSenior-level Full TimeBangalore, India17h ago
-
Software Engineer II, Data Engineer INR 2520K-3380KAWS | Apache Airflow | Apache Spark | Azure | Cloud platformSenior-level Full TimeBangalore, India17h ago
-
Data Engineer (MS) (Remote) INR 2040K-3380KCI/CD | Data Transformation | Data Validation | Date normalization | ETLMentorship opportunities | Professional growth | Remote workSenior-level Full TimeMaharashtra, Pune, India R20h ago
-
AI / LLM Integration Engineer (Remote) INR 1800K-2800KAPI Integration | Anthropic SDK | Async APIs | Benchmarking | Confidence scoring100 percent remote | Collaborative culture | Inclusive team culture | Professional growthMid-level Full TimeMaharashtra, Pune, India R20h ago
-
Data Engineer INR 1500K-2000KAWS Lambda | Amazon Redshift | Amazon S3 | Azure Data | Azure Data FactoryMid-level Full TimeAhmedabad, 380015, India20h ago
-
ML / LLM Engineer (Remote) INR 2500K-3000KAmazon Web Services | Azure | Classification | Feature Engineering | Language ModelsRemote workMid-level Full TimeMaharashtra, Pune, India R20h ago
-
Senior-level Full Timehosur road bangalore, India21h ago
-
QA Engineer INR 240K-360KDBT | Data Quality | Data Warehousing | Dimensional Modeling | ETLOff hour support on rotation basisEntry-level Full TimePune City, India21h ago
-
ADO.NET | Access Control | Audit Logging | Azure | CI/CDCareer growth opportunities | Collaborative non hierarchical culture | Flexible work environment | International impact projects | Mentorship opportunitiesSenior-level Full TimeIndia21h ago
-
Sr. Computer Vision & Edge AI Engineer INR 2500K-5000KComputer Vision | Deep learning | FP16 | GPU Acceleration | Human pose estimationSenior-level Full TimeMaharashtra, Pune, India21h ago
-
Azure Databricks INR 1500K-2000KAccess Controls | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeIN-AP-Hyderabad21h ago
-
Senior-level Full TimeIN-TN-Chennai21h ago