Data Engineer - Python, AI
Location(s): Pune, Maharashtra, India
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Automate test coverage using unittest
- Build NLP pipelines
- Build ingestion and transformation pipelines for AI and analytics
- Create and maintain Autosys job schedules using JIL
- Deploy model inference APIs using Flask
- Develop ETL jobs using PySpark
- Develop NLP preprocessing using regular expressions
- Implement caching with Redis
- Integrate services using REST APIs
- Monitor system health using ITRS Geneos
- Optimize data processing pipelines
- Support CI CD workflows using GitHub
- Track and version ML models using MLflow
- Troubleshoot using Linux commands
- Work with microservices
- Write unit tests using PyTest
Perks/Benefits
- N/A
Skills/Tech-stack
AWS ECS | Airflow | Autosys | Autosys JIL | BERT | Boto3 | CI/CD | Dask | Docker | FastAPI | Flair | Flask | GitHub | HuggingFace Transformers | ITRS Geneos | Kubernetes | LLM | Language Models | Large Language Models | Linux | MLflow | Microservices | NLP | Pandas | Polars | Prefect | PyArrow | PySpark | PyTorch | Pytest | Python | REST APIs | Redis | Redis caching | Regular Expressions | Shell Scripting | TensorFlow | Transformers | Unit Testing | Unittest
Education
N/A
Roles
Data Engineer | Developer | Engineer | Learning Engineer | Machine Learning Engineer | Python | Python Developer
Related jobs
-
Data Engineer, Global Affairs INR 1500K-2500KArtificial Intelligence | Big Data | C++ | Cloud platform | Data PipelinesMid-level Full TimeHyderabad, Telangana, India6h ago
-
Principal Engineer, Python fullstack (React+Genai) INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | ComplianceSenior-level Full TimeRemote, India R6h ago
-
AI/ML Engineer INR 2500K-3885KAzure | Deep learning | DeepSpeed | Distributed Systems | DockerCar lease | Certification programs | Corporate pension scheme | Dental & vision coverage | Education reimbursementMid-level Full TimeBangalore, Karnataka, India8h ago
-
Principal Engineer, Machine Learning INR 4000K-5000KArtificial Intelligence | Computer Vision | Deep learning | Docker | Foundation ModelsSenior-level Full TimeRemote, India R8h ago
-
Associate Principal Engineer, Machine Learning INR 1800K-3300KAdversarial Networks | Agent Orchestration | Agent systems | Computer Vision | Deep learningMid-level Full TimeRemote, India R8h ago
-
Senior-level Full Time Part Timebangalore, India8h ago
-
Junior Agentic AI Engineer (m/f/d) INR 300K-350KAI Foundry | AKS | API Wrappers | Azure AI | Azure AI FoundryAgile collaboration | Career development | Flexible working | International networking | Learning opportunitiesEntry-level Full TimeHyderabad, IN11h ago
-
Senior Agentic AI Engineer (M/F/D) INR 4000K-5500KAI Foundry | AKS | Asyncio | Autogen | Azure AICareer development | Flexible working hours | International networking | Learning opportunitiesSenior-level Full TimeHyderabad, IN11h ago
-
Data Engineering II INR 1500K-2000KBigQuery | Cloud Composer | Cloud Storage | Data Governance | Data QualityMid-level Full TimeChennai, Tamil Nadu, India11h ago
-
Senior Java Developer – Data Platform & Integration INR 2515K-4401KAgile Scrum | Amazon S3 | Apache Kafka | Avro | Azure BlobFlexible working | Hybrid workingSenior-level Full TimePune, Maharashtra, India12h ago
-
Associate Consultant_SQL_Python INR 1200K-1800KAlgorithms | Automation | C# | Data Structures | GitMid-level Full TimeChennai, IN, 60003212h ago
-
Sr SW Engineer, Machine Learning INR 2500K-5000KA/B | A/B Testing | Airflow | Amazon EMR | Amazon S3Financial wellness support | Flexible work schedule | Mental health support | Retirement plan matchingSenior-level Full TimeBengaluru, India13h ago
-
Senior-level Full TimeGurgaon, Haryāna, India14h ago
-
Senior-level Full TimeBangalore, Karnātaka, India14h ago
-
Data Engineering Associate INR 1500K-2000KAzure | Big Data | CI/CD | ELT | GitClient interaction | High responsibilityMid-level Full TimeBangalore, Karnātaka, India15h ago
-
Senior Software QA Engineer INR 2829K-3500KAPI Testing | AWS | Azure | CI/CD | Coverage metricsGlobal offices | Psychologist on staff | Remote work option | Training budgetSenior-level Full TimeNew Delhi, India15h ago
-
Data Engineering Associate INR 1500K-2000KAzure | Big Data | CI/CD | ELT | GitClient interaction | Collaborative team | International teamMid-level Full TimeGurgaon, Haryāna, India15h ago
-
Data Engineer INR 1500K-2400KAKS | API Management | Amazon Kinesis | Azure | Azure DataHybrid work environmentSenior-level Full TimeBangalore, KA, IN17h ago
-
Asynchronous programming | Business API | Cloud API | Conversation State Management | Conversation stateFlexible schedule | Fully remote | Part time workload 10 to 20 hours per week | Performance-based bonusesMid-level FreelanceIndia - Remote R17h ago
-
Mid-level Full TimeINBLR02 - Bangalore - Milesstone Buildcon, …17h ago
-
IN-Senior Associate_ Data Scientist (AI/ML) __ Data & Analytics _ Advisory _Bangalore INR 3000K-5000KAWS Bedrock | AWS Glue | Amazon S3 | Amazon SageMaker | Azure DataSenior-level Full TimeBengaluru Millenia, India17h ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeNoida, India17h ago
-
Staff Software Engineer - MySQL INR 2800K-3584KAgile | Database Lifecycle | Database lifecycle management | Distributed Systems | DockerConference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Flexible time offSenior-level Full TimeBengaluru1d ago
-
GBM - Bengaluru - Associate - Quantitative Engineering INR 1000K-1800KAngularJS | Continuous Delivery | Continuous Deployment | Continuous integration | HTMLMid-level Full TimeBengaluru, Karnataka, India1d ago
-
SDE III - Backend INR 3500K-5000KAPI Integration | AWS Lambda | Amazon EC2 | Amazon RDS | Amazon SQSCollaborative open minded culture | Learning and development programs | Multicultural experience | Professional growthSenior-level Full TimeIndia R1d ago