Senior Developer - Python and Spark
Location(s): Pune, Maharashtra, India
R
INR 3500K-4600K (estimate) Senior-level Full Time
Tasks
- Automate CI/CD pipelines
- Build production data ingestion transformation integration
- Collaborate with engineers and product owners
- Design ETL/ELT pipelines
- Develop production-grade code
- Embed agentic AI workflows
- Establish data quality standards
- Integrate generative AI and machine learning into data workflows
- Perform code reviews
- Perform performance tuning for large volume data
Perks/Benefits
- Continuous technical development opportunities
- Hybrid working model
- Remote work option
- Wellbeing support
- Work-life balance support
Skills/Tech-stack
Agentic AI | Apache Spark | CI/CD | Dataframes | DevOps | ELT | ETL | Generative AI | GitHub | Jupyter Notebook | Linux | Machine Learning | NumPy | Pandas | PySpark | Python | SQL | SciPy | Spark DataFrames | Spark SQL
Education
N/A
Roles
Related jobs
-
API Design | Anthropic | Automation | CRM Integrations | CrewAIDistributed work flexibility | Fully remote | High ownership roleMid-level Full TimeIndia R3d ago
-
AI Testing | AI testing frameworks | Adversarial Testing | Bias Assessment | Experiment trackingFlexible contract | Fully remoteSenior-level Contract Full TimeIndia R3d ago
-
Cloud Computing | Containerization | Docker | GPU | KubernetesDistributed team | Four-day work week | Fully remote | Open source contribution opportunities | Unlimited paid time offSenior-level Full TimeIndia R3d ago
-
AI Engineer - FDE (Forward Deployed Engineer) INR 3242K-4500KAWS | Agent systems | Apache Spark | Azure | DspyRemote workSenior-level Full TimeRemote - India R3d ago
-
Senior-level Full TimePune, India R3d ago
-
Principal Machine Learning Engineer INR 5000K-6000KBenchmarking | Cost Optimization | Deep learning | Keras | Language ProcessingSenior-level Full TimeBengaluru - India - Bengaluru, 560071 … R3d ago
-
Senior BI & AI Engineer INR 3000K-4064KAnomaly Detection | Azure Data | Azure Data Factory | Azure DevOps | DAXESG opportunities | Flexible vacation | Headspace app | Hybrid work model | Mental health daysSenior-level Full TimeIndia, Hyderabad, Telangana R3d ago
-
Senior Data Analyst INR 3000K-4000KApache Airflow | BI | CI/CD | DAX | DBTEmployee incentive programs | Flex my way policies | Flexible vacation | Headspace access | Hybrid work modelSenior-level Full TimeIndia, Bengaluru, Karnataka R3d ago
-
Data Engineer Azure Fabric INR 1500K-2200KActive Directory | Azure | Azure Active Directory | Azure Data | Azure Data FactoryEastern US time overlap | Proactive monitoring and alerting support | Remote workMid-level ContractIndia - Remote R3d ago
-
Senior ML Engineer INR 3470K-5449KA/B | A/B Testing | Amazon SageMaker | B testing | Data AnalysisHybrid work | Mentoring and knowledge sharing | Remote work option | Travel as neededSenior-level Full TimeAPAC - India - Bengaluru - … R3d ago
-
Principal Applied AI Engineer USD 185K-245KAgent Frameworks | Agent SDK | Anthropic Agent SDK | Context engineering | EvalsSenior-level Full TimeRedesign Health R3d ago
-
Lead Engineer, Testing INR 1500K-2500KCase management | Data Pipeline Testing | Data Quality | Data Reconciliation | Data ValidationSenior-level Full TimeRemote Working, India R3d ago
-
Senior Data Engineer INR 3600K-5000KAWS | Data Modeling | Data Quality | Data Security | Data integrationFlexible work schedule | Hybrid work | Professional development | Remote workSenior-level Full TimeDelhi NCR R3d ago
-
Data Platform Engineer INR 1500K-3000KAWS IAM | AWS KMS | AWS S3 | AWS Secrets | AWS Secrets ManagerSenior-level Full TimeRemote - India R3d ago
-
Fullstack Software Engineer - Embedded Payments INR 1392K-2437KAPI Gateway | AWS | Agile | Apple Pay | Bitbucket PipelinesDiversity and inclusion initiatives | Flexible working arrangements | Mental health support | Paid parental leave | Paid volunteer daysMid-level Full TimePune, MH, India R3d ago
-
Java, GCP, ReactJS/Consultant Specialist INR 2200K-3200KAnsible | Apache Airflow | Apache Atlas | BigQuery | ClaudeFlexible working | Professional developmentMid-level Full TimeHyderabad, Telangana, India R4d ago
-
Java, GCP, ReactJS/Consultant Specialist INR 2200K-3200KAnsible | Apache Airflow | Apache Atlas | BigQuery | ClaudeFlexible working | Professional developmentMid-level Full TimeHyderabad, Telangana, India R4d ago
-
Benchmarking | Chroma | CrateDB | Embedding Optimization | FaissContinuous learning | Flexible work hours | Fully remoteSenior-level Full TimeIndia R4d ago
-
Access Control | Agile | Analysis Services | App Service | AuditingCollaboration opportunities | Continuous learning | Flexible home-office arrangements | Knowledge sharing | Professional growthSenior-level Full TimeIndia R4d ago
-
QA Engineer INR 940K-1600KData Quality | Data Reconciliation | Data Validation | Data Warehousing | ETL TestingCareer development | Flexible work hours | Inclusive work culture | Insurance | Learning opportunitiesMid-level Full TimePune, India R4d ago
-
AI Agents | API | API Development | AWS | AutogenContinuous learning | Exposure to cutting-edge AI technologies | Flexible location | Fully remote | International engineering team collaborationSenior-level Full TimeIndia R4d ago
-
Data Engineering / Sr. Associate Director, Software Engineering INR 1000K-2000KAPIs | Airflow | Apache Beam | Auditability | Backwards CompatibilityCareer developmentMid-level Full TimeHyderabad, Telangana, India R4d ago
-
API Design | Channels | Distributed Systems | Docker | GoFlexible schedule | Four-day work week | Fully remote | Professional growth opportunities | Uncapped holiday allowanceSenior-level Full TimeIndia R4d ago
-
AI Applications Engineer INR 3242K-5000KAgent runtime | CI/CD | Data Pipelines | Data integration | DockerSenior-level Full TimeIndia, Chennai (Hybrid) R4d ago
-
AI Applications Engineer INR 3242K-5000KAgent runtime | CI/CD | Data Pipelines | Docker | Google CloudSenior-level Full TimeIndia, Bengaluru (Hybrid) R4d ago