Python Spark Developer
Tasks
- Build data pipelines
- Collaborate with engineering and business stakeholders
- Deliver in agile environment
- Design data pipeline architecture
- Develop ETL processes
- Integrate CI CD automated builds and deployments
- Maintain data pipelines
- Process large scale data
- Support downstream analytics use cases
Perks/Benefits
Skills/Tech-stack
Agile methodology | Apache Spark | CI/CD | Data pipeline | ETL | Python | SQL
Education
N/A
Roles
Backend | Backend Software Engineer | Data Engineer | Engineer | Software Engineer
Related jobs
-
Senior Staff Engineer, Data Migration Lead INR 3000K-4000KAccess Control | Audit Trail | Cutover planning | Data Governance | Data ManagementSenior-level Full TimeRemote, India R11h ago
-
Associate Engineer-Data Analyst(Hybrid) INR 700K-900KAerospace Engineering | Data Analysis | Data Visualization | Mechanical Engineering | Power BICar lease programme | Contingency leave | Employee scholar programme | Group health insurance | Group personal accident insuranceMid-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala … R21h ago
-
Sr Data Engineer - ETL, Power BI & Java INR 2775K-4401KData Governance | Data Modeling | Data Quality | Dimensional Modeling | ELTSenior-level Full TimeIndia Virtual R21h ago
-
AWS | Alerting | Autogen | Data Ingestion | Data PreprocessingSenior-level Full TimeBangalore - Carina, India R21h ago
-
AI Engineer II (Remote) USD 39K-72KAWS | CI/CD | Docker | Embeddings | Entity recognitionRemote workMid-level Full TimeIndia, Remote R2d ago
-
Machine Learning Engineer V INR 6866K-12359KAPIs | Agentic Workflows | Asynchronous Workflows | Classification | Cloud NativeBonuses | Disability insurance | Life insurance | Paid parental leave | Paid time offSenior-level Full TimeRemote, India R3d ago
-
Mid-level Full TimeIndia - Remote R3d ago
-
Principal Engineer, Python fullstack (React+Genai) INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | ComplianceSenior-level Full TimeRemote, India R3d ago
-
Principal Engineer, Machine Learning INR 4000K-5000KArtificial Intelligence | Computer Vision | Deep learning | Docker | Foundation ModelsSenior-level Full TimeRemote, India R3d ago
-
Associate Principal Engineer, Machine Learning INR 1800K-3300KAdversarial Networks | Agent Orchestration | Agent systems | Computer Vision | Deep learningMid-level Full TimeRemote, India R3d ago
-
AI Application Engineer INR 3000K-4408KAWS Lambda | AWS S3 | Amazon Bedrock | CI/CD | Cloud SecurityKnowledge sharing culture | Learning environmentMid-level Full TimeHybrid (Bengaluru, Karnataka, IN); Hybrid (Pune, … R3d ago
-
GenAI LLM Python/Sr. Associate Director, Software Engineering INR 1500K-3000KAWS | Agent Orchestration | Agent systems | Azure | Cloud platformFlexible working | Inclusive and diverse environment | Professional development opportunitiesMid-level Full TimePune, Maharashtra, India R3d ago
-
Senior Prompt Engineer – Generative AI (LLMs) INR 2000K-3500KAI API | API Integration | Anthropic API | Bias detection | Evaluation metricsContract workSenior-level Full TimeIndia (Remote) R3d ago
-
AI Engineer INR 4000K-5500KARIMA | Agentic Workflows | Amazon SageMaker | Computer Vision | Deep learningMid-level Full TimeIndia - Remote R3d ago
-
Software Engineering Senior Analyst - HIH - Evernorth INR 2475K-3380KAWS | Access Control | Auditability | CI | CI/CDSenior-level Full TimeHIH - Hyderabad, India R3d ago
-
SDE III - Backend INR 3500K-5000KAPI Integration | AWS Lambda | Amazon EC2 | Amazon RDS | Amazon SQSCollaborative open minded culture | Learning and development programs | Multicultural experience | Professional growthSenior-level Full TimeIndia R4d ago
-
SDE III - Backend INR 3500K-5000KAWS | Amazon SQS | Docker | EC2 | EmbeddingsLearning and development programs | Professional growthSenior-level Full TimeIndia R4d ago
-
Senior Applied AI Engineer INR 3000K-4000KAPIs | AWS Bedrock | Agent systems | AgentOps | Agentic ArchitecturesOwnership of projects | Professional training and playbooks | Remote-first work environmentSenior-level Full TimeIndia-Remote R4d ago
-
Forward Deployed AI Engineer INR 3264K-5000KAWS | Agentic AI | Automation | Azure | Cloud ComputingHealth benefits | Paid time off | Remote work | Travel for customer engagementsSenior-level Full TimeIndia - Remote R4d ago
-
Lead Data Engineer/ Data Architect INR 2000K-2800KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Telangana, India - Remote R4d ago
-
Vice President, Data Quality Lead Engineer INR 4000K-5000KAPI Design | Anomaly Detection | Audit trails | CD | CIComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeM11 - Commers III, 43, 44 … R4d ago
-
Data Engineer, AI (Hybrid) INR 2000K-2700KAWS | Access Control | Alerting | Confluence | Data GovernanceMid-level Full TimeKAP Bangalore IND, India R4d ago
-
Data Engineer, People Analytics INR 700K-2000KAWS | Airflow | DBT | Data Modeling | Data QualityHybrid work environment | Remote work optionsMid-level Full TimeRemote (IND), India R4d ago
-
Staff Software Engineer, Data (Employer of Record) INR 3715K-5449KAWS Glue | AWS Lambda | Agile | Amazon MSK | Amazon S3Cross-functional collaboration | Employee mentoring | Paid leave | Remote workSenior-level Full TimeIndia - Field R4d ago
-
Data Engineer INR 2771K-3880KAgile | CTE | Common table expressions | Continuous integration | Data AggregationEmployee community involvement | Hybrid work options | Remote work options | Work-life balanceSenior-level Full TimeRemote (IND), India R4d ago