Software Engineer, PySpark
Tasks
- Build scripts and tools
- Collaborate with engineers and architects
- Design, test, and implement solutions
- Engineer and maintain software
- Implement data quality testing
- Operate and maintain production systems
- Optimize software engineering capability
- Perform data cleansing and monitoring
- Perform requirements analysis design and coding
- Source and explore data
- Test and deploy software
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | Agile | Amazon EMR | Amazon S3 | Automation | Data Cleansing | Data Monitoring | Data Quality | DevOps | ETL | GitHub Copilot | Gitlab Duo | Language Models | Large Language Models | Performance optimization | Prompt engineering | PySpark | Python | SQL | Scalability | Spark
Education
N/A
Roles
Related jobs
-
Senior Software Engineer - Ingestion INR 2040K-2800KBackup and Recovery | C++ | Data Capture | Database replication | Distributed SystemsSenior-level Full TimeBengaluru, India5h ago
-
Technical Specialist, ML Data INR 4850K-5750KActive Learning | Annotation Policy | Dashboards | Data Analysis | Data CurationBonus eligibility | Company benefits | Equity incentive plan | Travel opportunitiesSenior-level Full TimeHyderabad, India13h ago
-
Data Engineer INR 1500K-2000KAgile | Apache Airflow | Apache Kafka | Ascend.io | CI/CDFlexible work modelMid-level Full TimeHyderabad, India14h ago
-
AI Engineer INR 2500K-5000KAPI-driven | API-driven Development | Agent Development | Agent Development Framework | BigQuerySenior-level Full TimePune, Maharashtra, India14h ago
-
Senior Applied AI Engineer INR 3264K-4800KAPI Integration | GraphQL | HubSpot | JavaScript | LangchainFlexible work hours | Hybrid work model | Mental health counseling | Merit based refresh grants | Paid parental leaveSenior-level Full TimeBangalore, India14h ago
-
Mid-level Full TimeHyderabad, IND-TG, India15h ago
-
Associate Data Engineer INR 1500K-2500KAgile | Apache NiFi | Azure DevOps | C plus plus | Database systemsMid-level Full TimePune, India18h ago
-
Senior-level Full TimeBANGALORE, Karnataka, Inde18h ago
-
Advanced Engineer-AI/ML INR 3264K-4800KAPI Integration | ASR | AUTOSAR | AWS | Audio ProcessingEmployee discounts | Recognition rewards program | Training opportunities | Tuition reimbursement | Wellness benefitsSenior-level Full TimeBangalore - Karnataka, India - Kalyani …18h ago
-
Senior Software Engineer - Data License Analytics, Pune INR 3000K-4720KAWS S3 | Agent to Agent | Agent to Agent A2A | Apache Airflow | Apache IcebergSenior-level Full TimePune18h ago
-
Spark, Scala, Hadoop & Quantexa/Senior Consultant Specialist INR 2000K-2800KApache Airflow | Apache Spark | CI/CD | DevOps | ElasticsearchFlexible working hours | On-call support | Shift workSenior-level Full TimeBangalore, Karnataka, India R19h ago
-
Mid-level Full TimeIN-KA-Bangalore19h ago
-
AI Lead and Automation Tester - Document Intelligence INR 2500K-5000KAI Workflow Orchestration | AI workflow | Automation Testing | Clinical Trial Compliance | Clinical trialSenior-level Full TimeIN-TN-Chennai19h ago
-
Senior Consultant INR 2000K-4500KAPI Testing | Adversarial Testing | Amazon SageMaker | Azure Machine Learning | Bias detectionSenior-level Full TimeIN-AP-Hyderabad19h ago
-
Assistant Director - Insights And Analytics INR 3000K-5199KCode reuse | Data Governance | Data Quality | Data Wrangling | Machine LearningExecutive-level Full TimeBangalore, Karnataka, India R19h ago
-
Senior-level Full TimeBangalore - Karnataka - India19h ago
-
Senior-level Full TimeMumbai, India20h ago
-
Java Full Stack Engineer - Professional INR 1200K-3000KAngular | Apache Airflow | Apache Spark | Azure Kubernetes | Azure Kubernetes ServiceSenior-level Full TimeIndia20h ago
-
Senior-level Full Timebengaluru, India20h ago
-
Senior-level Full Timebengaluru, India20h ago
-
Lead Data Platform Engineer INR 2040K-3900KAPI Integration | AWS | AWS CloudWatch | AWS DataZone | AWS GlueEnhanced medical benefits | Family well-being benefits | Hybrid work | Paid time off | Wellbeing programsSenior-level Full TimeHyderabad, India20h ago
-
Anomaly Detection | Autoencoders | Bayesian optimization | Classification | ClusteringOnsite workEntry-level Full TimeHyderabad, India21h ago
-
AI/ML Infrastructure Software Engineer INR 3000K-5000KC++ | JAX | Keras | Machine Learning | Machine Learning FairnessSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Data Engineer INR 1300K-2000KAPI Integration | Data Modeling | Data Transformation | Data pipeline | Power BIMid-level Full TimeHyderabad, Telangana, India21h ago
-
Senior Software Engineer INR 3000K-4000KALB | API Gateway | AWS ECS | AWS Glue | AWS LambdaFamily well-being benefits | Health benefits | Hybrid work | Paid time offSenior-level Full TimeHyderabad, India21h ago