Senior Spark QA Engineer
Pune, Maharashtra, India
INR 1632K-2500K (estimate) Senior-level Full Time
Tasks
- Conduct benchmarking and performance analysis
- Execute functional testing
- Execute performance testing
- Execute scalability testing
- Identify bottlenecks
- Lead QA initiatives
- Mentor QA team members
- Perform manual and automated testing
- Set up and manage Spark clusters
- Test ETL pipelines
- Test Spark SQL queries
- Test Spark jobs
- Troubleshoot distributed system issues
- Validate Spark application results
Perks/Benefits
Skills/Tech-stack
Amazon EMR | Apache Spark | Automation | Benchmarking | CI/CD | Databricks | Distributed Systems | ETL | Google Dataproc | Java | Kubernetes | Mesos | Performance Tuning | Python | Spark Architecture | Spark SQL | Standalone | YARN
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeIndia - Bengaluru; India - Hyderabad2h ago
-
GCP Data Engineer INR 2000K-3000KApache Airflow | Apache Spark | BigQuery | Cloud Composer | Cloud DataflowSenior-level Full TimeIndia - Bengaluru; India - Hyderabad2h ago
-
Senior Data Engineer INR 3000K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Data FactoryFlexible work environment | Hybrid work model | Learning and development supportSenior-level Full TimeIndia R3h ago
-
AWS | Agentic AI | Apache Spark | Databricks | Generative AICollaborative global engineering culture | Continuous learning | Flexible work environment | Opportunity to work on cutting edge GenAI | Remote-friendly work environmentSenior-level Full TimeIndia3h ago
-
Senior Data Engineer INR 3000K-4200KAWS | Access Management | Amazon Neptune | Apache Airflow | Apache KafkaCareer advancement | Hybrid work options | Professional development programs | Remote work options | Training programsSenior-level Full TimeBengaluru3h ago
-
.NET | APIs | AWS | Alerting | AzureAdoption leave | Employee assistance program | Health care benefits | Maternity leave | Mental wellness programsSenior-level Full TimeIndia6h ago
-
AI Data Engineer INR 2000K-3300KAWS | Agent memory | Audio Processing | Batch Processing | Cloud ComputingEquityMid-level Full TimeNew Delhi8h ago
-
Data Engineer, Analytics Engineering, VP INR 1500K-6000KAWS Data | AWS Data Catalog | AWS Glue | AWS Glue Catalog | AWS Glue Data GovernanceExecutive-level Full TimeBengaluru, India9h ago
-
AI Engineer - Full Stack INR 1200K-2500KAI output validation | AI tools | Agile | C++ | Code reviewEthical AI Guidelines | Learning opportunities | Onsite interview optionMid-level Full TimeIND-Pune-Smartworks, India9h ago
-
Data Engineer With Data Observability INR 1500K-2000KAWS | Agile | Airflow | CI/CD | Cloud OperationsMid-level Full TimeBangalore, IN9h ago
-
Principal Data Engineer INR 3000K-4000KAWS | Agile | Amazon EC2 | Amazon S3 | Automated testingBereavement leave | Diversity, equity, & inclusion programs | Employee assistance program | Employee referral program | Healthcare insuranceSenior-level Full TimeIND - Bengaluru, India9h ago
-
Senior Machine Learning Engineer, Model Training & Evaluation INR 2500K-4500KBenchmarking | Checkpointing | DeepSpeed | Distributed Training | Experiment trackingAccidental insurance | Flexible hours | Hybrid work | Life insurance | Medical insuranceSenior-level Full TimeBangalore, India (Hybrid) R10h ago
-
Sr. Delivery Solutions Architect INR 3000K-3900KData Architecture | Data and AI | Distributed Systems | Executive Communication | Program ManagementHybrid work | Travel 30 percentSenior-level Full TimeBengaluru, India10h ago
-
AWS Glue | AWS Lambda | Amazon QuickSight | Amazon S3 | DBTSenior-level Full TimeIndia19h ago
-
API Testing | Agile | Airflow | Azure | BitbucketEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai/Pune, India20h ago
-
Gen AI Engineer INR 2000K-4800KAI Governance | API Integration | AWS Bedrock | Azure OpenAI | Azure OpenAI ServiceSenior-level Full TimeIN-TN-Chennai20h ago
-
Senior-level Full TimeIN-TN-Chennai20h ago
-
Dot Net FSD AWS INR 1400K-1800K.Net Core | API Gateway | AWS CDK | AWS CodePipeline | AWS Well ArchitectedMid-level Full TimeIN-KA-Bangalore20h ago
-
Python Pyspark -Support Role INR 1500K-2000KApache Airflow | BMC | Informatica | PySpark | PythonHybrid work model | Night shift workEntry-level Full TimeIN-TN-Chennai R20h ago
-
Software Engineer INR 850K-1500KAPI Development | Artificial Intelligence | Automation | Azure | DebuggingMid-level Full TimeIN-KA-Bangalore20h ago
-
Software Engineer - Data engineer INR 2800K-4000KAWS | Azure | Data Governance | Data Lake | Data ModelingAccess to cutting-edge technologies | Collaborative work environment | Professional growth | Training and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …20h ago
-
(#1556) Sr. Dotnet Engineer INR 1500K-3500KAPIs | AWS | Audit Logging | Authentication | AuthorizationSenior-level Full TimeAndhra Pradesh, Visakhapatnam, India21h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India21h ago
-
APIs | AWS | Access Control | Apache Spark | AzureCollaborative engineering culture | Flexible working setup | Hands-on innovation | Learning and technical growth | Remote-friendly work environmentSenior-level Full TimeIndia21h ago
-
Associate Software Engineer INR 1500K-1910KAlerting | Angular | Azure | Azure Kubernetes | Azure Kubernetes ServiceEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India21h ago