QE (Scala, Kafka, NiFi, Jason)
Tasks
- Collaborate with data engineers, developers, and stakeholders
- Design and execute data test cases
- Identify log and track data quality issues to closure
- Monitor Kafka topics partitions offsets message flows
- Participate in Agile ceremonies and provide status updates
- Perform data validation using SQL
- Perform end-to-end data testing
- Validate Scala based backend processing logic
- Validate data ingestion transformation streaming workflows
- Verify JSON payloads and message integrity
Perks/Benefits
Skills/Tech-stack
Agile | Apache Kafka | Apache NiFi | CI | CI/CD | Data Pipelines | Data Quality | Data Validation | Data Warehousing | ETL | Event Driven | Event-driven architecture | JSON | Kafka Offsets | Kafka Partitions | Kafka topics | Real Time | Real-time Data | Real-time data pipelines | SQL | Scala | Scrum | Streaming Data
Education
N/A
Roles
Related jobs
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KAI Agents | AI Assisted Development | CI/CD | Docker | GitHub ActionsBudget for education | Budget for wellness | Local connection meetups | Remote workSenior-level Full TimeChennai, India1d ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Docker | GitHub Actions | Java | KubernetesLocal team connection | Remote workSenior-level Full TimePune City, India1d ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KAutomated testing | CI/CD | Docker | GitHub Actions | JavaEducation budget | Local team meetups | Personal growth budget | Remote work | Secure local complianceSenior-level Full TimeAhmedabad, India1d ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KAI Agents | CI/CD | Cloud Native | Docker | GitHubEducation budget | Local team connection | Periodic meetups | Personal growth budget | Remote workSenior-level Full TimeJalalabad, India1d ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Docker | GitHub Actions | Java | JiraEducation budget | Local meetups | Personal growth budget | Remote work | Wellness budgetSenior-level Full TimeKolkata, India1d ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Docker | GitHub Actions | Java | JavaScriptEducation budget | Local compliance | Local connection | Periodic meet ups | Remote workSenior-level Full TimeNoida, India1d ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KAI Agents | CI/CD | Docker | GitHub Actions | JavaEducation budget | Local office connectivity | Periodic team meetups | Personal growth budget | Remote workSenior-level Full TimeJaipur, India1d ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Docker | GitHub Actions | Java | JiraEducation budget | Legal compliance support for India | Personal growth budget | Remote work | Team meetupsSenior-level Full TimeTrivandrum, India1d ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KAI-assisted coding | Assisted coding | CI/CD | Docker | GitHubEducation budget | Local meet-ups | Professional development budget | Remote work | Wellness budgetSenior-level Full TimeHyderabad, India1d ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Docker | GitHub Actions | Java | KubernetesEducation budget | Local connection | Personal growth budget | Remote work | Wellness budgetSenior-level Full TimeKochi, India1d ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Cloud Native | Docker | GitHub Actions | JavaEducation budget | Local connection | Personal growth budget | Remote work | Wellness budgetSenior-level Full TimeIndore, India1d ago
-
Software Engineer (AI/DevOps) ID53179 INR 2500K-3200KCI/CD | Docker | GitHub | Java | JiraLocal connection meetups | Remote workSenior-level Full TimeCoimbatore South, India1d ago
-
Data Science AI Engineer, Senior Professional INR 2500K-4500KAPI Development | AWS | Agentic AI | Apache Spark | AzureFully remoteSenior-level Full TimeBangalore, KA, IN, 560100 R1d ago
-
Principal Engineer - Generative AI Infra Capabilities INR 2000K-4600KApigee | Arize | Avi | CI/CD | CUDASenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Mid-level Full TimeIndia2d ago
-
Lead Assistant Manager INR 500K-1500KAWS | Apache Airflow | Cloud platform | Data Governance | Data LakehouseSenior-level Full TimeIndia2d ago
-
Senior Data Engineer INR 1300K-2000KAPI Integration | API Security | Agile | Apigee | Asset ManagementSenior-level Full TimeChennai, Tamil Nadu, India2d ago
-
Senior Consultant INR 1800K-2200KAmazon Aurora | Amazon Aurora PostgreSQL | Amazon Relational Database Service | Amazon Web Services | Aurora PostgreSQLSenior-level Full TimeIN-AP-Hyderabad2d ago
-
Associate, Data Analytics & AI INR 1000K-1800KAmazon SageMaker | Anthropic API | Azure Machine Learning | CRM | CrewAIWellness Fridays | Wellness resources | Work-life balance supportMid-level Full TimePune, Maharashtra, India R2d ago
-
Senior-level Full TimeIN-AP-Hyderabad2d ago
-
Data Analytics-Python Developer INR 2000K-3000KAgile | Dagster | Data Modeling | Dimensional Modeling | DockerMid-level Full TimeBengaluru, Karnataka, India2d ago
-
DE&A - Core - Big Data Engineering - ETL INR 1500K-2000KApache Hive | Apache Spark | Batch Processing | BigQuery | Cloud StorageMid-level Full TimeBangalore, Karnataka, India2d ago
-
DE&A - Core - Big Data Engineering - ETL INR 1500K-2000KBatch Processing | BigQuery | Dataflow | Dataproc | ETLMid-level Full TimeBangalore, Karnataka, India2d ago
-
DE&A - Core - Big Data Engineering - ETL INR 1500K-2000KApache Hadoop | Apache Hive | Apache Spark | Batch Processing | Cloud DataflowMid-level Full TimeBangalore, Karnataka, India2d ago
-
DE&A - Core - Big Data Engineering - ETL INR 1500K-2000KApache Hive | Apache Spark | Batch Processing | BigQuery | Cloud StorageMid-level Full TimeBangalore, Karnataka, India2d ago