Senior QA Data Engineer
Tasks
- Collaborate with data engineers and product teams
- Contribute to automated data test frameworks
- Design data test plans
- Develop automated data test scripts
- Ensure correctness of data transformations
- Execute data quality tests
- Execute test scripts in Databricks
- Identify data issue root causes
- Inspect data with Databricks
- Investigate transformation failures
- Participate in refinement sessions
- Perform data accuracy validation
- Perform data completeness validation
- Perform data consistency validation
- Perform data timeliness validation
- Perform root cause analysis
- Run data profiling
- Support data issue resolution
- Support schema evolution regression testing
- Test dashboards
- Test data models
- Test pipeline refactoring regressions
- Validate Databricks notebook logic
- Validate ETL ELT workflows
- Validate data lineage
- Validate data transformations
- Validate ingestion pipelines
- Write PL SQL queries for data verification
- Write SQL queries for data verification
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | CI/CD | Data Lineage | Data Observability | Data Quality | Data Testing | Databricks | Delta Lake | ELT | ETL | Git | PL/SQL | Pandas | PySpark | Python | SQL
Education
N/A
Roles
Data Engineer | Data QA | Data QA Engineer | Engineer | QA Data Engineer | QA Engineer
Related jobs
-
AI/ML Infrastructure Software Engineer INR 3000K-5000KC++ | JAX | Keras | Machine Learning | Machine Learning FairnessSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Senior-level Full TimeBangalore, IN4h ago
-
Embedded Software Eng. INR 2475K-3000KADC | ASIL decomposition | AUTOSAR | AUTOSAR Classic | AUTOSAR Classic BSWCareer growth | Close collaboration | Company cultureSenior-level Full TimeBangalore, IN4h ago
-
Software Engineering Professional 2, AI Engineering INR 3000K-4800KAI Governance | AI Ops | API Integration | Amazon Q | Automated testingEntry-level Full TimeBengaluru, IN, 5601035h ago
-
Sr. Principal Business Systems Analyst 1 INR 3700K-5000KAgentic Frameworks | Azure DevOps | Big Data | C# | C++Senior-level Full TimeBengaluru, KA, IN5h ago
-
Mid-level Full TimeBangalore, KA, IN, 5600768h ago
-
Engineering Technical Leader – Embedded Software INR 3000K-3500KBash | Board Support | Board Support Package | Bootloader | C plus plusSenior-level Full TimeBengaluru, India8h ago
-
AWS | Airbyte | Airflow | Azure | CI/CDCollaboration across teams | Inclusive work environment | Learning opportunities | Professional growth | Remote workSenior-level Full TimeIndia8h ago
-
Senior Consultant INR 2700K-4000KAWS OpenSearch | Agile | Apache Kafka | At Least Once Delivery | At least onceSenior-level Full TimeBangalore, IN, 5600668h ago
-
Senior Consultant INR 2700K-4000KAWS OpenSearch | Agile | Apache Kafka | At Least Once Delivery | At least onceSenior-level Full TimeBangalore, IN, 5600668h ago
-
Senior Analytics Engineer – Data Applications INR 2771K-4064KAirflow | Anomaly Detection | Apache Spark | CI/CD | DBTSenior-level Full TimeBengaluru, INDIA, India9h ago
-
.NET | APIs | Automation | C Sharp | CrewAIAccess to AI tools | Accidental insurance | Casual leave | Earned Leave | Flexible autonomySenior-level Full TimeIndia10h ago
-
Senior Data Engineer INR 3000K-4000KA/B | A/B Testing | AWS | Apache Airflow | Apache HiveAccident insurance | Disability insurance | Financial wellness support | Flexible work schedule | Healthcare benefitsSenior-level Full TimeBengaluru, India10h ago
-
IN-Senior Associate_ Data Engineer Databricks_Data and Analytics_Advisory_ Bangalore INR 1500K-2500KAWS | Agile | Amazon Web Services | Apache Spark | Auto LoaderSenior-level Full TimeBengaluru Millenia, India14h ago
-
Data Scientist - Generative AI / Senior Consultant Specialist INR 2817K-4800KCI/CD | Chroma | Deep learning | Docker | FaissSenior-level Full TimePune, MH, IN, 41100614h ago
-
Engineering Lead,Microservices,Java Springboot /Sr. Associate Director, Technology Management INR 1500K-2400KApache Airflow | Apache Beam | Apache Flink | BigQuery | Cloud StorageMid-level Full TimePune, Maharashtra, India R22h ago
-
Senior-level Full TimeIndia, Bengaluru (Hybrid) R22h ago
-
Data Engineer II INR 2800K-3584KApache Airflow | BigQuery | CI/CD | Cloud Run | Cloud Run FunctionsSenior-level Full TimeIndia, Chennai22h ago
-
Applied AI Engineer INR 3264K-5876KAWS | Agent systems | Authentication | Autonomous Agents | AzureHybrid work | Mental health counseling | Paid volunteer time off | Subsidized Wellhub membership | Unlimited PTOSenior-level Full TimeBangalore, India23h ago
-
Sr. Cloud Engineer - Databricks/AI focus ( 5-9 years) Bangalore INR 2400K-3000KAKS | Bash | BigQuery | CI/CD | Cloud SecuritySenior-level Full TimeBengaluru, KA, India1d ago
-
Vice President - AI/ML Technical Developer INR 4000K-5199KAgentic Frameworks | Alerting | Automated testing | Cause analysis | Code reviewExecutive-level Full TimeBengaluru, Karnataka, India1d ago
-
ARM Microcontroller | Arc | C# | Clock | DMAEntry-level Full TimeBengaluru, KA, India1d ago
-
Data Engineer (Python ETL) INR 800K-2000KETL | Oracle Database | PL/SQL | Performance Tuning | PythonMid-level Full TimeIN-MH-Pune1d ago
-
Mid-level Full TimeIN-MH-Pune1d ago
-
API Design | AWS | Apache Spark | Azure | Big DataSenior-level Full TimeBangalore - Karnataka - India Pune …1d ago