QA Data Engineer
Tasks
- Build test and validation cases
- Build validation frameworks for data pipelines
- Collaborate to test and deploy data pipelines at scale
- Coordinate rollout changes and transition ownership
- Create development support documentation and presentations
- Create test automation frameworks for data pipelines
- Define data quality and unit testing best practices
- Design and automate data quality tests
- Develop scalable tools for peer reviews and unit testing
- Identify project requirements track progress and drive delivery
- Investigate unexpected data pipeline production issues
- Monitor and maintain QA reports KPIs and quality trends
- Script and automate tests for machine learning models dashboards and reports
Perks/Benefits
Skills/Tech-stack
Airflow | Amazon Web Services | Apache Spark | Azure | Azure Data | Azure Data Factory | CI/CD | Cloud Computing | Cloud platform | Data Factory | Data Modeling | Data Quality | Databricks | Delta Lake | Git | Google Cloud | Google Cloud Platform | MLflow | Python | SQL | Test automation | Unit Testing | Web Services
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Regions
Countries
States
Related jobs
-
Senior Software Engineer, Data Platform USD 163K-247KAWS | Amazon EMR | Amazon Kinesis | Amazon MSK | Amazon RedshiftHybrid workSenior-level Full TimeDenver, CO;San Francisco, CA;New York, NY;Los … R15h ago
-
Data Developer - TG Quality Engineering TGQF CAD 85K-107K.NET | AWS | Agile | Apache Flume | Apache NiFiSenior-level Full TimeQuebec City, QC, Canada19h ago
-
Data Engineer USD 133K-182KAWS | Airbyte | Airflow | Alerting | CI/CD401k contribution | Dental insurance | Health insurance | Life insurance | Long-term disabilitySenior-level Full TimeCanada - Remote R21h ago
-
Senior Data Engineer CAD 120K-145KApache Hadoop | Apache Kafka | Apache Spark | Azure Fabric | CI/CDFlexible working hours | Health and wellness benefits | Learning and development | Parental leave | Retirement planningSenior-level Full TimeToronto22h ago
-
Data Architect CAD 120K-150KA/B | A/B Testing | API Design | API Development | Amazon RedshiftAnnual tech allowance | Annual travel allowance | Flexible working hours | Health insurance | Learning and developmentSenior-level Full TimeToronto22h ago
-
DSP | FPGA | FPGA Integration | FPGA implementation | Hardware DesignDental insurance | Employee assistance program | Employer matching retirement savings | Flexible work hours | Health insuranceMid-level Full TimeMontreal (CAN), Canada1d ago
-
Data Engineer Co-op (8-12 Months) CAD 45K-45KAirflow | BI Dashboards | CI/CD | Cloud platform | Data ModelingCorporate partner discounts | Employee purchase program | Free Kobo device | Free weekly ebooks or audiobooks | Hybrid work modelNone Full TimeON-John Street, Canada1d ago
-
Lead Engineer 1 - Embedded SW Development CAD 96K-145KC++ | CI/CD | Code review | EEPROM | Embedded LinuxSenior-level Full TimeMarkham, Canada1d ago
-
Senior-level Full Time661 University Avenue, Toronto, Ontario, Canada1d ago
-
Machine Learning Engineer II CAD 154K-199KAzure | Cloud Architecture | Data Engineering | Deep learning | Generative AIBanking benefits and discounts | Career development | Health and well-being benefits | Mentoring programs | Paid time offSenior-level Full Time661 University Avenue, Toronto, Ontario, Canada1d ago
-
GenAI Testing CAD 90K-115KAgile | BDD | CI/CD | Cucumber | End to EndCompany-Paid Holidays | Disability insurance | Employee assistance program | Life insurance | Medical, dental & vision coverageMid-level Full TimeToronto, CA1d ago
-
Expert MLOps Platform Engineer CAD 108K-214KAWS SageMaker | Apache Kafka | ArgoCD | Azure Event | Azure Event HubsSenior-level Full TimeVancouver, British Columbia, CA, V6B 1A91d ago
-
Senior Data Quality Automation Engineer CAD 100K-106KAnomaly Detection | CI/CD | Data Quality | Data Validation | ETLEmployee discounts | Flexible health benefits | Matched pension plan | RRSP program | TFSA programSenior-level Full Time00000 Canadian Headquarters, Canada1d ago
-
Lead Data Engineer (Azure / Databricks / Python) CAD 115K-165KAzure Data | Azure Data Factory | Azure DevOps | Azure Functions | CI/CDCollaborative environment | Impactful work | Innovative culture | Professional growthSenior-level Full TimeVancouver, British Columbia, Canada1d ago
-
Data Engineer (Azure / Databricks / Python) CAD 115K-163KAzure Data | Azure Data Factory | Azure DevOps | Azure Functions | CI/CDCollaborative environment | Impactful work | Innovative culture | Professional growthSenior-level Full TimeVancouver, British Columbia, Canada1d ago
-
Data Engineer CAD 100K-140KAWS | Apache Spark | Azure | CI/CD | Data GovernanceContinuous learning opportunities | Coverage for dependents | Dental insurance | Health insurance | Hybrid workMid-level Full TimeToronto, Ontario1d ago
-
Conversational AI Engineer CAD 83K-102KAPIs | Agent Assist | BigQuery | Cloud Storage | Contact Center AIBaby bonus and parental leave top up program | Competitive medical and dental benefits | Electric vehicle purchase incentive program | Flex working arrangements | Home office reimbursement programMid-level Full TimeOakville, Ontario - Canada1d ago
-
.NET | AWS | Agile | Apache Flume | Apache IcebergEntry-level Full TimeQuebec City, QC, Canada1d ago
-
AWS CDK | AWS EventBridge | AWS Lambda | AWS Step Functions | Amazon DynamoDBMid-level Full TimeToronto, Ontario1d ago
-
AWS CDK | AWS EventBridge | AWS Glue | AWS Lambda | AWS SQSSenior-level Full TimeToronto, Ontario1d ago
-
Automated testing | CI/CD | Cloud Security | Cloud platform | Distributed SystemsHigh stakes fast paced environment | Startup experience favoredSenior-level Full TimeOttawa, Ontario1d ago
-
A/B | A/B Testing | B testing | Data Warehousing | DatabasesSenior-level Full TimeRemote, Canada or US R1d ago
-
SENIOR AI ENGINEER (Canada) CAD 125K-160KAWS ECS | Amazon S3 | Background job | Background job processing | DockerComprehensive training program | Global multicultural team | Great referral programs | Growth opportunities | Product DiscountsSenior-level Full TimeCanada1d ago
-
Embedded Software Developer-Team Lead CAD 130K-140KAgile | Automated testing | Bare Metal | C# | C++In-office workSenior-level Full TimeOttawa, Ontario, Canada1d ago
-
Senior Data Engineering Developer CAD 83K-139KAPI Management | Azure API | Azure API Management | Azure Data | Azure Data FactoryEmployee assistance program | Flexible work options | Group retirement savings plans | Health and wellness programs | Mental health supportSenior-level Full TimeGuelph, Ontario, Canada; Quebec, Quebec, Canada1d ago