QA Data Engineer
Langley Office - Langley BC, Canada
CAD 94K-118K Mid-level Full Time
Tasks
- Build test and validation cases
- Build validation frameworks for data pipelines
- Collaborate to test and deploy data pipelines at scale
- Coordinate rollout changes and transition ownership
- Create development support documentation and presentations
- Create test automation frameworks for data pipelines
- Define data quality and unit testing best practices
- Design and automate data quality tests
- Develop scalable tools for peer reviews and unit testing
- Identify project requirements track progress and drive delivery
- Investigate unexpected data pipeline production issues
- Monitor and maintain QA reports KPIs and quality trends
- Script and automate tests for machine learning models dashboards and reports
Perks/Benefits
Skills/Tech-stack
Airflow | Amazon Web Services | Apache Spark | Azure | Azure Data | Azure Data Factory | CI/CD | Cloud Computing | Cloud platform | Data Factory | Data Modeling | Data Quality | Databricks | Delta Lake | Git | Google Cloud | Google Cloud Platform | MLflow | Python | SQL | Test automation | Unit Testing | Web Services
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Science
Regions
Countries
States
Related jobs
-
Staff AI Engineer CAD 140K-174KAPI Design | API Gateway | AWS Lambda | AWS Step Functions | Agent OrchestrationSenior-level Full TimeCanada11h ago
-
Staff Engineer, Machine Learning Platform CAD 208K-312KAWS | Agent Orchestration | Agent systems | Amazon Bedrock | Amazon SageMakerCompany bonus | Equity | Health benefits | Retirement plans | Wellness stipendsSenior-level Full TimeToronto13h ago
-
Lead AI Engineer, NLQ & Agentic Systems CAD 179K-302KAI orchestration | Agentic Systems | Data Engineering | LLM Evaluation | Language ModelsSenior-level Full TimeToronto, Ontario, Canada14h ago
-
CI/CD | Docker | GCP | Go | GrafanaCompetitive retirement pension plan | Disability insurance | Employee assistance program | Employee resource groups | Employee stock purchase planSenior-level Full TimeMontreal, Canada17h ago
-
Senior Data Engineer CAD 140K-210KAWS | AWS CDK | AWS Glue | Amazon Athena | Amazon SageMakerCompany paid group benefits | Holiday closure | Mental health support stipend | Monthly paid meals | Paid time offSenior-level Full TimeRemote - Canada R18h ago
-
Applied AI Engineer CAD 115K-150KAI Pipelines | API Integration | AWS Bedrock | Anthropic SDK | Append Only DataFamily-friendly policies | Fitness and wellness budget | Home office setup budget | Hybrid working | MacBook ProMid-level Full TimeCanada East Coast18h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Collaborative team | Flexible, hands-off management | Mission-driven productMid-level Full TimeOttawa, Canada20h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Distributed work environment | Friendly work atmosphere | Mission driven product impactMid-level Full TimeCalgary, Canada20h ago
-
Data Engineer - Protect (South) GBP 33K-41KData Engineering | Data Governance | Data Quality | Data Security | Data WarehousingAnnual bonus | Buy As You Earn Scheme | Colleague discount | Holiday allowance | Hybrid workMid-level Full TimeReigate -The Omnibus Building, Lesbourne Road, …21h ago
-
AI infrastructure | Benchmarking | Bottleneck analysis | Cloud Computing | Edge ComputingAutonomy | Continuous learning | Flexible location options | Fully remote work | Professional developmentMid-level Full TimeCanada R23h ago
-
AI integration | API Design | AWS | Azure | Clean CodeEquity or stock options | Flexible paid time off | Flexible work environment | Healthcare coverage | Home office supportSenior-level Full TimeCanada1d ago
-
Airbyte | Amazon Web Services | Ansible | Apache Airflow | DBTHealth and dental coverage | Home office support stipend | Internet and mobile service allowance | Learning and development support | Remote-first flexibilitySenior-level Full TimeCanada1d ago
-
Ansible | Apache Airflow | CI/CD | DBT | Data CleansingFlexible vacation | Flexible work options | Hackathons | Mentorship programs | Recognition programsEntry-level InternshipOttawa, ON, Canada1d ago
-
Lead Python AI Engineer CAD 140K-165KAPI Development | AWS | AWS SDK | Agile | Amazon BedrockCertification support | Dental insurance | Employee learning access | Health insurance | Hybrid work policySenior-level Full TimeMDC – Montreal, Canada1d ago
-
Senior Data Engineer CAD 97K-140KAWS Glue | AWS Lambda | Amazon Web Services | Anomaly Detection | Apache SparkAutonomy | Career advancement opportunities | Equal opportunity employer | Health benefits | Job stabilitySenior-level Full Time100 New Park Place 500,Vaughan,ON, Canada1d ago
-
Senior Data Engineer CAD 141K-177KAI Automation | Apache Spark | Azure | Azure Functions | Data WarehousingSenior-level Full TimeCanada Home Office - ON1d ago
-
APIs | Azure DevOps | C++ | CI/CD | Camera SDKSenior-level Full TimeToronto, Canada (ONT40)1d ago
-
Infrastructure Engineer - DataOps Team CAD 180K-200KAWS | Application Firewall | ArgoCD | Bash | CI/CDOn-site work in TorontoMid-level Full TimeToronto, Ontario, Canada1d ago
-
Lead Data Engineer CAD 150K-241KBig Data | Continuous Delivery | Data Architecture | Data Engineering | Data GovernanceCareer development support | Learning and development | Mentoring | Remote workSenior-level Full TimeToronto, Canada R1d ago
-
Senior-level Full TimeVancouver, British Columbia, Canada R1d ago
-
Senior Data Engineer CAD 120K-145KApache Hadoop | Apache Kafka | Apache Spark | Azure Fabric | CI/CDFlexible working hours | Health and wellness benefits | Learning and development | Parental leave | Retirement planningSenior-level Full TimeToronto1d ago
-
Software Engineer II - Model Platform CAD 100K-159KAWS | Asynchronous Communication | Azure | Data Pipelines | Data ProcessingMid-level Full TimeRemote - Canada R1d ago
-
Mid-level Full TimeCA-ON-Toronto1d ago
-
Senior Engineer, Data CAD 120K-140KAzure | Data Modeling | Data Quality | Data Warehousing | Data integrationAssociate discount program | Continuous development | Diverse, inclusive work environment | Training and mentoringSenior-level Full TimeBrampton, ON, Canada1d ago
-
Senior Software Engineer (Typescript / FrontEnd) - AI/ML CAD 140K-195KAI Inference | API Design | AWS | Azure | Cloud deploymentFlexible time off | Global gatherings | Healthcare | Home office setup | Remote-friendlySenior-level Full TimeCanada R1d ago