Data Science Quality Engineer

This is a remote position.

We are seeking a highly skilled and motivated Data Science Quality Engineer to join our team for the OPEN Q & QUBED software applications. The ideal candidate will have a strong background in quality assurance, data science, and software engineering, with a focus on generative AI and machine learning operations.

Responsibilities:

• Develop and implement quality assurance processes for data science projects.
  
• Collaborate with data scientists and software engineers to ensure the accuracy and reliability of AI models.
  
• Conduct API testing, including NFT calls to OpenAI.
  
• Manage CICD pipelines using GitHub Actions, with a focus on staging and development environments.
  
• Perform Docker containerization and AWS cloud deployment.
  
• Apply statistical and mathematical techniques to test machine learning models.
  
• Provide insights and recommendations for improving the quality of AI models and software applications.
  

Requirements

1. Knowledge of Generative AI.
   
2. Experience with CICD GitHub Actions, with a focus on staging and development environments and quarterly production releases.
   
3. Strong API testing skills, including NFT calls to OpenAI.
   
4. Proficiency in Docker.
   
5. Experience with AWS.
   
6. Expertise in ML Ops, including statistical and mathematical testing of machine learning models.
   
7. Background in software engineering.
   

Optional Skills:

• Experience with guardrails from a QA perspective, particularly in dealing with LLM GI.
  

Tech Stack:

1. Python, FastAPI, OpenAI/AWS Bedrock, Pytest
   
2. Next.js, React, Typescript (Front end subject to change).