Senior ML/DevOps Engineer

Role:

We are looking for a highly skilled and motivated Senior ML/DevOps Engineer to join our dynamic team. The ideal candidate will possess extensive experience with designing and maintaining Azure Cloud Solutions, along with a strong background in AI/ML architectures and managing CI/CD pipelines. As a ML/DevOps Engineer at ProRata, you will play a crucial role in automating our software delivery process, ensuring the high availability, scalability, and security of our cutting-edge AI/ML applications. 

Responsibilities:

Cloud Infrastructure Management 

• Design, implement, and manage scalable, secure, and resilient cloud infrastructure on Azure. 

• In-depth understanding of (Azure) Kubernetes including lifecycle-management and orchestration of containers and virtual networking. 

• Knowledge of MLOps and good understanding of ML/AI model lifecycle management and tools such as Kubeflow, BentoML, Vertex AI, Azure AI/ML Studio. 

• Good understanding of latest LLM platforms and systems such as LlamaIndex, LangChain and agentic systems such as CrewAI and AutoGen 

• Utilize Infrastructure as Code (IaC) tools such as Terraform and develop Bicep/ARM templates for provisioning and managing cloud resources. 

• Manage and audit the security posture of ProRate.ai solutions, by implementing Application Gateway, Web Application Firewall, VNet configuration 

• Good technical knowledge on backend database services such as OpenSearch, Redis, MongoDB, ChromaDB, Neo4J and PostgreSQL 

CI/CD Pipeline Development 

• Develop, maintain, and optimize CI/CD pipelines using tools like Azure DevOps and GitHub Actions. 

• Implement automated testing, deployment, and monitoring processes to ensure high-quality software releases. 

Automation and Scripting 

• Write and maintain scripts for automation of infrastructure and application deployments using languages such as Python, Bash, or PowerShell. 

• Implement configuration management using tools like Terraform, Ansible, Chef, or Puppet. 

Monitoring and Logging 

• Set up and manage monitoring and logging solutions using tools like Azure Log Analytics, Prometheus, Grafana, Uptime Kuma and ELK stack. 

• Ensure proactive monitoring and alerting to maintain system health and performance. 
  
  

Qualifications: 

• Bachelor’s degree in Computer Science, Information Technology, or a related field. 

• 5+ years of experience as a DevOps Engineer or in a similar role. 

• Proven experience with Azure and AWS cloud platforms. 

• Strong experience in building and managing ML & CI/CD pipelines. 

• Experience with building and maintaining LLM infrastructure and/or applications 

• Proficiency in Infrastructure as Code (IaC) tools such as Terraform and ARM/Bicep templates. 

• Experience with CI/CD tools like Azure DevOps, Github, Jenkins, GitLab CI, etc. 

• Strong scripting skills in Python, Bash, or PowerShell. 

• Knowledge of configuration management tools like Ansible, Chef, or Puppet. 

• Familiarity with monitoring and logging tools such as Azure Monitor, AWS CloudWatch, Prometheus, Grafana, and ELK stack.

Work Environment: 

Location: This position is Onsite. This role is based at our Bellevue WA (or Pasadena, CA) office location, and employees are expected to work on-site during regular business hours. 

Compensation: 

The compensation for this position will be competitive and commensurate with experience. The estimated salary range for this role is 110,000 - 160,000 USD.

What We Offer

• Opportunity to work at the forefront of AI technology 

• Collaborative and innovative work environment 

• Competitive salary and benefits package 

• Professional development and growth opportunities 

• Chance to make a significant impact on the company's success 

Equal Employment Opportunity

• ProRata is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All employment decisions are made based on qualifications, merit, and business needs.  

California Specific Notices

• At-Will Employment: Employment at ProrataAI is at-will. This means that either the employee or the employer may terminate employment at any time, with or without cause or prior notice. 

• Salary Disclosure: In compliance with California law, salary information is provided to ensure transparency and fairness. 

• California Consumer Privacy Act (CCPA): ProrataAI complies with the CCPA. Personal information collected during the recruitment process will be used for employment purposes only.