MLOps Engineer
São Paulo
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
CloudWalk
Our mission is to create the best payment network on Earth. Then other planets.Who We’re Looking ForWe're looking for an MLOps Engineer to help us build ML infrastructure that scales dynamically from dozens to thousands of GPUs, reliably and efficiently.
You’ll be part of the AI R&D team, working closely with researchers and engineers to design systems for training, evaluating, and monitoring machine learning models at scale. This isn’t a research position, but your work will directly support researchers running large-scale experiments. You’ll help build fault-tolerant pipelines that preserve progress even when things break (like OOMs), and ensure model development flows can iterate with confidence.
Our current focus is on large-scale, non-interactive workloads: batch training, dataset-wide model evaluation, and metric-driven improvement loops. That said, the infrastructure you build may later support interactive tools and APIs.
You'll be contributing to system design under the guidance of senior ML researchers and infra engineers, your role is to bring modern tooling and practical engineering to a demanding, GPU-heavy environment.As a Machine Learning Engineer, your mission is to design and deploy intelligent systems that power core product experiences. You'll transform rich data into models that drive automation, personalization, and smart decision-making at scale. This role blends engineering and applied science, focused on building robust, adaptive ML systems that evolve continuously and make a tangible impact.
Responsibilities:
- Build and maintain ML pipelines for data processing, training, evaluation, and model deployment.
- Orchestrate batch and training jobs in Kubernetes, handling retries, failures, and resource constraints.
- Design systems that scale dynamically from small GPU jobs to thousands of GPUs on-demand.
- Collaborate with researchers to productionize their experiments into reproducible, robust workflows.
- Implement model serving endpoints (REST/gRPC) and integrate with internal tooling.
- Set up monitoring, logging, and KPI tracking for ML pipelines and compute jobs.
- Automate CI/CD and infra provisioning for ML workloads.
- Manage experiment tracking, model versioning, and metadata with tools like MLflow or W&B.
- Support model serving infrastructure that may be used by internal UIs or tools in the future.
Required Skills:
- Kubernetes: Strong experience orchestrating jobs, not just deploying services. You should be confident in managing training workloads, GPU scheduling, job retries, and Helm-based deployments.
- Python: Comfortable writing scripts and services that glue systems together. You don’t need to be a full-stack dev, but notebooks won’t cut it. Automation is the word here.
- ML Workflows: Familiarity with data preprocessing, training, evaluation, and deployment pipelines.
- Model Serving: Ability to expose models via FastAPI, TorchServe, or equivalent serving stacks.
- Linux: Strong CLI skills, you should know your way around debugging compute-heavy jobs.
- Experience with ML metadata systems (MLflow, W&B, Neptune).
- Know how to work side by side with AI assistants and agents.
- Ability to communicate and debate in English and Portuguese.
Nice-to-Have:
- Experience with orchestration tools (Airflow, Argo Workflows, Prefect).
- Fluency in cloud environments (GCP, AWS, Azure).
- Ability to write lean and customized Dockerfiles and Helm charts that run smoothly.
- Exposure to distributed training frameworks (Ray, Horovod, Dask).
- Deep understanding of GPU scheduling and tuning in Kubernetes environments.
- Experience supporting LLM workloads or inference systems powering internal tools.
What You’ll Need to Succeed:
- Curiosity about how things fail and how to make them not.
- Strong debugging chops, especially in distributed, resource-constrained environments.
- A practical mindset, you know when to patch and when to fix.
- Ability to collaborate across ML, research, and backend teams.
- Ownership: you care about keeping systems reliable, scalable, and clean.
Recruiting process outline:
- Online assessment: an online test to evaluate your theoretical skills and logical reasoning.
- Essay: a technical project for you to share your thoughts
- Technical interview and Essay presentation.
- Cultural interview.
If you are not willing to take an online quiz, do not apply.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow APIs AWS Azure Blockchain CI/CD Engineering FastAPI FinTech GCP GPU Helm Horovod Kubernetes Linux LLMs Machine Learning MLFlow ML infrastructure ML models MLOps Model deployment Pipelines Python R R&D Research Weights & Biases
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.