ML Operations Engineer (AI/LLM) - Mercari
Minato City, Tokyo, Japan
JPY 8600K-9700K (estimate) Senior-level Full Time
Tasks
- Build monitoring and alerting for model health
- Define SLOs and run on call and incident response
- Deploy and serve production machine learning models
- Implement automated model evaluation and quality monitoring
- Integrate research models into production services
- Optimize inference performance and cost
- Orchestrate model inference end to end
Perks/Benefits
Skills/Tech-stack
BigQuery | Bigtable | CI/CD | Docker | Drift Detection | Dynamic batching | Incident Response | Inference Server | JAX | KV caching | Kubernetes | LLM Evaluation | Machine Learning | Model Monitoring | PyTorch | Python | Quantization | RAG | SLO | TensorFlow | TensorRT-LLM | Terraform | Triton Inference | Triton Inference Server | Valkey | Vector Search
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
AWS | Cloud platform | Data Lake | Data Warehouse | Database Management SystemsOn site work location Japan | Relocation support | Visa sponsorshipEntry-level Full TimeSaitama, Japan1d ago
-
Software Engineer, Data Infrastructure & Acquisition - Nagoya, Japan JPY 8000K-10400KBash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Remote-friendlyMid-level Full TimeNagoya, Japan1d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOn site Tokyo Japan | Relocation support | Visa sponsorshipSenior-level Full TimeYokohama, Kanagawa, Japan2d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOnsite work in Tokyo Japan | Relocation support | Visa sponsorshipSenior-level Full TimeChiba, Japan2d ago
-
AIOps | Artificial Intelligence | Big Data | Big data analytics | CUDAOnsite in Tokyo Japan | Relocation support | Visa sponsorshipSenior-level Full TimeTokyo, Kantō, Japan2d ago
-
AI Pipelines | AWS | Amazon EKS | Apache Airflow | Azure AKSOnsite Tokyo Japan | Relocation support | Visa sponsorshipMid-level Full TimeChiba, Japan2d ago
-
AI Pipelines | AWS | Amazon EKS | Amazon SageMaker | Amazon SageMaker PipelinesOn site work Japan | Relocation assistance | Visa sponsorshipMid-level Full TimeKawasaki, Miyagi, Japan2d ago
-
Amazon Web Services | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOn-site work | Relocation assistance | Visa sponsorshipSenior-level Full TimeOsaka, Japan3d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceSenior-level Full TimeKawasaki, Miyagi, Japan3d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceOnsite work | Relocation support | Visa sponsorshipSenior-level Full TimeSaitama, Japan3d ago
-
AWS | Apache Spark | Cloud Security | Cloud platform | Data GovernanceRelocation assistance | Visa sponsorshipSenior-level Full TimeNagoya, Aichi, Japan3d ago
-
AIOps | Artificial Intelligence | Big Data | Big data analytics | CUDASenior-level Full TimeOsaka, Japan3d ago
-
AIEducation | AIOps | Big Data | Big data analytics | CUDAOnsite work | Relocation support | Visa sponsorshipSenior-level Full TimeKawasaki, Miyagi, Japan3d ago
-
AIOps | Big Data | Big data analytics | Cloud Computing | Computer VisionOnsite Tokyo Japan | Relocation assistance | Visa sponsorshipSenior-level Full TimeChiba, Japan3d ago
-
AIOps | Big Data | Big data analytics | CUDA | Computer VisionOnsite work | Relocation support | Visa sponsorshipSenior-level Full TimeNagoya, Aichi, Japan3d ago
-
AIOps | Artificial Intelligence | Big Data | Big data analytics | CUDAInternational projects | Onsite work | Relocation support | Visa sponsorshipSenior-level Full TimeYokohama, Kanagawa, Japan3d ago
-
AIOps | Big Data | Big data analytics | CUDA | Computer VisionOnsite work Japan | Relocation support | Visa sponsorshipSenior-level Full TimeSaitama, Japan3d ago
-
AI Pipelines | AWS | Airflow | Amazon EKS | Azure AKSJapanese language proficiency support | On site work Tokyo Japan | Relocation support | Visa sponsorshipMid-level Full TimeSaitama, Japan3d ago
-
AI Pipelines | AWS | Airflow | Amazon EKS | Azure AKSOn site Tokyo work | Visa sponsorshipMid-level Full TimeYokohama, Kanagawa, Japan3d ago
-
AI Pipelines | AWS | Airflow | Amazon EKS | Amazon SageMakerOn site Tokyo Japan | Relocation assistance | Visa sponsorshipMid-level Full TimeTokyo, Kantō, Japan3d ago
-
AKS | AWS | Airflow | CI/CD | Cloud platformBusiness level Japanese proficiency | Onsite work in Tokyo Japan | Relocation assistance | Visa sponsorshipMid-level Full TimeNagoya, Aichi, Japan3d ago
-
AI Pipelines | AWS | Amazon EKS | Amazon SageMaker | Apache AirflowOn site work Japan | Relocation support | Visa sponsorshipMid-level Full TimeOsaka, Japan3d ago
-
AWS | Cloud platform | Data Lake | Data Lakehouse | Data WarehouseOn site in Tokyo Japan | Relocation assistance | Visa sponsorshipEntry-level Full TimeNagoya, Aichi, Japan3d ago
-
AWS | Cloud platform | Data Lake | Data Warehouse | DatabricksOn site work Tokyo Japan | Relocation support | Visa sponsorshipEntry-level Full TimeKawasaki, Miyagi, Japan3d ago
-
AWS | Cloud platform | Data Lake | Data Lakehouse | Data TransformationOn-site work | Relocation support | Visa sponsorshipEntry-level Full TimeOsaka, Japan3d ago