Lead Software Engineer - Machine Learning Platform
Palo Alto, CA, United States
USD 170K-195K (estimate) Senior-level Full Time
Tasks
- Automate ML code build test release and deployment workflows
- Build and operate training infrastructure on Kubernetes
- Design end to end ML training platform
- Enable LLM training and fine tuning workflows
- Implement training observability metrics logs dashboards alerting
- Improve ML developer experience with CI CD templates documentation
- Lead team adoption of secure validated engineering practices
- Optimize GPU training workloads
- Profile and optimize training performance stability
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Alerting | Argo Workflows | Artifact management | CI/CD | CUDA | Caching | Checkpointing | CloudWatch | DDP | Dashboards | Dask | Data Sharding | Deep learning | DeepSpeed | Distributed Training | Docker | EC2 | ECR | EKS | FSDP | Fine Tuning | GPU Profiling | GPU Telemetry | IAM | Kubernetes | LLM | Logging | Machine Learning | Metrics | Mixed Precision | Model Registry | Observability | Parquet | Prefetching | PyTorch | Python | Ray | Reproducibility | Resource Management | S3 | Secure Coding | Spark | Supervised Fine Tuning | TensorFlow | Test automation | VPC | Version control | WebDataset
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Senior-level Full TimeAnnapolis Junction, United States R2h ago
-
Mid-level Full TimeBedminster, United States2h ago
-
Software Engineer, Parallel Scientific Computing USD 130K-190KBenchmarking | C++ | CUDA C++ | Computer Architecture | High PerformanceEntry-level Full TimeRedwood City2h ago
-
Software Engineer, Scientific Computing USD 130K-190KCUDA | Inverse problems | Numerical Methods | Performance optimization | PythonEntry-level Full TimeRedwood City2h ago
-
Entry-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2h ago
-
Palantir Engineer - AI and Data Science Engineer III USD 131K-218KArtificial Intelligence | Data Engineering | Data Modeling | Data Pipelines | Data TransformationActive secret clearanceSenior-level Full TimeHuntsville, Alabama, United States3h ago
-
Data Engineer III USD 124K-207KAmazon Web Services | Apache Spark | Cloud platform | Databricks | Google CloudAbility to obtain security clearance | Professional developmentSenior-level Full TimeRosslyn, Virginia, United States3h ago
-
Senior Data Engineer USD 179K-318KAI/ML | Apache Airflow | Big Data | Data Deduplication | Data MatchingHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Chantilly4h ago
-
Agent Evaluation & Evolution Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer USD 162K-316KAutomation | Benchmarking | Data Analysis | Language Models | Language ProcessingCareer development workshops | Hands-on projects | Industry exposure | Social eventsEntry-level InternshipSan Jose, California, United States4h ago
-
Visual Generation & Multimodal Evaluation Machine Learning Engineer Graduate (AML-Ark-US) - 2027 Start USD 128K-256KAutomated metrics | Computer Vision | Data Engineering | Data Pipelines | Deep learningEntry-level Full TimeSan Jose, California, United States4h ago
-
Visual Generation & Multimodal Evaluation Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer USD 153K-300KComputer Vision | Data Pipelines | Deep learning | Language Models | Large Language ModelsEntry-level InternshipSan Jose, California, United States4h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start USD 128K-256KAnalytics | Batch Processing | Data Engineering | Data Governance | Data LakeEntry-level Full TimeSan Jose, California, United States4h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start (PhD) USD 162K-316KBatch Processing | Data Engineering | Data Governance | Data Lake | Data QualityEntry-level Full TimeSan Jose, California, United States4h ago
-
Autoscaling | Containerd | Disaster Recovery | Docker | FinOpsEntry-level Full TimeSan Jose, California, United States4h ago
-
Autoscaling | Cluster scheduling | Container Runtime | Cross cluster | Cross-cluster schedulingEntry-level Full TimeSan Jose, California, United States4h ago
-
Autoscaling | Cluster scheduling | Container Runtime | Cross cluster | Cross-cluster schedulingEntry-level Full TimeSan Jose, California, United States4h ago
-
Autoscaling | Container Runtime | Disaster Recovery | FinOps | GPU UtilizationEntry-level InternshipSan Jose, California, United States4h ago
-
Autoscaling | Cluster management | Containerd | Disaster Recovery | DockerEntry-level InternshipSan Jose, California, United States4h ago
-
Autoscaling | Cluster management | Container Runtime | Disaster Recovery | ElasticityEntry-level InternshipSeattle, Washington, United States4h ago
-
Autoscaling | Cluster scheduling | Container Runtime | Cross cluster | Cross-cluster schedulingEntry-level Full TimeSeattle, Washington, United States4h ago
-
Autoscaling | Container Runtime | Disaster Recovery | Fair Sharing | FinOpsDevelopment workshops | Hands-on experience | Industry exposure | Learning programs | Social eventsEntry-level InternshipSeattle, Washington, United States4h ago
-
Autoscaling | Container Runtime | Disaster Recovery | Docker | ElasticityEntry-level Full TimeSeattle, Washington, United States4h ago
-
Autoscaling | Container Runtime | Disaster Recovery | FinOps | KubernetesEntry-level Full TimeSeattle, Washington, United States4h ago
-
Agent Evaluation & Evolution Machine Learning Engineer Graduate (AML-Ark-US) - 2027 Start USD 121K-243KBenchmarking | Data Pipelines | Fine Tuning | Human evaluation | LLM EvaluationEntry-level Full TimeSeattle, Washington, United States4h ago
-
Agent Evaluation & Evolution Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer USD 162K-316KBenchmarking | Data Analysis | Deep learning | Language Models | Language ProcessingDevelopment workshops | Industry exposure | Learning programs | Social eventsEntry-level InternshipSeattle, Washington, United States4h ago