Staff ML Engineer, Generative Model Performance & Efficiency
Mountain View, California, United States, New York City, New York, United States
USD 251K-310K Senior-level Full Time
Tasks
- Analyze model architectures for training performance bottlenecks
- Build performance profiling and debugging tools
- Design low latency high throughput serving systems
- Develop quantization and model compression techniques
- Implement model partitioning and sharding strategies
- Optimize model code for TPUs and GPUs
- Optimize training and inference performance
Perks/Benefits
- N/A
Skills/Tech-stack
Data parallelism | Diffusion Models | Efficient Attention | Expert parallelism | Flax | GPU | High Throughput | JAX | Knowledge Distillation | Low Latency | Low-latency serving | Mixture of Experts | Model Compression | Model partitioning | NVIDIA Nsight | Perfetto | Pipeline parallelism | Pruning | PyTorch | Python | Quantization | TPU | Tensor Parallelism | TensorFlow | Transformers | XLA | Xprof
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R12d ago
-
Senior-level ContractRaleigh, United States2h ago
-
SYSTEM ENGINEER - Computer Network Support - AI/ML - 6+ yrs of Experience - TS/SCI w/Poly clearance is required - ES - 032726-2 A USD 136K-140KAI/ML | Agile | Confluence | Jira | LLM401k retirement plan | Dental insurance | Disability insurance | Federal Holidays | Floating holidaysMid-level Full TimeFort George G Meade, United States2h ago
-
AI experimentation | Alerting | Artificial Intelligence | Data Annotation | Data ArchitectureSenior-level Full TimeNew York3h ago
-
Software Engineer - TikTok AI Search Infrastructure USD 212K-389KAlgorithm Design | C++ | DAG | Data Architecture | Data ProcessingSenior-level Full TimeSan Jose, California, United States4h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 78K-176KAPIs | Agile methodologies | Backend Development | Cloud Computing | Data Preparation401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, VA, US R5h ago
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | DashboardingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …5h ago
-
AI/HPC Network Performance Engineer USD 147K-226KAI Training | Alerting | Auto-remediation | C++ | Configuration ManagementOncall rotationSenior-level Full TimeMenlo Park, CA5h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-253KAPI Integration | Agent systems | Agentic Workflows | Chatbots | Cloud platformBenefits | Bonus | Equity | Travel up to 50 percentSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …5h ago
-
Research Software Engineer, Multimodal AI USD 174K-253KAgent Orchestration | Audio | C++ | Few-Shot Learning | Few-shotMid-level Full TimeSan Jose, CA, USA5h ago
-
ML Engineer, GenAI Ads, Search Personalization USD 207K-301KC++ | Clustering Algorithms | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeMountain View, CA, USA5h ago
-
Senior Software Engineer, AI/ML, Geo and Gemini App USD 174K-253KA/B | A/B Testing | B testing | C++ | Data AnalysisSenior-level Full TimeNew York, NY, USA5h ago
-
Senior Software Engineer, AI/ML, Ads Training USD 174K-253KC++ | Distributed Systems | GPU | JAX | Machine LearningSenior-level Full TimeMountain View, CA, USA5h ago
-
Principal Machine Learning Engineer, Content Safety USD 295K-345KComputer Vision | Content Moderation | Data Pipelines | Deep learning | Language ModelsEquity compensationSenior-level Full TimeSan Mateo, CA, United States R10h ago
-
Software Engineer, Product USD 208K-269KAgentic Frameworks | Anthropic | Claude Code | Cursor | DocumentationDental insurance | Health insurance | Paid time off | Retirement plan | Vision insuranceMid-level Full TimeSan Francisco, CA10h ago
-
C++ | Containers | Distributed Systems | Distributed Training | Distributed inferenceSenior-level Full TimeCupertino11h ago
-
Senior-level Full TimeUnited States12h ago
-
Lead Software Engineer - Applied AI ML Lead USD 170K-195KApache Airflow | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePalo Alto, CA, United States14h ago
-
Data Analysis | Data Visualization | GenAI | Java | Jupyter NotebookSenior-level Full TimeCupertino15h ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States16h ago
-
Principal AI Engineer USD 200K-245KAgent-based | Agent-based architecture | Amazon Web Services | Azure | CI/CD5 days per week | Collaborative culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States16h ago
-
Machine Learning Engineer, Sensor Pipelines USD 175K-215KC++ | Computer Vision | JAX | Machine Learning | PyTorchHybrid work scheduleMid-level Full TimeMountain View, CA, USA16h ago
-
AI Engineer (Temporary) USD 85K-95KAWS | Agents SDK | Anthropic API | Azure | Data RiskAccess to training and enablement resources | Hybrid work environment | Temporary contract with benefitsEntry-level Full Time TemporaryIthaca (Main Campus), United States16h ago
-
Principal Embedded Software Engineer - OS Build USD 152K-229KArtifactory | BSP | Bamboo | Bash | BitbucketSenior-level Full TimeUSA-CO Lafayette Bldg 2, United States16h ago
-
Mission Planning and Optimization Engineer USD 110K-165KAstrodynamics | C# | C++ | Combinatorial Optimization | Decision Making401k matching | Education assistance | Paid Holidays | Relocation assistance | Sick timeSenior-level Full TimeEl Segundo, United States16h ago