AI Tooling Engineer

Palo Alto, California

Luma AI

Luma AI, building the next generation of Creative Intelligence.

View all jobs at Luma AI

Apply now Apply later

We are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.

We're looking for full stack engineers who are passionate about AI tooling, have a strong product sense, and enjoy working at the intersection of research and usability. You'll be part of Luma's applied research team and build interfaces, pipelines, and services that bring the latest model capabilities directly into the hands of creators.

🧠 A Day in the Life

In the morning, you tweak a prototype interface used to test a new spatial-control feature for video generation — hooking it into an inference service you helped build last week.

After a quick sync with the Research team, you jump into a session with Technical Art to refine the UI for LoRA training on a stylized dataset.

By afternoon, you’re wiring up a ComfyUI extension to support a new model architecture. You close the day by reviewing feedback from a design partner who used your tool in a client demo.

🔨 What You’ll Do

  • Build web-based tools and UIs that make advanced model behavior feel intuitive and usable

  • Design and implement pipelines for model training, fine-tuning (e.g., LoRA), and real-time inference

  • Collaborate with Research and Technical Art teams to prototype new workflows grounded in evolving model capabilities

  • Extend and integrate open-source frameworks like ComfyUI to fit internal and client-specific use cases

  • Contribute to both internal experimentation tooling and external-facing production features

  • Support productization efforts for enterprise and B2B applications involving multimodal AI

🧩 You Might Be a Fit If…

  • 5+ years of experience in software engineering, ideally across both backend and frontend systems

  • Strong Python and JavaScript/TypeScript skills; fluency in modern web frameworks (e.g., React, Next.js)

  • Familiarity with ML pipelines and GPU-based compute (e.g., PyTorch, ffmpeg, SLURM/Kubernetes)

  • Experience with training and deploying models (LoRA, ControlNet, diffusion models a plus)

  • Passion for building usable, elegant tools for technical artists, researchers, or creative professionals

  • Bonus: experience shipping tools that sit between R&D and production, or serve external creative clients

💡 Bonus Points

  • Experience with LoRA, ControlNet, or real-time AI media generation

  • Tools that shipped between R&D prototypes and production-quality software

  • Interfaces or systems that helped non-engineers leverage AI models creatively

🌍 Why Join our Applied Research team?

  • Work on frontier multimodal models — and build the tools that make them real

  • Collaborate with an exceptional team of engineers, researchers, and technical artists

  • Shape the future of how humans interact with generative AI — not just inside Luma, but out in the world

  • Contribute at the boundary of research, product, and creativity — with real user impact

Apply now Apply later
Job stats:  0  0  0

Tags: Architecture ComfyUI ControlNet Diffusion models Engineering Generative AI GPU JavaScript Kubernetes LoRA Machine Learning Model training Open Source Pipelines Python PyTorch R R&D React Research TypeScript

Regions: Remote/Anywhere North America
Country: United States

More jobs like this