Member of Technical Staff, Image Generation
Union Square, New York City
Full Time Senior-level / Expert USD 175K - 275K
Captions
Meet Captions. The next generation of storytelling -āØat your fingertips. Discover the power of AIāØand create studio-grade videos in just a few taps.Captions is the leading AI video companyāour mission is to empower anyone, anywhere to tell their stories through video. Over 10 million creators and businesses have used Captions to simplify video creation with truly novel and groundbreaking AI capabilities.
We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. As an early member of our team, youāll have an opportunity to have an outsized impact on our products and our company's culture.
Our Technology
Mirage Announcement our proprietary omni-modal foundation model
Seeing Voices (technical paper) generating A-roll video from audio with Mirage
Mirage Studio for generating expressive videos at scale
"Captions: For Talking Videosā available in the iOS app store
Press Coverage
Lennyās Podcast: Interview with Gaurav Misra (CEO)
Latest Fundraise: Series C Announcement
The Information: 50 Most Promising Startups
Fast Company: Next Big Things in Tech
Business Insider: 34 most promising AI startups
TIME: The Best Inventions of 2024
Our Investors
Weāre very fortunate to have some the best investors and entrepreneurs backing us, including Index Ventures, Kleiner Perkins, Sequoia Capital, Andreessen Horowitz, Uncommon Projects, Kevin Systrom, Mike Krieger, Lenny Rachitsky, Antoine Martin, Julie Zhuo, Ben Rubin, Jaren Glover, SVAngel, 20VC, Ludlow Ventures, Chapter One, and more.
** Please note that all of our roles will require you to be in-person at our NYC HQ (located in Union Square)
We do not work with third-party recruiting agencies, please do not contact us**
About the Role
Captions is seeking an exceptional Member of Technical Staff to advance the stateāofātheāart in largeāscale image generation models. Youāll conduct novel research on generative image models for people and storytelling, developing new training techniques and scaling models to billions of parameters and millions of users. As a key member of our AI team, youāll work at the cutting edge of image generation systems that enable natural, expressive, and highāfidelity outputs.
Our team has strong expertise in training largeāscale models with demonstrated research and product impact (see our recent whitepaper here for details of recent work). Weāre especially excited to push the use of image synthesis for multimodal video generation, with a focus on photorealistic quality, professional-grade expressivity, and creative iteration. Our models power tools used by millions of creators, and weāre tackling fundamental challenges in how to generate compelling composition, lighting, and fineāgrained detail across diverse domains.
Key Responsibilities
Research & Architecture Development
Design and implement largeāscale image generation models (transformers, latent diffusion, flow matching, etc.).
Develop new approaches to multimodal conditioning and generation (e.g. audio and video) and controllability (editing, multi-frame consistency, script guidance, etc).
Research advanced imageāediting and -generation techniques such as contentāpreserving edits, multiāinput conditioning, and referenceābased generation.
Establish and validate scaling laws for image diffusion models across resolution and parameter count.
Develop automated evaluation approaches for improved fidelity and consistency.
Drive rapid experimentation with model architectures, sampling strategies, and training strategies.
Validate research directly through product deployment and real user feedback.
Derive insights from data and recommend architectures and training practices that will make meaningful impacts on our products.
Model Training & Optimization
Train and optimize models at massive scale (10sā100s of billions of parameters) across multiānode GPU clusters.
Push the boundaries of efficiency and hardware utilization for training and deploying models in a cost effective manner.
Develop sophisticated distributed training approaches using FSDP, DeepSpeed, MegatronāLM, Triton and custom CUDA kernels where needed.
Design and implement modelācompression techniques (pruning, distillation, quantization, etc.) for efficient serving.
Create new approaches to memory optimization, gradient checkpointing, and mixedāprecision training.
Research techniques for improving sampling speed (DDIM, PFGM++, SDEāVE) and training stability at scale.
Conduct systematic empirical studies to benchmark architecture and optimization choices.
Preferred Qualifications
Research Experience
Masterās or PhD in Computer Science, Machine Learning, or a related field or equivalent practical experience.
Demonstrated experience implementing and improving stateāofātheāart generative image models.
Deep expertise in generative modeling approaches (flow matching / diffusion, autoregressive models, VAEs, GANs, etc.).
Strong background in optimization techniques, sampling, and lossāfunction design.
Experience with empirical scaling studies and systematic architecture research.
Track record of research contributions at top ML conferences (NeurIPS, CVPR, ICCV, ICML, ICLR).
Technical Expertise
Strong proficiency in modern deepālearning tooling (PyTorch, CUDA, Triton, FSDP, etc.).
Experience training image diffusion models with billions of parameters.
Familiarity with large language models or multimodal transformers is a plus.
Deep understanding of attention, transformers, latent representations, and modern imageātext alignment techniques.
Expertise in distributed training systems, model parallelism, and highāthroughput inference.
Proven ability to implement and improve complex model architectures end to end.
Engineering Capabilities
Ability to write clean, modular research code that scales from prototype to production.
Strong softwareāengineering practices including testing, code review, and CI/CD.
Experience with rapid prototyping and experimental design under tight iteration loops.
Strong analytical skills for debugging model behavior, numerical stability, and performance bottlenecks.
Familiarity with profiling and optimization tools (Nsight, TensorBoard, PyTorch Profiler, etc.).
Track record of bringing research ideas to production and maintaining high code quality in a research environment.
About the Team
Youāll work directly alongside our research and engineering teams in our NYC office. Weāve intentionally built a culture where technical innovation and research excellence are highly valued. Your success will be measured by your contributions to improving our models and advancing the field, not by your ability to navigate politics. Weāre a team that loves diving deep into complex technical problems and emerging with practical breakthroughs.
Our Team Values
Open technical discussions and collaboration
Rapid iteration and practical solutions
Deep technical expertise and continuous learning
Direct impact on research and product outcomes
What Sets Us Apart
Opportunity to advance the stateāofātheāart in multimodal video generation
Direct impact on products used by millions of creators
Access to massive compute resources and diverse, largeāscale datasets
Environment that values both research excellence and practical impact
Ability to validate research through direct product feedback
Benefits:
Comprehensive medical, dental, and vision plans
401K with employer match
Commuter Benefits
Catered lunch multiple days per week
Dinner stipend every night if you're working late and want a bite!
Doordash DashPass subscription
Health & Wellness Perks (Talkspace, Kindbody, One Medical subscription, HealthAdvocate, Teladoc)
Multiple team offsites per year with team events every month
Generous PTO policy
Captions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
Please note benefits apply to full time employees only.
Tags: AI video Architecture Autoregressive models CI/CD Computer Science CUDA Diffusion models Engineering FSDP GANs Generative modeling GPU ICLR ICML LLMs Machine Learning Model training NeurIPS PhD Prototyping PyTorch Research Testing Transformers
Perks/benefits: 401(k) matching Career development Conferences Health care Team events Wellness
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.