Research Intern – 3D/4D Generation and Perception Foundation Model Research

Sony AI is looking for research interns to join our 3D/4D Foundation Model team. Our team emphasizes both fundamental and applied research, aiming to develop 3D/4D generation and perception model. As a research intern, you will engage in cutting-edge research, create methodologies, design, and prototype solutions. You will collaborate with a dedicated team of scientists and engineers to address complex challenges in 3D/4D foundation models and generative AI, such as object asset generation, scene generation, character generation, and video generation. Additionally, you may have the opportunity to collaborate with Sony's entertainment divisions in gaming, movies, music, and anime.

You will:

• Conduct fundamental and innovative research in 3D/4D generation and perception models, including but not limited to architecture design and methodology design.

• Be self-motivated and capable of proposing and implementing innovative ideas.

• Deep understanding of 3D/4D foundation model development and various applications, such as object asset generation, scene generation, character generation, and video generation.

• Write reports and give presentations to internal and external audiences.

• Contribute to library and tool development to support research and business.

• Publish influential research outcomes in top-tier conferences and journals.

Topics of interest:

• Multi-View Diffusion

• Feedforward/Large Reconstruction Models

• 3D-aware/Controllable Video Generative Models

• Multimodal Generation: joint/conditional generation with sound, music, etc.

• Diffusion Transformers (DiT)

• Gaussian Splatting and other 3D Representations and Rendering Techniques

• LLMs for 3D/4D

• High-Performance Computing (HPC) and software skills for large-scale training

You will bring:

• Currently has, or is in the process of obtaining, a master's/PhD degree in computer science or a related field.

• Publications or expertise in computer vision and generative AI applications (e.g., object asset generation, scene generation, character generation, video generation), multi-view diffusion, large reconstruction models, diffusion transformers, large-scale training, etc.

• Ability to communicate research in a clear and precise manner.

• Excellent analytical and programming skills in large-scale deep learning.

• Familiar with Python, PyTorch, etc.

• Experience with research communities, including having published papers at conferences, e.g., CVPR, ICCV, ECCV, SIGGRAPH, NeurIPS, ICLR, ICML, etc.

• Strong communication and presentation skills.

Your new office:

Surrounded by Swiss Alps, the Schlieren office is at the doorstep of Zurich, which is consistently voted in top three best cities to live. The city benefits from a very rich ecosystem where prestigious universities, research institutes, companies and organizations collaborate for the development and design of next generation technologies. Our office is very well connected with public transports (train, tram, bus) and located in a very modern and bright building. We have several enjoyable break rooms as well as a terrace which we use for regular social team events or as a casual working area. Our team is unique and international, representing engineering and sales/marketing functions, which creates this unique and passionate Sony Swiss DNA.

Life at Sony AI:

Our work environment is diverse and motivated with an innovative open mindset. Sony AI is committed to building a diverse team of people with different characters, stories and skillsets because we know this drives innovation and creativity. Our commitment to nurturing a friendly and supportive place of work where everyone has a sense of belonging and inclusion creates an atmosphere of learning and personal growth. We focus on achieving healthy work-life balance for our teams, supported by hybrid and flexible working.

You will work on exciting projects at the cutting edge of AI that are in the realms of entertainment or for the betterment of society, and you will have access to the most innovative technologies from across the Sony universe and the opportunity to partner with Sony’s leading companies.

When projects are finished, we publish our work, and all our contributors are recognised on research pieces, at top-tier conferences, and in journals. You will also have access to workshops and development programs to expand your knowledge and skills. We want you to drive your career, find your direction and take authorship of your personal story at Sony AI, while enjoying the security and the resource-rich environment that comes with being part of a global corporation that has R&D in its DNA.

Bring your uniqueness to Sony:

We are passionate about creating a culture that promotes equity and cultivates inclusion, diversity, and belonging. We want employees with diverse backgrounds and perspectives that will stimulate innovation and have a direct impact on our creation of social value to fulfil Sony’s purpose – ‘to fill the world with emotion, through the power of creativity and technology’. We want you to bring your unique self to work and help shape our culture.

Equal Opportunity:

Sony Europe is an Equal Opportunity Employer. All qualified applicants will receive equal consideration for employment regardless of race, colour, religion, gender, citizenship, ancestry, age, physical or mental disability, sexual orientation, gender identity, medical condition, or any other protected characteristics.

Disability Accommodation for Applicants to Sony Europe

Sony Europe will provide reasonable accommodation for any qualified individuals with disabilities in the application process. For reasonable accommodation requests, please contact us by email at AccommodationRequest@eu.sony.com or by mail to: Sony Europe B.V, Human Resources Department, the Heights, Brooklands, Surrey, KT13 0XW, UK. When contacting us please indicate the position you are applying for, and the accommodation required.

#LI-MC1