Intern, Algorithm Research in AR/VR Applications

Description:      

We are currently looking for interns with solid Electrical Engineering and Computer Science backgrounds who would be interested in exploring the applications of imaging & sensing, computer vision, machine learning, computer graphics, 3D reconstruction and rendering in developing advanced visual computing techniques for AR/VR applications.

 Responsibilities and opportunities to gain experience:

• Explore and develop optimization-based and deep learning-based (e.g., DNN, GAN, and Transformer) computer vision and video processing algorithms for AR/VR applications.

• Explore and develop model-based and deep learning-based human representation, reconstruction, synthesis, and rendering for AR/VR applications

• Research topics include the following. Research scope can be decided according to your experiences, work period, and interests.

o   Multimodal multi- sensor or multi-camera auto-calibration for camera pose estimation

o   Multimodal multi- sensor or multi-camera human body, hand, and face detection and tracking

o   Real-time human and scene reconstruction using 3D gaussian splatting or neural rendering

o   Deep learning‑based photo‑realistic character pose manipulation

o   Deep learning‑based gaze and head redirection model

o   Depth sensing, estimation, and 3D reconstruction

o   Multi-view vision and 3D perception enhancement

• Deliver algorithms and publishable results when finishing intern period with feasible SW / HW implementation in real products or services preferred.

• Collaborate with fellow camera / computer vision / graphics / machine learning research engineers on a regular basis.

 Prefer candidates with multiples of the following qualifications:

• Deep knowledge and hands-on experience in one of the areas of computer vision, AR/VR, 3D modeling in mesh / point cloud, graphic rendering, or video processing algorithms.

• Knowledge and hands-on experiences with ML algorithms and familiarity with ML implementation environments and platforms such as PyTorch (including NumPy, SciPy) and/or Tensorflow is a plus.

• Strong programming skills in python or C / C++ for Windows and/or Linux is required.

• Experience with OpenCV or OpenGL is a plus.

• Experience in working with prototype development and open-source software frameworks is a plus.

• Well organized, detail-oriented team player.

• Good verbal and written communication skills.

• Ph.D. or M.S. in Electrical Engineering or Computer Science or closely related majors.