Research Engineer for 3D Generative AI (Visual Geometry and Computer Graphics)

Key Skills

3D Graphics, Aartificial intelligence, Algorithms, C++, Computer Graphics, CUDA kernels, Deep Learning, Effective communication skills, High performance computing- HPC, Python Programming

Job Description

Sony Research is seeking a Research Engineer for 3D Generative AI (Visual Geometry and Computer Graphics). In this role, you will be responsible for developing Foundation Models for 3D applications and driving technological advancements for downstream applications. Collaborating with Sony's business companies and studios in video games, movies, Anime, music, sensing, and creator solutions, you will contribute to creating cutting-edge Foundation Models and Generative AI with a significant impact on the world. We are looking for a research engineer well-versed in various 3D representations, including visual geometry, computer graphics, neural fields, mesh, point cloud, and their rendering techniques. This position will bridge the gap between the rapidly evolving field of generative AI and the crucial world of 3D in visual production, including games, movies, music videos, and animation.

Responsibilities

• Research and develop novel deep generative algorithms and techniques for various 3D representations, such as visual geometry, computer graphics, neural fields, mesh, and point cloud, along with their rendering techniques.
• Contribute to the development of Foundation Models for 3D applications and explore ways to utilize them effectively in downstream applications.
• Collaborate with cross-functional teams to integrate Foundation Models into visual production applications, optimizing them for real-world scenarios.
• Implement and optimize algorithms using Python and relevant tools, leveraging your research, coding, and problem-solving skills.
• Stay up-to-date with the latest advancements in the field of 3D generative AI and actively contribute to the research community through publications and presentations.
• Collaborate closely with the research team, sharing knowledge, insights, and actively participating in collaborative projects.

Required Qualifications

• Ph.D. in Computer Science, Electrical Engineering, Applied Mathematics, or related fields, or demonstrated expertise and a record of relevant scientific publications in the field of visual geometry or computer graphics.
• Strong knowledge of visual geometry, computer graphics, neural fields, mesh, point cloud, and their rendering techniques.
• Proficiency in Python programming and experience with deep learning frameworks such as PyTorch, as well as 3D processing tools.
• Experience in analyzing and processing 3D data for research and development purposes.

Preferred qualifications

• Familiarity with generative models, such as diffusion models and autoregressive models, used in the field of generative AI.
• Industry experience in the field of generative AI, visual geometry, or computer graphics.
• Familiarity with the entertainment industry and its workflows, including video games, movies, Anime, and music production.
• Proven experience collaborating with cross-functional teams and working in an international environment.
• Excellent communication skills in English, both written and verbal.
• Extensive coding and software engineering experience with a strong focus on writing high-performance and maintainable code and software. Proficient in languages such as Python, C++, and CUDA. Familiarity with HPC (distributed computing) and ServerAdmin.
• Experience utilizing digital content creation GUI tools like Unreal Engine, Unity, and Blender, including plugin development.