Research Intern – Multimodal Foundation Model for Vision

Sony • Los Angeles, MA

96d • $50

About The Position

Sony AI America, a branch of Sony AI, is a remotely distributed organization spread across the U.S. and Canada. Sony AI is Sony’s new research organization pursuing the mission to use AI to unleash human creativity. Sony AI works closely with Sony’s other business units, including Sony Interactive Entertainment LLC., Sony Pictures Entertainment Inc., and Sony Music Entertainment. With some 900 million Sony devices in hands and homes worldwide today, a vast array of Sony movies, television shows and music, and the PlayStation Network, Sony creates and delivers more entertainment experiences to more people than anyone else on earth. To learn more: https://ai.sony/. Research Intern – Multimodal Foundation Model for Vision Sony AI is seeking research interns to join us. Our team mainly focuses on fundamental and applied research, with a focus on building next-generation foundation models for vision in a responsible manner. The role of a research intern is to develop efficient and effective methodologies and prototype solutions. You will work with a productive team of world-class scientists and engineers to tackle the most challenging problems in foundation models and generative AI, including low-cost yet powerful vision foundation models (VFM), vision-language models (VLM), unified models, automatic model compression, optimization and deployment on cloud and edge. You will see your ideas not only published in papers, but also improve the experience of billions of customers.

Requirements

• Currently has, or is in the process of obtaining, a master/PhD degree in computer science or related field.
• Be very self-motivated and capable of proposing and implementing innovative ideas.
• Solid presentation and communication skills to internal and external audiences.
• Publications or expertise in compact foundation model development and deployment.
• Influential open-source projects or paper publication at top conferences, e.g., CVPR, ICCV, ECCV, NeurIPS, ICML, ACL, etc.
• Better to have front-end development experience.
• Solid coding skills in Python, Pytorch, etc.

Responsibilities

• Conduct fundamental and innovative development in low-cost yet powerful vision-language models (VLM), unified models, automatic model compression, optimization and deployment on cloud and edge.
• Design or implement state-of-the-art techs on model compression, inference speedup, deployment on hardware, tool automation.
• PoC for various vision+text, generation relevant tasks (VQA, captioning, understanding, etc) and hardware.
• Contribute to library and tool development to support business; or Publish influential research in top-tier conferences and journals.

Benefits

• The target hourly rate for this internship is $50.00 per hour.
• The individual will be paid hourly and eligible for overtime.

What This Job Offers

• Career Level: Intern
• Education Level: Master's degree
• Number of Employees: 101-250 employees