PhD Research Intern - Vision Language Models (Fall 24)

Join the Innovators in Entertainment Technology – Dolby U Internship Program

Step into the forefront of entertainment innovation with Dolby Laboratories. Our Dolby U internship program offers a transformative, project-driven work experience in a dynamic, creative setting. Collaborate directly with industry leaders to implement real-world solutions that redefine communication and revolutionize entertainment creation, delivery, and enjoyment on a global scale.

At Dolby, you'll discover a collegial culture, challenging projects, and comprehensive compensation and benefits. Enjoy the ultimate in flexibility with our Flex Work policy, designed to support where, when, and how you do your finest work. If you're a student eager to gain invaluable expertise through meaningful contributions, join us in shaping a future where technology seamlessly intersects with entertainment.

About the Advanced Technology Group (ATG)

The Advanced Technology Group (ATG) is Dolby’s cutting-edge research division. ATG's mission is to pioneer, provide insights, and innovate technological solutions that fuel our company's continuous growth. Our experts specialize in various fields including AI/ML, algorithms, digital signal processing, audio engineering, image processing, computer vision, data science & analytics, distributed systems, cloud, edge & mobile computing, computer networking, and IoT.

Role Overview: Research Intern – Vision Language Models

As a Research Intern focusing on Vision Language Models at Dolby, you'll engage with cutting-edge vision language technologies. Under the mentorship of Dolby’s leading media technology experts, you'll tackle real-world vision language challenges, aiming to generate customized textual output based on contextual visual, textual, and other modalities for advanced multimedia entertainment experiences.

This role is based out of our research office in Sunnyvale, California.

Candidate Requirements

We're searching for current PhD students with expertise in vision language models, particularly for video analysis, understanding, question answering, and/or text generation. Candidates should have completed at least one year of their doctoral program. Ideal candidates will possess strong technical skills, problem-solving abilities, excellent communication and collaboration skills, an inquisitive mindset, and a passion for video or natural language technology. A desire to innovate and learn from others is essential.

Key Focus Areas

• Vision language models for content analysis and generation (video and/or text).
• Video content analysis, understanding, and information retrieval.
• Text generation using large language models (LLM) or multimodal LLM based on visual, textual, and other modalities.

Essential Qualifications

• PhD student in Artificial Intelligence, Electrical Engineering, Computer Science, or a related field.
• Proven track record in vision language research, AI, or data analysis with demonstrated results through projects, prototypes, patents, and peer-reviewed publications.
• Experience as a researcher (internships, full-time roles, or lab work).
• Proficiency in Python and PyTorch.

Highly Desired Experience

• Creating demos and prototypes for research applications.
• Developing vision language models for image/video analysis, understanding, captioning, question answering, or text generation.
• Experience in fine-tuning multimodal LLMs and/or multimodal foundation models.
• Writing technical reports and/or publications.
• First-author publications in peer-reviewed conferences or journals.

Application and Eligibility Information

We review applications on a rolling basis. Submit your application by June 28, 2024, for timely consideration.

Eligible candidates must be enrolled in a doctoral program in Computer Science, Electrical Engineering, Computer Engineering, or a related field. You should be available to work full-time, Monday – Friday, for 12 weeks from September 2024 – December 2024. The internship start date is Monday, September 23, 2024 (non-flexible).

The San Francisco/Bay Area base hourly range for this internship is $44-57/hr. This range may vary based on location. Individual pay is determined by various factors including job-related skills, experience, and relevant education or training. Your recruiter will provide more insight into the specific hourly range and associated perks and benefits for your location during the hiring process.

Equal Employment Opportunity

Dolby is an Equal Opportunity Employer. Our success hinges on the diverse skills and talents of