Mitsubishi Electric Research Laboratories
Internship - Multimodal Instruction and Video Synthesis
At a glance
- Education
- PhD required
- Length
- 13 weeks
- Preferred major(s)
- Computer VisionMachine Learning
- Preferred skills
- Generative AI & LLMsCADMachine learningPhysics simulation software
- Relocation
- "Interns receive a relocation stipend"
Listing details
About the job
Internship - Multimodal Instruction and Video Synthesis
We are seeking a highly motivated intern to conduct original research in generating multimodal instructions for tasks such as assembly, machine operation, and maintenance. The successful candidate will collaborate with MERL researchers in the design, implementation, and experimentation of novel methods for producing high-quality instructional manuals from operational video sequences, as well as synthesizing instructional videos from multimodal manuals. The candidate should be a PhD student (or recent graduate) in computer vision and machine learning with a strong publication record, including at least one paper in a top-tier computer vision or machine learning venue such as CVPR, ECCV, ICCV, ICML, ICLR, NeurIPS, AAAI, or TPAMI. Strong programming skills, experience developing and implementing new models, and broad knowledge of machine learning and deep learning methods are expected, including experience training foundation models. The start date is flexible; the duration should be at least three months.
Required Specific Experience
- Experience with 3D modeling tools for CAD data, physics simulators, and foundation models
- Experience in video analysis and synthesis, including using diffusion models
- At least one paper in a top-tier computer vision or machine learning venue such as CVPR, ECCV, ICCV, ICML, ICLR, NeurIPS, AAAI, or TPAMI.
- Ph.D. student in computer vision or a related field.
The pay range for this internship position will be 6-8K per month.
Research Areas
- Artificial Intelligence, Computer Vision, Machine Learning
Host
- Anoop Cherian
Interns receive a relocation stipend, covered travel to and from MERL, and a monthly Charlie Card for local commuting. Interns are invited to participate in weekly social gatherings and professional development opportunities, including research talks by both internal and external speakers. Interns who meet the 90-day waiting period are also eligible for health insurance coverage. MERL provides immigration support for qualified candidates as needed.