Skip to main content
view looking downstreet as cars and pedestrians are glowing green
Robotics Institute researchers have shown that computer vision systems can detect objects in motion more easily than objects at rest. The research could help computers and robots better automatically detect objects in videos.

바카라 온라인 추천 Computer Vision Researchers Use Motion To Discover Objects in Videos

바카라 온라인 추천 leads collaborative effort sponsored by Toyota Research Institute

Media Inquiries
Name
Aaron Aupperlee
Title
School of Computer Science
Name
Peter Kerwin
Title
University Communications & Marketing

Researchers at 온라인바카라's have shown that computer vision systems can more easily detect objects in motion — like a car driving down the street or a person walking in a crosswalk — than stationary objects.

, dean of 바카라 온라인 추천's School of Computer Science and a professor in the Robotics Institute, and robotics Ph.D. student collaborated on the project with Toyota Research Institute, which sponsored the work. The research could help computers and robots better automatically detect objects in videos.

Object recognition is fundamental to understanding real-world scenes, so developing motion-guided methods for discovering objects could improve autonomous driving. It could also prove useful for retail robotics, robotic manipulation and robots in the home.

Working with colleagues from Toyota, the University of California, Berkeley, and the University of Illinois Urbana-Champaign, the 바카라 온라인 추천 researchers developed a framework called that enables the computer to identify features of things it sees moving on its own. MoTok then uses these features to reconstruct the object, allowing the computer to discover the object in a way that enables it to find that same object again.

The researchers have since extended the work so the computer can depict these features in a simplified, virtualized fashion. This development enables the computer to better identify high-level features, making it possible for the computer to categorize objects rather than just identifying a particular object.

Visualizing objects comes naturally to people — so naturally, in fact, that vision is hard to introspect.

"We have no awareness of how we do it," Hebert said.

Machine learning advances have helped improve computers' ability to recognize objects, albeit in a way much different than humans. Those methods, however, require tens of thousands of hours of video containing labeled objects. It is laborious, expensive and prone to failures outside the lab.

"Obviously, that doesn't scale," Hebert said.

What is needed is a generalized method that enables computer programs to discover objects in videos on their own, without the need for labels or supervision. As MoTok demonstrates, using motion to guide object discovery is one way of achieving this goal.

"Objects that move are easy to differentiate from static backgrounds," said Bao, who completed the research while interning at Toyota Research Institute. "Movement also can help define an object that has multiple moving parts. A car door might open and close and wheels might spin, but all the parts moving together as the car travels down a street can help computer programs better understand the concept of a car."

The team on MoTok in June at the Conference on Vision and Pattern Recognition. More information about MoTok is available on the .
 

— Related Content —