video understanding

by Synced 2023-05-15 3

Meet VideoChat: Integrating Language and Video Models to Boost Video Understanding

In the new paper VideoChat: Chat-Centric Video Understanding, a research team from Shanghai AI Laboratory, Nanjing University, the University of Hong Kong, and the Chinese Academy of Sciences presents VideoChat, a groundbreaking end-to-end chat-centric video understanding system that leverages state-of-the-art video and language models to improve spatiotemporal reasoning, event localization, and causal relationship inference.

by Synced 2019-10-25 3

AI Research

Google AI Targets Video Understanding With Speedy ‘TinyVideoNet’ and Other Approaches

Google’s latest contribution came last week with “Tiny Video Networks (TVN),” a new method for reducing the runtime of neural networks when analyzing videos that is significantly faster than existing models.

by Synced 2019-08-09 1

AI Research

Google AI & DeepMind Temporal Cycle-Consistency Learning Understands Every Video Frame

Frame-by-frame fine-grained labeling is however a time-consuming task. To tackle this problem, researchers from Google AI and DeepMind have introduced a novel self-supervised learning method called Temporal Cycle-Consistency Learning (TCC).

by Synced 2017-11-07 0

Research United States

Video Understanding is a New Vista for AI

The success AI has achieved in image recognition has prompted tech companies to explore the new field of video understanding, in which machines are trained to answer questions like “Who is in this video?” or “What are the cats in the video doing?”