The SLIC Browsing System
   
(Demo)
|
| Project Description |
You are visiting the webpage of the SLIC (Semantically Linked Instructional Content ) project. This project aims to assist students and scholars efficiently browse and seek segments of interest in educational videos of lectures and talks. In particular, it focuses on lectures that use slides, where the content of the slides file gives valuable hints as to how to break the video into meaningful parts (segments), and how to enable students to access these segments. In this way, a student who is seeking a specific topic in the video of a lecture(s) can first find the relevant slide(s), and start watching the video only from the segment(s) where this slide was used. Using similar ideas, the system can also improve significantly the understandability of the video, improve its quality, and increase the overall effectiveness of the learning process. |
| About the Demo |
In this link you can find a demo of our system. This demo is currently password-protected. Please email Alon Efrat and he will send you the password. |
| Algorithmic Overview |
This demo contains several talks. In each frame of the videos, the system will
find the slide that is most likely to appear in the frame. This required the
use of non-trivial stochastic models and pattern matching, since slides may be
similar, but in some of the frames, only part or none of the slide is shown,
slides sometimes appear very blurry in the videos etc. In the demo you can
also see the effect of segmenting the videos based on slides, versus the effect
of segmenting the video based on changes in the flow of images only
(shot-boundary detection). fonts are generally clearly read.
|
| Collaborations | The project is the result of a joint work of academia and industry. In particular, it is resulted of a collaboration between the Computer Science Department, KUAT and the MIS department in the Eller College of Management, all at the University of Arizona, and Almaden IBM Research Center. |
| Personal | (in alphabetic order) Arnon Amir (IBM) Kobus Barnard Joe Chitwood (KUAT) Alon Efrat Quanfu Fan Sandiway Fong Ming Lin Ranjini Swaminathan Mohan Tanniru Juhani Torkkola Andrew Winslow |
| Publications |
Quanfu Fan, Kobus Barnard, Arnon Amir, Alon Efrat, and Ming Lin. "Matching
Slides To Presentation Videos Using SIFT and Scene Background Matching", 8th
ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR) ,
Santa Barbara, October 26-27. 2006.
(PDF) Quanfu Fan, Arnon Amir, Kobus Barnard, Ranjini Swaminathan, Alon Efrat, "Temporal modeling of slide change in presentation videos," International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2007 (PDF) . |
| Acknowlegements | This project would not exist without the help of the Arizona Center for Information Science and Technology (ACIST). We also want to thank IBM Research for the CueVideo Toolkit. |