Automatic generation of music slide show using personal photos

Xu Songhua, Jin Tao, C. M.Lau Francis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Scopus citations

Abstract

We present an algorithmic system capable of automatically generating a music slide show given a piece of music with lyrics. Different from previous approaches, our method generates slide shows using personal photos which are without annotation. We introduce a novel algorithm to infer the relevance of personal photos to the lyrics, based on which personal photos are optimally selected to match the music. The proposed system first detects the keyframes of the input music. For each music keyframe, it optimally selects an image from the personal photo collection via our image content analysis procedure. Once the keyframe images have been selected, the in-between frames are then generated via an image morphing process. Experiment results have shown that our method can successfully generate music slide shows which follow the rhythms of the music and at the same time match the lyrics.

Original languageEnglish (US)
Title of host publicationProceedings - 10th IEEE International Symposium on Multimedia, ISM 2008
Pages214-219
Number of pages6
DOIs
StatePublished - 2008
Externally publishedYes
Event10th IEEE International Symposium on Multimedia, ISM 2008 - Berkeley, CA, United States
Duration: Dec 15 2008Dec 17 2008

Publication series

NameProceedings - 10th IEEE International Symposium on Multimedia, ISM 2008

Other

Other10th IEEE International Symposium on Multimedia, ISM 2008
Country/TerritoryUnited States
CityBerkeley, CA
Period12/15/0812/17/08

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Automatic generation of music slide show using personal photos'. Together they form a unique fingerprint.

Cite this