Apparatus and method for designating various segment classes

Illlllllllllllllllllllllllllllllllllllllllllllllllll

US007304231B2

(12)

United States Patent

van Pinxteren et al.

(io) Patent No.: (45) Date of Patent:

US 7,304,231 B2 Dec. 4, 2007

(54) APPARATUS AND METHOD FOR

DESIGNATING VARIOUS SEGMENT
CLASSES

(75) Inventors: Markus van Pinxteren, Munich (DE);

Michael Saupe, Ilmenau (DE); Markus
Cremer, Ilmenau (DE)

(73) Assignee: Fraunhofer-Gesellschaft zur
Forderung der Angewandten
Forschung Ev, Munich (DE)

( * ) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 U.S.C. 154(b) by 375 days.

(21) Appl. No.: 11/048,693

(22) Filed: Feb. 1, 2005

(65) Prior Publication Data

US 2006/0080095 Al Apr. 13, 2006

(30) Foreign Application Priority Data

Sep. 28, 2004 (DE) 10 2004 047 032

(51) Int. CI.

G10H1/00 (2006.01)
G10H1/18 (2006.01)
G10H 7/00 (2006.01)
G10L15/00 (2006.01)

(52) U.S. CI 84/615; 84/600; 84/609;

84/616; 382/173; 382/224; 704/233; 704/249

(58) Field of Classification Search 84/615,

84/616,600,609; 704/249,233; 382/173,

382/224

See application file for complete search history.

(56) References Cited

U.S. PATENT DOCUMENTS

5,510,572 A * 4/1996 Hayashi et al 84/609

5,739,454 A * 4/1998 Kunimoto 84/615

5,918,223 A * 6/1999 Blum et al 707/1

U.S. PATENT DOCUMENTS

6,801,895 Bl * 10/2004 Huang et al 704/270

6,915,009 B2* 7/2005 Foote et al 382/173

7,035,793 B2* 4/2006 Jiang et al 704/214

7,091,409 B2* 8/2006 Li et al 84/634

7,191,128 B2* 3/2007 Sail et al 704/233

2003/0048946 Al * 3/2003 Foote et al 382/173

2003/0083871 Al * 5/2003 Foote et al 704/233

2003/0161396 Al* 8/2003 Foote et al 375/240.01

2003/0231775 Al * 12/2003 Wark 381/56

2003/0236661 Al * 12/2003 Burges et al 704/205

2004/0030547 Al* 2/2004 Leaning et al 704/211

2004/0064209 Al* 4/2004 Zhang 700/94

2004 0074378 Al * 4/2004 Allamanche et al 84/616

2005/0005760 Al * 1/2005 Hull et al 84/645

2005/0016360 Al * 1/2005 Zhang 84/600

2005/0055204 Al* 3/2005 Florencio et al 704/233

2005/0091062 Al* 4/2005 Burges et al 704/273

2005/0123053 Al * 6/2005 Cooper et al 375/240.24

2005/0238238 Al * 10/2005 Xu et al 382/224

2005/0241465 Al * 11/2005 Goto 84/616

2005/0249080 Al* 11/2005 Foote et al 369 59.1

2006/0065102 Al * 3/2006 Xu 84/600

2006/0205124 Al * 9/2006 Herner 438/149

2006/0288849 Al * 12/2006 Peeters 84/616

FOREIGN PATENT DOCUMENTS

EP 1 577 877 10/2003

JP 2004/205575 A 5/2003

WO WO 2004/038694 5/2004

WO WO 2004/049188 Al 10/2004

OTHER PUBLICATIONS

Written Opinion (in German) dated Jan. 19, 2006 for related applications, PCT/EP2005/00749.

International Search Report (In German) dated Jan. 19, 2006 for related application, PCT/EP2005/00749.

Cooper, M. et al., "Summarizing Popular Music Via Structural Similarity Analysis," Applications of Signal Processing to Audio and Acoustics, 2003 IEEE Workshop, Oct. 19-22, 2003, New Paltz, N.Y., pp. 127-130.

Logan, B. et al., "Music Summarization Using Key Phrases," Acoustics, Speech, and Signal Processing, 2000 IEEE International Conference, Jun. 5-9, 2000, Piscataway, N.J., pp. 749-752. Bartsch, M. A. et al., "To Catch A Chorus: Using Chroma-Based Representations for Audio Thumbnailing," Applications of Signal Processing to Audio and Acoustics, 2001 IEEE Workshop, Oct. 21-24, 2001, Piscataway, N.J., pp. 15-18.

Wang, Muyuan et al., "Repeating Pattern Discovery from Acoustic Musical Signals," 2004 IEEE International Conference on Multimedia and Expo, Jun. 27, 2004, Piscataway, N.J., pp. 2019-2022. Chai, Wei et al., "Structural Analysis of Musical Signals for Indexing and Thumbnailing," Proceedings 2003 Joint Conference on Digital Libraries, May 27, 2003, Piscataway, N.J., pp. 27-34. Music Summary Using Key Phrases, Stephen Chu, Beth Logan, Cambridge Research Laboratory, Technical Report Series, CRL 2000/1, Apr. 2000.

To Catch A Chorus: Using Chroma-Based Representations For
Audio Thumbnailing, Mark A. Bartsch, Gregory H. Wakefield,
University of Michigan, EECS Department, Oct. 2001.
Media Segmentation Using Self-Similarity Decomposition,
Jonathan T. Foote, Matthew L. Cooper. FX Palo Alto Laboratory.
Summarizing Popular Music Via Strucutral Similarity Analysis,
Matthew Cooper, Jonathan Foote, 2003 IEEE Workshop on Appli-
cations of Signal Processing to Audio and Acoustics, Oct. 19-22,
2003.

Automatic Music Summarization via Similarity Analysis, Matthew
Cooper, Jonathan Foote, FX Palo Laboratory, © 2002.
Finding Repeating Patterns in Acoustic Musical Signals: Applcia-
tions for Audio Thumbnailing, Jean-Julien Aucouturier, Mark
Sandler, AES 22nd Int'l Conference on Virtural, Syunfhetic and
Entertainment Audio.

Segmentation of Musical Signals Using Hidden Markov Models,
Jean-Julien Aucouturier, Mark Sandler, Department of Electronic
Engineering, King's College, London, U.K., Audio Engineering
Society, Convention Paper, 110th Convention May 12-15, 2001,
Amsterdam, The Netherlands.

Kiranyaz, S.; Qureshi, A.F.; and Gabbouj, M.: "A Fuzzy Approach Towards Perceptual Classification And Segmentation Of MP3/AAC Audio," IEEE 2004, pp. 727-730.

* cited by examiner