BIB-VERSION:: CS-TR-v2.0 ID:: ncstrl.dartmouthcs//TR97-321 ENTRY:: July 25, 1997 ORGANIZATION:: Dartmouth College, Computer Science TITLE:: Multiple Media Stream Data Analysis: Theory and Applications (Extended version) TYPE:: Technical Report (paper) REVISION:: 1 AUTHOR:: Owen, Charles B. AUTHOR:: Makedon, Fillia DATE:: July 10, 1997 RETRIEVAL:: For a paper copy, email RETRIEVAL:: For a paper copy, write to Technical Report Librarian Department of Computer Science Dartmouth College 6211 Sudikoff Laboratory Hanover, NH 03755-3510 USA RETRIEVAL:: Compressed Postscript at http://www.cs.dartmouth.edu/reports/TR97-321.ps.Z RETRIEVAL:: PDF at http://www.cs.dartmouth.edu/reports/TR97-321.pdf ABSTRACT:: This paper presents a new model for multiple media stream data analysis as well as descriptions of some applications of this model in development at Dartmouth College. This model formalizes the exploitation of correlations between multiple, potentially heterogeneous, media streams in support of numerous application areas. The goal of the technique is to determine temporal and spatial alignments which optimize a correlation function and indicate commonality and synchronization between media streams. It also provides a framework for comparison of media in unrelated domains. Applications such as text-to-speech alignment, functional magnetic resonance imaging, speaker localization, and degraded media realignment are described. NOTE:: A shorter version of this paper appears in the Proceedings of Gesellschaft fur Klassifikation e.V., University of Potsdam, Potsdam, Germany, March 12-14, 1997 END:: ncstrl.dartmouthcs//TR97-321