The advent of increasingly large consumer collections of audio
(e.g., iTunes), imagery (e.g., Flickr), and video (e.g., YouTube)
is driving a need not only for multimedia retrieval but also
information extraction from and across media. Furthermore,
industrial and government collections fuel requirements for stock
media access, media preservation, broadcast news retrieval,
identity management, and video surveillance. While
significant advances have been made in language processing for
information extraction from unstructured multilingual text and
extraction of objects from imagery and video, these advances have
been explored in largely independent research communities who have
addressed extracting information from single media (e.g., text,
imagery, audio). And yet users need to search for concepts
across individual media, author multimedia artifacts, and perform
multimedia analysis in many domains.

This collection is intended to serve several purposes, including
reporting the current state of the art, stimulating novel research,
and encouraging cross-fertilization of distinct research
disciplines. The collection and integration of a common base of
intellectual material will provide an invaluable service from which
to teach a future generation of cross disciplinary media scientists
and engineers.

MARK T. MAYBURY, PhD, is an Executive Director at MITRE, a federally funded research and development center. In 2010, Dr. Maybury took a leave of absence from MITRE when appointed to the role of Chief Scientist of the United States Air Force. He is a former member of the board of directors of the Object Management Group and the Air Force Scientific Advisory Board. An IEEE Fellow, Dr. Maybury is a member of the ACM Intelligent User Interface Steering Committee and has served on the Advanced Visual Interfaces Program Committee for over ten years. He holds several patents and has edited, coedited, or coauthored a number of books on information retrieval and related topics.

Klappentext

The definitive guide to the state of the art of multimedia information extraction

Government analysts, think tank researchers, managers at top websitesbasically everyoneis searching for the best ways to access and exploit the vast amounts of multimedia data made available over large networks every day. Written by an international team of experts, Multimedia Information Extraction provides a detailed road map to how that's done.

The first book to address not only multimedia retrieval but also information extraction from and across media, it offers diverse perspectives on how this emerging technology can help meet the growing demand in industry and government for stock media access, media preservation, broadcast news retrieval, identity management, video surveillance, and more.

Including a Foreword by Professor Alan Smeaton, founding coordinator of the international TRECVid, Multimedia Information Extraction covers:

• The fundamental issues in processing and multimedia source extraction
• The history and state of the art of multimedia information extraction
• Image and video extraction, with tools ranging from visual feature localization to social redundancy
• Affect extraction in audio and imagery, from paralinguistic information retrieval to affect-based indexing
• Multimedia annotation and authoring

An inspiring, much-needed resource for researchers and developers in government, industry, and academia, this book also offers guidance on using the material in the core curriculum of ACM SIGCHI, ACM/IEEE Computer Science, and ACM/IEEE Information Technology.

Zusammenfassung
The advent of increasingly large consumer collections of audio (e.g., iTunes), imagery (e.g., Flickr), and video (e.g., YouTube) is driving a need not only for multimedia retrieval but also information extraction from and across media. Furthermore, industrial and government collections fuel requirements for stock media access, media preservation, broadcast news retrieval, identity management, and video surveillance. While significant advances have been made in language processing for information extraction from unstructured multilingual text and extraction of objects from imagery and video, these advances have been explored in largely independent research communities who have addressed extracting information from single media (e.g., text, imagery, audio). And yet users need to search for concepts across individual media, author multimedia artifacts, and perform multimedia analysis in many domains.

This collection is intended to serve several purposes, including reporting the current state of the art, stimulating novel research, and encouraging cross-fertilization of distinct research disciplines. The collection and integration of a common base of intellectual material will provide an invaluable service from which to teach a future generation of cross disciplinary media scientists and engineers.

Foreword ix
Alan F. Smeaton

Preface xiii
Mark T. Maybury

Acknowledgments xv

Contributors xvii

1 Introduction 1
Mark T. Maybury

2 Multimedia Information Extraction: History and State of the Art 13
Mark T. Maybury

Section 1 Image Extraction 41

3 Visual Feature Localization for Detecting Unique Objects in Images 45
Madirakshi Das, Alexander C. Loui, and Andrew C. Blose

4 Entropy-based Analysis of Visual And Geolocation Concepts in Images 63
Keiji Yanai, Hidetoshi Kawakubo, and Kobus Barnard

5 the Meaning of 3d Shape and Some Techniques To Extract It 81
Sven Havemann, Torsten Ullrich, and Dieter W. Fellner

6 a Data-driven Meaningful Representation Of Emotional Facial Expressions 99
Nicolas Stoiber, Gaspard Breton, and Renaud Seguier

Section 2 Video Extraction 113

7 Visual Semantics for Reducing False Positives in Video Search 119
Rohini K. Srihari and Adrian Novischi

8 Automated Analysis of Ideological Bias in Video 129
Wei-Hao Lin and Alexander G. Hauptmann

9 Multimedia Information Extraction in a Live Multilingual News Monitoring System 145
David D. Palmer, Marc B. Reichman, and Noah White

10 Semantic Multimedia Extraction Using Audio and Video 159
Evelyne Tzoukermann, Geetu Ambwani, Amit Bagga, Leslie Chipman, Anthony R. Davis, Ryan Farrell, David Houghton, Oliver Jojic, Jan Neumann, Robert Rubinoff, Bageshree Shevade, and Hongzhong Zhou

11 Analysis of Multimodal Natural Language Content in Broadcast Video 175
Prem Natarajan, Ehry MacRostie, Rohit Prasad, and Jonathan Watson

12 Web-based Multimedia Information Extraction Based on Social Redundancy 185
Jose San Pedro, Stefan Siersdorfer, Vaiva Kalnikaite, and Steve Whittaker

13 Information Fusion and Anomaly Detection with Uncalibrated Cameras in Video Surveillance 201
Erhan Baki Ermis, Venkatesh Saligrama, and Pierre-Marc Jodoin

Section 3 Audio, Graphics, and Behavior Extraction 217

14 Automatic Detection, Indexing, and Retrieval Of Multiple Attributes From Cross-lingual Multimedia Data 221
Qian Hu, Fred J. Goodman, Stanley M. Boykin, Randall K. Fish, Warren R. Greiff, Stephen R. Jones, and Stephen R. Moore

15 Information Graphics in Multimodal Documents 235
Sandra Carberry, Stephanie Elzer, Richard Burns, Peng Wu, Daniel Chester, and Seniz Demir

16 Extracting Information From Human Behavior 253
Fabio Pianesi, Bruno Lepri, Nadia Mana, Alessandro Cappelletti, and Massimo Zancanaro

Section 4 A…