Preface Natural and Multimodal Interactivity Engineering - Directions and Needs / NIELS OLE BERNSEN and LAILA DYBKJÆR Part I Making Dialogues More Natural: Empirical Work and Applied Theory Social Dialogue with Embodied Conversational Agents / TIMOTHY BICKMORE and JUSTINE CASSELL A First Experiment in Engagement for Human-Robot Interaction in Hosting Activities / CANDACE L. SIDNER and MYROSLAVA DZIKOVSKA Part II Annotation and Analysis of Multimodal Data: Speech and Gesture FORM / CRAIG H. MARTELL On the Relationships among Speech, Gestures, and Object Manipulation in Virtual Environments: Initial Evidence / ANDREA CORRADINI and PHILIP R. COHEN Analysing Multimodal Communication / PATRICK G. T. HEALEY, MARCUS COLMAN and MIKE THIRLWELL Do Oral Messages Help Visual Search? / NOËLLE CARBONELL amd SUZANNE KIEFFER Geometric and Statistical Approaches to Audiovisual Segmentation / TREVOR DARRELL, JOHN W. FISHER III, KEVIN W. WILSON, and MICHAEL R. SIRACUSA Part III Animated Talking Heads and Evaluation The Psychology and Technology of Talking Heads: Applications in Language Learning / DOMINIC W. MASSARO Effective Interaction with Talking Animated Agents in Dialogue Systems / BJÖRN GRANSTRÖM and DAVID HOUSE Controlling the Gaze of Conversational Agents / DIRK HEYLEN, IVO VAN ES, ANTON NIJHOLT and BETSY VAN DIJK Part IV Architectures and Technologies for Advanced and Adaptive Multimodal Dialogue Systems MIND: A Context-Based Multimodal Interpretation Framework in Conversational Systems / JOYCE Y. CHAI, SHIMEI PAN and MICHELLE X. ZHOU A General Purpose Architecture for Intelligent Tutoring Systems / BRADY CLARK, OLIVER LEMON, ALEXANDER GRUENSTEIN, ELIZABETH OWEN BRATT, JOHN FRY, STANLEY PETERS,HEATHER PON-BARRY, KARL SCHULTZ, ZACK THOMSEN-GRAY and PUCKTADA TREERATPITUK MIAMM – A Multimodal Dialogue System using Haptics / NORBERT REITHINGER, DIRK FEDELER, ASHWANI KUMAR, CHRISTOPH LAUER, ELSA PECOURT and LAURENT ROMARY Adaptive Human-Computer Dialogue / SORIN DUSAN and JAMES FLANAGAN Machine Learning Approaches to Human Dialogue Modelling / YORICK WILKS, NICK WEBB, ANDREA SETZER, MARK HEPPLE and ROBERTA CATIZONE Index