Presentation Summary

Title : The Two-Ring paradigm: a computational approach to multisensory code binding
Authors : Andrew Davison, Ammar Belatreche, Johannes Fieres, Jason Chan, Fiona Newell and Yves Fr├ęgnac
Year : 2005

Abstract

The Two-Ring Problem is a framework for investigating the integration of multisensory information in humans and in a machine (the SenseMaker System), specifically visual and haptic information. The tasks to be attempted in the Two-Ring Problem involve the perception of static, two-dimensional scenes: the machine or observer has to segment a scene into its component objects, perceptually identify those objects and infer their relative spatial relationships. The tasks may be attempted using vision (an image is presented on a screen), the haptic sense (a finger is scanned over a textured surface), or both senses together. Comparing human and machine performance under different constraints will allow us to explore, using computational methods, neural-based hypotheses for the perceptual mechanisms underlying this performance. In this paper we outline the biology-inspired architecture and implementation of the neuronal-network model that will run on the SenseMaker system hardware, in order to solve multi-sensory perception tasks in the Two-Ring framework. Supported by EU project IST-2001-34712.