A majority of today's digital document formats are strongly based on the digital simulation of printed media. While such a paper simulation might be appropriate for the visualisation of certain digital content, it is generally not the most effective solution for digitally managing and storing information. Further, information is often no longer accessed from desktop computers only but also in mobile settings via different types of media including, for example, digital text, voice or digitally augmented paper.
Fig. 1: Cross-media information space
We investigate conceptual models and architectures for the representation and integration of information across media boundaries. The iServer platform supports the integration of cross-media resources based on the resource-selector-link (RSL) hypermedia metamodel. iServer not only enables links between different types of digital media, but can also be used for integrating physical and digital resources.
The RSL hypermedia metamodel introduces the general concepts of resources, selectors and links and can be extended for specific types of resources (e.g. interactive paper, HTML pages or movie clips). By implementing media-specific resource and selector instances, arbitrary new media types can be supported. The framework has been used within the European Paper++ and PaperWorks projects for integrating physical paper and digital content and is the main component of the iPaper interactive paper infrastructure. In addition, resource extensions for XHTML documents, movie clips or sound files have been developed. The sharing of link knowledge has been investigated in a distributed iServer version based on peer-to-peer concepts and we have experimented with the use of the RSL metamodel for the implementation of an associative file system that goes beyond the simple single classification of information (files) in hierarchical folder structures.
More recently, we are investigating the feasibility of the RSL model for the definition of structural relationships on top of different cross-media information entities. We envision that our structural cross-media model might lead to further discussions about innovative forms of document interfaces and interactions. It is time to question existing document formats which are very much based on the simulation of paper on static desktop computers and to come up with innovative information concepts for the representation of open and fluid cross-media "documents" that are accessible via multimodal interactions.
Towards a Framework for Dynamic Data Physicalisation,
Beat Signer, Payam Ebrahimi, Timothy J. Curtin and Ahmed K.A. Abdullah,
International Workshop Toward a Design Language for Data Physicalization, Berlin, Germany, October 2018
Available:
Cross-Media Document Linking and Navigation,
Ahmed A.O. Tayeh, Payam Ebrahimi and Beat Signer,
Proceedings of DocEng 2018, 18th ACM Symposium on Document Engineering, Halifax, Canada, August 2018 (acceptance rate: 50%)
Available:
A Metamodel and Prototype for Fluid Document Formats,
Ahmed A.O. Tayeh, Bruno Dumas and Beat Signer,
DChanges 2018, International Workshop on (Document) Changes: Modeling, Detection, Storage and Visualization, Halifax, Canada, August 2018
An Analysis of Cross-Document Linking Mechanisms,
Ahmed A.O. Tayeh and Beat Signer,
Proceedings of JCDL 2018, ACM/IEEE Joint Conference on Digital Libraries,
Fort Worth, USA, June 2018 (acceptance rate: 37%)
The Context Modelling Toolkit: A Unified Multi-layered Context Modelling Approach,
Sandra Trullemans, Lars Van Holsbeeke and Beat Signer,
Proceedings of the ACM on Human-Computer Interaction (PACMHCI), 1(1), June 2017, presented at EICS 2017, 9th ACM SIGCHI Symposium on Engineering Interactive Computing Systems,
Lisbon, Portugal, June 2017 (acceptance rate: 28%)
Towards User-defined Cross-Device Interaction,
Audrey Sanctorum and Beat Signer,
Proceedings of DUI 2016, 5th Workshop on Distributed User Interfaces,
Lugano, Switzerland, June 2016
A Dynamically Extensible Open Cross-Document Link Service,
Ahmed A.O. Tayeh and Beat Signer,
Proceedings of WISE 2015, 16th International Conference on Web Information Systems Engineering,
Miami, USA, November, 2015 (acceptance rate: 31%)
Design Guidelines for Adaptive Multimodal Mobile Input Solutions,
Bruno Dumas, María Solórzano and Beat Signer,
Proceedings of MobileHCI 2013, 15th International Conference on Human-Computer Interaction with Mobile Devices and Services,
Munich, Germany, August 2013 (acceptance rate: 22%)
Mudra: A Unified Multimodal Interaction Framework,
Lode Hoste, Bruno Dumas and Beat Signer,
Proceedings of ICMI 2011, 13th International Conference on Multimodal Interaction,
Alicante, Spain, November 2011 (acceptance rate: 39%)
PaperSketch: A Paper-Digital Collaborative Remote Sketching Tool,
Nadir Weibel, Beat Signer, Moira C. Norrie, Herman Hofstetter, Hans-Christian Jetter and Harald Reiterer,
Proceedings of IUI 2011, International Conference on Intelligent User Interfaces,
Palo Alto, USA, February 2011 (acceptance rate: 44%)
Available:
Midas: A Declarative Multi-Touch Interaction Framework,
Christophe Scholiers, Lode Hoste, Beat Signer and Wolfgang De Meuter,
Proceedings of TEI 2011, 5th International Conference on Tangible, Embedded and Embodied Interaction,
Funchal, Portugal, January 2011 (acceptance rate: 32%)
Paper-Digital Meeting Support and Review,
Adriana Ispas, Nan Li, Moira C. Norrie and Beat Signer,
Proceedings of CollaborateCom 2010, 6th International Conference on Collaborative Computing,
Chicago, USA, October 2010 (acceptance rate: 37%)
Available:
Interactive Paper: Past, Present and Future,
Beat Signer and Moira C. Norrie,
Proceedings of PaperComp 2010, 1st International Workshop on Paper Computing,
Copenhagen Denmark, September 2010
An Architecture for Open Cross-Media Annotation Services,
Beat Signer and Moira C. Norrie,
Proceedings of WISE 2009, 10th International Conference on Web Information Systems Engineering,
Poznan, Poland, October 2009 (acceptance rate: 23%)
Interactive Paper as a Reading Medium in Digital Libraries,
Moira C. Norrie, Beat Signer and Nadir Weibel,
Proceedings of ECDL 2008, 12th European Conference on Research and Advanced Technology for Digital Libraries,
Aarhus, Denmark, September 2008 (acceptance rate: 29%)
Available:
Pen and Paper-based Interaction with the Semantic Desktop,
Marcus Liwicki, Kinga Schumacher, Andreas Dengel, Nadir Weibel, Beat Signer and Moira C. Norrie,
Proceedings of DAS 2008, 8th IAPR International Workshop on Document Analysis Systems,
Nara, Japan, September 2008
Available:
Semantic eInk: Pen and Paper-based Interaction with the Semantic Desktop,
Marcus Liwicki, Kinga Schumacher, Andreas Dengel, Nadir Weibel, Beat Signer and Moira C. Norrie,
Demo Proceedings of DAS 2008, 8th IAPR International Workshop on Document Analysis Systems,
Nara, Japan, September 2008
PaperProof: A Paper-Digital Proof-Editing System,
Nadir Weibel, Adriana Ispas, Beat Signer and Moira C. Norrie,
Proceedings of CHI 2008, 26th International Conference on Human Factors in Computing Systems (Interactivity Track),
Florence, Italy, April 2008
Context-aware Platform for Mobile Data Management,
Moira C. Norrie, Beat Signer, Michael Grossniklaus, Rudi Belotti, Corsin Decurtins and Nadir Weibel,
Wireless Networks (WINET),
13(6), Springer, December 2007
Available:
Towards Query by Sketch,
Michael Springmann, Adriana Ispas, Heiko Schuldt, Moira C. Norrie andBeat Signer,
Second DELOS Conference on Digital Libraries,
Pisa, Italy, December 2007
Available:
PaperProof: A Paper-Digital Proof-Editing System,
Nadir Weibel, Beat Signer, Patrick Ponti and Moira C. Norrie,
CoPADD 2007, 2nd International Workshop on Collaborating over Paper and Digital Documents,
London, UK, November 2007
Producing Interactive Paper Documents Based on Multi-Channel Content Publishing,
Michael Grossniklaus, Moira C. Norrie, Beat Signer and Nadir Weibel,
Proceedings of AXMEDIS 2007, 3rd International Conference on Automated Production of Cross Media Content for Multi-channel Distribution,
Barcelona, Spain, November 2007
DelosDLMS: The Integrated DELOS Digital Library Management System,
Maristella Agosti, Stefano Beretti, Gert Brettlecker, Alberto del Bimbo, Nicola Ferro, Norbert Fuhr, Daniel Keim, Claus-Peter Klas, Thomas Lidy, Moira C. Norrie, Paola Ranaldi, Andreas Rauber, Hans-Jörg Schek, Tobias Schreck, Heiko Schuldt, Beat Signer and Michael Springmann,
DELOS Conference on Digital Libraries,
Pisa, Italy, February 2007
Available:
Augmented Paper: Developing Relationships between Digital Content and Paper,
Paul Luff, Guy Adams, Wolfgang Bock, Adam Drazin, David M. Frohlich, Christian Heath, Peter Herdman, Heather King, Nadja Linketscher, Rachel Murphy, Moira C. Norrie, Abigail Sellen, Beat Signer, Ella Tallyn and Emil Zeller,
The Disappearing Computer: Interaction Design, System Infrastructures and Applications for Smart Environments, LNCS 4500,
2007
Available:
2006
Putting Location-based Services on the Map,
Michael Grossniklaus, Moira C. Norrie, Beat Signer and Nadir Weibel,
Proceedings of W2GIS 2006, 6th International Symposium on Web and Wireless Geographical Information Systems,
Hong Kong, China, December 2006
Print-n-Link: Weaving the Paper Web,
Moira C. Norrie, Beat Signer and Nadir Weibel,
Proceedings of DocEng 2006, ACM Symposium on Document Engineering,
Amsterdam, The Netherlands, October 2006 (acceptance rate: 33%)
Available:
Paper-based Mobile Access to Databases,
Beat Signer, Moira C. Norrie, Michael Grossniklaus, Rudi Belotti, Corsin Decurtins and Nadir Weibel,
Demo Proceedings of SIGMOD 2006, ACM International Conference on Management of Data,
Chicago, USA, June 2006
Available:
Spatio-Temporal Proximity as a Basis for Collaborative Filtering in Mobile Environments,
Alexandre de Spindler, Moira C. Norrie, Michael Grossniklaus and Beat Signer,
Proceedings of UMICS 2006, Workshop on Ubiquitous Mobile Information and Collaboration Systems, CAiSE 2006, 18th International Conference on Advanced Information Systems Engineering,
Luxembourg, Grand Duchy of Luxembourg, June 2006
Content Publishing Framework for Interactive Paper Documents,
Moira C. Norrie, Alexios Palinginis and Beat Signer,
Proceedings of DocEng 2005, ACM Symposium on Document Engineering,
Bristol, United Kingdom, November 2005 (acceptance rate: 33%)
Available:
Experimental Platform for Mobile Information Systems,
Rudi Belotti, Corsin Decurtins, Moira C. Norrie, Beat Signer and Ljiljana Vukelja,
Proceedings of MobiCom 2005, 11th Annual International Conference on Mobile Computing and Networking,
Cologne, Germany, August 2005 (acceptance rate: 10%)
Available:
Using Paper to Support Collaboration in Educational Activities,
Ella Tallyn, David M. Frohlich, Nadja Linketscher, Beat Signer and Guy Adams,
Proceedings of CSCL 2005, Conference on Computer Supported Collaborative Learning,
Taipei, Taiwan, May 2005 (acceptance rate: 30%)
Available:
A Framework for Cross-Media Information Management,
Beat Signer and Moira C. Norrie,
Proceedings of EuroIMSA 2005, International Conference on Internet and Multimedia Systems and Applications,
Grindelwald, Switzerland, February 2005
Switching over to Paper: A New Web Channel,
Moira C. Norrie and Beat Signer,
Proceedings of WISE 2003, 4th International Conference on Web Information Systems Engineering,
Rome, Italy, December 2003 (acceptance rate: 25%)
Available:
Digital Annotation of Printed Documents,
Corsin Decurtins, Moira C. Norrie and Beat Signer,
Proceedings of CIKM 2003, 12th International Conference on Information and Knowledge Management,
New Orleans, USA, November 2003
Available:
Multi-Layered Cross-Media Linking,
Beat Signer and Moira C. Norrie,
Proceedings of Hypertext 2003, 14th ACM Conference on Hypertext and Hypermedia,
Nottingham, United Kingdom, August 2003
Aural Interfaces to Databases Based on VoiceXML,
Beat Signer, Moira C. Norrie, Peter Geissbuehler and Daniel Heiniger,
Proceedings of VDB6, 6th IFIP Workshop on Visual Database Systems,
Brisbane, Australia, May 2002
Java Framework for Database-centric Web Engineering,
Beat Signer, Michael Grossniklaus and Moira C. Norrie,
Proceedings of WebE 2001, 4th Workshop on Web Engineering (in conjunction with 10th International World Wide Web Conference),
Hong Kong, May 2001
