Multimodality and Design of Interactive Virtual Environments for Creative Collaboration: A Social Semiotic Perspective

    Research output: Contribution to conferenceConference abstract for conferenceResearchpeer-review

    Abstract

    Developments in digital interaction technologies provide new interdisciplinary fields for creative work at the intersection of design, art and technology. These technologies also present new possibilities to integrate physical spaces with interactive layers of digital information for multi-user interaction, customization and interdisciplinary collaboration. These spaces accommodate new forms of spatial and social practices, provide multimodal communication resources in physical and virtual environments, and allow individuals (or groups) to actively engage with collaborative creative experiences. The three-dimensional representation of space and the resources for non-verbal communication enable the users to interact with the digital content in more complex yet engaging ways. However, understanding the communicative resources in virtual spaces with the theoretical tools that are conventionally used to describe physical spaces become problematic, especially when we consider the affordances and constraints for mediating spatial practices with digital tools.

    This article proposes a multimodal social semiotic approach to the design of interactive virtual environments and virtually augmented physical spaces as new forms of technologically mediated collaborative spaces. It presents the findings of multiple case studies conducted by different 3D virtual environment technologies and interaction contexts, including screen-based virtual worlds and virtually- augmented physical spaces. The multimodal analytical perspective particularly emphasizes the role of audio-visual resources in co-creating representations for effective collaboration, and the socio-cultural factors in construction of meaningful virtual environments.
    Original languageEnglish
    Publication date2014
    Publication statusPublished - 2014
    EventØrecomm Festival 2014: Voice & Matter - Roskilde and Malmö, Denmark
    Duration: 17 Sep 201420 Sep 2014

    Conference

    ConferenceØrecomm Festival 2014
    CountryDenmark
    CityRoskilde and Malmö
    Period17/09/201420/09/2014
    OtherFourth annual Glocal Conference on Communication for Development

    Cite this

    @conference{52a648f424dd4398b7bd8d4cd6ead86f,
    title = "Multimodality and Design of Interactive Virtual Environments for Creative Collaboration: A Social Semiotic Perspective",
    abstract = "Developments in digital interaction technologies provide new interdisciplinary fields for creative work at the intersection of design, art and technology. These technologies also present new possibilities to integrate physical spaces with interactive layers of digital information for multi-user interaction, customization and interdisciplinary collaboration. These spaces accommodate new forms of spatial and social practices, provide multimodal communication resources in physical and virtual environments, and allow individuals (or groups) to actively engage with collaborative creative experiences. The three-dimensional representation of space and the resources for non-verbal communication enable the users to interact with the digital content in more complex yet engaging ways. However, understanding the communicative resources in virtual spaces with the theoretical tools that are conventionally used to describe physical spaces become problematic, especially when we consider the affordances and constraints for mediating spatial practices with digital tools.This article proposes a multimodal social semiotic approach to the design of interactive virtual environments and virtually augmented physical spaces as new forms of technologically mediated collaborative spaces. It presents the findings of multiple case studies conducted by different 3D virtual environment technologies and interaction contexts, including screen-based virtual worlds and virtually- augmented physical spaces. The multimodal analytical perspective particularly emphasizes the role of audio-visual resources in co-creating representations for effective collaboration, and the socio-cultural factors in construction of meaningful virtual environments.",
    author = "G{\"u}rsimsek, {Remzi Ates}",
    year = "2014",
    language = "English",
    note = "{\O}recomm Festival 2014 : Voice & Matter ; Conference date: 17-09-2014 Through 20-09-2014",

    }

    Gürsimsek, RA 2014, 'Multimodality and Design of Interactive Virtual Environments for Creative Collaboration: A Social Semiotic Perspective' Ørecomm Festival 2014, Roskilde and Malmö, Denmark, 17/09/2014 - 20/09/2014, .

    Multimodality and Design of Interactive Virtual Environments for Creative Collaboration : A Social Semiotic Perspective. / Gürsimsek, Remzi Ates.

    2014. Abstract from Ørecomm Festival 2014, Roskilde and Malmö, Denmark.

    Research output: Contribution to conferenceConference abstract for conferenceResearchpeer-review

    TY - ABST

    T1 - Multimodality and Design of Interactive Virtual Environments for Creative Collaboration

    T2 - A Social Semiotic Perspective

    AU - Gürsimsek, Remzi Ates

    PY - 2014

    Y1 - 2014

    N2 - Developments in digital interaction technologies provide new interdisciplinary fields for creative work at the intersection of design, art and technology. These technologies also present new possibilities to integrate physical spaces with interactive layers of digital information for multi-user interaction, customization and interdisciplinary collaboration. These spaces accommodate new forms of spatial and social practices, provide multimodal communication resources in physical and virtual environments, and allow individuals (or groups) to actively engage with collaborative creative experiences. The three-dimensional representation of space and the resources for non-verbal communication enable the users to interact with the digital content in more complex yet engaging ways. However, understanding the communicative resources in virtual spaces with the theoretical tools that are conventionally used to describe physical spaces become problematic, especially when we consider the affordances and constraints for mediating spatial practices with digital tools.This article proposes a multimodal social semiotic approach to the design of interactive virtual environments and virtually augmented physical spaces as new forms of technologically mediated collaborative spaces. It presents the findings of multiple case studies conducted by different 3D virtual environment technologies and interaction contexts, including screen-based virtual worlds and virtually- augmented physical spaces. The multimodal analytical perspective particularly emphasizes the role of audio-visual resources in co-creating representations for effective collaboration, and the socio-cultural factors in construction of meaningful virtual environments.

    AB - Developments in digital interaction technologies provide new interdisciplinary fields for creative work at the intersection of design, art and technology. These technologies also present new possibilities to integrate physical spaces with interactive layers of digital information for multi-user interaction, customization and interdisciplinary collaboration. These spaces accommodate new forms of spatial and social practices, provide multimodal communication resources in physical and virtual environments, and allow individuals (or groups) to actively engage with collaborative creative experiences. The three-dimensional representation of space and the resources for non-verbal communication enable the users to interact with the digital content in more complex yet engaging ways. However, understanding the communicative resources in virtual spaces with the theoretical tools that are conventionally used to describe physical spaces become problematic, especially when we consider the affordances and constraints for mediating spatial practices with digital tools.This article proposes a multimodal social semiotic approach to the design of interactive virtual environments and virtually augmented physical spaces as new forms of technologically mediated collaborative spaces. It presents the findings of multiple case studies conducted by different 3D virtual environment technologies and interaction contexts, including screen-based virtual worlds and virtually- augmented physical spaces. The multimodal analytical perspective particularly emphasizes the role of audio-visual resources in co-creating representations for effective collaboration, and the socio-cultural factors in construction of meaningful virtual environments.

    M3 - Conference abstract for conference

    ER -