DSL-Lab: A Modular Ecosystem for Online User Studies of End-User Programming Languages for Robot Automation

Mads Høbye; Anahide Silahli; Thiago Rocha Silva

doi:10.1007/978-3-032-05008-3_18

DSL-Lab: A Modular Ecosystem for Online User Studies of End-User Programming Languages for Robot Automation

Mads Høbye^*
, Anahide Silahli
, Thiago Rocha Silva

^*Corresponding author

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

8 Downloads (Pure)

Abstract

This paper introduces the interactive prototype of an online domain-specific language laboratory (DSL-Lab) to test the usability of different end-user programming languages at scale. It is a web-based ecosystem that simulates different robotic environments and supports various programming languages. The ecosystem provides a controlled experimental environment where only selected variables, like the programming language, are interchanged, eliminating confounding factors such as differences in editor features, console displays, or test setups that might influence user experience and performance metrics. The system features an editor, integrated console, robot simulation, task manager, and automatic metrics collection, and it is built over an extensible architecture where components can be changed and features can be specifically added to the given test setup. DSL-Lab makes an important contribution towards scalable, consistent, and configurable user studies, largely facilitating quantitative data collection across multiple testing sessions

Original language	English
Title of host publication	Human-Computer Interaction – INTERACT 2025 : 20th IFIP TC 13 International Conference, Proceedings, Part IV
Editors	Carmelo Ardito, Simone D.J. Barbosa, Tayana Conte, André Freire, Isabela Gasparini, Philippe Palanque, Raquel Prates
Number of pages	5
Publisher	Springer
Publication date	2026
Pages	89-93
ISBN (Print)	978-3-032-05007-6
ISBN (Electronic)	978-3-032-05008-3
DOIs	https://doi.org/10.1007/978-3-032-05008-3_18
Publication status	Published - 2026
Event	20th IFIP TC 13 International Human-Computer Interaction Conference - Belo Horizonte, Brazil Duration: 8 Sept 2025 → 12 Sept 2025 Conference number: 20

Conference

Conference	20th IFIP TC 13 International Human-Computer Interaction Conference
Number	20
Country/Territory	Brazil
City	Belo Horizonte
Period	08/09/2025 → 12/09/2025

Series	Lecture Notes in Computer Science
Volume	16111
ISSN	0302-9743

Keywords

Domain-Specific Languages
End-User Programming
Robotics
User Studies

Access to Document

10.1007/978-3-032-05008-3_18

Poster_Interact25Final published version, 1.93 MBLicence: Unspecified

Embargoed Document

INTERACT2025
Accepted author manuscript, 782 KB
Licence: Other
Embargo ends: 13/09/2026 00:00 CEST

Citation Styles

Høbye, M., Silahli, A., & Rocha Silva, T. (2026). DSL-Lab: A Modular Ecosystem for Online User Studies of End-User Programming Languages for Robot Automation. In C. Ardito, S. D. J. Barbosa, T. Conte, A. Freire, I. Gasparini, P. Palanque, & R. Prates (Eds.), Human-Computer Interaction – INTERACT 2025: 20th IFIP TC 13 International Conference, Proceedings, Part IV (pp. 89-93). Springer. https://doi.org/10.1007/978-3-032-05008-3_18

Høbye, Mads ; Silahli, Anahide ; Rocha Silva, Thiago. / DSL-Lab : A Modular Ecosystem for Online User Studies of End-User Programming Languages for Robot Automation. Human-Computer Interaction – INTERACT 2025: 20th IFIP TC 13 International Conference, Proceedings, Part IV. editor / Carmelo Ardito ; Simone D.J. Barbosa ; Tayana Conte ; André Freire ; Isabela Gasparini ; Philippe Palanque ; Raquel Prates. Springer, 2026. pp. 89-93 (Lecture Notes in Computer Science, Vol. 16111).

@inproceedings{0cf57f7e0fb041328defad9c7402d83a,

title = "DSL-Lab: A Modular Ecosystem for Online User Studies of End-User Programming Languages for Robot Automation",

abstract = "This paper introduces the interactive prototype of an online domain-specific language laboratory (DSL-Lab) to test the usability of different end-user programming languages at scale. It is a web-based ecosystem that simulates different robotic environments and supports various programming languages. The ecosystem provides a controlled experimental environment where only selected variables, like the programming language, are interchanged, eliminating confounding factors such as differences in editor features, console displays, or test setups that might influence user experience and performance metrics. The system features an editor, integrated console, robot simulation, task manager, and automatic metrics collection, and it is built over an extensible architecture where components can be changed and features can be specifically added to the given test setup. DSL-Lab makes an important contribution towards scalable, consistent, and configurable user studies, largely facilitating quantitative data collection across multiple testing sessions",

keywords = "Domain-Specific Languages, End-User Programming, Robotics, User Studies",

author = "Mads H{\o}bye and Anahide Silahli and \{Rocha Silva\}, Thiago",

year = "2026",

doi = "10.1007/978-3-032-05008-3\_18",

language = "English",

isbn = "978-3-032-05007-6",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "89--93",

editor = "Carmelo Ardito and Barbosa, \{Simone D.J.\} and Tayana Conte and Andr{\'e} Freire and Isabela Gasparini and Philippe Palanque and Raquel Prates",

booktitle = "Human-Computer Interaction – INTERACT 2025",

note = "20th IFIP TC 13 International Human-Computer Interaction Conference, INTERACT 2025 ; Conference date: 08-09-2025 Through 12-09-2025",

}

Høbye, M, Silahli, A & Rocha Silva, T 2026, DSL-Lab: A Modular Ecosystem for Online User Studies of End-User Programming Languages for Robot Automation. in C Ardito, SDJ Barbosa, T Conte, A Freire, I Gasparini, P Palanque & R Prates (eds), Human-Computer Interaction – INTERACT 2025: 20th IFIP TC 13 International Conference, Proceedings, Part IV. Springer, Lecture Notes in Computer Science, vol. 16111, pp. 89-93, 20th IFIP TC 13 International Human-Computer Interaction Conference, Belo Horizonte, Brazil, 08/09/2025. https://doi.org/10.1007/978-3-032-05008-3_18

DSL-Lab: A Modular Ecosystem for Online User Studies of End-User Programming Languages for Robot Automation. / Høbye, Mads; Silahli, Anahide; Rocha Silva, Thiago.
Human-Computer Interaction – INTERACT 2025: 20th IFIP TC 13 International Conference, Proceedings, Part IV. ed. / Carmelo Ardito; Simone D.J. Barbosa; Tayana Conte; André Freire; Isabela Gasparini; Philippe Palanque; Raquel Prates. Springer, 2026. p. 89-93 (Lecture Notes in Computer Science, Vol. 16111).

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

TY - GEN

T1 - DSL-Lab

T2 - 20th IFIP TC 13 International Human-Computer Interaction Conference

AU - Høbye, Mads

AU - Silahli, Anahide

AU - Rocha Silva, Thiago

N1 - Conference code: 20

PY - 2026

Y1 - 2026

N2 - This paper introduces the interactive prototype of an online domain-specific language laboratory (DSL-Lab) to test the usability of different end-user programming languages at scale. It is a web-based ecosystem that simulates different robotic environments and supports various programming languages. The ecosystem provides a controlled experimental environment where only selected variables, like the programming language, are interchanged, eliminating confounding factors such as differences in editor features, console displays, or test setups that might influence user experience and performance metrics. The system features an editor, integrated console, robot simulation, task manager, and automatic metrics collection, and it is built over an extensible architecture where components can be changed and features can be specifically added to the given test setup. DSL-Lab makes an important contribution towards scalable, consistent, and configurable user studies, largely facilitating quantitative data collection across multiple testing sessions

AB - This paper introduces the interactive prototype of an online domain-specific language laboratory (DSL-Lab) to test the usability of different end-user programming languages at scale. It is a web-based ecosystem that simulates different robotic environments and supports various programming languages. The ecosystem provides a controlled experimental environment where only selected variables, like the programming language, are interchanged, eliminating confounding factors such as differences in editor features, console displays, or test setups that might influence user experience and performance metrics. The system features an editor, integrated console, robot simulation, task manager, and automatic metrics collection, and it is built over an extensible architecture where components can be changed and features can be specifically added to the given test setup. DSL-Lab makes an important contribution towards scalable, consistent, and configurable user studies, largely facilitating quantitative data collection across multiple testing sessions

KW - Domain-Specific Languages

KW - End-User Programming

KW - Robotics

KW - User Studies

U2 - 10.1007/978-3-032-05008-3_18

DO - 10.1007/978-3-032-05008-3_18

M3 - Article in proceedings

SN - 978-3-032-05007-6

T3 - Lecture Notes in Computer Science

SP - 89

EP - 93

BT - Human-Computer Interaction – INTERACT 2025

A2 - Ardito, Carmelo

A2 - Barbosa, Simone D.J.

A2 - Conte, Tayana

A2 - Freire, André

A2 - Gasparini, Isabela

A2 - Palanque, Philippe

A2 - Prates, Raquel

PB - Springer

Y2 - 8 September 2025 through 12 September 2025

ER -

Høbye M, Silahli A, Rocha Silva T. DSL-Lab: A Modular Ecosystem for Online User Studies of End-User Programming Languages for Robot Automation. In Ardito C, Barbosa SDJ, Conte T, Freire A, Gasparini I, Palanque P, Prates R, editors, Human-Computer Interaction – INTERACT 2025: 20th IFIP TC 13 International Conference, Proceedings, Part IV. Springer. 2026. p. 89-93. (Lecture Notes in Computer Science, Vol. 16111). doi: 10.1007/978-3-032-05008-3_18