Quality in Use of Domain Specific Language: a Case Study

Research output: Chapter in Book/Report/Conference proceedingConference contribution

28 Citations (Scopus)

Abstract

Domain-Specific Languages (DSLs) are claimed to increment productivity, while reducing the required maintenance and programming expertise. In this context, DSLs usability is a key factor for its successful adoption. In this paper, we propose a systematic approach based on User Interfaces Experimental validation techniques to assess the impact of the introduction of DSLs on the productivity of domain experts. To illustrate this evaluation approach we present a case study of a DSL for High Energy Physics (HEP). The DSL on this case study, called Pheasant (PHysicist's EAsy Analysis Tool), is assessed in contrast with a pre-existing baseline, using General Purpose Languages (GPLs) such as C++. The comparison combines quantitative and qualitative data, collected with users from a real-world setting. Our assessment includes Physicists with programming experience with two profiles; ones with no experience with the previous framework used in the project and other experienced. This work's contribution highlights the problem of the absence of systematic approaches for experimental validation of DSLs. It also illustrates how an experimental approach can be used in the context of a DSL evaluation during the Software Languages Engineering activity, with respect to its impact on effectiveness and efficiency.
Original languageUnknown
Title of host publicationWorkshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU)
Pages1-14
Volume1
DOIs
Publication statusPublished - 1 Jan 2011
EventProceedings of the Workshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU 2011), held at Splash 2011, Portland, Oregon, USA, October 24, 2011. -
Duration: 1 Jan 2011 → …

Conference

ConferenceProceedings of the Workshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU 2011), held at Splash 2011, Portland, Oregon, USA, October 24, 2011.
Period1/01/11 → …

Cite this

Goulão, M. C. P. A., & Amaral, V. M. M. D. (2011). Quality in Use of Domain Specific Language: a Case Study. In Workshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU) (Vol. 1, pp. 1-14) https://doi.org/10.1145/2089155.2089170
Goulão, Miguel Carlos Pacheco Afonso ; Amaral, Vasco Miguel Moreira do. / Quality in Use of Domain Specific Language: a Case Study. Workshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU). Vol. 1 2011. pp. 1-14
@inproceedings{cf41613f68ab4bccae4469bdfe97f66c,
title = "Quality in Use of Domain Specific Language: a Case Study",
abstract = "Domain-Specific Languages (DSLs) are claimed to increment productivity, while reducing the required maintenance and programming expertise. In this context, DSLs usability is a key factor for its successful adoption. In this paper, we propose a systematic approach based on User Interfaces Experimental validation techniques to assess the impact of the introduction of DSLs on the productivity of domain experts. To illustrate this evaluation approach we present a case study of a DSL for High Energy Physics (HEP). The DSL on this case study, called Pheasant (PHysicist's EAsy Analysis Tool), is assessed in contrast with a pre-existing baseline, using General Purpose Languages (GPLs) such as C++. The comparison combines quantitative and qualitative data, collected with users from a real-world setting. Our assessment includes Physicists with programming experience with two profiles; ones with no experience with the previous framework used in the project and other experienced. This work's contribution highlights the problem of the absence of systematic approaches for experimental validation of DSLs. It also illustrates how an experimental approach can be used in the context of a DSL evaluation during the Software Languages Engineering activity, with respect to its impact on effectiveness and efficiency.",
author = "Goul{\~a}o, {Miguel Carlos Pacheco Afonso} and Amaral, {Vasco Miguel Moreira do}",
year = "2011",
month = "1",
day = "1",
doi = "10.1145/2089155.2089170",
language = "Unknown",
isbn = "978-1-4503-1024-6",
volume = "1",
pages = "1--14",
booktitle = "Workshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU)",

}

Goulão, MCPA & Amaral, VMMD 2011, Quality in Use of Domain Specific Language: a Case Study. in Workshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU). vol. 1, pp. 1-14, Proceedings of the Workshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU 2011), held at Splash 2011, Portland, Oregon, USA, October 24, 2011., 1/01/11. https://doi.org/10.1145/2089155.2089170

Quality in Use of Domain Specific Language: a Case Study. / Goulão, Miguel Carlos Pacheco Afonso; Amaral, Vasco Miguel Moreira do.

Workshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU). Vol. 1 2011. p. 1-14.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Quality in Use of Domain Specific Language: a Case Study

AU - Goulão, Miguel Carlos Pacheco Afonso

AU - Amaral, Vasco Miguel Moreira do

PY - 2011/1/1

Y1 - 2011/1/1

N2 - Domain-Specific Languages (DSLs) are claimed to increment productivity, while reducing the required maintenance and programming expertise. In this context, DSLs usability is a key factor for its successful adoption. In this paper, we propose a systematic approach based on User Interfaces Experimental validation techniques to assess the impact of the introduction of DSLs on the productivity of domain experts. To illustrate this evaluation approach we present a case study of a DSL for High Energy Physics (HEP). The DSL on this case study, called Pheasant (PHysicist's EAsy Analysis Tool), is assessed in contrast with a pre-existing baseline, using General Purpose Languages (GPLs) such as C++. The comparison combines quantitative and qualitative data, collected with users from a real-world setting. Our assessment includes Physicists with programming experience with two profiles; ones with no experience with the previous framework used in the project and other experienced. This work's contribution highlights the problem of the absence of systematic approaches for experimental validation of DSLs. It also illustrates how an experimental approach can be used in the context of a DSL evaluation during the Software Languages Engineering activity, with respect to its impact on effectiveness and efficiency.

AB - Domain-Specific Languages (DSLs) are claimed to increment productivity, while reducing the required maintenance and programming expertise. In this context, DSLs usability is a key factor for its successful adoption. In this paper, we propose a systematic approach based on User Interfaces Experimental validation techniques to assess the impact of the introduction of DSLs on the productivity of domain experts. To illustrate this evaluation approach we present a case study of a DSL for High Energy Physics (HEP). The DSL on this case study, called Pheasant (PHysicist's EAsy Analysis Tool), is assessed in contrast with a pre-existing baseline, using General Purpose Languages (GPLs) such as C++. The comparison combines quantitative and qualitative data, collected with users from a real-world setting. Our assessment includes Physicists with programming experience with two profiles; ones with no experience with the previous framework used in the project and other experienced. This work's contribution highlights the problem of the absence of systematic approaches for experimental validation of DSLs. It also illustrates how an experimental approach can be used in the context of a DSL evaluation during the Software Languages Engineering activity, with respect to its impact on effectiveness and efficiency.

U2 - 10.1145/2089155.2089170

DO - 10.1145/2089155.2089170

M3 - Conference contribution

SN - 978-1-4503-1024-6

VL - 1

SP - 1

EP - 14

BT - Workshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU)

ER -

Goulão MCPA, Amaral VMMD. Quality in Use of Domain Specific Language: a Case Study. In Workshop on Evaluation and Usability of Programming Languages and Tools (PLATEAU). Vol. 1. 2011. p. 1-14 https://doi.org/10.1145/2089155.2089170