BEGIN:VCALENDAR
VERSION:2.0
PRODID:Linklings LLC
BEGIN:VTIMEZONE
TZID:Europe/Stockholm
X-LIC-LOCATION:Europe/Stockholm
BEGIN:DAYLIGHT
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
TZNAME:CEST
DTSTART:19700308T020000
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=-1SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
TZNAME:CET
DTSTART:19701101T020000
RRULE:FREQ=YEARLY;BYMONTH=10;BYDAY=-1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTAMP:20241120T082409Z
LOCATION:HG F 3
DTSTART;TZID=Europe/Stockholm:20240603T153000
DTEND;TZID=Europe/Stockholm:20240603T160000
UID:submissions.pasc-conference.org_PASC24_sess152_msa194@linklings.com
SUMMARY:Studying Artifact Evaluation to Improve Reproducibility and Usabil
 ity
DESCRIPTION:Minisymposium\n\nJohanna Cohoon, Robert Ricci, Eric Eide, and 
 Jason Wiese (University of Utah)\n\nResearchers support reproducibility an
 d rigorous science by sharing and reviewing research artifacts—the documen
 tation and code necessary to replicate a computational study. Creating qua
 lity research artifacts and conducting reviews for conferences and journal
 s are both considered to be time consuming and poorly rewarded activities.
  To simplify these scholarly tasks, we studied the work of artifact evalua
 tion (i.e., artifact reviewing) for a recent ACM conference. Through analy
 sis of reviewers’ comments and their responses to a set of three surveys d
 istributed throughout the evaluation process, we recognized common issues 
 reviewers faced and the features of high quality artifacts. To lessen the 
 time and difficulty of artifact creation and evaluation, we identify desig
 n implications for infrastructures like the testbeds used to execute resea
 rch artifacts. By applying the knowledge gleaned through our study, we hop
 e to improve the usability of research infrastructure and, consequently, t
 he reproducibility of research artifacts.\n\nDomain: Applied Social Scienc
 es and Humanities, Engineering, Computational Methods and Applied Mathemat
 ics\n\nSession Chair: Jim Willenbring (Sandia National Laboratories)
END:VEVENT
END:VCALENDAR