We tested an early version of this new workshop survey experience in early 2019 on 12 workshops and collected about 300 responses for the pre-workshop survey and 120 for the post-workshop survey. Instructors who used this system rated it 4 out of 5 (and it was an early prototype with some bugs). Instructors familiar with the old system (using SurveyMonkey) commented that the visualisations were clearer and enjoyed being able to get the results for both surveys in the same place.
The pull request to update the link on the workshop website template has just been merged. This means that any new workshop website created from now on will use the new survey system, and the workshop administrator will send you a link to access the results.
One of the most exciting features of this new approach is that we can control the code that generates the visualisations that are presented. We are hoping that Instructors will give us feedback on how we can improve how the results of these surveys are presented and analysed so they can prepare better and improve on their teaching.
We’ll soon pilot and use this new system for our Instructor Training workshops as well.
We are planning on open-sourcing the code behind this before the end of the year. Before that, we’d love to have a full code review by a community member. If you are familiar with Shiny and are interested in reviewing the code before it’s released, please get in touch with François (firstname.lastname@example.org).
The presentation of the survey results was developped using feedback and ideas from members of The Carpentries community including Ben Marwick, Katrin Leinweber, and Katrin Tirok.
For any other questions about this new system, please reach out to email@example.com.