Complexity of tools and user feedback

So I recently ran a course that allowed parallel tracks of the Galaxy visual programming environment vs a Jupyter Notebook with predominantly Python.

We had participants fill out a SUS survey about their experience.

Galaxy scored a 7.2 while notebooks scored a 6.7 from 55 ratings, which I thought was shockingly close, given that the idea of Galaxy was to be significantly more usable.

A very, very common refrain from these new users (all undergraduates) was that they were overwhelmed by all the choices/parameters in tools, and that they wanted to learn the details on every single one in order to understand what they were doing. We reiterated numerous times that this was not important to do, that they should only note the parameters we note for them, but nevertheless this was a recurring theme.

Comparatively, notebooks/code literally only showed the parameters of import (anything not left as default they’d have to actually check the docs for), so visually, it looks a lot simpler, and ultimately the users don’t even realise what they don’t know because it isn’t staring them in the face.

Therefore, I propose the following solution - all non-essential parameters get hidden across all tools, UNLESS a user has selected a general ‘show all’ button somewhere in their user preferences (or still better, a giant button on their main page that then essentially lets us distinguish advanced from beginner users, as I suspect this ‘simplification’ strategy may want to be employed else where. *Note that to enable this, the selection of ‘nonessential’ parameters (or more likely, ‘essential parameters’) needs to be easy to do (even for non-tool developers), and prioritised for tools used in training rather than across the board. It could/should be a n ‘opt-in’ situation.

Then we can ease beginners in, without overwhelming them with choice.

Also open to alternatives, but this data robust and something we should seriously action. We can’t be that close to a notebook.

1 Like

Hi Wendi

I fully understand your frustration. I am actually on my way to Lausanne to give a 1 1/2 day introductory Galaxy course, and I am sure we will run into the same issues.

However, this looks like opening a can of worms to me. How do you gonna define essential and non-essential parameters? Depending on your data a non-essential parameter suddenly becomes an essential one. Also, it is one of the strong points of Galaxy, that it is more than just a tool where you click a red button, and the result is ready - IMHO. And ultimately, we end up with the topic of “documentation”. Good documentation will solve already a lot…

Nevertheless, your idea deserve more attention. You should bring it up to other discussion platforms (maybe a discussion point at the next GCB meeting? / maybe a BoF at the upcoming GCC / etc)

Hans-Rudolf

2 Likes