Design

  • Overview
  • Adding Experiment Nodes
  • Manipulations and Multiple Spreadsheets
  • Checking Experiment Flow

Overview


This page guides you through the Design tab of the Experiment Builder. Check out the topics in the menu for walkthroughs of specific features.

The screenshot and description below shows New Experiment Builder. If you are still using Classic Experiment Builder, open the expandable section.


Annotated Design tab in Classic Experiment Builder showing the interface described below
  1. Name of your Experiment and Description: you can change these in the Settings menu under Name and Description.
  2. Settings & Preview Experiment. Click Preview Experiment to see how your experiment looks for a participant.
  3. Version control tools: Version History to view previous versions of your experiment, and either the Edit button (if you are not currently making changes), or Cancel Changes/Commit Version buttons (if you are currently making changes).
  4. Design Bar: Add New Node button and New Node icons. Use these to add new content to your experiment.
  5. Utilities menu. Update All Nodes: updates all task and questionnaire nodes in your experiment to the latest versions; Check for Errors: reports any problems with your Experiment Tree.
  6. Design Space. Zoom in and out is not available in Classic Experiment Builder. To zoom in and out, click 'Try Beta' in the blue banner at the top to try New Experiment Builder.

Annotated Design tab in New Experiment Builder showing the interface described below
  1. Experiment Name. Change the name and description of your experiment by clicking the pencil icon.
  2. More Actions menu. Use this to view previous versions of your experiment.
    • When in Edit mode, use this menu to cancel your changes and revert to a previous version.
    • When not in Edit mode, use this menu to clone your experiment or send it to another user.
  3. Commit/Edit button.
    • When in Edit mode, click Commit to commit changes to your experiment.
    • When not in Edit mode, click Edit to start making changes to your experiment.
  4. Preview button. Click this to see how your experiment looks for a participant.
  5. Update Nodes button. Click this to update nodes in your experiment to their latest versions.
  6. Check For Errors button. Use this button to check for errors in your experiment tree.
  7. Add Node button. Click this to add new content to your experiment. You can also use the blue plus buttons to add a node in a specific location in the experiment tree.
  8. Design Space. Use the scroll wheel on your mouse to zoom in and out.

Adding Experiment Nodes


To find this guide useful, you should have added your Task and Questionnaire Nodes to an experiment tree. If you haven't done this yet, read more about how to build an experiment.

Once you have added your tasks and questionnaires to your experiment, you may want to consider adding Control Nodes to your experiment. These nodes allow you to manipulate the path of participants through your experiment. For example, you may want to randomise participants to two different conditions of your experiment - this can be achieved by adding a Randomiser Node.

Checkpoint Nodes are also incredibly useful nodes to add to your experiment. These allow you to keep track of Participant progress throughout your experiment. Checkpoint Nodes can be helpful in tracking participants returning to your study in longitudinal or multi-part studies, or helping judge when to manually include participants in your dataset.

You can find more information about the available Experiment Nodes in our Experiment Tooling Reference Guide.


Manipulations and Multiple Spreadsheets


If you are using multiple spreadsheets or manipulations within your tasks, these will all need to be set within the Task Node at the experiment level.


Multiple Spreadsheets

You can add as many spreadsheets to your task as you wish. You may want to use multiple spreadsheets to show participants a different set of stimuli, for example. You can find some more information about how to add multiple spreadsheets in your task in our How-To guide.

If you would like to set a specific spreadsheet to a specific instance of the task, you will need to click on the Task Node within the experiment tree, and choose the spreadsheet from the Spreadsheet dropdown.

Screenshot of task node settings in New Experiment Builder showing Spreadsheet dropdown
Info

The screenshots on this page show the new Experiment Builder interface. If you’re still using the classic interface, it will appear slightly different.

Once you have selected which spreadsheet you would like to use for more than one node, you will be able to see the spreadsheet associated with each task at the experiment tree level.

Screenshot of experiment tree showing 2 copies of a task, one with Easy spreadsheet and one with Hard spreadsheet

If you do not set up the spreadsheet at the task node level in this way, the first spreadsheet in the list will be used by default.

If you have a larger number of spreadsheets, setting the spreadsheet for each task individually can lead to a very large experiment tree which can be difficult to manage. In this case, we would recommend using a Counterbalance Node to assign participants to different spreadsheets within the same task node.


Task Manipulations

If you have set up manipulations within your task, you will need to configure these at the experiment level before participants start your experiment.

To configure the manipulation at the experiment, click on the task node. When you click on the task node, you will be able to see the Task Manipulation in the window. This will include the name and description you have set for the Manipulation. Then, from the dropdown or in the free text field, you can set the value you would like to use for each task.

Screenshot of task node settings in New Experiment Builder showing Manipulation free text field

Once you have set Manipulations for more than one task node, you will be able to see which manipulation has been set for each task, as shown below.

Screenshot of experiment tree showing 2 copies of a task, one with Time Limit set to 1000 and one with Time Limit set to 3000

If you do not set the manipulations in this way, the default value of the manipulation will be used for every participant.


Checking Experiment Flow


Before you get ready to launch your experiment, there are a few things we recommend doing to check your experiment works properly.


Preview your experiment


Previewing your experiment is the best way to see what your experiment will look like to your participants. You can preview your experiment as many times as you want to!

The screenshot below shows New Experiment Builder. If you are still using Classic Experiment Builder, open the expandable section.


In Classic Experiment Builder, click the red 'Preview Experiment' button at the top right:

A screenshot of the Classic Experiment Builder. The red preview button on the right has been highlighted with a purple box.

In New Experiment Builder, click the white and blue Preview button at the top right:

A screenshot of the New Experiment Builder. The preview button has been highlighted with a red box.

At the end of the preview, you will be given the opportunity to download the data from that preview. This is a great way to check your data, and make sure all the relevant data that you need for your analysis are being recorded.


Check your nodes are up-to-date


If your experiment preview doesn't look how you expect, a good first step is to check if any of the nodes in your experiment tree are out-of-date.

In New Experiment Builder, new task and questionnaire nodes have Auto-update enabled by default. This means that the node will automatically reflect the latest changes, including any changes that have not yet been committed.

A screenshot of the task node settings with auto-update enabled.

If any of your nodes are set to 'Fixed version', you will need to either switch them to 'Auto-update' or take further steps to make sure they reflect your latest changes. For more guidance on this, see Updating Your Nodes.


Commit your experiment


When you are happy with how your experiment works, be sure to commit this version of the experiment. When you recruit participants, they will enter the latest committed version of the experiment.

The screenshot below shows New Experiment Builder. If you are still using Classic Experiment Builder, open the expandable section.


In Classic Experiment Builder, click the green 'Commit Version X' button at the top right:

A screenshot of the Classic Experiment Builder. The green commit button has been highlighted with a purple box.

The auto-commit and auto-update features described in the Pro Tip box below are not available in Classic Experiment Builder. You need to manually commit all your tasks and questionnaires and update the nodes in your experiment before committing your experiment.


In New Experiment Builder, click the green Commit button at the top right:

A screenshot of the New Experiment Builder. The green commit button has been highlighted with a red box.
Pro Tip

Committing and updating nodes on experiment commit

When you commit your experiment, open changes to any activity nodes set to Auto-update will automatically be committed too.

A screenshot of the commit message when auto-update is enabled, informing that nodes willl also be committed and updated on experiment commit.

For any node set to Fixed version, Gorilla will alert you to:

  • nodes you are currently editing
  • nodes that are committed, but not updated to the latest version

Nodes you are currently editing

Screenshot of the Commit window with message about tasks with open edits and button to commit edits and update nodes

Click 'Commit all changes and update all nodes' to commit all open changes to all activities in your experiment, and update all nodes to use the newly committed versions.

If you do not click this button before committing your experiment, the experiment uses the fixed versions selected in the node settings.

Nodes that are out-of-date

Screenshot of the Commit window with message about tasks with newer versions available and button to update nodes

Click 'Update all nodes to latest versions' to update all nodes in your experiment tree to use the latest versions.

If you do not click this button before committing your experiment, the experiment uses the fixed versions selected in the node settings.