Chat with us
  1. aytm Help Center
  2. Knowledge Base
  3. Question Types

Articles in this section

See more

The side-by-side comparison test is perfect when you have many logos/icons/banners/short names/etc. to compare. Our system breaks your items into balanced pairs and presents two at a time to respondents, asking them to choose one. We've implemented a smart adaptive algorithm that will show the minimum number of pairs to each respondent in order to arrive at a clear conclusion of their preferences. 

Want to learn more about our question types? Enroll in our Question Types Overview course in the Lighthouse Academy!

Lighthouse_CTA.png

 

1. Building a Side-by-Side Question

  1. In the Survey Editor, click the Side-by-side Icon in the question menu, or drag the icon into place.
  2. Type or paste your question into the Question field.
  3. Type up to 12 entities in the Alternative to Compare fields, and click the + icon to add additional answer options.
  4. Hover over a number and click the X to delete an option.
  5. Click the Full screen checkbox to force respondents to a view text or images as full-screen.
2022-07-22_13-10-43.gif
Note: Because this question type uses an adaptive algorithm, Randomize is always enabled.
 
 

2. Analyzing a Side-by-Side Question

On the Results page, Side-by-side responses are shown in a stacked bar chart.

  1. Click the first drop-down to alternatively view the chart as an Area map, or as a Score Average.

  2. When Stacked or Area are selected, click the second drop down to view Entities (which display the popularity ranking on the X axis, and color-coded percentages for each entity on the Y axis), or as Positions (where entities are shown on the X axis, and place rankings become the color-coded percentages on the Y axis).
    Note: When Score Average is selected, each answer option’s average rank is displayed. Rank values are reverse-scored for this mean average; for example, if four items were ranked then first would have a rank score value of 4, second would be 3, third would be 2, and fourth would be 1. A higher Score Average indicates higher average rank.

  3. Click an Entity header to show more details and statistics for a particular response.

  4. Hover over the chart to see any statistically significant differences, or click the chart icon in the upper right corner of an Entity’s detail view to visualize data in a different way.

sidebyside.png

Take a test drive on real-world results for this question type! Explore a live demo report.

 

Learn more about Interpreting Score Averages.