ComPAIR Instructor Guide

ComPAIR Logo
ComPAIR is UBC’s homegrown peer review tool that adds comparing to the process of students reviewing one another’s work. In ComPAIR, students see pairs of their peers’ assignments presented side-by-side for criteria-guided comparison and feedback. Students can identify strengths or weaknesses that may not be as evident in an isolated assignment, encouraging productive peer feedback and critical thinking.
Cost Yes Free
Bandwidth Yes Low demand
Canvas Integration Yes Works in coordination with Canvas
Privacy Yes ComPAIR is FIPPA compliant and data is stored securely in Canada
Similar UBC-Supported Tools CLAS and peerScholar are also centrally supported for student peer assessment.

What can I use it for?

You can use ComPAIR to facilitate student peer assessment (aka peer review) assignments:

  • Managing assignment collection of work done in groups or by individuals and automating distribution of this work to peers
  • Seeing how students compare and offer feedback on pairs of their peers’ work
  • Giving individual feedback to each student or to the class as a whole

How are faculty using ComPAIR?

Tiffany Potter uses ComPAIR to promote critical thinking skills in English

Nearly half of my students listed ComPAIR as the most useful classroom assignment on the year-end course evaluation: they enjoyed the comparison aspect, and they could readily understand how the tool and the assignment were helping them to engage course content and the critical processes behind their assignments and assessment. Read More »


James Charbonneau uses ComPAIR to explore grey areas in Physics

Students can read six assignments and get exposure to many viewpoints, while still exercising their peer evaluation skills. The direct comparisons themselves also allow students to more acutely see what separates good work from better work. It’s an invaluable tool for getting students to explore the grey areas in science. Read More »


What do I need to use ComPAIR?

A supported web browser

ComPAIR runs in your web browser and supports using Chrome, Edge, Firefox, or Safari.

A ComPAIR account

Accounts for ComPAIR are based on UBC CWLs (Campus-Wide Logins), so all faculty, staff, and students who have a CWL can create an account themselves. Account creation will happen automatically the first time you log in to ComPAIR.

Tips

  • You can log in to the ComPAIR at compair.elearning.ubc.ca, but if you use Canvas to set up a course, your students will need to log in to ComPAIR through the link you set up in Canvas.
  • You and your students can access ComPAIR on a mobile device, in a web browser (there is no app you have to download). We do recommend students use a larger screen when comparing, though, to better see the side-by-side answer pairs.

What should I consider before using ComPAIR?

Before you dive in, it’s best to establish your assessment approach from a pedagogical perspective. This includes determining your plan for using ComPAIR and how assessments will relate to grades.

Click any bar below to explore considerations for ComPAIR.

Plan your student peer assessments

As with any learning activity, how these assignments are introduced, designed, and integrated in courses impacts the student experience with ComPAIR. UBC internal studies so far have surfaced a few recommendations to consider in your planning.

  • Clearly explain the learning objective(s): Students who understand what underlying skills they are practicing in the application feel they learn more from the assignments. It is important to explain the end goal of using ComPAIR—how comparing will concretely help learning—not only how the process works. As a starting point, download the modifiable template for introducing ComPAIR to students that UBC instructors have created.
  • Build on ComPAIR assignments: Assignments in ComPAIR are more beneficial to students when presented as part of a larger process. It is better to use ComPAIR for peer review in the context of a bigger course goal (e.g., prep for writing a later term paper, evaluation of an early project draft), rather than for standalone assignments or “busy work”.
  • Provide a low-stakes training round: Students feel more confident when no- or low-stakes practice with comparing answer pairs happens prior to graded assignments in ComPAIR, especially when the practice includes review of how they've done the comparisons.
  • Use multiple, detailed criteria for comparisons: Students given more guidance say they learn more from comparing, especially when assignments are more complex. Explaining precisely what to look for during comparisons—with multiple descriptive criteria in the application and/or detailed external rubrics that are provided and explained ahead of time—may result in stronger learning and possibly richer feedback.
  • Require 3+ comparisons per assignment: Despite low reported confidence giving peer feedback, many students report they learn simply from practicing this skill with answer pairs. A minimum of three comparisons per student (i.e., each student reviews six peer works) is suggested to give students repeated practice to learn from.
  • Assess the quality of peer feedback: Adding weight of some kind to the peer feedback students write has helped instructors increase the quality of feedback given. Assigning marks creates additional accountability for students and increases their buy-in to the process.

Develop your student peer assessment criteria

In ComPAIR, one or more custom criteria can be used to guide students' comparison of the answer pairs. Each criterion must pose a question answered by choosing between the answers (e.g., Which is better?).

To develop criteria, start with the course learning outcomes and think about how seeing other work will help students get there—what can students learn from each other? Keep in mind how experienced students in the course will be, and use criteria at a difficulty level the majority will be able to understand. UBC instructors generally stick with between 1-6 total criteria, and some advise using an odd number to discourage students from selecting a “tie” between answers.

Consider also if the goal is more summative (critically looking at final work) or formative (constructively looking at drafted work). Harder, more complex, and longer criteria may be better for summative uses. Softer, more straightforward, and shorter criteria may be better for formative uses.

Decide on the timing of your assignment phases

You will need to decide how many ComPAIR assignments you will give in the course as well as the timing for each phase of the assignment: answering, comparing, and (optionally) self-evaluating. By default, comparing begins after answering ends, though these may be designed to overlap. However, keeping the phases separate allows students to complete their evaluations without delays (which can happen if answering and comparing overlap and there aren't enough answers available for students to compare).

ComPAIR assignments can be given during and after group projects as well. When you use a group assignment, one answer will be requested from each group (which any member can submit), but each group member must complete the required comparisons and self-evaluation (if enabled) individually.

Choose how outcomes will influence grades

If ComPAIR assignments will influence grades, you should communicate to students in the beginning how exactly the assessment marks will be counted, so students are not caught off-guard.

Often, instructors grade students with a combination of two aspects:

  • Their participation in the process (i.e., answering, comparing, and/or self-evaluating). When creating your ComPAIR assignment, you will be able to assign the weight given for completing each phase of the assignment.
  • The quality of the work students do through ComPAIR, which may mean any of the following: reviewing the answers students initially submit, seeing how peer feedback informs a revised or later work they submit, or looking at the thoroughness and thoughtfulness of their peer feedback (this has the added benefit of increasing students’ sense of accountability in providing quality constructive criticism).

A note on ComPAIR's rankings

ComPAIR’s main pedagogical focus is to help students effectively review peer work and write insightful feedback using the power of comparison. However, some instructors have considered using ComPAIR’s optional scoring/ranking of answers for grading as well, primarily by chunking the answers into rough top, middle, and bottom groups and assigning a grade to each.

Conduct your own validation, if you intend to factor ComPAIR’s outcomes into the marks you assign. Internal research so far indicates that ComPAIR’s scoring may not reliably map to traditional expert grading, as it ultimately relies on the skills and training of novices (students) to provide accurate, well-informed rankings of their peers’ answers.

How do I use ComPAIR?

To use ComPAIR, you will first set up a course and create an assignment. Students will then be able to answer, compare, and comment.

Click any bar below for instructions and tips for using ComPAIR.

Set up a ComPAIR course

You can most easily get started with ComPAIR in Canvas. Through Canvas, you can set up a ComPAIR course that will automatically populate with your class list. The instructions differ depending on if you want to sync the ComPAIR participation grades with the Canvas gradebook or not.

  1. Log in to your Canvas course, and click Assignments in the Course Navigation.
  2. Click the +Assignment blue button in the upper right side of the screen.
  3. Enter the assignment name as "ComPAIR Link" to prevent confusing this with other assignments.
  4. Scroll down to submission type and select External Tool from the drop-down menu.
  5. Even if you know the URL, click Find. (Entering the URL directly will not sync properly with Canvas.)
  6. From the list, pick ComPAIR and click Select.
  7. Check Load This Tool In A New Tab.
  8. Save the assignment.
    • Don't publish this assignment, if you want to sync grades between ComPAIR and Canvas. Instead, set up syncing for individual assignments using instructions in the accordion section farther below.
  9. You will be redirected to the assignment page you just saved. Click Load ComPAIR Link in a new window to create your ComPAIR course.
    • If you are a completely new user of ComPAIR, you will be prompted to create a ComPAIR account first.
  10. Follow the guided steps to create or link your course in ComPAIR.
    • If you are a new user of ComPAIR or would like to create a new ComPAIR course, fill out the course details (name, year, semester) and the schedule. Then click Save.
    • If you are a returning user of ComPAIR and would like to use an existing ComPAIR course, click Use This or Duplicate This next to the course.
  1. Log in to your Canvas course, and click Settings in the Course Navigation.
  2. Click the Navigation tab.
  3. Find the ComPAIR menu item, click the options menu (the 3 vertical dots), and choose Enable.
  4. The ComPAIR menu item will now be available in the Course Navigation for you and your students. You must click ComPAIR in the menu to create or link your ComPAIR course.
    • If you are a completely new user of ComPAIR, you will be prompted to create a ComPAIR account first.
  5. Follow the guided steps to create or link your course in ComPAIR.
    • If you are a new user of ComPAIR or would like to create a new ComPAIR course, fill out the course details (name, year, semester) and the schedule. Then click Save.
    • If you are a returning user of ComPAIR and would like to use an existing ComPAIR course, click Use This or Duplicate This next to the course.
  6. Tell your students they must follow the ComPAIR link from your Canvas course to initially enrol in your ComPAIR course. Students cannot go to the ComPAIR application and log in there first; this will not properly enrol them in your ComPAIR course.

Tips

  • Including grade syncing means you must set up ComPAIR assignments in Canvas that students will click to sync their grades, using the steps in the accordion below. Not setting up grade syncing means students must follow a ComPAIR link from your Canvas course only once: to initially enrol in your ComPAIR course.
  • Skipping the setup for grade syncing does not affect your ability to include grades in Canvas for ComPAIR assignments. You can still enter these grades manually.
  • If you do not want to use Canvas to set up ComPAIR, you may log in directly at compair.elearning.ubc.ca. From there, you can add a course and add students to it. Contact us for help setting this up.

Understand the ComPAIR workflow

Using ComPAIR for peer review is a straightforward process.

  1. You create an assignment: You set up five structural elements (the assignment details, timing of phases, comparison criteria, number of comparisons, and participation grade) for each assignment, a process that can be completed in under ten minutes.
  2. Students answer the assignment: Students can answer using a rich text editor, a file attachment, or both. For a group assignment, only one student from each group needs to answer.
  3. Students compare and comment on pairs of peer answers: Students select a preferred answer from the pair for each criterion you set (e.g., "Which is better?), then write feedback to the author of each answer, following instructions that you can customize. This phase is done individually, whether or not it is a group assignment.
  4. Students complete a self-evaluation (optional): If you enable self-evaluation, students reflect and comment on their own answer at the end of the process, following instructions that you can customize. This phase is done individually, whether or not it is a group assignment.
  5. Everyone views results: Once the phases of a peer review assignment complete, students can access the peer feedback given to their (or their group’s) answer, as well as all answers submitted by peers. You and your teaching team can read and comment privately or publicly on student answers, access a participation table to view activity and participation grades, mark "top" answers, and view each student’s comparison choices, peer feedback, and self-evaluation.

To find out more about each step, visit the ComPAIR support site's workflow page.

Create a basic ComPAIR assignment

  1. Log in to ComPAIR, and click your course name. If you don't have a course, you can follow the earlier steps to set one up.
  2. Click Add Assignment, which will take you to a page for filling in information about the assignment:
    • Under "Assignment Details", set the short name of the assignment, enable/disable self-evaluation and group functionality, and add any assignment instructions.
    • Under "Schedule", set the timelines for when students can answer, compare answers and, optionally, evaluate their own answer.
    • Under "Prompts", set the criteria that students will use to compare the answer pairs. One or more criteria can be used and each must pose a question answered by choosing between the answers. Instructions for peer feedback and self-evaluation can also be customized.
    • Under "Comparison Settings", set the number of comparisons required from each student and how the pairs will be selected by the application—at random or adaptively based on how students have ranked answers so far. You can also add a practice answer pair for students to start with and enable replies.
    • Under "Participation Grade", set the weight given for completing each part of the assignment, which is used in calculating a total participation grade.
  3. Save the assignment.

Tips

  • The number of comparisons you require determines the amount of feedback students will do and receive. For example, with the default of three comparisons required for an assignment, students will need to review six peer answers and will receive roughly six peer feedback comments on their answer.
  • When assignments are set up to select answer pairs adaptively, ComPAIR tracks a score for each answer that is used to match up the pairs. You can read more about how ComPAIR's scoring works on the ComPAIR support site.
  • The advantage of pairing answers adaptively is it can create more challenging comparisons, since answers are selected for the comparison pairs based on the proximity of their scores, meaning the pairs theoretically become closer in quality over time. However, this effect is more pronounced for students who complete comparisons later; students in the beginning will see more or less random pairings.

Set up grade syncing for ComPAIR in Canvas

Once you have set up a ComPAIR course and assignment, you can sync grades directly from ComPAIR to Canvas. To sync properly, you will need to set up individual links in Canvas to each ComPAIR assignment. Each student must click the link of each Canvas assignment to establish a connection between their Canvas gradebook entries and their work in ComPAIR.

  1. To create an assignment link in Canvas, first copy the necessary information from ComPAIR:
    • Log in to ComPAIR, and click your course title.
    • Scroll to the ComPAIR assignment you want to sync grades from and click Edit underneath the assignment title.
    • Click Copy? at the top right of the edit assignment page. This will copy the information you need to enter in Canvas.
  2. Log in to your Canvas course, and click Assignments in the Course Navigation.
  3. Click the + Assignment blue button in the upper right side of the screen.
  4. Enter the assignment name as you want students to see it.
  5. Scroll down to submission type and select External Tool from the drop-down menu.
  6. Even if you know the URL, click Find. (Entering the URL directly will not sync properly with Canvas.)
  7. From the list, pick ComPAIR and click Select.
  8. At the end of the "External Tool URL" field, type a question mark (?), then paste the value you copied from ComPAIR.
    • The "External Tool URL" will ultimately something look like this:
      compair.elearning.ubc.ca/api/lti/auth?assignment=*******
  9. Check Load This Tool In A New Tab. This allows grades to properly sync with Canvas.
  10. Save & Publish the assignment. (Students can only access published assignments.)

Tips

  • The grade passed from ComPAIR to Canvas with this setup is for participation points only. The grade does not factor in answer scores, even if you've enabled ComPAIR to track these by using adaptive pairing in the assignment setup.
  • If you don't want participation grades to sync from ComPAIR to Canvas, these steps are not required. If you plan to manually enter ComPAIR grades in Canvas, you can do so without following these instructions and without having students click an assignment link.
  • Make sure students know that they have to click each ComPAIR assignment link in Canvas for syncing to work, otherwise they won't receive the grades they expect!
  • If you will be including assignment links, it's best to remove all other links to ComPAIR from your Canvas course, so students don't accidentally click the wrong link (e.g., from the Course Navigation).

Where can I get more support with ComPAIR?

Technical support

If you have trouble with ComPAIR:

Learn more


« See all tools