peerScholar Instructor Guide

peerScholar Logo
peerScholar is a peer review tool that allows a high degree of granularity and customization in how you have students review one another’s work. peerScholar assignments have three phases: students submitting work, students evaluating peer work and providing feedback, and students reflecting on the outcomes (e.g., reading the feedback received and, optionally, evaluating the feedback and/or revising and resubmitting their work).
Cost Yes Free (funded until at least December 31, 2021)
Bandwidth Yes Low demand
Canvas Integration Yes Works in coordination with Canvas
Privacy Yes peerScholar is FIPPA compliant and data is stored securely in Canada
Similar UBC-Supported Tools CLAS and ComPAIR are also centrally supported for student peer assessment.

What can I use it for?

You can use peerScholar to facilitate student peer assessment (aka peer review) assignments:

  • Managing assignment collection of work done in groups or by individuals and automating distribution of this work to peers
  • Seeing how students mark and offer feedback on their peers’ work
  • Having students evaluate the feedback they receive and/or resubmit a revised work, as the final phase of the assignment

What to know about peerScholar

Warning: The LT Hub has made changes to the peerScholar Canvas integration as of August 26, 2021. Please contact the LT Hub if you require access to old courses or activities in peerScholar.

How are faculty using peerScholar?

Catherine Rawn uses peerScholar to encourage peer-based learning in psychology

Empirical data suggested that students may improve their own writing skills by reading that of their peers’ and being in that evaluator role. That extra layer of not just writing but having students evaluate appealed to me. There is a richer learning opportunity within the thinking process of evaluation that exposes people to more ideas, to a different lens of viewing written work, which will help them write better. Read More »

What do I need to use peerScholar?

A supported web browser

peerScholar runs in your web browser and supports using Chrome, Edge, Firefox, or Safari.

A Canvas course

peerScholar only works with Canvas courses at UBC.

Tips

  • Although peerScholar can be accessed outside Canvas, students must go through Canvas to properly register in your peerScholar course.
  • Students have different requirements to get started with peerScholar. Direct students to the peerScholar student guide for more information.

What should I consider before using peerScholar?

Before you dive in, it’s best to establish your assessment approach from a pedagogical perspective. This includes determining your plan for using peerScholar and how assessments will relate to grades.

Click any bar below for considerations for using peerScholar.

Plan your student peer assessments

As with any learning activity, how these assignments are introduced, designed, and integrated in courses impacts the student experience with peerScholar. A UBC pilot and related evaluation of peerScholar highlighted some general recommendations to consider in your planning.

  • Explain the learning objective(s) to students: Outline the end goal of using peerScholar in your course—why student peer assessment can help with learning and why peerScholar was been chosen for doing the activity.
  • Clearly articulate peerScholar’s phases and process to students: The workflow can be complicated, especially if you include extra steps like the feedback-on-feedback, self-assessment, and/or revision. Make sure students understand what will be involved in the assignment and when each step needs to be completed.
  • Train students to use contextual commenting: peerScholar lets students directly annotate each other's assignments, and this contextual feedback can be helpful for learning, as it encourages granular engagement with peer work. However, the feature can be a bit hidden, unless students are trained in how to use it.
  • Enable and incentivize the feedback-on-feedback feature: peerScholar allows students to evaluate the feedback they receive. This feature is another reported perk of the system, both from student and instructor perspectives, as it closes the feedback loop, allowing students to learn what makes peer feedback more or less useful. Adding marks for how deeply students engage with their feedback evaluations can motivate students to leave more detailed feedback-on-feedback.
  • Prepare to deal with marking variations: Not all students will complete all phases of the assignments, so be prepared for how to grade around these drop-offs. For example, if you will use the marks that students receive on their feedback as part of grading, consider how you will accommodate a student whose feedback was only marked by one student.
  • Run internal test assignments before going live: Test assignments completed by the teaching team are a good way to identify if what you want to do with the tool is possible and practical.

You will also want to think about how many student peer assessments each student should complete, keeping in mind the time it will take to review the type of work you assigned.

Develop your student peer assessment rubrics

In peerScholar, you can set up virtually any kind of assessment, customizing both the questions and question types that you have students respond to in their assignments. You will set the questions for the assessing phase (where students review one another's work) as well as the optional self-assessment phase (where students review their own work) and the feedback evaluation phase (where students review the peer feedback they've received). Questions can be assigned relative weights, depending on how important each criterion is to that phase of the assignment.

To develop your rubrics, start with the course learning outcomes and think about how evaluations will help students get there—what can students learn from each other? Keep in mind how experienced students in the course will be, and use rubrics at a difficulty level the majority will be able to understand. Requiring detailed written peer feedback as part of the evaluation also helps students think more deeply about the peer work they review.

Note that peerScholar does not incorporate a training phase. You can instead plan an in-class activity before the first assignment to discuss the rubrics with students and model or have students practice applying the rubrics to peer work.

Decide on the timing of your assignment phases

You will need to decide how many peerScholar assignments you will give in the course as well as the timing for each phase of the assignment: creating, assessing, and reflecting. In deciding on the right amount of assignments and timing, consider the time commitment required from students to complete the phases as you've designed them. It may be difficult to fit more than three assignments per term, but this will depend on your context.

Choose how outcomes will influence grades

For each peerScholar assignment, you will be able to choose how marks are generated, meaning how much impact your marks, student peer marks, and participation marks have on each student's final grade. Once you've decided on this, you should communicate to students in the beginning how exactly marks will be generated, so they are not caught off-guard.

If you choose to use the marks given by students in the final grade, also ask yourself the following:

  • How will you examine peer assessments to ensure fairness and accuracy? When marks are on the line, students may sometimes try to influence them with exaggerated reviews (good and bad). How will you investigate outliers and what will you do with outliers?
  • What grading calculations will best fit for your course? Typically, peer marks count for a smaller percentage of the assignment.
  • How will you deal with marking variations? Not all students will complete all phases of the assignments, so you'll need to know how you'll grade around these drop-offs.

How do I use peerScholar?

To use peerScholar, you will start by creating a Canvas assignment and complete the setup in peerScholar. Students will then be able to go through the phases of creating, assessing, and reflecting.

Click any bar below for instructions and tips for using peerScholar.

Understand the peerScholar workflow

peerScholar asks students to perform student peer assessment in three sequential phases:

  1. Create - Many instructors have students submit a written assignment for peer assessment, but submissions can be in other mediums, including images and other multimedia.
  2. Assess - Each peer work is presented anonymously for students to analyze, mark, and provide feedback on, all based on the custom rubrics you set up when building the assignment. Students can also be required to assess their own work as part of this phase, using the same or different custom rubrics.
  3. Reflect - In this phase, students read and reflect on the peer feedback they received. Depending on how you set up the assignment, students may be asked to evaluate each piece of feedback they received and/or implement feedback suggestions by submitting a revised version of the original work.

To learn more about peerScholar's assignment phases and the underlying purpose of each, you can read the peerScholar vision document.

Set up a peerScholar assignment

Through Canvas, you can set up a peerScholar assignment that will be open to all students enrolled in your Canvas course. Assignments in peerScholar are called activities, but these terms are interchangeable.

  1. Log in to your Canvas course, and click Assignments in the Course Navigation.
  2. Click the +Assignment blue button in the upper right side of the screen.
  3. Enter the assignment name, e.g., "peerScholar Assignment #1".
  4. Scroll down to submission type and select External Tool from the drop-down menu.
  5. Even if you know the URL, click Find. (Entering the URL directly will not sync properly with Canvas.)
  6. From the list, pick peerScholar and click Select.
  7. Check Load This Tool In A New Tab.
  8. Save the assignment.
    • Don't publish this assignment yet, if your course is already live to students, as you will want to complete setup first.
  9. You will be redirected to the assignment page you just saved. Click Load peerScholar Link in a new window to be taken to the workflow in peerScholar for building your assignment.
  10. You will be prompted to create a new activity or copy an existing one. If you are creating a new one, select the activity type:
    • Classic Activity - An individual student peer assessment assignment.
    • Group Work Activity - A group student peer assessment assignment.
    • Case Study Activity - A conditional student peer assessment assignment, where different students see different cases or sets of instructions to respond to.
  11. Enter a name for the assignment, then click Create Activity and follow the prompts to finish setting up the assignment.
  12. Once your assignment is created, you will be taken to an overview page. Make the assignment visible to students in peerScholar by clicking the toggle for "Show Activity" here so it turns blue.
  13. The final step is to make the link to this peerScholar assignment visible in Canvas. Back in your Canvas course, navigate to the page for this assignment (if it is not open already), click Edit Assignment Settings, and scroll down to Save & Publish.

Tips

  • A peerScholar course is automatically created based on your Canvas course when you click the link to peerScholar from your first assignment. All subsequent assignments will be added to this peerScholar course.
  • You can get help merging multiple sections into one Canvas course, if you're running a large course with peerScholar and don't want to do this setup multiple times. Contact your Instructional Support Unit for help.
  • A new column in your Canvas gradebook will automatically be created when you set up each peerScholar assignment using these steps. You will still need to manually sync between Canvas and peerScholar using the steps outlined in the accordion on grading below.
  • You can learn more about each type of assessment available in peerScholar:
    • Classic Activity - An individual student peer assessment assignment, where students submit work, assess one another's work, and then receive peer feedback on their work. You can also ask students submit a revised work.
    • Group Work Activity - A group student peer assessment assignment, where work is submitted by the group and you decide whether assessing is done by the group or by each group member individually.
    • Case Study Activity - A conditional student peer assessment assignment, where different students see different cases or sets of instructions to respond to when they submit work initially. For the next phase, you can have them assess each other's work randomly, only assess work for the same case that they received, or only assess work for cases different than the one they received.
  • For any phase, you can add assessment questions that only the teaching team will see students' responses for; peers will not see these responses. When creating or editing an assignment, click the plus (+) icon on the right-hand side and follow the prompts to add these questions.

Monitor student progress on a peerScholar assignment

peerScholar provides detailed information about student progress and grades for each assignment.

  1. Log in to your Canvas course, and click Assignments in the Course Navigation.
  2. Click the peerScholar assignment you want to review, then click Load peerScholar Link in a new window.
  3. In the peerScholar interface, you will see an overview of the assignment, along with how many students have completed each phase and how many have been graded.
  4. Click the Student Progress & Grading tab at the top of the page to monitor student progress more closely.
  5. Click the Analytics tab for a visual overview of the completion rate and grade distribution.
  6. Under "Activities" in the left-hand sidebar, you can click any assignment name to switch to another assignment overview, if you have multiple assignments in peerScholar.

Tips

  • Help your students feel supported. Share UBC's peerScholar student guide with them and ensure they understand their expectations for participation.
  • Late submissions can be accepted if needed. This can be enabled for everyone from the Activity Schedule for the Create and Reflect phases, or from the Student Progress & Grading area for individual students for the Create, Assess, or Reflect phases.

Grade a peerScholar assignment and sync grades with Canvas

peerScholar allows you to manage grades within its interface and then sync those grades with the Canvas gradebook.

  1. Log in to your Canvas course, and click Assignments in the Course Navigation.
  2. Click the peerScholar assignment you want to grade, then click Load peerScholar Link in a new window.
  3. On the right side of the peerScholar assignment overview, you will see a grading box. Click Grade Now to open the grading interface.
  4. The name at the top will identify the student you are grading. Below, you will see the student's submission (original and, if included, revised), self-assessment (if included), and feedback received. Switch between peer reviewers by clicking the people icons in the bar below the student's name or switch to feedback the student gave by clicking View Given Feedback in the same bar.
  5. Enter your grade and feedback in the grading area on the right, then click Save.
  6. At the top of the page, you can advance to the next student by clicking the arrow or using the drop-down.
  7. Once you are done grading, click Back at the top left to return to the assignment overview.
  8. To sync the grade changes you've made with the Canvas gradebook, click Gradebook in the left-hand sidebar.
  9. Click Sync Grades at the top right, above the grading table.
  10. Select the sync method:
    • Smart Sync - Send only new or updated grades in peerScholar to the Canvas gradebook.
    • All Sync - Send all grades from peerScholar to the Canvas gradebook.
  11. Click Continue and a success message will appear at the bottom of the screen when the sync is complete. Although the sync request will be sent, it may take time to show in the Canvas gradebook.

Tips

  • You can update the grading scheme you set up for the assignment at any time and change how much impact your marks, student peer marks, and participation marks have on each student's final grade. From the peerScholar assignment overview page, click "Edit Grading" in the grading box to make and save your changes.
  • You can download a spreadsheet of the gradebook from peerScholar, if you prefer to manage grading outside the peerScholar interface (view an example peerScholar data spreadsheet, as customized for one UBC course). From the peerScholar assignment overview page, click "Gradebook" in the left-hand sidebar, then click "Download CSV" at the top right, above the grading table.
  • If you want students to see their grades in peerScholar, you can enable this. From the peerScholar assignment overview page, click the toggle for "Show Grades" so it turns blue. Note that this toggle controls the visibility of grades in peerScholar only and does not affect what students see in Canvas.

Where can I get more support with peerScholar?

Technical support

If you have trouble with peerScholar:

For supporting your students:

Pedagogical support

  • Connect with an educational consultant for guidance on how to incorporate student peer assessments into your course, by completing the CTLT’s request form and choosing “Consultation”.
  • For help with training students to review one another’s work, you can consider including the UBC-developed Peer Assessment Training Workshop in your course, prior to assigning your student peer assessments.

Learn more


« See all tools