Allow admins to set a maximum number of applications to be assigned per reviewer.

Problem:User recruits alumni to review, and because they are reviewing 2-3 extensive essays per opportunity, they only want to assign each reviewer 20 applications. They believe that alumni won't sign up to review if they think they will have to read more than 20.

Manual assignments would be arduous, but using auto-assign means reviewers could be assigned more than 20.

  • Mary Trautman
  • Mar 23 2018
  • Reviewed: Voting Open
Employee Name Mary Trautman
Client Name "shard name" ucla, calalumni
User System Admin , Reviewer
Functional Unit Assigning Reviews
  • Attach files
  • Jessica Beatty commented
    March 28, 2019 22:01

    UCLA has extremely short time-frames to turn around reviews for a large group of applicants: In this case over 2100 applications in 2 days. They Learned the random assignment maximum wasn't going to work for them to form a meaningful number of applications to each (15, in this case). 

    In addition to using the opportunity as a tool for Enrollment Management, Alumni is using these application reviews as an engagement opportunity in hopes it will eventually drive more donor giving to Alumni scholarships, so we don't want to discourage them from fully engaging those in the reviewer group by offering less applications. In addition, the time-frame is not going to get any longer- UCLA receives the most admissions applications in the nation- over 100,000 the past few years- so we're not going to be able to get our admissions decisions any earlier, before reviewing scholarship applications and then get through any additional requirements (interviews, audition, competitions, etc.) and such by mid-April, when we hold our welcome event, Bruin Day, for all admitted students.

    I think many of us have these short turnaround times and having minimums and increased maximums on the random assignment function would allow us the flexibility to get large applicant pools read in a short time, whether the reviewer group is small or large.

  • Admin
    Carrie Goldberger commented
    March 21, 2019 14:10

    UCLA has a similar use case -

    Issue: Reviewer Groups autoassign only go up to "At Most 5 Reviews per application." From case 017118472, "Would it be possible to expand the options on the Reviewer Group template to include minimums and a higher maximum? For example, I have an opportunity with 2000+ reviewers to read about 1500 applications. They require a minimum of 3 reviewer scores and as many as 15. Right now, I can only go up to 5 max on automatic assignments."

    They have a reviewer group with ~2,000 reviewers: https://prospective-ugstudents-ucla.academicworks.com/admin/reviewer/groups/2
    They require at a min. 3 reviews per application and a max of 10
    The "At most 5 reviews per application" does not allow a min of 3 reviews because there can be a large number of reviewers who end up not doing the work.
    They also have people complaining that they do not have enough applications to review...
    We suggested they can use the lock feature for those that back out of reviewing. but they say they have a hard time knowing with ~2,000 reviewers...
    In the meantime, they said they will have to manually assign reviews by creating more RGs and manually assigning them in bulk to each group of reviewers.