Evaluation

Peer-to-Peer Review

Evaluation Phase 1

Wise Head Panel

Evaluation Phase 2

Technical Review

Evaluation Phase 3

MacArthur’s Board of Directors

Evaluation Phase 4

During the Peer-to-Peer review, each applicant will score and comment on five other applications within the same domain, using four criteria included in the scoring rubric: impactful, evidence-based, feasible, and durable. This is the same scoring rubric that the Wise Head Panel will use.

Scores will be calculated using an algorithm that ensures a level playing field for all applicants. In addition to scoring each application on the four criteria in the scoring rubric, Peer-to-Peer reviewers will also provide a final numerical score, ranging between 0-100, representing an overall assessment of quality for the entire application. We ask that each Peer-to-Peer reviewer carefully read the applications given to them and provide meaningful feedback.

The Peer-to-Peer review will result in a rank order of all valid submissions. Based on the rank order of scores, up to 500 applications will move forward to the Wise Head Panel review.

Using the scoring rubric, the Wise Head Panel members score and comment on up to 500 applications as determined by the Peer-to-Peer review. These applications will receive an additional five sets of reviews that have been statistically normalized. The Wise Head Panel review will result in a rank order of submissions. Based on the rank order of scores, up to 120 applications will receive a technical review.

Meet the Wise Heads

Based on the results of the Wise Head Panel review, up to 120 top scoring applications will receive domain specific technical reviews in which proposals will be assigned to a technical reviewer with expertise in the field of the proposed project.

Informed by the Wise Head Panel results and the technical review, MacArthur’s Board of Directors will select up to ten finalists. These finalists will be invited to work with a team of experts to further strengthen their proposals.

High-impact ideas designated as “Top 100” will be also named. These applications will receive recognition and support by being featured in our online database of the strongest proposals.

Selection of the final award recipient rests with MacArthur’s Board of Directors.

Meet the Board