Exploring AI Tools
Evaluating AI Tools
The Rubric for AI Tool Evaluation provides a framework for assessing the strengths and weaknesses of AI tools based on a set of criteria, including functionality, accessibility, privacy, as well as pedagogical, ethical, and environmental considerations.
By evaluating these key areas, you can make informed judgments about the suitability of AI tools, ensuring that they align with your needs.[1] We have provided 2 versions below. The “Fundamental Criteria” version will allow you to perform an initial evaluation of a tool. The “In-Depth Criteria” version introduces more categories and criteria, facilitating a deeper examination of a tool.
Fundamental Criteria version
You can download the Rubric for AI Tool Evaluation: Fundamental Criteria version (opens in new window), or use the interactive version below.
To navigate this resource:
- Answer each of the 15 criteria to receive general feedback.[2]
- Overall results will be compiled on the Final page.[3]
In-Depth Criteria version
You can download the Rubric for AI Tool Evaluation: In-Depth Criteria version (opens in new window), or use the interactive version below.
To navigate this resource:
- Choose a category from the Table of Contents.
- Complete the evaluation criteria to receive general feedback.
- Overall results will be compiled on the Summary page.
Risk Mitigation Strategies
- Cross-check AI outputs with manual methods.
- Request detailed documentation from the tool provider.
- Implement additional data encryption. Limit data access permissions. Use tool in controlled environments.
- Utilize the tool in combination with other platforms. Encourage user feedback for customization.
- Explore middleware solutions. Regularly update integrations.
- Establish process for ethical review. Regularly review AI ethics guidelines and update practices accordingly.
- This resource is meant as an informal evaluation tool, with the aim of informing decision-making and conversations. Be sure to check with your local teaching and learning centre for advice, along with your local IT department's practices around evaluation and appropriate use of technologies. ↵
- Please note: questions reveal "correct" responses based on what's most ideal. An "incorrect" answer isn't "wrong" but indicates a potential point of concern for consideration and remediation. ↵
- "Works Well" responses receive 1 point. "Minor Concerns" and "Serious Concerns" receive zero points. ↵
