LLM-Powered Reviews of Student Work Samples
Author
Aaron Carver
Title
LLM-Powered Reviews of Student Work Samples
Description
This notebook uses LLMs to review student work samples, specifically ACT writing essays
Category
Other
Keywords
Evaluation Rubric, ACT Essay Samples
URL
http://www.notebookarchive.org/2023-07-5kv909m/
DOI
https://notebookarchive.org/2023-07-5kv909m
Date Added
2023-07-12
Date Last Modified
2023-07-12
File Size
2.57 megabytes
Supplements
Rights
Redistribution rights reserved
Download
Open in Wolfram Cloud
LLM-Powered Reviews of Student Work Samples
LLM-Powered Reviews of Student Work Samples
Aaron Carver, Wolfram Summer School 2023
ACT Essay Samples and Evaluation Rubric
ACT Essay Samples and Evaluation Rubric
Essay Samples
Essay Samples
4-Category Rubric
4-Category Rubric
Applying a Descriptive Evaluation Rubric
Applying a Descriptive Evaluation Rubric
Whole-essay score, no rubric, (N=50, T=1, GPT-3.5-Turbo)
Whole-essay score, no rubric, (N=50, T=1, GPT-3.5-Turbo)
Whole-essay score, full rubric, (N=50, T=1, GPT-3.5-Turbo)
Whole-essay score, full rubric, (N=50, T=1, GPT-3.5-Turbo)
Per-category and whole-essay scores, full rubric, (N=50, T=1, GPT-3.5-Turbo)
Per-category and whole-essay scores, full rubric, (N=50, T=1, GPT-3.5-Turbo)
Per-category and whole-essay scores, full rubric, (N=50, T=1, GPT-4-Turbo)
Per-category and whole-essay scores, full rubric, (N=50, T=1, GPT-4-Turbo)
Per-category and whole-essay scores, full rubric, (N=25, T=0, GPT-4-Turbo)
Per-category and whole-essay scores, full rubric, (N=25, T=0, GPT-4-Turbo)
GEC via LLMExampleFunction for Few-Shot Learning, K={0, 1, 5, 10, 20}
GEC via LLMExampleFunction for Few-Shot Learning, K={0, 1, 5, 10, 20}
Introduction
Introduction
LLMFunctions for GEC Error Extraction
LLMFunctions for GEC Error Extraction
Utility Functions
Utility Functions
No Prompting (K=0)
No Prompting (K=0)
Prompting with Instructions (K=0)
Prompting with Instructions (K=0)
Essay 1 - False {Negative, Positive} Analysis
Essay 1 - False {Negative, Positive} Analysis
Essay 1, K=1, Calls=1
Essay 1, K=1, Calls=1
Essay 1, K=1, Calls=5
Essay 1, K=1, Calls=5
Essay 1, K=5, Calls=1
Essay 1, K=5, Calls=1
Essay 1, K=5, Calls=5
Essay 1, K=5, Calls=5
Essay 1, K=10, Calls=1
Essay 1, K=10, Calls=1
Essay 1, K=10, Calls=5
Essay 1, K=10, Calls=5
Essay 1, K=20, Calls=1
Essay 1, K=20, Calls=1
Essay 1, K=20, Calls=5
Essay 1, K=20, Calls=5
Essay 1, Comparable Services False {Negatives, Positives}
Essay 1, Comparable Services False {Negatives, Positives}
Essay 1, Few-shot learning results for K={1, 5, 10, 20}
Essay 1, Few-shot learning results for K={1, 5, 10, 20}
Essay 1 Plot for K = {1, 5, 10, 20}
Essay 1 Plot for K = {1, 5, 10, 20}
Essay 2 - False {Negative, Positive} Analysis
Essay 2 - False {Negative, Positive} Analysis
Essay 2, K=1, Calls=5
Essay 2, K=1, Calls=5
Essay 2, K=5, Calls=5
Essay 2, K=5, Calls=5
Essay 2, K=10, Calls=5
Essay 2, K=10, Calls=5
Essay 2, K=20, Calls=5
Essay 2, K=20, Calls=5
Essay 2, Comparable Services False {Negatives, Positives}
Essay 2, Comparable Services False {Negatives, Positives}
Essay 2, Few-shot learning results for K={1, 5, 10, 20}
Essay 2, Few-shot learning results for K={1, 5, 10, 20}
Essay 2 Plot for K = {1, 5, 10, 20}
Essay 2 Plot for K = {1, 5, 10, 20}
Essay 3 - False {Negative, Positive} Analysis
Essay 3 - False {Negative, Positive} Analysis
Essay 3, K=1, Calls=5
Essay 3, K=1, Calls=5
Essay 3, K=5, Calls=5
Essay 3, K=5, Calls=5
Essay 3, K=10, Calls=5
Essay 3, K=10, Calls=5
Essay 3, K=20, Calls=5
Essay 3, K=20, Calls=5
Essay 3, Comparable Services False {Negatives, Positives}
Essay 3, Comparable Services False {Negatives, Positives}
Essay 3, Few-shot learning results for K={1, 5, 10, 20}
Essay 3, Few-shot learning results for K={1, 5, 10, 20}
Essay 3 Plot for K = {1, 5, 10, 20}
Essay 3 Plot for K = {1, 5, 10, 20}
Essay 4 - False {Negative, Positive} Analysis
Essay 4 - False {Negative, Positive} Analysis
Essay 4, K=1, Calls=5
Essay 4, K=1, Calls=5
Essay 4, K=5, Calls=5
Essay 4, K=5, Calls=5
Essay 4, K=10, Calls=5
Essay 4, K=10, Calls=5
Essay 4, K=20, Calls=5
Essay 4, K=20, Calls=5
Essay 4, Comparable Services False {Negatives, Positives}
Essay 4, Comparable Services False {Negatives, Positives}
Essay 4, Few-shot learning results for K={1, 5, 10, 20}
Essay 4, Few-shot learning results for K={1, 5, 10, 20}
Essay 4 Plot for K = {1, 5, 10, 20}
Essay 4 Plot for K = {1, 5, 10, 20}
Essay 5 - False {Negative, Positive} Analysis
Essay 5 - False {Negative, Positive} Analysis
Essay 5, K=1, Calls=5
Essay 5, K=1, Calls=5
Essay 5, K=5, Calls=5
Essay 5, K=5, Calls=5
Essay 5, K=10, Calls=5
Essay 5, K=10, Calls=5
Essay 5, K=20, Calls=5
Essay 5, K=20, Calls=5
Essay 5, Comparable Services False {Negatives, Positives}
Essay 5, Comparable Services False {Negatives, Positives}
Essay 5, Few-shot learning results for K={1, 5, 10, 20}
Essay 5, Few-shot learning results for K={1, 5, 10, 20}
Essay 5 Plot for K = {1, 5, 10, 20}
Essay 5 Plot for K = {1, 5, 10, 20}
Essay 6 - False {Negative, Positive} Analysis
Essay 6 - False {Negative, Positive} Analysis
Essay 6, K=1, Calls=5
Essay 6, K=1, Calls=5
Essay 6, K=5, Calls=5
Essay 6, K=5, Calls=5
Essay 6, K=10, Calls=5
Essay 6, K=10, Calls=5
Essay 6, K=20, Calls=5
Essay 6, K=20, Calls=5
Essay 6, Comparable Services False {Negatives, Positives}
Essay 6, Comparable Services False {Negatives, Positives}
Essay 6, Few-shot learning results for K={1, 5, 10, 20}
Essay 6, Few-shot learning results for K={1, 5, 10, 20}
Essay 6 Plot for K = {1, 5, 10, 20}
Essay 6 Plot for K = {1, 5, 10, 20}
Plots for 2, 3, 4
Plots for 2, 3, 4
Plots for 5, 6
Plots for 5, 6
UI Markup
UI Markup
Cite this as: Aaron Carver, "LLM-Powered Reviews of Student Work Samples" from the Notebook Archive (2023), https://notebookarchive.org/2023-07-5kv909m
Download
