What is SCTT-AI?
SCTT-AI is a neural network that is finetuned to score responses from the Scientific Creativity task.
SCTT-AI currently only supports English, but the model should perform well on responses that have been translated to English via Google Translate.
How do I use SCTT-AI?
To have your SCTT responses automatically scored, upload a utf-8 encoded CSV that includes a column named 'item' (e.g., How can you test if someone can read minds?) and another column named 'response', which contains the participant's response. The 'item' column should include an official SCTT item in each row; the model will not work for items that are not included in the formal SCTT item-set. The algorithm is case sensitive for the item/response column names, but it does not matter if other columns are present in the CSV.
The algorithm will add two new columns to your CSV: one named 'prediction' which reflects the model's creativity score and a column named 'modelname', which is added to reflect the model providing the score.
