Innovation‘s framework for harnessing AI encompasses a set of strategies to maximize the new technology’s practical value. Few teachers just want to set their students loose on a chatbot! Innovation’s chat is corralled by important guardrails: interactions have a pre-set limited number, chats are recorded for later viewing and evaluation, and the AI response style is pre-set by the teacher. This provides the important bridle for the AI’s responses, setting age group and purpose for the chat.
Our company name “Innovation Assessments” is a little archaic to be sure. It dates back to a time when we were just a test generator site. That being the case, it should be said that evaluation still plays an important role in all our applications. This week, we added an AI grading assistant to the chat evaluations.
Imagine an assignment to a tenth grade social studies student to chat with the AI or with another student on the causes of the French Revolution. How well did they complete the task? Was their time chatting with the AI time well-spent? Did the student try to generate insightful responses to the AI’s questions and challenges? Did the student use the prompts wisely?
Imagine a student of French, CEFR level B, practicing with the AI to order a meal in a restaurant and to solve a problem with their order. Same questions: how well did they use their time with the chatbot? Did they achieve the objective of the dialogue?
Two applications exist for evaluating student participation in a chat. The main individual scoring application is found from the playlist controls for the task under the Task dropdown. Choose “Score”.
The build-in rubric lets teachers assess the quality, etiquette, appropriateness, and form of the student’s work. Click “AI Score” to get the AI’s suggested score.
Like all of the AI assistants at Innovation, the application is designed to present AI work product for teacher approval before being saved or presented to students.
The original scoring mode is still installed. Teachers run the chat program from the course playlist and then click Scoring Mode from the buttons on the left of screen.
Each chat is organized into a thread with a nickname (the name of a world capital city). This feature is useful for scoring chats between students in the class and that was how it was originally developed. The AI scoring assistant is installed here as well.
At Innovation Assessments, we believe in empowering teachers with tools that not only streamline their work but also deepen their understanding of student progress. AI-Assisted Chat Scoring is a testament to this commitment, transforming how you evaluate conversational learning while ensuring you remain in control. We’re excited for you to experience how this new feature, alongside our existing robust evaluation tools, will revolutionize the way you foster engaging and effective student interactions.