How to Design a TW Edition to Store Exam Questions and Their Answers

#1

Purpose: Create a notebook to store exam questions for a course with their answer
Tools: TiddlyWiki, CodeMirror, KaTex, Shiraz, Commander, Section-Editior, Autocomplete

Design Objectives

  • A question is stored in single tiddler (I call it QT: Question Tiddler)

    • The QT has colorful tags

      • Easy in green
      • Moderate in yellow
      • Difficult in red

    • The QT has few fields

      • The source: the place you take the question, name of textbook, web, or course pamphlets tiddler
      • The exam : the name of semester, this question is used like Winter 2024, or Fall 2018
      • The description or caption: to store a short description or a longer title for the question
      • The topic refers to course topics like: linear algebra, initial value problems, can store more than one topic

  • The answer tiddler which stores the answer to a question (I call it AT: Answer Tiddler)

    • The AT has few fields
      • question to store the name of tiddler contains the question
      • description to store short description on how problem solved e.g. method
    • The AT transclude the question tiddler
    • The AT uses Section editor when the answer is long or multipart

  • On click on an exam e.g. Winter 2024 a tiddler is opened with all questions in that exam are transcluded

  • A sidebar tab to show all questions with title, dificullty level, description and list of exams in them this question is used

More input please. What do you think?

2 Likes
Problem Deck Plugin (Pdeck)
#2

Further idea: An Exam Maker, Test Maker, or Quiz Generator

A form to get some inputs like:
Exam semester
Topics
Number of questions

and then on press a tiddler is created with random questions selected from the database (all those QTs)

#3

Very interesting ideas!

Would you have students taking the exams/quizzes in this tool, or would you use it to generate printed material for them to use? For text-heavy disciplines (English, history, philosophy [Hi @springer! :slight_smile: ], etc.), using the tool for taking the tests would make sense. But for notation-heavy disciplines (math [Hi @Ste_W! :slight_smile: ] or chemistry [is this you @Mohammad?], etc.) I canā€™t see how to teach the students to enter technical notation simply, even if they have KaTex or similar available.

Another possible extension: Use this to track studentā€™s performance: ā€œHmm, only 32% of students got full-credit on question 37; I guess itā€™s not really an easy one. Do I need to spend more classroom time on that section?ā€

2 Likes
#4

I did some messing on this a few years ago for setting and marking maths questions but ground to a halt.
A very work in progress (or not) tiddler here:
https://steachertests.tiddlyhost.com/#Force%20Question%201

https://steachertests.tiddlyhost.com/#Question1

#5

Hi Scott,
Well this is a teacher notebook. It used to act as a database for questions with answers.
Thank you for the references. I follow the works by both of them (@Springer and @Ste_W)

#6

Thank you for the link and for the Engineerā€™s Textbook.

1 Like
#7

Iā€™m a big fan of proximity.

My approach: a question and an answer always exist in the same tiddler. That tiddler is a ā€œdeployedā€ tiddler.

The questions to be deployed, letā€™s call them repository tiddlers. They might or might not have answers to the questions, but those are meant for the teacher. When the teacher deploys a question tiddler (for an exam/test or assignment), the answer is stripped away.

Something like that.

3 Likes
#8

One reason I have separated tiddlers is the are big one. I went through section editor to be able to edit and maintain them. Normally an answer is in range 20-40 lines with several formula.

#9

To explain my rational for anybody interested, otherwise definitely disregard:

Proximity, for me, always takes precedence over the size of any one field (or however many fields).

In one tiddler, the parts (question and answer) will always be together, and the answer will always reflect the question as it existed at the time the answer was created. A self-contained and ā€œforeverā€ together unit.

2 Likes
Bulk conversion of embedded image tiddlers into _canonical_uri tiddlers
#10

This is a great idea and something Iā€™d always wanted to be able to easily do.

Suggestions for additional fields:

  • Module (Moodle calls these courses) code if such a thing exists ā€“ maybe this is covered by topic but the same topic could be covered in different modules (basic/intermediate/advanced whatever)
  • Similar questions ā€“ I know itā€™s generally not considered good practice to repeat questions in subsequent years but maybe one has a question where the calculations are the same but the data are different

If exactly the same questions is used (yes, itā€™s been knownā€¦) then include the possibility of recording this in the ā€˜yearā€™ and/or ā€˜moduleā€™ fields ā€“ i.e. multiple values in each field. One could then track the questions used each year and recreate the exam for ā€˜Fall 2018ā€™ in the future

Many thanks for an interesting idea and thread.

1 Like
#11

I did this My TiddlyWiki ā€” Experiments and stuff which might be helpfulā€¦

https://steachertests.tiddlyhost.com/#Question1

#12

Oh, thatā€™s great stuff! But do you actually have students using that format in real-time exams?

#13

No, I never developed it further, time and a shift in the modules I was teaching.

#14

I just remembered some parts of these design have been implemented in TiddlyWiki Garden

Tiddlywiki Garden ā€” demonstrate, practice and learn Filters and CSS

2 Likes
#15

I love this idea and the design ideas behind it.

I have nothing close to it. I created a questionnaire. Not sure any ideas here will help.

https://clsturgeon.github.io/MemoryKeeper#Genealogical%20Questionnaire

1 Like
#16

Interesting design. Thank you for sharing, Craig.

1 Like
#17

A quick search for quizz in the linksTW throws up:

https://ooktech.com/jed/ExampleWikis/Oppiaish%20Thing/

And

http://twiz.tiddlyspot.com/

For something to ponder

1 Like
#18

In the AT I would rename description into guidance or guide or may be hint, so it can not be mistaken. ā€“ Just an idea

1 Like
#19

I havenā€™t had time to follow the whole thread.

Iā€™ll just chime in that there are lots of different kinds of questions, and they may require different kinds of tiddler-structures (of course).

Hereā€™s a set of what I call ā€œMulti-choicesā€ questions, in a fully-functioning higher-ed wiki that has been actively under development for years.

Theyā€™re probing for deep comprehension of readings, and structured superficially like ā€œmultiple choiceā€ questions ā€” except thereā€™s no process of elimination! Any subset of responses (any number, potentially including none or all) can be correct. So, you could also think of each question as a cluster of true-false questions, independently scored, but with five at a time (on my model) sharing same thematic framing.

(The pedagogical situation is that these are initially discussed in groups, under ā€œopen bookā€ classroom conditions, though itā€™s impossible to do well in real time without advance preparation. Often the juxtaposition of alternate responses to the same basic prompt helps to foster discussion ā€” one student recognizing a claim that was explicit in the text, another noticing that a certain option exaggerates, or smuggles in a concept thatā€™s really accurate only for a prior reading, etc.)

Right now, Iā€™ve only set up the site for self-quizzing purposes, as well as displaying (and printing) in a classroom setting so that answers are available for discussion immediately after papers are submitted. Iā€™ve also printed (customized) exams using list-conditions based on this format.

Iā€™ve not tried to set up anything like a procedure that would allow this to function as an online exam or at-home quiz (say, for a student who has prepared for class but canā€™t attend due to illness or emergency).

These questions (with answers) are currently each packed into a single tiddler (as preferred by @Charlie_Veniot). Their order and the associated details widgets are currently hard-coded in the body of each tiddler (though the fine-grained contents are actually articulated within an old FileMaker database, which churns out the TiddlyWiki body text).

Iā€™ve considered refactoring into a more fine-grained structure in TiddlyWiki because of the structural complexity of the five multiple-choices options. Clearly it would be super-neat to articulate the data more neatly (either into carefully named fields, or into separate tiddlers) and to be able to shuffle the order of answers, or tweak their presentation details, via template-level changes. Further, if I ever want an automated process for selecting and scoring responses, the current structure would be insufficient ā€” since self-evaluation on the current model is simply a matter of verbal/visual recognition that is available to the student through the detail disclosure GUI of each tiddler.

5 Likes
#20

Thank you for your post, the shared wiki and your comments.
My purpose at this stage is to have teacher course notebook, so students do not have direct access to the notebook wiki. The teacher/lecturer/professor uses the wiki as a notebokk for a semester in that the course is taught. It acts as a source for exam questions with solution/answer and grading. The wiki acts as a database for future exams or solved problems selectively exported as pdf/html and distributed during the semester to students in the class.

I found the Grok TiddlyWiki @sobjornstad form of Questions/Answers inspiring, also the TiddlyWiki Garden from kookma library.