Re: DSM: (Almost) errorless measurement


John Axtell (newlife@theofficenet.com)
Fri, 10 Nov 2000 12:21:45 -0800


Arie,

Where can I learn more about the TestBet program and BetVote.

John Axtell

Arie Dirkzwager wrote:

> Rick,
> The TestBet program in which I implemented the Multiple Evaluation
> method features also open ended questions. In that case the testee has to
> think up the "pile of possibles" (answer options) and assign the
> probabilities to them. But of course one could go further: the main thing
> is not to answer given questions but to ask the right questions and
> thinking about them is really furthering (new) knowledge. That should be
> trained in education. In that perspective Multiple Evaluation is a (minor
> but important) help. One could ask the students to formulate relevant
> questions and have them answered by their fellow students and see what
> happens. I extended "TestBet" to "BetVote" to do exactly that. In that way
> questions (not answers) can be evaluated. However the psychometrics of that
> approach is a little bit tricky.
>
> Kind greetings,
>
> Arie
>
> At 11:46 8-11-00 -0700, you wrote:
> >Arie,
> >the main problem is with the tests themselves. They don't measure real
> >knowledge. Real command of knowledge only shows itself in the presence of a
> >true problem. A true problem is not one in which the answer is known and must
> >be picked from a pile (That is just an exercise), but one in which the answer
> >doesn't yet exist and must be discovered or created. You may eliminate
> >guessing
> >from computer-graded standardized tests, but the only way you can measure true
> >knowledge is by how a person uses the knowns to find the unknowns. And
> >thus the
> >unknowns must be truly unknown to the person, and not just one of a pile of
> >possibles.
> >
> >Rick
> >
> >Arie Dirkzwager wrote:
> >
> > > With Multiple Evaluation we have a testing method with much less
> > > measurement error than the traditional Multiple Choice as guessing and
> > > gambling is really eliminated (not just "corrected for"). See
> > > http://www.xs4all.nl/~aried/MSMTERR.htm for a short article on this. The
> > > method is based on eliciting personal probabilities instead of "pock one".
> > > It should be used widely as a replacement of Multiple Choice. For more see
> > > my web site and the links it gives. I'd appreciate any comments.
> > >
> > > Arie Dirkzwager
> > >
> > > BetterSystems,
> > > Prof.Dr.A.Dirkzwager,
> > > Educational Instrumentation Technology,
> > > Computers in Education.
> > > Huizerweg 62,
> > > 1402 AE Bussum,
> > > The Netherlands.
> > > voice: x31-35-6981676
> > > E-mail: mailto:aried@xs4all.nl
> > > web site featuring educational testing methods:
> > > http://www.xs4all.nl/~aried/home.htm
> > > {========================================================================}
> > > When reading the works of an important thinker, look first for the
> > > apparent absurdities in the text and ask yourself how a sensible person
> > > could have written them." T. S. Kuhn, The Essential Tension (1977).
> > >
> > ============================================================================
> > > Accept that some days you are the statue, and some days you are the bird.
> >
> >--
> >"Heaven and skid row are separated only by an act of
> >consciousness." Robert A.
> >Johnson
>
> BetterSystems,
> Prof.Dr.A.Dirkzwager,
> Educational Instrumentation Technology,
> Computers in Education.
> Huizerweg 62,
> 1402 AE Bussum,
> The Netherlands.
> voice: x31-35-6981676
> E-mail: mailto:aried@xs4all.nl
> web site featuring educational testing methods:
> http://www.xs4all.nl/~aried/home.htm
> {========================================================================}
> When reading the works of an important thinker, look first for the
> apparent absurdities in the text and ask yourself how a sensible person
> could have written them." T. S. Kuhn, The Essential Tension (1977).
> ============================================================================
> Accept that some days you are the statue, and some days you are the bird.



This archive was generated by hypermail 2.0b3 on Sun Nov 12 2000 - 19:48:14 EST