Re: DSM: (Almost) errorless measurement


Arie Dirkzwager (aried@xs4all.nl)
Fri, 10 Nov 2000 22:25:42 +0000


At 12:21 10-11-00 -0800, John Axtell wrote:
>Arie,
>
>Where can I learn more about the TestBet program and BetVote.
>
>John Axtell

Dear John,
         see my web site (mentioned in my signature)

Arie

>Arie Dirkzwager wrote:
>
> > Rick,
> > The TestBet program in which I implemented the Multiple Evaluation
> > method features also open ended questions. In that case the testee has to
> > think up the "pile of possibles" (answer options) and assign the
> > probabilities to them. But of course one could go further: the main thing
> > is not to answer given questions but to ask the right questions and
> > thinking about them is really furthering (new) knowledge. That should be
> > trained in education. In that perspective Multiple Evaluation is a (minor
> > but important) help. One could ask the students to formulate relevant
> > questions and have them answered by their fellow students and see what
> > happens. I extended "TestBet" to "BetVote" to do exactly that. In that way
> > questions (not answers) can be evaluated. However the psychometrics of that
> > approach is a little bit tricky.
> >
> > Kind greetings,
> >
> > Arie
> >
> > At 11:46 8-11-00 -0700, you wrote:
> > >Arie,
> > >the main problem is with the tests themselves. They don't measure real
> > >knowledge. Real command of knowledge only shows itself in the
> presence of a
> > >true problem. A true problem is not one in which the answer is known
> and must
> > >be picked from a pile (That is just an exercise), but one in which the
> answer
> > >doesn't yet exist and must be discovered or created. You may eliminate
> > >guessing
> > >from computer-graded standardized tests, but the only way you can
> measure true
> > >knowledge is by how a person uses the knowns to find the unknowns. And
> > >thus the
> > >unknowns must be truly unknown to the person, and not just one of a
> pile of
> > >possibles.
> > >
> > >Rick
> > >
> > >Arie Dirkzwager wrote:
> > >
> > > > With Multiple Evaluation we have a testing method with much less
> > > > measurement error than the traditional Multiple Choice as guessing and
> > > > gambling is really eliminated (not just "corrected for"). See
> > > > http://www.xs4all.nl/~aried/MSMTERR.htm for a short article on
> this. The
> > > > method is based on eliciting personal probabilities instead of
> "pock one".
> > > > It should be used widely as a replacement of Multiple Choice. For
> more see
> > > > my web site and the links it gives. I'd appreciate any comments.
> > > >
> > > > Arie Dirkzwager
> > > >
> > > > BetterSystems,
> > > > Prof.Dr.A.Dirkzwager,
> > > > Educational Instrumentation Technology,
> > > > Computers in Education.
> > > > Huizerweg 62,
> > > > 1402 AE Bussum,
> > > > The Netherlands.
> > > > voice: x31-35-6981676
> > > > E-mail: mailto:aried@xs4all.nl
> > > > web site featuring educational testing methods:
> > > > http://www.xs4all.nl/~aried/home.htm
> > > >
> {========================================================================}
> > > > When reading the works of an important thinker, look first for the
> > > > apparent absurdities in the text and ask yourself how a sensible person
> > > > could have written them." T. S. Kuhn, The Essential Tension (1977).
> > > >
> > >
> ============================================================================
> > > > Accept that some days you are the statue, and some days you are the
> bird.
> > >
> > >--
> > >"Heaven and skid row are separated only by an act of
> > >consciousness." Robert A.
> > >Johnson
> >
> > BetterSystems,
> > Prof.Dr.A.Dirkzwager,
> > Educational Instrumentation Technology,
> > Computers in Education.
> > Huizerweg 62,
> > 1402 AE Bussum,
> > The Netherlands.
> > voice: x31-35-6981676
> > E-mail: mailto:aried@xs4all.nl
> > web site featuring educational testing methods:
> > http://www.xs4all.nl/~aried/home.htm
> > {========================================================================}
> > When reading the works of an important thinker, look first for the
> > apparent absurdities in the text and ask yourself how a sensible person
> > could have written them." T. S. Kuhn, The Essential Tension (1977).
> >
> ============================================================================
> > Accept that some days you are the statue, and some days you are the bird.

BetterSystems,
Prof.Dr.A.Dirkzwager,
Educational Instrumentation Technology,
Computers in Education.
Huizerweg 62,
1402 AE Bussum,
The Netherlands.
voice: x31-35-6981676
E-mail: mailto:aried@xs4all.nl
web site featuring educational testing methods:
http://www.xs4all.nl/~aried/home.htm
{========================================================================}
When reading the works of an important thinker, look first for the
apparent absurdities in the text and ask yourself how a sensible person
could have written them." T. S. Kuhn, The Essential Tension (1977).
============================================================================
Accept that some days you are the statue, and some days you are the bird.



This archive was generated by hypermail 2.0b3 on Sun Nov 12 2000 - 19:48:14 EST