Hi Marie, Bruce and All,
 
These kinds of constructed response assessments are easier to build that selected-response, but MUCH harder to score. The REEP is one Performance Assessment with which many of us are familiar.  It is a standardized, constructed-response tool, and I think we can look at its statewide implementation as a bellwether of using more authentic, alternative assessments.  
 
In Massachusetts, a lot of time and effort goes into standardizing scorers, initially and continually, in order to ensure that the tool is being used according to its design. Despite the institutional commitment of the DOE, it is a great struggle, perhaps even an act of faith, to ensure that all scorers are aligned.  We all know of cases where two scorers, reading the same essay and using the same rubric, show a startling disparity in points awarded.
 
This is not to say that authentic assessment is invalid or undesirable; I fell that they are MORE authentic, valid and desirable... but we need to keep an eye on their reliability.  As we put forward the strengths of these tools, we must be ready to acknowledge and pro-actively address their limitations by diligently and thoroughly preparing these tools.  This is not as hard as it might sound: we must be sure that the tools we select are design actually measure the domain for which we aim and we must make sure that we use them reliably, i.e., with some standardization (which is NOT a four-letter word).  We can't just take them off the shelf and expect one size to fit all- that's what gave "standardized testing" its bad name in the first place.
 
Every teacher designs assessments for their own class- I have a great presentation rating form, but it only works for the specific curriculum.  I'm sure that others have great things as well and I'd like to get ideas from them; what's the best way to get these out in the field, and discuss where they are appropriate?
 
 
-----Original Message-----
From: assessment-bounces at nifl.gov [mailto:assessment-bounces at nifl.gov]On Behalf Of Marie Cora
Sent: Thursday, February 02, 2006 11:52 AM
To: Assessment Discussion List
Subject: [Assessment] Legitimacy of alternative tools


Hi Bruce and everyone,
 
Bruce, you said:
 
"I think putting forth the strengths and legitimacy of tools such as portfolios, outcome checklists, holistically scored writing samples, etc is a good way to go."
 
This sounds like a very good path to go down to me.  I think people would have a lot to say and share about alternative tools, their uses, and their strengths.  It would be a great exercise to list them all out and discuss the strengths, uses, and limitations of each one.
 
What questions do folks have about alternative assessments?:  using them, seeking them out, developing them, whatever area most intrigues you.
 
What can folks share with the rest of us in terms of "the strengths and legitimacy" of alternative tools such as portfolios, checklists, analytic/holistic scoring, rubric use, writing samples, in-take/placement processes?
 
Are any of the tools you use standardized?  Not standardized?  Do you think that this is important?  Why or why not?
 
Are any of the tools used for both classroom and program purposes?  
 
I have other questions for you, but let's leave it at that for right now.  Let us hear what your thoughts are.  We're looking forward to it.
 
Thanks,
 
marie cora
Assessment Discussion List Moderator
 
 
 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.nifl.gov/pipermail/assessment/attachments/20060202/8031989b/attachment.html