National Institute for Literacy
 

[Assessment] Has U.S. Literacy increased, declined or stayed the same?

Jacobson, Erik EJacobson at air.org
Fri Dec 23 13:17:23 EST 2005


I have to admit that it is difficult for me to keep up with who said
what, and whose conclusions are whose. Yet the results don't seem that
puzzling to me. For example, these two statements:

1) There was no overall decline in the average score for prose literacy

2) The score for prose literacy dropped at every level of education

To me, the first statement precludes one from suggesting that prose
literacy has declined. In fact, given the reports of the scores of
African Americans (increases in all three), Asians and White (a mix of
increases and unchanged), it would seem that things are not so bad. The
reduced average scores of Hispanic adults is troubling, but I think the
combination of a more inclusive study and changes in demographics might
have more to do with it than any generalized decline in the nation's
literacy (defined by this instrument).

I also think that more than likely the second statement does not provide
evidence of a reduction in standards or of a reduced impact of higher
education. To measure the impact of higher education by this instrument,
you would have to track individuals' progress through the school system.
That is, what score did you have before you went to school and what did
you have after? This is also true at the societal level, if one is
trying to measure the impact of college spending on general literacy
levels. Again, since the study did not involve identifying what literacy
level was required by colleges, inferences about changes in the nature
of those requirements would not be supported by the data.

I think that framing it in terms of standards might confuse the analysis
of the decline at the different educational levels. Imagine that there
was a group of people in 1992 who had no college experience despite
having literacy skills that could possible provide entry. They didn't
have the high scores in literacy typically associated with college, but
were more on the line between going and not going. Now that more members
of this group are in college (the report notes more people falling in
that category), it would seem to do two things. First, it would reduce
the literacy levels of "those without college experience" because the
higher scorers from that category have been removed. A good thing, since
that means they are getting a chance to go to college. Second, the
average scores of those with college experience might be reduced because
this newly entering group is not beginning college with the same scores
of those that had been there in the past. Again, since there is no
preset score that indicates that one has met the standards for entering
college, I don't think you can automatically say that standards for
admission have declined.

The increased number of people who might show up as "high-education with
lower scores" (and therefore reduce the average score of the
high-education group) would only be a bad thing if once they were in
college their literacy scores did not go up, but this report cannot
address that because it is a not a longitudinal study - it is snapshot.
It is possible that although their scores are lower compared to past
averages, the college experience has increased their personal score
quite a bit. Of course it is also possible that it didn't, but we don't
know. Because of this ambiguity, I don't think one can jump to
conclusions about lower standards or a lowered impact of higher
education based on the results of this study.

Erik Jacobson




More information about the Assessment mailing list