I knew, when I decided to come to Stanford, that there would be days I would wish I had gone to UCSD instead (just as the reverse would have been true). I did not expect that one of those days would come so early.
Those that know me know that I care little for grades. I am perfectly capable of assessing my own learning. What I desire, instead, is feedback, constructive criticism, helpful advice. Harsh doesn't hurt. On the contrary, the more direct the feedback, the more specific the criticism, the better. I want to be a better writer, a better thinker, a more skilled lover of wisdom.
In one (or two) of my courses this quarter, however, I'm feeling something of a crisis of purpose. The course is a core requirement for all Stanford PhD students, a course that, in principle anyway, is at the heart of what we're doing and learning as future researchers. The course is a methods course, an introduction to research methodology and thinking.
It is in this course that we recently read a piece by Jerome Kagan. The piece was the first chapter of his "The Three Cultures," and, frankly, it's one of the worst pieces of writing I've read in a long time. Its point - that different research methodologies* have different cultures - was blindingly obvious, but its construction was totally inane, ranging from disorganized to grossly oversimplified to needlessly complex. Phrases like "the critical point is" appeared over and over, often referring to disparate ideas, while the phrase "to put it simply" appeared in front of one of the most complex formulations in the text. A single paragraph mentioned algae, bees, and ferrets in an effort to make a point about language, but the point got lost in the bestiary.
* That is, the hard sciences, the social sciences, and the humanities.
All of this was prefaced by two inexcusable writing decisions. The first was a table that shouldn't have been a table. The table charted "dimensions of research cultures" against those cultures, with the horrifying result that some cells contained whole sentences formatted like bad poems. Note to self: anytime you put a 20 word sentence in a table, try to make the cells wide enough so that you do not to have one word per line.
The other decision - perhaps graver - was an invocation of Ludwig Wittgenstein near the opening of the text. Wittgenstein, if you don't know, is famous for destabilizing theories of language and meaning with his not-always-clear, fragmentary texts. He challenged the assumption that words meant the same thing all the time, and ultimately convinced everyone from philosophers to linguists to social scientists that context is really important - perhaps the only thing that is important - to meaning.
Kagan uses Wittgenstein, then, to begin his treatise on the three cultures. His citation of the philosopher is made to preface his own observation that, within different research paradigms, different words have different meanings. Fear, for example, means a different thing to an English professor than to a Behavioral Psychologist.
Which is all well and good, of course, if blindingly obvious. No, the offense here was pointing to Wittgenstein as the divider of the disciplines. It perhaps did not strike Kagan as supremely ironic that Wittgenstein himself probably would not have been all that excited by the theoretical division of the "three cultures" of modern academic research, that Wittgenstein's ways of thinking were in equal part scientific, social, and humanistic, that his methodology was not easy to categorize by the very system that Kagan found Wittgenstein to be the father of.
Behind my disgust at reading page after page (after page) of the drivel in "The Three Cultures"* was a lurking fear. You see, this was not something I was reading on my own. No, this was one of the first pieces that I was meant to read as a PhD student at Stanford University. In some sense, this was canonical, brilliant, an important work for me to contemplate and consider.
* I prefer to be a generous reader, but in this case I cannot think of a single redeeming quality of the piece.
With even greater horror I turned to my assignment: I must summarize this monster and, what's more, apply its reasoning to my own potential research interests. The written summary is, I think, a poor piece of pedagogy and assessment as is, but it's doubly hard when the work in question is of such poor quality.
Being the contrarian that I am (nicht diese tone, after all), I decided to write a poem. I suspected this might get me in trouble, to a degree, but I have always tested academic limits (often to my benefit) throughout my time as a student. This was not, for example, the first poem I've turned in on a non-poetry assignment, and historically my assessors have appreciated the change of pace, as well as the effort at creative insight. Some have leveled a warranted "don't do that again" at me, as well, but at least there was respect for the process.
In this case, I borrowed some of Kagan's language, inserted a one-sentence statement of the simple fact - that different research cultures are different, basically - and ended with the observation that "somebody misappropriated the Wittgenstein." It was, in my opinion, a funny but not inaccurate piece of analytical and synthetic work considering the quite dull material with which I was presented. It was not a good poem, but it was not meant to be. Good poems (and perhaps good writing of any kind) need subject matter worth writing about. Of course I could have, in less time and probably with better results - at least from the Professorial point of view - done a traditional summary, but if I'm going to spend hours reading a piece of drivel, I intend not to bore myself by writing the same kind of drivel in response.*
* It is worth noting that the Kagan piece was poor writing by academic standards as well. It was flowery and full of needless metaphors. It was organized so that multiple and unclear ideas populated each sentence. It was a mess.
In response to my poem (and, for the other reading, an interpolation of the reading into Plato's Meno; another, I thought, interesting and synthetic attempt to summarize the work without driving myself totally mad at the grade-school-book-reportiness of it all), I received a "check-minus" with a note that I did not summarize Kagan, and that I should look at my classmate's example passages for help.
Hence my crisis. I know how to summarize a piece of writing. I can write a clear and concise sentence when it is worth writing. But I am not here to learn how to regurgitate simple information poorly presented. And yet, increasingly, that is how I feel my classes are designed. Classes taught ostensibly by critical pedagogues - who believe in student-run classrooms and dialogue and activity - are two-hour lectures.* Courses in research methodology involve no training in research or methodology, but rather middle-school level assignments that ask primarily that I demonstrate not that I understand the ideas of a text or am striving to make them my own, but rather that I have done the reading, and am able to copy and paste important ideas into equally vapid academic jargon.**
* A fact that would amuse me were it not so sad. It is a shocking revelation that the people who teach teachers to teach (and teach education researchers to assess good teaching) - that is, School of Education Professors - are such poor teachers.
** Perhaps that is "methodology" to the modern researcher? If so, academia is in worse trouble than I thought.
Perhaps I was mistaken in thinking that Education research was open to people who value ideas as much as research, people who value creativity, process, and inspiration as much as method and practice. It is not that I discount research, method, or practice, it is rather that I see so little of the other stuff that I'm beginning to wonder, well, whether wonder is a part of the equation at all.
Again, I don't really care about grades. I could get a check-double-minus or a D or whatever and that wouldn't bother me. No, what bothers me is that the feedback I received misses the point entirely. It bothers me that the conversation is one way. That the pedagogy is so deeply flawed. That the underlying philosophy is so undemocratic. That the value system is so blindly accepted that it cannot see that, maybe, a whimsical, irreverent, and sarcastic spark might have merit beyond "not being a summary." Of course it wasn't a summary; it was a condemnation.
If a summary had been worth writing, I would have written one. Give me an assignment worth doing, an article worth reading, a conversation to have (instead of a lecture to attend to), and I will produce high quality work.* Give me a class worth taking - do not waste my time for three hours at a time with your pontificating and your holier-than-thou elitism (tenure alone does not make you interesting). I, too, am an intellectual. I, too, love ideas, perhaps more than you would believe. I, too, can speak and listen. I, in my own way, am well-read. I have stood in front of students and shut myself up so that they might speak, and it was wondrous. Yet, if no such thing can happen even here, at Stanford University, in a PhD program, in Education, can we hope for it to happen anywhere else?
* I might as well say the same for any and every student, and yet this lesson learned so well in research has not been learned in practice even by the very researchers who teach it.
It is not my assignment that makes me wonder about all of this. That is but a small and ultimately meaningless symptom of a much deeper problem. Nevertheless, it is an indicative example of the bigger picture: a case in which, it now seems obvious to me, the result was destined both because of how I was inevitably to respond to the assignment, and how the assignment, so to speak, was going to respond back to me. And so the deeper culture becomes the question, and leaves me with an exhortation.
Instead of demanding that I fit into your narrow boxes, academia, you would do well to invite and celebrate your radicals, your creative thinkers, your irreverent teachers, your trouble-makers. I know that UCSD does, and yet I chose Stanford, in part, because I believed that it did as well. Now I'm not so sure.
Showing posts with label homework. Show all posts
Showing posts with label homework. Show all posts
Tuesday, October 11, 2011
Saturday, February 13, 2010
The Meaning of Grades
One of the biggest assumptions of our education system is the need for graded assessment, or evaluation. For many colleges, grades and SAT scores make up the entire admissions process. For policy makers, the debate centers around how to improve those scores, taking for granted that they are good measures of learning.
I would argue that the main thing grades assess is a student's ability to get a good grade, and the main thing a standardized test score assesses is a student's skill in taking standardized tests. How many students generate strategies for getting a good grade that have nothing to do with learning? I know I was one, even though I was never as grade-motivated as many of my peers. Likewise, how many people take test-prep courses or work with tutors not so they can learn better the content of tests like the SAT or GRE, but so they can develop test-taking strategies?
The problem with placing evaluation of students above assessment - and then making those evaluations determining factors in student's lives - is that doing so obfuscates the purpose of education for students, and therefore undermines their desire to actually learn. Considering the competitive nature of most evaluation (in order for some to succeed, many more must fail), it is no wonder that students begin to play their appointed roles as "drop-outs" and "failures." How many brilliant minds do we lose to frustration, both among said "failures" and among the "achievers?" How much creativity and critical thinking is stomped out because, in the end, those things are hard to evaluate?
I do not believe that assessment should be abolished, by any stretch. Teachers, whether wittingly or not, are constantly assessing their students. Even a lecture hall with 100 undergraduates and a single Professor has some level of assessment built in ("ah, look who's asleep in the back again"). Most teachers will tell you that they know - usually early in the course - who in their classes gets it, who doesn't, who needs extra help, who is a trouble-maker, who's passing notes to who, and who they can trust to run down to their office to pick up a forgotten hand-out. Most teachers are excellent assessors of their students.
The problem is, those dozens of qualities and skills that teachers assess constantly are narrowed into a single evaluative measure. A to F. What's more, most of those qualities are cut out of the evaluation process. What matters, come grade time, is not a student's work-ethic, or his trustworthiness, or his interest in the material, or his sense of humor.* What matters is how well he 'gets' the material, and how well he is able to navigate the structure of the evaluation the teacher chooses.
* I choose these in particular because of Valentine's Day. We "assess" our lovers largely on these criteria - as well as a few others like attractiveness. In our culture, it seems perfectly natural that the criteria we place at the heart of love - which we tend to say is one of the most important activities in our lives - are ignored by our education system. Indeed, a culture that designed things like sense of humor and trustworthiness and appreciation of beauty into their education systems would seem unsophisticated and barbaric to us. It seems just the opposite to me.
Because we need to be able to communicate student abilities across vast distances of time and space, we transform the myriad assessments a teacher makes of her students into a single letter. The necessity for this is a social one: we need to know how good the student is doing, and we don't have time to listen to the full report. A state senator or school board member especially can't sift through thousands of pages of teacher write-ups, nor do teachers have time to write reports about each of their hundred or more students. The system is what it is because, on some level, it has to be just that.
Education reform is uncommon. Our system is very similar to what it was one hundred years ago, and despite the noise made by just about every presidential candidate, it is likely to resemble its current form for decades to come. Digital technology is a disruptive force, to be sure, just like the television was. The pervasiveness of the Internet and mobile phones might effect the delivery of educational materials more than TV ever could have, but the content and the evaluations are likely to remain much the same. Indeed, if anything the downsizing of the role of the teacher - the transformation from teacher to computer - necessitates an even more rigorous protocol of traditional multiple-choice and true-or-false tests.
I believe that digital technology can have the opposite effect, but only if educators strive to use it in a more progressive way. On the way to doing that, however, there are a great many steps. One is developing technologies - or implementations of technologies that exist, at least - which undercut the need for an evaluation-driven system. I don't believe that means that computers will do the assessments that teachers once did; rather, computers can deliver content and learning environments in a way that students don't see as evaluative or, strictly speaking, educational. How many students of my generation have learned a significant amount of history though computer games, for example?
Another important step is transforming attitudes about education. Education and teaching, as words, should give way to learning (indeed, not all cultures differentiate the three: imagine if we believed teaching and learning to be the same thing). The role of formal education should be questioned, not on the assumption that it will be abandoned, but rather with an eye towards its purpose, and whether technology can help it better fulfill that purpose.
Ultimately, I believe the highly-structured system of homework, test (or essay), grade that we've developed needs to change, and that modern technology makes possible - but not necessary - that change. Education researchers have been fighting that fight for a century (with a remarkable lack of success), as have many teachers and - unwittingly - a great many students. Politicians, businesses, and parents, however, tend to resist change (painting in exceptionally broad strokes), not for any good reason, but because either it's too politically risky, because they like discrete and scalable evaluations, or because that's the way they did it when I was a kid. After all, you gotta learn to buckle down and do your homework so you can get an A so you can get a job so you can have money so you can send your kids to 'good' schools so...
Alas, perhaps challenging the assumptions of education involves challenging the assumptions of a whole culture, an even bigger task.
I would argue that the main thing grades assess is a student's ability to get a good grade, and the main thing a standardized test score assesses is a student's skill in taking standardized tests. How many students generate strategies for getting a good grade that have nothing to do with learning? I know I was one, even though I was never as grade-motivated as many of my peers. Likewise, how many people take test-prep courses or work with tutors not so they can learn better the content of tests like the SAT or GRE, but so they can develop test-taking strategies?
The problem with placing evaluation of students above assessment - and then making those evaluations determining factors in student's lives - is that doing so obfuscates the purpose of education for students, and therefore undermines their desire to actually learn. Considering the competitive nature of most evaluation (in order for some to succeed, many more must fail), it is no wonder that students begin to play their appointed roles as "drop-outs" and "failures." How many brilliant minds do we lose to frustration, both among said "failures" and among the "achievers?" How much creativity and critical thinking is stomped out because, in the end, those things are hard to evaluate?
I do not believe that assessment should be abolished, by any stretch. Teachers, whether wittingly or not, are constantly assessing their students. Even a lecture hall with 100 undergraduates and a single Professor has some level of assessment built in ("ah, look who's asleep in the back again"). Most teachers will tell you that they know - usually early in the course - who in their classes gets it, who doesn't, who needs extra help, who is a trouble-maker, who's passing notes to who, and who they can trust to run down to their office to pick up a forgotten hand-out. Most teachers are excellent assessors of their students.
The problem is, those dozens of qualities and skills that teachers assess constantly are narrowed into a single evaluative measure. A to F. What's more, most of those qualities are cut out of the evaluation process. What matters, come grade time, is not a student's work-ethic, or his trustworthiness, or his interest in the material, or his sense of humor.* What matters is how well he 'gets' the material, and how well he is able to navigate the structure of the evaluation the teacher chooses.
* I choose these in particular because of Valentine's Day. We "assess" our lovers largely on these criteria - as well as a few others like attractiveness. In our culture, it seems perfectly natural that the criteria we place at the heart of love - which we tend to say is one of the most important activities in our lives - are ignored by our education system. Indeed, a culture that designed things like sense of humor and trustworthiness and appreciation of beauty into their education systems would seem unsophisticated and barbaric to us. It seems just the opposite to me.
Because we need to be able to communicate student abilities across vast distances of time and space, we transform the myriad assessments a teacher makes of her students into a single letter. The necessity for this is a social one: we need to know how good the student is doing, and we don't have time to listen to the full report. A state senator or school board member especially can't sift through thousands of pages of teacher write-ups, nor do teachers have time to write reports about each of their hundred or more students. The system is what it is because, on some level, it has to be just that.
Education reform is uncommon. Our system is very similar to what it was one hundred years ago, and despite the noise made by just about every presidential candidate, it is likely to resemble its current form for decades to come. Digital technology is a disruptive force, to be sure, just like the television was. The pervasiveness of the Internet and mobile phones might effect the delivery of educational materials more than TV ever could have, but the content and the evaluations are likely to remain much the same. Indeed, if anything the downsizing of the role of the teacher - the transformation from teacher to computer - necessitates an even more rigorous protocol of traditional multiple-choice and true-or-false tests.
I believe that digital technology can have the opposite effect, but only if educators strive to use it in a more progressive way. On the way to doing that, however, there are a great many steps. One is developing technologies - or implementations of technologies that exist, at least - which undercut the need for an evaluation-driven system. I don't believe that means that computers will do the assessments that teachers once did; rather, computers can deliver content and learning environments in a way that students don't see as evaluative or, strictly speaking, educational. How many students of my generation have learned a significant amount of history though computer games, for example?
Another important step is transforming attitudes about education. Education and teaching, as words, should give way to learning (indeed, not all cultures differentiate the three: imagine if we believed teaching and learning to be the same thing). The role of formal education should be questioned, not on the assumption that it will be abandoned, but rather with an eye towards its purpose, and whether technology can help it better fulfill that purpose.
Ultimately, I believe the highly-structured system of homework, test (or essay), grade that we've developed needs to change, and that modern technology makes possible - but not necessary - that change. Education researchers have been fighting that fight for a century (with a remarkable lack of success), as have many teachers and - unwittingly - a great many students. Politicians, businesses, and parents, however, tend to resist change (painting in exceptionally broad strokes), not for any good reason, but because either it's too politically risky, because they like discrete and scalable evaluations, or because that's the way they did it when I was a kid. After all, you gotta learn to buckle down and do your homework so you can get an A so you can get a job so you can have money so you can send your kids to 'good' schools so...
Alas, perhaps challenging the assumptions of education involves challenging the assumptions of a whole culture, an even bigger task.
Labels:
assessment,
culture,
Education,
evaluation,
grades,
homework,
Learning,
teaching,
technology
Subscribe to:
Posts (Atom)