In my Learning Sciences and Technology Design seminar we recently read a draft of an upcoming book by Dan Schwartz, a Professor here at Stanford. He argues that we need to reconsider our assumptions about assessment in order to better capture the things we actually care about as educators. Instead of evaluating student knowledge, understanding, or even skills, he argues, we should try to assess student choices. That is, what a information or skills a student knows, and even her ability to learn further information or skills is not as important as the decision to learn.
That choices are central to how we move through the world is perhaps obvious, but it is striking how infrequently choice is a core part of any assessment framework (multiple-choice tests certainly do not count as "choice" in the sense that Dr. Schwartz means it). Even forward-thinking educators tend to focus more on acquisition of skills or overly-ambiguous notions of "metacognition" or "critical thinking" than on the specifics of decision making. And specifics are the keys. "Making good choices" is as bad a curricular goal as "being able to organize the following events chronologically." A better option is a synthesis of the two, perhaps something to the effect of: "Given the task of explaining a historical event, choosing to organize parts of that event chronologically."
It seems to me that little education - indeed, even little of my own education, excellent though it has been - is organized around this kind of formulation. I believe that the most successful students end up adopting good strategies and making good choices, but Denise Pope's Doing School (about which I've written previously) suggests that a great many of our most successful students (if grades are our standard for success) in fact make terrible choices, ethically, academically, and even physically.
For my own part, I am struck by how often the schools I've attended - even Stanford - have not only tacitly accepted but in fact actively encouraged poor choices and unhealthy habits. And I don't just mean ambiguous moral choices, but concrete habits of mind and academic practice. For example, in spite of Stanford's ostensible lack of concern over grades, their various administrative policy practically forces students to waste hours of time engaged in a gamey calculus over which courses to take credit/no-credit, and which to take for a grade. If I choose not to engage in this practice, I put myself at a disadvantage in terms of various small-scale political interactions that are inevitable in a graduate school. On the other hand, the process itself, besides consuming intellectual energy better spend elsewhere, has undesirable effects on the way students engage with the particular courses they are not taking for a grade and the way professors engage with those students.
In other words, by separating this seemingly administrative cultural artifact from the curriculum, we've set up a situation where knowledge and skills are within the purview of the course, but where the most important actual decision making is made at an institutional level. In graduate school - which is at least theoretically preparation for a life in the academy - this is perhaps not overly troubling, but as we shift our gaze to undergraduate or k-12 education, it's easy to see that students are often well-taught to make bad learning choices by the broader curricula and institutions in which they find themselves. My rule of thumb for this kind of supposition is simple: if Stanford's graduate programs have a fundamental pedagogical or curricular problem, odds are that same problem can be found - and, indeed, is probably worse - at earlier stages of the education system.
So what is there to do? Unfortunately, it seems to me that this problem is virtually intractable in our current education system because it is endemic not merely to our curricula and pedagogy, but to our very culture, our policies, our institutions, and even our economics. That is, there is a good reason we teach bad choices in schools: because our political, economic, and social systems are built upon the majority of people making bad choices.
Showing posts with label assessment. Show all posts
Showing posts with label assessment. Show all posts
Thursday, February 2, 2012
On Choosing to Learn
Labels:
academia,
assessment,
choices,
culture,
Dan Schwartz,
denise pope,
Education,
LSTD,
society,
Stanford
Saturday, July 23, 2011
A Brief Thought on Final Exams
The long-awaited Part Four of the Beethoven series is finally in the works, but in the meantime, I wanted to talk a little about final exams.
In many subjects - particularly science and math - the culminating assessment of student learning is a final exam. Students are meant to demonstrate their understanding of the material by answering a massive collection of multiple choice and free response questions. In principle, this all seems like a good idea: after all, if the subject is really important enough that students should take the class in the first place, we need to make sure students know the material at the end of the course.
The problem is, there's no reason to believe that final exams (or tests in general) really do assess student knowledge in a meaningful way. What do I mean? Well, what is learning? I would argue that, for learning to really have occurred, students should retain the skills and knowledge from that learning well beyond the end of the course. What good is it to memorize the various organelles in a cell if two weeks after the test you won't remember them? Why do we test students on their ability to remember formulas that they will later be able to look up? Why do we force students to test alone when in their real lives they'll almost always be working with others (collaboration is called "cheating" on a final exam)?
My point, however, is not to raise those questions, but this one. How many students from your most recent class in which you had a final would pass that final if they took it again today? Would you pass your high school Chemistry final? Physics? Biology? Could you succeed on an Algebra test? Geometry? US History?
What values do we show when we design assessments that test knowledge that is not actually important or useful? Why do we make students demonstrate their learning by taking tests they will not be able to pass even months - let alone years - later? What good does that do?
Now consider the alternative: project based assessments, collaborative design challenges, even portfolios. I know mathematics and science teachers in particular might find those foreign to their subjects, but they meet a criterion that seems important to me. Students who can succeed at completing a Physics design challenge in high school will likely be able to complete that same challenge with the same level - if not greater - success later on in their lives. Why is that? Because that design challenge is testing the stuff we do care about, like collaboration, the ability to find and filter information, and, yes, physics content knowledge, but in a way that actually matters instead of in abstract and meaningless questions.
As I completed my own creative writing course this summer, I reflected on the wonder of teaching skills-based, instead of content-based courses. Assessment can be about growth, and can be designed in such a way that students could succeed equally well twenty years from now as they did this summer. But the "content-based" excuse for bad assessment is just that, an excuse.
In many subjects - particularly science and math - the culminating assessment of student learning is a final exam. Students are meant to demonstrate their understanding of the material by answering a massive collection of multiple choice and free response questions. In principle, this all seems like a good idea: after all, if the subject is really important enough that students should take the class in the first place, we need to make sure students know the material at the end of the course.
The problem is, there's no reason to believe that final exams (or tests in general) really do assess student knowledge in a meaningful way. What do I mean? Well, what is learning? I would argue that, for learning to really have occurred, students should retain the skills and knowledge from that learning well beyond the end of the course. What good is it to memorize the various organelles in a cell if two weeks after the test you won't remember them? Why do we test students on their ability to remember formulas that they will later be able to look up? Why do we force students to test alone when in their real lives they'll almost always be working with others (collaboration is called "cheating" on a final exam)?
My point, however, is not to raise those questions, but this one. How many students from your most recent class in which you had a final would pass that final if they took it again today? Would you pass your high school Chemistry final? Physics? Biology? Could you succeed on an Algebra test? Geometry? US History?
What values do we show when we design assessments that test knowledge that is not actually important or useful? Why do we make students demonstrate their learning by taking tests they will not be able to pass even months - let alone years - later? What good does that do?
Now consider the alternative: project based assessments, collaborative design challenges, even portfolios. I know mathematics and science teachers in particular might find those foreign to their subjects, but they meet a criterion that seems important to me. Students who can succeed at completing a Physics design challenge in high school will likely be able to complete that same challenge with the same level - if not greater - success later on in their lives. Why is that? Because that design challenge is testing the stuff we do care about, like collaboration, the ability to find and filter information, and, yes, physics content knowledge, but in a way that actually matters instead of in abstract and meaningless questions.
As I completed my own creative writing course this summer, I reflected on the wonder of teaching skills-based, instead of content-based courses. Assessment can be about growth, and can be designed in such a way that students could succeed equally well twenty years from now as they did this summer. But the "content-based" excuse for bad assessment is just that, an excuse.
Labels:
assessment,
collaboration,
Education,
final exams,
Learning,
tests
Friday, April 23, 2010
Corporate Education
It's the direction we're heading, like it or not. I for one, decidedly do not, but have been surprised in one of my Spring quarter courses to find that not everybody has the same reservations I do. Indeed, there is a big push - especially in the technology world - to embrace the disruptive and innovative opportunities that a more corporate model of education offers. Our current reading for the aforementioned class, Disrupting Class, by Clayton Christensen, speaks to how technology will revolutionize education, the undying undertone being: technology will turn education corporate. Scary? Big time.
First things first, what exactly does a more corporate model of education look like? Well, for one thing, we're already moving down that track in the language that schools use. Former Chicago Superintendent and current Secretary of Education Arne Duncan did not go by "Superintendent" in his previous post. Rather, he was the Chief Executive Officer (CEO) of his district. It is hardly a bad things that schools are paying more and better attention to how they spend their money, and to what their results are, but it is also important to ask about what comes along with bringing business to schools.
For one thing, the emphasis we now place on test scores is a vestige of business, which, even in its most dynamic and innovative forms, is always concerned with producing certain usable products for its consumers, whose use can then be measured. It does Apple no good to produce a product if they cannot later tell how and why people are using it, so they do extensive market research, they do intensive user-feedback and bug fixing, and so on. Some business types think that education needs exactly this: we should think of curriculum content as a product, students as consumers, and thus tailor the whole educational experience to the wants and needs of individual students. In many ways, that would be an improvement, but the first difficulty here is how we do our evaluations.
Standardized testing is an effort to scientifically compare students across time, space, and culture. Moreover, it is a mechanism by which we can make policy decisions in education, electing who to fund and who to fire, which students to slap "at-risk" labels or "learning disabled" labels on, and which to call "gifted." In all, assessment is the framework upon which modern education is built, and it is almost certainly not going anywhere soon. The tricky thing is making assessment more dynamic, which would be a step towards fulfilling a more business-y model of education. How can we do that? Is there really a meaningful way to engage students beyond, on some level, their knowledge of content? It's really hard to standardize essays - because good writing is so varied - or to assess thousands of students on their knowledge of the scientific process, because those are performance-based and intensive processes. Even computers, with their amazing, disruptive capabilities cannot replace a human eye for the aesthetic component that comes along with assessing learning.
Apple measures how consumers use the iPhone quantitatively and qualitatively. They need both. In education, we do a little of each, but quantitative measures dominate. As long as content is important to education, quantitative measures will continue to dominate. Or, is that the other way around? As long as it is important to assess, content will be the purpose. Christensen rightly believes that technology is transforming education, but he still understands that transformation as being formal, and not centered around content as such. That is, he does believe that each student will be able to learn a content based on individual preference, but he still sees the purpose of education as the delivery of content. Technology makes it easier to do that, and to assess it, but is that really what we want out of our schools (or computers)?
Why does Christensen value content over, say, thought process, innovation, or critical thinking? Because he is, I believe, stuck in a businessman's world, where outcomes need to be assessable, and where all things can be understood in terms of production, consumption, and exchange. For a long time - and even still to a degree in these sad times where tests dominate the schools - K-12 education in America has been a place where students were at least partially extracted from a capitalist, survival-of-the-fittest world in favor of exposing them to myriad possibilities and thought-patterns, ranging from artistic expressions to advanced mathematics to world history. The why of all of that content was never "because Johnny needs to know who won the war of 1812," but rather because Johnny's quality of life would be higher, his citizenship more robust, and, yes, his contributions to the work-force more meaningful if he knew how to think about a wide variety of topics.
Christensen takes for granted that students, given the choice, will pursue what topics are most interesting and important to them, but that is exactly the trouble. Without the guidance of a teacher, who personally knows and personally interacts with a student, none of us might ever have found our respective callings. Computers can certainly do some of that work, but where is the teacher who encourages you to take a subject even though you don't want to, ultimately to your benefit? How many - to give a concrete example - St. John's graduates would ever take Greek or Music Theory on their own? How many, having taken those courses, regret it? I think the answer to both is almost none.
Education is not a business because students are not consumers. The vision of a public education system has always been to create intelligent, moral citizens. Public education is essential to Democratic government precisely because Democracy is non-disciplinary, non-specialized. It asks its members to be adept at weighing evidence and testimony in any and every subject. It desires citizens conversant with history, with mathematics, with science, with arts, with music, with foreign languages, and so on. More important than the content of any of those subjects, however, Democracy requires citizens who know how to think like historians, mathematicians, scientists, artists, musicians, and linguists. A business model of education is not interested in such a broad ambition as this, and yet this is the very ambition upon which public education in America was founded.
There is a telling analogy in Christensen's book, which I think captures the essence of his argument, and also my reservations. He describes the disruptive technological effect of recorded sound, and how it allowed for high-quality recordings to be distributed far more widely than a visit to a concert hall ever could (whilst leaving the possibility of attending a concert intact). By analogy, he sees education as moving in a similar direction. Great teachers can distribute - through video, or through as yet uninvented technologies - their teaching over a wider network than ever before. Sure, it's not necessarily as good as in person, but its a whole lot better than nothing.
All of that I agree with, but the problem with Christensen's analogy is that he ignores what happened to music with the invention of recorded sound. What was once an art form pursued and distributed primarily for its own sake - Beethoven and Brahms didn't write music because it made them rich - became, with wider distribution, more economized, more capitalized. That's not to say music for the sake of music doesn't exist now, but it can be really hard to tell the difference. More importantly, though, in the everyone-can-access-everything modern music world commercial viability has replaced quality. Christensen tellingly uses Rachmaninoff and Mozart as his exemplars in his analogy, and he's right to say that now more people can listen to Mozart than every could before. But do more people actually choose to? That's another question.
I've shared my thoughts about great music here, and my readers are free to disagree. In education, however, I think we'll all agree that some teaching is better than other teaching. Some classes are more instructive. Some schools do a better job of turning out critical thinkers. The problem with market forces is that there's no reason to believe that they will allow good teachers to succeed. Good online courses won't necessarily do best, rather, the most popular ones will. There's much to be said for the wisdom of the crowd, sure, but I also wonder whether the direction of a student's education ought to follow a path created by someone (or a culture, broadly) who believes that Justin Timberlake is a better musician than John Tavener, Usher better than Scott Joplin.
My biggest concern with applying business to education is the same as my biggest concern when applying business to life: what's the point? Business is built around an internal structure of meaning. Namely, money is meaning. The point is to compete, to get rich, to produce, to consume, and to iterate on that process ad infinitum (until you die or your planet can no longer support you). Nowhere, in that cycle, are you to ask, "Why?" Why breaks the whole thing apart. It is as if, finding the question, "What is the meaning of life?" too unwieldy, we have decided to build a whole structure that makes asking the question impossible. But I think we need to demand, not answers, but the freedom - and there is no other freedom - to ask "Why?"
What is the purpose of education? I demand that you answer me, Mr. Christensen, and with you all the businessmen who would reform education in the image of Toyota, Starbucks, Virgin Records, Southwest Airlines, Apple, and McDonalds. What is the purpose of education?
First things first, what exactly does a more corporate model of education look like? Well, for one thing, we're already moving down that track in the language that schools use. Former Chicago Superintendent and current Secretary of Education Arne Duncan did not go by "Superintendent" in his previous post. Rather, he was the Chief Executive Officer (CEO) of his district. It is hardly a bad things that schools are paying more and better attention to how they spend their money, and to what their results are, but it is also important to ask about what comes along with bringing business to schools.
For one thing, the emphasis we now place on test scores is a vestige of business, which, even in its most dynamic and innovative forms, is always concerned with producing certain usable products for its consumers, whose use can then be measured. It does Apple no good to produce a product if they cannot later tell how and why people are using it, so they do extensive market research, they do intensive user-feedback and bug fixing, and so on. Some business types think that education needs exactly this: we should think of curriculum content as a product, students as consumers, and thus tailor the whole educational experience to the wants and needs of individual students. In many ways, that would be an improvement, but the first difficulty here is how we do our evaluations.
Standardized testing is an effort to scientifically compare students across time, space, and culture. Moreover, it is a mechanism by which we can make policy decisions in education, electing who to fund and who to fire, which students to slap "at-risk" labels or "learning disabled" labels on, and which to call "gifted." In all, assessment is the framework upon which modern education is built, and it is almost certainly not going anywhere soon. The tricky thing is making assessment more dynamic, which would be a step towards fulfilling a more business-y model of education. How can we do that? Is there really a meaningful way to engage students beyond, on some level, their knowledge of content? It's really hard to standardize essays - because good writing is so varied - or to assess thousands of students on their knowledge of the scientific process, because those are performance-based and intensive processes. Even computers, with their amazing, disruptive capabilities cannot replace a human eye for the aesthetic component that comes along with assessing learning.
Apple measures how consumers use the iPhone quantitatively and qualitatively. They need both. In education, we do a little of each, but quantitative measures dominate. As long as content is important to education, quantitative measures will continue to dominate. Or, is that the other way around? As long as it is important to assess, content will be the purpose. Christensen rightly believes that technology is transforming education, but he still understands that transformation as being formal, and not centered around content as such. That is, he does believe that each student will be able to learn a content based on individual preference, but he still sees the purpose of education as the delivery of content. Technology makes it easier to do that, and to assess it, but is that really what we want out of our schools (or computers)?
Why does Christensen value content over, say, thought process, innovation, or critical thinking? Because he is, I believe, stuck in a businessman's world, where outcomes need to be assessable, and where all things can be understood in terms of production, consumption, and exchange. For a long time - and even still to a degree in these sad times where tests dominate the schools - K-12 education in America has been a place where students were at least partially extracted from a capitalist, survival-of-the-fittest world in favor of exposing them to myriad possibilities and thought-patterns, ranging from artistic expressions to advanced mathematics to world history. The why of all of that content was never "because Johnny needs to know who won the war of 1812," but rather because Johnny's quality of life would be higher, his citizenship more robust, and, yes, his contributions to the work-force more meaningful if he knew how to think about a wide variety of topics.
Christensen takes for granted that students, given the choice, will pursue what topics are most interesting and important to them, but that is exactly the trouble. Without the guidance of a teacher, who personally knows and personally interacts with a student, none of us might ever have found our respective callings. Computers can certainly do some of that work, but where is the teacher who encourages you to take a subject even though you don't want to, ultimately to your benefit? How many - to give a concrete example - St. John's graduates would ever take Greek or Music Theory on their own? How many, having taken those courses, regret it? I think the answer to both is almost none.
Education is not a business because students are not consumers. The vision of a public education system has always been to create intelligent, moral citizens. Public education is essential to Democratic government precisely because Democracy is non-disciplinary, non-specialized. It asks its members to be adept at weighing evidence and testimony in any and every subject. It desires citizens conversant with history, with mathematics, with science, with arts, with music, with foreign languages, and so on. More important than the content of any of those subjects, however, Democracy requires citizens who know how to think like historians, mathematicians, scientists, artists, musicians, and linguists. A business model of education is not interested in such a broad ambition as this, and yet this is the very ambition upon which public education in America was founded.
There is a telling analogy in Christensen's book, which I think captures the essence of his argument, and also my reservations. He describes the disruptive technological effect of recorded sound, and how it allowed for high-quality recordings to be distributed far more widely than a visit to a concert hall ever could (whilst leaving the possibility of attending a concert intact). By analogy, he sees education as moving in a similar direction. Great teachers can distribute - through video, or through as yet uninvented technologies - their teaching over a wider network than ever before. Sure, it's not necessarily as good as in person, but its a whole lot better than nothing.
All of that I agree with, but the problem with Christensen's analogy is that he ignores what happened to music with the invention of recorded sound. What was once an art form pursued and distributed primarily for its own sake - Beethoven and Brahms didn't write music because it made them rich - became, with wider distribution, more economized, more capitalized. That's not to say music for the sake of music doesn't exist now, but it can be really hard to tell the difference. More importantly, though, in the everyone-can-access-everything modern music world commercial viability has replaced quality. Christensen tellingly uses Rachmaninoff and Mozart as his exemplars in his analogy, and he's right to say that now more people can listen to Mozart than every could before. But do more people actually choose to? That's another question.
I've shared my thoughts about great music here, and my readers are free to disagree. In education, however, I think we'll all agree that some teaching is better than other teaching. Some classes are more instructive. Some schools do a better job of turning out critical thinkers. The problem with market forces is that there's no reason to believe that they will allow good teachers to succeed. Good online courses won't necessarily do best, rather, the most popular ones will. There's much to be said for the wisdom of the crowd, sure, but I also wonder whether the direction of a student's education ought to follow a path created by someone (or a culture, broadly) who believes that Justin Timberlake is a better musician than John Tavener, Usher better than Scott Joplin.
My biggest concern with applying business to education is the same as my biggest concern when applying business to life: what's the point? Business is built around an internal structure of meaning. Namely, money is meaning. The point is to compete, to get rich, to produce, to consume, and to iterate on that process ad infinitum (until you die or your planet can no longer support you). Nowhere, in that cycle, are you to ask, "Why?" Why breaks the whole thing apart. It is as if, finding the question, "What is the meaning of life?" too unwieldy, we have decided to build a whole structure that makes asking the question impossible. But I think we need to demand, not answers, but the freedom - and there is no other freedom - to ask "Why?"
What is the purpose of education? I demand that you answer me, Mr. Christensen, and with you all the businessmen who would reform education in the image of Toyota, Starbucks, Virgin Records, Southwest Airlines, Apple, and McDonalds. What is the purpose of education?
Labels:
Arne Duncan,
assessment,
business,
capitalism,
Clayton Christensen,
Disrupting Class,
Education,
Music,
why
Saturday, February 13, 2010
The Meaning of Grades
One of the biggest assumptions of our education system is the need for graded assessment, or evaluation. For many colleges, grades and SAT scores make up the entire admissions process. For policy makers, the debate centers around how to improve those scores, taking for granted that they are good measures of learning.
I would argue that the main thing grades assess is a student's ability to get a good grade, and the main thing a standardized test score assesses is a student's skill in taking standardized tests. How many students generate strategies for getting a good grade that have nothing to do with learning? I know I was one, even though I was never as grade-motivated as many of my peers. Likewise, how many people take test-prep courses or work with tutors not so they can learn better the content of tests like the SAT or GRE, but so they can develop test-taking strategies?
The problem with placing evaluation of students above assessment - and then making those evaluations determining factors in student's lives - is that doing so obfuscates the purpose of education for students, and therefore undermines their desire to actually learn. Considering the competitive nature of most evaluation (in order for some to succeed, many more must fail), it is no wonder that students begin to play their appointed roles as "drop-outs" and "failures." How many brilliant minds do we lose to frustration, both among said "failures" and among the "achievers?" How much creativity and critical thinking is stomped out because, in the end, those things are hard to evaluate?
I do not believe that assessment should be abolished, by any stretch. Teachers, whether wittingly or not, are constantly assessing their students. Even a lecture hall with 100 undergraduates and a single Professor has some level of assessment built in ("ah, look who's asleep in the back again"). Most teachers will tell you that they know - usually early in the course - who in their classes gets it, who doesn't, who needs extra help, who is a trouble-maker, who's passing notes to who, and who they can trust to run down to their office to pick up a forgotten hand-out. Most teachers are excellent assessors of their students.
The problem is, those dozens of qualities and skills that teachers assess constantly are narrowed into a single evaluative measure. A to F. What's more, most of those qualities are cut out of the evaluation process. What matters, come grade time, is not a student's work-ethic, or his trustworthiness, or his interest in the material, or his sense of humor.* What matters is how well he 'gets' the material, and how well he is able to navigate the structure of the evaluation the teacher chooses.
* I choose these in particular because of Valentine's Day. We "assess" our lovers largely on these criteria - as well as a few others like attractiveness. In our culture, it seems perfectly natural that the criteria we place at the heart of love - which we tend to say is one of the most important activities in our lives - are ignored by our education system. Indeed, a culture that designed things like sense of humor and trustworthiness and appreciation of beauty into their education systems would seem unsophisticated and barbaric to us. It seems just the opposite to me.
Because we need to be able to communicate student abilities across vast distances of time and space, we transform the myriad assessments a teacher makes of her students into a single letter. The necessity for this is a social one: we need to know how good the student is doing, and we don't have time to listen to the full report. A state senator or school board member especially can't sift through thousands of pages of teacher write-ups, nor do teachers have time to write reports about each of their hundred or more students. The system is what it is because, on some level, it has to be just that.
Education reform is uncommon. Our system is very similar to what it was one hundred years ago, and despite the noise made by just about every presidential candidate, it is likely to resemble its current form for decades to come. Digital technology is a disruptive force, to be sure, just like the television was. The pervasiveness of the Internet and mobile phones might effect the delivery of educational materials more than TV ever could have, but the content and the evaluations are likely to remain much the same. Indeed, if anything the downsizing of the role of the teacher - the transformation from teacher to computer - necessitates an even more rigorous protocol of traditional multiple-choice and true-or-false tests.
I believe that digital technology can have the opposite effect, but only if educators strive to use it in a more progressive way. On the way to doing that, however, there are a great many steps. One is developing technologies - or implementations of technologies that exist, at least - which undercut the need for an evaluation-driven system. I don't believe that means that computers will do the assessments that teachers once did; rather, computers can deliver content and learning environments in a way that students don't see as evaluative or, strictly speaking, educational. How many students of my generation have learned a significant amount of history though computer games, for example?
Another important step is transforming attitudes about education. Education and teaching, as words, should give way to learning (indeed, not all cultures differentiate the three: imagine if we believed teaching and learning to be the same thing). The role of formal education should be questioned, not on the assumption that it will be abandoned, but rather with an eye towards its purpose, and whether technology can help it better fulfill that purpose.
Ultimately, I believe the highly-structured system of homework, test (or essay), grade that we've developed needs to change, and that modern technology makes possible - but not necessary - that change. Education researchers have been fighting that fight for a century (with a remarkable lack of success), as have many teachers and - unwittingly - a great many students. Politicians, businesses, and parents, however, tend to resist change (painting in exceptionally broad strokes), not for any good reason, but because either it's too politically risky, because they like discrete and scalable evaluations, or because that's the way they did it when I was a kid. After all, you gotta learn to buckle down and do your homework so you can get an A so you can get a job so you can have money so you can send your kids to 'good' schools so...
Alas, perhaps challenging the assumptions of education involves challenging the assumptions of a whole culture, an even bigger task.
I would argue that the main thing grades assess is a student's ability to get a good grade, and the main thing a standardized test score assesses is a student's skill in taking standardized tests. How many students generate strategies for getting a good grade that have nothing to do with learning? I know I was one, even though I was never as grade-motivated as many of my peers. Likewise, how many people take test-prep courses or work with tutors not so they can learn better the content of tests like the SAT or GRE, but so they can develop test-taking strategies?
The problem with placing evaluation of students above assessment - and then making those evaluations determining factors in student's lives - is that doing so obfuscates the purpose of education for students, and therefore undermines their desire to actually learn. Considering the competitive nature of most evaluation (in order for some to succeed, many more must fail), it is no wonder that students begin to play their appointed roles as "drop-outs" and "failures." How many brilliant minds do we lose to frustration, both among said "failures" and among the "achievers?" How much creativity and critical thinking is stomped out because, in the end, those things are hard to evaluate?
I do not believe that assessment should be abolished, by any stretch. Teachers, whether wittingly or not, are constantly assessing their students. Even a lecture hall with 100 undergraduates and a single Professor has some level of assessment built in ("ah, look who's asleep in the back again"). Most teachers will tell you that they know - usually early in the course - who in their classes gets it, who doesn't, who needs extra help, who is a trouble-maker, who's passing notes to who, and who they can trust to run down to their office to pick up a forgotten hand-out. Most teachers are excellent assessors of their students.
The problem is, those dozens of qualities and skills that teachers assess constantly are narrowed into a single evaluative measure. A to F. What's more, most of those qualities are cut out of the evaluation process. What matters, come grade time, is not a student's work-ethic, or his trustworthiness, or his interest in the material, or his sense of humor.* What matters is how well he 'gets' the material, and how well he is able to navigate the structure of the evaluation the teacher chooses.
* I choose these in particular because of Valentine's Day. We "assess" our lovers largely on these criteria - as well as a few others like attractiveness. In our culture, it seems perfectly natural that the criteria we place at the heart of love - which we tend to say is one of the most important activities in our lives - are ignored by our education system. Indeed, a culture that designed things like sense of humor and trustworthiness and appreciation of beauty into their education systems would seem unsophisticated and barbaric to us. It seems just the opposite to me.
Because we need to be able to communicate student abilities across vast distances of time and space, we transform the myriad assessments a teacher makes of her students into a single letter. The necessity for this is a social one: we need to know how good the student is doing, and we don't have time to listen to the full report. A state senator or school board member especially can't sift through thousands of pages of teacher write-ups, nor do teachers have time to write reports about each of their hundred or more students. The system is what it is because, on some level, it has to be just that.
Education reform is uncommon. Our system is very similar to what it was one hundred years ago, and despite the noise made by just about every presidential candidate, it is likely to resemble its current form for decades to come. Digital technology is a disruptive force, to be sure, just like the television was. The pervasiveness of the Internet and mobile phones might effect the delivery of educational materials more than TV ever could have, but the content and the evaluations are likely to remain much the same. Indeed, if anything the downsizing of the role of the teacher - the transformation from teacher to computer - necessitates an even more rigorous protocol of traditional multiple-choice and true-or-false tests.
I believe that digital technology can have the opposite effect, but only if educators strive to use it in a more progressive way. On the way to doing that, however, there are a great many steps. One is developing technologies - or implementations of technologies that exist, at least - which undercut the need for an evaluation-driven system. I don't believe that means that computers will do the assessments that teachers once did; rather, computers can deliver content and learning environments in a way that students don't see as evaluative or, strictly speaking, educational. How many students of my generation have learned a significant amount of history though computer games, for example?
Another important step is transforming attitudes about education. Education and teaching, as words, should give way to learning (indeed, not all cultures differentiate the three: imagine if we believed teaching and learning to be the same thing). The role of formal education should be questioned, not on the assumption that it will be abandoned, but rather with an eye towards its purpose, and whether technology can help it better fulfill that purpose.
Ultimately, I believe the highly-structured system of homework, test (or essay), grade that we've developed needs to change, and that modern technology makes possible - but not necessary - that change. Education researchers have been fighting that fight for a century (with a remarkable lack of success), as have many teachers and - unwittingly - a great many students. Politicians, businesses, and parents, however, tend to resist change (painting in exceptionally broad strokes), not for any good reason, but because either it's too politically risky, because they like discrete and scalable evaluations, or because that's the way they did it when I was a kid. After all, you gotta learn to buckle down and do your homework so you can get an A so you can get a job so you can have money so you can send your kids to 'good' schools so...
Alas, perhaps challenging the assumptions of education involves challenging the assumptions of a whole culture, an even bigger task.
Labels:
assessment,
culture,
Education,
evaluation,
grades,
homework,
Learning,
teaching,
technology
Subscribe to:
Posts (Atom)