Example Scenarios


Imagine a classroom with a student, a teacher, and an impartial objective observer.  For this you can even imagine the observer with the usual white lab coat and clipboard taking notes.  For 21st century classooms we'll allow a tablet, but the white coat is still helpful.


Let's take a look at different scenarios and student projects and try out these tests to see which parts qualify as recall, comprehension, application or synthesis.


Recall


Imagine a teacher shows a student a map of the U.S. with the states named. Then later, the teacher shows the student a picture of a given state outline, and asks the student, "What is the name of that state?"  If the student replies with the correct name, then that is recall, because the student used the exact words and images that were given to them earlier by the teacher.  Our observer with the clipboard, sorry… tablet, notes it as such.


If the teacher then asks, "What are 'states'", and the student replies with a list of the names that they remember, or can draw rough outlines of the shapes of different states, then that is also recall.


Recall is repeating what was previously read, seen, heard, or demonstrated.


   
   



Comprehension


However, if the student responds instead with a story, and can explain the idea of "states" without using phrases or images that were already given to them by the teacher (or someone else), then our observer will note it as demonstrating comprehension. 


For example, imagine that the student is now observed explaining "states" to a younger student.  First imagine that the student simply repeats what they were previously shown by the teacher: a labeled map. But then imagine that instead, the older student acts more like a parent (instinctively, many parents actually "get" this part), and tells something like a story: "In a big country like the U.S., people decided to separate out different areas to make it easier to manage. Sometimes they used a river or some mountains to decide where to make the lines that divide the areas.  Sometimes they just drew a line on a map.  The different areas that they ended up with are called "states".


Notice that in the second case, except for the concluding sentence at the end, none of the words or images that the teacher originally gave the older student are used in the explanation.  This is the one definitive demonstration of "understanding" or "comprehension".


Comprehension is evidenced by re-expressing, without using what was already read, seen, heard or demonstrated.


Why? Because it's impossible to correctly re-express a concept without actually comprehending it.  And in fact, it is equally impossible for the teacher, or our objective observer, to know whether the re-expression is correct unless they themselves also comprehend the concept.


        


Important point:  If the teacher uses the above explanation about large countries, rivers, etc. to describe "states", or if the student is given the same or alternate explanation by someone else (parent, another student, Internet resource, etc.), then that particular explanation is then excluded from a response that would qualify as comprehension! Why? Because the use of the explanation gained from another source would then again just be repeating, and not re-expressing. That is, it would just be recall.


This is the reason that a professional educator is required for there to be the most successful learning environment possible.  By professional educator, it means someone who has been trained to be aware of both best practice pedagogical techniques for instruction, who actually understands the concepts that they are teaching so as to be able to correctly assess the accuracy of the re-expression, and also to maintain an ongoing awareness of what "answers" have already been given to the learner so as to be able to specifically exclude those pre-given answers to any later measure of whether comprehension is being demonstrated.



Application


Now imagine that the teacher asks the student to take a topographical map of a region that has not been divided into "states" (or countries for that matter), and to use what they've learned about the idea of how states or countries are delineated, and to make their own new map.  This would be an example of application, because although the possible solutions (rivers or mountain ranges) are known to the student, the particular problem itself (the given map) does not yet have a known solution.  The student can only create the application example if they have an underlying comprehension of the concept, and demonstrates it for a problem that they have not previously seen.


    
  


Application is the process of matching the new problem given with an available inventory of known solutions.   For that it will be necessary to re-express already-known solutions to the given problem.


Application is solving a new problem for which the solution is already generally known.



Synthesis


For synthesis, the teacher could now present the problem, or the student could self-initiate it, of saying, "Can you write a description of alternate ways that the states of the United States, or countries of Europe, could have been delineated?"  Or, "Can you create a map of the Middle East with countries delineated based on your own explanation for the reasons that you have chosen?".


  
 


In that case, the student must consider what they have learned and applied with known solutions, and then essentially "invent" new criteria for delineating states or countries.  I could give examples here of what those might be, but in giving the examples, I would eliminate those from the possible solutions that I'd like you to now consider.


Take a moment to turn to your neighbor, and discuss ways other than rivers and mountain ranges that states or countries could be delineated.  If you are already aware of systems such as lines of latitude or longitude, or use of language over a geographic area, exclude those from your possible solutions.  The challenge is, can you think of something that you didn't already have "in your inventory of exising rules" for state and country borders?


<5 minutes for discussion of possible border-drawing schemes>


Synthesis is solving a problem for which the solution is not already known (not already given to the student by the teacher or another source), and which requires bringing together multiple solutions to create something that clearly didn't exist before.  "Intention" is an important aspect and is implied by the objective of solving a problem.  The problem itself need not be independently initiated by the student, but the solution(s) to the problem do need to be such that they have independently put them together for solving the problem.  If the student "looks up" the answer, or simply gets "the answer" from another source (friend, parent, Internet search, etc.) then that invalidates that response as demonstrating synthesis.


This may seem to be a harsh criterion, but it is a realistic measure of whether true synthesis is taking place.  For example, if the student is presented with a topological puzzle ("Can you connect 9 dots with 4 lines?"), and solves the problem through their own experimentation and insight, then that would demonstrate synthesis. 





But if a friend just shows them the "trick", then repeating it is simple recall.




Thus, if the challenge is to create a timeline of historical events, and the student already knows how to order events by date, and is familiar with the concept of timelines, then the creation of the timeline is at best application, not "synthesis", or being "creative" in a meaningful way.


Synthesis (real creativity) is solving a problem with combined solutions that are not already known.



The Circular Nature of the Categories


Simply put, this is just the observation that no matter how clever and innovative the re-expression is that demonstrates "comprehension", once the learner has used it themselves, the next time they use it, they will be back at recall.  We have all had the experience of coming up with a new way of explaining something that particularly pleases us, and then going back to that explanation in future years while teaching that class.  Even though the first time qualified as "comprehension", and demonstrated a new insight and understanding of the contenton our own part, the later repetition of that is simply recall.  It doesn't mean that the comprehension is lost, only that from the standpoint of an impartial observer, they don't know years later whether the teacher (or student in adult life) still retains the comprehension of the concept, or is simply repeating what they remember as the correct explanation of something, even if they did (back then) come up with that explanation themselves.  Only by demonstrating new re-expressions of the concept would our impartial observer be able to say that they had continued to demonstrate that their comprehension of the concept had been retained.




The rationale behind the cycle is that even if the solution to a problem wasn’t known to the learner the first time a new problem was encountered, and thus qualified as a demonstration of comprehension, the next time the problem is encountered, the previously “new” solution would be remembered from before, and once again be recall.  In fact, even the highest level of synthesis, having been done once, itself becomes recall when the learner uses what was learned previously and demonstrated by “synthesis” in a repeat of the demonstration.  In fact, the overall learning process of life is one where the “revelation of learning” at one age becomes the “of course I know that” at a later age.


Likewise, for someone that invents something totally new, some extraordinary demonstration of synthesis, once that solution to a problem is known, repeating it just reverts to recall.  It is only the further elaboration and improvement (for example) that would demonstrate further examples of synthesis.


Examining Sample Lessons


Let's look at the following series of examples of technology-using student-made activities and projects, and de-construct it with respect to the four tests being applied separately to technology and content. 



Challenge the Model:  http://bit.ly/xdjwtl

Remember, you can enter this url to open up the collaborative Google Doc where you can add questions and comments during the presentation of these examples.  As we discuss those examples, you can enter descriptions of your own example classroom scenarios that challenge the proposed model, or that you would like to see explained from the viewpoint of the model.



Critiquing example projects:  Tidal Biology and Kaila in Egypt.




Arctic Wolf:




House on Neptune:




Cell City:





TPACK:  Technology, Pedagogy, Content Knowledge


"Any sufficiently novel use of technology is indistinguishable from real learning" - Roger Wagner paraphrasing Arthur C. Clark


See a good discussion of TPACK here:   http://mkoehler.educ.msu.edu/tpack/what-is-tpack/ and http://www.tpck.org/


Teachers, parents, administrators and even the students themselves make assessments every day as to which categories in Bloom's taxonomy different responses or activities can be ascribed.  A big challenge is that the four tests can be applied to the use of the technology processes used in a project as well as the content itself.


That is to say, it's quite easy to find instances where someone will say, "The student was creative, and demonstrated higher-order thinking skills because they made a movie!".  However, there are two parts to this: a) the skills required to "make a movie", and b) the demonstration of the learning that took place with respect to the content.  Quite often, students, parents, teachers, and even administrators mistake what might even be a legitimate demonstration of "synthesis" with the technology for being a demonstration of synthesis regarding the content.


Because newer technologies are, well, "new", their use does often seem to satisfy the application and synthesis tests presented here, and in the process, distract us from asking the same questions about the content.




The Elephant…





Do We Need Technology?

Technology is an amplifier, and its purpose is to provide the most enabling, least restrictive environment to increase the possibility and likelihood that the higher levels of learning take place.  It does not in itself though, automatically bring into being these higher levels without proper pedagogy, and also without a very large foundation in each of the lower levels to make the higher levels possible.  That is to say, a huge amount of recall is necessary to enable a certain amount of comprehension, and a lot of comprehension is required for application.  True synthesis is the most difficult of all, and actually rarely happens as one gets older.


What is the Ideal Use of Educational Technology?

In short, the best educational technology should be that which is the most enabling, the least restrictive, to the learning process, and goals of demonstrating comprehension, application and synthesis.   Technology that limits the student in their ability to gather and organize information, and later to express themselves and represent their research and thinking, is much less effective. 



Ideally, the technology environment should function as a truly enabling tool, presenting as few roadblocks as possible, and in fact leading, encouraging, and permitting the student to do more research, organization and self-expression than would otherwise be possible.


The learning cycle in young children, and why it's understandable for it to diminish with age.

The leap from application to synthesis can happen very quickly for simple concepts and/or clever students, or more slowly in other cases.  Experimentation is an important ingredient, because if the solution/answer/process is not known, some degree of experimentation on the part of the learner is always required. It may be visible, physical experimentation on the part of the learner, or it may take place solely in a mental space, as the learner imagines the possible outcomes.  By the way, some of the most famous examples of this are Einstein's thought experiments.

For a young child, the process of experimentation, analysis, and evaluation take place almost simulataneously with the initial presentation of the information, because there are very few "already known" solutions to problems. As they age to become adults, people increasingly rely (as they should) on already-known solutions.  This is faster and more efficient, and does explain why adults are less explorative and experimentive.  It's not necessarily a bad thing, and it's also why many scientific breakthroughs are made by young scientists in their early 20s, or sometimes even younger.

It's very true that the recall of solutions is much faster than the process for synthesis.  If you see a car coming at you, and you jump out of the way, because you learned to do that early on, it's more efficient, and has a higher survival value than pondering other possible solutions which are as yet unknown to you.  Of course, when there is no known solution to anyone, making recall impossible, such as what to do about a growing ozone hole over the poles, or how to make a practical working light bulb in 1878, then true synthesis is the only way to create a solution.

Note: To get an insight into just how much of Edison's light bulb was "new", and how much was matching known solutions with a given problem (application), see this description of the history of the incandescent bulb:  http://en.wikipedia.org/wiki/Incandescent_light_bulb#Early_pre-commercial_research

It's understandable then, that for a very young child, everything is a huge swirl of recall, comprehension, application, and synthesis, and Piaget and Papert describe this process through the models of constructivism and constructionism.  However, as people get older, they are able to (and desirably so) act quickly and efficiently on a growing body of remembered behaviors.  In fact, the huge body of this knowledge is what gives values to "the elders", who can often say, "I've seen this before, and I can tell you what's going to happen."

On the other hand, in a world that is now changing more and more rapidly, the ability to extend the skills of application and synthesis into later years of life is essential for job security, productivity, and even the long term viability of a democracy.

Bloom said it himself back in 1956:




Taxonomy of Educational Objectives, Handbook 1: Cognitive Domain

Anderson, Lorin W. (Editor)/ Krathwohl, David R. (Editor)/ Bloom, Benjamin Samuel (Editor), David McKay, 1956


Conclusion:

As you first start to try to apply these four tests (assessment tools), it may not seem that easy for you to separate the technology from the content, or to easily classify activities into Bloom's categories.  However, with practice, you'll not only get better at it, but find that the rules themselves make this process easier than with any other alternative system.


In fact, ultimately I think you'll find it easier and more effective to practice getting better at this model:




than this one:




Also, it's worth noting that your students themselves will do better in their projects, and thinking about their own thinking (metacognition), if they have this same illustration to refer to, and if you discuss the principles witht them on which they will be assessed.


I would greatly enjoy hearing from you in the future as you explore this, both with challenges, and any comments you have about whether this has helped improve your classroom teaching experience.


--


Postscript: Valuing "creativity" (or synthesis) over all other activities.


Because "create" is at the top of the revised Bloom's taxonomy, and because "creating" can be so easily applied to an activity, there has been a marked tendency to emphasize this as a classroom activity and objective at the expense of the other categories.


The problem is that recall is necessary for comprehension, comprehension for application, and application for synthesis.


In fact, you can think of it rather like a "food pyramid":


  

http://schools.mukilteo.wednet.edu/staff/willetj/lessons/food_chain.htm




http://www.tutorvista.com/biology/definition-of-energy-pyramid-ecosystem

 


 


You can't re-express something without having a large vocabulary of other words (that you already comprehend) with which to do the re-expression. 


Application is the process of matching the given problem with the available inventory of known solutions. For that it may be necessary to re-express the given problem to match a known solution.


For Synthesis, a huge number of previously known solutions need to be available for combination to result in a previously unknown solution to a challenge, and resulting in a new and unique product.


Postscript:


Why are there so many apps (and so many unused apps) on most iPhones and iPads?




(from "101 screenshots of useful Apple iPad apps")

http://www.techrepublic.com/blog/hiner/101-screenshots-of-useful-apple-ipad-apps/4780


I believe that the answer is in part because each of the apps is intrinsically shallow in functionality.  Most are "one-trick ponies" that can do a particular function like take a picture, make a note, or play a game, but few have more than a dozen features/functions to their operation and design. 



Largely, this is a result of the economics of the app marketplace.  With a retail price of only a few dollars for most apps, and a moderately "successful" app selling 10,000 copies, that is only $20k in total revenue for development, marketing, etc.   Even if the app sells 100,000 copies for $3 each, total revenue for the project would only pay for one or two programmers for a year or so.   This is illustrated very well in the infographic to the left.






“80% of developers don’t generate enough revenue to support a standalone business” - app-promo.com


Infographic from: http://app-promo.com/wake-up-call-infographic/



It's just not practical for app developers in general to put a lot of development effort (read: depth of functions, and in turn, enabling technology) into a mobile app for anything other than a top-selling game app, or a convenience app subsidized by another larger operation.


Narrow the audience segment and companies to K-12 education, and it’s nearly impossible, from a financial standpoint, to develop apps with any depth of functionality.


Contrast that to desktop/laptop applications where the pricing is traditionally higher, and companies could afford to invest in the development costs necessary to deliver a much higher level of functionality to their customers.


An app that costs less than a desktop/laptop application, but which only delivers a small fraction of what the customer needs, is not actually a bargain or an effective solution at all.


Although mobile computing offers many new learning opportunities, the present challenges include a plethora of apps where no single app provides more than a fragment of the tool needed for an effective approach to a constructivist learning philosophy.




======


Synthesis: Solve a problem with combined solutions that are not already known.


Application: Solve a new problem with an approach that is already known.


Comprehension: Re-express without using what was already read, seen, heard or demonstrated.


Recall: Repeat what was previously read, seen, heard, or demonstrated.