Friday, June 17, 2011

Negative Space

In art, negative space is an important yet occasionally overlooked concept. There are a couple different types of negative space. If you google the term, the results are mostly all types of silhouettes, where an object doesn't actually appear in the image at all. What is missing is what you're supposed to actually see. An example of this is the arrow in the FedEx logo. What arrow, you ask? Well, go look real quick, and then come back. ... Pretty cool, eh? The silhouette walking across the street here is another more obvious example.

The other type of negative space is a type of balance or contrast to the focus of the piece, also apparent in the photo of the sign pictured above (which iboy_daniel was so gracious to share with an open license). The same picture taken head on would simply not be as interesting. Negative space used this way adds a level of depth that is missing otherwise. The divine proportion and rule of thirds are related to the concept of negative space.

In images with a lot going on, photographers will often use a large aperture, resulting in a shallow depth of field, meaning that only a small range of the picture is in focus. This artistic blurring of the foreground and background is negative space that makes the pieces that are in focus almost pop out at the viewer. The out of focus elements are important because of the context they provide to the in focus elements.

In a recent conversation with a former employee of mine, we got to talking about the importance of negative space in the workplace, although we didn't call it that at the time. It's the idea that time spent sitting around talking, grabbing a cup of coffee, running to the break room to play ping pong, going to lunch together, or otherwise spending time together not immediately engaged in "work" is an important aspect of the workplace.

An article in the paper about a team running the Ragnar Wasatch Back Relay, which happens to have started today, points out this same concept. A business sponsored a team a few years ago for the 200 mile 12 person relay race through the mountains and found clear benefits in the way of increased collaboration and connections among employees back at the office long after the race ended, so they've continued doing it.

Being able to step away momentarily from the task at hand to do something that doesn't really matter helps increase focus on important issues upon returning to work. These important issues are often lost if taken on too directly with nowhere to allow the eyes or mind to rest. Of course unrealistic deadlines, high travel costs, juggling multiple projects, and other factors can make such downtime seemingly difficult to fit in. It doesn't have to be huge, though, and probably shouldn't be. Care does need to be taken to ensure the focus isn't moved off what is important and onto elements that should be in the background.

In virtual teams, instant messaging can provide some of the same downtime to a limited extent, but getting together in the same physical location occasionally can do wonders to reinvigorate a project or team that is suffering from lack of contact. Whether or not the in-person time is "productive", it can help remind everyone of the importance of their piece in relation to the big goal and that there are real people receiving their submissions on the other end of the line.

I often practice a negative space technique when working on a paper or presentation. A month or two out I'll review the requirements and read some related articles or books but not write anything. A week or two goes by, and I'll put together a basic outline of what I'm going to write or talk about. I'll sit on it for another week, while in the back of my mind I'm thinking of stories, articles, events, theories, videos, and all sorts of related issues. This cycle progresses until it's relatively close to the time of submission/presentation, depending on its size and importance. When I do sit down to knock it out, the whole thing flows from my fingertips in a way that was not possible the month or two prior, because of the downtime I'd had to process it.

I always did like it at the moving company I used to work for when the person over our crew on any given day was a smoker; it meant we would get a 10 minute break every hour instead of one 15 minute break every four hours. The focus there was always on when the next break was coming. Everyone filed out of the warehouse like kids following an ice cream truck when the snack truck would pull into the parking lot every morning and save us all if he was ever late. At a physically demanding job, that negative space is closely guarded and for good reason, but at white collar jobs it can be easy to forget or to spend your downtime alone.

So be positive. But don't forget about the negative.

16 Free Tools to Create Media in eLearning

From a presentation at eLearning DevCon 2011 by Jeff Batt, a trainer with Rapid Intake.
I can vouch for Audacity, GIMP, Kuler (my new blog colors are from the Retro Package color scheme), and obviously Sumo Paint.

Now start creating!

Tuesday, June 14, 2011

The Enlightened Eye

I just wanted to jot a few notes down from Elliott Eisner's 1991 book The Enlightened Eye: Qualitative Inquiry and the Enhancement of Educational Practice.

Eisner discusses 6 features of qualitative study:
  • qualitative studies are field focused; that is, anything that is important for education is potential subject matter, from observing teachers in the classroom to how children play to the design of the trophy case in the school
  • the researcher as instrument; we all make judgments as to what is or isn't important, and calling out one's own biases is as important as identifying those of others
  • a qualitative study is interpretive; thick description, motivation, underlying attitudes, and nuanced differences are essential
  • expressive language and presence of voice; this goes along with the researcher as instrument in that it is false to assert a neutrality that does not exist
  • attention to particulars; rather than run details through a statistics engine to arrive at a general statement, the analysis of outliers and unique details of an individual situation, individual, event, or object provides a flavor that is often lost
  • triangulation; qualitative researchers look for multiple sources to validate findings, not a sterile statistical test of significance.

I'm reminded of the story of a quantitative and a qualitative researcher observing a man mowing his lawn. The quantitative researcher measures the length of the grass before and after it is cut, in addition to the average and standard deviations of the length of the grass of his neighbors, and explains that he was cutting his grass in order to keep it within a certain threshold acceptable for that street. The qualitative researcher asks the man why he is cutting his lawn, to which he replies he is doing it early in the morning to get back at the neighbors who were up late loudly partying the night before.

Of course, both quantitative and qualitative are important, and you can't really have one without the other. Straight quantitative research loses touch with reality fairly quickly, and qualitative research simply isn't scalable. Problems can be identified by either method or a combination of the two. Heavy quantitative analysis is often used to develop and validate interventions that work for the majority, but then qualitative work is necessary to really understand whether the desired effects are taking hold and to work with those who don't fit in the majority mold.

Friday, June 3, 2011

Course Design Rubric

As a follow-up to my last post presenting the idea of a design rubric, here is the first real draft of the course design rubric.

I haven't worried yet about putting the rubric items in any specific order or weighting them in importance at all. That will come later. I will probably group them together somehow so related rubric items are next to each other. They will also be fleshed out with better descriptions of what it takes to get a certain score. There's only so much space in each little box.

The way a rubric like this works is that the rater starts at 0 and moves towards 3, stopping whenever criteria are no longer being met. So you can't meet the criteria for a 3 if the criteria for a 2 were not met. In working to validate the rubric, I'll look at an overall score out of 21 by adding up the 7 individual scores, the correlations between individual rubric items and external criteria, and the correlations/dependencies among rubric items.

There were a few times that I debated which items would score higher on a given criterion when one was not naturally subsumed by the other. For example, what if the recommended learning path does build effectively but is not flexible? Or what if learning activities provide new experiences as a foundation for the content to be presented but do not build at all on student experiences prior to the course? Those are obvious holes that will need to be patched before this is production ready.

As I hinted I might do in my last post, I did decide to combine the Measurable and Clarity items into Clear and Measurable Objectives. That was a more interesting decision to make than it seems. As I wrote last time, the goal was to write a rubric that allowed for rating the design of a course before it was developed. What I've been leaning more towards, however, is a rating of a developed course. Most of the items could still be used in a design-only situation (and really should be if you're not shooting from the hip and developing without designing first), but combining those two items related to writing good objectives in effect serves to weight that portion less than some of the other items that apply more naturally to a developed course.

Of course, the real power of using a rubric is not so much that you can use it to come up with a grade but rather that it can be used during the creation process to improve the quality of the end product.

So what's missing? What's redundant? What's out of order? What can't be measured?

Thursday, May 19, 2011

Instructional Design Rubric

In looking around for research opportunities, I made an indirect connection between the research a friend of mine was doing and something I had been thinking about at work. I helped with the research on a pilot study. It was using a rubric (Boote & Beile) to measure the quality of dissertation literature reviews. It turns out literature reviews aren't taught consistently, and (no surprise here) are not consistently performed properly either. I'll just say that after reading a stack of dissertations, my confidence in my own ability to do academic research increased dramatically.

The conversation has been had several times about how strange it was for my friend doing a literature review on doing literature reviews, just as last summer I was working on designing instruction about designing instruction. My thoughts turned to whether it would be possible to do something at a level that could improve more of the higher education world, of which PhD studies are a fairly small part. One interesting idea I came up with deals with an analysis of the gap between expected outcomes from current students in higher education and recognized outcomes from graduates of higher education, with cross sections based on type of institution, level of degree, subject area, etc. My guess is that we'd find that students aren't fully realizing the benefits they expect to receive; that is, there is a misalignment somewhere. Think about what you were asked to do in your first job out of college and whether you used anything that was listed as an objective for any of the courses you took. While I still think that is an interesting topic to pursue at some future date, it's not quite dissertation material at this point.

At work, we follow a fairly well structured design process to come up with what we call the competencies and learning objectives for our courses. Competencies are roughly equivalent to educational objectives in Bloom's Taxonomy, and the more focused learning objectives match up with Bloom's instructional objectives. Going with a more wide angle, we also couch everything for a degree program within a conceptual framework, which Bloom would probably call global objectives.

While there is research on Bloom's Taxonomy, much of what I've seen has to do with validating the order, leading to a recent swap in the last two levels since researchers had identified that evaluation is less cognitively demanding than creation. There are other taxonomies out there, which overlap quite a bit, but I have yet to come across any good research that really supports the most famous of educational taxonomies. I believe it, because it makes sense, but who is to say if something is missing or if all the current components are really necessary? One article talked about how the iconic triangle should be flipped on its point so it opens up as you reach higher cognitive levels. Whatever. I don't care about the job aid. I want to know if the taxonomy is right. So the proposed research is to rate the quality of a course designed using Bloom's Taxonomy and compare that to some measure of the actual quality of the finished course developed according to that design.

I haven't pulled this together as a formal literature review yet (but I will be pulling out my Boote & Beile rubric when I do). Just a quick compilation of features from several models out there, and I come up with an unpolished rubric that I hope may be useful in rating the quality of a course design, with design being the first D in ADDIE, not the kind where you're choosing background colors.

While I have not yet found anything substantive related to measuring the quality of the initial design of a course, Merrill does have his 5 Star and e3 rating forms based on his First Principles of Instruction along with some other theories, which are intended to rate a developed course. At that point, however, it's a little late. The course is already created and perhaps already taught. It would be more helpful to rate the design of a course before it's developed. Fix the problems before developing the instruction on a flawed design.

Again, this is not complete or valid in any way. The models I considered, based on our practice at work and general research I'm familiar with in the area, in no particular order, are as follows:
  • Wiggins & McTighe - Backwards Design Model
  • Merrill - First Principles of Instruction
  • Gagne - Nine Events of Instruction
  • Anderson & Krathwohl - Revised Bloom's Taxonomy
  • Mager - Preparing Instructional Objectives
  • Knowles - Principles of Andragogy


The principles or characteristics of effective design that align with the above theories, and that serve as a first draft of rubric principles are:
  • Problem-based or realistic (publishing work, problem solving, creation)
  • Alignment between assessment and content (teach what you test and test what you teach)
  • Appropriate path to complete objectives (flexibility for diverse learners, no orphans, properly scaffolded)
  • Measurable behavior (specific, discrete, observable)
  • Level of performance (alignment with content and audience)
  • Clarity (one verb, understandable, meaningful, maybe combine with measurable)
  • Metacognition
  • Bridging prior knowledge and future practice
  • Any other suggestions as to what's missing?


I'm picturing a four point scale, 0-3 for each item. The 0 is obvious; it simply doesn't meet the requirements. A score of 1 would indicate minimal coverage. A score of 2 would indicate significant alignment but missing higher level components or perhaps most objectives are written correctly and a few incorrectly. The goal is to score a 3, meaning all principles and characteristics are present and appropriately applied.

The rubric itself would take the form of a table, which I'll put together later, but the principles or characteristics would be listed down the left and the points across the top, with a description of what is needed to receive that score in the intersecting boxes.

A graduate-level course, for example, with all multiple choice tests would likely score poorly on problem solving and realism but could score okay on the alignment if you're planning on teaching at the scantron level. One could argue whether completing a multiple choice test is measurable behavior; I'd maybe put that in the 1-2 range, since while the correctness of the student's answers can be easily measured, it's debatable whether it can be considered behavior. The level of performance is obviously wrong if we're talking about giving grad students multiple choice tests, so we're talking maybe a 1 here if the questions get past a superficial level. There's not going to be much metacognition going on.

For an undergraduate-level course, on the other hand, while some of the principles may still be rated low in terms of realism and metacognition, the level of performance may be appropriate. It may even be possible to score decently on bridging prior knowledge and future practice if the scantron content is considered foundational knowledge that will support more in-depth performance in later classes.

Good, bad, too much, not enough? Other principles, theories, or methods that should be included? Has anyone actually done something like this for instructional design? What measures other than inter-rater reliability could be used to validate the score from this type of rubric?

Saturday, April 30, 2011

Metered Internet

In the early days of the Internet, some 10-15 years ago, there was a different landscape than we view before us today. Consumers and content providers faced a strange problem. Many consumers used slow but cheap dial-up connections to access the Internet. They couldn't justify the outrageous costs of high speed Internet, which probably wasn't even available where they lived. Maybe if there was actually any good content beyond plain text and some banded gifs, it would be worth paying the higher price, and I'm not just talking about those Flash splash pages that were popular back in 1999. I mean real multimedia content.

Content producers didn't want to invest in putting heavy content online, however, because nobody could see it. It would take too long to download over a 56K connection; there really wasn't an audience with the necessary bandwidth, other than perhaps faculty and students at universities.

We talked about it, though. Some day in the future, we would all have broadband access, and we would be able to watch videos whenever we wanted. We would make video calls, share music, and play games. As the content grew little by little, so would the numbers of broadband subscribers until there was a critical mass.

High speed Internet is practically considered a public good now, and its pervasiveness is taken for granted. Interactive multimedia content abounds, broadband access is available in most homes, as well as on mobile devices, and many consumers produce large amounts of their own content.

So of course we are now taking the obvious step of reducing our broadband use through throttling and overage charges.

In Canada, there have been some crazy expensive overage plans that look like they are being scaled back due to their ridiculosity. I can't find the link right now, but one blogger calculated that between speed limits and overage charges, it was both faster and cheaper to buy a new terabyte hard drive, fill it up, and overnight it across the country than it would be to transfer the data over the internet.

These data caps are advertised as necessary due to the strain from multimedia content, especially video sites like youtube, hulu, netflix, and the rest of their ilk. That sounds reasonable until you look at the way service providers are bundling internet-based phones and TV along with their internet service. So yes, that's right, the service providers are piling more types of traffic onto the very same network that they claim is not big enough for current usage.

The method of measuring by amount of data transferred over a month is flawed anyway. Data transfer should only really be measured by available speed. If you want to stream voice and video, you need a higher speed than if you just tweet and check emails with little real regard to volume.

Mobile is following the footsteps of traditional ISPs. Many mobile carriers are touting new cheaper wireless data plans, which actually make a ton of sense for those people who buy a smartphone with no intent of actually getting online with it. And there are a lot of people for whom that is the case. The early adopters of smartphones were IT guys who used the data like crazy. Now that the common folk carry smartphones, they don't use them to their full potential. It's still seen as odd when someone looks up information on the internet using their phone whether during a class or an informal conversation. Oh, who's Mr. Smart Pants, showing off his fancy phone? Well, you could have looked it up on your phone, too, but you apparently don't know how.

So there are some heavy users and some light users of mobile internet, so it makes sense to let the light users pay less, right? Have we learned nothing? Notice how more phones are coming with videoconferencing hardware and applications? Notice how everyone has downloadable apps for everything? Notice how more and more devices will act as a GPS with turn by turn directions? Notice how more content providers are advertising that their content is being optimized for these mobile devices? Does this sound familiar? There is more and better multimedia content coming available for smartphones, not to mention tablets which have finally started to take hold. These applications and content are user friendly enough that the non-techie masses will start using them more. The social stigma of actually using your device in a way that approaches its potential will decrease.

Let me put it more directly. Unlimited data plans on mobile devices served well to stimulate the generation of more multimedia mobile content. Now that there is plenty of content, service providers are dropping the unlimited data plans before everyone starts using the data fully, telling them that it is for their own good, but knowing full well that very soon everyone will be using more data and start slamming up against massive overage charges. Just like traditional landline high speed internet only a short time ago.

Wednesday, March 23, 2011

No More Books

It's interesting how an initiative touted by one group as being a revolutionary improvement will often be seen as counterproductive or ineffective by another group.

At a recent faculty meeting, where discussion of a new writing center was taking place, I was witness to such an example. One faculty member pointed out that as important as it is to help students improve their writing, which the writing center is intended to do, there is unfortunately something else that has the potential to hurt our students even more.

What's the insidious plague about to be unleashed on our students' writing skills? It is an initiative aimed at reducing the amount they have to read. If we require them to read less, it will have direct impact on their ability to write. Well, of course, the matchup between reading and writing seems pretty obvious, but why would anyone propose to dramatically reduce student reading?

It turns out the faculty member misunderstood the initiative. The proposal is to create integrated learning environments where students can access multimedia, direct themselves to activities based on formative quizzes, oh yeah, and read. His understanding was that the multimedia and pretty websites were going to replace books.

While it's true that the goal is to move away from traditional printed textbooks, the same text from the publishers is going to be integrated in an electronic form with the bells and whistles that improve student engagement and track progress in ways that a plain old book could never do. I know a lot of publishers create companion websites where students can access some bonus materials, but they're not integrated with the text. Bringing them together in one place reduces the extraneous cognitive load associated with having the text and bonus features in completely separate mediums, giving them more time and mental capacity to devote to their reading.

Wednesday, March 2, 2011

Trolling

Sitting in on some meetings with faculty members from several different departments, the discussion turned at one point to staying on top of student opinions, experiences, and problems they might be having.

photo by sue_elias

Various methods of keeping tabs on the student experience were discussed. One in particular was worthy of note. A faculty member shared her habit of trolling the course message boards and encouraged others to do the same. (Just to be clear, these are message boards open to anyone working on a given course, not locked down to just one section of a course inside an LMS.)

I alternated between staring in disbelief and suppressing laughter as I pictured a seemingly polite and professional faculty member taunting students in the official university message boards. I could understand if she wanted to do it under a pseudonym on a third party site. I mean, who doesn't do that, right? Right?

Obviously the behavior she engages in is lurking, not trolling. As nefarious as it sounds to be a lurker, it's really no big deal. It's just someone who sits by and watches the conversation but doesn't contribute. The real life equivalent of lurking is somewhat awkward; just sitting around watching people and listening in on their conversations is not considered polite. In the online world, however, lurking is often recommended, primarily as a way to get acquainted with a community before actively contributing in order to get a handle on the norms of that particular group and to get to know who the trolls are.

That brings us to trolling. It really doesn't have anything to do with trolls, as nasty as they are. Rather, it comes from a fishing term describing a method of dragging a lure behind a boat. The lures are often designed to mimic dying or injured fish. The idea is the troll tosses the bait out there and drags it around looking for easy prey. The victim thinks they're attacking a helpless victim, but they thus become the victim as they take the bait and are unwittingly dragged into an argument. Getting into an argument with a troll means you have lost. You are the victim. There is no way to win. The argument is what the troll is looking for. The flame war is the desired end result. Even the most glaring hole in a troll's argument cannot be addressed, because it is often simply more bait designed to keep the "conversation" going.

Chaos is only avoided by ignoring the troll or calling him or her out directly as a troll and then proceeding to ignore. I recently watched a video of a dude hitting himself in the face with a racquetball. In the comments, a troll starts an argument by claiming that the sport they were playing was squash, not racquetball. It's clearly racquetball. No logic prevails, as any evidence is simply countered by "it's squash". At one point, the troll even directly admits to being a troll and then immediately parrots back the line again, "it's squash" and the argument continues.

What's the point? Why would someone do that? It doesn't matter. Analyzing why someone would do such a thing is beside the point. The only thing that really matters is recognizing it and disengaging immediately.

Now imagine with me again the kind-hearted faculty member leaving our discussion on how to best engage with and assist our students, pulling up her laptop in some dark corner of the hallway, and leaving provoking comments on the student message boards.

Thursday, February 17, 2011

A Whole New World

Last month, I mentioned how sometimes people will fight against something and by so doing cause what they were trying to avoid in the first place. Here is a similar example, this time of people arguing against something and thus making the point they were arguing against.



At East High School in Salt Lake City (yes, THE East High School), they are putting on a bilingual production of Aladdin. I think it's a great idea. Basically, half the school is Caucasian, one quarter Hispanic, and the rest other minorities. The problem is that only the white kids try out for the theater, until now.

They are coming together. They are all happy to have met people they didn't know before. They're helping each other with their languages. What a great story, too. Aladdin is all about not trying to be something you're not but loving others for what they are. Maybe next year they'll do a bilingual Romeo and Juliet.

The point I made in the first paragraph comes from the comments on the story. The more people complain about this production, the more their own xenophobia is apparent, thus reinforcing the need for such a production. Most of the first comments were people saying this was a bad thing, though it is balancing out with supporting comments as the day goes on. Some commenters claim this is a ploy to encourage acceptance of illegal aliens. One asks that we stop catering to minorities and accept each other without bringing race and culture into the conversation. Another asserts that a bilingual production won't help the Hispanic kids learn English, which is the global language of business and science. Two commenters unfold the logical fallacy that if we do things in Spanish, we'll have to start doing things in many other languages as well.

First, who knows if the Hispanic kids are illegal or not? Second, who cares? They may very well have been born here, and whether they were or were not, they likely have little choice but to live where their parents are. These are children we're talking about. How messed up is the request that we accept each other without talking about our races and cultures? If the acceptance only goes one way, from minority to majority, that is actually a request that minorities reject their own race and culture with an out where the majority doesn't have to accept anyone that's different.

When it comes to learning languages, I don't think we need to worry about whether or not the Hispanic kids are learning English. They've grown up here; they know the language. They weren't ignoring the theater because they don't know the language but because there was simply a cultural barrier that needed to be broken. It has now been broken.

It's the white kids who are less likely to know another language, like the joke (not actually a joke) that if you know two languages you're bilingual, three languages you're trilingual, and one language you're American. Learning a second (or third) language helps one understand his or own language better. And talk about the language of science being English, except that many of the terms we use come from Latin, upon which Spanish is based. A firm grasp of a Romance language makes Latin a lot easier.

I think it would be great if the slippery slope argument came true when it was put forward that if we allow Spanish, we'd have to do things in countless other languages. Okay, let's do it then. Let's mix in Arabic, Hindi, Mandarin, and Russian. We're still arguing about Spanish, when there are all these other languages that millions (even billions) of other people are speaking. We're not at risk of having the issues that China and India have with hundreds of languages swirled all over the place causing communication issues. English is already common, in spite of how poor of a language it is; we just need to add on a few more to spice things up.

The bigger question is one of culture, not language. Language happens to often be the piece that starts someone off into a better understanding of other cultures. Is there a better way to build cultural understanding than our children sharing language and song in a production about not trying to change yourself to impress others?

Wednesday, February 16, 2011

Improving Teaching by Understanding How People Learn

A colleague recommended a book he's been reading, “How People Learn: Brain, Mind, Experience, and School” by the National Research Council.

In the introductory chapter, they give some important concepts for teaching based on an understanding of how people learn. The main points:
  • student initial knowledge and conceptions provide a foundation for further learning

  • frequent formative assessment encourages metacognition and leads to deeper learning

  • need to teach education students to help their students recognize and replace incorrect preconceptions

  • in-depth coverage of fewer topics is better than superficial coverage in many topics

  • to be an effective teacher, you need to have done in-depth study yourself

  • assessment must test at the level teaching occurs, that is deep testing for deep teaching (students will do poorly on superficial testing if they've been taught for deep understanding)

  • metacognition needs to be planned into the curriculum
The whole book is graciously provided online for free. See the complete table of contents.