Hump-Jumping: How the Education of Computer Science can be Saved, err, maybe.
secretGeek .:dot Nuts about dot Net:.
home .: about .: sign up .: sitemap .: secretGeek RSS

Hump-Jumping: How the Education of Computer Science can be Saved, err, maybe.

In a paper called 'The Camel has two humps' the authors described a test which can be applied to students before they've begun a computer science course, and can fairly accurately predict those that will do well and those that will not.

I've never agreed with their summary of the results.

They say they are dividing:

"programming sheep from non-programming goats"

...which implies the differences between pass and fail are as pronounced as speciation. That's a big claim and well outside the scope of their research.

And I think they misrepresent their study when they say:

"This test predicts ability to program with very high accuracy before the subjects have ever seen a program or a programming language."

...as, crucially, their study failed to check whether the students "had ever seen a program or programming language."

(Unless I'm misinterpreting this sentence from the paper, taken verbatim:

We believe (without any interview evidence at all) that they had had no contact with programming but had received basic school mathematics teaching.

... I've written to one of the authors to seek clarity.)

I asked Alan Kay for his opinion, when he commented here on a different topic -- he was very kind in providing a lengthy and thoughful answer.

His opening phrase really sticks in my mind:

"They could be right, but there is nothing in the paper that substantiates it."

Then, this morning, I saw a fresh comment at that article, from David Smith

"If there were a definitive test of ultimate programming capability I could apply on the first day of class, what would I say to those who 'failed'?"

Which presents a very human response to the topic from an educator directly affected by it. And I don't have a sufficient answer to that.

But a different approach to the whole problem has occurred to me since:

Let's suppose that this test is indeed an accurate test of those that will and won't succeed in computer science 101.

We put aside all worries about what biases or inconsistencies the study might have. Just accept that the test is effective. Stick with me here.

So we give the test to all students before they start Computer Science 101. At the end of the subject, we see that, as predicated, those that do poorly in the subject tend to do poorly on the pre-test. But instead of looking for correlation, what if we looked for outliers?

Which students did poorly on the pre-test, but did well in computer science? Those are the students with the most to teach us. Why did they buck the trend?

Okay, so maybe some of them cheated. (I remember a high incidence of cheating in early computer subjects I took; particularly amongst those who didn't continue in the field.) And maybe some of people deliberately blew the pre-test, even though they did well at the subject.

But once we find the genuine hump-jumpers, we focus on what it was that helped computer science 'click' for them. Did they find there were specific misconceptions they had to overcome? Did they have extra-tuition? Were there specific problems that helped them get their thinking in order? Was it just hard work? And, regardless of the answer, would they like to become tutors next semester, specifically working with those who perform poorly on the pre-test?

It might be necessary to look at a lot of such hump-jumpers before useful lessons emerge. It might be that every one of them has a different story to tell, there's no common pattern. (As Tolstoy said in his Turing Award speech: "Happy programmers are all alike; but every unhappy programmer is unhappy in her own way.")

So that's my answer for David. I don't know what you could say to those who fail the pre-test. But I think that over time a good pre-test could be used to develop new and better teaching methods, and maybe that's the best we can do.





'mike' on Fri, 09 Apr 2010 14:40:18 GMT, sez:

It's also possible that the entire idea is overly influenced by a generally Western notion that you either have ability or your don't, and there's not much to be done about it. This seems remarkably widespread in our attitudes about math[s], for example, where we accept without comment (or dissent) when people say "Oh, I'm just not a math person."

As has been reported about math education in Asian countries, and about music education in the UK, whatever "talent" a student might or might not have is only a weak determiner in how successful they are in those subjects. A far better predictor turns out to be an old-fashioned kind: how hard they work at it. Malcolm Gladwell (who, admittedly, is the epitome of a popularizer) notes that what might distinguish successful music students is not musical talent as such, but what he refers to as "a talent for practice" -- ie, motivation to practice and an instinct for (or instruction in) doing so effectively.

IOW, motivation and hard work are probably ultimately far more important than native ability. Of course, it doesn't hurt to be a "genius," but one generally discovers that geniuses have somewhere, at some time, put in a whole lotta work into their chosen field of endeavo[u]r.



'Roberto Liffredo' on Sat, 10 Apr 2010 22:03:42 GMT, sez:

Maybe I've always been in the "geek" side of the classroom, but I do not remember any of the people I was involved with that had not hacked at least a bit with some form of basic.



'jim' on Tue, 13 Apr 2010 14:12:36 GMT, sez:

I gave this idea a lot of bandwidth after reading your original post on the topic. My sense is that it really boils down to the idea of nurture versus nature - the idea that individuals carry along an inherent set of preferences or perhaps can evolve along the way.

Functionally, Denadi and Bornat found that their first set of tests were not predictive for people who had already been exposed to programming. So, they went back to the drawing board and have refined the test to capture patterns / modes of response that they believe are more predictive.

Intuitively, this seems "truthy" to me (who hasn't worked with someone with a decent academic background that was hopeless as a developer?), but at the same time, it seems to me that the predictive aspect results in too many "programmer positives" - which makes me think that the pattern matching aspect is probably more inate (see Baron-Cohen's E-S Theory and search engine the words "autism quotient" for a self assessment) in some, but teachable for most.

Someone would probably have to test a bunch of 5 year olds and then keep track of them through their academic careers to really sort this out.



'Andrew' on Tue, 20 Apr 2010 00:23:07 GMT, sez:

Expanding on the hypothesis of Gladwell's (via mike). Maybe an initial test of programming should be "Are you the type of person who is going to stay up late programming".

eg

"Explain the inherent plot flaw of 'The Terminator', ignoring the implausability of time travel and sentient computers."


Any lame answer like "I haven't seen it" disqualifies you from programming.








'Alan' on Fri, 20 Aug 2010 18:25:37 GMT, sez:

Maybe the best tests could be built by emulating the military aptitude tests. When I took such a test in 1975, I had the vast computer experience of having once watched a teletype print out a christmas tree of asterisks, and the significant electronics experience of having figured out that I could get distant FM stations from our family cable TV feed. (Oh yeah, lest I forget, I once plugged an 8-ohm speaker into a wall outlet because I wanted to hear what electricity sounded like.) The Air Force put me into electronics, and I am now an accomplished telecommunications engineer, having recently crosstrained after a long career as a proficient software engineer. I think they know something.




name


website (optional)


enter the word:
 

comment (HTML not allowed)


All viewpoints welcome. But the right to delete any post for any reason is reserved. Don't make me do it. Comments may be republished, emailed to your loved ones or printed and used as toilet paper. Who reads this legal bit anyhow?

TimeSnapper is a life analysis system that stores and plays-back your computer use. It makes timesheet recording a breeze, helps you recover lost work and shows you how to sharpen your act.

TimeSnapper won last year's Developer Competition at Larkware.com, and is used by over 10,000 people.

Articles

JSON Query Languages: 5 special purpose editors JSON Query Languages: 5 special purpose editors
What then, is b? What then, is b?
SQLike: A simple editor SQLike: A simple editor
Yet Another BizPlan Generator. Yet Another BizPlan Generator.
HOT GUIDS: A hot or not site for guids HOT GUIDS: A hot or not site for guids
How does life get better? One tiny hack at a time. How does life get better? One tiny hack at a time.
24 things to do, and 100 things *not* to do (yet) for building a MicroISV 24 things to do, and 100 things *not* to do (yet) for building a MicroISV
Venture capital won't kill Jeff Atwood, it will only make him Jeffer. Venture capital won't kill Jeff Atwood, it will only make him Jeffer.
A handy workflow image for newbie mercurial users A handy workflow image for newbie mercurial users
Fractal Feedback, a diversion into recreational programming Fractal Feedback, a diversion into recreational programming
Hump-Jumping: How the Education of Computer Science can be Saved, err, maybe. Hump-Jumping: How the Education of Computer Science can be Saved, err, maybe.
Suggested User Experience Improvements for DiffMerge Suggested User Experience Improvements for DiffMerge
SQL Style Extensions for C# SQL Style Extensions for C#
The Movie Hollywood (And My Wife) Doesn't Want You To See: Weekend at Jacko's The Movie Hollywood (And My Wife) Doesn't Want You To See: Weekend at Jacko's
Sysi: the ultimate administrators toolkit Sysi: the ultimate administrators toolkit

Archives .: secretGeek :: Complete Archives
TimeSnapper -- Automated Screenshot Journal TimeSnapper.com    
Version 3.3: true productivity boost

Next Action NextAction
Managing the top of your mind

World's Simplest Code Generator (html edition) World's Simplest Code Generator

25 steps for building a Micro-ISV 25 steps for building a Micro-ISV
3 minute guides -- babysteps in new technologies: powershell, JSON, watir, F# 3 Minute Guide Series
Universal Troubleshooting checklist Universal Troubleshooting Checklist
Top 10 SecretGeek articles Top 10 SecretGeek articles
ShinyPower (help with Powershell) ShinyPower
Now at CodePlex

Realtime CSS Editor, in a browser RealTime Online CSS Editor
Gradient Maker -- a tool for making background images that blend from one colour to another. Forget photoshop, this is the bomb. Gradient Maker


[powered by Google] 


How to be depressed How to be depressed
You are not inadequate.



Recommended Reading

The Best Software Writing I
The Business Of Software (Eric Sink)

Recommended blogs

Jeff Atwood
Joseph Cooney
Phil Haack
Scott Hanselman
Julia Lerman
Rhys Parry
Joel Pobar
OJ Reeves
Eric Sink

Aggregated Links

proggit
dzone
hacker news
dot net kicks

Human Link Machines

interesting finds
a continuous learner's weblog
arjan's world
weekly link post

LinkedIn profile
LogEnvy - event logs made sexy
ShuffleText - fuzzy search for .net
PC Smart Buys - Computer Hardware in Australia
 
home .: about .: sign up .: sitemap .: secretGeek RSS .: © Leon Bambrick 2006 .: privacy

home .: about .: sign up .: sitemap .: RSS .: © Leon Bambrick 2006 .: privacy