Computers and Education - Need for longitudinal studies

An interesting article in Bloomberg Businessweek on use of computers and educational outcomes (outcomes being performance in standardized tests or 'knowing').  So the general conclusion appears to be that technology has no impact or a negative impact.  However a quick read indicates that the results of the some of the cited studies are more nuanced.

The important issue is how one defines learning outcomes - learning is about more than math and science scores, but even it we stick with these outcomes, it is not just introduction of technology that may lead to negative outcomes but also changes in the curriculum.

Here are some results from the Inter-American Development Bank Study on Costa Rica:

" ... the intervention generated a more active learning environment ... students in the treatment group report explaining concepts to the class more often, preparing more exercises for others to solve, and frequently discussing possible solutions or arguments with other students."

"... all treatment groups that changed pedagogy to a student-centered approach learned less geometry than the control group ... results form the computer lab are very similar to results of the new curriculum suggesting that it does not help much."

So forget about technology - a student centered approach also has a negative impact as does the introduction of a new curriculum (without adding in technology.  And as one would expect, outcomes also depend on teachers.

"The evidence also suggests that teachers went through the motions as prescribed but did not master the innovation in a way that would have allowed students to get the most of it."  This - after training teachers!

Now to the best students.  Classes became more participative in the treatment groups and this made some students "uncomfortable with their new roles".  The "most abled" students were most uncomfortable.  Students with "higher pre-treatment SAT were disproportionally disengaged from the class".  Perhaps because they were more comfortable with the lecture style of teaching and/or because they lacked other 'soft' skills which are more important in a student-centered environment.

Regardless, this is not just about technology, but about any changes in the way of doing things.  In the short-run (which is what randomized-trial based studies measure) there are likely to be adjustments costs and those most uncomfortable with the change are likely to be the 'best students' since they did so well under the old regime.  So it would be nice to get some longitudinal evidence before concluding that technology has no impact or a negative impact on educational outcomes.  There is also a need to move away from the technocratic bean-counting approach to measuring outcomes.



OLPC again ...

I have always wondered why Nick Negroponte draws so much flak for OLPC.   Some tech companies don't like him either.  But their community affairs folks are doing the same thing - partnering with Govt. in developing countries to distribute subsidized laptops (of course these comes pre-loaded with proprietary software and other 'educational materials' from publishers who are using it as a channel to push their content.

Negroponte of course is not giving up ... The next version is supposed to be a tablet.  Here are two interesting articles on OLPC.

ARTS   | December 19, 2011 
Design:  A Few Stumbles on the Road to Connectivity 
By ALICE RAWSTHORN 
Technological advances help to slowly bring laptops and tablet computers to children all over the world. 

ARTS   | November 09, 2009 
Design:  Nonprofit Laptops: A Dream Not Yet Over 
By ALICE RAWSTHORN 
With a new Uruguayan project, the '$100 laptops' might finally start living up to their own hype. 

Homer-Dixon takes a dig at Negroponte

This is a cut-paste from:

The Ingenuity Gap:  Facing the Economic, Environmental, and Other Challenges of an Increasingly Complex and Unpredictable Future
Thomas Homer-Dixon
PhD Political Science, MIT

I don't know if anyone should read this book … he writes ...

"The people who work in political science are, for the most part, well-intentioned and smart."  *but*  "They have largely failed to produce any really valuable knowledge."

"Economics certainly deserves to be regarded as the queen of social sciences; unlike the others, it has unquestionably produced useful knowledge on a wide range of issues that affect our daily lives."

… Thanks but some of us have always known that!

Of course he is partly wrong (and I hope he is completely wrong) since we know from an earlier post that uneducated poor kids can use computers without being taught how to do so.  I continue to admire Negroponte's persistence.