Tag Archives: Ivo Swarties

Interacting with stories and/or with data

A researcher, Ivo Swarties, at the University of Twente in The Netherlands is developing a means of allowing viewers to enter into a story (via avatar) and affect the plotline in what seems like a combination of what you’d see in 2nd Life and gaming. The project also brings to mind The Diamond Age by Neal Stephenson and its intelligent nanotechnology-enabled book along with Stephenson’s latest publishing project, Mongoliad (which I blogged about here).

The article about Swarties’ project on physorg.com by Rianne Wanders goes on to note,

The ‘Virtual Storyteller’, developed by Ivo Swartjes of the University of Twente, is a computer-controlled system that generates stories automatically. Soon it will be possible for you as a player to take on the role of a character and ‘step inside’ the story, which then unfolds on the basis of what you as a player do. In the gaming world there are already ‘branching storylines’ in which the gamer can influence the development of a story, but Swartjes’ new system goes a step further. [emphasis mine]The world of the story is populated with various virtual figures, each with their own emotions, plans and goals. ‘Rules’ drawn up in advance determine the characters’ behaviour, and the story comes about as the different characters interact.

There’s a video with the article if you want to see this project for yourself.

On another related front, Cliff Kuang profiles in an article (The Genius Behind Minority Report’s Interfaces Resurfaces, With Mind-blowing New Tech) on the Fast Company site describes a new human-computer interface. This story provides a contrast to the one about the ‘Virtual Storyteller’ because this time you don’t have to become an avatar to interact with the content. From the article,

It’s a cliche to say that Minority Report-style interfaces are just around the corner. But not when John Underkoffler [founder of Oblong Industries] is involved. As tech advistor on the film, he was the guy whose work actually inspired the interfaces that Tom Cruise used. The real-life system he’s been developing, called g-speak, is unbelievable.

Oblong hasn’t previously revealed most of the features you see in the later half of the video [available in the article’s web page or on YouTube], including the ability zoom in and fly through a virtual, 3-D image environment (6:30); the ability to navigate an SQL database in 3-D (8:40); the gestural wand that lets you manipulate and disassemble 3-D models (10:00); and the stunning movie-editing system, called Tamper (11:00).

Do go see the video. At one point, Underkoffler (who was speaking at the February 2010 TED) drags data from the big screen in front of him onto a table set up on the stage where he’s speaking.

Perhaps most shockingly (at least for me) was the information that this interface is already in use commercially (probably in a limited way).

These developments and many others suggest that the printed word’s primacy is seriously on the wane, something I first heard 20 years ago. Oftentimes when ideas about how technology will affect us are discussed, there’s a kind of hysterical reaction which is remarkably similar across at least two centuries. Dave Bruggeman at his Pasco Phronesis blog has a posting about the similarities between Twitter and 19th century diaries,

Lee Humphreys, a Cornell University communications professor, has reviewed several 18th and 19th century diaries as background to her ongoing work in classifying Twitter output (H/T Futurity). These were relatively small journals, necessitating short messages. And those messages bear a resemblance to the kinds of Twitter messages that focus on what people are doing (as opposed to the messages where people are reacting to things).

Dave goes on to recommend The Shock of the Old; Technology and Global History since 1900 by David Edgerton as an antidote to our general ignorance (from the book’s web page),

Edgerton offers a startling new and fresh way of thinking about the history of technology, radically revising our ideas about the interaction of technology and society in the past and in the present.

I’d also recommend Carolyn Marvin’s book, When old technologies were new, where she discusses the introduction of telecommunications technology and includes the electric light with these then new technologies (telegraph and telephone). She includes cautionary commentary from the newspapers, magazines, and books of the day which is remarkably similar to what’s available in our contemporary media environment.

Adding a little more fuel is Stephen Hume in a June 12, 2010 article about Shakespeare for the Vancouver Sun who asks,

But is the Bard relevant in an age of atom bombs; a world of instant communication gratified by movies based on comic books, sex-saturated graphic novels, gory video games, the television soaps and the hip tsunami of fan fiction that swashes around the Internet?

[and answers]

So, the Bard may be stereotyped as the bane of high school students, symbol of snooty, barely comprehensible language, disparaged as sexist, racist, anti-Semitic, representative of an age in which men wore tights and silly codpieces to inflate their egos, but Shakespeare trumps his critics by remaining unassailably popular.

His plays have been performed on every continent in every major language. He’s been produced as classic opera in China; as traditional kabuki in Japan. He’s been enthusiastically embraced and sparked an artistic renaissance in South Asia. In St. Petersburg, Russia, there can be a dozen Shakespeare plays running simultaneously. Shakespeare festivals occur in Austria, Belgium, Finland, Portugal, Sweden and Turkey, to list but a few.

Yes to Pasco Phronesis, David Edgerton, Carolyn Marvin, and Stephen Hume, I agree that we have much  in common with our ancestors but there are also some profound and subtle differences not easily articulated.  I suspect that if time travel were possible and we could visit Shakespeare’s time we would find that the basic human experience doesn’t change that much but that we would be hardpressed to fit into that society as our ideas wouldn’t just be outlandish they would be unthinkable. I mean literally unthinkable.

As Walter Ong noted in his book, Orality and Literacy, the concept of a certain type of list is a product of literacy. Have you ever done that test where you pick out the item that doesn’t belong on the list? Try: hammer, saw, nails, tree. The correct answer anybody knows is tree since it’s not a tool. However, someone from oral culture would view the exclusion of the tree as crazy since you need both tools and  wood to build something and clearly the tree provides wood. (I’ll see if I can find the citation in Ong’s book as he provides research to prove his point.) A list is a particular way of organizing information and thinking about it.