Category Archives: new media

More on the trip

After my talk at De Geuzen, I wandered around downtown a bit and then had dinner with Florian at a cheap but good Roti place near Piet Zwart’s new location in the Kareldormanhoff. We are still trying to think about how to do a joint MA, but it’s proving much tougher than I originally expected. I think we (the CSUStan group) will have to get our MA going, and maybe first try some simple exchanges for course credit. Also, the the CSU is under threat of major budget cuts, and so any new projects will be harder if we are all tightening our belts.

I was still really jet-lagged, so after dinner I went back to the flat and tried to answer email or read, or something, but while I had trouble sleeping I also couldn’t think very well. So annoying. I should have drunk more at dinner. 😉

Wednesday I had another interview scheduled with Hajo Doorn, director at Worm, and thanks to my jet-lag I woke up barely in time to dress and race over there. This time we talked less about Worm itself and more about how Hajo sees the Dutch new media scene and his own role in it. I was impressed at how ambivalent he felt. I say impressed because Worm seems to be doing very well and Hajo himself has gained some influence, including serving on some kind of committee or board that awards grant money for projects. I’m not sure how many people in this position would question what it meant, whether it was right, so I am impressed that Hajo does.

He made several striking comments in this vein. First, and this seems to be a shift since last summer, he thinks Worm is in a way forced to be too big now that they are successful and receive funding themselves. They have to employ a lot of people in order to comply with the requirement of receiving funding, and maybe its good that all these people have jobs, but a lot of money is now not spent directly on projects. Also, he’s not even sure that their projects are always the most deserving or successful–that goes back to our earlier discussion of how success is measured. Also, based on his comments on certain other groups, I think Hajo worries that he will become disconnected from real innovative work, because he’s so wrapped up in administrivia. Finally, he’s not sure the project he is involved in evaluating are always so great, but who knows, maybe that’s not so important either, maybe the experiment is worthwhile. I haven’t met anyone else willing to be this forthright and I admire that like hell, because of course it’s a risk, both personally and professionally.

We also talked about what kinds of work is most interesting right now, and what is overrated. Hajo is completely fed up with what passes for interactivity, and I agree with his critique. He gave the example of an art piece in which people step onto a platform with sensors that measure their feet and if their feet are one size, a light this color glows, and if they are that size, a different color light appears. So what? Unfortunately a lot of interactive pieces do seem to remain at this really basic level and so they very quickly become really boring. I further agree that for real, interesting interaction we would probably do better with artificial intelligence.

When I think about, for example, the web sites that are interesting, they are those that facilitate interaction with others–whether we speak of something like FaceBook, World of Warcraft, old-school MOOs, or what have you. And compare this to static texts like novels, paintings, movies. Though these don’t change, they represent (I think) a density of the creator’s/s’ thoughts that readers or viewers can interact with over time. So, interactive new media, to succeed, has to either connect us to other people, or in someway recreate the experience of a conversation with another intelligence.

I’ll have more on the conversation with Hajo later on, but I have to to catch up on other stuff–I am so behind on my entries!

I am a "third back-up"

No, I’m not talking about computers. A friend’s wife is expecting a baby and they already have a little girl who is about 18 months old, so when the baby comes, I am 3rd in line to watch the little girl. –of the three of us on the list, my own kids are youngest, so I guess that makes me least eligible, or something like that. My own require the most attention, this actually means, which I hope is a function of age. Anyway, my friend is quite anxious because if his wife needs a C-section, she won’t be able to lift either baby for about 10 days, my friend works full-time, and their families are far away. He asked “what will we do?” And I said, “you call me, and M, and S, and T, (other friends) and you ask for help, of course.” Parents know that you have to help other parents because you have to be able to trust others will help you, and it’s the right thing anyway.

–I’m also thinking about how no one ever flames parents for asking newbie questions, which we all have done, in spite of reading all the manuals and guides obsessively. The first thing parents learn is that infants are full of buggy software, installing new apps never goes as planned, predicting up or down-time is impossible, and the documentation never seems to cover your exact problem, the error messages are well nigh unintelligible (voice recognition training takes forever). Even input and output are pretty unreliable.

Really, after kids, computers are an f-ing cakewalk.

I bring all this up because it occurred to me that in all the discussion of how communities work, and why some people will help others with computer stuff for free, or put effort into communities for free, this is one model I’ve never heard mentioned. That is, I think just about anyone who has had children understands that sometimes you have to just ask for help without knowing if you’ll ever be able to repay it, and sometimes you offer help without worrying about being repaid. Both cases require swallowing your pride, I’d say. Maybe that’s why it’s not discussed, because people are so firm in believing that net culture is all about reputation. (I assume it’s not lack of experience, because net/computer/whatever scholars can’t all be childless!) And people think the web is all about impatience; but regardless of anything else, parenting requires incredible patience for years on end, with consistently insufficient sleep.

Also, thinking about intellectual property, our children represent perhaps the only group to whom most of us will give money, time, energy, and maybe most important, ideas, without the least concern about who gets the credit. Maybe this last sounds silly, but it’s rather novel for an academic who lives and prospers on the strength of her ideas (or doesn’t).

Well, I think the failure to consider parenting as a useful behavioral model might represent a blindspot in the research. Not sure yet; now that I’ve thought of the possibility, I have to watch and see if it seems to be borne out. (so to speak. *g*)

The transformation of Literary and Media Studies

Finally I have a chance to finish my report on Katherine Hayles; I’m sure you must all be relieved, waiting with baited breath as you were. Or weren’t you? tsk tsk. Well, I will finish it for my own satisfaction then.

After laying out her argument for human-computer interaction being an example of intermediation, or emergent complexity (or at least having the potential to so be) Hayles then claimed that “consciousness is not the expression of a coherent unified self, but is the narrative that sutures together a fragmented collection of multiple agents working simultaneously.” Based on my own fairly extensive research in neuroscience, I can say that this is indeed what is believed, and has been believed for since around 1997 at least. She cites Daniel Dennet.

Some E-lit takes a form that enacts this view: for example Slipping Glimpse by Stephanie Strickland, work by Cynthia Lawson, and by Jaramillo.

Hermeneutics alone can’t do the bridgework needed for E-lit (I know of one friend who might disagree…) and this has led to a profound transformation of traditional disciplines under the pressure of electronic media. Here we ran out of time, so unfortunately rather than elaborating on the above examples or explaining further about this transformation, Hayles said only that Literary and Media studies should be part of this conversation, rather than being shunted aside by new fields or by the sciences themselves.

And lastly a plug for the new E-Lit Anthology.

Of course there were a few questions, but the most interesting was from Samuel Weber who asked if meaning had to equal unity–what about the 7 types of ambiguity, for example, and isn’t hermeneutics all about interpreting? (refering to here early point that meaning depends on the device doing the interpretation). Hayles answered that there has been a shift in (or an expansion of) “interpretation” from high level cognition to machine interpretation. She then quoted Emo Phillips: “I used to think the brain was the most wonderful organ, but then I thought about who was telling me this.”

It was a funny response, but I don’t think Weber is so easily answered as all that, and while ultimately I could imagine possibly agreeing with Hayles, I really need to hear or read more about the latter stages of her argument.

Overall this was a good talk in the clarity of explanation and competence of its delivery, but I really wish we had gotten farther than just laying the groundwork because of course it’s her last claims about hermeneutics and the transformation of the disciplines that really need to be argued, rather than just explained. Better yet if she had a paper out somewhere that went into more detail. But so far she doesn’t, that I could find, and I checked. If anyone knows of one, please tell me!

More on Hayles

Ok, so having introduced the idea of emergent complexity and it’s requirements, Hayles next started talking about analogies as pattern recognition. She reminded us of Douglas Hofstader’s claim that all “cognition is recognition.” If recognizing patterns is what leads to understanding analogies, well so what? She gave some examples first of human ability to understand analogies.

If ABC =>ABD
then WXY=>?
of course WXZ.

But then what would the next term be? everyone in the audience immediately suggested WXA, because we know that typically lettering starts over (or possibly doubles, but I guess we all assumed only three-letter combinations were allowed).

The machine comes up with:

WXZ=>XY
WXZ=>WXZZ
WXY=>WXA

So it eventually reached the same solution–Hayles didn’t say exactly how they “learned” or whether it was just random, and now I wish I’d asked… Then she gave an example of Morse code which combined digital (substituting dots and dashes for letters) with analog (using spaces to represent pauses) so that space=time. By contrast, binary code is all digital in which space (absence) must be represented by an actual term. She brought up Morse code to demonstrate that we all understood the spaces to represent spaces or pauses between words because of implicit assumptions based on homologies between Morse code and our everyday experience of speech.

The invisible assumptions we make about one medium are made visible when we change to a media that doesn’t support the homology behind the assumption.

Next she refers to Ed Fredkin’s notion that “the meaning of information is given by the process that interprets it.” By interpretation she means for example the way an MP3 player interprets digital information and interfaces with some other device to produce sound, but we can also say this about cognition. –Question, is this a metaphor, or a model? I think she means it to be a model.

We experience sensory input which activates neuronal groups that then activate maps, which activate larger cognitive structures, which eventually add up as cognition (recognize this pattern?).

If we go along with Fredkin, then we shift our emphasis from product to process (of course we did this in Comp. Theory years ago), from intentionality to consciousness, to “aboutness” as a spectrum….meaning is de-anthropomorphized. I hope I didn’t miss something important in that ellipses in my notes.

Having said all of this, humans and computers interacting meet the conditions for emergent complexity or intermediation. Certain works of E-literature foreground this as content as well as process. The evolution of E-literature also exemplifies a dynamic heterarchy (see the outline of conditions in my previous post)as we adopt new media. So the codex book was for storage and transmission of ideas; iit was a vehicle for cognitions. The computer though is an active cognitive agent–that is, it acts upon data and doesn’t just store or transmit it.

Ok, I only have one more page of notes, but it’s the most complex, so it must wait until tomorrow. At the earliest!

I leave tomorrow and while I’m mostly packed, I may need the morning to make sure everything is organized before I leave around 9:30 to get the tram, to get the train, to be at Schiphol by 11:30 for my 2pm flight. Tot ziens!

A brief interruption of the timeline…

Before I finish reporting on Worm, I have to pause and catch up on some earlier stuff, before I forget everything, so this entry will be on Katherine Hayles’ keynote speech at the Re-mediating Literature conference that I covered very generally a few posts back.

Ok, she had a really clearly laid out talk with started with an explanation of emergent complexity and what conditions produce it. Here is an overview of her points, closely paraphrased from her slides (finally, someone who did a simple PPT presentation with no bugs):

–The universe is fundamentally computational (Wolfram)
*examples of cellular automata, fractals
–Emergence, complex behaviors arising spontaneously and unpredictably from simple computational rules
*example cute program with 24 independent agents to which various rules can be applied (I wonder if she coded that herself?)

But, digital mechanisms can’t be the whole story; digital and analog cooperate, for example in DNA strand replication, which is digital, only creates a practical or concrete result when it is expressed through protein-folding, which is an analog process. Analog is good at transferring information while digital is good at error control and both are essential in the case of DNA.

But these two processes affect each other and we see evolving complexity across levels–“dynamic heterarchies.”

Feed forward and feedback loops in dynamically interconnecting media. In other words, First level primitives interact and the results of those interactions become second level primitives, and so on. For example, the interaction of sub-atomic particles make atoms, the atoms interact to form molecules, and the molecules interact to form proteins. But, activity on any level reaches not just those right about or below, but may reach through levels as well.

Another example is pregnancy; the mother is producing the fetus, but at the same time, the fetus is re-engineering the mother. –This example really struck me because it’s really quite interesting the way developments in the fetus trigger further changes in the mother, and at the same time the fetus is reacting to changes in the environment (the mother) who mediates changes in the external environment, such as what is present in the air or the water or the food she takes in.

So intermediation has these crucial components:

–Different levels of complexity
–Different media
–Re-representation
–Heterarchical dynamics

all of which lead to emergent complexity. Damn, still 4 pages of notes left, but I will pause here. So remember, emergent complexity comes from dynamic intermediation.

Reflections on New Media/Cyberculture studies

During the first conference and in many of my conversations with people connected to Piet Zwart, the question keeps coming up about what exactly we are all doing in this field. Should we be studying the technology? The creative practices? The sociology? Thank God I’m in rhetoric–there’s nothing like a meta-field to happily encompass interests (like mine) that might generously be described as broad…maybe fragmented is more accurate…

But back to the question, why do we study these things? I think that’s the big question, and while we don’t have to have the same answer, I don’t see many people talking about the question at all. There seems to be an idea that we all have already agreed that computer tech, the internet, the web, are worth studying by definition. –Well, you could argue that anything produced by people is worth studying, certainly that’s a long-standing view of cultural studies. But I think we have to make the case a bit more clearly than that. Maybe I will make this a central question in my interviews.