{"id":1103,"date":"2011-12-14T10:06:10","date_gmt":"2011-12-14T10:06:10","guid":{"rendered":"http:\/\/www.mariarabinovich.com\/blog\/?p=1103"},"modified":"2012-10-01T20:41:48","modified_gmt":"2012-10-01T20:41:48","slug":"eye-tracking-attire","status":"publish","type":"post","link":"http:\/\/www.mariarabinovich.com\/blog\/archives\/1103","title":{"rendered":"the Gesticulator: Sensitive Attire"},"content":{"rendered":"

\u00a0A \u00a0 tool for overtly engaging the power of the eyes.<\/strong><\/p>\n

The Gesticulator projects what I am looking at onto my front, turning the gestures of my eyes from a passive to an active, even aggressive, statement. \u00a0<\/em><\/p>\n

More so than the gestures themselves, it is the shared awareness (between me and others) of the overtness of my eye movements, their visual representation, and potential archive, that renders common gestures extreme.<\/em><\/p>\n

\"\"<\/a><\/p>\n

 <\/p>\n

\"\"<\/a>

1 The Gesticulator at the ITP Winter Show<\/p><\/div>\n

 <\/p>\n

Whether being passive, assertive, passive-aggressive, thoughtful, or somewhere in between, you probably employ the power of body language and eye contact. But the unspoken rules that govern the subtle forms of eye communication are difficult to teach. Like language, these rules vary throughout cultures, and depend on one’s view of themselves.<\/p>\n

 <\/p>\n

<\/p>\n

<\/pre>\n

The uncrossable divide between the known and felt, between the stated, and the understood, is expressed and perceived in many ways.\u00a0There seems to be a level of appropriateness and formality to overt verbal communication, that eludes the kind of things we can say, suggest, or demand with our eyes and bodies.<\/p>\n

 <\/p>\n

Some<\/em>\u00a0of the gestures we “are allowed” to make with our eyes and bodies (like \u201cscrew you for stepping on my foot\u201d or \u201cI\u2019m looking at you, up and down, and thinking about making sweet love to you\u201d or \u201cum, you are making me really uncomfortable please back away\u201d, or \u201cI am so disinterested in what you are talking about I am trying to escape\u201d) \u00a0are absolutely not appropriate to say out-loud. \u00a0Yet we are fully accustomed to perceiving them otherwise. \u00a0Why do we accept them in their less-overt forms? \u00a0At times, the contrast between the perceived<\/em> and the acknowledged<\/em> is so great that it becomes awkward, hilarious, and very interesting.<\/p>\n

 <\/p>\n

I was recently in Boston riding the T and a man, sitting in the middle of a bench, was hoarding the surrounding three seats by literally holding onto them with his arms.\u00a0 His head was down all the way to avoid eye contact with the crowd standing directly in front of the empty seats. I was struck by the fact that he was so territorial yet unable to stand up for it with his eyes. If I had verbally asked him to sit down, I wondered, would he deny the statements of his body and allow me to sit? Or would he be able to say out-loud what he was already clearly communicating? \u00a0 It seemed that by not looking up at us, he was denying us the ability to engage in his non-overt form of communication. He was reserving the unilateral right to “speak”, and leaving no room for two-way non-verbal discussion. He was putting us at the very edge of the divide between the two forms of communication: a very precarious position, where one is forced to confront their fears about engagement.<\/p>\n

 <\/p>\n

To a lesser degree, I encounter this precarious situation daily during my subway commute, where I use my eyes to kindly ask for some space, or to sternly make somebody aware that they are in the way. \u00a0Avoiding eye contact shields us from these statements.\u00a0\u00a0In this way, eye contact seems to be the bridge to acknowledging body language and behavior.<\/p>\n

 <\/p>\n

 <\/p>\n

The train is a breeding ground for these moments. \u00a0We don\u2019t speak to each other, yet crowd into a small spaces. We use exclusively gesture and eye contact to communicate.<\/p>\n

 <\/p>\n

Sometimes non-verbal statements seem to creep toward the “overt layer,” like when two people are aware that they are both aware of it, and yet maintain a distance between the spoken and physical in their conversation. It can be ignored as people see fit: it is essentially passive. \u00a0As a result, it can be frustrating.<\/p>\n

 <\/p>\n

There is an entire blog dedicated to inappropriate subway\u00a0behavior that speaks to this frustration:\u00a0http:\/\/www.subwaydouchery.com\/page\/25<\/a><\/p>\n

I found the blog while looking for a good illustration of \u00a0this awkward moment where making eye contact threatens to bring your behavior into the realm of the addressable, the acknowledgeable, and maybe even the spoken.\u00a0 This thought\u00a0is not mine alone, because I found this post:<\/p>\n

 <\/p>\n

 <\/p>\n

\"\"<\/a><\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

Gaze, direction, focus, and glances, can be<\/em> powerful and tools. \u00a0I use the periphery of my vision as intentionally as I use my direct glance. \u00a0Today I was walking down the street when a man started to walk toward me very quickly from the side. Instead of looking directly at him, I looked in his direction, but specifically at somebody else more slightly to my left, so as to hold him in my periphery. I immediately wondered where this controlled and intentional reaction came from. \u00a0My instinct was to turn my head immediately in fear of approaching danger, but just as instantly something inside of me gave me pause and, with the ease of somebody expert at such gestures, I widened my vision and changed the intention of my gaze.<\/p>\n

Perhaps direct gaze is more communicative and therefore more acknowledgeable, and maybe I did not want to expose my fear. Whatever the reason, it seemed to be learned and personal.<\/p>\n

 <\/p>\n

 <\/p>\n

These rules, personal or cultural, that define the divide between the stated and the non-overt, define our engagement with each other. We use our eyes to mediate these rules.<\/p>\n

 <\/p>\n

This project is about our personal struggles with a social contract that creates hilarious, awkward, and sometimes difficult situations.<\/p>\n

 <\/p>\n

Would amplifying it visually, making it undeniable, make it less passive? How would I deal with the power of non passive body language? What if I were subjected to the same level of scrutiny in regards to my bodily statements as I feel toward my words?<\/p>\n

 <\/p>\n

The Gesticulator projects what I am looking at onto my front, turning the gestures of my eyes from a passive to an active, even aggressive, statement. More so than the gestures themselves, it is the shared awareness (between me and others) of the overtness of my eye movements, their visual representation, and potential archive, that renders the common gestures extreme.<\/p>\n

 <\/p>\n

Is objectifying the gestures the key to bridging the gap between the unspoken and passive and the spoken, active, and intentional?<\/p>\n

\"\"<\/a><\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

Technical Infos:<\/strong><\/p>\n

This project was built with the help of the open source eyewriter project<\/a>.<\/p>\n

 <\/p>\n

\"\"<\/a><\/p>\n

 <\/p>\n

\"\"<\/a><\/p>\n

The\u00a0eyewriter project\u2019s instructions<\/a>\u00a0are available online, and helped me figure out how to hack a ps3 Eye camera to include an IR filter. In addition to their system, I added an externally-facing camera with a wide angle lens to capture the field of vision. I adapted a code given to me by Dan O’Sullivan that uses the java rectangle class to find the pupil based on its size, and its relationship to the glint, a reflection of an infrared LED pointed at the eye.<\/p>\n

The code analyzes the field of vision to find the eye’s view based on the position of the pupil. This is done by first calibrating the glasses to the extreme locations of the pupil, and mapping that onto the field of vision.<\/p>\n

 <\/p>\n

My first attempts were surprisingly successful. In the following video, one clip shows my eyeball movement, and the next what my program thinks I am looking at. \u00a0Because I could not look at something while also looking at my computer to check for accuracy, I typed what I was looking at, and checked the video for accuracy afterward, and for the most part it was accurate!<\/p>\n