offkey

If you are curious about how I spend my time, as I know handfuls of people on earth are, here is today’s answer: Bkrpr Blog – Paperback testing begins in earnest.

The longer answer is that it is a device I’ve been working on since the summer to more easily convert my paper books into a digital form. I’ve had test hardware working for a number of months but things were going pretty slowly until James decided to build some image processing scripts to accompany the effort. Those scripts became a fully fledged python application around the end of the year, and we’ve since begun documenting the project in earnest.

The bkrpr wiki has all the relevant links, and a nice front page YouTube video of the device in use. Or a very poor YouTube video of the inside of my room, depending on how you look at it.

If you’re curious to check it out, take a look at the site, or grab the processed test pages online or in pdf.

Shortly before christmas last year I had an experience with the internet that left me speechless. The actual effects, besides possibly this blog post, aren’t exactly negative, but the implications of it, and the incredible ease with which it happened, left me a little stunned.

To put it simply, my past caught up to me. A friend, who I had trouble even recognizing at first, friended me on facebook. This one connection was enough to fill my notification streams with the faces of people I hadn’t seen since childhood and pictures I was in before I knew how to read, let alone had heard of something called the “Information superhighway”. My newly rediscovered friend was one of a small handful that I had actually gone to school with continually from Elementary school through High School. Growing up in the NYC School system, that was natural. Equally natural to me was losing touch with most of the other kids as we moved up and between different schools. But now, by reconnecting to a single relationship that ran all the way back in school, I was around them again. Curious, I dove into the stream of new profiles.

What I found was part photo album and part class reunion. Old friends were getting back together, talking about old times and updating each other about all the new things happening in everyone’s lives. Old pictures were scanned and reminisced about, any relationship status of “married” received obligatory public comments of impressed congratulation, and a couple people threw up class photos from back in elementary school, tagging most of the names with either the person’s direct facebook link, or just their name if no one was yet connected to them. That is about when things started getting weird for me.

Something about seeing everyone’s picture streams mesh together Jr. High school, College, Elementary school, and wedding pictures side by side made me a little uneasy. Coincidentally, I had seen one of the posted class pictures a few weeks before while at my mother’s house for the holidays. Looking at the electronic version I realized that it had more people identified than I had been able to identify when trying on my own. On the first grade class picture I couldn’t even find my face without the tag someone put on it. In some ways, facebook knew these events from my life better than I did.

That’s when I realized that this was not just a class reunion or looking through an old photo alum, this was history rebuilding. The activity is much the same, you get together with your friends, talk about the old days and who we all used to be, but when it happens in a social networking site the result is very different. This time, when you reconstruct what happened way back when, it stays reconstructed. The more people that join in, adding details, fleshing out stories, agreeing and disagreeing about how things happened, the better the history becomes, until our childhood photos sit side by side with our wedding portraits in the public profile of our lives and arguments we have forgotten are summarized and immortalized on someone’s Wall.

I was stunned at the ease with which social networking tools allowed this kind of collaborative memory rebuilding to happen. If you had asked me two months ago how to go about getting in contact with my 3rd grade teacher, I would have stared at you blankly. Now, I would just go and reply to her facebook mail (I will soon Ms. Santiago! I just don’t like facebook mail). I almost dismissed the original friend request as SPAM, but the strength of our mutual connection to one of my/our Jr. High teachers made me stare at my friend’s picture until I could put an identity to the face.

If you are a big user of social networking tools you are unlikely to be shocked by anything I’ve said. Even as an arms-reach user I understand that this is simply the tool working as advertised, and I’ve always known that this kind of full-life documentation was possible. I’ve known that it was possible but I always thought of it as a problem for the next generation, the one that is growing up inside the social network right now as the only natives in a strange land. What I didn’t see, or didn’t let myself realize, is just how fast the network is filling in our lives behind us. To a large degree, the online reconstruction of our pasts is happening whether we participate or not.

My childhood happened before the internet, most of my life occurred before digital cameras became mainstream, and I managed to get out of college without anything that current social networking users would recognize as a profile. But the network is there with family and friends on it and the old connections can be re-connected as easily as new ones can be built. If I am going to have to live with this in my lifetime, without the experience or established social norms that would have come along with growing up with such a system, I want good tools and a deeper look at what kinds of things our society might have to change in order to keep up.

The whole experience greatly increased my interest in ideas for a free, and truly user-controlled, social network as well as in the book on privacy, the law, and networked society that I’m attempting to work with Eben on over the course of this semester. More on both later.

The incident

At the end of July a small PA lawsuit gained relatively wide coverage when Google, who was being sued, filed papers with the court that mentioned how satellite imaging impacts privacy. The story is interesting not because of what Google said, though that is what most stories focused on, but because of what it shows about the public sensitivity towards Google on matters of privacy.

Background

Back in the spring, a couple in Pittsburg sued Google for posting pictures of their home on the company’s Street View map of the area. They claimed that having a “private road” sign on the street made Google’s picture taking a “grossly reckless invasion on Plaintiffs’ seclusion” and that publishing them in the Street View map of the area caused them “mental suffering and diminished the value of their property,” for which they sought $25,000 in damages from Google, and the destruction of the pictures of the house.

While the “private road” sign might make you wonder whether the pictures should have been taken, the idea that taking them caused mental suffering and diminished the value of the house, or that $25k is somehow warranted to make amends, those just seem far fetched. The couple’s claims seem even worse once you find out that the county’s Office of Property Assessments already had a picture of the house on their own website, as well as a floor plan and details about the price the couple paid for the property, the age of the structure, and the size of the lot.

What Google said, in context

In their reply to the couple’s complaint Google points out that similar pictures of the house were already available on the internet. They also point out that the view of the house is not really private at all, being routinely viewable to the several other families on the road, delivery and salesmen, and other members of the community in the common course of going about their daily business. As additional evidence that no invasion of privacy occurred, Google cites the Restatement (Second) of Torts. The Restatement series are:

highly regarded distillations of common law. They are prepared by the American Law Institute (ALI), a prestigious organization comprising judges, professors, and lawyers. The ALI’s aim is to distill the “black letter law” from cases, to indicate a trend in common law, and, occasionally, to recommend what a rule of law should be. In essence, they restate existing common law into a series of principles or rules.

law.harvard.edu

In this case Google quotes a section dealing with the idea of complete privacy, saying:

[c]omplete privacy does not exist in this world except in a desert, and anyone who is not a hermit must expect and endure the ordinary incidents of the community life of which he [or she] is a part.

Which Google follows up by saying “Today’s satellite-image technology means that even in today’s desert, complete privacy does not exist” (Google’s filing), a single sentence to help bring the 1977 Restatement into line with our current realities.

Regardless of the comment’s brevity and the fact that Google’s point about satellite imaging is entirely correct, seeing Google state that “complete privacy does not exist” was enough to get people upset and talking about it. Even in the context of elaborating on a quote

Why?

Why did this sentence, or rather the second “no complete privacy” half that most of the coverage focused on, get people upset? Other people have said similar things, and in context it is clearly uncontroversial. But this time Google is saying it.

As a result of their success, Google has become something of a bag man for the information age. They know about the things you like, and the things you are curious about, and they probably know where the bodies are buried. So when they talk about the limits, or lack thereof, of modern information gathering, people get nervous. Even if what they say is obvious, or uncontroversial, or has been said many times by others. It is one of the reasons that bag men don’t talk much, though of course that just adds impact to the few things they do say.

They understand privacy better than we do

People are nervous because Google has them at a disadvantage. Our social sense of privacy is in a period of flux, still adapting to the rise of computers and the digital networking of information around them. The first half of making that adjustment is knowing just what information is currently being kept quiet and what information we are all broadcasting to each other. Google has a pretty good idea, most of us don’t. Though attempts have been made at documentation.

What should bother you

You don’t know

While the privacy implications of Street View are interesting to talk about, it is only a single instance of a larger problem. In the world before networking, we had photographs of every building in every city. Some few iconic pictures became famous and were accessible to a wide audience, but the majority remained in the hands of the original photographer or a small collection of people around the photographer. The change from that world to the world we are entering where all our pictures get networked, and overlayed, and geo-tagged, and are in general becoming available to anyone with an internet connection at any time, that change from isolated pockets of information to wide pools of networked information does just as much to change our expectations of privacy as the movement from small towns to cities.

The thing is, everyone who has moved from a small town to a city, or from a city to a small town, can tell you about the changes in privacy expectations that come with the move. Both ways of life are familiar enough that the trade-offs of space vs. anonymity are well understood and there are social coping mechanisms to help people adjust in either direction. But when I talk with people about the rapid networking of personal information online, about the power and knowledge of your life that you give to other people when you feed everything you do online through other people’s social networking sites and webmail, the changes are so new that there is no vocabulary, no set of examples with which to illustrate the new trade-offs.

It is hard to put your finger on…

Right now, it is hard to even talk about the social impacts of this networking, about the changes in power relationships between family, friends, businesses, and government because those relationships are still changing. Except for an increased risk of credit fraud and the still mention-worthy instances of people fired based on information from social networks, the larger social consequences of personal information networking have not yet started working through society. Because of this newness most of the public discussion of these issues is reactionary, like these pieces about the PA lawsuit. Over time we will move past reaction. Private records of presidential candidates will continue to be inappropriately accessed and large databases of personal information will continue to be lost by government and private industry alike, until it becomes clear just what kinds of new illicit behavior are made possible by all this new information.

In the meantime, I’m trying to work with my boss on a book that will explore how some of these changes can impact the historical social and power dynamics embodied in our legal system and government. Even if contextualizing the issues doesn’t give us a crystal ball to see how they will evolve over time, it should give us a better understanding of what the stakes are and structure some of the wild reactions, like these and other privacy stories about Google. Hopefully it will help the conversation.

Update:

Case dismissed

Looks like the case was dismissed because, among other things, “[t]he Plaintiffs have failed to plead — much less set out facts supporting — a plausible claim of entitlement to injunctive relief”. Not surprising.

Farms vs. WoW

In 2006, I read a great blog post that pointed out how the professional media is still working from a very old picture of the American lifestyle. The post, called “Farm Fetish,” explained that more people in the United Stated have World of Warcraft (WoW) accounts than work on farms or ranches. I don’t know exactly where he got his numbers, but the most recent Census ones I can find (2006) list the number of people employed in farming, fishing, and forestry occupations at almost exactly 1 million. Blizzard’s most recently publicized (2008) subscriber numbers claim more than 2.5 million North American players. So the scale of the comparisson is right.

Go where the people are

Ok, so maybe you shouldn’t go to farms or WoW when looking for the statistically average American, but if you’re just looking for votes, that’s different; politicians need to address people wherever people can be found. Even if only a million of the North American players are in the USA and old enough to vote, think of how that compares to the farmer population! And odds are that a significant number of those other million and a half subscribers are simply too young and will be voting eligible by the next presidential cycle.

Take advantage of it

So why shouldn’t political campaigns take advantage of the shared interest? They could hold a “Maintenance Tuesday: Get Out The Vote” campaign to try and get players to commit to voting on Tuesday morning when the North American servers have their weekly maintenance. Using the scheduled maintenance means you don’t have to change anything about the game in order to reach players, and the morning of election day is when lines are shortest.

Talk about it

Since you don’t need to change anything with the game, it can be a very simple campaign, just talk about it. Talk about it in the forums. Talk to other media about it. When talking to people directly, mention it just like you might mention other targeted drives in an effort to get people to vote.

Who knows?

It might work, and you can get great coverage from showing that you actually understand how technology is affecting people’s lives. And it plays in Kansas.

I’ve done a lot of writing in word processors over the years, but now that I work in an office full time, I no longer have much use for them. The passing of this once essential program into the category of “sometimes comes in handy” seems worth a moment of reflection, so I offer here a short eulogy and some words of explanation for the death of the word processor.

Looking back

Before we mourn losing the word processor we should look back at what it is and what it has done for us. At its core the word processor is virtual paper and the promise of WYSIWYG, the promise that, however you arrange things on the virtual paper, they will look the same on real paper when you print a copy. Other capabilities were built in later, things like change tracking, macro languages, and outlining modes, but these tools never take the spotlight; word processors remain word processors, not outlining tools or version control systems. It is all about the virtual paper.

And it was great. In Jr. High we spent weeks learning how to properly format documents. There were tests on where to place the opening line on a business letter, how many lines to skip between address blocks and the To: or From: lines, and other layout details. We were effectively learning typewriter office skills. Word processors made laying out documents so easy that simple formatting information like this could be stored for us. So, by the time any of us had to write a business letter, we no longer needed to remember how to format it. All we needed to do was pick “business letter” from the template menu of our word processor and remember to replace all the dummy "YOUR NAME HERE" text with our real information.

Problems with virtual paper

It was great, but there were problems. Competing word processors were often incapable of reading each other’s files, locking people into one camp or another. Time and competition between camps brought new versions of the word processor software; new tools were added to allow for more complicated layouts, to help correct common errors, and to make existing features easier to use. These changes increased what people could do but also brought further incompatibilities. New versions of the software had problems using old documents and documents in the new formats wouldn’t work at all with the old software.

Virtual paper began to age. People who had used these virtual sheets as a way to archive documents found that new word processors would corrupt the formatting in old documents and refuse entirely to open some of them. People who wanted to switch from one word processor camp to another had it worst, often having to rely on third party conversion utilities to use their old documents at all.

Digital communication

So virtual paper aged, people got increasingly tied to one format or another, and the internet happened. Now rather than exchanging the paper documents, people began exchanging the virtual paper versions, making it even harder to know what version of what program your document would be opened with. Once .doc and .wpd, and later, .odt documents were being sent around, the promise of WYSIWYG stopped meaning much. What you saw might be what you got but you could no longer know just what the other person was getting.

To regain control of their formatting, people began using PDF, the virtual printer for our virtual documents. By making a PDF of your document you basically trade the ability to edit your document in the future for an assurance that your document will look and print the same on any other computer. While this is useful for documents where formatting is important, resumes are an often cited example, it represents a step backwards for word processors.

Word processors are not the only, or even best, way to generate PDFs. Once PDFs became a standard form of print-ready documents, people built web applications to generate them from any page on a website as well as OS-level PDF printers that let you create a PDF out of any file on your computer. As the tools capable of producing print-ready documents multiplied, the word processor began to lose its place as people’s primary tool for authoring documents.

Simplification

At the same time that PDF was ironing out incompatibilities and creating a nearly universal form of print-ready virtual paper, people started to notice that a lot of their print-ready documents were never getting printed. As people grew more comfortable with digital means of communication they began to rely on them to carry more of the content once invested in paper. People who had once felt the need to attach word processor or PDF documents to their emails began moving the material from those documents into the email itself. Personal correspondence moved not only to email but to chat rooms and instant messaging, places where printing to paper was not a concern.

Free of the complicated formatting necessary for paper, people fell back to the handful of basic formatting options they felt most necessary for communication in a digital context, things like:

>> quoting and
> later
/italics/
*bold*
[ links | to places ] and

paragraph breaks.

Those five, in addition to the rich complexity of our natural languages, turn out to cover most of what people need for communicating the sense of their messages.

This trend, of replacing elaborate formatting, like virtual paper, with lightly marked up plain text, is shrinking the domain of word processors each day. Wikis, the largest document creation projects in history, all use variations of the basic formatting options shown above. Current social networking and publishing tools are the same, as is email. The rise of syndication formats like RSS and ATOM is perhaps the best example of people happily removing all page layout formatting to more easily access the plaintext or lightly marked up text underneath.

Which is not to say that people stopped caring about the visual appearance of their documents. Layout and design remain as important as ever, but all of that information simply moved to the side, into CSS sheets, and blog or social networking theme packages.

The prime example of both these trends is the web itself. While many PDF documents, and some few .doc files, remain available online, they are dwarfed by the HTML ones that make up the web around them. The combination of HTML and CSS has beaten out all previous electronic formatting standards and become the most universal way to format writing since paper. Word processors have never created either format well.

Today

Today I neither send nor receive business letters. Almost all of my professional communication happens over email, including things like negotiating for event space, arranging travel, and handling requests for legal services from our office. I write my documents in markdown, one of the popular lightweight markup systems, and use a program called pandoc to convert them to whatever format I need: PDF, HTML, LaTeX, or odt. Separate style sheets let me easily format the same text for letterhead, publishing on our website, publishing on my website, or general printing. The things I read come to me as websites, RSS feeds, email messages, and, most recently, ebooks (which are really just simple HTML documents re-packaged).

And so the word processor has passed from my life. I realize that it has not passed from everyone’s and it may not have left yours yet, but if the trends towards simple markup and PDFs continue forward, odds are that it will.