Separating Data and Implementation for California’s War Dead project

A few months ago, I got a spreadsheet in my email which I quickly turned into a CSV file. The data was pretty straightforward, an id, first name, last name, date and another type of id. I was able to parse thru it, looking up the secondary id and date and coming back with a value. It was a all pretty standard stuff for dealing with data. The problem was the what the data represented. Each line was a member of the Armed Forces who had been killed since 2001.

When I looked at the data that way, it was difficult to focus on the task at hand, knowing what each line was but separating and just looking at it as pure data helped.

Now, the project has been finished and you can view it at California’s War Dead. It’s a sobering data-driven view of the those from California who have lost their lives protecting this country. It’s something that should cause you to pause in between the BBQ’s and holiday enjoyment.

I don’t take any credit for the app though, it’s really the work of Ben and Eric. I just helped with getting some of the archived obituaries on to our Article server.

You can see people from your home town, your high school and how old you are. All of these are ways to bring the tragedy closer to you and no longer have those who have died just a name in an article.

It is these kinds of projects that brought me to the Times and I can only hope that I can help with more in the future.

Linked from Anarchaia

My Friday afternoon tradition is to check out Anarchaia which is one of my favorite tumblelogs. I wait until Friday because invariably there will be many links for blog posts and papers that I want to read and doing so on the weekend is much better for my productivity.

I was pretty amazed to find myself being linked to last week though. It seems my post about Facebook’s new Chat application and the way they tested it hidden on the page was useful. It seems like a little thing but I’m pretty proud of it.

Facebook Chat development

One issue when you have existing user base is how to roll out new features with minimal impact on servers and user experience. When Facebook rolled out Facebook Chat they used a pretty good system of figuring out how things can scale.

The secret for going from zero to seventy million users overnight is to avoid doing it all in one fell swoop. We chose to simulate the impact of many real users hitting many machines by means of a “dark launch” period in which Facebook pages would make connections to the chat servers, query for presence information and simulate message sends without a single UI element drawn on the page.

At EarthLink, I helped build a new user preference system, replacing an older system. Obviously, you have to switch the systems without a hiccup so no one would notice. The way we did was very similar to Facebook’s. Each time a preference was saved in the old system, we also saved it in the new system, allowing us to see the impact of the new system on the user experience. It helped us shake out bugs which wouldn’t have shown themselves during basic load testing. Lauching a new app is easy since you can scale it up but it makes things much more interesting when you have to deal with existing users.

Links Links Links

Weekend Chicago ‘RedEye’ Reaches 100,000 Opt-In Subscribe

Interesting… I wonder what it is about RedEye that is causing this.

A year after its launch, the weekend edition of RedEye has more than 100,000 opt-in subscribers, the Chicago Tribune’s quick-read tabloid said Monday.

Mondays through Fridays, about 200,000 copies of the free paper are distributed through newsboxes and stacks in the city of Chicago. The weekend edition is home-delivery only, and must be requested. It is delivered Saturday mornings.