Tuesday, December 11, 2007

A problem with Megan's Law: the price of false inclusion

So what does Megan's Law say the penalty should be for erroneously including someone in a sex offender registry?
Slashdot | Online Sex Offender Database Leads To Murder?

...The LA Times reports on the story of Michael A. Dodele, a convicted rapist, found murdered in a Lakeport trailer park. He moved there after having been released from prison just 35 days before. A 29-year-old construction worker has been arrested in the attack, and explained that he killed Dodele to protect his son from child molestation. He found out on the internet about Dodele being a sex offender, via the 'Megan's Law' database. The public entry for Dodele in the database was wrong — though he was found guilty of committing crimes against adult women he was not a child molester. Dodele's entry in Megan's Law DB has been removed....
Wow, what a coincidence that a bizarre murder would coincidentally expose the only erroneous entry in this online registry.

Gee, there couldn't possibly be other errors, could there?

Your name couldn't be on the list, could it?

Terry Gilliam's brilliant and prescient movie Brazil (inspired by 1984), begins with a data retrieval "bug", that plunges the protagonist into a dystopian nightmare. That movie should be mandatory viewing prior to graduation from an American High School. (That's one more reason I'll never be elected to anything!)

To answer my original question, I suspect that Megan's Law specifies the same penalty for misidentification as the Homeland Security Act.

Nothing.

No price for falsely including a person in a list. A potentially high price for failing to include a person in a list.

Gee. I wonder what error will be more common.

The entity responsible for maintaining such registries (lists) should be required to:
  1. Pay $10,000 for every false entry regardless of injury or lack of injury.
  2. Be liable for triple damages in the result of injury or inconvenience, plus payment of legal fees.
That would reduce the false inclusion error rates significantly. In the case of Homeland Security's Do Not Fly list, I suspect it would eliminate the list.

Note, by the way, I'm not saying it's wrong to publish the details of a person's crime, and to mandate that they should notify the public of their whereabouts [1]. I am saying that we need to reflect on the consequences of the inevitable data entry errors associated with every form of profiling.

[1] That's for another post. This one is about errors in assignment.

Sunday, December 09, 2007

1967 was a long time ago

We saw a children's play yesterday. It was written in the 1950s, and it reminded me of how much culture has changed in 50 years.

One of the curious comic anachronisms is that the "bad" kids smoke cigars in the school bathrooms. Of course at that time most adults smoked everywhere, including in school offices and teacher meeting areas. So high school students smoking cigars in the bathroom would have seemed a funny exaggeration of everyday life.

In 2007, when middle class grade school kids rarely see anyone smoking anywhere, it's mostly weird - a message from an alien world. I guess the modern comic equivalent would feature body piercings.

Our culture has changed more than we usually recognize. Consider this prescient corporate video ...
Warming and the Right - New York Times

... This week, though, a short, uncannily accurate clip from “1999 A.D.,” a film made in 1967 by Philco-Ford, got lots of attention online when it was posted to the Ultimate News Flash blog (ultimatenewsflash.blogspot.com). The film’s depictions of electronic commerce and e-mail are about as spot-on as they could be, though the filmmakers failed to forecast changes in attitudes toward sex roles. “What the wife selects on her console will be paid for by the husband on his counterpart console,” the narrator declares. She is in the kitchen, buying clothes; he is in the den, paying bills....
When we were kids in Quebec (Napoleonic legal code) I think my mother wasn't allowed to give permission for medical procedures. Only the male could do that ...

The story of leaded gasoline

The Philip Morris ("Altria") story is pretty familiar. Buy off scientists, lie, addict children, etc. If there's a Hell, Philip Morris has meetings there.

I didn't know the story of leaded gasoline though, not till I read DI's review. By the 1920s the science was very clear that lead was a dangerous neurotoxin. Europe was restricting its use.

America put lead in gasoline, and kept it there until the 1970s...
Damn Interesting » The Ethyl-Poisoned Earth

... Upon learning that automotive fuel was the source of the contamination, Dr. Patterson began to publish materials discussing the toxic metal's ubiquity and its probable ill effects. In order to demonstrate the increase of lead in the environment, Patterson proposed taking core samples from pack ice in Greenland, and testing the lead content of each layer– a novel concept which had not been previously attempted. The experiment worked, and the results showed that airborne lead had been negligible before 1923, and that it had climbed precipitously ever since. In 1965, when the tests were conducted, lead levels were roughly 1,000 times higher than they had been in the pre-Ethyl era. He also compared modern bone samples to that of older human remains, and found that modern humans' lead levels were hundreds of times higher.

The Ethyl corporation allegedly offered him lucrative employment in exchange for more favorable research results, but Dr. Patterson declined. For a time thereafter, Patterson found himself ostracized from government and corporate sponsored research projects, including the a National Research Council panel on atmospheric lead contamination. The Ethyl corporation had powerful friends, including a Supreme Court justice, members of the US Public Health Service, and the mighty American Petroleum Institute. Nevertheless, Patterson was unrelenting, and the resulting rise in scientific and public awareness eventually led to the Clean Air Act of 1970, and a staged phaseout of leaded gasoline. Ethyl and Du Pont sued the Environmental Protection Agency, claiming that "actual harm" must be demonstrated rather than just "significant risk," an effort which successfully prolonged lead additives' life by another decade...

Alas, it doesn't sound like Dr. Patterson got a Nobel for his work ...

Steal a movie for all the scared children

My son's copy of Barnyard starts with a RIAA drm commercial. It reminds me of the "this is your brain on drugs".

It's supposed to scare kids straight I guess, flashing "downloading is stealing" with painful sound and visuals.

My 8 yo has to leave the room every time it comes on.

Gee, what a way for the RIAA to make some friends. If I could, I'd make a donation to 'united pirates of america'.

In the meanwhile, please steal a movie for all the scared children of the world.

Slouching towards Skynet

What drove the development of human sentience?

We didn't need fusion bombs to become earth's dominant predator.

The most popular justification of human cognitive evolution is that it was driven by deception. The need to detect deception, and the need to deceive. Deceive other humans, deceive ourselves.

So it makes sense that nonhuman sentience is also driven by the deception wars ...
Rough Type: Nicholas Carr's Blog: Slutbot aces Turing Test

Russian crooks have unleashed an artificial intelligence, called CyberLover, that poses as a would-be paramour in sex chat rooms, enticing randy gentlemen to reveal personal information that can then be put to criminal use. Amazingly, the slutbot appears to be successful in convincing targets that it's a real person...
War, games, and financial instruments, are the other modern AI drivers. Search is the classic motivator.

We're toast, but then we always were.

Good thing I can't explain why we're still around - otherwise I wouldn't be so optimistic!

Burn the Kindle

Not the books mind you. Just the Kindle. Virtually, since we don't need toxic smoke.
dougscrptr:

... If you are a Macintosh user, you need to connect your Kindle to a Windows-based computer running AudibleManager to authorize your Kindle...Once authorized with your Audible credentials, you can then use Audible files downloaded through AudibleManager under Windows or iTunes by copying them to your Kindle.
So if Jobs does deliver a slate at MacWorld, as the wildest rumors have it, there will a book-friendly device that works with both Apple and Microsoft.

So, was this an accident, a desperate deadline-driven move, or by design?

Saturday, December 08, 2007

Resisting the temptation of web services

It's so appealing to move software to a web services remote hosting model.

I lived through that era in the 90s. Among other things, we discovered that the internet fell a few orders of magnitude sort of the optimistic predictions of 1990. (We were all supposed to have fiber to the desktop by 2000.)

Joel Spolsky (over 40,000 subscribers on Bloglines alone, millions of readers) reminds us why a new generation should think twice about abandoning installed software (emphases mine):
Where there's muck, there's brass - Joel on Software

... For us, the installable option gives us five times the sales. It costs us an extra salary or two (in tech support costs). It also means we have to use Wasabi, which has some serious disadvantages compared to off-the-shelf programming languages, but which we found to be the most cost-effective and efficient way, given our code base, to ship software that is installable on Windows, Linux, and Mac. Boy, I would love nothing more than to scrap installable FogBugz and run everything on our servers... we've got racks and racks of nice, well-managed Dell servers with plenty of capacity and our tech support costs for the hosted version are zero. Life would be much easier. But we'd be making so much less money we'd be out of business.

The one thing that so many of today's cute startups have in common is that all they have is a simple little Ruby-on-Rails Ajax site that has no barriers to entry and doesn't solve any gnarly problems. So many of these companies feel insubstantial and fluffy, because, out of necessity (the whole company is three kids and an iguana), they haven't solved anything difficult yet. Until they do, they won't be solving problems for people. People pay for solutions to their problems...

Actually, people often pay for dreams unrelated to their real problems, but that's another story. (Informed customers are a blessing, but in some domains they are rare.)

One day, the web services dream might work. In the meantime, my prior DSL service was unavailable at least once a week...

Thursday, December 06, 2007

CIA Torture tapes destroyed

The CIA videotaped their torture sessions, now they've destroyed the tapes.

Evidently they are unsure that the GOP will win in 2008.

There's nothing to say, but I think we need to mark these events.

Indentured servitude in the modern world -- the noncompete

My employer can fire me at any time.

That's fine, I can also leave at any time.

Except, I theoretically can't work after I leave, but my employer can stay in business. I knowingly signed a non-compete ...
Techdirt: Noncompete Agreements Are The DRM Of Human Capital

... Much of this discussion kicked off with AnnaLee Saxenian's 1994 book Regional Advantage that tries to understand why Silicon Valley developed into the high tech hub it is today, while Boston's Route 128 failed to follow the same path -- even though both were considered at about the same level in the 1970s. Saxenian finds that the single biggest difference in the two regions was the ability of employees to move from firm to firm in Silicon Valley. That factor, ahead of many others, caused Silicon Valley to take off, while the lack of mobility in Boston caused its tech companies to stagnate and make them unable to compete against more nimble Silicon Valley firms....

Ronald Gilson found this to be interesting, and followed it up with his own research suggesting that that it had much less to do with cultural reasons and much more to do with the legal differences between the two places, specifically: California does not enforce noncompetes, while Massachusetts does. Gilson looks at a few of the other possible explanations for the difference and shows how they're all lacking, leaving the difference in noncompetes as being the key difference between the two regions in terms of the flow of information and ideas leading to new innovations. He also explains the history of non-enforcement in California, showing that it was mostly an accident of history more than anything done on purpose...
I think that the single biggest thing Minnesota could do for its economy would be to limit non-compete agreements.

PS. In fact non-competes are rarely enforced, they're mostly about intimidation. The way to break them, I'm told, is to get a job in a state where they are not enforceable and to bring suit there.

The only kind of change management that works

At least outside of a tyranny:
Life as a Healthcare CIO: Leading Change

...My decade of experience executing change suggests that Kotter was right. Building a guiding coalition, broadly communicating the vision, and celebrating a series of short term successes really works. I've watched projects without vision, resources or communication cause pain and anxiety throughout the organization. The good news is that we now know how to execute change and it is the role of senior management to enforce Kotter's principles in every change project...
Excellent details in Halamka's full post.

I read this stuff and I think about how much it used to cost to get advice like this. There's a generation emerging that will be accustomed to finding and tracking freely available wisdom.

Freedom requires religion

So atheists can't be free, but Wiccans can?
Romney: President needs prayers of people of all faiths - CNN.com: "

... Romney said religion is essential to freedom, without pointing to any specific faith.

'Freedom requires religion, just as religion requires freedom. Freedom opens the windows of the soul so that man can discover his most profound beliefs and commune with God. Freedom and religion endure together, or perish alone,' the GOP contender said.
On another front Huckabee, who's even more explicit than Bush that Creationism should be taught in science class, is emerging as a GOP front runner.

Proclamations of the 'end of the religious right' appear to have been a bit premature.

Predictions of a rationalist victory, or at least a Democrat as president, are equally premature. The nation that reelected George W Bush has not changed radically in the past three years.

Tuesday, December 04, 2007

The thirty five year slowdown

In the past 35 years America has become vastly more wealthy.

Krugman, DeLong and Reich tell us that wealth has not gone to the middle class:
Robert Reich's Blog: It's the Economy, Stupid -- But Not Just the Slowdown

... middle-class families have exhausted the coping mechanisms they've used for over three decades to get by on median wages that are barely higher than they were in 1970, adjusted for inflation. Male wages today are actually lower than they were then; the income of a young man in his 30s is now 12 percent below that of a man his age three decades ago.

The first coping mechanism was moving more women into paid work. The percent of working mothers with school-age children has almost doubled since 1970 -- from 38 percent to about 70 percent. Some parents are now even doing 24-hour shifts, one on child duty while the other works...

When families couldn't paddle any harder, we started paddling longer. The typical American now works two weeks more each year than 30 years ago...

As the tide of economic necessity continued to rise, we turned to the third coping mechanism. We began taking equity out of our homes, big time....

...The fact is, most Americans are still not prospering in the high-tech, global economy that emerged three decades ago. Almost all the benefits of economic growth since then have gone to a relatively small number of people at the very top. The candidate who acknowledges this and comes up with ways to truly spread prosperity will have a good chance of winning over America's large and largely-anxious middle class.
The polls I know of don't show any sign that America's middle class recognizes their dilemma. Until I see that I can't share Reich's faith that there's a winning progressive political strategy in their discontent.

Software comments: quality and metaphor

My paternal grandfather was a railway man. In those days lots of people were. He must have had opinions about how to run a train, but he didn't have a blog.

Today software is the latest railway, but we have blogs. So people like Joel Spolsky, who has about a million or so readers, tell us some very interesting things:
Hitting the High Notes - Joel on Software

.... the conventional wisdom in the world of copycat business journalists and large companies who rely on overpaid management consultants to think for them, chew their food, etc., seems to be that the most important thing is reducing the cost of programmers.

In some other industries, cheap is more important than good. Wal*Mart grew to be the biggest corporation on Earth by selling cheap products, not good products. If Wal*Mart tried to sell high quality goods, their costs would go up and their whole cheap advantage would be lost. For example if they tried to sell a tube sock that can withstand the unusual rigors of, say, being washed in a washing machine, they'd have to use all kinds of expensive components, like, say, cotton, and the cost for every single sock would go up.

So, why isn't there room in the software industry for a low cost provider, someone who uses the cheapest programmers available? (Remind me to ask Quark how that whole fire-everybody-and-hire-low-cost-replacements plan is working.)

Here's why: duplication of software is free. That means that the cost of programmers is spread out over all the copies of the software you sell. With software, you can improve quality without adding to the incremental cost of each unit sold.

Essentially, design adds value faster than it adds cost...
I've read similar arguments in discussions about artists and entertainers -- such as professional baseball players). A hundred journeyman players can't deliver anywhere near the value of one superstar. The incremental cost of sending signal to a few more antennae is very, very small.

I hadn't, however, though about how well this applies to software as well. The incremental cost of creating another CD is very, very small.

In most industries quality doesn't scale all that well. In software, it can. It makes sense to pay enough to hire the very best designers and coders, and to give them working conditions that make them happy and productive. That's what Spolsky has done (See the "in house" software description.) I hope the meme is contagious.

So let's accept that producing software is still very hard and it takes really good and expensive people to create good software.

By why is it so hard to create good software, and why do so many products never fulfill their early promise?

I think I can add something from my own experience here.

I think we have trouble creating and nurturing great software because it's a very long process with a thousand different paths to an premature end. You can get a lot of things right, have a few good years of growth, then fumble a critical transition and see your work die a slow and ugly death.

We commonly use metaphors from architecture, literature, or music to describe the software creation process. I think they all add value, but I think they miss the organic aspect of how software grows and evolves. Maybe a better metaphor is building a company, creating a formal garden, or, perhaps, raising a particularly challenging child.

There's no perfect metaphor, but the common ones have a trap. They imply that there's a point that a product is "done" and the "A team" can move on. I'm sure that's sometimes true, but even then process may take 10 years. In many instances complex software remains a very demanding beast, requiring a lot of skill and ingenuity to keep it health and adaptive. Often that skill has moved on and the software can enter a spiral of every increasing entropy.

I think the long life cycle of software, and the easily underestimated costs of keeping a complex software beast "healthy", help explain why truly excellent software is unusual.

Google Street View in Saint Paul, Minnesota?

This is odd.

Google Street View (more here) is Google's amazing and controversial photographic reconstruction of street level details. It's enabled for San Francisco and a few select other cities.

And Saint Paul, Minnesota?!

My traffic map today has a 'street view' button. Clicking it merely toggles an icon of a standing biped, currently located in an obscure parking lot by an unremarkable intersection about one mile north of my home in Saint Paul.

The icon, which I recognize from other Street Views, is inactive, though s/he does have a context menu (center, zoom, etc).

So is it a glitch, or are we really going to see Street View in the twin cities? Who the heck picked that spot and why?

Update: Each time I access maps the little icon moves around the metro area. So I assume it's being placed randomly. I think Google is picking on me, but my new hat should protect me from Googlation ...

Pay phones join tape reels and broadcast TV

I'm surprised there are still a million pay phones around:
Pay phones? Yeah, I’ve seen them in old movies : Good Morning Silicon Valley:

...AT&T announced today that it will pull out of the pay-phone business by the end of next year, selling off its remaining 65,000 installations in a 13-state area. The company said it wanted to get out before the business became unprofitable, surprising many who figured that with everyone walking around with a phone in their pocket, the coin-op sector had been moribund for a while now. Indeed, it’s a lot tougher to find a public phone than it used to be. In 1998, there were 2.6 million of them scattered about; now it’s down to about a million....
The number of phones probably varies by state and climate. I bought my first cell phone at least 8 years ago because it was getting harder to find a pay phone in the Twin Cities metro area.

Another bit of culture our children will find odd when they see old movies.

By the way, dial phones and vinyl records, aren't yet one of those odd things. They still show up as toys or working devices -- at least in preschool. Carbon paper, rust, broadcast television, typewriters, telegrams, tape reels, punch cards, slide rules and family motels will probably be forgotten first.