Wednesday, December 14, 2005

Blind spots, tech commentary and complexity

"Digital music" (odd term, CDs are digital - really should be "lossy compressed music") is "big". So it wasn't surprising that NPR spent an hour or so this morning with a tech columnist talking mostly about "MP3" (meaning AAC, MP3, MP4, etc etc) players. What was a bit surpising, and annoying, was that the expert seemed to have never of heard of something called "iTunes". He compared Dell's MP3 player to the iPod as though the devices existed in isolation and felt they were of roughly equal value.

His advice was thus fairly worthless. An "MP3 player" today is only as good as the desktop software it works with; for the moment the billions of CDs in circulation keep iPods and their competitors bound to XP or OS X. (There are lots of ways this could change dramatically, but that's another story.) iTunes is a brilliant piece of software, and much of the success of the iPod is due to iTunes. He was comparing jet engines instead of jets.

I see this kind of glaring omission reasonably often. Is the complexity of our world ovewhelming the "experts", or is this simply an old story -- the popular 'expert' is selected more often for entertainment value than expertise ...


Samsung - hiring 5000 engineers for DRAM work?

This is astounding:
Among Makers of Memory Chips for Gadgets, Fierce Scrum Takes Shape - New York
Times:

...Samsung also said it would hire 5,000 more engineers to increase research and development of new chips...
Five thousand engineers? That's not a typo, though the hiring is over 7 years. Even so, if they mean real engineering school graduates that's a heck of a lot of brainpower. That's 50 years output from a typical engineering school. They'd have to pillage the engineering powerhouses of the world: India, China, Taiwan, South Korea ...

I can't see how they could effectively use that many engineers ...

Illogical design - the Narwhal's tusk

Only evolution could produce such as klduge, such a hack, as the Narwhal's tusk:
It's Sensitive. Really. - New York Times

The find came when the team turned an electron microscope on the tusk's material and found new subtleties of dental anatomy. The close-ups showed that 10 million nerve endings tunnel from the tusk's core toward its outer surface, communicating with the outside world. The scientists say the nerves can detect subtle changes of temperature, pressure, particle gradients and probably much else, giving the animal unique insights.
The tusk started out as a tooth; the research was led by an adventurous dentist. It makes a bizarre sort of sense; anyone with an exposed tooth root or broken tooth knows how sensitive teeth can be to temperature. Invert the tooth, put the soft tissue on the outside, and you have a weather sensor.

Evolution works with the tools at hand. The Narwhal is now Darwin's poster child.

Monday, December 12, 2005

A plausible summary of the state of Iraq

This feels plausible.
BBC NEWS | Middle East | Danger cannot dent Iraqi optimism

... So here, courtesy of the BBC poll, is a snapshot of Iraq today: a country whose people often seem close to civil war, yet feel overwhelmingly safe in their own neighbourhoods.

Iraqis are scathing about the performance of the American, British and other troops, yet believe it's too soon for them to leave.

People are so worried the country is falling apart that they want a strong government to take control, yet believe that in a few years' time things will be really good here.

These findings are only useful if you bear in mind how complex and varied Iraqi society is.

Often, when I write my online column about Iraq and try to explain about life in this country, someone will write in and say something like: 'My son is a soldier in Iraq and people there keep telling him what a wonderful job the US is doing', or alternatively: 'Iraqis just want to get rid of all foreign troops, period.'

Both things are true; it's just that different Iraqis are saying them. Unless you understand who they are - and why - it's impossible to make out what is happening in the country.

And in the meantime the one thing that everyone can agree with is that life is much more dangerous in Iraq than it was when our last opinion poll came out.

Sunday, December 11, 2005

Wozniak agrees: Apple's software quality is truly abysmal

It pains me to acknowledge that Microsoft's software quality in the past year has been substantially superior to Apple's. It's not just their relentlessly buggy software releases, it's the vast weight of half-implemented OS features. OS X services? AppleScript? Automator? Those absurd widgets that don't run on the desktop as they should? Quartz Extreme? No reliable and useable way to address a user session via AppleScript? Most of all, the churn in the OS that breaks applications with each update (that is supposed to improve post 10.4).

It turns out that someone with far more credibility than I feels the same way. Wozniak is an OS X user, but he's also a legendary engineer (emphases mine, broader implications below):
The Cardinal Inquirer - Talking with The Woz

Do you think that is at all similar to the computer industry, where engineers develop a product and someone else sets the price?

It's very much like that, but sometimes the engineers are - yeah, no, I think it's very similar, very similar. Sometimes the engineers are true artists and really care what they're doing, doing a really great job. Although, I don't know how much I can even say that because the big companies, Microsoft, Apple and AOL, they tend to turn out the crappiest products, you know, software-wise. The ones that have the most bugs, the most items that are supposedly in there but don't work. The most things that are left out because they aren't finished. The most things that are inconsistent with the way they did their last program. I get the worst, worst software almost always from Apple.

You think so?

Oh yeah. I get third-party stuff and it's almost always just better, cleaner and more understandable. It works better and does what you'd expect instead of, you know, buggy things or not what you expect.

Is OS X is problematic in that way?

I don't even call it a problem; it's just something you learn to work around. It's like, there was such a cleaner, good approach to it and they did this stupid thing. But remember, the people who wrote the OS X weren't the people who developed the Lisa and Macintosh. Those guys are gone.

Do you see this problem getting worse or better over time?

Worse. And part of it is because the software gets huge and complex and we're always moving to the new things rather than fix old things. I think a lot of it is because people just get complacent with what they have.
The Woz and I are about the same age (except he's a gazillionaire), maybe some of our reaction is generational. I think the young-uns have grown up in a world where things don't work reliably -- they're accustomed to routing around defects. Aged want things to work the first time and every time.

The one ray of hope is the small software companies. Maybe it's because there's often one person who's architect, analyst, engineer and QA. Maybe it's because these firms live or die by their reputations. I agree with Woz; it's the small shops that produce products that work.

Aside from the complacency of those who've grown up with unreliable and unstable systems, the complexity factor is hard to overstate. Despite enormous efforts, we don't have a handle on building reliable complex systems; the cost of reliability still seems to rise exponentially with complexity. An airplane is reliable, but the cost of that reliability is very high.

Beyond complexity, we have crummy software for the same reason we have a singularly crummy American government. In both cases, the aspects that sell aren't the things the customer really needs on an ongoing basis. We won't get better software until we get smarter consumers. I think that may eventually happen.

It's probably also true that we need to move from buying software to renting it, but that step requires very reliable data interchange. The combination of software rental and proprietary data formats is far worse than unreliable software.

Friday, December 09, 2005

More speculations on the evolutionary biology of acne

A comment on a blog posting
It's a humorous post, but the evolutionary biology of acne is, to me, quite fascinating.

The best theory I've heard of (or maybe I invented it, I'm not sure) is that the primary value is to render fertile young women less attractive, and to avoid male assault and early pregnancy. This theory would say acne is males is a side-effect of males and females sharing the same genes; it would have no adaptive advantage for males. We know from other gene studies that there are many genes that have such gender-specific value.

What is the relationship then with 'nerdiness' and pimples in males? I would wonder about a correlation between maternal androgen levels, maternal mate selection, and intrauterine androgen exposure affecting adolescent male aggressiveness. So the connection would be subtle, but both the 'nerdiness' (lack of aggression) and the acne would be indirectly a result of maternal adolescent acne."

Incompetent Design: a scientist points out the flaws in humanity

Seed: The Other I.D. points out that humans are very badly "designed".

Fun and interesting, no surprise to a physician of course. I enjoyed the comment on facial plumbing (aka sinuses). They are a disaster. I remember in medical school a lecturer earnestly explaining the role of the sinus as 'changing timbre of the voice' or 'warming inhaled air'. Bah!!

Now I'd like to see a physicist comment on the flaws in the universe. It seems far too hostile to life for my tastes (and yes, I do acutely follow discussions on finely balanced fundamental constants.)

Agnostics for Lewis - Narnia the movie

I do declare I am philosophically agnostic, and to the extent I have speculations about deities they are neither traditional nor comforting. I also declare that CS Lewis' theology has always struck me as primitive and inconsistent. I have, however, read and appreciated many of his books. Primitive yes, but also wise. Very wise.

So I was hoping the Narnia movie would be well done. I am pleased to read a review in the NYT which ends with a remarkably effective and encouraging paragraph:
The Chronicles of Narnia: The Lion, the Witch and the Wardrobe - Review - Movies - New York Times

... For me, the best moments in the film take place in the wardrobe itself, which serves as a portal between England and Narnia. When the children pass through it for the first time, I felt a welcome tremor of apprehension and anticipation as the wooden floor turned into snowy ground and fur coats gave way to fir trees. The next two hours might not have quite delivered on that initial promise of wonder - we grown-ups, being heavy, are not so easily swept away by visual tricks - except when I looked away from the screen at the faces of breathless and wide-eyed children, my own among them, for whom the whole experience was new, strange, disturbing and delightful.

Gmail is getting better: new features

I've been very impressed and pleased with Gmail -- despite the significant privacy issues. It's true that my maximum mailbox is no longer growing (it stopped growing at about 2.6GB, so now I've used 17% -- if it were to stay at 2.7GB I'd run out in a few years), but Google is adding a lot of interesting new features. The new RSS/mail integration model is very interesting, especially given Google's disappointing standalone RSS client. Here's the current list. Note the use of Google Tooblar to integrate the desktop with the Gmail application suite (edits, emphases, comments mine):
About Gmail
  • View your favorite RSS feeds right in Gmail as “Clips” along the top of your Gmail screen. Display clips from blogs, news sites and other online sources. Pick from the latest headlines, random popular feeds, or add any RSS/Atom feed you want. [Example, RSS feed that monitors email activity in a separate Yahoo "spam" account ....]
  • When you get Microsoft Office, OpenOffice or .pdf attachments, you can view them as a web page in HTML by clicking the "View as HTML" link right next to it.
  • Gmail automatically detects addresses and tracking numbers, and displays useful information for them alongside your messages.
  • Virus scanning... [of course I'd imagined they always did this. Shame on me.]
  • Export your Gmail Contacts and save them in a file for back-up or to use in another account or service ... [noble]
  • Saves to ‘Drafts’ as you’re composing. Never lose a half-written email again. (huge)
  • Google Toolbar ... Search your mail or instantly go to your Inbox from any web page with just one click.
  • Google Desktop lets you search your computer for files, music, photos, chats, web pages you've seen, and now, your Gmail messages too. Even if you’re offline. [jf: so read access to Gmail repository when offline -- that's big. Too bad Yahoo Desktop Search is so superior to GDS.]
  • Gmail contacts are pre-loaded in Google Talk.
  • Customize the address on your outgoing messages to display another one of your addresses instead.
  • Gmail Notifier for Mac OS X even supports plug-in development.
  • Gmail now gives you over 2.5 gigabytes of free space (and growing every day)! [but mine has stopped growing]
  • Rich text formatting
  • Send up to 10MB of photos, works with Picasa
  • Gmail now works with Picasa, Google's free
  • Basic HTML view lets you access your Gmail messages from almost any computer running almost any web browser. Learn more
  • Free POP access and automatic forwarding
  • Move all your contacts from Yahoo! Mail, Outlook, and others to Gmail in just a few clicks.

Cheating on Amazon: positive reviews are far more "helpful".

Amazon.com: John G Faughnan's Home

This doesn't quite rise to the Freakononomics level, but I've written enough Amazon reviews to see a clear trend. My positive reviews are rated as "useful' far more often than my critical reviews. This may represent human limitations, but it's trivially easy for persons associated with a vendor or retailer to downrate critical reviews and uprate positive reviews. I'd say this qualifies as cheating an a reasonably impressive scale.

Of course when I look at a product on Amazon, I always sort so the most negative reviews are the top. I find that the "useful" attribute is ... ummm ... useless.

PS. Amazon did not post my review of the Digital Rebel XT -- in which I mentioned the rebate directions were rather confused. I think Amazon is getting more selective about critical reviews of top selling items. That's another sort of cheating.

Monday, December 05, 2005

Intelligent Design - a simple voice of clear reason

Ahh. The sweet sound of Reason:
Intelligent Design Might Be Meeting Its Maker - New York Times

... Derek Davis, director of the J. M. Dawson Institute of Church-State Studies at Baylor, said: 'I teach at the largest Baptist university in the world. I'm a religious person. And my basic perspective is intelligent design doesn't belong in science class.'

Mr. Davis noted that the advocates of intelligent design claim they are not talking about God or religion. 'But they are, and everybody knows they are,' Mr. Davis said. 'I just think we ought to quit playing games. It's a religious worldview that's being advanced.'
The NYT claims that the Intelligent Design mask is being stripped away. We'll see. Perhaps I've underestimated the American public ...

Thursday, December 01, 2005

Philip K Dick - a primer

Metafilter has a nice intro to an extraordinary thinker: The Other SF Prophet Meat | MetaFilter

In the first essay Dick writes:
...The two basic topics which fascinate me are "What is reality?" and "What constitutes the authentic human being?"

Schizophrenia and the increased attractiveness of the non-conformist

Why is schizophrenia so common? It's a terrible disease, yet it's quite prevalent. Why hasn't evolution selected against it? How can schizophrenia have any adaptive advantages?

A single small and probably unreliable study claims a correlation between schizophrenic traits, being "non-conformist", (they say "creative", but they aren't talking about inventors and scientists) and have more sexual partners. The implication is that a mild dose of schizophrenia is good for one's mating opportunities, and that's enough of an advantage to keep the genes around in the population -- even when a full dose is horrible.
Science & Technology at Scientific American.com: Creativity Linked to Sexual Success and Schizophrenia

Psychologist Daniel Nettle of the University of Newcastle upon Tyne in England and his colleagues recruited 425 British men and women through advertisements in a small town newsletter and specialty lists for creative types. The researchers surveyed this group with questions designed to measure various schizophrenic behaviors, artistic output and sexual success, among other aspects of their personal history.

Results of that survey showed that people who displayed strong evidence of "unusual experiences" and "impulsive non-conformity"--two broad types of schizophrenic behavior--had more sexual partners than their peers did and were more likely to be involved in artistic pursuits, either professionally or as a hobby. Those who professionally pursued the arts had the highest average number of partners--5.5--compared to just over four for the less creative study participants.

... the finding, published yesterday in the Proceedings of the Royal Society (B), offers some insights into why schizophrenia, which seems to be passed from generation to generation and affects roughly 1 percent of people, does not disappear from the general population. In the study, even non-creative types who revealed an urge to resist conformity had more sexual success. In short, some of the traits associated with the debilitating mental illness can actually increase a person’s desirability...
There's something about this story that reminds me of how parasites spread themselves by altering their host's behavior. Could one think of a schizophrenia gene as a parasite that spread itself for altering host behaviors? Probably not, but it's a funny similarity.

The study is pretty slender stuff, but one can imagine several ways in which "non-conformity" might be adaptive -- even beyond more sex partners. It would be interesting if schizophrenia were the price we pay for keeping some non-conformists around...

When science is rejected: AIDS and the failure of South Africa

This is the saddest news I've read in some time.
BBC NEWS | Africa | Controversy clouds World Aids Day

... South African Health Minister Manto Tshabalala-Msimang, who has long been lukewarm over the usefulness of anti-retroviral drugs, refused to back their use.

In an interview, she said that anti-retrovirals offered no cure, and that she might use food supplements or traditional medicines if she became infected.
Logic, empiricism, and science are an integrated package. When Bush endorses teaching intelligent design in American schools he strengthens people like Tshabalala-Msimang. When republican senators exempt herbal remedies from FDA safety standards required for pharmaceuticals they strengthen people like Tshabalala-Msimang.

Whatever good Prime Minister Mbeki has acheived in his entire life, it will all be outweighed by the tragedy of his HIV policies. He will be remembered as a catastrophe for South Africa.

Global climate change, not global warming

Europe is unnaturally warm given its far northern latitude. Edmonton Alberta often hits 40 below, but Edinborough gets very little snow. The secret to Europe's wamth is a warm ocean current. That current may go away in the next few decades (extensive editing below, the article was badly written and/or edited):
BBC NEWS | Science/Nature | Ocean changes 'will cool Europe'

... Researchers from the UK's National Oceanography Centre say currents derived from the Gulf Stream are weakening, bringing less heat north.

Their conclusions, reported in the scientific journal Nature, are based on 50 years of Atlantic observations.

... The key is the Gulf Stream. After it emerges from the Caribbean, it splits in two, with one part heading north-east to Europe and the other circulating back through the tropical Atlantic.

As the north-eastern branch flows, it gives off heat to the atmosphere, which in turn warms European land.

"It's like a radiator giving its heat to the atmosphere," said Harry Bryden from the National Oceanography Centre (NOC) at Britain's Southampton University.

"The heat it gives off is roughly equivalent to the output of a million power stations," he told reporters.

... "We saw a 30% decline in the southwards flow of deep cold water," said Harry Bryden.

"And so the summary is that in 2004, we have a larger circulating current [in the tropical Atlantic] and less overturning."

... Computer models of climate have regularly predicted that the North Atlantic conveyor may well reduce in intensity or even turn off altogether ...

... if it turned off completely, Europe would cool by perhaps four to six degrees Celsius.

... The findings will have resonance beyond the shores of the UK and Europe, as extra heat left circulating around the tropical Atlantic could have major impacts on weather systems in Africa, the Caribbean and Central America.
On the other hand, warming trends might make the cooling much milder. This is why scientist don't write any more about 'global warming', they write about 'global climate change'. Even if the world on the whole gets warmer, some areas may get far colder (Europe) even as others warm up enormously (Alaska). In other areas violent weather may predominate (more warm water in the Caribbean means more hurricaines ...). We have to be ready for anything, and everything!