My brutal Palm to iPhone migration - lessons from refactoring a geek workflow

Sometimes it's tough being a geek.

I'm a "market of one" -- when I adopt a technology I push it to the limits -- and beyond. When it dies, I have a heck of a transition to make.

My Palm to iPhone/cloud migration has been particularly tough.

Gordon's Tech: My Palm to iPhone migration challenge -- summarized

Google Docs - Palm migration is a spreadsheet that captures in a glance how very hard the Palm to iPhone migration is. There's a feed for change notification...

... Of the 10 core functions I have identified migration strategies for exactly 3 of them.

Suggestions are most welcome, but I need suggestions that allow me to migrate my
data as needed. Data lock is not acceptable for this material.

Ok, not "brutal" as in the things life routinely does to us, but tough in terms of lack of sleep and exercise. So far I've more or less migrated my personal calendar - by starting over.

Consider the tasks problem. Of the many, many solutions I've looked at, only ToodleDo (bad name) and ToDo.app come close, but ToodleDo allows operations on only one task at a time (web 1.0). That's a long, long, way from what I've grown accustomed to.

So I have to backtrack. I feel like I've moved into an alternate reality, a "past earth" where the printing press has yet to be invented but millions live on Mars. I can't migrate on a functional basis, I have to refactor what I do into different solutions.

So the combination of Palm and Outlook let me keep a large catalog of ideas and potential actions as tasks, but that workflow won't fit into my iPhone world. All the iPhone can handle as tasks are things I might actually do in the next few weeks. So I'll have to split my data stream, moving 15% forward as tasks and finding new homes for the rest (Evernote, would you please show me you don't want to lock my data?)

There are interesting lessons here that relate to my real-world job. I develop what we like to think of as "advanced" healthcare IT knowledge rich solutions. They all change what people do. Those changes have costs, costs like my Palm to iPhone transition. Even if it's for the better, the near term pain is pretty extreme.

It's good to get a reminder of what that feels like.

Splog war friendly fire - Google whacks me for the sins of others

I think I now see why the indexing speeds of my kateva.org pages wax and wane...

Gordon's Tech: The hidden curse of spam blogs - collateral damage

I've noticed an unhappy correlation.

Periodically spam blogs (splogs) will start harvesting my posts.

When they do that, email from kateva.org begins to be filtered into Gmail's spam folders, my Google PageRank falls, and the site is indexed less often.

When the splogs move on to another victim, things reverse.

I'm just collateral damage.

Ouch.

What hurts the most, really, is the decreased indexing. I like being able to search my memory collection.

Splogs fraudulently assume a part of my "data signature", so Google assigns a part of their reputation to me. Google knows "me", after all, only by my data.

It's a new form of identity theft, one that biologists would readily understand.

In the end I'm collateral damage; splog wars between Google's and the parasites are damaging my reputation -- and my memory.

Cyberwar is heck.

So, what do I do about it?

Update 8/18/08: Here's one view of the splog effect -- it's a list of splog posts generated in the past few hours from recent Gordon's Tech articles




Google is not yet omniscient. All it knows is that these posts are found here -- and in some very bad neighborhoods. We are the reputation of our data.

David Brooks - caught again

Incredibly, David Brooks is paid to write nonsense. I do it for free

Happily I can read James Fallows, who is a superb journalist. He points us to the Language Log's annihilation of Brooks. 

In addition to the obvious blunders, pay attention to the basic structure of the experiment. It's insane that people are able to publish this junk, and hilarious that Brooks transcends the junk ...

Language Log David Brooks, Social Psychologist

Those who've followed our previous discussions of David Brooks' forays into the human sciences ("David Brooks, Cognitive Neuroscientist", 6/12/2006; "David Brooks, Neuroendocrinologist", 9/17/2006) will be able to guess what's coming.

In this case, Mr. Brooks has taken his science from the work of Richard E. Nisbett, as described in his 2003 book The Geography of Thought: How Asians and Westerners Think Differently and Why, and in many papers, some of which are cited below. I was familiar with some of this work, which has linguistic aspects, and so I traced Brooks' assertions to their sources. And even I, a hardened Brooks-checker, was surprised to find how careless his account of the research is. ...

... Is it correct that if you show an American an image of a fish tank, the American will usually describe the biggest fish in the tank and what it is doing, while if you ask a Chinese person to describe a fish tank, the Chinese will usually describe the context in which the fish swim?

Answer: In principle, yes. But first of all, it wasn't a representative sample of Americans, it was undergraduates in a psychology course at the University of Michigan; and second, it wasn't Chinese, it was undergraduates in a psychology course at Kyoto University in Japan; and third, it wasn't a fish tank, it was 10 20-second animated vignettes of underwater scenes; and fourth, the Americans didn't mention the "focal fish" more often than the Japanese, they mentioned them less often.

The research in question was reported in T. Masuda and R.E. Nisbett, "Attending holistically vs. analytically: Comparing the context sensitivity of Japanese and Americans", J. Pers. Soc. Psychol. 81:922–934, 2001.

The subjects were 36 Americans at the University of Michigan and 41 Japanese at Kyoto University, who "participated in the experiments as a course requirement"...

Who's more absurd - Maureen Down or David Brooks? It's a tough contest.

What does it say about America that both are very influential and widely read?

Ouch.

Spooky action 10,000 times FTL. Yawn.

On the one hand, completely boring. Another test of QM is in complete agreement with theory.

On the other hand, this is almost as creepy now as it was when a 2007 Wired magazine article on a 1999 entanglement experiment casually noted that observer-independent reality was up against the possibility of free will. That set me off on my extended review of quantum mechanics; along the way free will seems to have come out ahead of reality.

Not quite as creepy though, because I'm getting used to living in a universe that's infinitely weirder than it seems. Here's the latest edition ...

Quantum weirdness wins again: Entanglement clocks in at 10,000 times faster than light: Scientific American Blog

No matter how many times researchers try, there's just no getting around the weirdness of quantum mechanics.

In the latest attempt, researchers at the University of Geneva in Switzerland tried to determine whether entanglement—the fact that measuring a property of one particle instantly determines the property of another—is actually transmitted by some wave-like signal that's fast but not infinitely fast.

Their test involved a series of measurements on pairs of entangled photons (particles of light) that were generated in Geneva (aerial view at left) and then split apart by optical fiber to two villages 18 kilometers (11 miles) apart where the team had set up photon detectors. (In 2007, researchers transmitted entangled light 144 kilometers between two of the Canary Islands.)

The idea in the new experiment is that the photons in each pair of entangled pair are hitting the distant detectors simultaneously, so there's no time for them to exchange a signal. By comparing results from the two detectors, the researchers determined whether the photons were entangled or not, using a test known as Bell's inequalities.

The photons were indeed entangled, the group reports in Nature. But in reality, no experiment is perfect, so what they end up with is a lower limit on how fast the entanglement could be traveling: 10,000 times the speed of light....

.. It's always conceivable that quantum mechanics might break down (read: show some signs of everyday normalcy) if experimenters could test it the right way. In a 2007 study, researchers in Vienna tested the idea that maybe the instantaneous-ness of entanglement (called nonlocality) was consistent with hidden "variables" that can explain the randomness of quantum measurements. But no dice for that idea...

... Rudolph says we're probably stuck with instantaneous entanglement, which seems impossible to us because we're stuck in everyday space and time. "We need to understand how quantum mechanics sees space and time," he says. "I think there's probably much deeper issues.

Yep, we're stuck.

I recommend Gribbin for a layperson explanation of how bad things are, though his preferred model for understanding entanglement is currently out of fashion (and incompatible with free will).

Slate reviews swim goggles

This is a surprisingly useful review. I'm tempted by fixed optical correction goggles, but otherwise ...

The best swim goggles. - By Juliet Lapidos - Slate Magazine

Speedo Speed Socket, $24.99

This pair is roughly like the Swedish goggles in that the eyecups are exceptionally well-designed to match the bone structure of the socket and it's possible to custom-fit the nosepiece. But they're better for nonprofessional swimmers, because the soft eyepieces rest more comfortably against the skin than the hard-plastic Swedes, and because they're much easier to customize. Speedo sends along three ready-made nosepieces, each slightly different in size, and it couldn't be easier to clip them on and off.

My friends and I agreed that the Speed Sockets look sleek and professional. And for just $5 more you can get a pair with mirrored lenses, which keep out sunlight and give your face a certain T-1000, liquid metal je ne sais quoi. Because the suction isn't too aggressive, I didn't experience any pain, and the raccoon effect was minimal. These goggles deserve high marks in every category...

Ease of Use: 5
Comfort: 9
Visibility: 10
Aesthetics: 5
Value: 5
Total: 34

Obama as the Antichrist - now from McCain

We weren't suprised by the Obama is the Antichrist meme. Heck, Clinton was accused of the same role.

Now we aren't suprised that the GOP is embracing Obama as Antichrist:

An Antichrist Obama in McCain Ad? - TIME

... includes images of Charlton Heston as Moses and culled clips that make Obama sound truly egomaniacal — taps into a conversation that has been gaining urgency on Christian radio and political...

McCain/Rove and the GOP will make this the ugliest campaign in modern history. They will do anything and say anything. They'll incite paranoid schizophrenics to violent action -- whatever it takes to win.

Don't assume it won't work. America is perfectly capable of falling for this.

Need some reading? Hugo nominees online

2008 Hugo Nomination List includes links to novellas and shorter works that are now available online.

I think that's really neat.

My Peak Oil Call

On 3/10/08 I wrote:

Gordon's Notes: Oil price speculation: is it rational investment or a bubble?

...So here's my proposal for deciding if Peak Oil is on the way.

If the price of oil craters ($65) in the next 6 months then we're living in an energy bubble today and Peak Oil is more than 10-15 years away.

If the price of oil is above $105 a barrel in August of 2008 then Peak Oil is on the sooner rather than later, and the world I grew up in is shuffling away -- sooner than I'd expected....

Today a barrel of oil costs $115 or so.

I believe that's above $105/bbl. True, the price is falling, but that doesn't matter. I'll stick to my criteria.

I say Peak oil is here.

I say that despite, in my 1979 chemical engineering class, being told that peak oil was coming in the late 1980s (I think we reviewed the 1957 Rickover speech back then). I say this despite remembering Jimmy Carter's peak oil prediction in the 1970s.

Of course I'm really talking about Peak sweet light oil, and I don't mean "Peak" in absolute, or even demand > supply, I mean Peak in terms of rational market expectation of a > 70% probability that demand > supply within 5-8 years.

Basically I'm claiming that the price increases of this past year were due to praiseworthy speculation on the fundamentals rather than salacious speculation on psychology.

This means I'm expecting oil to go to Dyer's $200/bbl limit at least once in the next five years, though may transiently fall back to $80 along the way. After 5-8 years it will be very apparent that oil will be a shrinking percentage of our energy supply, and that in the absence of a severe carbon tax (or the equivalent) we'll be baking the plane with burning coal and burning tar sands.

It also means that it's now rational to invest in conservation, and to expect real estate prices to reflect increased commuting costs.

More on Peak Oil later, but I was overdue to make my promised call. (It's been a busy month!)

People didn't used to laugh when we said these things

This would be funnier if Russia weren't invading Georgia:

BBC NEWS | Europe | South Ossetia clashes intensify

...US Secretary of State Condoleezza Rice called on Russia to pull its troops out of Georgia and respect its territorial integrity...

She probably says it without irony.

The value of GrandCentral

GrandCentral is a VOIP service that gives users a phone routing service. Google bought 'em, and I signed up.

Problem is, I couldn't figure out what they were good for. Until today ...

Gordon's Tech: GrandDialer: will this help my phone bill?

But what if I could use my GrandCentral account to call Canada, then GrandCentral connects me in?

GrandDialer would make that easier:

GrandDialer, an iPhone app for GrandCentral - The Unofficial Apple Weblog (TUAW)

...GrandDialer (iTunes link) allows you to use your iPhone to call people using your GrandCentral telephone number....

This is using the GrandCentral "Click2Call" feature.

Briefly, it works. For most people this is a curiosity, but free AT&T cell calls to Montreal will pay for my iPhone.

Which explains this mysterious meeting transcript I found in my junk mail today:

... AT&T guy: "Thanks for joining us today. We really admire the work you've done at Google. We know you appreciate the fiber services we provide, and you understand why it's only fair that Google pay a bit more for the quality of service only we can provide."

Google guy's phone starts playing The Rolling Stone's "Under my Thumb".

Google guy: "Sorry about that. It's the ring tone I use for my GrandCentral calls. You understand ..."

AT&T guy: Would a 5% volume discount be ok?

AT&T is living off the big bucks they charge me for long distance calls. If they lost their long distance service they'd fall over dead.

GrandCentral could take a lot of that away -- if Google ever opened it up and created a GrandCentral widget like GrandDialer for every cell phone on the market.

In the meantime, GrandCentral is paying its way without earning a penny. They can afford to pay for my calls to Canada ...

Net security, the end of the password, and human evolution

The signs of the end are at hand.

First, this completely asinine alleged (a misquote I hope) comment from someone who must, really, know better:

BBC NEWS | Technology | Net address bug worse than feared

... Mr Silva at VeriSign said even though patches have been put in place, this doesn't mean users can sit back and relax.

'The biggest gap in security rests between the keyboard and the back of the chair,' he said.

'The look and feel of a website is not what a consumer should trust. They should trust the security behind that website and do simple things like use more secure passwords and change their password regularly...

Of course they should. They should also lose 50 lbs, run ten miles a morning, study a new language every month, and master levitation.

I really hope that was a misquote.

Next, I lose my last remaining gasket when the complexity of modern life leads to a security breach, and the need to change my 2 year old high quality primary Google account password:

Gordon's Tech: How to steal my Google account

... Yes, to steal my Google account, my primary digital identity, all you need to know is my first phone number...

1. Passwords are a complete fail. Schneier has been saying this for years. We are now into the realm of madness. We need multi-factor authentication devices that handle our secondary authentication for us. Yeah, it's not perfect, but, really, this is s#$!@# insane.
   
   
2. We live in the age of the tyranny of the mean. Even the vast majority of geeks aren't going to figure out how to sync 1Password with an iPhone. Regular folks are going to use one password everywhere and then forget it. Google, like everyone else with these asinine security question is bowing to the reality that humans didn't evolve to live in a digital world. We're maxing out right now.

This madness has to stop. The stupidity is hurting my brain.

Really, none of us evolved for this. We either need to reengineer the human mind or we need to implement better security measures.

This is going to need real help from an Obama administration, we've seen decades of banks failing to deal basic with security issues. This won't get fixed by libertarian emergence; the current system is simply providing endless prey for hungry predators.

Oh, and remember, sooner or later, we're all prey.

An unusual view into Apple, and why MobileMe may be fixed before January

Chuqui has almost as many typos as me, and that’s saying something. Read around ‘em though, because he’s written a very unusual post about how Apple does business. Shockingly, Apple is not Steve Jobs, though he is an amazingly hands-on CEO.

For the first time I’m actually thinking MobileMe might be get fixed before January 2009. That would be very good – especially Apple is also able to add calendar publish and subscribe features. I especially would like to see CalDAV sync with gCal (not entirely far fetched since CalDAV is built into OS X iCal).

Software reviews and the App Store: We do have a problem

It's well known in geek circles that the iPhone App Store doesn't allow "try before you buy" distribution. It's less well known that app sales have been less than some had hoped.

I think slow sales and the lack of demo versions are connected.

I "terminate with cause" at least 75% of the desktop software I try -- and I only try products that I want to buy. In most cases the software is either seriously buggy, or it fails a critical test (such as the ability to export and import data).

Reviews should help with this, but they don't. It's not just that reviewers need to be kind to keep getting software, it's also that readers don't like negative reviews. Illogical, sure, but this is humanity we're talking about. We're hard wired to mix the state of the product with the state of the reviewer.

I'm not just making this up! I've been writing Amazon reviews for many years. My positive reviews are always more highly rated. Sure, it could be a retailer rating effect, but my recollection is this effect has been seen in cognitive psychology studies as well.

This human glitch means that a rigorous software reviewer would soon lack for readers. Even amateur reviewers generally like to have an audience, so those that survive learn to be gentle.

The inevitably weak state of the product review marketplace, and, yes Andrew, the fact that I push the limits of software, means I have to test personally. The App Store doesn't allow this. So geeks like me are slow to buy, and that means we're slow to talk about the software. Even if we're few in number, lack of geek chatter impacts sales.

There's an obvious solution.

The App Store should show two buttons for every item. One is "demo", it downloads the demo version. The other is "buy". The demo version would follow the usual practices of desktop demo software: limited lifespan, some carefully chosen feature limitations, use of watermarks etc.

I expect Apple will do something like this soon (it is kind of obvious, after all). Then App Store sales will improve -- at least for quality products.

Interesting lesson about the limited utility of product reviews however ...

Progress is non-linear: Palm vs. iPhone Address Book

My iPhone Address book, with about 400 entries, is pretty darned slow ...

Gordon's Tech: iPhone notes you won't read elsewhere

... The Address Book is very slow to launch (4 secs on my phone), but Google Mobile search also searches the Address Book -- and it's fast...

My Palm address book, with about 600 entries, launches instantly. There's no perceptible delay.

Time to select an address on the Palm? Maybe 1-2 sec. On the iPhone? Maybe 6-7 seconds. (Faster if you use Google Mobile.)

The iPhone has, of course, at least fifty times the processor speed and more than 1,600 times the memory capacity of the original Palm.

The Palm had essentially instantaneous responsiveness from day one. It was one of the design goals of the original team. The Palm was to have instant on, no user waiting for a system response, and no crashes. Incredibly, the original Palm team met those goals. Later ... well, that's a sadder story.

Apple will one day fix the iPhone Address Book problems. Heck, Google Mobile already has. It is a good example, however, of the random walk aspect of progress.

The iPhone does a lot that the Palm never could, but the original Palm did a lot of things well that the modern iPhone does poorly or not at all. Technological progress is squirrelly.

The Domain Registry Support fax scan is still in business

I received a cell phone call from a blocked caller ID today. The caller, a woman with a youngish Indian accent, said she was with "Domain Registry Support" and needed to send me a fax number regarding "changes in the Internet" that would affect one of my domain names.

I asked for their phone number so I could google it. The funny thing is that they've used 800-591-7398 in their scam since at least 2006. It's some kind of domain name transfer fraud. I assume they then resell the domain to someone else, or hold it for ransom, or use the personal information for an identity theft project.

I didn't have time to follow it up of course. I get at least 3 non-trivial phishing attacks every week, if I followed up on every fraud attack I'd have no sleeping time. Still, this is the first phone call attack in a while.

It's hard to remember when fraud wasn't a part of everyday life. It all feels like something out of a Charles Stross novel.