Building a Fort: Lessons in Software Estimation - 10x Software Development
1. Numerous unplanned problems collectively added up...
2. Underestimation of unfamiliar tasks. My estimates weren't too far off for a lot of the work that I'd done before. But some things, like mapping out the site for the footing holes, I assumed would be 15-30 minute task ended up taking several hours.
3. Not decomposing big tasks into smaller subtasks. I'd planned out my project in whole days. At a birds eye view nothing seems obviously wrong with planning "frame the fort in one day." But when you break it down ... you start thinking, can I really do a whole wall in 2 hours? If the answer's even close to "no," then you start to realize that the whole estimate for that big task is probably wrong.
3. Using overly round time units. Using round units like "1 day" contributes to not thinking hard enough about decomposing large tasks into smaller tasks.
4. Substituting a target for an estimate. I had 7 days to do the project, and my estimate turned out to be 7 days. That's a little suspicious, and I should have known better than to make that particular mistake!
5. Sweeping numerous little tasks under the estimation rug....
6. Never creating a real estimate. The fact of the matter is that I carried around a rough plan in my head for weeks, but I never actually committed a schedule to paper...
7. All's Well That Ends Well. My kids love their fort, and I had a great time building it. "All's well that ends well" is one reason that companies don't improve their software practices more often than they do. If people like the software that the team produced, and the software is successful, then that reduces the incentive to try to do better next time.
Monday, September 24, 2007
Error types in software and fort construction
Broadband speed trickery: couldn't happen here
BBC NEWS | Technology | Broadband speeds under scrutinyScandalous. It would never happen here of course.
Broadband speeds in the UK are much slower than advertised by internet service providers, a study by Computeractive magazine has found. Some 3,000 readers took part in speed tests and 62% found they routinely got less than half of the top speed advertised by their provider. It is the latest in a series of questions over the way net firms advertise broadband services...
Seriously, the interesting bit here is that a trade magazine actually did something useful. There was never much life in the trade journals (except for BYTE) to begin with, and I'd thought the web had completely killed them.
The market answer to dementia: Soylent Green
The traditional approach to the care of the demented is very expensive. Americans don't want to pay for full-service nursing home care, but they refuse to consider the alternatives. That means market is going to invent an alternative, which it has.
The answer is - kill the demented elders faster, but setup ownership to avoid prosecution...
More Profit and Less Nursing at Many Homes - New York TimesIt's a "soylent green" class solution. Anyone could come up with the solution of "make them die sooner", but it took genius to figure out a way to do this and avoid prosecution.
Habana Health Care Center, a 150-bed nursing home in Tampa, Fla., was struggling when a group of large private investment firms purchased it and 48 other nursing homes in 2002.
The facility’s managers quickly cut costs. Within months, the number of clinical registered nurses at the home was half what it had been a year earlier, records collected by the Centers for Medicare and Medicaid Services indicate. Budgets for nursing supplies, resident activities and other services also fell, according to Florida’s Agency for Health Care Administration.
The investors and operators were soon earning millions of dollars a year from their 49 homes.
Residents fared less well. Over three years, 15 at Habana died from what their families contend was negligent care in lawsuits filed in state court. Regulators repeatedly warned the home that staff levels were below mandatory minimums. When regulators visited, they found malfunctioning fire doors, unhygienic kitchens and a resident using a leg brace that was broken.
“They’ve created a hellhole,” said Vivian Hewitt, who sued Habana in 2004 when her mother died after a large bedsore became infected by feces.
Habana is one of thousands of nursing homes across the nation that large Wall Street investment companies have bought or agreed to acquire in recent years.
Those investors include prominent private equity firms like Warburg Pincus and the Carlyle Group, better known for buying companies like Dunkin’ Donuts.
As such investors have acquired nursing homes, they have often reduced costs, increased profits and quickly resold facilities for significant gains.
But by many regulatory benchmarks, residents at those nursing homes are worse off, on average, than they were under previous owners, according to an analysis by The New York Times of data collected by government agencies from 2000 to 2006.
The Times analysis shows that, as at Habana, managers at many other nursing homes acquired by large private investors have cut expenses and staff, sometimes below minimum legal requirements...
Markets always answer "problem of the weak" questions this way. That's why we need government ...
Sunday, September 23, 2007
The human eye vs. a camera: how do they compare?
It's a great set of references from a photographer and professional astronomer*. I'm not sure how this translates into realtime perception however, and that's the bit that matters. I recall reading that the pathways beween the retina and the visual cortex have pretty limited bandwidth, and the visual connections to the prefrontal cortex are astoundingly weak. It's as though the world's best camera were connected to your computer by an RS-232 serial cable. There has to be an incredible amount of pre-processing and lossy compression to get any useful realtime work, and for us only realtime counts. On the other end of the circuit, the brain is doing a lot of informed guessing to create it's simulacra of "reality".
This is why a human studying a photograph will get much more from the image than they can ever perceive from a realtime glance. The eye is a marvelous camera, but evolution hasn't had harder time optimizing the neural interfaces.
By the way, how good might the eye/brain be at lossy compression and re-representation of image input? One clue is how successful living organisms are at storing their "construction specifications" and startup machinery in a single cell (egg, the sperm could be eliminated). That's a level of data compression/packing (relatively lossless) orders of magnitude greater than we can achieve with current technologies.
* I've noticed less repetition lately of the absurd "bloggers are ignorant fools" meme.
UPS delivery record fraud - how to respond
Harry Potter and the Phantom Delivery (kottke.org)Recently I wrote of UPS' package-crushing habits.
... At some point after 7pm, the UPS status page updated to say that a notice was left at 3:36 pm, implying that a delivery attempt was made and no one was home to receive it. (Amazon's tracking page says that UPS told them "Delivery attempted - recipient not home".) No such notice was left. My door buzzer did not ring at 3:36 pm (I was home all day on Saturday) and the doorman of the building next door who takes the deliveries for our building when people aren't home reported no notice or delivery attempt...
UPS is following the airlines down the tubes, perhaps for similar reasons. Today I'd recommend the USPS over UPS. If you run into UPS problems with an Amazon order, use the Amazon feedback option linked to your order to complain. Don't bother contacting UPS, they're too far gone. We need Amazon to shift them, or to find another solution.
That Jena business: it's time to stop watching television news
The story is thus mostly interesting as an example of how narratives are created in America's divided communities, and I suspect the real criminal here is American television news (CBC, NCB, ABC and Fox in particular*) and the people who persist in watching it.
Now, you might question how I can say this, since I told you I don't watch TV. Well, I do sometimes catch network TV news when walking through airports or sitting at restaurants. In the seconds before I can avert my gaze the shocking stupidity of it shines through. On the other hand, I read a lot of print media, and it's not so bad.
America, stop watching television news. It's a drowning beast that will grab onto anything above the water line. Just turn it off. Now.
* What about radio talk shows? Good question. I can't comment there, because it's been years since one of those accidentally crossed my radio. I mostly listen to podcasts these days ...
Today, would Gerald Ford be to the left of Hillary Clinton?
Justice John Paul Stevens - Supreme Court - Law - Washington - New York TimesI usually think that the GOP has moved to an extreme position, so much so that a Ford Republican is a liberal today. On the other hand, is it correct to say that Gerald Ford would be to the left of Hillary?
Stevens, however, is an improbable liberal icon. “I don’t think of myself as a liberal at all,” he told me during a recent interview in his chambers, laughing and shaking his head. “I think as part of my general politics, I’m pretty darn conservative.” Stevens said that his views haven’t changed since 1975, when as a moderate Republican he was appointed by President Gerald Ford to the Supreme Court. Stevens’s judicial hero is Potter Stewart, the Republican centrist, whom Stevens has said he admires more than all of the other justices with whom he has served. He considers himself a “judicial conservative,” he said, and only appears liberal today because he has been surrounded by increasingly conservative colleagues. “Including myself,” he said, “every judge who’s been appointed to the court since Lewis Powell” — nominated by Richard Nixon in 1971 — “has been more conservative than his or her predecessor. Except maybe Justice Ginsburg. That’s bound to have an effect on the court.”
It's a tricky question. These days even commies like me respect the power of markets, even as we fear the answers markets give the weak. Ford-era price controls aren't "liberal" today, they're dumb. On another paw, Ford @1970 would be far less tolerant of non-heterosexual gender relationships than most of today's GOP (ignoring their theater for a moment).
Bottom line, I don't think Gerald Ford @ 1970 would map onto any part of today's political spectrum. Probably not the Democrats, and certainly not today's GOP. Stevens and the few Republicans like him have been left adrift as the GOP has moved to some weird political dimension ...
Saturday, September 22, 2007
kottke.org - Gordon's Notes on steroids, more art, less physics
Except for one I came across today for the first time:
kottke.org :: home of fine hypertext products:This blog has tends of thousands of readers on bloglines alone and includes gems like this review of the NYT archives. Compared to me Jason Kottke is a much better writer, and is more interested in the arts, movie and culture than exotic physics. He's also bawdier than me and lives in Manhattan rather than Saint Paul*, so be careful when reading at work.
... kottke.org is a weblog about the liberal arts 2.0 edited by Jason Kottke since March 1998. You can read about me and kottke.org here. If you've got questions, concerns, or an interesting link for me, send them along. Follow kottke.org via RSS kottke.org RSS feed, see what I'm up to on Twitter, view my Flickr photostream, or check out some random entries from the archives. You may also be interested in my thoughts on books & movies or some photos I've taken. I also made a tiny bitmap font called Silkscreen several years ago...it's free and works on OS X, Windows, and Linux...
His growing tags collection is a good topics guide:
I recommend a trip to the archives, including the very earliest posts. I enjoyed the "about" page as well. Great fun!Some recommended tags
photography economics lists bestof infoviz food nyc firstworldproblems cities restaurants video timelapse interviews language maps fashion nsfw remixRecently popular tags (last 3 weeks)
indianajones multitouch harrisonford ratatouille movies firstworldproblems iphone facebook desktoptd aol jasonkottke nyc jenbekman mobiletelephones design pixar apple photography art mcsweeneys harrypotter geography books tv tennisAll-time popular tags
movies books photography nyc science food lists design business sports weblogs music art video bestof games tv funny apple language videogames google restaurants interviews mapsRandom tags
bengibbard ajax sony pizza arthurclarke mattwebb kenjennings lordoftherings d70 soda textmate vogue anildash lifeaquatic china starbucks anaisnin barnabyfurnas stevenspielberg upperdeck election2008 meteorology uptonsinclair legendofzelda foodnetwork
Update: *Kottke was born in the Twin Cities, where I now live. He left at an early age though.
Update 9/23/07: Browsing Kottke's archives, I see he was back in Minneapolis from 1996-2000. Ahh, that explains it. Nice post on the Mill City Museum too.
Do you know where your identities are?
Gordon's Tech: Online identities: management and multiplication:It's the gold rush of the 21st century, each identity a piece of reputation management. Which ring will bind them all?
... I currently have manged 'major' identities at Amazon, faughnan.com, faughnanlagace.com, Google Gmail/Blogger, LinkedIn, and, yes, even Facebook -- and those are only the ones I can remember right now. I debated including my Yahoo! identity in the mix, but unless Yahoo does something remarkable with Zimbra that's just a front for spammers. I do have a Microsoft Passport (or whatever they call that now) identity as well, but I try to forget that one. I used to have a .Mac identity, but Apple's .Mac hasn't delivered much value for money so that one is in abeyance. There are a myriad of 'unmanaged' lesser identities, and of course all my emails have some form of identity associated with them ...
If we survive, we will be Sweden
The blessed nations include Norway, Denmark, the Netherlands and, way out there at tip-top, Sweden. Japan and New Zealand approach from different directions, the US has a ways to move.
I'd love to see a dynamic model of this chart, showing the movement of nations over the past 30 years. Zimbabwe, by the way, now owns the bottom left.
Friday, September 21, 2007
Attitudes change: suicide bombing is unfashionable
No wonder Muslim support for suicide bombing is declining | FP PassportNext year it might be 20%. That's a change worth mentioning.
...The percentage of Muslims saying that suicide bombing is justified in the defense of Islam has declined dramatically over the past five years in five of eight countries where trends are available. In Lebanon, for example, just 34% of Muslims say suicide bombings in the defense of Islam are often or sometimes justified; in 2002, 74% expressed this view...
America's Billion Dollar Embassy - in Baghdad
Welcome to Baghdad, U.S.A. | FP PassportA billion dollars.
...Located in Baghdad’s 4-square-mile Green Zone, the embassy will occupy 104 acres. It will be six times larger than the U.N. complex in New York and more than 10 times the size of the new U.S. Embassy being built in Beijing.... The Baghdad compound will be entirely self-sufficient, with no need to rely on the Iraqis for services of any kind. The embassy has its own electricity plant, fresh water and sewage treatment facilities, storage warehouses, and maintenance shops. The embassy is composed of more than 20 buildings, including six apartment complexes with 619 one-bedroom units. Two office blocks will accommodate about 1,000 employees.... Once inside the compound, Americans will have almost no reason to leave. It will have a shopping market, food court, movie theater, beauty salon, gymnasium, swimming pool, tennis courts, a school, and an American Club for social gatherings...
The cure for the AMT: The Carbon Tax
America is hooked on the AMT (Alternative Minimum Tax). You can disregard all the Bush blather about cutting taxes, because he hasn't cut my taxes at all -- he's basically only cut the estate tax that affects very wealthy people. That's because I pay the AMT.
Inflation and economic growth will drive more and more Americans to pay the AMT. This is good in a way, because it's a built-in tax engine, though I think this has already been incorporated into social security and medicare projections. (Meaning if we actually did anything about the creeping tax aspect of the AMT our current huge deficits would see modest.) On the other hand, Republicans are allegedly supposed to hate taxes (true, that's not the way the Bush administration behaves, but it's the theory).
So here's the deal. Make the Carbon Tax "tax neutral". Use it to replace the AMT.
The roads will still need rebuilding, and medicare and social security will still be underfunded, but that's a political discussion. Providing a planet for our children is more important than getting our nation's finances in order.
So there you go Republicans -- embrace the Carbon Tax and axe the AMT. Let's see a candidate come out and say that ...
The dinosaur you ate yesterday
Velociraptor was just a scary turkey, say scientists | Science | The GuardianGeezers like me still tend to think the dinosaurs became extinct, but my son Ben's books talk only about the 'extinction of the non-avian dinosaurs'. The dinosaurs that attract our imagination were probably all avian dinosaurs, so, truly, they never did become extinct. Now that's a successful design ...
... Velociraptor, which was much smaller in real life than its screen version, was a one-metre tall, two-legged predator that lived more than 70m years ago. Equipped with large claws on each leg, it was a close relative to the earliest birds.
In a study of the fossilised forearms of velociraptors found in Mongolia in 1998, palaeontologist Mark Norell of the American Museum of Natural History found 'quill knobs' - bumps where the feathers used for flight in modern birds are anchored to the bone with ligaments. His results are published today in the journal Science.
'The more that we learn about these animals the more we find that there is basically no difference between birds and their closely related dinosaur ancestors like velociraptor,' said Professor Norell. 'Both have wishbones, brooded their nests, possess hollow bones, and were covered in feathers. If animals like velociraptor were alive today our first impression would be that they were just very unusual looking birds.'
Because of velociraptor's relatively short forelimbs, the feathers would not have helped it to fly. The researchers speculated that the feathers could have been passed down from smaller ancestors that did fly but would have served other functions such as display, shielding nests, temperature control or to help stability.
Distrusting climate models - it cuts both ways
Now that those battles are done, we have to justly fight the battles over the reliability of climate simulation. I'm not making bets on this one, I think the deniers may have a case. Simulation is hard, the models may not work.
Of course (insert evil laughter), this cuts both ways. The models may exaggerate climate change, or they may underestimate it. Observational data from the arctic shows that in that region the models have been consistently too conservative (emphases mine)...
The North Pole Is Melting: Scientific AmericanThe antarctic is mercifully protected, but as goes the Arctic, so goes Greenland. That may lead to faster sea level changes than the simulations predict, but I expect they will be in line with estimates of ancient climate impacts on Greenland.
... As a result of atmospheric patterns that both warmed the air and reduced cloud cover as well as increased residual heat in newly exposed ocean waters, such melting helped open the fabled Northwest Passage for the first time [see photo] this summer and presaged tough times for polar bears and other Arctic animals that rely on sea ice to survive, according to the U.S. Geological Survey. Such precipitous loss of ice cover far outpaces anything climate models or scientists have predicted.
This new record low continues the trend of steadily shrinking summer sea ice. "We're already set up for a big loss next year," Serreze notes. "We've got so much open water in the Arctic right now that has absorbed so much energy over the summer that the ocean has warmed. The ice that grows back this autumn will be thin."
In fact, a German expedition on the icebreaker Polarstern has revealed that existing Arctic sea ice in the center of the ice cap is only about three feet (one meter) thick, 50 percent thinner than it was just six years ago. As a result, more melt water is mixing with the salty seawater and pulses of warmer Atlantic seawater have intruded into the Arctic Ocean.
Whereas the South Pole remains protected by differing geographic, atmospheric and oceanic conditions, the North Pole is undergoing rapid change not seen in at least 6,000 years and perhaps as much as 125,000 years, and which may spread to lower latitudes. "It is reasonable to think that if you lose the sea ice cover that is going to have an impact elsewhere, in the midlatitudes," Serreze says. Some modeling studies of such effects have suggested drought in the western U.S. or changes in precipitation patterns across Europe.
Serreze expects the ice will bounce back somewhat next year, if only because he cannot imagine it shrinking any more so swiftly. But ice-free summers in the Arctic may become the norm in the near future. "At this point, I'd say the year 2030 is not unreasonable" for a summer without sea ice in the Arctic, Serreze says. "Within our lifetimes and certainly within our children's lifetimes."
When that occurs, the Arctic Ocean may become a spooky, foggy place, haunted by diminished populations of spectrally thin polar bears clinging to life in residual habitat. "It's going to be a different world," Serreze notes. "The observed rates of change have far outstripped what we projected."
Meanwhile, in Minnesota, we live the future. Our climate in the continental center is very affected by arctic conditions. The Feds have moved southern MN into a new climactic zone, outdoor ice skating is disappearing, Nordic (cross-country) skiing is finished in the metro area, snow sledding now requires artificial snow, the northern snowmobile industry has collapsed and we're building lots of indoor water parks to get the kids through increasingly dull winters.
Carbon tax, anybody?