Google Groups: Crawling, indexing, and ranking
I still get emails of gratitude from visitors to my legacy personal web site, even for pages that haven't been updated in five or six years. Much of the material is of historic or special interest -- some of it goes back about 10 years -- but there's a place for such content.
Alas, it's noise for most searchers, especially since Google can't handle date constrained searches very well. Which leads to a plea for Google to support date range meta tags.
If Google supported a 'creation date', 'last revised date', and 'archival date' users could create searches that would either filter out, or focus on, old pages. Sure crooks and scammers would produce invalid dates, but the bias would probably be to create invalid new dates. The value of false archival dates would be much less, so Google's algorithms could make inferences about the utility of the date information and act on it. (Archival dates are more likely to be true, date information from unchanging pages more likely to be true, date information from higher ranked pages more likely to be true, etc, etc.)
Thus my plea.
Sunday, December 17, 2006
A plea for Google: meta tags for dates
Retail organs: not a slippery slope
Slippery implies some possibility of friction. Slope implies the possibility of balance. We need a better metaphor. How about 'obvious cliff'?
Alas, the trade continues to expand exponentially, despite my screed of last April. The Economist is the latest champion.
Gee, you'd think nobody reads this thing. The egg-donation and kidney transfer trade is big these days, much bigger than the involuntary donations of Chinese "criminals". It's a true 21st century growth industry. Niven, alas, was spot on thirty years ago. If we come up with really good anti-rejection treaments the exponential growth curve will go vertical. Eye transplants anyone? After all, one can live well with one eye.
Sigh.
There is a darkly millenial bright side. Sooner or later, maybe after the eye donations and the hemi-hepatectomies are booming, this trade will tip us into reexamining the duties of the strong to the weak, the rich to the poor, and the limited adaptability of the human to a logically utilitarian ethos.
I'm sure I'll have similar comments in another 6-12 months.
Saturday, December 16, 2006
Common Good Books: A place to visit in Saint Paul
Common Good Books. As best I can tell it doesn't have a web site or a marketing budget. It's downstairs from Nina's Coffee Shop, an upscale bohemian hangout in what was once a chancy neighborhood. Purely by coincidence, it's across from Representative Betty McCollum's office. (Keillor is a hard core democrat.)
Emily and I wandered in, and fell in love with both the bookstore and Nina's upstairs (there's a staircase from inside Nina's to the bookstore, Nina's has wifi). It's not a big place, but every book is remarkable. The reading nooks with the overhead skylight are irresistible. It reminds me of the much grander bookstores west of the University of Chicago, and of a much mourned East Lansing fixture that died after an ill-fated move. Odegard's of Saint Paul was like that, but perhaps a bit more commercial.
Keillor is wealthy enough to fund bookstore for decades -- if he wants to. There are worse ways to lose money. Oddly enough, the bookstore and the location are sufficiently appealing and unusual that, despite the negligible marketing budget, he might one day break even ...
Thursday, December 14, 2006
Anti-war demonstrations: why we don't have them
Why you're not demonstrating against the Iraq war. - By Jacob Weisberg - Slate Magazine:Weisberg points out that our mortality rates are much less than in Vietnam, and this reduces the emotional impact of the war (Iraqi casualties, alas, don't count. We are human that way.). I agree, but I wish Weisberg had pointed out that the public has been very uninterested in the number of veterans with traumatic head injuries who will suffer lifelong disabilities. That's a failing of both the media and the US public.
... Lastly, there is the matter of the Iraq war protests themselves, such as they are. Have you been to one? Demonstrating in the '60s, I gather, was a lot of fun. You went for the politics but stayed for the party—or was it the other way around? Forty years later, antiwar rallies are politically and socially disagreeable. The organizers are inevitably moth-eaten left-wing sectarians, some of whom actually do favor the Iraq insurgents. The sane or rational are quickly routed by the first LaRouchie, anti-Semite, or "Free Mumia" ranter to grab hold of the microphone. The latest in protest music has much the same effect.
Wednesday, December 13, 2006
Panoramio and Google Earth
The Google Earth integration is particularly impressive.
Once cameras all integrate geo-location, and even target geo-location (trickier), this will all get easier, but the results are impressive even now. Try flying Google Earth around San Franciso with the Panoramio layer enabled...
If you're a photo hobbyist who enjoys landscape and city scenes, you can build karma by using Panoramio to show Google Earth passengers the world ...
Why college tuition continues to increase: Mankiw
Greg Mankiw's Blog: On College TuitionThe implication of #1 is that smart buyers can get a bargain courtesy of those who are unable to judge quality. My own experience is dated, but I have never seen evidence of a correlation between quality and price in the many educational institutions I've attended and the two that I've taught at.
.... One reason college tuition has risen was explained by economist William Baumol. Consider an industry that uses only labor in production and experiences no technological progress, assumptions that arguably approximate colleges and string quartets. The price of its output will have to grow with the price of labor. The price of labor (the real wage) will, in turn, grow with economy-wide technological progress. Using the numbers in the above table from the Times, one finds that Harvard tuition has grown at 2.8 percent per year (note that this is adjusted for overall inflation). Real GDP per capita grows about 2 percent per year--a rough measure of economy-wide technological change. Thus, much of the increase in tuition, but probably not all, can be explain by the Baumol effect.
3. Over the past thirty years, the college premium has risen substantially. That is, workers with college degrees have enjoyed stronger wage gains than those without--a phenomenon often attributed to skill-biased technological progress. This rising college premium has had two effects on college tuition. First, colleges use a lot of educated labor in producing their output, so their costs have risen faster than they otherwise would. Second, the rising college premium has increased the demand for the services of colleges. Supply shifts left, demand shifts right, and the price unambiguously rises.
4. Colleges have gotten increasingly good at price discriminating. (Recall the discussion of price discrimination in chapter 15 of my favorite economics textbook.) The list price is set high, and then many customers are offered a discount called "financial aid" based on their ability to pay. Here's the secret plan: In the future, Harvard will cost $1 billion a year, and only Bill Gates's children will pay full price. When anyone else walks through the door, the message will be "Special price, just for you.
Tuesday, December 12, 2006
Apple's feet of clay: OS X Simple Finder
Yes, we all know that the Finder is flawed, that Apple broke their beautiful Classic OS file indirection system with OS X, that Apple's metadata management (file type, creator, etc) was screwed up in OS X compared to classic, and that OS X's smb network services are feeble -- but these are all minor flaws compared to Simple Finder. At first glance this looks like a great way to introduce a non-expert users to OS X, but the pretty face is deceiving. Simple Finder in Mac Classic (OS 8+) was a great piece of work, in OS X it's proof positive that Apple can be as incompetent as Microsoft.
Don't do what I did. Don't spend hours trying to make Simple Finder work as a user environment.
Yech.
iTunes sales and the status of DRMd music: next steps
If it is a some great awakening, if enough people have run into DRM problems that they're soured on the whole idea, then the entire digital music industry will need to reboot. It's not a biggie for Apple -- they make their money on iPod hardware sales, but it's huge for everyone else. Note Yahoo is now selling non-DRMd music ...
I posted a comment about the rant and some of the comments. Excerpts below:
- We also have 3 iPods in active use and may add a Shuffle. All from one music Library. Of course the interesting point here is that copyright holders HAVE NEVER APPROVED OF A FAMILY LIBRARY. So by sharing the music library with my spouse and children on separate iPods I'm probably 'stealing music' as far as the RIAA is concerned. They would say that each person should have their own library, irregardless of relationships.
- ... the beauty of the iPod was making our hundreds (thousand?) CDs new again. It takes a long time to explore that much music, so many consumers may have a very long latency period before they start buying new music again -- whether classic CD or DRMd.
- In terms of IP theft I wonder if the biggest methods now are merging iTunes Libraries (attach external drive, drag and drop, it's easy as pie) and ripping tracks from Library CDs and from purchased used CDs that are quickly resold to the dealer. I'm sure the RIAA knows that, but it's not something they talk about much. They prefer to think about file sharing.
- Controlling all those non-DRMd CDs in the world is a tough task. The way to do it, of course, is rather like gun control. Buy up all the CDs on the market and then destroy them. In time the price of used CDs will rise to the level of new DRMd CDs. In fact, smart people should start hoarding used CDs now in anticipation of when the the prices will rise. The next step is to make it impossible to play non-DRMd digital tracks or CDs/DVDs. It's a big project, but I'm sure the RIAA is working on it.
- Lastly, it's not really that hard to get real data on what's happening. Medical researchers study far more sensitive topics than this all the time. The issue is that only the vendors will pay for the research, and they won't share what we find. So we'll make do with rumor and anecdote.
Monday, December 11, 2006
Realm of wonders: Ocean census VI
Sunday, December 10, 2006
Minnesota: what the heck are these people doing here?
Neil Gaiman is a writer of witty fantasy novels, often set at least partly in London, and a hot Hollywood property besides. He lives on the nearby St Croix river. Backpackit, a hot web 2. company, is local. A number of OS X shops are local.
A number of the blogs I read turn out to be unexpectedly written by local folks. What are all these people doing here? For that matter, how the heck did I end up here anyway?
(The influx is likely to worsen. This weekend my son played baseball in shirt sleeves. Outdoors. In December. The ice rinks are all puddles. If word gets out that the Minnesota winter is gone, we'll go the way of Atlanta ...
Saturday, December 09, 2006
Thoughtcrime
Those who score too high will yearn for exile to old Australia.
Speeders will be strip searched ... reputation management II
Schneier on Security: American Authorities Secretly Give International Travellers Terrorist "Risk" ScoreHave you had more than one speeding ticket in the past five years? Did you order a vegetarian meal for your flight? You should wear clothing that's easy to shed ...
The scores are assigned to people entering and leaving the United States after computers assess their travel records, including where they are from, how they paid for tickets, their motor vehicle records, past one-way travel, seating preference and what kind of meal they ordered.
If people ever figure this out, they'll fight every traffic ticket in court tooth and nail ...
Hacking your reputation: the wars begin
Except, of course, the reputations can be hacked. And so the ancient battles restart on new terrain ...
American terrorism: Cuba and the Bush connection
Twilight of the AssassinsThe Bush family has not always been unequivocally opposed to terrorists, even terrorists who've bombed American targets. (I'd forgotten about the Miami bombings -- back when Miami was a small town. That was around the time the FLQ was bombing and kidnapping in my home province of Quebec.) I am sure a similar story could be told about many American political families and the IRA. The Bushies and the Kennedys seem to have more than a passing resemblance in several respects.
It was the first act of airline terrorism in the Americas: thirty years ago, seventy-three people died in the bombing of a Cuban passenger plane. Now, one alleged mastermind lives freely in Miami, while another awaits trial on other charges in Texas...
...why did the Reagan and Bush administrations hire Posada and grant Bosch U.S. residency, when the CIA believed they’d had a hand in blowing up the plane?...
...the attention Posada garnered from the Times series was more than he had bargained for. His boasts of masterminding the bombings compromised his supporters in South Florida and New Jersey, some of whom he named as providing him with money. If the attorney general decides to try Posada for acts of terrorism, Exhibit A will be Posada’s own admissions. Two grand juries, one in El Paso and another in Union City, New Jersey, empaneled intermittently to investigate Posada’s activities, have subpoenaed several exile militants and detained one who refused to testify. What’s clear from the meandering investigation, however, is that the Bush Justice Department has been reluctant so far to prosecute this case....
... George H. W. Bush became director of the CIA in January 1976 and served through January 1977. Bush succeeded William Colby... Colby had implemented major reforms, including a prohibition on political assassinations, and was the first director to give major public briefings to Congress on agency operations. These actions deeply alienated some of the CIA’s more committed Cold Warriors, many of whom backed the appointment of Bush.When Bush took up his post, he offered Ted Shackley, the former head of JMWave, the CIA’s third most powerful job: associate deputy director. Bush appears to have had contacts with Cuban exiles as far back as the 1960s, when, according to a declassified memo by J. Edgar Hoover, the FBI briefed him on their response to the assassination of John F. Kennedy...
Shackley was a divisive figure, and relations between Henry Kissinger’s State Department and George Bush’s CIA were painfully strained—so much so, according to William Rogers, the assistant secretary of state for Latin America, that the State Department rarely relied on CIA intelligence. “The agency was controlled by hard-liners,” he said. “They had an agenda, and the intelligence was lousy.” Shackley later played a role in the Iran-Contra affair.
Bush’s tenure at the CIA coincided with the worst spate of bombings and assassinations by Cuban exile militants in Latin America and in the United States. At that time, bombs went off regularly in Miami; sometimes there were several explosions in one day. In December 1975, thirteen bombs went off in forty-eight hours, striking at the very heart of the city: the airport, the police department, the state attorney’s office, the Social Security building, the post office, and the FBI’s main office...
...In 1989, securing Bosch’s release was one of the cornerstones of Ileana Ros-Lehtinen’s congressional campaign in Miami. She praised Bosch as a hero and a patriot on exile radio stations and raised $265,000 for his legal defense fund. Her campaign manager was a political neophyte, but one who had the ear of the White House. His name was Jeb Bush.
On August 17, 1989, Jeb Bush attended a meeting he had arranged for Ros-Lehtinen with his father to discuss the matter. The following July, President Bush rejected his own Justice Department’s recommendation and authorized Bosch’s release... ... Two years later, the Bush administration granted Bosch U.S. residency.
...In 2002, Governor Jeb Bush appointed Raoul Cantero, Orlando Bosch’s attorney, to the Florida Supreme Court...
The story adds another gloss to George W's Oedipal complex, and to the passionate hatred of "terrorism" that became his watchword. As has been pointed out many times, "terrorist" is a relatively meaningless term. It also suggests reasons why Jeb could never have run for the presidency -- even before 9/11.
Lastly, politically controlled and worse-than-worthless intelligence was not an invention of George Jr and Dick in Iraq. George Sr pioneered it when he ran the CIA ...