Freedom
By Cicero | Related entries in Bad Decisions, Technology
Ray Kurzweil and Bill Joy have co-written an op-ed in today’s New York Times. They say that publishing the genome of the 1918 influenza virus is as irresponsible as publishing atomic bomb specifications. Because it is important, I will publish their full warning here: Recipe for Destruction:
After a decade of painstaking research, federal and university scientists have reconstructed the 1918 influenza virus that killed 50 million people worldwide. Like the flu viruses now raising alarm bells in Asia, the 1918 virus was a bird flu that jumped directly to humans, the scientists reported. To shed light on how the virus evolved, the United States Department of Health and Human Services published the full genome of the 1918 influenza virus on the Internet in the GenBank database.
This is extremely foolish. The genome is essentially the design of a weapon of mass destruction. No responsible scientist would advocate publishing precise designs for an atomic bomb, and in two ways revealing the sequence for the flu virus is even more dangerous.First, it would be easier to create and release this highly destructive virus from the genetic data than it would be to build and detonate an atomic bomb given only its design, as you don’t need rare raw materials like plutonium or enriched uranium. Synthesizing the virus from scratch would be difficult, but far from impossible. An easier approach would be to modify a conventional flu virus with the eight unique and now published genes of the 1918 killer virus.
Second, release of the virus would be far worse than an atomic bomb. Analyses have shown that the detonation of an atomic bomb in an American city could kill as many as one million people. Release of a highly communicable and deadly biological virus could kill tens of millions, with some estimates in the hundreds of millions.
A Science staff writer, Jocelyn Kaiser, said, “Both the authors and Science’s editors acknowledge concerns that terrorists could, in theory, use the information to reconstruct the 1918 flu virus.” And yet the journal required that the full genome sequence be made available on the GenBank database as a condition for publishing the paper.
Proponents of publishing this data point out that valuable insights have been gained from the virus’s recreation. These insights could help scientists across the world detect and defend against future pandemics, including avian flu.
There are other approaches, however, to sharing the scientifically useful information. Specific insights - for example, that a key mutation noted in one gene may in part explain the virus’s unusual virulence - could be published without disclosing the complete genetic recipe. The precise genome could potentially be shared with scientists with suitable security assurances.
We urgently need international agreements by scientific organizations to limit such publications and an international dialogue on the best approach to preventing recipes for weapons of mass destruction from falling into the wrong hands. Part of that discussion should concern the appropriate role of governments, scientists and their scientific societies, and industry.
We also need a new Manhattan Project to develop specific defenses against new biological viral threats, natural or human made. There are promising new technologies, like RNA interference, that could be harnessed. We need to put more stones on the defensive side of the scale.
We realize that calling for this genome to be “un-published” is a bit like trying to gather the horses back into the barn. Perhaps we will be lucky this time, and we will indeed succeed in developing defenses for these killer flu viruses before they are needed. We should, however, treat the genetic sequences of pathological biological viruses with no less care than designs for nuclear weapons.
I find their argument compelling. It was foolish to publish the entirety of the 1918 genome and hope for the best. Now we have yet another chunk of public data in our world that will always be hanging over us. We live in an era where the President obsesses over the proliferation of weapons of mass destruction, leading to fundamental changes in foreign policy. The threat is real, and growing. I wonder: did the decision of whether or not to publish the 1918 influenza genome ever cross the President’s desk? I would bet not. Why?
The Times essay being co-written by Joy and Kurzweil is interesting in and of itself, since these two futurist-scientists have often been at odds with how to manage dangerous knowledge that the modern age continually unveils. Mr. Joy’s legendary warning Why The Future Doesn’t Need Us and Kurzweil’s tireless advocacy of the Singularity as desirable has made for an interesting public debate between these two scientists. It seems to me that the New York Times op-ed favors Mr. Joy’s established cautious positions, with Mr. Kurzweil giving ground; ceaseless, unabated and exponential innovation is not always best, though it may not be easy to reign-in.
The Open Source community often champions the axiom, Information wants to be free. Indeed, open communities, open tools and open information is leading the current innovation revolution, this blog being a part of it. But information ‘wanting to be free’ might be a truism or merely an altruistic mantra. Clearly, this is the debate of our time — one that has lethal consequences. The degree to which we allow information’s freedom will be based on the unofficial constitution that is being written, or should be. As we reconfigure society and innovation around new paradigms, a new social writ is par for the course — one that idealizes the human spirit, and takes it to a higher level. We should be clear that ‘information wants to be free’ should not devolve into the hideous, debased meaning of ‘Arbeit macht frei,’ where so far, mankind has dug its deepest grave.
This entry was posted on Monday, October 17th, 2005 and is filed under Bad Decisions, Technology. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.










October 17th, 2005 at 2:13 pm
But information ‘wanting to be free’ might be a truism or merely an altruistic mantra.
I lean more toward the former, but more in the sense of a more famous statement of reality: “Nature abhors a vacuum.” Someone’s going to figure it out someday — the cat’s practically half out of the bag. Secrets are fragile things, especially as time passes.
Look, for example, at Joy and Kurzweil’s nuclear weapons analogy — it should be clear to anyone that what’s frustrating most groups’ nuclear ambitions is not the lack of a workable design, but the lack of fissionable materials. Just making a big boom is relatively easy, if you have about twenty pounds of uranium. Heck, remember the Progressive case?
Likewise, not publishing the genome saves us nothing, really. Right now, it’s difficult enough to synthesize a virus that anyone stupid enough to think that the flu makes a good bioweapon is probably going to get a sample of avian flu from Asia and see what effects they can get with some clever distribution. (To any terrorists who might stumble across this, I urge you to think this through thoroughly, because it’s a really stupid idea.)
Meanwhile, having the genome available might stimulate researchers to come up with more effective defenses against not only engineered viruses, but natural ones as well.
October 17th, 2005 at 2:27 pm
A small note. I read a reasonably complete atomic bomb plan published in Analog Science fiction when I was a high school kid in the mid-1980s. It was a “poor man’s bomb” set up specifically for terrorist use. Any reasonably well educated physics undergraduate could have double checked those plans.
October 17th, 2005 at 2:52 pm
You know, I may be confusing the Analog plan with the Progressive one, as I remember that this was when I was an undergraduate (in physics, no less.) The Progressive case was when I was a high-school kid — too early to be the one I was thinking of.
October 17th, 2005 at 3:42 pm
It’s an interesting problem.
I’ve long suggested that the day we make munging around with the genome as easy as creating suburban GarageBand tunes, is the day we sign our own death warrants. Open Source is an amazingly powerful meme. Information does want to be free! That doesn’t mean that it should be granted its wish.
If you make an open source computer virus creation toolkit (in the interests of understanding computer viruses no doubt), next thing you know, the web is crawling with viruses cobbled together by 14 year old script kiddies.
If you make an open source bulk emailer (to run legitimate email campaigns no doubt), next thing you know, the web is crawling with unsolicited emails.
If you make a cheap device that lets you create your own designer organisms (in the interests of finding a cure for AIDS or cancer or genetically enhanced foods no doubt), next thing you know, some lonely geek with a bad sense of irony creates a highly contageous virus whose only symptom is to make everyone go sterile.
Just because information wants to be free doesn’t mean you let it out of its cage.
October 18th, 2005 at 7:53 am
Just because information wants to be free doesn’t mean you let it out of its cage.
You speak as if we have a choice in the matter. This is an illusion.
October 18th, 2005 at 4:07 pm
“Life finds a way” is a famous quote from Michael Chriton’s “Jurassic Park”, describing how, no matter what precautions you attempt to take, nature will manage to cirumvent them.
You could apply the same axiom to information; it doesn’t just “want to be free”, it will find a way to escape. In other words, the more closely guarded the secret, the more strenuous will be the efforts of outlaws to obtain it. They can get it, and you may not even know they have it.
Therefore, the most logical defense against potentially dangerous information is to share it freely and actively, relying on the collective intelligence of the world community to develop (in this case) an antidote. If there’s a mad scientist out there smart enough to beat the collective scientific community to a cure, then he was probably capable of circumventing any security around the info in the first place.