carboncopies.org
Concerns arose recently about the concept of so-called “catchment areas”, evolutionary developments that result in a very tight interdependence between requirements for survival and behavioral drives. In particular, the concern has been raised that such catchment might render any significant modification of the human mind, such as through brain enhancement, impossible (Suzanne Gildert, “Pavlov’s AI: What do superintelligences REALLY want?”, Humanity+@Caltech, 2010).
The concept of a catchment area assumes that beneath the veneer of goal-oriented rational planning, learned behavior and skill lies a basic set of drives and reward mechanisms. The only purpose of those drives and reward mechanisms is genetic survival, a necessary result of eons of natural selection. It follows that all of our perceived goals, our desires and interests, the pursuit of wealth, social acceptance or fame, love, scientific understanding, all of it is merely a means to an end. All of it points back to the set of drives and reward mechanisms that best enable us as individuals, us as a tribe and us as a species to survive in our given environment.
Why does that describe a catchment area, a type of prison of behavior? It is assumed that the distribution of behaviors that have enabled long-term survival is a narrow one with little real variance. Stray too far from the norm and your behaviors become counter-productive to survival. Worst of all, if you recognize your enslavement to those single-purpose drives and reward mechanisms, if you realize that they have no meaning beyond a survival that itself links to no universal purpose, then you risk embarking upon a nihilistic course that would likely end in your extermination or self-termination.
Continue reading “The Darwin Escape” »