CIO
Blog: Why we need biological models
Fred Hapgood  28 November, 2007 08:22:53

A notable enthusiasm in contemporary software engineering is the idea that the field has a lot to learn from biology. You see it everywhere, from using neuroscience to get to AI ("reverse engineering the brain") to employing biological motifs like chemotaxis in network design. There is even a computer science journal -- "Bioinspiration and Biomimetics" -- devoted to the theme.

An example of the material in that journal might be a recent article by Craig Tovey of Georgia Tech and Sunil Nakrani of Oxford on using honeybee behavior to model the management of server farms. The point of connection is that both systems have resource allocation issues. A typical up-to-date hosting center uses virtualization software to dice a single large computing infrastructure (mainframe or cluster) into a constantly changing number of virtual servers (servers that exist only in software). Each of these virtual servers runs a slightly different configuration of services (like calls to different data bases, or various queues) simultaneously. The problem facing the Center as a whole is deciding how big a bite each of these virtual servers should be allowed to take out of the pool of common resources at any one time. (This is called the "orchestration problem".) In practice that decision is made by calculating the costs and benefits of all the servers, collecting them into a single list, and allocating resources accordingly.

Bees have a more decentralized system, in which each unit of resource -- each foraging bee -- gets to decide for itself how its time might be best spent. A bee returning from a flower patch reports to the rest of the hive via a medium called a waggle dance. The directions to the patch are encoded in the patterns of movements, while the intensity of the dance reflects the quality of the source. Unemployed foragers looking for a source to exploit survey the range of dances, picking one that seems to promise a good return on investment. When that bee returns, she delivers her own report, her own dance, standardized against the mean intensity of the dancing observed before she left the hive. (If there hadn't been much dancing when she left, she gets more excited about a given find than if everyone had been boasting about their own harvests.)

In both cases the loads in question fluctuate wildly (in the neighborhood of 1:100) and in both cases these fluctations have just enough continuity to them to make adapting to them profitable. The challenge therefore is not in figuring out the right average response (easy in either case) but in locating spikes in demand, mobilizing and dispatching resources fast enough to satisfy that spike, and then withdrawing those resources when demand goes away. The basic problem might best be understood as a problem of rapid learning, a theme that arises almost everywhere in contemporary computer science.

Hives execute on this issue impressively: according to the website of the nation's premier bee biologist, Tom Seeley of Cornell, the distribution of bees among nectar sources is close to the theoretical ideal: i.e., the distribution you would see if bees were omniscient. Server farms have lots of room for improvement. So a few months ago Tovey and Nakrani were inspired to write a bee- like internet hosting orchestration algorithm, in which each server published information about its own workload. Underemployed servers surveyed the information published by all the employed servers, and migrated to the load with the greatest revenue potential. The bee algorithm improved hosting performance significantly -- by about 25%.

It is interesting to ask why these computer scientists needed to consult the biological model at all. Why didn't one or both of them just solve the problem the way most engineers solve most problems, by thinking carefully about the constraints in the context of the tools at hand?

It is possible that there is a category of problem solving that we humans just can't think about very well, solutions that our brains are just not well adapted to. For these domains we need concrete demonstrations, the way a kindergarten student needs to understand addition in terms of "one egg and one egg" instead of the more abstract "1+1". One such domain might be the task of writing and debugging programs in which solutions emerge from the interaction of simple primitives over time and/or from dividing problems into large numbers of pieces, sending each piece to its own processor, and then combining the outputs of these processors. Both techniques are called parallel computing.

Parallel computing has been an important thread in the theory of computer science for decades. In theory its advantages appear to be considerable -- oldtimers might remember Thinking Machines' famous experiment in what it called Connectionism -- but so far single agent, uniprocessor, computing has prevailed. Humans don't seem to be able to do parallel programming very well. Our minds seem to have evolved to follow individual agents over time; we are just not that good at constructing narratives about multiple agents interacting simultaneously.

Fortunately for us, biology does almost everything through one or another species of parallel processing, from genetic networks to neural networks to networks of protein signalling. It is therefore in a position to explain parallel solutions to us one step at time, in the most elementary fashion. (Once we get the idea we slap our foreheads and move on, doing what we want with it.)

This raises the question of why nature selected every other computational organ out there to work in parallel while it forced our minds -- our conscious thinking -- to be confined to linear uniprocessing. Did nature have a reason for making us stupider than it is?

Perhaps so.

Latest User Comments
There are no comments yet. Be the first to add one!

Comments

Post new comment

Login or register to link comments to your user profile, or you may also post a comment without being logged in.
The content of this field is kept private and will not be shown publicly.
Enter the fully qualified URL, eg. http://www.example.com/
  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.

More information about formatting options

Syndicate content

HP Data Center Transformation solutions offer practical ways to overcome the energy and capacity limitations, operational vulnerabilities and technology constraints that can plague your data center. Choosing from a portfolio of solutions matched to your business needs, we can help you transform your data center into a business-driven, process-smart and future-ready asset.

Latest on Data Centre

  • +

    Inside Internode's data centre 05 June, 2009 14:39:00

    Computerworld gets an exclusive behind the scenes look inside Internode's Adelaide data centre with network guru Mark Newton
    Computerworld gets an exclusive behind the scenes look inside Internode's Adelaide data centre with network guru Mark Newton
  • +

    HP uses outside air, big fans, 12-foot raised floor to cool servers 03 June, 2009 07:44:00

    It's also cutting data center power use by painting server racks white
    Just off the North Sea coast in the United Kingdom, Hewlett-Packard Co.'s EDS unit has built a data center that largely relies on cold sea air to keep servers chilled and -- by doing so -- cut the center's cooling power needs in half.
  • +

    HP targets the cloud with new hardware 12 June, 2009 08:27:00

    HP offers complete cloud computing package for businesses
    HP has designed a new portfolio of hardware, software, and services, aimed at reducing costs and saving resource, particularly for businesses involved in Web 2.0, cloud and high-performance computing.
  • +

    Defence to spend $700m on ICT reform 05 June, 2009 11:13:00

    Strategic Reform Program report reveals only half of defence IT budget visible to CIO
    Less than half of the annual $1.2 billion spent by Defence on its ICT is visible to its chief information officer, Greg Farr, a new report has revealed.
  • +

    Inside Telstra's Virtualisation Strategy 11 May, 2009 14:12:00

    Need to cut infrastructure costs driving the strategy
    Telstra is increasingly turning to virtualisation as its core strategy to both manage the rising costs of, and growth in, its data centres, according the company’s CIO, John McInerney.
  • +

    Defence to Initiate ICT Reform Program, Expand CIO Role 05 May, 2009 11:56:00

    ERP rollout, data centre consolidation, single architecture all on the cards, according to the Department of Defence’s strategic policy white paper
    The Defence department has signaled a raft of changes to its approach to information technology under a new ICT reform program.

Free Resource Library

Data Centre Assessments

The First step to Optimising

Speeding business innovation

Removing barriers to growth, increasing agility and driving out costs

Assessments: Ammunition for Facts-Based Decision Making
by Richard L. Sawyer, Senior Principal, HP Critical Facilities Services
Download Podcast Download Transcript
 

CIO Summit The New World Order Opportunities and Challenges for CIOs

23rd July 2009
The Westin Sydney


A content-rich networking event where CIOs and senior executives collaborate on business and technology issues ranging from the impact of the economic downturn to the most pressing trends affecting IT in the enterprise.

Register Now

  • +

    New scam email uses Australian Federal Police to gain victims' trust 03 July, 2009 10:49:00

    Fake offers of free AFP monitoring service to stop "cybernetic attacks"
    Cyber criminals have changed tack in their ongoing scam campaign against banks, moving to the use of government agencies to gain the trust of unsuspecting email recipients.
  • +

    AFP hits $6 million identity fraud syndicate 03 July, 2009 08:25:00

    $500,000 of goods per week purchased with fake credit cards
    The Australian Federal Police (AFP) claims to have struck a major blow to a multi-million identity fraud syndicate.
  • +

    5 steps to secure a new PC 30 June, 2009 00:19:00

    Just unwrapped a brand-new PC? Security pros share their secrets for making your system Internet-safe.
    A common misconception is that a shiny new computer is more or less secure because it hasn't yet been exposed to the Internet's sinister underbelly. But the truth is, these machines come out of the box needing scores of patches, some basic security software downloads and the disabling or replacing of items security pros don't typically trust.
  • +

    Facebook simplifies privacy settings, calls them too complex 02 July, 2009 05:48:00

    The social-networking site is also getting ready to let members share content with anyone on the Internet
    Facebook will simplify the way in which it offers privacy options to its users, as it gets ready to give its members for the first time the option to make the content they post on their profiles available to anyone on the Internet.
  • +

    DR a growing concern for A/NZ CIOs: Symantec 02 July, 2009 09:16:00

    Mission critical apps and cost of down-time major drivers
    CIOs in Australia and New Zealand are increasingly getting involved in the disaster recovery planning of their organisations, according to a new survey from Symantec.
Upcoming Industry Events
  • CIO SummitNSW - Sydney | 23/07/2009 | Hosted by CIO Magazine, IDC & the CIO Executive Council
Whitepaper

Data Centre Assessments: The First Step to Optimisation

A well-designed and executed assessment supports the ability to respond to a change in the business environment. Help make good management decisions by knowing what you have, what it can and can’t do, and where investment gives the greatest returns. Read on.


CIO Industry Insight Podcast #4: Kerry Stratton, Managing Director of Healthcare, InterSystems
Listen to the latest edition of CIO Live which is now available for download.
Listen to the podcast
Sign up to the CIO Live email