A notable enthusiasm in contemporary software engineering is the idea that the field has a lot to learn from biology. You see it everywhere, from using neuroscience to get to AI ("reverse engineering the brain") to employing biological motifs like chemotaxis in network design. There is even a computer science journal -- "Bioinspiration and Biomimetics" -- devoted to the theme.
An example of the material in that journal might be a recent article by Craig Tovey of Georgia Tech and Sunil Nakrani of Oxford on using honeybee behavior to model the management of server farms. The point of connection is that both systems have resource allocation issues. A typical up-to-date hosting center uses virtualization software to dice a single large computing infrastructure (mainframe or cluster) into a constantly changing number of virtual servers (servers that exist only in software). Each of these virtual servers runs a slightly different configuration of services (like calls to different data bases, or various queues) simultaneously. The problem facing the Center as a whole is deciding how big a bite each of these virtual servers should be allowed to take out of the pool of common resources at any one time. (This is called the "orchestration problem".) In practice that decision is made by calculating the costs and benefits of all the servers, collecting them into a single list, and allocating resources accordingly.
Bees have a more decentralized system, in which each unit of resource -- each foraging bee -- gets to decide for itself how its time might be best spent. A bee returning from a flower patch reports to the rest of the hive via a medium called a waggle dance. The directions to the patch are encoded in the patterns of movements, while the intensity of the dance reflects the quality of the source. Unemployed foragers looking for a source to exploit survey the range of dances, picking one that seems to promise a good return on investment. When that bee returns, she delivers her own report, her own dance, standardized against the mean intensity of the dancing observed before she left the hive. (If there hadn't been much dancing when she left, she gets more excited about a given find than if everyone had been boasting about their own harvests.)
In both cases the loads in question fluctuate wildly (in the neighborhood of 1:100) and in both cases these fluctations have just enough continuity to them to make adapting to them profitable. The challenge therefore is not in figuring out the right average response (easy in either case) but in locating spikes in demand, mobilizing and dispatching resources fast enough to satisfy that spike, and then withdrawing those resources when demand goes away. The basic problem might best be understood as a problem of rapid learning, a theme that arises almost everywhere in contemporary computer science.
Hives execute on this issue impressively: according to the website of the nation's premier bee biologist, Tom Seeley of Cornell, the distribution of bees among nectar sources is close to the theoretical ideal: i.e., the distribution you would see if bees were omniscient. Server farms have lots of room for improvement. So a few months ago Tovey and Nakrani were inspired to write a bee- like internet hosting orchestration algorithm, in which each server published information about its own workload. Underemployed servers surveyed the information published by all the employed servers, and migrated to the load with the greatest revenue potential. The bee algorithm improved hosting performance significantly -- by about 25%.
It is interesting to ask why these computer scientists needed to consult the biological model at all. Why didn't one or both of them just solve the problem the way most engineers solve most problems, by thinking carefully about the constraints in the context of the tools at hand?
It is possible that there is a category of problem solving that we humans just can't think about very well, solutions that our brains are just not well adapted to. For these domains we need concrete demonstrations, the way a kindergarten student needs to understand addition in terms of "one egg and one egg" instead of the more abstract "1+1". One such domain might be the task of writing and debugging programs in which solutions emerge from the interaction of simple primitives over time and/or from dividing problems into large numbers of pieces, sending each piece to its own processor, and then combining the outputs of these processors. Both techniques are called parallel computing.
Parallel computing has been an important thread in the theory of computer science for decades. In theory its advantages appear to be considerable -- oldtimers might remember Thinking Machines' famous experiment in what it called Connectionism -- but so far single agent, uniprocessor, computing has prevailed. Humans don't seem to be able to do parallel programming very well. Our minds seem to have evolved to follow individual agents over time; we are just not that good at constructing narratives about multiple agents interacting simultaneously.
Fortunately for us, biology does almost everything through one or another species of parallel processing, from genetic networks to neural networks to networks of protein signalling. It is therefore in a position to explain parallel solutions to us one step at time, in the most elementary fashion. (Once we get the idea we slap our foreheads and move on, doing what we want with it.)
This raises the question of why nature selected every other computational organ out there to work in parallel while it forced our minds -- our conscious thinking -- to be confined to linear uniprocessing. Did nature have a reason for making us stupider than it is?
Perhaps so.
- +
Strategies for Dealing With IT Complexity 24 December, 2007 10:30:47
Every innovation, every business process improvement, comes with an IT complexity tax that must be paid by CIOs in time, money and sweat. Here are strategies to mitigate the increasing complexity of IT as it enables new business.Every innovation, every business process improvement, comes with an IT complexity tax that must be paid by CIOs in time, money and sweat. Here are strategies to mitigate the increasing complexity of IT as it enables new business. - +
Ticked Off at Tick the Box Mentality 04 February, 2008 13:01:15
Does your executive search firm know the difference between an MIS manager and a CIO, and if it does, can it explain that difference to its corporate clients?Does your executive search firm know its MIS managers from its elbow? Does it even know the difference between an MIS manager and a CIO, and if it does, can it explain that difference to its corporate clients? - +
Process Trip 04 February, 2008 13:07:03
Why Maritz Travel revamped key business processes — and how business and IT came together to make it workWhen Rich Phillips became COO OF Maritz Travel about two and-a-half years ago, he sat down and took a hard look at the big industry picture - +
9 Paths to Higher Performance 10 December, 2007 14:09:23
When an organization brings together talented people in a creative, collaborative environment it fosters a culture of high performance, which in turn leads to superior business resultsLike high-achieving individuals, some organizations seem to have the Midas touch. Virtually every initiative they touch earns them gold and even those that fail never seem to cost them much of anything at all - +
How to Get Real About Strategic Planning 04 February, 2008 12:50:59
Everyone agrees that having a strategic plan for IT is a good thing but most CIOs approach the process with fear and loathing. In fact, the majority of CIOs (and the enterprises they work for) are faking it when it comes to strategic planning. Isn't it time we all got real?Oh, it must be nice to be the CIO of a FedEx or a GE or a Credit Suisse. Places where IT and the business are so tightly aligned you can barely tell the two apart. Where corporate leaders understand that IT is a strategic asset and support it as such
- +
Bill Gates: A New Approach to Capitalism in the 21st Century 28 January, 2008 07:12:19
Transcript of Gates speech, and a Q&A at World Economic Forum in Davos, SwitzerlandAs you all may know, in July I'll make a big career change. I'm not worried; I believe I'm still marketable. I'm a self-starter, I'm proficient in Microsoft Office. I guess that's it. Also I'm learning how to give money away. - +
Mob wisdom means business 04 January, 2008 07:14:47
So-called 'crowdsourcing' lets companies create massive focus groups, garner fresh ideas, and even predict the futureCrowdsourcing, mob wisdom, interactive ideation, artificial AI -- call it what you will, but the idea of tapping external collaborators to develop or enhance products and services is far from revolutionary. - +
Can Macs conquer the enterprise? 11 January, 2008 10:55:53
The field is wide open for a Macintosh insurrection on the business desktop. It could happen, but probably won't. Here's why.If Apple were a football team, the New England Patriots would have had some serious competition this year.
Read up on the latest ideas and technologies from companies that sell hardware, software and services. Refresh your AUP: Top tips to ensure your acceptable use policy is fit for purpose
Email Archiving 101—Customer Case Study
Gaining Competitive Advantage Through Enterprise Planning
Data grids and service-oriented architecture
Best Practice in Building an Integrated Information Management Strategy
Solve Exchange Mailbox Storage Issues Once and for All
Delivering the Power of Choice with Microsoft Dynamics CRM
CRM your salespeople will love
- White PaperWhat you don’t know can destroy your business. It’s hard to imagine modern business without the internet but in the last few years it has become fraught with danger. Read on to discover how internet security can give your business a competitive advantage.
- White PaperJoin industry expert Martin Tuip to discover best practice strategy for the archival and removal of .PST files using email archiving. Learn how to ensure long-term email records are there when needed, and reduce the risk to your business and clients.
- White PaperJoin industry expert Bob Spurzem and Chuck Arconi of Fox Hollow to discover how to reduce Exchange total storage and keep it at a manageable level. Learn how Exchange storage growth can be contained without sacrificing security and accessibility.
Discover how SOA can create smarter outcomes for your business.
Attend and learn:
- How SOA is helping leading companies to become more agile
- Where you should be applying SOA processes in your company
- The top SOA implementation mistakes to avoid
Click here for more information.
- +
CIO Live Podcast #79: Brent D Taylor, author of The Outsider's Edge: The Making of Self-Made Billionaires Part II 05 October, 2007 06:00:00
For his new book, The Outsider's Edge: The Making of Self-Made Billionaires, social researcher Brent D Taylor spent four years of intensive research investigating the psychological make-up and backgrounds of some of the world's richest men and women, including IT luminaries Bill Gates, Larry Ellison and Steve Jobs. Taylor discovered that, despite working in different industries and coming from different upbringings, they all have one thing in common -- they are all outsiders. - +
CIO Live Podcast #78: Brent D Taylor, author of The Outsider's Edge: The Making of Self-Made Billionaires 28 September, 2007 17:34:25
For his new book, The Outsider's Edge: The Making of Self-Made Billionaires, social researcher Brent D Taylor spent four years of intensive research investigating the psychological make-up and backgrounds of some of the world's richest men and women, including IT luminaries Bill Gates, Larry Ellison and Steve Jobs. Taylor discovered that, despite working in different industries and coming from different upbringings, they all have one thing in common -- they are all outsiders. - +
CIO Live Podcast #77: Panasonic Speeds Up Trans-Pacific File Transfers, Part III 21 September, 2007 07:00:00
Part three in our three-part special report from CIO's sister publication Network World in the US, as Paul Desmond reports from the Network World IT Roadmap Conference in Santa Clara, California. With development teams in the US and Japan, Panasonic needed a more efficient way to move very large files between the two locations. Iben Rodriguez, IT consultant for Panasonic Research and Development, explains how a storage-area network and virtual server technology helped speed up WAN performance. - +
CIO Live Podcast #76: Panasonic Speeds Up Trans-Pacific File Transfers, Part II 14 September, 2007 07:00:00
Part two in our three-part special report from CIO's sister publication Network World in the US, as Paul Desmond reports from the Network World IT Roadmap Conference in Santa Clara, California. With development teams in the US and Japan, Panasonic needed a more efficient way to move very large files between the two locations. Iben Rodriguez, IT consultant for Panasonic Research and Development, explains how a storage-area network and virtual server technology helped speed up WAN performance. - +
CIO Live Podcast #75: Panasonic Speeds Up Trans-Pacific File Transfers, Part I 07 September, 2007 07:00:05
Part one in our three-part special report from CIO's sister publication Network World in the US, as Paul Desmond reports from the Network World IT Roadmap Conference in Santa Clara, California. With development teams in the US and Japan, Panasonic needed a more efficient way to move very large files between the two locations. Iben Rodriguez, IT consultant for Panasonic Research and Development, explains how a storage-area network and virtual server technology helped speed up WAN performance.
- +
Chris Hoff on Virtualization and Cloud Computing 20 November, 2008 10:55:00
Chris Hoff, chief security architect for the systems and technology division at Unisys and an advisor on the Skybox Security customer advisory board, is one of the biggest critics of virtualization security out there. Not because it isn't important - but rather because it is vital and needs to mature rapidly. - +
Cybersecurity is focus of new start-up incubator 20 November, 2008 07:19:00
Texas uni announces the Institute for Cyber Security.The University of Texas at San Antonio Tuesday announced a technology incubator aimed at fostering IT security-based start-ups within the state. - +
Dilip Sarangan on Physical Security M&A 20 November, 2008 11:18:00
Dilip Sarangan tracks physical security companies for Frost & Sullivan. He expects the industry's "need to have" products to weather the economic storm well, with the big players (now including IBM and Cisco) looking for value-priced acquisitions. - +
International Challenges in PCI Security 20 November, 2008 09:15:00
In a country that's seen many regulatory compliance challenges this decade, the headaches of PCI security tend to be analyzed from a largely American perspective. - +
PCI council sharpens oversight of security auditors 19 November, 2008 10:53:00
Quality assurance plan targets security assessors and scanning vendorsThe PCI Security Standards Council Monday unveiled a plan to sharpen oversight of the hundreds of security-service providers now authorized to evaluate merchant networks under the organization's Payment Card Industry data standards.
Vignette Announces 2008 Excellence Awards 21 November, 2008 10:50:00
PGP and Ponemon Institute Unveil Inaugural Australian Data Breach Study 2008 20 November, 2008 17:34:00
Symantec Cloud Services Transform Data Centre Operations Through Proactive Management 20 November, 2008 12:06:00
Verizon Business Offers Tips to Building a Successful Unified Communications and Collaboration Plan 20 November, 2008 12:04:00
AARNet Brings 4K Digital Cinema to Australia: First 4K HD Video Signal delivered into Australia by AARNet 20 November, 2008 12:02:00
|
||
|
||
|
|
||
|
Email Archiving 101—Customer Case Study
Join Lee Benjamin, a Microsoft Exchange MVP and Ryan Shipkowski, network administrator for Matthews, to discuss the process and ROI of implementing an email archiving solution, with emphasis on a case study from Matthews International.














