Please wait while the page is being loaded Skip this advertisement >
Thursday | 20 November, 2008
CIO
How To Build a 1.5 Terabyte SAN for Less than $US35,000
Scott Berinato 05 February, 2002 13:03:44

Lew Goldstein is a sound supervisor editor for C5 Inc. in New York City. C5 does postproduction audio for major motion pictures - which means it creates or embellishes every sound you hear in a movie from a dog bark to every spoken word. They put the hurricane in Cape Fear. The woodchipper in Fargo too.

Goldstein is also a closet IT guy. To store all those space-hogging audio clips, he built a 1.5 terabyte storage area network (SAN). He did this without a SAN vendor and for less than $US35,000, a third of what vendors charge for equipment alone - never mind pesky consulting and integration fees.

His SAN has never crashed. Once, he unplugged it on purpose in an attempt to cross it up. When he plugged it back in, sound editors returned to work as if nothing had happened.

Goldstein didn't set out to build a SAN because SANs are trendy. He did it because the transition from tape to digital editing was wreaking all sorts of havoc in audio postproduction. Digital audio files are big, and Goldstein has more than 45,000 of them. Every sound from the natural world - and thousands not of this world - is stored on a server's hard drive at C5. Most of them are bigger than 1MB. Here's a tiny sample: in Get Shorty, a 20-second clip of a 767 flying overhead was 8MB. Goldstein has gigabytes of"dins", which are long stretches of ambient city noise. Some dins run 15 minutes (120MB). Goldstein has a file called Aircraft Toilet Flush. He has a folder called simply Blowtorches.

C5 not only edits the sounds; it creates them. Each new movie (he recently finished Men in Black 2) involves 15 days of recording with"foley artists", people who are recorded knocking on a door or walking on gravel and so forth. Hundreds of audio files emerge from that work.

Work processes also contributed to C5's storage problem. Because editors at C5 couldn't share files, they made local copies of everything they worked on. They also made 6GB local copies of the movies in order to sync sound and picture. At any one time, C5 is working on four major motion pictures plus several documentaries and indie films, each having up to six editors. On top of that, directors will often change entire sections of movies during audio postproduction, which means everyone will stop what they're doing, upload their work, wait for the new video file, make a new local copy and then start editing again.

Vendors offered to sell Goldstein a SAN, of course, but they wouldn't sell him what he wanted. If he wanted just an empty rack to put his own hard drives in, they'd tell him he had to buy the drives, too, at enormous mark-ups. If he wanted fibre channel, they tried to sell him on SCSI - a technology his research taught him to avoid. One vendor offered a discount if he would beta-test its SAN. He thought that sounded like he would be working for them instead of the other way around.

A SAN, Goldstein says, is just a big rack of hard drives everyone shares. With a hobbyist's background and some dedicated research, he was able to learn the technology on his own and avoid vendors' upselling, technology biases, and their price tags.

Goldstein did have to call on a couple of vendors to complete his first SAN. He bought fibre channel switches and PCI-to-fibre channel cards. He found a humble little company that sold him empty racks at a good price.

He picked up 10 9GB drives on eBay. He spent $US51. Total.

Don't scoff. They've never crashed.

He put each $US5.10 eBay drive in one of the empty racks and connected the rack to the switches that in turn connected to four end users."I slapped it together, and it worked," Goldstein says."I had probably spent less than $US5000 at this point."

The thing hummed, and C5's editors started jumping on board. Four nodes became eight. Eight became 16. Soon, every sound editor was connected. Users could share files. No more local replications. The editing process became more efficient and more collaborative. Goldstein believes without his SAN, C5 couldn't have pulled off the audio postproduction on Ang Lee's Crouching Tiger, Hidden Dragon. Lee was dissatisfied with much of the movie's audio, and he leaned on C5. With the SAN, multiple members of the crack team could work simultaneously on a file. By the old method, each editor had to wait for the previous one to finish his work and upload it.

The system keeps growing. Goldstein now buys 73GB drives for about $US700 each - still a minor theft. He has more than 3 racks running 1.5 terabytes of storage. He just added 500GB without a hitch. Each editor gets his own 20GB workspace, and each has access to the archive of 39,000 (and growing) audio files. In fact, Goldstein finds SAN-building so straightforward, he now sells them on the side.

The sounds of Scorcese's New York, every wistful breeze in an Ang Lee film, every Coen brothers gunshot is sitting there on Lew Goldstein's first SAN at C5. That's probably a billion dollars in ticket receipts, and Goldstein has yet to spend $US35,000.

More about eBay
Related Stories
  • +

    Adobe launches hosted services, adds Flash to Acrobat 03 June, 2008 09:02:44

    Adobe to launch Web site offering users free hosted services for document creation, sharing and storage
    Adobe this week is set to unveil the next version of its Adobe Acrobat software, which adds support for the company's Flash multimedia technology. The company also plans to launch a new Web site offering users free hosted services for document creation, sharing and storage.
Market Place
 
Featured Whitepapers

Smart SOA World Tour

Discover how SOA can create smarter outcomes for your business.

Attend and learn:

  • How SOA is helping leading companies to become more agile
  • Where you should be applying SOA processes in your company
  • The top SOA implementation mistakes to avoid

Click here for more information.
  • +

    CIO Live Podcast #79: Brent D Taylor, author of The Outsider's Edge: The Making of Self-Made Billionaires Part II 05 October, 2007 06:00:00

    For his new book, The Outsider's Edge: The Making of Self-Made Billionaires, social researcher Brent D Taylor spent four years of intensive research investigating the psychological make-up and backgrounds of some of the world's richest men and women, including IT luminaries Bill Gates, Larry Ellison and Steve Jobs. Taylor discovered that, despite working in different industries and coming from different upbringings, they all have one thing in common -- they are all outsiders.
  • +

    CIO Live Podcast #78: Brent D Taylor, author of The Outsider's Edge: The Making of Self-Made Billionaires 28 September, 2007 17:34:25

    For his new book, The Outsider's Edge: The Making of Self-Made Billionaires, social researcher Brent D Taylor spent four years of intensive research investigating the psychological make-up and backgrounds of some of the world's richest men and women, including IT luminaries Bill Gates, Larry Ellison and Steve Jobs. Taylor discovered that, despite working in different industries and coming from different upbringings, they all have one thing in common -- they are all outsiders.
  • +

    CIO Live Podcast #77: Panasonic Speeds Up Trans-Pacific File Transfers, Part III 21 September, 2007 07:00:00

    Part three in our three-part special report from CIO's sister publication Network World in the US, as Paul Desmond reports from the Network World IT Roadmap Conference in Santa Clara, California. With development teams in the US and Japan, Panasonic needed a more efficient way to move very large files between the two locations. Iben Rodriguez, IT consultant for Panasonic Research and Development, explains how a storage-area network and virtual server technology helped speed up WAN performance.
  • +

    CIO Live Podcast #76: Panasonic Speeds Up Trans-Pacific File Transfers, Part II 14 September, 2007 07:00:00

    Part two in our three-part special report from CIO's sister publication Network World in the US, as Paul Desmond reports from the Network World IT Roadmap Conference in Santa Clara, California. With development teams in the US and Japan, Panasonic needed a more efficient way to move very large files between the two locations. Iben Rodriguez, IT consultant for Panasonic Research and Development, explains how a storage-area network and virtual server technology helped speed up WAN performance.
  • +

    CIO Live Podcast #75: Panasonic Speeds Up Trans-Pacific File Transfers, Part I 07 September, 2007 07:00:05

    Part one in our three-part special report from CIO's sister publication Network World in the US, as Paul Desmond reports from the Network World IT Roadmap Conference in Santa Clara, California. With development teams in the US and Japan, Panasonic needed a more efficient way to move very large files between the two locations. Iben Rodriguez, IT consultant for Panasonic Research and Development, explains how a storage-area network and virtual server technology helped speed up WAN performance.
  • +

    Chris Hoff on Virtualization and Cloud Computing 20 November, 2008 10:55:00

    Chris Hoff, chief security architect for the systems and technology division at Unisys and an advisor on the Skybox Security customer advisory board, is one of the biggest critics of virtualization security out there. Not because it isn't important - but rather because it is vital and needs to mature rapidly.
  • +

    Cybersecurity is focus of new start-up incubator 20 November, 2008 07:19:00

    Texas uni announces the Institute for Cyber Security.
    The University of Texas at San Antonio Tuesday announced a technology incubator aimed at fostering IT security-based start-ups within the state.
  • +

    Dilip Sarangan on Physical Security M&A 20 November, 2008 11:18:00

    Dilip Sarangan tracks physical security companies for Frost & Sullivan. He expects the industry's "need to have" products to weather the economic storm well, with the big players (now including IBM and Cisco) looking for value-priced acquisitions.
  • +

    International Challenges in PCI Security 20 November, 2008 09:15:00

    In a country that's seen many regulatory compliance challenges this decade, the headaches of PCI security tend to be analyzed from a largely American perspective.
  • +

    PCI council sharpens oversight of security auditors 19 November, 2008 10:53:00

    Quality assurance plan targets security assessors and scanning vendors
    The PCI Security Standards Council Monday unveiled a plan to sharpen oversight of the hundreds of security-service providers now authorized to evaluate merchant networks under the organization's Payment Card Industry data standards.
CIO Webcast Innovation #8 - What are the biggest roadblocks to IT's involvement in innovation at your company?
Watch the latest latest edition of CIO Innovation which is now available for download.
Watch the webcast
Sign up to the CIO Innovation update email


CIO Live Podcast #79: Brent D Taylor, author of The Outsider's Edge: The Making of Self-Made Billionaires Part II
Listen to the latest edition of CIO Live which is now available for download.
Listen to the podcast
Sign up to the CIO Live email
Whitepaper

Understanding Email Marketing: A Guide for SMBs

Email marketing is often viewed as a marketers silver bullet. If used effectively, email campaigns will provide strong results for a limited spend each and every time. Download this white paper to discover how email marketing can work for you and your business.