With digital video on the rise in enterprises, storage teams will play a key role in accommodating the petabytes of data that can be generated by video surveillance systems.
With the high cost of digital video surveillance systems falling, organisations can now buy additional IP video technology and do much more with video surveillance data. In addition to combating fraud and crime, companies are applying analytics to video data to aid merchandising, operations and customer service. "The advent of IP video is one of the key things that changed surveillance video from a sleepy technology backwater to something that IT needs to get involved in," says Steven Norall, senior analyst and consultant at Taneja Group.
Industry researcher Frost & Sullivan sees IP as the next phase for the surveillance industry and one that will have a far-reaching impact on storage. According to company research, "the most important advantage in an IP surveillance network is the capability of storing large quantities of video footage in a relatively limited storage space with much higher image quality than analog networks."
"Companies doing surveillance are generating a lot more data, 24/7. The data is increasingly high resolution. Now they want to see a recognisable face," says Rick Bentley, CEO at video surveillance system integrator Connexed Technologies.
IP video
The IP video surveillance storage market is on a steady growth track. Garnering $US767 million in revenue in 2003, the market is projected to reach $US1.7 billion in 2008 and top $US2.9 billion by 2013, according to Frost & Sullivan.
"Storage stands to receive a large chunk of that money, currently about 25%," reports Dilip Sarangan, research analyst in the North America AutoID and Security Practice at Frost & Sullivan. "Storage is the largest and most expensive component in a video surveillance system."
As soon as the video surveillance stream has been digitized and directed across a network, companies can implement shared, scalable network storage instead of being limited to the storage typically attached to each digital video recorder (DVR). "DVRs create islands of storage," says Lee Caswell, chief strategy officer and founder of Pivot3. Islands of video storage suffer from the same inefficiencies and unnecessary management overhead as the islands of data storage that drove enterprises to implement SAN and NAS to consolidate their storage.
Of course, companies don't need the latest IP video cameras to take advantage of digitized video. "Companies still use a lot of analog cameras," says Caswell. "They aren't going to replace those cameras that fast because today there is still about a $250 price delta between an IP camera and a conventional video camera." By using an encoder, companies can capture and digitize the incoming analog video data stream before shipping it over a LAN to networked storage.
The importance of IP video can be seen in the arrival of a new class of video product, the network video recorder (NVR), which captures data feeds from multiple cameras for storage on directly attached disks. "The NVR is like the old DVR except that it attaches to the network. You can log in remotely and access data or manage it over the network," says Bentley.
IT in the video spotlight
In the not so distant past, IT barely noticed conventional video surveillance and generally had little interest in getting involved. Video surveillance was handled by the guards, guns and dogs crowd, or by the facilities group that took responsibility for fire alarms, smoke detectors, maintenance and phone services.
From a storage standpoint, video surveillance was totally uninteresting. Initially, the data was stored and viewed on VCRs, and tapes were continually rerecorded in a rotation. Rarely did organisations keep surveillance data for more than a month; often, it was kept for a week or less. Things became more interesting when the DVR, which contained a few hard drives, came on the scene. As disk capacity increased, the amount of storage in a DVR grew. With the advent of IP video and NVRs, the video surveillance effort required the services of the storage group.
"The problem is that most video surveillance purchasers are not IT-sophisticated," says Norall at Taneja Group. "They went with packaged systems based on direct-attached storage. But that is hard to scale and expensive to manage." The scale of video surveillance storage can be staggering. A retailer can have dozens of cameras per store, while a single large casino can have thousands of megapixel cameras generating high-resolution video streams 24/7.
The typical enterprise IT storage infrastructure isn't optimally set up for surveillance video storage. "This is absolutely not an FC [Fibre Channel] market, and clusters of NAS filers won't do the job either," says Norall. "Block-based iSCSI storage is what makes the most sense," he adds, while the security industry has shown a preference for packaged proprietary systems.
Storage challenges
Even with block-based iSCSI storage, not every product can handle the demands of video surveillance storage. For starters, the amount of storage can be staggering. "Video surveillance will probably make up the single biggest data store in the enterprise," says Bentley at Connexed Technologies.
Storage managers who think giving each email user 2GB of storage space is a big deal will be shocked. Consider the following formula: Take the number of cameras generating video streams 24/7 and the megapixel resolution of the new cameras and an acceptable frame per second (fps) rate (3fps to 5fps won't cut it--think 10fps, 15fps, 20fps) with medium compression and multiply that by the length of time you want to store the data.
The total is a very big number. The need to store 30GB to 40GB per camera per day isn't unusual. That comes to 1TB or more per camera per month. Now, if a retail organization has 30 to 40 cameras per store and 1,000 stores, you're looking at multipetabytes of storage, even if you're rewriting over some old data.
Another challenge is the storage workload. "This is not your typical enterprise storage workload," says Jeff Whitney, VP of marketing at Intransa. For example, surveillance storage is 95% to 98% writing. "It is hard to keep up with a near constant write load," he notes. "The storage system doesn't have any time for the usual housekeeping."
Most SAN storage arrays are optimised for business workloads that use small blocks and present a balance of read/write activity. "With video surveillance, you are constantly writing large sequential blocks," adds Whitney. And you don't keep it long; often just a week, a month, a year at most. And skip the backup; RAID 5 is all the protection that's required.
Finally, video storage has to be simple. The systems are usually deployed and operated by security and facilities people who don't understand storage provisioning and networking. LUNs, zones, masking, RAID--forget it. "You need fast performance to the drive, linear scalability and utterly simple management," says Caswell at Pivot3. That's why DVR/NVR appliances have been such a hit; however, they can't scale in the face of the storage capacities required.
Limited storage options
Until recently, a handful of nonstorage vendors - Bosch, JVC and Toshiba - dominated the video security market and offered complete solutions with embedded hard drives for storage. Cisco, through the acquisition of SyPixx Networks Inc. (2006) and BroadWare Technologies (2007), appears poised to enter the market.
"Cisco grabbed lots of mindshare, but nobody knows what products they are offering," says Bentley at Connexed Technologies. Adds Frost & Sullivan's Sarangan: "It looks like Cisco is planning to converge of lot of technologies, but it hasn't announced products yet."
The surveillance market would seem ideal for low-cost storage vendors, but that hasn't been the case. "This is a market for cheap iSCSI, but companies like Dell are focused on the small- to medium-sized market. Network Appliance is aiming more at the data center," says Taneja Group's Norall. Products optimised for those markets won't meet surveillance storage requirements.
"EMC, IBM and HP are exploring surveillance storage, but haven't done much yet," adds Sarangan.
Maybe the biggest challenge storage professionals face will be working with the group that's mainly responsible for surveillance video. "The security people may not be so welcoming," says Caswell at Pivot3. "They see storage as just a small part of the overall solution." They're quite comfortable buying complete solutions from one vendor or integrator.
No matter who controls the video surveillance budget, the storage team will be asked to build out the necessary capacity to store video. And they'll have to learn the idiosyncrasies of surveillance storage because it's not going away.