Video Analytics Solutions Are Not All Created Equal
The use of video analytics is growing rapidly in the surveillance market. It has proven indispensable in high-risk security projects, and is becoming increasingly popular in commercial jobs for a wide range of applications, including outdoor protection, customer service measurements, people counting, crowd monitoring, and many others.
We are not far from the day when most video products will include embedded content analysis, making all video products smarter. However, there is a lack of solid technical information to help compare available technologies. The problem is that companies often make grand claims, but many fall far short in performance, leading to widespread disappointment.
The purpose of this article, therefore, is to outline the general principles of how video analytics works, in non-technical language, and examine how competing technologies try to solve these problems. The results vary dramatically, and a closer look shows why there are such big differences in performance.
Video analytics systems are built on three core components:
- Motion detection and object segmentation: This is where the video is processed to separate foreground objects from the background. This is the most processor intensive part of video analytics, accounting for up to 80% of the computational resources. However, there is a wide range in how well different products segment moving objects from the rest of the video.
- Object Tracking: This step tracks groups of pixels that are foreground objects as they move from frame to frame. If a group of pixels moves across the scene, it is probably a foreground object. The challenge is to track this blob of changing pixels. Once again, there is a huge range in performance from the different approaches taken.
- Object Classification: This function identifies the type of object detected. If a group of pixels moves across the scene, it is probably a foreground object. The challenge is to track this blob of changing pixels. Once again, there is a huge range in performance from the different approaches taken.
Systems vary in how well they perform each of these three steps. For example, there are many products being sold today as video analytics
