1. Skip to navigation
  2. Skip to content
  3. Skip to sidebar

How useful are the Home Office’s i-LIDS video analytics tests in today’s world?

May 24th, 2013 by Kevin Bowyer

Logo: i-LIDSFollowing NW Systems Group’s look at the new Surveillance Camera Code last month, we decided to follow up this month by taking a closer look at the world of video analytics.

The video analytics market has had compound annual growth rate (CAGR) of over 16% for several years now and was predicted to have a value of over $88m this year (Source: IMS Research). Traditionally video analytics software has required a great deal of processing power to make it work – hence nearly all of its focus in the early years was PC-based.  PC-based analytics software still makes up over 75% of total software revenues in the space (Source: IMS Research).

But analytics software is being embedded increasingly into IP-based ‘edge’ devices i.e. network cameras. Several manufacturers, most notably Mobotix, have made impressive progress in this area in the last year. One key advantage of edge-based analytics is that it takes pressure off the network as all the hard processing is done at the edge and only data relating to alerts is sent through to the central monitoring units (CMUs).

Video analytics market prospects remain strong in the UK as well as overseas despite or in fact because of the economic downturn. One of the key drivers for this demand in the UK is local authority CMU consolidation which is a major trend now. The CMUs that are left in place, when this wave of consolidations has run its course, will be monitoring several local authorities’ camera systems each. This means that each CMU will be monitoring several hundred more cameras and they may well be doing this with the same or even fewer staff. UK control room staff are at risk of being overloaded.

We think sophisticated video analytics could be the answer because the software can be configured to alert staff when specific types of incidents or scenarios happen which may be the precursor to (or indicative of) criminal behaviour.  In short, analytics can help separate the ‘wheat from the chaff’.

i-lids speed filter screenshot

In order to help Government CCTV system procurement teams select effective analytics solutions, the Home Office Science’s Centre for Applied Science and Technology (CAST (pdf)) partners with the Centre for Protection of National Infrastructure (CPNI) to maintain and develop the Imagery Library for Intelligent Detection Systems (i-LIDS).

i-LIDS comprises a library of CCTV video footage based around ‘scenarios’ central to the government’s requirements. The footage accurately represents real operating conditions and potential threats. The ‘event detection’ and ‘tracking’ scenarios are:

  • Abandoned baggage detection
  • Parked vehicle detection
  • Doorway surveillance
  • Sterile zone monitoring
  • Multiple-camera tracking
  • New technologies

CAST runs most of the evaluations, although sterile zone monitoring tests are now outsourced.  All the scenarios have a scheduled annual evaluation and manufacturers can submit their test performance scores to CAST to be considered for inclusion in one of the annual evaluations. The latest annual timetable is here (pdf).

These scenario tests are being steadily adapted and improved by CAST.  Latest enhancements have absorbed changes associated with use of HD and infrared cameras.

Video analytics software can be evaluated by official testing bodies against official datasets established for each of the above.  Some datasets contain up to 50 hours of real world footage. The test provides an accuracy measurement based on the percentage of false positives (false alarms).

Each dataset consists of two or three camera views referred to as stages, and is further segmented into shorter video clips of 30 to 60 minutes. The training dataset is further split into individual events. Each dataset is supplied with a user guide detailing the library structure, user interface and the procedure used to evaluate the systems against the relevant scenario.

Analytics software firms wear their i-LIDS badges with pride. And because it is the only globally recognised certification system for video analytics it helps secure major contracts in the Far East and Middle East as well as in the UK.

There do however appear to be two specific draw backs to the existing tests:

  • They are geared to test CCTV systems not IP-based surveillance systems which are being increasingly adopted, even in IP-adverse local authority CMUs.
  • They are designed to test PC-based analytics rather than edge-based analytics. Both IP and edge-based surveillance deployments are of course on the rise and most major camera manufacturers are now focusing hard on building more intelligence/analytics into their cameras.

i-LIDS is clearly a market-leading testing service which just needs further investment to keep it relevant to newer technologies as they emerge. Had Andrew Rennison not decided to resign perhaps this would have been something he would have pushed for. But without him who will champion this inside Government?

For further reading go to:

Home Office CAST paper on helping small businesses specify CCTV Systems correctly

More information on iLIDS.

Do you think i-LIDS is in need of further development in recognition of wider adoption of IP Surveillance and more intelligent surveillance cameras?  Is video analytics the key to unlocking greater central monitoring efficiencies? Do let us know.

 

 

One Response to “How useful are the Home Office’s i-LIDS video analytics tests in today’s world?”

  1. Gary Mercer says:

    When iLIDS was originally developed by CAST ( I think in 1999) as a means of evaluation, Video Analytics as a security surveillance tool was still in its formative stages and it served a purpose for the limited equipment available over 10 years ago. It was however flawed, both in concept and content.

    The data sets being used now, are the same ones that were originally developed and that probably makes them around 13 years old. To my knowledge, apart from Sterile Zone Monitoring no other scenario had been passed by any manufacturer, so hardly the greatest challenge for a half decent VA system.

    The fact that iLIDS is still only applicable to a PC or server based analytics engine despite the emergence over the last 5 years of edge based analytics makes it outdated and it excludes a number of key manufacturers including ourselves.

    In general iLIDS has done a good job but it's now time to bring it into the 21st Century because the lack of ability to deal with edge based devices is doing a disservice to the industry by prohibiting the adoption of edge solutions, when certain projects would be better served both commercially and technically by its use.

    As a company we obviously have an interest in the tests being modified to accept edge based devices and I together with some of our competitors have been trying for over 4 years to persuade CAST to change. Unfortunately, whilst there is an acknowledgement of the benefits this would bring it would appear that neither the resources or finance are currently available.

    Gary Mercer
    Sales Director
    VideoIQ UK