KEDRI - the Knowledge Engineering and Discovery Research Institute

Permanent link for this collection

https://hdl.handle.net/10292/552
KEDRI - the Knowledge Engineering and Discovery Research Institute of Auckland University of Technology was established in June 2002 and since then has been developing novel information processing methods, technologies and their applications to enhance discoveries across different areas of science and engineering. The methods are mainly based on principles from Nature, such as brain information processing, evolution, genetics, quantum physics.

Browse

Browsing KEDRI - the Knowledge Engineering and Discovery Research Institute by Subject "0602 Ecology"

Now showing 1 - 1 of 1
  • Thumbnail Image
    Item
    Integrating Spatial and Temporal Information for Violent Activity Detection from Video Using Deep Spiking Neural Networks
    (MDPI AG, 2023-05-06) Wang, Xiang; Yang, Jie; Kasabov, Nikola K
    Increasing violence in workplaces such as hospitals seriously challenges public safety. However, it is time- and labor-consuming to visually monitor masses of video data in real time. Therefore, automatic and timely violent activity detection from videos is vital, especially for small monitoring systems. This paper proposes a two-stream deep learning architecture for video violent activity detection named SpikeConvFlowNet. First, RGB frames and their optical flow data are used as inputs for each stream to extract the spatiotemporal features of videos. After that, the spatiotemporal features from the two streams are concatenated and fed to the classifier for the final decision. Each stream utilizes a supervised neural network consisting of multiple convolutional spiking and pooling layers. Convolutional layers are used to extract high-quality spatial features within frames, and spiking neurons can efficiently extract temporal features across frames by remembering historical information. The spiking neuron-based optical flow can strengthen the capability of extracting critical motion information. This method combines their advantages to enhance the performance and efficiency for recognizing violent actions. The experimental results on public datasets demonstrate that, compared with the latest methods, this approach greatly reduces parameters and achieves higher inference efficiency with limited accuracy loss. It is a potential solution for applications in embedded devices that provide low computing power but require fast processing speeds.
Items in these collections are protected by the Copyright Act 1994 (New Zealand). These works may be consulted by you, provided you comply with the provisions of the Act and the following conditions of use:
  • Any use you make of these works must be for research or private study purposes only, and you may not make them available to any other person.
  • Authors control the copyright of their works. You will recognise the author’s right to be identified as the author of the work, and due acknowledgement will be made to the author where appropriate.
  • You will obtain the author’s permission before publishing any material from the work.