Spatio-Temporal Attention Fusion SlowFast for Interrogation Violation Recognition
نویسندگان
چکیده
The use of video surveillance to monitor interrogation behavior can effectively maintain judicial civility in the context law enforcement cases. However, analyzing and reviewing videos be a time-consuming resource-intensive process, particularly manual identification violations. This work is dedicated development an intelligent recognition system for violations by using spatio-temporal attention fusion SlowFast Network. To address issue feature information underutilization slow path traditional SlowFast, slow-to-fast incorporated into original enhance learning. model fuses spatial temporal channels, replacing convolution module with this new approach. proposed was evaluated publicly available UCF101 action dataset, resulting 1.52% improvement Top-1 accuracy compared SlowFast. Based on two custom misconduct datasets, evaluated, achieving rate 99.16% misconduct. demonstrates its effectiveness identifying behaviors inside rooms. Compared some advanced models, strong competitiveness during interrogations.
منابع مشابه
Pose-conditioned Spatio-Temporal Attention for Human Action Recognition
We address human action recognition from multi-modal video data involving articulated pose and RGB frames and propose a two-stream approach. The pose stream is processed with a convolutional model taking as input a 3D tensor holding data from a sub-sequence. A specific joint ordering, which respects the topology of the human body, ensures that different convolutional layers correspond to meanin...
متن کاملSpatio-Temporal Ontologies and Attention
This paper presents a new proposal for the design of spatio-temporal ontologies which has its origin in cognitively motivated spatial semantics. It is shown that selective attention not only plays a central role in the characterization of spatial relations but that the representation of attentional aspects also leads to the possibility of defining an ontological upper structure which systematic...
متن کاملAttention modulates spatio-temporal grouping
Dynamic stimuli are ubiquitous in natural viewing conditions implying that grouping operations need to operate, not only in space, but also jointly in space and time. Moreover, in natural viewing, attention plays an important role in controlling how resources are allocated. We investigated how attention interacts with spatio-temporal perceptual grouping by using a bistable stimulus, called the ...
متن کاملLocal Descriptors for Spatio-temporal Recognition
This paper presents and investigates a set of local spacetime descriptors for representing and recognizing motion patterns in video. Following the idea of local features in the spatial domain, we use the notion of space-time interest points and represent video data in terms of local space-time events. To describe such events, we define several types of image descriptors over local spatio-tempor...
متن کاملSpatio-temporal SURF for Human Action Recognition
In this paper, we propose a new spatio-temporal descriptor called ST-SURF. The latter is based on a novel combination between the speed up robust feature and the optical flow. The Hessian detector is employed to find all interest points. To reduce the computation time, we propose a new methodology for video segmentation, in Frames Packets FPs, based on the interest points trajectory tracking. W...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2023
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2023.3316724