SYSTEMS, METHODS AND BITSTREAMS FOR REMOVING NON-ESSENTIAL FEATURE MAP INFORMATION IN MACHINE-BASED APPLICATIONS USING REGIONS OF INTEREST

by Martinraj Nadar | Tuesday, Apr 15, 2025
patent photo

Abstract:

Systems and methods for codecs for feature coding for machines with region of interest processing are provided. At an FCM encoder, a split neural network part 1 is configured to receive a video signal and generate a plurality of feature maps representing the video signal. A feature reduction module coupled to the NN Part 1 receives the plurality of feature maps and generating at least one reduced feature map. An image ROI extractor is configured to receive the video signal and perform detection methods to identify regions of interest in the video signal. A feature ROI extractor receives the feature maps and identifies regions of interest in the feature maps. A region filter removes content of the feature maps outside of the detected regions of interest. The remaining feature information for the regions of interest is provided in an encoded bitstream for transmission to an FCM decoder.