Method to increase resolution of video sequence

FIELD: information technologies.

SUBSTANCE: in the method for identification of contours of a moving object, in a video sequence of low resolution, information is used from auxiliary photographs of the specified object, taken with high resolution, mutual identification of contours is carried out from a photograph and a video sequence at appropriate moments of time in the same sequence with correlation and modelling of high-resolution frames.

EFFECT: increased resolution and dynamic range of a video sequence.

5 cl, 1 dwg

 

The invention relates to the field of digital processing of moving images and can be used in compact, Amateur and professional photo/video cameras when solving the task of creating a quality video.

There is a method of increasing the resolution of video sequences based on wavelet analysis, in which each frame of a video sequence is represented as a set of wavelet coefficients obtained from the block decoding video that uses the discrete wavelet transform (application for invention of the Russian Federation No. 2007132982, publication date 10.03.2009). This set of wavelet transform coefficients by the method of refinement coefficients, and further modified set of wavelet coefficients are used as input for the interpolation by inverse discrete wavelet transform, which get the bigger frame of the sequence; in this case, the interpolation integrate with decoding, using the intermediate coefficients obtained by decoding, as input for the interpolation; and clarification of the wavelet coefficients perform linear interpolation using information about the direction of the border.

The disadvantage of this method (as well as all methods that use interpolation) is that interpolation is not POS which enables you to extract a new qualitative information from images and thereby objectively improve the detail and dynamic range of the image.

There is a method of error-correcting gradient contour highlight objects in digital images (application for invention of the Russian Federation No. 2008133097 IPC G06K 9/48, H04N 1/409, publication date 27.06.09), which solves the problem of pattern recognition by their footprints on digital images. The technical result is to increase the stability of gradienty operators selection circuit to pulse interference resulting from many conditions of transfer and transformation of images. How robust gradient contours allocation of objects in digital grayscale images based on the fact that previously perform the operation of the local assessment of impulse noise in the image, and then form four auxiliary mask, and four corresponding control vector corresponding to the four differently oriented masks Prewitt. After that, using these masks calculate the approximate value of the modulus of the gradient of the image and by its threshold conversion gain contours of objects in the image.

The technical result is to increase the resolution and dynamic range video sequences, and the ability to obtain photographic quality images of the sequence.

The problem is solved in that the new JV is own robust gradient contour highlight objects in digital images, different from the existing ones because of the selection circuits in the low-resolution video sequence is used with high-resolution photos (selection gradient contours) and mutual identification circuits with pictures and video sequences.

While recording video using standard sequences compression recording resolution (a*b), where a is the horizontal component of the video resolution, b - vertical component of the video resolution, inserting images with a resolution of (A*B), where A is the horizontal component resolution pictures, B - vertical component resolution pictures, and A>a, B>b, obtained with photos information passed to the analyzer, making the correlation analysis of the video and photos, and further generator for generating a sequence of higher quality than the main the video data stream.

In addition, to support photos and record video sequence using different receiving the locking sensors.

From the matrix to accommodate photos read settings - white balance, exposure in different areas of the frame for transmission to the analyzer sequence, with the aim of improving the dynamic range total videoposted is Telenesti.

A new way of increasing the resolution of video sequences is proposed to use the method to obtain the contours of the objects in the sequence of low-resolution and supporting high-resolution photos, which carries out the operation of the local assessment of impulse noise on the video and the photos, and then forming an auxiliary mask, and the corresponding control vector. After that, using these masks calculate the approximate value of the modulus of the gradient image in the video sequence and supporting photographs and by converting it to receive the contours of the objects in the images, then use the comparison to produce cross-identification of objects in video sequences and supporting photos to generate the final sequence of photographic quality.

We offer a new way to increase the resolution of the video sequence based on conversion information of the subsidiary pictures is very important.

The invention is illustrated by a drawing. The drawing shows: main lens for receiving the video sequence and supporting photos (1), additional (optional) lens to receive assistance), the locking sensors: selection matrix for receiving the main stream of video sequences with low extension (3), the matrix for receiving an auxiliary high-resolution photos (4), correlation analyzer (5), the generator of the sequence (6).

The images that appear on the lenses 1 and 2, independently accepted adoptive image sensors (foster matrices 3 and 4).

Information received from the receiving image sensors (3, 4) is passed to the analyzer (5), making correlation analysis of video sequences and supporting photos, and further generator (6) for generating a sequence of higher quality than the main video data stream.

An EXAMPLE of a SPECIFIC IMPLEMENTATION

Created a stream of video data P1 320*240 dots, removing moving along a certain circular trajectory of the object (with a repetition period of T0with a digital camera F1 (Olympus C-725). Then, at the beginning of the next repetition of the cycle of movement of the object O at time (T1>T0) is a photograph of an object with a resolution of 1984*1488 points F1 using a digital camera FA1. Also, using a digital camera F1 is the subject About at 1-second intervals (pictures F at time Ti>=T1+i (C)). Using VirtualDub made the reader to insert photos F in the flow of P1 with the corresponding time stamps (Ti-T1). Further, with the help of specially developed software identifies the contours of the images in the sequence P1 and supporting photos Of in this same sequence, finding correlations and modeling of frames with a resolution of 1984*1488 points. Thus, a final sequence with a resolution of 1984*1488 pixels and a frame rate equal to the frequency of the sequence P1.

1. How robust gradient contour highlight objects in digital images, which carries out the operation of the local assessment of impulse noise in the image, and then formed an auxiliary mask, and the corresponding control vector that is different from the existing ones, which is to highlight the contours of a moving object captured by a digital camera, a low-resolution video sequence using information with supporting photographs of a moving object captured with a high resolution, and mutual identification circuits with pictures and video sequences at corresponding points in time in the same sequence with correlation and modeling of frames with high resolution.

2. The method according to claim 1, characterized in that during recording, the video recording resolution ab, where the - the horizontal component of the video resolution, b - vertical component of the video resolution, inserting images with a resolution of AB, where a is the horizontal component of the resolution of the photos, the vertical component resolution photos, and A>,>b, obtained with photos, information is transmitted to the analyzer, making correlation analysis of video sequences and auxiliary images, the selection and mapping of the contours of the images in the video sequence and photographs, and a further generator for generating sequences of a higher resolution than the main video data stream.

3. The method according to claim 2, characterized in that for obtaining auxiliary photos and record video sequence using different receiving the locking sensors.

4. The method according to claim 2, characterized in that for receiving the main video data and auxiliary photos using different lenses.

5. The method according to claim 2, characterized in that the matrix in the auxiliary reception photos read settings - white balance, exposure in different areas of the frame for transmission to the analyzer sequence, with the aim of improving the dynamic range of the final sequence.



 

Same patents:

FIELD: information technology.

SUBSTANCE: adaptive definition of the wavelet-basis for discrete wavelet transformation is possible through selection from a library or calculation. The wavelet-basis can be defined using: characteristics obtained using statistical, correlation and spectral analysis methods for blocks and sub-bands of blocks of the initial image; image block reconstruction error.

EFFECT: fewer transmitted or stored data through adaptive definition of the basis function for discrete wavelet transformation for initial image blocks.

12 cl, 5 dwg

FIELD: information technology.

SUBSTANCE: method of highlighting an object in an electronic document such that, the highlighted object retains colour and formatting properties to allow for maintenance of visual fidelity relative the pre-highlighted view of the highlighted object and which allows for a semi-transparent background underneath a highlighted object which allows a user to see and appreciate the colouring and any visual properties applied to the background underneath the highlighting applied to the selected object.

EFFECT: high efficiency of searching for objects in electronic documents.

20 cl, 6 dwg

FIELD: information technology.

SUBSTANCE: position of pulse noise on the image is evaluated first, after which four auxiliary masks are formed, as well as eight control vectors (two vectors based on each auxiliary mask), and coefficients of corresponding four differently aligned Prewitt masks are then changed using given vectors. Further, the given masks are used to calculated the approximate value of the modulus of the image gradient, and contours of the object on the image are obtained through its threshold conversion.

EFFECT: higher sensitivity of the noise-immune gradient method of detecting contours to useful contour features of the image.

5 dwg

FIELD: information technology.

SUBSTANCE: snap-shot of a graphic image is reduced by resising by 4 times. The snap-shot is compressed and stored as a compressed file, which can be decompressed and increased by 4 times. The initial snap-shot of the graphic image is then superimposed onto a decompressed increased snap-shot. Differences of pixel values between the initial snap-shot of the graphical image and the decompressed increased snap-shot are searched for, from a given contrast, based on contrast elements using arithmetical subtraction. After that a snap-shot with contour values is obtained, and contrast elements are compressed and stored as a compressed file.

EFFECT: increased efficiency of compressing files and reducing amount of memory required with retention of definition of the graphical image after decompression of files.

8 dwg

FIELD: physics, computation equipment.

SUBSTANCE: the invention claims method of image blur compensation involving: calculation of difference between measured image pixel brightness and brightness assessment obtained earlier on the basis of previous frame sequence; movement detection by comparison of obtained difference to threshold value; defining of movement direction for each pixel; combination of adjoining pixels with the same movement direction in a single object; outlining contours of moving objects by adding their initial B(k) and gradient ▿(B(k)) of images; and generation of output image where k1, k2 are weight factors. Device of image blur compensation includes: image sensor, controller, mode movement detection module, object detection module, correction module, first RAM device, second RAM device, third RAM device, counter, first comparator, second comparator, first multiplexor, second multiplexor, third multiplexor, fourth multiplexor, fifth multiplexor, sixth multiplexor, seventh multiplexor, first demultiplexor, second demultiplexor.

EFFECT: blur compensation for moving object image in real-time mode.

2 cl, 11 dwg

FIELD: medicine.

SUBSTANCE: system comprises a display unit for presenting a view of segmented 3D medical image on a display; an indicating unit for specifying a position on the presented view; an activation unit for firing an event; an identification unit for identifying a segmented anatomic structure contained in the segmented 3D medical video data on the basis of said position on the presented view in response to the fired event; and also an actuating unit for execution of an action connected with the identified segmented anatomic structure that allows receiving the information on the segmented 3D medical video data. The action executed by the actuating unit can represent displaying a name of the segmented anatomic structure, a short description of the segmented anatomic structure or prompt messages of a potential abnormality or dysfunction of the segmented anatomic structure.

EFFECT: enhancement ensured by searching actual body volume data.

15 cl, 10 dwg

FIELD: information technology.

SUBSTANCE: in the method, the size of a structure-forming element is selected equal to one element of a mesh halftone matrix; that size is increased at end points of fragments of the initial contour until the region of the structure-forming element covers the end point of the closest fragment of the initial contour, after which end points are connected by a straight line; the size of the structure-forming element is once more set equal to one element of the mesh halftone matrix and moved to the end point of the next fragment of the initial contour.

EFFECT: eliminating contour abruption on a mesh halftone matrix.

2 dwg

FIELD: information technology.

SUBSTANCE: device for painting original identification is executed comprised of coder, identification unit, non-volatile memory and light source with time relay.

EFFECT: implementation of painting art original identification by comparison original code with code of painting art piece claiming to be original.

10 dwg

FIELD: information technology.

SUBSTANCE: block transform-based digital media codec more efficiently encodes wide dynamic range transform coefficients in two parts: a normalised coefficient and bin address. The normalised coefficient relates to a grouping of coefficient values of the wide dynamic range into bins, whereas the bin address is an index of the coefficient value within a bin. With careful selection of the bin size, the normalised coefficients have a probability distribution roughly similar to narrow range transform coefficients, which is better suited to variable length entropy coding. The codec uses variable length entropy coding to encode the normalised coefficients in a 'core' of the compressed bitstream, and fixed length coding to encode the bin address as a separate optional layer that can be omitted. The codec further adaptively varies the bin size of the grouping based on a backward adaptation process to adjust the normalised coefficients towards a probability distribution well suited for efficient variable length entropy coding.

EFFECT: efficient compression of wide-range transform coefficients.

29 cl, 12 dwg

FIELD: information technology.

SUBSTANCE: in the method, object search zones are predefined. The image is converted to a set of signals which is a matrix of signals. The signals are discretised and extended signals are picked up. The search zone is first formed using adjoining windows. The centre of each window is the pint on the perimetre of the adjoining window. Boundary points of the determined object are estimated using a luminance difference criterion function. An object of arbitrary shape is constructed between boundary points around the central point, as well as a strobe around that object. Dimensions of the formed object are constrained by dimensions of the strobe on the horizontal and (or) vertical coordinate.

EFFECT: high probability of identifying an object at low object contrast and high background contrast.

2 cl, 1 dwg

FIELD: information technologies.

SUBSTANCE: digital multimedia codec based on block conversion achieves higher efficiency by reprojection of digital multimedia data components into vectors or parallel units, on which multiple conversion operations may be carried out on the basis of architecture with single instruction flow and multiple data flows. In case of one-dimensional overlapping biorthogonal conversion, components of digital multimedia data are reprojected into vectors, for which "butterfly" stages of parts of preliminary/postfilter overlapping and block conversion may be arranged on the basis of SIMD. In case of two-dimensional overlapping biorthogonal conversion, components of digital multimedia data are reprojected into vectors, for which hadamard operator of preliminary/post-filter overlapping and block conversion may be arranged on the basis of SIMD.

EFFECT: higher coding and decoding speed for digital data.

33 cl, 17 dwg

Mixing images // 2424569

FIELD: information technology.

SUBSTANCE: method comprises the following steps: merging at least part of a first image and at least part of a second image to form the intended image; identifying borders of the formed image, lying between an area in the formed image formed from the first image, and an area in the formed image formed from the second image; modifying the formed image based on the gradient of at least part of any of the first and second images; said modification is also performed based on or more of: an element for storing colour and indicating contrast ratio of at least one of the first and second images. The device realises the said method. A machine readable data medium contains a program code for executing the said method in a computer system.

EFFECT: obtaining smooth compositions and reduced decolouration defects owing to modification of the formed image based on an element for storing colour or measure of fragility.

19 cl, 6 dwg

FIELD: information technology.

SUBSTANCE: displaying network content search results on mobile devices involves obtaining results (208) of a network content request (202) via a mobile device (200). A geolocation of at least one object (402) associated with the results (208) of the network content request (202) is also obtained. A scene is viewed in a camera view (212) of the mobile device (200) and a virtual location is determined, where the virtual location represents the actual location of the object (402) relative to the scene contained in the camera view (212). A graphic image (214, 216) representing the object (402) is then displayed at the virtual location in the camera view (212).

EFFECT: high relevancy of content when a user perceives location.

32 cl, 10 dwg

FIELD: information technology.

SUBSTANCE: method of processing multimedia data associated with multiple layers includes determination of base layer residual data and performing interlayer prediction to generate extension layer residual data, if at least one of a certain number of non-zero coefficients of base layer residual data or a certain number of zero coefficients of base layer residual data satisfies a fist selected condition. The method of decoding a multimedia bit stream can include reception of a multimedia bit stream, having a base layer and an extension layer and decoding the base layer to determine whether the extension layer must be decoded using intralayer prediction of interlayer prediction.

EFFECT: reduced amount of coded data.

55 cl, 10 dwg

FIELD: information technologies.

SUBSTANCE: user interface includes control panel, making it possible for the user to input dimensions and shape of a meeting table, location and orientation of camera, and also coefficient of desired correction from 0 to 100%. Corrected panoramic image is displayed on display device. Image of head (corrected or non-corrected) of a meeting participant is extracted and displayed in a separate window. Corrected panoramic image, dimensions of which vary together with a coefficient of applied deformation, may be displayed and sent with additional pixels along its perimetre for provision of possibility for a corrected or normalised panoramic image to adapt to any display device with standard dimensions and resolution ability, which also simplifies transfer along network. Corrected image may also be transferred with a standard resolution through use of proportion ratios of pixel, which differ from one.

EFFECT: reduced quantity of distortions and provision of efficient perception of panoramic images.

10 cl, 17 dwg

FIELD: coding elementary-wave data by means of null tree.

SUBSTANCE: proposed method includes generation of elementary-wave ratios pointing to image. In the process bits of each elementary-wave ratio are associated with different bit places so that each place is associated with one of bits of each elementary-wave ratio and associated bits are coded with respect to each place of bits to point to null tree roots. Each place of bits is also associated only with one of bits of each elementary-wave ratio. Computer system 100 for coding elementary-wave ratios by means of null tree has processor 112 and memory 118 saving program that enables processor 112 to generate elementary-wave ratios pointing to image. Processor 112 functions to code bits of each place to point to null tree roots associated with place of bits.

EFFECT: enhanced data compression speed.

18 cl, 7 dwg

FIELD: text optical recognition.

SUBSTANCE: method includes following stages: separating data of bitmap image on levels with varying complication degree; separating these data on objects; determining membership of each objects at one of complication levels; setting hierarchical connections between objects of different complication levels; setting interconnection between objects of same complication level; analyzing properties of objects, including at least following steps: making a theory about properties of analyzed object, checking theory concerning properties of analyzed objects, correcting data concerning properties of connected objects of same or different complication levels.

EFFECT: higher quality, simplified processing, higher error sensitivity.

6 cl, 3 dwg

FIELD: communications.

SUBSTANCE: previously, at transmitting and receiving sides random quadratic matrix is identically generated with size m×m elements and two pairs of random key matrices with sizes N×m and m×N elements. From k frames of colored images with sound signal k of matrices of quantized counts of colored moving image are formed with size M×M×k elements and Z-digit sound vector. Received matrices are transformed to digital form on basis of presentation of each of them in form of result of multiplication of three matrices: random rectangular matrix with size N×m elements, random quadratic matrix with size m×m elements and random rectangular matrix with size m×N elements. Into digital communication channel elements of rectangular matrices of size N×m and m×N elements are transferred. Restoration of images is performed in reversed order.

EFFECT: higher speed of data transfer.

5 cl, 23 dwg

FIELD: optical object identification means.

SUBSTANCE: identification element of optical seal is lit by passing optical probing emission, its optical image is projected into place of multi-element photo-detector, voltages Un are recorded at outputs of elements of photo-detector and aforementioned signals are used to form an optical image of seal, which is recorded and then used to compare to control optical image of seal. During recording process aforementioned voltages are measured and also measured are exposition time spans appropriate for them in case of presence pot absence of identification element in optical track, and also voltages during replacement of identification element by black body and measured values are used for calculation by given method of a block of mathematical expressions, representing an optical image of seal.

EFFECT: optical image, free from influence of alternation of a parameters of optical track and photo-detector elements.

1 dwg

FIELD: technology for processing remote probing data for detection and recognition of objects on basis of their images.

SUBSTANCE: method includes source geometrically pixel-wise combined digitized images of one and the same scene concurrently in n spectrum ranges, source signs matrix is formed, each element of which represents n-dimensional values vector of signals of pixels of source images with similar coordinates, standard is selected in form of arbitrary element of source signs matrix, final numeric matrix is formed, to each current element of which value is assigned, equal to distance in vector signs space between vector, appropriate for standard and vector, appropriate for element of source matrix with same number of row and column to those of current element, final matrix is transformed to digital image, while as signs, brightness values of pixels are used, textural and gradient characteristics of source image pixels.

EFFECT: simplified operations concerning generation of synthesized image for visual interpretation, its adaptation to objects targeted by observer, detailed reflection of chosen objects on synthesized image and compact representation of information.

4 cl, 2 dwg

Up!