Device for panoramic television surveillance "day-night"

FIELD: physics, video.

SUBSTANCE: invention relates to panoramic television surveillance. The result is achieved due to that surveillance is carried out by a television system through a television camera with all-round view in a region close to a hemisphere, i.e., in a spatial angle of 360 degrees on the azimuth and tens of degrees on the elevation angle. Panoramic colour or black and white images are automatically transmitted to the server of a local area network depending on the time of the day, wherein monochromatic video signals are detected therein with a high signal-to-noise ratio.

EFFECT: providing an operator with a colour image during the day and a black and white image during the evening and night in automatic switching mode and with a high signal-to-noise ratio for a monochromatic image.

4 cl, 11 dwg

The present invention relates to a panoramic television surveillance, which is a television system using a television camera of the circular review in the field, close to a hemisphere, i.e. in the spatial angle of 360 degrees in azimuth and tens of degrees in elevation.

The closest to the technical nature of the claimed invention should be considered as a device panoramic television surveillance "day - night" [1], contains one United television camera and the server, which is a node of a local area network that is connected to two or more personal computer, a television camera consists of sequentially arranged and optically coupled panoramic lens and the sensor of a digital television signal (sensor sjpc), and in an expansion slot on the motherboard of the server video card is installed, coordinated through the channels I/o, control and power bus of the server that contains the unit conversion ring" frame in rectangular frames, the input of which is connected to the output of the block RAM on the frame, and output - to-output network, and the number of "rectangular" frame, corresponding to one current "ring" frame, satisfy the following relations :

where γ_g- horizon the capacity field of view in degrees observed by the operator of the image, but this transformation programmatically.

The disadvantage of the prototype is the lack of automatic selection of the character image (color or black and white) depending on the time of day, as well as limited opportunities CCTV in the evening and especially at night due to low signal-to-noise ratio at the input of the monitor.

The objective of the invention is the provision of operator color images by day and black and white images at night in the automatic switching mode and with a high signal-to-noise ratio for monochrome images.

The task in the inventive device, panoramic television surveillance "day - night" is solved in that the device prototype [1], contains one United television camera and the server, which is a node of a local area network that is connected to two or more personal computers, and TV camera prototype consists of sequentially arranged and optically coupled panoramic lens and sensor CTS, and in an expansion slot on the motherboard of the server prototype video card is installed, coordinated through the channels I/o, control and power bus of the server that contains the unit conversion "ring" frame in rectangular frames, which input data is n to the output of the block RAM on the frame, and the output - to-output network, and the number of "rectangular" frame, corresponding to one current "ring" frame, satisfies the relation (1), and the transformation programmatically, in the television camera prototype introduced optical unit, the second sensor CTS, synchronized in frequency and phase with the first sensor CTS on the synchronization signal receiver (BSC), and connected in series selector clock pulses and a pulse shaper (PHI) record and reset, connected in series detector signals, the fetch block-storage and comparator, the installation log which is connected to the threshold voltage, and the output to the control input of the switch, the first information input of which is connected to the output digital signal of the first sensor CTS, the second information input of the switch to the output digital signal of the second sensor CTS, and the output of the switch is the output video television camera at the entrance optical unit optically connected with the optical frame of the panoramic lens, the first optical block with a target of a sensor of the first sensor CTS, and the second output end of the optical block with the target of a sensor of the second sensor CTS, with analog output television signal of the first sensor CTS, which the sensor is a color image signal, and is made on the basis of the CCD image sensor with line wrap", connected respectively to the input selector clock pulses and to the information input of the detector signal and the second sensor CTS sensor is a black-and-white image signal and is made on the basis of the CCD image sensor with line personnel transfer, while the control input of the sample-hold is connected to the first output PHI record and reset, the second output of which is connected to the control input of the detector signal, a second sensor CTS additionally introduced shaper pulse (PHI) accumulation, providing in the memory sections CCD summed charge packets generated in the photodetecting section, and the video card on the server provides input digital monochrome video memory with period nT_toand the conclusion from it that the image signal with period T_towhere T_to- frame duration, n is the number of summed frames.

Comparative analysis of the prototype shows that the inventive device is characterized by the presence of new structural elements comprising a television camera including an optical unit, the second sensor CTS, the selector pulses, the detector signals, PHI record and reset, the unit sample-hold comparator and the switch, as well as financial savings as part of the second sensor CTS.

Sosaku is of known and novel characteristics of the claimed device is not known from the prior art, therefore, the proposed technical solution meets the criterion of novelty.

In the inventive solution in the server local area network is entered in the automatic mode, depending on the time of day panoramic image color or grayscale images, and monochrome video signals are recorded with a high signal-to-noise.

Therefore, the proposed solution meets the criterion of the presence of inventive step.

Figure 1 shows the structural diagram of the inventive device; figure 2 - structural diagram of the second sensor CTS; figure 3 - functional diagram of the technological organization of a sensor to the second sensor CTS; figure 4 is a structural diagram of PHI accumulation in the composition of the second sensor CTS; 5...7 is the time chart explaining the operation of the inventive device; Fig, according to [2], presents a photograph image obtained by using domestic panoramic lens / mirror lens; figure 9 shows the optical arrangement of the optical unit; figure 10 shows conventionally a circular image that is perceived first and second sensors CTS television cameras; figure 11 schematically presents a panoramic picture of this annular area, the proposed operator of the personal computer, in the form of a sequence of 6 is rectangular frames.

The inventive device panoramic television surveillance "day - night", see figure 1, contains connected in series television camera 1 and the server 2, which is a node of a local area network that is connected to two or more personal computer at position 3, while the television camera 1 is composed of sequentially arranged and optically coupled panoramic lens 1-1 and the optical unit 1-2, the first output of which is optically connected with the target of a sensor of the first sensor CTS 1-3, and the second output end of the optical block with the target of a sensor of the second sensor CTS 1-4, which is synchronized in frequency and phase with the first sensor CTS 1-3 according to the synchronization signal receiver (BSC); television camera comprises connected in series selector 1-5 clock and PHI 1-6 record and reset, and connected in series detector 1-7 video block 1-8 sample-hold and comparator 1-9, with analog output television signal of the first sensor CTS 1-3 connected respectively to the input selector 1-5 clock pulses and to the information input of the detector 1-7 video signals and digital output TV signal of the sensor 1-3 - the first information input of the switch 1-10, the second information input of which is connected to the digital output of the TV with the persecuted second sensor CTS 1-4, and the control input of the switch 1-10 connected to the output of the comparator 1-9, the installation log which is connected to the threshold voltage U_nwhen this control input unit 1-8 sample-hold connected to the first output PHI 1-6 record and reset, the second output of which is connected to the control input of the detector 1-7 video signals, and the output switch 1-10 is the output video TV cameras.

Panoramic lens 1-1 television cameras, as in the prototype, intended for forming the optical image of the circular review (circular image). As a technical solutions for panoramic lens 1-1, coinciding with a similar solution for the prototype, may be offered a panoramic lens / mirror lens design which is patented in Russia by domestic experts from the Moscow state University of geodesy and cartography [2].

The photo of the ring image formed panoramic lens presented on Fig. Angular field in space items for this lens is 360 degrees in azimuth and can reach (75-80) degrees in elevation.

The optical block 1-2 is designed to parallelize the optical image output from the panoramic lens 1-1 on target in each of the two sensors CTS.

The optical block -2 (see Fig.9) contains a beam splitter 1-2-1 and corrective filter 1-2-2, with a beam splitter 1-2-1 made in the form of a prism with two beam-splitting faces arranged at an angle of 30°with the first beam-splitting face of the prism is the input of the beam splitter, the second beam-splitting face of the first output beam splitter, the third face of the prism, which is located at an angle of 60° with respect to the first face, the second output of the beam splitter, and corrective filter 1-2-2 made in the form of a prism with one spectrometrically face, which is the input correction filter is located at an angle of 30° with respect to its second face, which is the output of the correction filter, the first output beam splitter 1-2-1 optically connected to the input correction filter 1-2-2, the second beam-splitting face of the prism beam splitter 1-2-1 installed close to spectrometrically faces of the prism correction filter 1-2-2, while the output of the correction filter 1-2-2 is the first output of the optical unit and the second output of the beam splitter 1-2-1 - a second output optical block.

In the future can be developed and specialized technical solution television panoramic lens integrated into the design of the beam splitter and corrective Sveti what ltram, i.e. it blocks 1-1 and 1-2 are made in a single optical device.

Target photodetectors of the first and second sensors CTS should be included in the optical frame of the panoramic lens 1-1. The resolution matrix of a sensor depends on the horizontal angle of the field of view observed by an operator of the personal computer image (γ_g). The smaller the value of γ_gthe higher the number of required matrix elements horizontally and vertically. Given that the geometric dimensions of the optical frame today's panoramic lens coincide with frame sizes standard photographic film, it is necessary to recognize these requirements are very high.

Modern megapixel matrix of charge-coupled devices (CCD) have an explicit limit on the speed clocking phase electrodes of the output of the register: the maximum sampling frequency element (pixel) does not exceed 40 MHz. Hence the frame rate observed by the operator of the personal computer panoramic images must be taken significantly below 50 Hz, which is not always valid due to the additional distortion of the video signal when the registration of dynamic scenes.

It should be recognized, and another condition, namely, a further increase of the resolution of the CCD is limited to a production enabled the values of their technology, which by many measures is approaching physical limits.

However, rapidly developing technology for the production of matrices based on the complementary structures of the metal - oxide - semiconductor (matrices CMOS) may remedy this situation in the near future, because the maximum sampling frequency of the pixels in these photodetectors have already surpassed the mark of 100 MHz [3].

If the sensor CTS 1-3 as the sensor used, the CCD having the organization "line wrap", the sensor CTS 1-4 it is organized by type "string-personnel transfer.

The implementation of the string-frame transfer sensor means that the crystal matrix CCD prototype with the organization "line wrap", added memory section 1-4-1-2, which is located between the photodetecting section 1-4-1-1 and output register 1-4-1-3 (see figure 3).

The photodetector section 1-4-1-1 new CCD has a typical design for CCD with line wrap. It allows accumulating the charge packets in the photosensitive elements such as photodiodes arranged in columns. In close proximity to each column of the photodiodes is insensitive to light vertical CCD register, separated from the photodiodes a photo chopper. During the charge accumulation packets fot the diodes on the photo chopper fed a low voltage level, providing a potential barrier between the photodiode and the vertical CCD register. At the end of the accumulation on the photo chopper short-term high level is applied voltage, allowing the transfer of charge packets from the photodiodes in the potential well formed in the vertical CCD registers.

The photodetector section 1-4-1-1 is equipped with an electronic shutter that performs electronic sensitivity adjustment via control of the accumulation time of the charge carriers within the human period.

The charge packets from the vertical CCD register section 1-4-1-1 in the interval interval reverse the vertical scan are transferred to section 1-4-1-2, and from there to the next forward stroke on the frame line is transferred to the output register 1-4-1-3. Each charge line of the bitmap image is then read through BPSN 1-4-1-4, forming the output video of the photodetector electrical signal.

Compared with the prototype, changes and structural scheme of the second sensor CTS 1-4 (see figure 2). Enter in the composition of the generator 1-4-2 control pulse additional pulse shaper (PHI) 1-4-2-5 accumulation is used to implement the logical operation control section memory 1-4-1-2 the purpose of summing it with the frame period of the charge packets generated in fotopriemniki section 1-4-1-1. Velich is on accumulated thus charge in section 1-4-1-2 should be proportional to the light photomechanic 1-4-1-1, it is this dependence is due to the choice of interval nT_toin the feedback circuit: digital output from the detector signal in the signal processor 1-4-3 - control input PHI 1-4-2-5 accumulation. The number of summed frames accumulation of n is limited, on the one hand, the dynamics of the event on the object that you want to see the operator, and on the other hand, the growth of the dark component in the video signal of the CCD image sensor. The typical value of the parameter n for a second reason is 50...60 at normal temperature sensor.

As applied to a three phase system management photodetector structural diagram PHI 1-4-2-5 savings can be made according to the solution proposed in figure 4. It contains the following digital blocks: counter interval nT_tothe first and second element "And"element "OR", and the first and second elements "NOT".

It is obvious that the device PHI 1-4-2-5 accumulation can be performed as part of a large integrated circuit (LSI) temporary controller 1-4-2-1.

Obviously something else. Using this method, but with a radically smaller gain in signal-to-noise ratio it is possible to increase the sensitivity of the monochrome channel devices and when used as a sensor of the second sensor CTS 1-4 CCD with line transfer, if the summation of the charge p is the ket to produce shielded from light vertical CCD registers the touch target.

At clock input PHI 1-4-2-5 accumulation served with a temporary controller 1-4-2-1 personnel sync - XI (see figa), which are further taken to the counting input of the counter interval PT_to. The capacity of the counter is n frames, i.e. nT_toand the generated signal should with a period of (n+1)T_to(see figb). At the output of the counter, this signal is further delayed by the value of the duration of XI (see figv).

The output signal of the counter at a different scale presents on figa. If phase input PHI 1-4-2-5 with temporary controller 1-4-2-1 served a three-phase pulse sequence (see figb...g), then exit FI 1-3-2-5 will be shot converted sequence, as shown respectively Figg...J.

As a result, the photodetector CTS 1-4 charge packets accumulated in the section 1-4-1-1, are formed in the memory sections 1-4-1-2. Therefore, in the composite video signal at the output CTS 1-4 signal-to-noise ratio is increased n times, and the image signal will be followed with a period of (n+1)T_to, i.e. pass on the value of the time interval PT_toas shown on figs.

The selector 1-5 clock is used for separation of the analog composite video signal of the first sensor CTS 1-3 lowercase and HR clock.

PHI 1-6 record and reset is used to perform the pulse control is possible (with the frame period T _todetector 1-7 video and block 1-8 sample-and-hold. Electric diagram PHI 1-6 is, in fact, the diagram of digital delay, published in [4, s.138].

On figa shows HR clock pulses from the output of the selector 1-5. The pulse control unit 1-8 - impulse records (see figv) is formed from the decay of HR clock. The pulse control unit 1-7 - reset pulse (see Figg) is produced from the decay of impulse records. The duration of output pulses PHI 1-5 is the period of the line T_with.

The detector 1-7 signal (peak or average value), the unit 1-8 sample-hold and comparator 1-9 can be performed using operational amplifiers for known schemes (see, for example, [5, s, s]).

Switch 1-10 intended for output on command from the comparator 1-9 on the output of the television camera or a digital television signal of the color image sensor 1-3, or a digital television signal is a black and white image from the sensor 1-4. Fee video installed into a free slot on the motherboard of the server 2 performs the following functions:

- enter the "ring" digital color or monochrome video signal in a memory;

- convert output "ring" frame black-and-white image or a "ring" of the frame Svetog the image in the respective rectangular frames by reading the video signal from memory.

Note that the read operation of these "rectangular" frame includes correction software by the geometric distortions of the corresponding area of the panoramic image is exactly the same as in the prototype.

The device panoramic television surveillance "day - night" (see figure 1) works as follows. The television camera 1 is installed in a fixed position, for example, using potestative (figure 1 it is not shown).

"Ring" the image of the observed scene, the generated panoramic lens 1-1, on the optical path of the first beam-splitting face of the prism beam splitter 1-2-1, the second beam-splitting face of the prism beam splitter 1-2-1, spectrometrically face of the prism correction filter 1-2-2, the second face of the prism correction filter 1-2-2 projected in the visible spectral range on photomixing first sensor CTS 1-3. At the same time optical frame panoramic lens 1-1 through different optical paths: the first beam-splitting face of the prism beam splitter 1-2-1, the second beam-splitting face of the prism beam splitter 1-2-1, the third face of the prism beam splitter 1-2-1 in the whole spectral range (visible and infrared) is projected onto photomixing second sensor CTS 1-4. Note that the infrared spectrum of the last image additionally in ylibaetsa due to the light flux, reflected spectrometrically facet prism correction filter 1-2-2 in the direction of the third face of the prism beam splitter 1-2-1.

In the photovoltaic and subsequent analog-to-digital conversion of the video signal at the output of "video 1" sensor CTS 1-3 is formed of a digital television signal of the color image and the output is "video 2" sensor CTS 1-4 - digital television signal is a black and white image.

The selector 1-5 highlights of the analog composite color video signal of the sensor CTS 1-3 (see figa) any personnel sync (see figb), and PHI 1-5 develops within each human quenching pulse following with a period of T_toimpulses record and reset (see respectively figv and Figg).

The detector 1-7 with a period of T_tomeasures the level of the video signal of the first sensor 1-3 (see Figg), block 1-8 sample-and-hold to save it for a time T_to(see file), and the comparator 1-9 evaluates the output voltage, comparing it with a threshold voltage U_n(see figs).

Assume that the device panoramic television surveillance works in the daytime, i.e. in the "day". Then the comparator 1-9 does not change its state according to the output, while maintaining the logical state "1" (see diagram on Figg)and, consequently, on the output video television camera in front of which is a digital composite video signal from the first sensor 1-3. Then "the ring" video color image on the communication line between the television camera 1 and the server 2 comes on Board video, and then transferred (recorded) in blocks of memory.

Suppose that the current angle (γ_g) presented a panoramic image is 60 degrees horizontally, then the "ring" record frame includes 6 (six) conventional areas (see figure 10).

Digital video recording for each "ring" of the image frame is converted to 6 "rectangular" frame, which can be offered in the form of the chosen sequence (see 11) operators local area network.

We assume that as personal computers 3, forming this network, used laptops, containing in its composition motherboard with the attached processor and RAM, and hard disk drive, display, keyboard and touchpad pointing device that is used instead of the mouse. The operator of each laptop 3 can carry out the selection offered by the server 2 of the image and displaying on the display screen.

Assume that the device panoramic television surveillance work in the evening or night. Then at the output of the comparator 1-9 sets the state to a logical "0" (see figs). In the N. the output of the television camera is transmitted to a digital composite video signal from the second sensor 1-4, and lines of communication on Board video server 2 receives the "ring" video black and white image.

Depending on the illumination of the observed scene in the memory sections 1-4-1-2 of the CCD image sensor of the second sensor 1-4 will be implemented by the addition of such number of charge packets personnel to ensure optimal accumulation of the photodetector and the formation of the sensor output a monochrome image with the highest possible signal-to-noise.

Otherwise, the operation of the device panoramic observation at this time is not different from his work in the daytime.

The technical result of the invention is that the operator of the laptop compared to the prototype, it is proposed a color image by day and black-and-white image at night in the automatic switching mode and with a high signal-to-noise ratio for monochrome images.

Currently, all the circuit elements of the device panoramic television surveillance "day - night" mastered or can be mastered by the domestic industry. Therefore, we must assume the present invention corresponding to the requirement of industrial application.

SOURCES of INFORMATION

1. RF patent №2371880, IPC H04N 7/00. Method panoramic television surveillance and a device for its implementation. / V.M. See lcov // B. I. - 2009. No. 30.

2. RF patent №2185645, IPC G02B 13/06, G02B 17/08. Panoramic lens / mirror lens. / A. Kurtov, VA Solomatin // B. I. - 2002. No. 20.

3. Berezin CENTURIES, Umetaliev A.A., Fahmi SH.S., Sycolin A.K., Shipilov NN. Solid-state revolution in television: Television system based on charge-coupled devices, systems on chip and systems-on-chip / Ed. by A.A. Umetalieva and A.K. Tsytsulina. - M.: Radio and communication, 2006.

4. Horowitz P., hill U. Art circuitry, in three volumes. M.: Mir, volume 2, 1983.

5. Horowitz P., hill U. Art circuitry, in three volumes. M.: Mir, volume 1, 1983.

1. The device panoramic television surveillance "day-night", contains one United television camera and the server, which is a node of a local area network that is connected to two or more personal computer, a television camera consists of sequentially arranged and optically coupled panoramic lens and the sensor of a digital television signal (sensor sjpc), and in an expansion slot on the motherboard of the server video card is installed, coordinated through the channels I/o, control and power bus of the server that contains the unit conversion "ring" frame in rectangular frames (BPKP), whose input is connected to the output of the block RAM on the frame, and you are the one to exit the "network", and the number of "rectangular" frame, corresponding to one current "ring" frame, satisfy the following relations:

where γ_g- horizontal angle in degrees observed by the operator of the image, and the transformation programmatically, characterized in that the television camera introduced optical unit, the second sensor CTS, synchronized in frequency and phase with the first sensor CTS on the synchronization signal receiver (BSC), and connected in series selector clock pulses and a pulse shaper (PHI) record and reset, connected in series detector signals, the fetch block-storage and comparator, the installation log which is connected to the threshold voltage, and the output to the control input of the switch, the first information input of which is connected the output digital signal of the first sensor CTS, the second information input of the switch to the output digital signal of the second sensor CTS, and the output of the switch is the output video television camera at the entrance optical unit optically connected with the optical frame of the panoramic lens, the first optical block with a target of a sensor of the first sensor CTS, and the second output end of the optical block with the target of a sensor of the second sensor CTS, thus, the analog output of the television signal of the first sensor CTS, which is a sensor of a color image signal, and is made on the basis of the CCD image sensor with line switch, connected respectively to the input selector clock pulses and to the information input of the detector signal and the second sensor CTS sensor is a black-and-white image signal and is made on the basis of the CCD image sensor with line personnel transfer, while the control input of the sample-hold is connected to the first output PHI record and reset, the second output of which is connected to the control input of the detector signal, a second sensor CTS additionally introduced shaper pulse (PHI) accumulation, providing in the memory sections CCD summed charge packets generated in the photodetecting section, and the video card on the server provides input digital monochrome video memory with period nT_toand the conclusion from it that the image signal with period T_towhere T_to- frame duration, n is the number of summed frames.

2. The device panoramic television surveillance according to claim 1, wherein the optical unit includes a beam splitter and a correction filter, the beam splitter is made in the form of a prism with two light the dividing faces, arranged at an angle of 30°with the first beam-splitting face of the prism is the input of the beam splitter, the second beam-splitting face of the first output beam splitter, the third face of the prism, which is located at an angle of 60° with respect to the first face, the second output of the beam splitter, and the corrective filter is made in the form of a prism with one spectrometrically face, which is the input correction filter is located at an angle of 30° with respect to its second face, which is the output of the correction filter, the first output beam splitter optically connected to the input of the correction filter, and a second beam-splitting face of the prism beam splitter installed close to spectrometrically faces of the prism correction filter, and the output of the correction filter is the first output of the optical unit and the second output of the beam splitter, the second output optical block.

3. The device panoramic television surveillance according to claim 1, characterized in that the panoramic lens, a beam splitter and corrective filter is made in a single optical device.

4. The panoramic device monitoring according to claim 1, characterized in that the sensor of the second sensor CTS television camera is made on the basis of the CCD image sensor with per line the nose", and the summation of the charge packets accumulated during the frame in the photosensitive elements of the target of the photodetector is in a shielded light from the vertical CCD registers of the target.