Device and method for automated control of situation in auditoriums

FIELD: technical systems for provision of safety and automated monitoring, in particular, systems for automated control of situation in auditoriums.

SUBSTANCE: in accordance to invention at least one video camera is mounted in auditorium for producing image of auditorium, and at least one computer with memory, interconnected via a local area network, while in memory of computer a database is generated, storing data, reflecting filling of auditorium, in accordance to sold tickets, and computer can process video signal received from video camera for producing data about filling of auditorium with possible storage of these data in memory for following analysis, and also with possible comparison of produced data to data stored in database and with possible generation of signal of disruption of set mode in case if mismatch of data being compared exceeds the predetermined threshold value.

EFFECT: increased efficiency of control and statistical counting of access of viewers to auditorium.

2 cl, 2 dwg

The technical field

The present invention relates to the field of technical security systems and automated monitoring and, more specifically, relates to devices and method for automated control of the situation in auditoriums.

The level of technology

The prior art automated (hardware and software) systems and methods of security and monitoring of various objects. Most often these systems are used for security and monitoring of the protected premises or area, in particular to monitor the movement and presence in this area of mobile objects, in particular of people and cars. Known systems use video cameras, combined with the means of videos. Overall control of the situation in the room is usually performed by the operator, or automatically received by the video camera with the help of hardware and software is compared with predetermined "disturbing" video with the option to generate an alarm if there is a match.

Also, the prior art automated systems for access control and accounting of the number of people in the room. Such systems rely on the automated reading of passes (tickets or Gitano is) when passing people in a controlled area. Reading carried out by using a computer system with the appropriate electronic reading device, examples of such systems are automated transmission system, mounted on plants (e.g., Siemens), and automated filling Parking areas, taking into account the number entered and left the car and automatically alert the overflow Parking.

For example, from the patent of the Russian Federation 2231123 known surveillance and monitoring premises containing serially connected TV camera, a scheme of automatic alarm about the presence of a moving object in a field of view of a TV camera and video device (ICD). The circuit composition of an automatic alarm system includes a generator strobe moved by the operator on the screen internals in the area of increased interest. The video signals of two consecutive frames allocated using the strobe, wind up in the appropriate storage device (memory) and compared by the comparator. When the difference exceeds the threshold, are included alarm indicator and a recorder for recording a television signal. A TV camera is a tool of the same purposes as the sensor of a television signal, the circuit of the automatic alarm system is equivalent to the set of blocks comprising a selector with which nhamoinesu, shaper signal frame and the motion detector; internals equivalent visual display unit. This system does not effectively control the room with a fairly large number of objects subject to control. There is no possibility of collection of statistical data on the controlled object and the mobile object.

Known from the patent of the Russian Federation 2137203 control system for the movement of vehicles, which includes a mobile control point, a number of stationary control zones, each of which represents a notional rectangle covering a particular local section of the road, switching devices installed near the road at a specified distance from the specified rectangle. In each control area installed video cameras, lamps, separator strips and driving directions. The system also includes a hardware-software system installed on a mobile checkpoint. The complex includes computers identify the vehicles through which the switching devices are connected at certain times of the video, the server for management and search of vehicles in the database, a local area network, video surveillance system, connected to the camcorder via a switching device, the system is mu telephone, the system of telecommunications. This system allows a certain margin of error to identify a separate mobile search objects in controlled areas and to register them. Limitations of this system are limited controlled zones (camera fixed and have a limited viewing angle), static cameras. In addition, this system does not provide the possibility of high-precision automated recognition of the situation in the control zone. There is no duplication of the work of individual elements of the system, therefore, the detection accuracy is limited. There is no possibility of preserving the memory system crisp images for subsequent analysis. There is no possibility of collection of statistical data on the controlled object and the mobile object.

Known from the patent of the Russian Federation 2196358 alarm system and fleet management, monitoring of moving objects and their movements in real time, the protection of stationary and mobile objects, as well as environmental monitoring. The system contains is made with the possibility of communication dispatch center and the equipment of the consumer, containing on-Board computer, interface, processor, analog-to-digital video Converter, a storage device, the digital to the tax Converter audio video Converter, a group of security sensors, keyboard, modem, camera video, audio, television monitor, self-contained power unit. Control station includes a computer differential correction of the coordinates of the observed object, the control server protected objects, computers, communications, computer network, modems, transceivers with antennas, power supply unit, the setpoint generators, buzzer, Executive block doors, signal marker lamp. This system allows you to monitor protected area by receiving and processing signals from the sensors, and camcorders. Possible duplication of sensors and video cameras to enhance recognition accuracy. You cannot save and image analysis of protected objects with high accuracy. There is no possibility of collection of statistical data on the controlled object and the mobile object.

Known from the prior art system of video monitoring allows you to monitor a specific area and its mobile objects with a certain accuracy. Known access control system in the room allow you to control and account access mobile objects in space, but does not allow you to effectively monitor and promptly respond to cell volume is tov indoors. However, in some cases it is necessary to implement both effective control and statistical account of people's access to the premises and monitor for their presence within the space. Particularly acute this problem is in large multiplex cinemas, otherwise called cineplexes or multiplexes. This is because in such complexes, the number of staff, including providing security, relatively small compared to the number of viewers that increases the risk of emergency situations and hampers their rapid elimination. Also found that losses from unauthorized visit to the cinema (without a ticket) can be a substantial amount.

The invention

The present invention is a technical problem to create such a system or a device and method for automated access control and environment in auditoriums, which would ensure effective control and statistical records access spectators in the auditorium and would allow us to monitor the atmosphere in the auditorium with the ability to quickly and reliably respond to emergency situations.

The mentioned technical problem is solved due to the fact that the proposed system or device avtomatizirov the frame of the access control and the situation in the auditorium, containing at least one installed in the auditorium of the camera, adapted to obtain an image of the auditorium, and at least one computing device with memory, connected via a local area network, and in accordance with the present invention in the memory of the computing device, a database that stores data reflecting the filling of the auditorium according to the sold tickets, and a computing device adapted to process the received video signal to obtain data about filling the auditorium with the ability to store this data in memory for subsequent analysis, with the possibility to compare the received data with data stored in database, and with the option to generate a signal violation of the established mode in case of discrepancy of data that can be compared by more than a predefined threshold value.

Preferably the device further comprises at least one video camera to ensure effective coverage of the entire space of the hall with the possibility of duplication of the video signal. Preferably, a local area network adapted to transfer video from the camcorder to a computing device without interference to electronic equipment of the hall.

Preferably the device comprises at least one movable camera made with the possibility of targeting and obtaining a target image, suitable for further analysis by the operator. Mobile video is made to rotate in a vertical and horizontal plane and/or change the focal length, and/or change the aperture and/or settings on the focus to ensure targeting.

Primarily, the device contains a hardware-software interface for communication with the operator.

Preferably, as a computing device with memory used by a personal computer or a server, and the server is adapted to process up to 4 video streams. If the device according to the present invention includes more than 4 cameras, it additionally includes, at m is re, one additional computing device connected to the local area network and coupled with the aforementioned computing device. The device according to the present invention includes also implemented on software and hardware device data accumulation sold tickets, adapted to transmit the data stored in the database, formed in memory of a computing device. The device according to the present invention may also contain device control input of the audience, representing the mean of the automated reading of the ticket, adapted to bring the audience into the auditorium in case of any proper ticket, and commit to memory the past number of viewers in accordance with the submitted their tickets. The device control input of the audience is preferably implemented on a computer system, a barcode reader, which is applied at the box office for a ticket.

The technical problem solved also due to the fact that a method of automated access control and environment in the auditorium, including the stages at which a hall set the camcorder with the ability to obtain images of the auditorium, connect the camcorder using the local network with calc is tion device with memory, moreover, according to the present invention, receive data on sold tickets to the hall and record these data in the database generated in the computer's memory, periodically using the video camera to receive the image of the auditorium, process the image on a computing device in order to obtain data suitable for comparison with the data on sold tickets, store this information in memory of the computing device, comparing the received data with the data on sold tickets and make a conclusion about the violation mode in case of discrepancies between the compared data by more than a predefined memory of the computing device threshold value.

Preferably in the memory of the computing device writes data characterizing abnormal situations, including smoke, fire, crowd, and a computing device adapted to process the received video signal to generate the data about the situation in the auditorium and comparing these data with data characterizing abnormal situations, with the ability to give the alarm in case of coincidence of the compared data.

Preferably use at least one additional camera to ensure effective coverage of the entire space of the hall with the possibility of duplication of the video is.

Preferably in the method according to the present invention is used optionally, at least one movable camera made with the possibility of targeting and obtaining a target image, suitable for further analysis by the operator, and use the camcorder, is made with a possibility of rotation in the vertical and horizontal plane and/or change the focal length, and/or change the aperture and/or settings on the focus to ensure targeting.

Detailed description of the invention

The present invention will be clear to the specialist from the following more detailed description of a particular non-limiting example of implementation, with reference to the figures of drawings, on which:

figure 1 depicts a General diagram of a specific example of implementation of the device according to the present invention;

figure 2 depicts a General functional diagram of a method in accordance with the specific example of implementation of the present invention.

The device and method according to the present invention are implemented, in particular, in a particular system of control rooms (hereafter RMS), the structure and operation of which are described in volume, sufficient for its implementation specialist in this field.

VHC is a hardware-software complex intended for monitoring the attendance of spectators, and tangela support services to ensure public order and security in large cinemas, otherwise called cineplexes or multiplexes.

Depicted schematically in figure 1 a non-limiting example of implementation of a system or device according to the present invention is intended for use in the cinema with two auditoriums. Control of the situation in auditoriums 1 and 2 cinema exercise device comprising four high-sensitivity video camera 3, 4, 5 and 6, placed respectively at two in each room and installed with the possibility of effective coverage of the entire auditorium with software duplication. Video camera electrically connected through the interface connected to the server 7, intended for processing video streams coming from these cameras. Server 7 is connected electrically with the computer 8 implementing the interface with the operator. Server 7 is also connected electrically with the computer 9 of the cinema ticket, in which is formed a database of sold out tickets. The server 7, the computer 8 and the computer 9 offices are connected through a local network, via the interface connected to the video camera 3, 4, 5 and 6. The cameras installed capture card video image (not shown in figure 1).

The system works as follows. Data on the number sold at specific sessions tickets generated in the database are transferred via LAN from the computer 9 service CI is teatra (most modern screens with computer ticketing system) to the server 7. Data is transmitted in the form of a database reflecting the filling of specific places in each of the rooms, adapted for operation with a processing algorithm. Conventionally, such a mapping can be represented by a matrix table in which the rows represent the rows of the cinema, and each position in the table - seat. The place that sold the ticket, conventionally represented as 1, the place that the cashier unsold tickets, represented as 0.

Count of audience and control of the situation in the auditorium in real time during a session by using video Analytics installed in cinemas highly sensitive cameras 3, 4, 5 and 6, provides clear playback and with a limited level of light that exists in the halls 1 and 2 at a film. The analysis of the image using a processing programs on the server 7 provide data about which of the seats filled. Perform count and the estimator of cinema. The result of this calculation in server memory 7 system is formed model of the actual filling the auditorium (for example, in the form of a table as a matrix, where rows correspond to rows of the cinema, and each item place, while the 1 - position filled, 0 - space is free). By comparing the received real model and generated according to p is obtained from the computer 9 of the cinema ticket (for example, performed in software in the form of arithmetic operations with matrices), receive data between actual filling with data on the tickets sold.

As a high-sensitive cameras that are necessary for use in low light conditions during a session, can be used as a color video camera (e.g., WAT-220, represented on the Russian market the company Watec), black-and-white video camera (e.g., WAT-902H, firms Watec), infrared camera (for example, TVC200ML, F. The NRI "Electron"), termovizory camera (for example, TV-04 CRP, F. NTPP "NICTP").

In halls 1 and 2, in General, can be installed not four, but a different number and combination of the above cameras, depending on the specific needs of users, devices, and environments. Cameras can be installed with software duplication each other and overlap zones of control to ensure high reliability of the device. The camera is electrically connected through the interface (for example, composite video, or Ethernet) with the computing device implemented on the server. The server is connected to a personal computer that provides an interface with the operator.

In General, the computing device may be implemented as a specialized computing devices (such as the er, industrial computer-based modules standard PC-104 CPU "multicore") or based on universal personal computer (e.g., processor Intel Pentium"), equipped with software that allows you to get and put in digital form information from the camera and remember the information in the database.

For more complex systems covered by this application, characterized by the use of additional cameras for a more detailed analysis of the situation in the hall. In the case of use of the mobile camera (for example, WV-CS854 F. Panasonic or more sensitive analogues on the market) to get a rough image of some object computing device electrically connected through the interface (such as RS-485) with a moving camera, and the computing device is adapted to control the mobile camera via the serial communication channel through the use of, for example, a typical software. The mobile camera is used to obtain a detailed enlarged image of objectives used for additional recognition objectives or detailed tracking on demand of the operator of the system, connected to it via the hardware-software interface (n is an example, implemented on a personal computer with a monitor). The operator has the ability to collect data, and manage the operation of the mobile camera through a keyboard or other specialized interface type man-computer (e.g., joystick).

It is also possible automated analysis of the situation in the cinema by means of a special algorithm built into the system. In particular, this is achieved by implementing the following algorithm: receive one large video of the auditorium with the first chamber, his analysis in the computer for the detection of alarm conditions in the room (by comparison with models of alarm conditions stored in the computer's memory) and coordinates of the places where there is a worrying situation, and guidance on this location of the mobile camera (second camera) with a variable focal length to obtain an enlarged image of an alarm situation for further analysis (for example, by the operator or programmatically) and saved in the system memory.

If the system is designed to work in the cinema with the number of rooms is greater than one, each movie is set a few cameras. The upper limit on the number of installed cameras and their technical characteristics (resolution, sensitive the TB etc) are limited to desired system cost (price cameras), and the lower limit for this part of the hardware is determined by the following conditions: overlap of cinema should be complete, possible points of fastening of the cameras are located on the side walls or on the ceiling and agreed beforehand in accordance with the layout of the seats in the hall, when image processing is one chair occupied by the viewer, should be at least 30 pixels wide on the frame resolution of 720×576. The same restrictions apply when choosing the focal length of the lenses of the cameras.

For signal transmission from the camera to the computing platforms used any well-known specialist in this field channel of communication, not affected by external interference cinema and not preventing its interference equipment for cinema. This should take into account the power and frequency characteristics of the e-film screening room and sound equipment to eliminate crosstalk and interference that can be achieved by the choice of the communication channel, and due to the installation of lines at a sufficient distance from the corresponding equipment of the cinema.

The video capture and conversion is capture cards (for example, on the market model cards capture bt-878). For this system with different efficiency fit almost any device zahwah the and video available on the market.

As a computing device, use a standard computing platform (server), intended for use with video applications such. The typical server on the market currently can handle up to 4 video streams simultaneously, so if the movie has more than 4 cameras, the control of the situation it carry out more than one server. When this is done the orchestration server well-known specialist ways to support parallel processing streams. To servers on the local network, in addition to the computer that provides an interface with the operator, can be connected workstations (for example, implemented on personal computers), which can be run of the application for withdrawal is received and processed by the system data (data about the real number of the people in the audience and their location in the auditorium, video (General plan and the enhanced plan separate places, archival records from the system memory).

Processing of the received camera image (video signal) is carried out at the computing device (computing platform)that meets certain requirements for the speed of operations. In particular, the processing speed must ensure that the prob is the possibility of comparing the data mode, near real-time. Other indicators of computing platforms is chosen based on the desired application (e.g., types of presenting information to users, and retention of data - graphical and statistical applications).

As a computing device with memory used by a personal computer or a server, and the server is adapted to process up to 4 video streams. If the device according to the present invention includes more than 4 cameras, it additionally includes at least one additional computing device connected to the local area network and coupled with the aforementioned computing device. Through the use of data processing algorithms it is possible to implement a server that can process up to 6 streams (due to this, you can save the number of servers), however, preferred for modern hardware is processing mode up to 4 video streams.

Counting the number of spectators in cinemas in accordance with the session, the formation of the array data, save the data in a format suitable for statistical analysis and its comparison with data on sold tickets can be done in different ways.

For example, each session is done a series of videos and dimensions number of viewers. Each dimension number of viewers occurs over time at certain points in time, relative to the beginning of each session, in accordance with the set configuration. This approach allows to obtain statistically reliable data and to minimize the statistical error. Before the start of the working day, the VHC system, automatic request through the information system cinemas (multiplex), receives the schedule of sessions for each hall, which will be determined by the beginning of the measuring cycles and their end. During the working day, the VHC system periodically sends requests to confirm the correctness of the schedule, to insure against situations of cancellation or postponement of the session. Program ticket service and system RMS operate synchronously, the time difference between servers that are running these systems should not exceed 5 seconds to ensure operation in near real time.

When you measure the number of viewers is also the formation of pictures just of the auditorium at the time of measurement with indication of the date, time, names of cinema, hall rooms, the estimated number of viewers. Recognition of the fact that the filling is known from the field of engineering methods. MC is connected above the lower limits of the requirements for the video cameras allow you to exclude a read error. Converting the data signal to each of the cameras, as well as comparing data from the cameras installed with redundancy, the system receives data about filling in cinema at the moment. In fact, the system matches the fact of filling each space, generates this data and stores in memory a table showing the filling, similar to the above described table data on sold tickets (1 - filled space, 0 free). This approach allows you to easily compare the data on the tickets sold and the actual data to fill seats. This should take into account the possibility of transplantation of the audience from place to place and temporary absence (the exit from the hall at the time). Comparison of data should take into account such facts as allowable systematic error of measurement. Asked level, above which is the basis for alarm "violation"should be considered bias. Inappropriate is set too low the threshold.

These quantitative data and pictures are stored in the database in the cinema, for example, within 6 months (this value is configurable) if there is sufficient disk space. Possibly longer be deposited in a special additional memory devices (tape memory, and so on).

The system is nedosmotrel interface view quantitative data and photos places can be viewed from remote computers.

Data on the maximum number of spectators attending each session, are exported in the ticketing system for archiving and reporting.

Video in auditoriums, video recording rooms in the files, the ability to view images from each camera in real time and record (glued). The video is produced in native format VHC and available for viewing on any computer where you installed the client application VHC.

Since the filming of each of the hall are several cameras on sites, is "bonding" individual images and video surveillance is reproduced in its entirety. Guaranteed frame rate for such entry shall not be less than 1 frame per 5 seconds. In one frame gluing shown: the venue, date, time, estimated number of spectators (figure). Archive video data based on the ring principle and stores data for 3-4 weeks if there is enough space on the disk.

Raising the alarm in case of abnormal situations. The list of contingencies:

- the number of spectators in the hall, exceeding the number of tickets sold, more than the given value N.

- situations of violation of public order and fire safety in the halls (fighting, Smoking, wonderlane,the presence of foreign objects after the end of the session, and so on).

Setting up the system operation on the specified alarm situation is due to the use of computing platforms and software. This specific alarming situation presented in the form of specialized routines that stores pre-recorded data, access to which is by comparison of the received signal. For example, wonderlane represented in the form of changes in the indices of brightness in the area of a defined area on an information model of the hall. The fight is presented in the form of intensive movement of mobile objects (defined as the number of units of movement for controlling the time) in a specific zone information model of the hall.

In the particular case of implementation of the present invention for the simplest system consisting of one room and a minimum number of cameras covering his image this room, a computing platform may be implemented on universal personal computer with processor Intel Pentium", Operational storage capacity of 32 MB and a hard disk with a capacity of 20 MB. On this personal computer hosts the database and terminal monitoring results analysis and management system. The computer in accordance with the software-based operational with the system "Windows" converts analog composite video signal, received from cameras in digital form and performs image processing, and it performs the following steps: analyzing the background, detects the target, produces recognition purposes and situations, defines the parameters of the objectives, their coordinates, and stores the motion path, transmits the recognition result to the database, tying the event to the time records the video signal in a compressed or raw form in the computer memory in the form of files, the address of which is located in the database, thus the video signal is associated with events whose information is in the database are given, compares the signal with pre-recorded data that reflect the alarming situation.

Developed system software for scalable and provides the possibility of control in the multiplexes, which have an arbitrary number of cinemas with an arbitrary number of seats in each.

In the General case, the method according to the present invention includes, as shown in figure 2, the following steps (if coming from outside the system video signal, the control commands and information about the audience):

- getting video signal from cameras to capture card (YUY2) video installed on a personal computer

the processing flow of images (counting spectators and other functions),

- motobravo the ka data recognition,

- interaction with the information system of the cinema, and work with your database

record in the archive,

Work with client interface (using the archive, displaying the current video settings),

- remove archive cycle, and redundancy in managing backup settings and control algorithm).

Software used in the system, and its underlying algorithms for video processing are resistant to sudden changes in illumination in the cinema.

Industrial applicability

The present invention allows effective monitoring of the situation in the auditorium. This solved the problem of counting and control the actual number of viewers and their location, warning and timely response for alarming situations in the hall are important but not the only purpose of the invention. In the framework of the present invention are solved and other practical tasks automation multiplex cinemas, which are relevant to the present.

1. The device of the automated access control and environment in the auditorium containing at least one installed in the auditorium of the camera, adapted to obtain an image of the auditorium, and at least one vychislitelnykhsistem memory, connected through a local area network, and in accordance with the present invention in the memory of the computing device, a database that stores data reflecting the filling of the auditorium according to the sold tickets, and a computing device adapted to process the received video signal to obtain data about filling the auditorium with the ability to store this data in memory for subsequent analysis, with the possibility to compare the received data with data stored in the database, and with the option to generate a signal violation of the established mode in case of discrepancy of data that can be compared by more than a predefined threshold value.

2. The device according to claim 1, characterized in that it further comprises at least one video camera to ensure effective coverage of the entire space of the hall with the possibility of duplication of the video.

3. The device according to claim 1, wherein the local area network adapted to transfer video from the camcorder to a computing device without interference to electronic equipment of the hall.

4. The device according to claim 1, characterized in that in the memory of the computing device, the recorded data characterizing abnormal situations, including smoke, after the R, the crowd of people, and a computing device adapted to process the received video signal to generate the data about the situation in the auditorium and comparing these data with data characterizing abnormal situations, with the ability to give the alarm in case of coincidence of the compared data.

5. The device according to claim 1, characterized in that it contains at least one mobile video, made with the possibility of targeting and obtaining a target image, suitable for further analysis by the operator, and mobile video made with the possibility of rotation in the vertical and horizontal planes, and/or change the focal length, and/or change the aperture and/or settings on the focus to ensure targeting.

6. The device according to claim 1, characterized in that it contains the hardware-software interface for communication with the operator.

7. The device according to claim 1, characterized in that as a computing device with memory used personal computer.

8. The device according to claim 1, characterized in that as a computing device with memory used by the server, and the server is adapted to process up to 4 video streams.

9. The device according to claim 1, characterized in that it further includes a data accumulation device on selling the different tickets, adapted to transmit the data stored in the database, formed in memory of a computing device.

10. The device according to claim 1, characterized in that it further comprises a device control input of the audience, representing the mean of the automated reading of the ticket, adapted to bring the audience into the auditorium in case of any proper ticket, and commit to memory the past number of viewers in accordance with the submitted their tickets.

11. The device according to claim 10, characterized in that the control device for the input of the audience is implemented on the computer system reads the bar code, which is applied at the box office for a ticket.

12. Method for automated access control and environment in the auditorium, including the stages at which a hall set the camcorder with the ability to obtain images of the auditorium, connect the camcorder using the local network with the computing device memory, and according to the present invention receives data on sold tickets to the hall and record these data in the database generated in the computer's memory, periodically using the video camera to receive the image of the auditorium, process the image on a computing device in order to obtain data on the form used to request the attachment of the auditorium, store this information in memory of the computing device, comparing the received data with the data on sold tickets and make a conclusion about the violation mode in case of discrepancies between the compared data by more than a predefined memory of the computing device threshold value.

13. The method according to item 12, characterized in that in the memory of the computing device writes data characterizing abnormal situations, including smoke, fire, crowd, and a computing device adapted to process the received video signal to generate the data about the situation in the auditorium and comparing these data with data characterizing abnormal situations, with the ability to give the alarm in case of coincidence of the compared data.

14. The method according to item 12, wherein using at least one additional camera to ensure effective coverage of the entire space of the hall with the possibility of duplication of the video.

15. The method according to item 12, characterized in that use is additionally at least one mobile video, made with the possibility of targeting and obtaining a target image, suitable for further analysis by the operator, and use the camcorder, is made with a possibility of rotation in the vertical and horizontal is th planes, and/or change the focal length and/or aperture change and/or settings on the focus to ensure targeting.