Device for organisation of 3d user interface. RU patent 2514086.

FIELD: measurement equipment.

SUBSTANCE: invention relates to equipment of optic-electronic measurement systems and devices of information input into calculation devices and systems. The device comprises optically coupled first and second emitters, "surface of shadow location", a television camera and a calculation device, besides, the emitters generate light beams with different spectral maxima γ₁ and γ₂, and the television camera has appropriate separate spectral channels for reception of these emissions, at the same time coordinates of half-shadows generated from a finger of a man operator located on the way of these light beams, are input into the calculation device, which by their values calculates its spatial position.

EFFECT: increased efficiency of a device.

2 cl, 4 dwg

The invention relates to the technique for optical-electronic measurement systems and devices of input of the information in the computing devices and systems. It can be used in informational and payment terminals for organization of new types of interaction with their software software, to facilitate the design during the three-dimensional manipulation of objects in the computer-aided design (CAD) and other interactive and passive systems.

The number of known devices of similar applications. This, for example, the device company 3Dconnexion [1, 2] which represents an opto-mechanical systems of three-dimensional positioning, with a ball or a joystick. They are designed for CAD applications or in applications that require control move anything in the virtual space (for example, Google Earth, 3ds Max, Autodesk Inventor, Kompas-3D, and the like). The obvious disadvantage of this system is the need for physical contact with the joystick.

From contactless optical-electronic systems of similar purpose a device proposed by Apple [3]. This appliance contains a laser, which with 2 mobile, optical associated mirrors scans workspace, which can be located fingers of the human operator. Reflected from these fingers optical radiation falls on the sensor, the output of which is connected to the input of the phase detector. Output of the phase detector is proportional to the phase shift between the signal that modulates the laser beam amplitude, and the output signal of a sensor. Thus, as a result of scanning workspace, you can obtain a set of distances to the illuminated dots on the fingers of a human operator. This information is further used for imaging fingers and displayed on the monitor screen. A computer device that determines the points of agreement the position of the fingers in the working area with coordinates of virtual objects, interact human operator. The disadvantage of this device is its complexity associated with the need to measure small phase shifts and the existence of a manual scan.

The closest to the technical implementation claimed is "the Device for three-dimensional manipulation" [4]. This device contains the first and second emitters, the surface of the diffuse scattering of the incident radiation, and optically coupled with these emitters and hereinafter called "the surface of the shadow locations, which in turn fall light streams from the first and second emitter. In addition, the device includes a TV camera view area which is optically coupled with her "surface shadow location". The working area of the device is formed by the intersection of cones of distribution of streams of radiation incident on the surface of the shadow location" from the first and second emitters. However with the introduction of a finger operator in the work area on "surface shadow locations" are formed in turn, signals computing device Manager inclusion emitters, two shadows. Their images with the aid of television cameras are entered in a computing device that can identify the spatial coordinates of the finger and the angles of slope. This information is then entered into the computer that is connected to this unit.

The disadvantage of this device is a low speed, connected with successive formation of shadows from two sources of radiation and simultaneous with this the process of entering into a computer device values of video signals separately when the first and second emitters.

The aim of the invention is to increase speed and simplification of the device.

To do this in the known device that contains the first and second emitters, optically coupled with them "surface shadow location", made in the form of diffuse scattering of the incident radiation the surface of the television camera field of view which is the "surface of the shadow location", and computing device on which input signals are being input from the output of the television cameras, the above-mentioned first and second radiators are designed so that form the light streams interval 1 and 2 & psi with different spectral maxima γ 1 and g 2 , and the TV camera should be at least dvuhstadialnoj (color), with the value γ 1 can be one, and γ2 another range of spectral sensitivity television cameras. When in the working area of the finger operator on the surfaces of the shadow location" formation of two partial shade, first, due to the absence of the light flux from the first emitter, the second, with the absence of the light flux from the second emitter. In computing device entered images of the surface of the shadow location", in two spectral ranges television cameras and next are the boundaries of both twilight, which are determined by the spatial coordinates of the finger operator.

Figure 1 shows the functional diagram of the device,

where 1, 2 - the first and second emitters forming the light streams interval 1 & psi and 2 with wavelength γ 1 and g 2 respectively;

3 - television camera with angle f;

4 - computing device;

5 - "the surface of the shadow location";

The device operates in the following way.

Emitters 1 and 2 represent a sufficient approximation of point sources of radiation, such as high-power LEDs red and green color ranges, and their optical axes must pass through the "surface shadow location". To their radiation is most effectively used, i.e. does not go beyond the "surface shadow location", they can be supplied with the focusing optics. These emitters create two radiation flux & psi 1 & psi and 2 with a maximum in the spectrum γ 1 and g 2 , in particular for the red and green LEDs their values are equal 620-630 nm [5] and 520-530 nm [6], respectively.

Reflected from the surface of the shadow location" light & Phi; 1 (a partial reflection of the thread 1 & psi ) and j 2 (partial reflection flow 2 & psi ) is a television camera 3, which is a standard camera color image output signals RGB (red, green, and blue components of brightness) in analogue or digital form and coming next on entrance computing devices 4. The working area of the device is formed by the intersection of cones of distribution flows interval 1 and 2 & psi , falling on the surface of the "shadow location" 5. In case of occurrence in the workspace finger human operator on the surfaces of the shadow location" formation of two partial shade.

This is displayed by the optical and geometric diagram shown in figure 2,

Where 6, 7 - partial shade, formed at the surface of the shadow location".

8 - lens of a television camera;

9 - the photodetector matrix in the composition of television cameras 3;

10, 11 - image penumbra 6 and 7, respectively;

12 - brush of the human operator.

Image surface shadow location" on the photodetector matrix 9 has the following features:

- in region 10 are missing the spectral luminous flux generated by the emitter 1 and present the spectral luminous flux generated emitter 2;

- in the field of 11 missing the spectral luminous flux generated by the emitter 2 and present the spectral luminous flux generated by the emitter 1;

- on the rest of the image surface shadow location" there are light flows generated by as the emitter 1 and emitter 2.

Thus, if 1 emitter is a red led and the second emitter green led, video, television cameras 3 areas 10 and 11 can be detected based on the following rules:

found region 10;

found region 11

where R(t) and G(t) are the current values of color R G components of the video signal;

- threshold level of noise components of the video signal (peak spurious blown highlights) in the spectral ranges R and G picture "of the surface shadow location";

- threshold level of useful values of the video signal (the minimum value of the useful signal) in the spectral ranges R and G picture "of the surface shadow location";

Calculation formulas, which allows to determine the spatial coordinates of the finger human operator, can be derived on the basis of a geometric diagram, shown in figure 3,

where I 1 (x I1 ,y I1 ,z, I1 ) - coordinates of the optical center of the first emitter;

I 2 (x I2 ,y I2 ,z I2 ) - coordinates optical center of the second emitter;

5 - "the surface of the shadow location";

6,7 - penumbra;

a, b - specific points that belong to the surface of the finger human operator (the tip of your finger and any points distant from the tip of a finger, respectively);

0XYZ is a basic system of coordinates;

1 (a1 x ,y A1 ,0) - coordinates of the projection of a point on a plane 0XY, and projecting straight out from the optical center of the first emitter;

2 (x a2 ,A2 y ,0) - coordinates of the projection of a point on a plane 0XY, and projecting straight out from the optical center of the second emitter;

b 1 (x b1 ,b1 y ,0) - coordinates of the projection of the point b on the plane 0XY, and projecting straight out from the optical center of the first emitter;

b 2 (x b2 ,y b2 ,0) - coordinates of the projection of the point b on the plane 0XY, and projecting straight out from the optical center of the second driver.

The coordinates of the points and

2 , b 1 , b 2 can be derived from the values of the coordinates of their images on the surface of the photodetector 9, multiplied by the value of a linear increase of the optical system [7].

The equation of a straight line passing through 2 preset points (X 1 ,Y 1 ,Z 1 ) and (X 2 ,Y 2 ,Z 2 ) has the form [8]:

And can be presented in the form of systems:

Turning to used in the text values of the coordinates I 1 , I 2 , and

2 , b 1 , b 2 , we obtain the following (override) the system of equations.

For the first point:

Point b:

Systems solutions, 4 and 5 about unknown x a , y, a , z, a, x , b, y, b , z b gives the coordinates of the points a and b in the system OXYZ.

Direction cosines of the vector passing through points a and B, can be obtained from formula[6]:

In the second version of this unit, the surface of the shadow location" is an optically transparent, diffuse scattering radiation material (for example, frosted glass). While TV camera 3 is located under the surface of the shadow location", and optical associated with the surface, as shown in figure 4, and registers radiation falling on it.

The computing device can be made on the basis of performance processor-oriented stream processing of video information, such as type TMS320DM8148 based on DaVinci technology [9]. In addition, in the case of a television camera has a standard USB interface, it can be connected directly to a personal computer, on which will be implemented calculation of the spatial position.

Literature

1. http://www.3dconnexion.com/

2. US patent # 8063883 B2 from 22 November 2011

3. US patent # 8018579 1 September 13, 2011

4. RF patent №2362216 from 12.05.2008, (prototype).

5. http://www.transistor.ru/pdf/arlight/powerleds/ARPL Emitter 3W-RED-140-RER3E.pdf.

6. http://www.transistor.ru/pdf/arlight/powerleds/ARPL_Emitter-3 W-GREEN-140-GNH3E.pdf.

7. Reference designer optical-mechanical devices. Under the General Ed. Century A. Panov. Leningrad, engineering, 1980,

8. M. I. Profitable. A Handbook for higher mathematics. Moscow, ACT, 2006

9. http://www.ti.com/lsds/ti/dsp/platform/davinci/device.page.

1. The device for the organization of a three-dimensional user interface, containing an optically conjugate first and second radiators, TV camera and surface shadow location"and computing device, the input of which is connected with the release of television cameras, wherein the first and second emitters form of luminous flux falling on a surface shadow location" with the distinguished spectral maxima γ 1 and g 2 , and the TV camera has the appropriate individual spectral channels for the admission of these emissions, with images shades on the surface of the shadow location", formed by the thumb of the human operator in the path of both the light streams recorded television camera and is entered in a computing device that by the values of the coordinates of these twilight calculated spatial position of the finger.

2. The device of claim 1, characterized in that "surface shadow location" performed optically transparent, diffuse scattering radiation, while the first and second emitters are on one and the TV camera on the other side of this surface.