Apparatus for partial substitution of speaking and hearing functions

FIELD: medical technique for rehabilitation of individuals with limited health capabilities, including elderly people, for creating special means allowing individuals with health disorders such as speech disorders including dyslalia, aphonia, rhinolalia, dysarthria, stammering etc, deafness, limited excursion, combined disorders etc to perform communication actions through telephone and radio communication means.

SUBSTANCE: apparatus has complex of devices operating in coordinated manner and connected with one another through bidirectional multiple-discharge (wireless) busbars: device for outer (wireless) interference with telephone line, mobile device for partial substitution of speaking and hearing functions, set of outer information sensors. Apparatus enables verbal communication between individuals and the people of their circle, transmitting and receiving of needed messages and commands through telephone and radio communication means.

EFFECT: wider operational capabilities, improved ergonomics and safety for users.

7 cl, 4 dwg

The invention relates to medical equipment, namely to the technical means of rehabilitation of persons with disabilities, persons with disabilities on health, including the elderly, and is intended to create specialized hardware that allows people with disabilities to health, such as speech (dyslalia, aphonia, rinolaliya, dysarthria, stuttering, and other), deafness, limited mobility, joint disorders, and others, to carry out communication actions, verbal to communicate with others, to send and receive messages and commands using the telephone and radio communications. Device using appropriate technical means generates the required voice message and other situational necessary for exchanging information signals, and also performs the recognition of sounds and speech.

The invention will create technical devices, greatly enhancing the independence and autonomy appropriate contingent of persons with disabilities on health, which will find wide application in everyday life, professional and educational activities in the structures of health and social protection.

From the above it follows that the creation of a modern device partial replacement of the functions of speech and hearing you considered the ü current technical and social challenge.

A device RU # 2190380 C2 "Method of communication to people with hearing loss and speech using the telephone network and the device for its implementation", containing two information channels for the communication of individuals with disorders of speech and hearing, use the phone. The first channel is receiving contains electro-acoustic transducer, amplifier, limiter, electro-optical Converter, the light display; a second channel - transmitter - contains electro-acoustic transducer, generator, crane, self-contained power source and the inverter call. The thunk call generates optical signals analog audio beeps. The device allows you to send the phone line informational messages by Morse code, as adopted by the adoptive telephone tone signals to convert the sequence of light pulses.

The main drawback of the patented device is its low functionality, and methods of solving these tasks require special training and skills, do not have the necessary level of ergonomics. In addition, the use of this device is difficult when dealing with people, not suffering from impaired hearing and speech.

Known patent RU No. 2197749 C2 "Device information exchange between deafblind. sabreena refers to the means of communication between the deaf and blind, deaf and dumb and sighted people and can be applied in cases where the exchange of information by other known methods impossible. The device interfacing with the transceiver (usually normal and the phone) and transmits information in the form of tactile signals generated by electric current in the receiving part of the dial-up connection.

The disadvantages of the device include the presence of serious physiological and ergonomic limitations to the application, as well as its low functionality.

Also known patent EP 0446856 A2 "Sound output electronic apparatus", which describes a device comprising means enter information in the form of a keyboard, with certain combinations of keystrokes corresponds to the characters of the Braille alphabet, as well as the memory block for writing the data entered using the keyboard, and a memory unit for recording audio signals intended for the subsequent generation. Entered using the keyboard information is recognized by the unit of comparison, determining the line of characters, the characters written in the internal memory of the library device. The coincidence of characters is generated corresponding to the recorded character of the sound (speech) equivalent. The disadvantages of the devices can be attributed to its poor functionality, the duration of the input required inform the tion, as well as the inability to use standard means of communication, such as, for example, the telephone.

A device EP 0533055 B1 Communication apparatus for hearing or speech handicaped person"designed to generate speech sequences, based on information compiled using a special keyboard. The communication device consists of a block of input is made in the form of a keyboard unit of the output device to generate output information in the form of text sequences of different alphabets, words and nonword information control unit. The control unit ensures consistent operation of the system elements, as well as highlighting the key you press on the keyboard. The device includes memory blocks for storing the information entered from the keyboard, and the information recorded originally intended for comparison with the entered information and storage of special programs and addresses. The device includes a block of the input audio information, allowing you to record and store the recorded information to a specified address, if this information is in the audio symbol keyboard characters (letters). The specified device operates as follows: the power is turned on, using the corresponding button set red the necessary operation. Typed using keyboard text after processing and conversion is supplied to plug the printer for printing. This mode is a priority for this device. Its main disadvantages are low functionality, as well as inefficient (low-quality) way of text-to-speech.

Known mobile handheld device, US 4215490 "Braille deaf-Blind communicators that can be used for communication severely disabled people. The device contains a specialized unit tunable (only) Electromechanical symbol Braille, six-button keypad and the control unit. Transmitting the message using the keypad generates cell Braille symbol that can be read tactilely by recipients. The disadvantages of the device can also be attributed to its limited functionality and low speed communication actions using only one touch (tactile) channel.

It is also known device GB 2302476 A "One-handed speech and communication device for the speech-impaired or mute"is selected as a prototype.

Structurally, the device consists of two parts, one of which is in the hand of the user and contains controls - specialized keyboard that consists of 5 buttons. Combination of pressed buttons allow you to generate a 32 character who, which are then reproduced on the display and announced by the speech synthesizer. The device can be connected to telephone, Fax, computer and other devices through special connectors. In this case, can be transmitted not synthesized speech signals and their corresponding numeric codes. The second, larger part of the device contains the power supply, the speech synthesizer and the Converter input code symbols on the display.

Mobile, handheld device, protected by this patent contains a power source; a processor unit (control unit) with appropriate software; remote with a group of buttons for user-generated code (keypad); blocks wired interfacing with external devices (for connection to a telephone, recording equipment or a personal computer), a unit of the led, the coding block led indicator, block a speech synthesizer, a block of sound, and the memory indicator signals led indicator codes prepared words and messages, codes for the transmission of digital information, and the memory block algorithms.

The device has several disadvantages:

- limited range of problems solved by system, the low efficiency of use;

- the complexity of managing ustroystva keyboard consisting of five buttons

- ergonomicznie constructive separation of the device into two blocks connected by a cable,

- no automatic selection of the volume level of the spoken voice,

- limited ability to ensure the safety of the user with disabilities,

- limitations of the display system (only optical and speech) and, as a consequence, the complexity of using the device for different groups of people with disabilities, such as individuals with combined hearing and vision,

- no possibility of rapid changes in the composition of the prepared phrases intended for reading aloud,

- the inability to control the device with "the voice", including a person with unintelligible speech,

- the inability conversion unintelligible speech of the user in a comprehensible verbal voice message

- lack of access to information spoken by the user words and expressions

- no possibility of wireless transmission of data to the external communication devices.

The present invention is directed to solving the following technical tasks:

- empowering communication of persons with various health problems, including with Oceanie disorders

- raising awareness display system,

- improving the safety of the user with significant disabilities,

- improving the ergonomics of the system by designing the device in a single mobile body with a standard keyboard

- increasing the functionality of the device: the formation of an additional service modes, including the introduction of quick replacement of speech and audio signals, the introduction of wireless transmission of information to external devices,

- providing a text display of spoken phrases,

- the ability to recognize and convert unintelligible speech user in discerning the voice message generated by the device.

The implementation of this technical problem will significantly expand the capabilities and safety of persons with disabilities, including persons with various concomitant disorders, will expand the area of effective application of devices such assignments in the areas of special education, and employment.

The solution of this problem is as follows:

the device partial replacement of the functions of speech and hearing, designed primarily to ensure communication and security functions for persons with special needs in health, the particular hearing, vision, speech, mobility, and also with concomitant medical disorders, including

the control unit (DSP unit)connected to a bidirectional data buses

with a chain of series-connected between a multi-bit bidirectional buses block the keyboard and block encoding of the signals keyboard,

with a chain of series-connected between a multi-bit bidirectional busses signal optical indicator and optical indicator

with a chain of series-connected between a multi-bit bidirectional buses block the speech synthesizer and block sound,

unit wired pairing with the phone line, with power contact mating with external digital devices, memory blocks indicative of optical signals, telephone addresses, codes prepared words and references, codes for transmitting digital information, the memory block algorithms of operation of the device; the memory blocks indicative of optical signals, codes prepared words and references, wired pairing with the phone line, wired pairing with the phone line, the codes for the transmission of digital information connected bi-directional data buses, respectively, with the processing unit signals the s optical indicator, unit speech synthesizer, with a block of the speech synthesizer, with power contact pairing the phone with the unit wired interfacing with an external digital devices, and the memory block of telephone addresses connected to the power wire pair telephone line; the memory blocks of codes for transmitting digital information and codes prepared by the words and references connected multi-bit bidirectional buses with signal optical indicator, in this case, all blocks of the device are connected to the appropriate pins of the first power supply.

According to the invention, the device partial replacement of the functions of speech and hearing contains additionally connected to the control unit multi-bit bidirectional buses

circuit connected in series between a multi-bit bidirectional buses block Electromechanical indicator of the Braille alphabet and signal Electromechanical indicator of the Braille alphabet,

- memory block indicative of the characters in the Braille alphabet, while the signal of the Electromechanical indicator of the Braille alphabet is connected bi-directional data buses with a block encoding signals of the keyboard and the signal of the Electromechanical indicator of the Braille alphabet,

- posledovatel is but the United bidirectional multi-digit tire chains: the power of radio and the block decoding signal of the radio receiver; the transmitter unit and the block coding signal transmitter, and the blocks decode the radio signal and encoding the signal transmitter is connected bi-directional data buses with a block of the speech synthesizer,

- blocks of memory addresses of radio and radio broadcasts, United bidirectional data buses respectively with the blocks of the decoding signal of the radio receiver and signal encoding transmitter,

circuit connected in series between a multi-bit bidirectional buses block the microphone unit microphone amplifier with automatic gain control, analog-to-digital conversion unit, automatic noise reduction, block, speech recognition and sounds of the coding block of the recognized audio

blocks to adapt the volume level

- record block/storage/playback audio

- memory block of the recognized characteristics of audio signals,

- memory block service indication signals

when this unit to adapt the volume level of the connected multi-bit bidirectional buses with blocks analog-to-digital conversion and an audible indication,

the record block/storage/playback of audio signals connected multi-bit bidirectional buses with unit and microphone a speech synthesizer, an audible indication, a block encoding of the signals keyboard,

the memory block of the recognized characteristics of the audio signals is connected to a bidirectional data bus to a unit of speech recognition and sounds, and the coding block detected audio signals connected multi-bit bidirectional buses with blocks forming optical signals indicator, signal conditioning Electromechanical indicator Braille, speech synthesizer,

when all the blocks are connected to the appropriate pins of the first power supply

and it also contains an additional set of external sensors, and external wireless device pairing with a wired telephone line connected to the mobile device partial replacement of the functions of speech and hearing multi-bit bidirectional wireless tires.

The invention provides that the external information sensors comprise serially connected bi-directional multi-digit tire sensor unit, processing unit, the signal unit threshold device, block coding signal of the transceiver block transmitter, all units connected to the respective outputs of the second power supply.

The invention provides that the external device interfacing with a wired telephone Lin is it contains a chain of series-connected between a multi-bit bidirectional buses block the radio, the block decoding signal, the unit wired pairing with the phone line. In this case, all blocks connected to the respective outputs of the third power supply.

In a mobile device, partial replacement of the functions of speech and hearing

- the control unit is designed to coordinate the work of all components of the device and perform the necessary programs stored in the memory block algorithms of operation of the device,

- the keypad is designed to set and select the desired messages and signals, and for setting and switching devices

block encoding signals keyboard is designed to convert signals from the keyboard signals, consistent with the work of other parts of the device;

- signal optical display, optical indicator and the memory block indicative of optical signals are used to display textual and symbolic optical information corresponding to the operating modes and content transmitted, received and detected information;

- signal Electromechanical indicator of the Braille alphabet, block Electromechanical indicator of the Braille alphabet and the memory block is indicative of the characters in the Braille alphabet performs functions similar to those of the optical block in the paths described above, but in a different physical modalities,

- block speech synthesizer is designed for the formation of verbal messages in their code designations,

block audible indication is designed to convert electrical signals indicative of the acoustic,

- unit radio, the block decoding signal of the radio receiver and the memory block address of the radio is designed to receive and convert the received signals from the external signal sensor signals, as well as with other sources of information, signals from which are coordinated with the work of the receiving part of the device for further indication of the source of the received signal and, if necessary, the information signal from this source.

- unit radio transmitter, the block encoding transmitter and the memory block address of the radio is designed to transmit a signal to the external alarm sensors, external device interfacing with a wired telephone line or other external device, the reception part configured to receive the transmitted information signals,

- memory block codes for transmission of digital information designed for transfer relevant information to the external device in digital form via the contact block mates with external digital devices or through radio castlestreet,

- memory block codes prepared words and messages intended for the storage and transmission of codes to the speech synthesizer to generate words and messages that are most frequently used by the user

- block wire pair and to the telephone line and the memory block phone addresses are intended for transmission over a telephone channel relevant information to a specified address, including the mode dial,

the microphone unit, the microphone amplifier with automatic gain control, analog-to-digital conversion is designed for receiving digital values of acoustic signals

unit Avtozavodskaya must provide the necessary level of signal/noise ratio required for high-quality speech recognition and sounds,

- block speech recognition/sounds and the memory block of the signs of the recognized words, sounds and messages are intended to recognize the set of acoustic signals and transfer the received information in the coding block of the recognized words, for the subsequent conversion of the speech of the speaker in the indicative text messages, to convert the unintelligible speech of the user in discerning the voice message generated by the device, and to control the operation of the device "voice",

block encoding the recognized word is intended to represent information about the recognized words, the sounds and messages in the form that meets the conditions of the exchange of information between the respective functional blocks of the device.

block adapt the volume level is designed to provide volume level, adequate environment for automatic gain sound verbal and other sound signals in conditions of high noise pollution (for example on the street or in the subway require a higher volume level, and in the apartment or in the hallway specialised buildings - reduced),

- record block/storage/playback audio is designed for recording and storage and playback of speech and audio information recorded with a microphone and a speech synthesizer,

- memory block service indication signals intended for storage of some information sub-modes, which may include audio, speech and light indicative of the preamble of the speech appeals to others, effective for attracting attention, and attitude on their cooperative interaction and so on,

external alarm sensors include a sensor block, the block signal processing block threshold device, the block coding signal transmitter, the transmitter unit designed to receive alarm signals from the sensor and forming matched with the existing code signal for transmission to the host device,

external device interfacing with a wired telephone line contains the unit of a radio receiver, the block decoding signal, the unit wired pairing with the phone line, intended for user interaction with various external devices without the need for wired connections, including remote transmission of audio and code signals on the telephone line.

The technical result of the present invention is to expand the range of opportunities for person with disabilities health, such as disorders of speech, hearing, mobility, combined violations in the implementation of situational necessary communication and information functions with the help of special technical means of improving the level of accessibility of the surrounding vital space and, consequently, increase the level of social adaptation, adequate classification of events, additional important information, the ability to effectively use the device groups of individuals with various disabilities health, enhancing the safety of users, a significant expansion opportunities, including special processes, adequate labour and household activities.

The inventive belt is aetsa example of a specific implementation of the device for partial replacement of the functions of speech in the following drawings:

figure 1 - block diagram of system devices partial replacement of the functions of speech;

figure 2 - block diagram of the external information sensors

figure 3 - block diagram of the mobile device partial replacement of the functions of speech and hearing

4 is a block diagram external (wireless) device interfacing with a wired telephone line.

Patent-pending device (system devices) (figure 1) contains the complex working in unison devices connected by a bidirectional multiple bit (wireless) tires: external device (wireless) mates with a wired telephone line (46), the mobile device partial replacement of the functions of speech and hearing (45) and an external information sensors (44).

Set external alarm sensors 44 consists of devices of the same type on the principle of their organization (figure 2), containing a serial circuit connected between a respective multi-bit bidirectional buses blocks: sensor unit (1), the block signal processing (2), the block threshold device (3), block coding signal transmitter (4), the transmitter unit (5), and the transmitter unit (5) connected bidirectional wireless multi-bit bus with a mobile device, partial replacement of the functions of speech and hearing (45). Blocks (1)to(5) devices external alarm sensors are connected according to the relevant conclusions of the second power supply unit (6).

The external device (wireless) mates with a wired telephone (44) contains a series circuit connected between a respective multi-bit bidirectional buses block the radio (7), the block decoding signal (8), block wired interfacing with a telephone line (9), the block radio (7) is connected bidirectional wireless multi-bit bus with a mobile device, partial replacement of the functions of speech and hearing (45). Blocks (7)-(9) external (wireless) mates with a wired telephone line connected to the corresponding outputs of the third power supply unit (10).

Mobile device partial replacement of the functions of speech and hearing (3)

contains a control unit (11), the first multi-bit bidirectional bus which is connected to the circuit serially connected between a multi-bit bidirectional buses blocks keyboard (12), encoding the signals of the keyboard (13),

a second bidirectional data bus which is connected to the circuit serially connected between a multi-bit bidirectional buses - unit optical indicator (14), the signal optical indicator (15).

the third bidirectional data bus which is connected to the memory block indicative of optical signals (6), United bidirectional data bus with the signal of the optical indicator (15),

the fourth multi-bit bidirectional bus which is connected with a chain of series-connected multi-bit bidirectional buses block the audio indicator (17), block speech synthesizer (18), the block speech synthesizer (18) is connected to a bidirectional data bus with block coding keyboard (13),

fifth, sixth, seventh, eighth bi-directional data bus which are connected respectively with the memory block codes prepared words and references (19), block wired interfacing with a telephone line (20), a memory block of telephone numbers (43), power contact mating with external digital devices (21), a memory block codes for transmission of digital information (22). Blocks (15), (19), and blocks (22), (15), and blocks (20), (18), and blocks (21), (22)and blocks (18), (19) is connected between a respective multi-bit bidirectional buses,

ninth bi-directional data bus which is connected to the memory block algorithms work device (23),

the tenth bi-directional data bus which is connected to the circuit serially connected between a multi-bit bidirectional buses Electromechanical what ndicator alphabet Braille (24), the signal Electromechanical indicator of the Braille alphabet (25). Blocks(24), (25), (11), and blocks (13), (25), and blocks (25), (19) is connected between a respective multi-bit bidirectional buses,

eleventh bidirectional data bus which is connected to the memory block indicative of the characters in the Braille alphabet (26), blocks (25) and (26) are connected between a respective multi-bit bidirectional buses,

twelfth bidirectional data bus which is connected to the memory unit service indication signal (27),

the thirteenth and fourteenth bidirectional data bus which are connected respectively with the memory address of the radio broadcast (28) and address broadcast (29),

fifteenth bidirectional data bus which is connected to the circuit serially connected between a multi-bit bidirectional buses block the radio (30), the block decoding signal receiver (31),

sixteenth bidirectional data bus which is connected to the circuit serially connected between a multi-bit bidirectional buses - unit radio transmitter (32), block coding signal transmitter (33). Blocks(30), (31), (11), and(32), (33), (11), and (31), (18)and (31),(15)and (31) (25), and (33),(18)and (33), (15)and (33),(25)and (28),(31)and (29), (33) connected between a respective multi-bit bidirectional buses,

seventeenth bidirectional data bus which is connected to the circuit serially connected between a multi-bit bidirectional buses - microphone unit (34), block microphone amplifier with automatic gain control (35), analog-to-digital conversion (36), block automatic squelch (37), block speech recognition and sounds (38), block coding the detected audio signals (39). Blocks(34), (35), (36). (37), (38), (39), (11), and (39), (25)and (39),(15)and (39), (18) connected between a respective multi-bit bidirectional buses,

eighteenth, nineteenth and twentieth bidirectional data bus which are connected respectively with the blocks adapt the volume level (40), the record block/storage/playback of audio signals (41) and the memory block of the recognized characteristics of audio signals (42), blocks (36), (40)and (40), (17)and (34), (41)and (41), (18)and (41), (17)and (38), (42) connected between a respective multi-bit bidirectional buses.

While the blocks (11)-(42) of the mobile device partial replacement of the functions of speech and hearing (45) connected to correspond to them the findings of the first power supply unit (43).

All blocks are patented devices can be implemented on the basis of various electronic components, a high degree of integration that minimizes massogabaritnyh characteristics of the device, improved reliability and durability.

Blocks of radio receivers and transmitters(7), (5), (30), (32) can be implemented, for example, on the basis of transceivers RXQ1-433,9 company Telecontrolli (see the catalogue of the firm Telecontrolli 2004, p.52).

Blocks of encoding and decoding signals(8), (4), (31), (33), (39), (13) as the blocks forming the optical signals of the indicator (15), Electromechanical indicator of the Braille alphabet (25) can be implemented, for example, on the basis of microcontrollers from Microchip Pic 18 F2320 (see 2004 Microchip Product Selector Guide, r.9) or signal processor of the same Microchip dsPIC30F6014 (see 2004 Microchip Product Selector Guide, r.21).

Block external information sensors (44) may be formed on the basis of the standard of finished products, for example, devices AURORA-ETC/TR/TDR-fire radioslushatelei (smoke, heat, combined with a range of up to 60 m, with output power up to 10 milliwatts in the range of radio frequencies 433,05-434, 79 MHz (see catalog company Argus-spectrum for 2004 "New devices", page 7), and on the basis of standard electronic components, for example, as the basis of the sensor unit (1) can be the application is in as the smoke sensor chip Motorola MC145010/12, (see Panfilov DI, Ivanov V.S. Sensors Motorola. M.; TODAKA, 2000, 96 S.), the basis of blocks of signal processing (2), block threshold device (3) and block coding signal transmitter (4) may be the MC68HC908RF2 MCU (see Remisiewicz So New models microcontroller family NS Motorola. CHIP NEWS, No. 5 (68), 2002, p.5-13) is integrated into the housing of the radio transmitter as a basis for the implementation of the transmitter unit (5), the main function of this standard MCU is the processing of optical signals from the sensor to obtain information about the presence of smoke, reducing the voltage level and maintenance Protocol data over the air.

Blocks wired interfacing with a telephone line (9), (20) can be implemented in various ways to transmit both analog and digital signals standard tools used and standardized for modern telephony devices, and can be implemented, for example, on the basis of chip Winbond corporations ISD 5216 (see Winbond Product selection Guide 2005, p.12), or the function module with THE pulse-frequency dialing (catalogue of works "Angstrom", Zelenograd, Sviaz-Expocomm-2001").

Block contact interfacing with an external digital device (21) can be implemented, for example, on the basis of standard mikroC is ntroller and standard software Pic 18F4550 (see Microchip 2005 Product Selector Guide, R.12) to exchange information via the USB ports.

As a control unit (11) can be used, for example, signal processor Microchip dsPIC30F6014 with the following options:

As the memory block algorithms work device (23) can be used program memory of the above-described signal processor.

The keyboard unit (12) can be implemented based on standard products, for example dvenadcatiletnih keyboards IP67 company EAO (see the catalogue of radio elements of the Swedish company ELFA 2004, str).

As the basis of the optical display unit (14) can be used compact graphical zhidkokristallicheskoi is their displays type G241D company Seiko (see the catalogue of radio elements of the Swedish company ELFA 2004, str), in specialized modifications can be implemented, for example, on the basis of multicolor LEDs TLUV5300 firms EVERLIGHT (see the catalogue of radio elements of the Swedish company ELFA 2004, str).

Memory blocks(16), (19), (22), (26), (27), (28), (29), (42), (43) can be implemented on the basis of standard electronic components, such as, for example, W39V080FA Winbond corporations, with the following main characteristics: Density - 8M, Organization - mH, but Time 33Mhz (see Winbond Product selection Guide 2005, p.12).

As the basis of the block audible indication (17) can be used, for example, the standard zvukoizlucheniya type SR (see the catalogue of radio elements of the Swedish company ELFA 2004, str), the output of amplifier LM 386 (see the catalogue of radio elements of the Swedish company ELFA 2004, str), MCP6S91 (see 2005 Microchip Product Selector Guide, p.39). and other

Speech synthesizer (5) can be constructed, for example, on the basis of specialized chip Winbond corporations W523A120 (see Product selection guide 2005, p.1) or WTS 701 (Product bulletin).

As the base unit of the Electromechanical indicator of the Braille alphabet (24) can be used commercially available tactile elements used, for example, the firm Tieman Gmbh, (brochure model Braille Voyager 70).

In ka is este basics of microphone unit (34) can be used a standard microphone element type ES301 (see the catalogue of radio elements of the Swedish company ELFA 2004, str).

One of the operational amplifiers Microchip, for example, MSR (see 2004 Microchip Product Selector Guide, p.34), external components which can be determined using a special computer program for the same company SW300001, Digital Filter Design (see 2004 Microchip Product Selector Guide, R), can be used to create a block of the microphone amplifier with automatic gain control (35).

As analog-to-digital Converter (36) can be used with standard electronic components type AD7541 of Analog Devices (see the catalogue of radio elements of the Swedish company ELFA 2004, str) or integrated analog-to-digital device chips higher degree of integration, for example, in the chip Speech recognition processor RSC-4128 Data Sheet).

Block automatic squelch (37) can be implemented in various ways, in particular, a processor-based Microchip dsPic30F and standard software) from the same company SW300040, Noise Suppression Library (see 2005 Microchip Product Selector Guide, R) or on the basis of chips and software firms Sensory Inc (Speech recognition processor RSC-4128 Data Sheet).

Block recognition of speech and sounds (38) can be implemented in various ways, for example, dichloroethylene races is osnovnie words can be implemented in a processor-based Microchip dsPic30F and standard software (software) of the same company SW300010-300012, dsPicSpeech Recognition (see 2005 Microchip Product Selector Guide, R). Picturesanime speech recognition and sounds can be achieved, for example, the scheme on the basis of chip AR-01 company Aplus Integrated circuits inc. (see Application note AP 7003-01, Voice recognition IC.) or RSC-4128 (chip without external components), as well as Voice Direc_tm364Module (the world with external components) firms Sensory Inc. (see Direct Voice_tm364, Data book or VRC-300/364 Data Sheet) and standard software, for example. Fluent Speech^TM(Speech recognition processor RSC-4128 Data Sheet).

Block adjustment of volume level (40) can be implemented based on different algorithms, one of which is to estimate the current volume level of the ambient sound of the space and the choice in accordance with the desired gain of the audio indicator (17), which is set in modern chips play sounds (e.g., chips MCP6S91) software (see 2005 Microchip Product Selector Guide, p.39).

The record block/storage/playback of audio signals (41) can be implemented on the basis of chips ISD4004 company Information Storage Devices (see the catalogue of radio elements of the Swedish company ELFA 2004, str).

Due to the extended operational capabilities of the device can be operated in stand-alone modes, and combinations of these modes, the main of which are described below:/p>

mode pre-record voice calls with microphone for subsequent scoring and corresponding playback of recorded messages using the keyboard to a specified address,

mode pre-record voice calls using the keypad and speech synthesizer for sound and corresponding playback of recorded messages using the keyboard to a specified address,

- recording mode voice calls with an external device for subsequent scoring and corresponding playback of recorded messages using the keyboard to a specified address,

- mode of the keyboard the desired text for subsequent visualization and corresponding quick play mode text mode or playback of a recorded text messages using the keyboard to a specified address,

- recognition mode pseudoracemic message people with disabilities speech (with distorted speech) for its subsequent transformation into a synthesized or pre-recorded verbal sequence with good intelligibility, either in the text sequence on the optical indicator or an informational message on the Braille display,

- modes of operation "with Golo is a", including the use of phonetically irregular commands spoken by people with speech disorders,

- mode of speech recognition sequences for subsequent display on a text, pictographic or Electromechanical Braille display,

- recognition mode of the content of verbal questions addressed to the user with subsequent automatic speech or text response devices

- recognition mode standard sounds (like the sound of the door and phone calls, timer, etc.),

- modes of dialogue or select cases using pictographic characters

- the dialogue using Electromechanical Braille indicator people (or people)who have visual impairments or those with combined hearing and vision,

- control mode, and information about events based on the state of the external information sensors (including smoke detectors, fire, human presence, security sensors, etc.),

transmission mode information on the external device and on a specified telephone address in wired and wireless (remote) mode, after selecting this mode from the keyboard, and after actuation of information sensors

- modes of operation of the service of indication the x signals

- modes change the keyboard functions that are required, for example, at the transition from digital set to letter-by-letter or character and so on,

- automatic volume control device-generated voice messages depending on the conditions.

The combination of the operating modes of the device partially replace the functions of speech and hearing allow a person with limited functionality (disabled) to improve and diversify their own communication capabilities, improve security, streamline the process of monitoring the environment, to enhance communication of individuals with functional disabilities, in its sole discretion or automatically determining the necessary priorities to get extended and updated information about what is happening. These capabilities allow you to create new applications for socially useful work of persons with disabilities, to facilitate the processes of learning, work, will help to solve a range of everyday problems, including security.

When communication people with speech disorders, hearing or vision can benefit from adequate for each specific case by the algorithms, selectable via the keypad of the memory block algorithms work is trojstva (23). Below are the main possible operating modes of the device partially replace the functions of speech and hearing (45).

In case of operation of any device included in the external information sensors (44) (when this signal is received from the unit (1) after the processing in block (2) and after identifying the events in the unit (3)unit (4) is formed by an individual code is fed to the transmitter unit (5)), initiated by the work of his radio transmitter and transmitting a radio signal that meets the requirements of one of the well-known transfer protocols of the radio signal), and the latter is identified in the circuit - unit radio (30), the block decoding signal to the radio (31). From the block data memory address of the radio broadcast (28) the control unit (11) is chosen the same address and the corresponding (associated) codes, which, in General, is coming to the display units (14-15, 17-18, 24-25) to generate information indicative of the signals on the event that modality. Control and information about events based on the state of the external information sensors and other functional modes can be selected using the keypad (12) and block encoding signals of the keyboard (13), in accordance with possible scenarios of the device is recorded in the block of the memory algorithms work device (23). External sensors (44), including fire, security, sensors cry of the child and others, are working on well-known principles and on the basis of known technical solutions, fixing the specified changes - smoke, movement, opening Windows, etc. Condition of their application is the availability of wireless devices working in unison with the mobile device partial replacement of the functions of speech and hearing (45) (first with blocks(30), (31).

Possible modes as programmable and automatic transmission of information about the work of the external information of the sensors to an external device (modes of transmission of information messages to external devices, and on a specified telephone address in wired and wireless (remote) mode after selecting this mode from the keyboard, or automatically after actuation information of the sensors). In these modes adopted by the unit of a radio receiver (30) and decoded in the block (31) the signal or after conversion unit speech synthesizer (18) again encoded block (33) and passed through a block (32) and the external (wireless) pairing with the phone line, or transformed in the block speech synthesizer (18) in a signal corresponding to a voice comes on the block wired interfacing with a telephone line (20), for posleduyuschiey at the addresses recorded in the memory block of telephone numbers(44), or served on the block surface interfacing with an external digital device (21), which transmits to the external device codes that correspond to the received message type is selected according to the correspondence principle of the memory block codes for transmission of digital information (22).

In a similar way, the information signals can be transmitted wired and wirelessly when typing messages with the keypad (12), after coding in a block (13) and the conversion unit (18), and after speech recognition (blocks 35-39) and the conversion unit (18).

mode pre-record voice calls with microphone for subsequent scoring and corresponding playback of recorded messages using the keyboard to a specified address. In this mode, recording a voice calls made using blocks (34) and (41), recording and preserving in the unit (41) the amplified signal from the microphone. Start recording the voice message and the address of its storage is determined using blocks keyboard (12), (13). Recorded messages can be played back at the right time, calling them by the same addresses using blocks keyboard (12),(13), with amplification and direct their reproduction is made using the audible indication (17).

- write mode is echevin appeals from an external device for subsequent scoring and corresponding playback of recorded messages using the keyboard to a specified address. The second recording mode voice calls by using obtain and record in the unit for playback/recording/storage of audio signals (41), the transformed block of the speech synthesizer (18) and received blocks with wire and pin pair (20), (21), and also blocks radio (30), (31) and also converted block speech synthesizer (18) for storing in the block (41) at the addresses defined with blocks keyboard (12), (13). Subsequent dubbing is also possible using blocks keyboard(12), (13).

Mode pre-record voice calls using the keypad and speech synthesizer for sound and corresponding playback of recorded messages using the keyboard to a specified address. Mode text set of words and phrases to write to the block (41) is performed using blocks(12), (13), (18), with the subsequent reproduction in a block (17). Possible quick play mode without saving the message in the block (41) by delaying typed messages to their full set in block coding (13) with the following playback using blocks of speech synthesizer (18) and the audio indicator (17).

In all modes except mode recording from a microphone, simultaneous and separate display of messages in the unit of the optical indicator (14), Electromechanical indica is the PR of the Braille alphabet (24), and the audio indicator (17) due to a code signals, depending on the mode received from one of the following blocks: (13), (39), (31), (33). Code signals, depending on the mode, the signal optical indicator (15), the processing unit of the Electromechanical indicator of the Braille alphabet (25), or block a speech synthesizer (18).

Indicative signals may inform the user, in the General case, the text typed from the keyboard, the recognized spoken words and phrases, the number of information-verbal, pre-recorded messages about the content transmitted to the external device and received from the external device messages. The structure of the device allows, if necessary, to indicate the designation of the current operation.

The desired volume is provided by the unit to adapt the volume level (40) and block sound indication (20). With the help of the block (40) preset algorithm, noise control (for example, on average in a given time interval the amplitude component of the noise signal), is determined by the General background noise in the surrounding space, then, in accordance with the obtained results, changes the gain of the audio signal in a block (17).

The mode of speech recognition sequences for after the ith its display on optical, Braille or audio display. The signal from the microphone unit (34), after amplification in the block (35) and analog-to-digital conversion unit (36), "cleaned" from the noise bothered in the block (37), then in block (38) is the recognition of words, phrases or sounds based on the characteristics stored in the memory block of the signs of recognizable signals (42) at the stage of preliminary training system. Recognition can be done in one of the following standard modes:

decorativism and dichloroethylene recognition of verbal signals,

mode switch the device on a code word,

the mode switching on the set of acoustic signals

the recognition of the given words on the background of continuous verbal signals,

dictionairy the mode of recognition of words and expressions typed at the keyboard,

recognition of information sounds like bells, whistles, rattles, sirens, etc. with a relatively stationary spectral and amplitude characteristics,

the recognition of words and expressions, as well as the management device using phonetically incorrect expressions of people with speech disorders.

In the case of the recognition of the audio coding block detected audio signals (39) is the formation of corresponding codes that the Udut correctly identified and converted to adequately represent the nodes display (blocks (14), (15); (24), (25); (17), (18)) and based on which indication on the display will be generated informational messages that modality according to the above principles.

Similarly implemented recognition mode pseudoracemic message people with disabilities speech (dichlorosalicylic recognition mode that allows you to recognize not only the correct verbal messages, but also various sound combinations that can create voicegenerating machine man)for its subsequent transformation into a synthesized or pre-recorded speech sequence with good intelligibility, either in the text sequence on the optical indicator, or in Braille message on the Braille display. A feature of this mode is that confusing to others pseudoracemic sounds that say people with speech disorders are in most cases illegible to others with normal hearing, but may be detected by technical means (in accordance with a limited vocabulary of recognizable "pseudowords" and "pseudomys", the symptoms of which are recorded in the memory unit of the recognized characteristics of audio signals (42) and in accordance with kotorii pronounced "pseudorutile" message is detected in mode dictors is independent of recognition and, in the recognition result, in the block (39) is formed code that correctly identified nodes display for demonstratie informational messages on one or more display screens.

Similarly, there is recognition mode standard sounds (like the sound of the door and phone calls, timer, etc). After storage in the memory block of the characteristics of the audio signals (42) in the process of teaching the standard algorithm, if the recognition mode will have a similar sound, this sound can be set in accordance with a display signal on one of the displays. This mode is important for users with hearing impairments - for these users is extremely important information about what is happening acoustic events. When using this mode, it is advisable to initiate the work not only of the text or pictorial, but bright optical indicator based on LEDs, capable of attracting the attention of the deaf user even if the opinion of the latter is not directed directly to the device.

The mode of recognition of the content of verbal questions addressed to the user with subsequent automatic speech or text response device. In this case, not talking or hearing-impaired person can use the device as AB is otvetit. This organization of work of the device, in which after recognition standard question (from a limited vocabulary recognition) in the block (38), block coding (39) generates code that corresponds to a prepared text of the answer to this common question. For example, it is useful to prepare a dictionary recognition standard questions of the following type: "Where are you going?" (or the abbreviation "where?", "address"), "What do you want?" (or abbreviated as "routine", "food", "target"), etc. To these questions it is necessary to prepare the answers. The choice is prepared to recognize words and phrases that are usually produced from a node of the keyboard on the basis of one of the alternative scenarios that are recorded in the block (23).

To simplify and speed up communication it is possible to organize the exchange of information of the user and the other party is not using a text message set, and the rapid communication with special pictographic symbols (images which are stored in the block (16)) when choosing a site keyboard. For the organization of such a mode requires a unified hierarchical algorithm for communication, which can be used, for example, the principle of special cards used in special for communicating with children who have impairments in speech or with concomitant impairments.

Similar is cnym can be secured mode of monologue or dialogue using Electromechanical Braille indicator people (or people with visual impairments, or with combined hearing and vision.

The modes of operation of the service indication signals are required to establish procedures for proper switch operation modes of the device, change the keyboard functions that are required, for example, at the transition from digital set to letter-by-letter or character, etc. and also for the formation of a special indicator signals that contribute to a more successful and efficient operation. So, in the process of experimenting with a trial models patented device was that hearing people accessed not talking people that use this tech tool, much better aware of the meaning of events and, therefore, more meaningful and cooperative approach to the request of the user if before generating voice messages forming the characteristic audio signal type signal in the subway before the arrival of the train. Possible use cases are not only sound, but also optical signals to attract the attention of others. The parameters of such signals are stored in the block service indication signals (27). This unit also stores the settings for sound or other indication signals arising from the pressing device, indicative signals when changing modes of operation, pre the preliminary indication is recognized messages, etc.

The automatic volume control device-generated voice message is provided by blocks (40) and (17), which changes the gain of the output signal of the block audible indication.

Thus, the introduction of the mobile device (45) external device (wireless) mates with a wired telephone line (46) allows you to send data signals over the telephone network remotely, which is very important for persons with limited mobility.

Introduction to mobile device (45) external device information sensors (44) and external (wireless) mates with a wired telephone line (46) allows the user to receive information about events that cannot be controlled or breach touch, or because of limited mobility, increasing the safety and awareness of the user.

Introduction to the unit block of Electromechanical indicator of the Braille alphabet (24), the signal of the Electromechanical indicator of the Braille alphabet (25) and memory block indicative of the characters in the Braille alphabet (26) allows you to enter new information modality for information by persons with impaired vision or with concomitant medical disorders.

The introduction of the memory block service features is the R signals (27) allows you to create special, but very important for the efficient operation of auxiliary properties and operating modes of the device type, sound or optical confirm button presses, the introduction of advanced audio preamble before generating voice messages, etc.

The introduction of blocks of the receiver (30), decoding of radio signals (31) and the memory block address of the radio broadcast (28) allows to receive information remotely with external information sensors and other devices with a coherent system of transmit-receive radio signals.

The introduction of blocks of the transmitter (31), encode the signal transmitter (33) and the memory block address of a broadcast (29) allows to transmit information to the remote device external (wireless) interfacing with the wired telephone lines and other devices with a coherent system of transmit-receive radio signals.

Introduction blocks(34)-(39), (42) allows the detection of audio signals with the subsequent presentation of the results of the information displays, and using the detected signals to control the operation of the device, auto-replies and transformation of unintelligible speech in particular.

Introduction of the unit to adapt the volume level (40) allows you to create a volume-generated speech and sound the new messages volume appropriate external acoustic environment.

The introduction of the record block/storage/playback (41) allows the recording, storage and playback of acoustic signals to generate them at appropriate times based on the selected mode of the device.

Experimental samples of the device has shown its high demand among potential users, due to the significant expansion opportunities. The developed device is the first domestic rehabilitation communication device using pattern recognition of acoustic signals.

1. The device partial replacement of the functions of speech and hearing, containing the mobile device partial replacement of the functions of speech and hearing, including the control unit, the first bidirectional data bus which is connected to the circuit serially connected between a multi-bit bidirectional buses block the keyboard and block encoding signals of the keyboard, the second bidirectional data bus which is connected to the circuit serially connected between a multi-bit bidirectional buses block the optical indicator and signal optical indicator, the signal optical what about the indicator is connected to a bidirectional data bus with a block encoding of the signals keyboard, the third bidirectional data bus which is connected to the memory block indicative of optical signals, and the memory block indicative of optical signals is connected to a bidirectional data bus with the signal optical indicator, the fourth multi-bit bidirectional bus which is connected to the circuit serially connected between a multi-bit bidirectional buses blocks of an audible indication and a speech synthesizer, the block speech synthesizer connected to a bidirectional data bus with block coding signal keyboard, fifth, sixth, twenty-first, seventh, eighth and ninth bi-directional data bus which are connected respectively with the memory block codes prepared words and appeals unit wired pair with phone line memory unit telephone addresses, with power contact mating with external digital devices, memory block codes for transmission of digital information from the memory block algorithms of operation of the device, the block of the speech synthesizer and the memory block codes prepared words and references are interconnected bidirectional data buses, memory blocks of codes prepared words and appeals and the formation of optical signal indicator connected between the a bidirectional data buses, blocks wired interfacing with a telephone line and a speech synthesizer connected between a multi-bit bidirectional buses, blocks wired interfacing with a telephone line and a memory block of telephone addresses are interconnected multi-bit bidirectional buses, blocks contact mates with the phone line and the memory block codes for transmission of digital information are interconnected bidirectional data buses, memory block codes for transmission of digital information and the signal optical indicator connected bi-directional data buses, all blocks of the device are connected to the appropriate pins of the first power supply, wherein the device is provided with a set of external sensors, and external device (wireless pairing with the phone line, the external information sensors comprise a series circuit connected between a multi-bit bidirectional buses blocks of sensors, signal processing, threshold devices, signal coding of the radio transmitter and radio transmitter, all blocks external information of the sensors are connected to the appropriate pins of the second power supply and the external device (wireless) interfacing with the telephone line that contains the using serial circuit is connected by a bidirectional data buses of the second radio the second block decoding signals and the second unit wired pairing with the phone line, all blocks of the external device (wireless) pairing with the phone line connected to the appropriate pins of the third power supply unit, and external sensors, and external device (wireless) pairing with the phone line connected multi-bit bidirectional wireless bus to the mobile device partial replacement of the functions of speech and hearing.

2. The device according to claim 1, in which is inserted and connected to the tenth bi-directional data bus, which is series connected bi-directional multi-digit tire chain, consisting of blocks of Electromechanical indicator of the Braille alphabet and block signal of the Electromechanical indicator of the Braille alphabet, to the eleventh multi-bit bidirectional bus - memory block indicative of the characters in the Braille alphabet, and the processing unit of the Electromechanical indicator of the Braille alphabet and the memory block is indicative of the characters in the Braille alphabet interconnected bidirectional multi-bit buses, the processing unit of the Electromechanical indicator of the Braille alphabet and the memory block codes prepared words and references are interconnected multi-bit bidirectional and tires the processing unit of the Electromechanical indicator of the Braille alphabet and block encoding signals keyboard connected bi-directional data buses.

3. The device according to claim 2, in which is inserted and connected to the twelfth bi-directional multi-bit bus - memory block service indication signals.

4. The device according to claim 3, in which is inserted and connected to the thirteenth and fourteenth bidirectional data buses, respectively, the memory block address of the radio, the memory block address broadcast to the fifteenth bidirectional data bus, which is series connected bi-directional multi-digit tire chain, consisting of blocks of the first radio and decode the radio signal, and the memory block address of the radio and the first block decoding signal of the radio receiver is connected bi-directional data buses, and the first block decoding signal of the radio receiver is connected bi-directional data buses with a block of the speech synthesizer, the signal optical indicator, signal Electromechanical indicator of the Braille alphabet, and to sixteenth multi-bit bidirectional bus series connected bi-directional multi-digit tire chain of the block is in the first radio transmitter and coding of the signal transmitter, the first block coding signal transmitter connected multi-bit bidirectional buses with blocks of memory addresses broadcast, speech synthesizer, a signal optical indicator, signal Electromechanical indicator of the Braille alphabet.

5. The device according to claim 4, in which is inserted and connected to the seventeenth bidirectional data bus, which is series connected bi-directional multi-digit tire chain, consisting of blocks-in microphone, microphone amplifier with automatic gain control, analog-to-digital conversion, automatic noise reduction, speech recognition and sounds, encoding the detected audio signals, the block encoding detected audio signals connected multi-bit bidirectional buses with blocks forming optical signals of the display, a speech synthesizer, a signal-Electromechanical indicator of the Braille alphabet, and by the twentieth multi-bit bidirectional bus - memory block of the recognized characteristics of the audio signals directly connected to the bidirectional data bus with the recognition block speech and sounds.

6. The device according to claim 5, in which is inserted and connected to the eighteenth multi-bit bidirectional bus - block adaptation level loudly the minute, connected also multi-bit bidirectional buses with blocks analog-to-digital conversion and an audible indication.

7. The device according to claim 6, in which is inserted and connected to the nineteenth bidirectional data bus block write/storage/playback of audio signals, connected also multi-bit bidirectional buses with microphone blocks, encoding the signals keyboard, sound, display, a speech synthesizer, with all the blocks of the mobile device partial replacement of the functions of speech and hearing connected to the appropriate pins of the first, second and third power supplies.