Programmable multimedia controller with programmable functions

FIELD: information technology.

SUBSTANCE: disclosed is an integrated system which is based on a general purpose computer and is capable of interfacing with, controlling or managing a wide variety of audio, video, communication, data transmission or other devices. The system includes a programming environment for creating functions or user experiences that may incorporate features or functionalities of several devices that are conventionally used as separate, standalone devices.

EFFECT: best compatible operation of audio and video devices and providing the best quality of entertainment functions.

18 cl, 42 dwg

This application is associated with a parallel application "System and method for implementing a programmable multimedia controller", filed on 20 December 2005 on behalf of the same applicant and identified as the application Cesari and McKenna No. 104215-0003, which thereby is incorporated herein by reference.

The technical field to which the invention relates.

The present invention generally relates to the fields of media and communications, and more particularly to a programmable multimedia controller, designed for home and commercial use, professional audio or video broadcast or Studio work, security, automation and other fields of application, which is made interoperable, control and management of a wide range of audio and video devices, communication devices, data transmission and other devices.

The level of technology

The rapid growth of offer volume consumer electronic devices on the market have arisen as a result of declines in the value of electronic equipment and the advent of new media. For example, in the last few years the technology of compact discs (CDS) have largely replaced vinyl records and magnetic tapes with the position of the most popular media music, but was, in its turn is, supplanted by technology MDE. Similarly, the former the most popular medium for recording, videotape, have largely given way to digital versatile discs (digital versatile disk-DVD); at the same time the digital camera is actually replaced the film camera. The emergence of new technologies and media, and the respective consumer demand for products based on the latest developments, forcing manufacturers to rapidly introduce new products. As a result, the market gets a huge number of types and models of various products.

One of the oldest problems, the influence of which is exposed to many consumers, is the complexity of the connections between the various electronic devices that are usually sold separately and are not components of the integrated system. For example, consumers can buy the receiver (audio receiver, cable box, TV, DVD player and surround sound system, and these devices will be manufactured by different manufacturers. For many users, the big problem is even the connection component groups cord set, not to mention a sufficient understanding of the various modes of operation and characteristics, which when properly used allow you to get the best the second joint component and the highest quality entertainment options.

Another long-standing problem with most, if not all, previous approaches to integrating the various components is that you are using any type Central controller, which operates on the basis of software written in machine language to high level. The use of machine language high-level presents several difficulties. First of all, the likelihood that the manufacturer will provide the user with the source code, is very small that will not actually allow the user to configure the system as desired. Secondly, even if the source code is available, the vast majority of users do not have the relevant technical knowledge, time or inclination to write or modify the source code. Thirdly, the introduction of new devices manufacturers will almost certainly require changes to this source code to ensure compatibility of the Central controller with such devices.

Another long-standing problem is the lack of any generally accepted industry standard management interfaces for consumer electronic devices. Manufacturers use a variety of communication protocols, most of which are closed, do not correspond to any standard and implemented by an extremely complex source the th code. This lack of standards significantly complicates the problem of integration and Central management of a large number of various consumer electronic devices necessary for their collaboration and control the average user who does not have more technical knowledge.

Disclosure of inventions

Basically the present invention provides a programmable multimedia controller with programmable functions. The basis of the multimedia controller is a universal computer, which manages the specialized built-in computer system. The mainframe can be attached to the second universal computer for redundancy. Multimedia controller made interoperable, control or management of a wide range of different audio and video devices, communication devices, data or other devices.

Multimedia controller includes a programming environment designed for creation functions or user submissions, which may include features or functionality of multiple devices in the traditional version runs as a separate stand-alone device. The complexity of these functions can range from simple control functions to the player the dia-views combining high-performance audio and video equipment with the graphical capabilities of the universal computer, Web services and various types of communication.

Functions may be implemented in accordance with various zones in a larger physical space. For example, the user may specify that certain functions must be available in the living room in the house, and other features should be available in the kitchen, depending on the components available in each room, or user preferences. In addition, functions can also be implemented for a specific user according to the user profile that specifies the settings, limitations (e.g., parental control), etc.

The programming environment includes a library of profile components. Profiles of the components can be implemented in several ways depending on the desired attributes of the source data structures. In a preferred embodiment, the profile component is implemented as an XML file (Extensible Markup Language, extensible markup language)that describes certain attributes of a component, such as a DVD player, TV, amplifier or any other type of component capable of interacting with the system of the present invention. Typically, the component profile describes at least some of the C physical characteristics of a component (for example, connectors input/output on the rear side of the component), the component configuration (for example, all possible types of modules that may be present in slots or compartments of the modular receiver), a set of commands that can be recognized by a component (for example, turning on, off, open the disc tray), and functions supported by the component (e.g., play, pause, stop).

The use of XML files for profiles of components and other features of the present invention, described below, provides several advantages, including the ease of creating a profile components to new components, which will appear on the market in the future. Further, the use of XML is extremely simplifies the configuration process by editing existing profiles of components compared to writing or modifying the source code. Accordingly, the present invention includes a software tool designed to provide relevant opportunities installers or users who want to create their own profiles, components or change profiles, available in the library.

The profile library components can be stored on a hard disk or other data storage devices that are physically part of the system or available to the system over the network or on the natives communication channel. One or more profiles of the components or even the entire library can be queried and updated as necessary by accessing a specific Web site through the Internet and download the appropriate files. Update profile library components may occur automatically, or by user command, or under the control of the user.

Use the library of profiles of the components in the present invention allows the user to describe the wiring of a specific interactive installation at the instructions in the onscreen guide. In the case of a new installation in accordance with the present invention, the user may be issued recommendations for wiring installation. After you connect the cables according to the present invention, the user can get information about what functions are available.

The programming environment also includes the configuration of the zones, which are also preferably implemented as XML files. The zone configuration is essentially the description, which provides guidance on what components are in a particular room or other place, what modules are actually present in the composition modular component, how interconnected these components, and a description of the type (types) of controllers available to use is the motor in this place.

The programming environment also includes the configuration of the compounds, preferably in the form of XML files. The configuration of the connections is essentially a file that contains the setup information on connecting the cables and used to determine what functions can be supported by this installation.

In addition, the programming environment includes rules functions. The rule functions, preferably implemented as an XML file, essentially determines what components are required to implement specific functions and how they interact on a particular component or group of components to ensure functionality.

Profiles of components, the configuration of the zones, the configuration of connections and rules functions in the programming environment are input to the compiler configuration that generates the implementation of the function, also preferably in the form of an XML file. The implementation of the function, in turn, is passed as input to the generator workflow that creates an executable form of implementation of functions and graphical representation of the executable form. Graphical representation of the best way provides a convenient and easy-to-use format that can be displayed and edited using a universal computer. By redaktirovat the Oia graphical representation of the user actually changes the corresponding executable form. Thus, a user with little or no programming knowledge gains the ability to create and configure the programmable functions on request.

Another aspect of the present invention to improve the ease of use and ease of programming of the system is the user interface, which in the preferred embodiment, based on the functionality of the DVD player in conjunction with widely available software to create a DVD. In this aspect, the present invention uses two important circumstances: DVD player (i.e. the functionality of a DVD player, which is implemented in the chip decoder) has a low cost, and users are usually familiar with running a DVD player by selecting from the displayed menu. Thus, on the basis of software to create DVD, available on the market, can be implemented in low-cost custom interface that will be easily understandable to the vast majority of users. With this software you can create video playback which will receive the information, menus or options with which the user interacts using a simple remote remote the CSO control portable DVD player, touch screen, or any of many other control devices that are supported according to the present invention. One such video can be used to collect the necessary information to create one or more user profiles, as part of the configuration and installation of the system.

Another aspect of the present invention is its extensibility. Many multimedia controllers can be interconnected with the formation of a larger system, in which any input audio and video signals of one controller can be switched to any output in the same or a different controller. In this extended system with different controllers can be programmed to perform different functions. For example, one controller may be programmed to provide functions related to the video while connected therewith, a second controller can be programmed to provide functions related to sound.

In accordance with the present invention can be implemented in a number of different functions. For example, assume that the user has a system according to the present invention, associated with a DVD player, a TV and a telephone line. These components can be determined simply is I function which is that if the user is watching a movie on DVD and this time receives a phone call, the system of the present invention automatically takes the DVD player the team pause and displays the caller ID on the TV screen. Thus, the user can decide whether to answer the call or not is not up to the phone and not controlling the DVD player manually. If the user answers the call, the DVD player will remain in pause mode. If the user does not answer the call or answer and then terminates the connection, the movie will automatically renew upon expiration period, which can be programmed by the user.

Another example of a simple function, implemented in accordance with the present invention, involves the use of a combination of TV and Internet access. The present invention can be used to access information online, such as stock quotes, sports scores or weather information, and display this information in any area of the video image on the TV screen or, alternatively, in a scrolling Ticker at the bottom of the image, while the user will see the desired television program.

Another example of a simple function, realize is according to my present invention, involves the use of a combination of TV and phone (cell phone). The present invention can be used to determine the receipt of a short text message (SMS) on mobile phone and display the text message on top of the image shown on the TV. Thus, the user can view a text message without performing any action with a cell phone.

Brief description of drawings

The following is the description of the invention with reference to the following accompanying drawings:

figure 1 presents the block diagram of the home multimedia controller 100 connected to the next device according to an exemplary variant of implementation of the present invention;

figure 2 shows the block diagram of the high-level hardware architecture of the system in figure 1;

figure 3 shows the block diagram of the high-level software architecture of the system in figure 1;

figure 4 shows the block diagram showing the basic software components involved in the implementation of the functions provided by the system in figure 1;

on figa-5M shows the profile of the component for the DVD player;

figure 6 shows the configuration of a zone receiver;

on figa-7C shows the configuration of the connections to the receiver;

on figa-8H illustrates the rule function for p is okuchivanija radio broadcasting;

on figa-N presents the implementation of the function for playing a CD in a DVD player connected to the receiver, which is also connected to the speakers of a surround-sound system;

figure 10 shows a screenshot of the workflow in Automator application;

figure 11 shows a diagram of the message structure for application programming interface (API) of the controller in figure 1;

on Fig shows the block diagram of the processing of the message, showing how the device running Mac OS X interacts with the API of figure 11;

on Fig shows the block diagram of the processing of the message, showing how the remote control that transmits a radio frequency commands, interacts with the API of figure 11;

on Fig shows the block diagram of the processing of the message, showing how a DVD player with S/PDIF output can be used as the device management API figure 11.

The implementation of the invention

Figure 1 shows the block diagram of the programmable multimedia controller 100 connected with a number of devices, according to an exemplary variant of implementation of the present invention. The term "programmable multimedia controller" should be understood broadly as a device that is configured to control various electronic devices the devices, switch between data and/or interaction with them, where these devices can be a audio and video devices, telephony devices device data protection device by using motors, relays and/or other types of electronic devices. When interacting with these devices programmable multimedia controller may implement integrated multimedia management solution.

In an exemplary embodiment, the programmable multimedia controller 100 is associated with a wide range of audio/video components, such as the player 105 compact discs (CD), the player 110 digital versatile discs (DVDs), audio receiver 115, a television 120, a personal media player 125, speakers 122, the microphone 123 and/or the video camera 124. Programmable multimedia controller may also be connected to telephony devices such as the telephone network 130 and handset 132. The telephone network 130 may be a telephone network (PSTN (publicly switched telephone network, PSTN), digital network integrated services Integrated Services Digital Network (ISDN) or other network connection.

In addition, the programmable multimedia controller can interact with a variety of systems 135 lighting and/or home automation. These eliminate the STV can work on X10 Protocol, developed by Pico Electronics, Protocol INSTEON™, developed by SmartHome, Inc., the CEBus standard, controlled Industrial Council CEBus, or another well-known Protocol for home automation or control. Similarly, the controller may be associated with devices 137, driven by the engine and/or relays, which may include, for example, heating, ventilation and air conditioning (heating, ventilation and air conditioning, HVAC, irrigation system, automatic shading or blinds, electronic door lock and other types of devices.

With multimedia controller connected to a computer network such as the Internet 140. In addition, it can be connected with a personal computer (PC) 145, 150 games, home accessories 165 for recording and other devices. Further, there may be provided one or more remotes 170 remote control designed to control functions of the controller and/or control devices connected to the controller. Such remote control may be connected to the controller via a wired network connection, an infrared channel, radio channel, Bluetooth™, ZigBee channel™ or other suitable data transmission channel.

In addition to providing interoperability with a wide range of devices prog is amberway multimedia controller can be combined, to synthesize and process in other ways different data types to implement integrated multimedia solutions for the user.

In order to facilitate the above-described compounds and processing of the programmable multimedia controller 100 may have a modular design. For example, in one embodiment, the implementation of the programmable multimedia controller 100 is made with twelve separate modules input and output, each of which has a set of connecting ports. Modules input and output are inserted in the connectors or modular compartments programmable multimedia controller 100. The modules are connected with a common card that provides connectivity to the rest of the system. The modular design allows the user to select specific modules according to needs, and the system can be adapted to the specific application. In addition, it may be reduced by the cost of the initial purchase due to the fact that the user will be able to buy a basic configuration with disabilities and expand your system by purchasing additional modules. The following describes some examples of modules with reference to figure 4 to 10, 12 and 13. It should be understood that may be provided by a variety of additional modules, and, accordingly, this description can the t apply to other possible configurations. In addition, it should be understood that multiple programmable multimedia controllers can be interconnected with the formation of a larger system, actually implementing the decision module type level controllers. Further information regarding this relationship and extensions are provided later with reference to Fig and 19.

Figure 2 shows the block diagram of the high-level hardware architecture of the programmable multimedia controller. Presents the various components can be located on the system Board ("system Board") of the controller or on multiple boards connected by a connecting plate (not shown). The microcontroller 210 controls the operation of the system as a whole. In an exemplary embodiment, the microcontroller is a 32-bit microcontroller model MCF5234 supplied Freescale Semiconductor Inc. The microcontroller 210 is connected to audiokommentare 215 and videocommunication 220 via bus 218. Audiokommentar 215 and video crossbar 220 preferably represent matrix switchers, providing simultaneous switching of many compounds. However, it can be used with many other types of switches, providing switching digital signals, for example, switches, TDM (Time Division Multiplexing, multiplexing in time). More detailed described the e of these switches below with reference to Fig 3 and 11.

Total fees 235 connects the switches, and other devices with a variety of input modules and output, such as modules 600 input digital video with the HDMI connector modules 1000 video output HDMI connector modules 400 input digital audio and modules 900 output digital audio. Total fees 235 is also connected to the Ethernet switch 230, which performs signal switching Ethernet 10 BaseT, 100 BaseT or Gigabyte Ethernet. The Ethernet switch 230 connects the Ethernet ports 232 and subsystem 240 processing by the microcontroller 210. In one embodiment, the implementation of the subsystem 240 processing includes several universal personal computers, small form factor, which operate with redundancy and/or load distribution. In some embodiments, the implementation of the subsystem 240 processing can include one or more storage devices, external to personal computers and is designed to expand the capacity of storage devices, for example, to store digital media content. A more detailed description of various embodiments of the subsystem 240 data below with reference to Fig-16.

In addition, a number of USB ports 242 a Universal Serial Bus (universal serial bus) is connected to a USB hub 243 connection subsystem 240 processing. USB concentrate is the operator 243 may be connected to the interface 225 memory cards. This interface supports one or more common memory card formats, for example, CompactFlash™, Memory Stick™, Secure Digital card™ (SD) and other formats. For switching the USB connection between multiple processing components, the presence of which may be the system that you are using a USB switch 244. Similarly, a set of ports 246 IEEE 1394 (FireWire™), connected to the hub 247 IEEE 1394 and to the switch 248 IEEE 1394.

Next, the microcontroller 210 is connected to a distribution circuit 250 standard SPI (serial interface peripherals Serial Peripheral Interface) and I²With (Inter-lntegrated Circuit)that implements the serial communication interface for devices with relatively low data rate. The controller 250 SPI/I²C is connected to the connector General Board 235 and thus transmits the control commands from the microcontroller 210 in modules and other devices in the programmable multimedia controller 100. Other compounds controller 250 SPI/I²C designed for devices such as the controller 251 of the fan, the temperature sensor 252 and circuit 253 power management, which control thermal characteristics of the system and prevent overheating.

The microcontroller 210 is also connected with the interface 260 infrared communication interface 265 RS232 and RF interf Isom 267, providing communication with external devices. This relationship allows the programmable multimedia controller 100 to control external devices. In addition, interfaces can receive the control signals that control the operation of the programmable multimedia controller. Obviously, in a multimedia controller 100 may use a variety of other interfaces, including WI-FI, Bluetooth™, ZigBee™, and other wired and wireless interfaces. A more detailed description of these interfaces is given below with reference to Fig.

Next, to connect one or more video game systems, camcorders, computers, karaoke devices or other devices have an auxiliary audio/video port 700. To connect with the telephone network (PSTN) or a private network, and telephone headsets provides a telephone interface 270. Further, interface 275 control devices designed to communicate with devices, lighting, and home automation devices, driven by the engine and/or relay. As described in more detail below, provides port 280 extensions, designed to connect multiple programmable multimedia controllers with the formation of the extended system. Finally, the display 1150 front panel allows from brigati state, the configuration and/or other information to the user. In one of the embodiments on the front panel can display video from any input source connected to the system that allows you to display the video content on the display for preview. In another embodiment, the display 1150 front panel has a touch screen, and the user can specify options by selecting the icons on the screen.

Figure 3 shows the block diagram of the high-level software architecture of the controller 100. Software architecture is organized as a sequence of levels, including the level 302 management system, level 304 of the user interface (U1, user interface), access 306 API to control the level 308 functions, level 310 environment, the level 312 of the control components and the level 314 configuration/settings.

Level 302 management system includes the functionality of the system Manager 316, application 318 can start the system Manager 320 redundancy, the Web server 322, the server 324 touch screen/PDA, Manager 326 remote access to the system and system logs 328.

Level 304 Ul accommodates the server 330 Ul together with the level 308 functions. Level 308 functions includes the functionality of the controller 332 functions, which, in turn, includes the process 334 Appendix is placed Automator. Level 308 functions also includes the functionality of the controller 336 to display the Mac, the application 338 output data to the screen (on-screen display OSD), a third-party application 340, the application 342 Mac and controller 344 audio/video components. Through a process 334 Automator application controller 332 functions manages Mac applications, including iTunes, iChat, iPhoto, and iDVD that support Applescript interface to enable management of the sequence of applications. Similarly, through a process 334 Automator application controller 332 functions manages other third-party applications that support AppleScript.

Level 310 environment includes the functionality of input/output (I / O) by Weight of all supported formats such as DVI, Ethernet, FireWire™, USB etc). Level 312 control components includes functionality to control audio/video components 348.

Level 314 configuration/setup includes the functionality of the application 350 custom configurations, the compiler 352 configurations, the application 354 control custom functions, the generator 356 workflow and application 358 viewing workflow/search engine/setup. Level 314 configuration/settings also transmits the information of several types on the level of UI 304 and the level 308 functions, including the intended configuration, 360, workflow 362 automator application, definitions 364 functions, profiles 366 components and settings 368 Mac. As described in detail hereinafter with reference to figure 5-11, in the preferred embodiment to represent the system configuration 360, workflow 362 automator application, definitions 364 services and profiles 366 component uses XML files.

Here are the General functions of the various levels, are presented in figure 3. In General, the level 302 management system is responsible for system tasks and processes high level. Manager 320 redundancy is responsible overall for ensuring redundancy, which can profitably be used in a multimedia controller 100. For example, subsystem 240 processing can be implemented on the basis of two Mac Mini™, as noted above. The use of two computers enables load balancing, as well as one level of redundancy in case one of the computers fails.

For the correct operation of these two computers, as in the case of normal operation of both computers and the failure of one of them, you must synchronize the data stored on hard drives, which usually addresses only one of the computers. Preferably it is implemented using the rsync application, features that are part of perational OS X. In addition, one of the computers will be assigned to the "main" computer-based arbitration, which is performed when enabling multimedia controller 100. "Subsidiary" computer functioning as subordinate to the main computer.

One of the options for implementing the arbitration commences with each computer of your presence through Bonjour service Name. When one of the computers detects another computer, it connects with another computer. If both computers are candidates for the role of the main computer, it becomes a computer with a large Ethernet address control access to the transmission medium. Each computer maintains an open connection and periodically polls the other computer. If the host computer does not respond, the auxiliary computer takes the role of the main computer itself.

The host computer is responsible for the distribution of stream resources between him and "subsidiary" of a computer. Plug and removable media (such as disks FireWire or USB, cameras, iPods) are connected to the main computer. The data collected by the main computer of such devices can be transmitted to the auxiliary computer through a shared mount points or otherwise.

Access 306 to API management is responsible for the API, what redstem which multimedia controller 100 may be controlled by the user, which can choose to use devices with Web functionality, radio frequency remote control device, touch screen, PDA or cell phone. Level 304 UI functionally responsible for the user interface of the multimedia controller 100. Level 308 functions functionally responsible for the implementation of the functions described above. The process 334 Automator application is responsible for receiving requests or commands from the user and displayed in a workflow for a specific function.

Level 310 environment is functionally responsible for the I / o for Mac and for other internal and external communication interfaces supported by the multimedia controller 100.

Level 312 control components functionally responsible for managing the actions of audio or video components, which can interact with the multimedia controller 100. Level 314 configuration/settings functionally responsible for providing users the option of configuring the multimedia controller 100; select, create or modify functions; select, create or modify a profile component.

Next, with reference to figure 4 provides a more detailed description of the logical relationships between certain functional modules presented in figure 3. A set of data stored within the system player is inogo controller 100 or received from an external source (for example, a Web-site containing the profile library components), denoted by reference number 402. The aggregate data 402 includes profiles of components, types of protection and rules of functions, preferably in the form of XML files, as described above. The second set of data comes from the user and indicated by reference number 404. The aggregate data 404 includes the configuration of connections and information about your system configuration, also preferably in the form of XML files.

The user interacts with the application 350 custom configurations, which is preferably implemented in the form of on-screen interactive guide, generates the data contained in the aggregate data 404. The guide may be displayed on the display 1150 front panel (figure 1) or on the TV or other display, which is connected with the multimedia controller 100. In addition, when using a microphone and speakers connected to the multimedia controller 100, and the application of the functions of recognition and speech synthesis, built-in operating system Mac OS X, the on-screen guide may be implemented support for users with low vision. Questions to the user, instead of on-screen hints that can be synthesized voice, and the user can just speak the answers.

In the alternative the version of the application 350 custom configurations can be implemented as a "stand-alone" program, which can run on Mac or other device, not necessarily connected with the multimedia controller 100. Such an implementation option may be preferable for installers who need to prepare configuration before physically installing the controller.

The application 350 custom configurations can be used to create user profiles, as described above. User profiles allow each user to customize their system settings, styles, colors, etc. for display on the display presented to this user multimedia controller 100. User profiles may also include limits of functions. For example, the user profile for the child may contain information that is blocking access to video programs for adults or cable channels. The user profile may be in the form of an XML file or other data file or structure that is compatible with other aspects of the system that require access to them.

The user interacts with the tool 400 profiles, components will be easy to choose the profiles of components available in the library multimedia controller 100, to give the controller a command to load the appropriate profile from the specified Web site or other source, or possibly what about, to modify an existing profile or to create a completely new profile, if desired.

The tool 400 profiles of the components may also include the functionality of the "explore" commands sent via infrared channel or radio channel using a conventional remote control. Due to this, the user who creates a new profile for component with remote control, can quickly enter a set of remote control commands to the instrument 400 profiles of components.

The tool 400 profiles of the components may also operate in conjunction with an optical reader (not shown)through which the user can scan the bar codes manufacturer located on the housing component, or may, on its packaging. After scanning the barcode tool 400 profiles component tries to find a match in the profile library components, or find the appropriate profile on the specified Web site or other source.

The aggregate data 402 may also contain application profiles, also preferably implemented in the form of XML files that are used to manage third-party applications (such as iTunes, iChat) in the framework of the implementation of the function. In a preferred embodiment, the application profile mo is et to be implemented essentially in the form of a list of actions performed by execution of Applescript. However, application profiles, as well as other design described here can be implemented in various ways.

Together 402 and 404 of the data are passed as input to the compiler 352 configurations, which in response generates an implementation of the function. The implementation of the function, in turn, is passed as input to the module 364 function definitions. The application 354 control custom functions allows the user to view the implemented functions and modify or delete them. Module 364 function definitions transmits defining functions in the controller 332 functions and generator 356 workflows. Function definitions contain specifications which areas, features and components included in the system configuration. In response to determining the functions of the controller 332 function creates an internal state and control areas, functions and components. In addition, the controller 332 function uses the function definitions to help determine which workflows application automator will exist.

Using the information contained in the function definition, the generator 356 workflow generates the initial set of worker processes "default" in executable form and in graphical representation. Each of the zones and function in a function definition has the workflow, implemented for each request made by the function. The workflow is performed in the form executed by the controller 332 functions (figure 3).

The application 358 viewing workflow/search engine/ settings can be used to display, examine and modify the graphical representations of workflows. When the user edits a graphical representation corresponding to the executed form is automatically changed according to the edits made by the user. Thus, the user can easily work with workflows in a graphical programming environment and configure them without having to deal with complex logic and details of the original executables. In addition, together with the application 358 viewing workflow/search engine/ settings or alternatively he can use the voice recognition and speech synthesis, built-in Mac OS X. Thus can be implemented to help users with low vision.

On figa-5M presents examples of profile components that are implemented in the preferred embodiment, in the form of an XML file. Specialist in the art it will be clear that the profiles of the components, as well as any of the other structures described herein may be implemented in various p the authorities on the basis of known technologies, languages and data structures, including databases that support access using standard query languages, binary data representations of a closed format, text files, HTML files, spreadsheets, or other ways of storing data in the form of files. More specifically, figa-5M shows the profile of the component for the DVD player Integra model DPS-5.5. The section labeled 500, indicates that the DVD player has a serial RS232 communication port that can be used to control the player. Section 502 indicates that the DVD player has a digital audio output with coaxial and optical connectors. Section 504 specifies that the DVD player has composite video output with BNC connector and coaxial connector and that has a composite out and S-video output (left and right).

Section 506 are several possible States, which can tell the DVD player: standby mode, play, pause, shutdown, unknown. Similarly, section 508 specifies several types of media, the loading can tell the DVD player: DVD, VCD, CD, data disc, is unknown. Any of these possible messages can be passed to the specified function and used as event-initiator of some action performed by the multimedia controller 100. N the example, when you receive a message stating that the player was loaded DVD disc, the controller 100 may include a television (or other specified display), and a surround sound system in the assumption that the user wants to watch a DVD. Section 510 specified label I/o, physically present on the body of the DVD player.

Section 512 defines a command in the package in which the RS232 port of the DVD player is included. Section 514, on the contrary, defines the shutdown command. Section 516 determines the team play. Other sections on figs-5M define other commands via RS232, which will meet this particular DVD player.

Figure 6 presents the configuration of the zones having the shape of the XML file for the zone named "Lab", where the primary zone, use the Integra receiver model DTR-10.5. This zone also contains plasma screen NEC px-GE, Motorola cable receiver 62000, DVD/CD player Integra DPS 5.5 and surround speakers Bay Audio as defined in section 606. Section 600 determines the physical input-output (and occupied slots), installed in the receiver. In section 602 describes the input format specified by the receiver with the name "DVD". This particular receiver Integra has appointed inputs, so the user can give the input a simple name. Thus the om, required sections 602 and 604 to inform the function configuration of the present invention how the user actually has appointed inputs on the receiver.

In the configuration shows that the receiver was appointed by the associated login "DVD" input names "Stereo IN 1" for audio "Component IN 2" for video signals. Section 604 determines the input format specified by the receiver with the name “Video 1." In the configuration shows that the user has set the display of the input to "Video 1" to the inputs with the names "Stereo IN 2" for audio "Component IN 2" for video.

On figa-7C presents an example configuration of connections for receiver Integra model DTR-10.5. In section 700 indicates that analog audio output (RCA connector) DVD player Integra is connected to the MIC input 1 (RCA connector) on the Integra receiver. Section 702 States that audio output (RCA connector) cable set-top boxes, Motorola connected with 2 stereo line inputs (RCA connector) on the Integra receiver. Section 704 States that composite video (coax connector) DVD player Integra connected with composite video input 1 (coaxial connector) on the Integra receiver. In section 706 indicates that the video output (coaxial connector) cable set-top boxes, Motorola connected with composite video input 2 (coaxial connector) on the Integra receiver.

In section 708 indicates that composite video output (coax the hydrated connector) on the Integra receiver is connected with composite video (coax connector) plasma TV NEC. In section 710 indicates that a set of speakers 7.1 surround sound connected with connectors "Speakers And" Integra receiver. In section 712 indicates that the receiver Integra has a RS232 port, through which you can manage. Similarly, in section 714 indicates that plasma TV NEC has a RS232 port, through which you can manage.

On figa-8H shows the rule functions to listen to the radio, which may be processed by a digital signal processor (digital signal processor, DSP) necessary for decoding or applying effects. In section 800 identifies the resources required to implement this function: the source broadcasts; function audiokommentare (for connection of the input audio signal to the output device (speakers); function processing for surround sound and surround speakers; or in another embodiment, the source broadcasts; function audiokommentare; function volume control; the function of the amplifier; stereo speakers.

In section 802 contains two General query, namely on and off. In section 804 specified requests for volume control, including on and off sound. Section 806 is determined by several queries relating to the processing options for surround sound. In section 808 is determined by the management request receiver, which includes the choice of hours is the notes, selecting presets, display and scan.

On figa-N shows the implementation of options to play the CD in the DVD player when the DVD player is connected to the receiver, providing processing surround sound. In section 900 is defined as follows (audio)components needed to implement this function: DVD player Integra model DPS-5.5; receiver Integra model DTR-10.5 (having a function of processing surround sound); a set of speakers for surround sound. In section 902 identifies all user requests or commands that are recognized by your DVD player and AV receiver.

Figure 10 presents a screen shot illustrating an example of a workflow process when viewed in the Automator application made by Apple Computer, Inc. The Automator application that ships with Mac OS X that implements the simple graphics programming. This environment is comfortable and easy to use environment for viewing and editing workflows created using the present invention. On the other hand, specialists in the art should be understood that for use in the present invention can be used either to adapt third-party graphical programming environment, or the environment may be created specially for use on who I work with multimedia controller 100.

In panels 1000, 1002 figure 10 identifies specific actions that must be performed sequentially. For example, the action specified on the panel 1000 is the inclusion of a DVD player Integra model DPS-5.5. Panel 1002 specified action enable receiver Integra model DTR-10.5.

Figure 11 shows a diagram of the message structure for the application programming interface (API) for the controller in figure 1. Each message includes a header 1100 that may be implemented based on any of the headers (Ethernet, IP, TCP, or UDP. The header should 1100 significant portion 1102. Significant part 1102 contains information that identifies the area, function, event and event type. Significant portion 1102 may merely represent a variable length string consisting of ASCII characters, or be implemented using any of various other known data types or structures.

On Fig shows the block diagram of the processing of messages describing the interaction between a device running Mac OS X with API 11, and its use in the management of the multimedia controller 100. A device running Mac OS X denoted by reference number 1200. In a preferred embodiment, the device 1200 is initially tries to automatically detect the server (i.e. the server 330 interface (figure 3)) pose the CTV broadcast search 1202 Bonjour service Name, the built-in OS x Server 330 user interface includes a service 1204 registration Bonjour Name. The device 1200 sends a message 1206 discovery Bonjour Name, which is received by the server 330 user interface. Next, the query is executed 1208 registration, which is handled by the service 1204 registration Bonjour Name and confirmed by message 1210 registration confirmation.

Next, after the registration of the device 1200, the user presses the button 1212 (for example, the volume of the TV), resulting in the server 330 user interface is sent to the indicator 1214 team. Indicator 1214 team and request 1220 command, confirmation 1222 commands and indicator 1226 team in General are created in accordance with the message structure shown in Fig.

The server 330 user interface recognizes indicator 1214 command as a control command or request and in response sends a message command to the controller 332 functions (figure 3), which reacts according to the appropriate implementation of the function, i.e. the volume of the TV.

In the case of interactive commands 1218 (for example, a user wants to view the album cover), when you need data from the server 330 user interface, the device 1200 sends to the server 330 user interf is ISA request 1220 team. The server 330 user interface responds with a confirmation 1222 commands containing the required data, which is returned to the device 1200.

In the case of unexpected interactive commands 1224 (for example, the user has inserted the DVD in the DVD player or disconnected component), the server 330 user interface just tells the device 1200 about this event by sending an indicator 1226 command.

On Fig shows the block diagram of the processing of the message, showing how the device 1300, such as a remote control that transmits a radio frequency commands, interacts with the API figure 11. Initially, the device 1300 sends "raw" radio frequency command 1302. The server 330 user interface receives radio frequency command, and converts (1304) in the message area/function/event/event type is shown figure 11. Then, the converted message is sent (1306) to the controller 332 functions, which performs a response action under appropriate implementation of the function.

On Fig shows the block diagram of the processing of the message, showing how the DVD player output format Sony/Philips Digital Interconnect (S/PDIF) can be used as the device management API figure 11. In a normal DVD player (or just the chip decoder, realizowany function DVD player) 1400 installed a special DVD, which may contain, for example, interactive or controlled by the menu of the video image, which provides the user with a set menu, system "control panel" or similar control options. When the user selects control options, DVD players, 1400 responds to these actions by the output of an audio stream that includes the management information; this process is described in a parallel application that you specified earlier. Output audio S/PDIF is converted by the adapter 1402 in a piece of music 1408 WiFi S/PDIF, which is transmitted over the air to the receiver 1404 S/PDIF, part of the multimedia controller 100 (Fig 1). The receiver 1404 converts the received musical fragment 1408 S/PDIF in team 1410, which is transmitted to the server 330 user interface.

Examples of functions

The following are examples of functions that can be implemented using the present invention. Specialist in the art will understand that the following description is only an example, and the present invention allows much more functionality than in the described examples, both from the point of view of the types and quantity point of view.

Features of work with video

The present invention enables the creation and use of videoconferencing, including the number of the e multipoint video conferencing. The video signals and audio signals for video conferencing can come from the Internet 140 (Fig 1), the telephone network 130 (PSTN) or from another source that is associated with the multimedia controller 100. If necessary, the video signals can be transmitted over the Internet, while the corresponding audio will be held over the telephone network of General use. This configuration can provide better sound quality compared to the videoconference, in which audio signals are transmitted over the Internet.

Another feature that is supported by the present invention, "chat", including multipoint chat. This function may be based wholly or partly on a separate Annex iChat or similar to the functionality provided by third-party vendors.

Another feature supported by the present invention, the mailbox, which can be considered as e-mail, the content of which is not text or an image, and video.

Another feature supported by the present invention, video integrated with telephony functions. This function allows you to display on the TV screen or other display picture-in-picture to display caller ID or other information related to the incoming call. This is the function may also include the display of text messaging or unified messaging service through a shared Inbox, where you can receive e-mail, video mail, voice mail, faxes, etc.

Another feature supported by the present invention, video on demand (video on demand, VoD) or videopodcasts in high or standard definition.

Another feature supported by the present invention, processing of the video image, including one or more of the following functions: color space conversion; customizable size when capturing the input signal; mutable conversion range; switching effects; processing the motion; zoning; diagonal compensation; simultaneous work with multiple inputs; reducing the three-dimensional noise; alpha blending; smart sharpen; seamless transitions; up-conversion for video image; scaling and resizing of the video; the recording, playback and editing of HD-DVD; DVD playback; the functions of DVR/PVR; decoding/encoding MPEG; recoding video; audio surround decoding (Dolby and DTS).

In the General case can be created in any known or new feature for working with video in any of the main standards for digital video encoding, including MPEG-2, MPEG-4 AVC, DivX, JPEG, BMP and PNG images.

Function messages

The present invention under the handles instant messaging. This can also facilitate the exchange of short text messages (SMS).

Features of work with sound

The present invention supports the implementation of one or more of the following functions: Internet radio; radio high quality; radio FM / AM; satellite radio.

Another feature that is supported by the present invention, a digital audio device "jukebox" with the ability to create "smart" playlists based on user preferences. This feature may provide for the organization and display of metadata about the artist and song title, and search metadata on the Internet (for example, service Gracenote® MusicID or other similar service).

Another feature supported by the present invention, karaoke, this can be used both wired and wireless microphones.

Another supported feature - recognition/speech synthesis, and such basic functionality is part of the operating system Mac OS X. in Addition, this function may wholly or partly be based on the mechanism of recognition/speech synthesis third-party compatible with multimedia controller 100.

Game features

The present invention supports interactive who's games, including online games and games in the house.

Functions of home automation and functions related to security

The present invention supports the functions of security, including remote monitoring via the Internet, and intellectual security, system management, signaling, lighting control, HVAC control, irrigation management and use of DVR/PVR for recording in the security system.

The present invention also supports remote monitoring and control of the health of the user, as well as the functions of telemedicine.

Configuration functions, management and control

As described above, the present invention allows the user to configure the multimedia controller 100 with increased ease and convenience through the use of on-screen manuals, and the like. After the initial configuration and system start-the present invention provides a function which when connected to the multimedia controller 100 of a computer or other device that may contain digital multimediabay, you can scan specific folders or areas of a computer or device on the new multimedieobjekter, previously unavailable to the controller. Any new multi is mediaobject may be automatically downloaded to the controller and stored in accordance with the library or other structure, defined.

In addition, the present invention supports, in which the multimedia controller 100 continuously enabled and/or constantly monitors and automatically detects and identifies new components in connection with the controller. In addition, after the identification of a new component, this function can inform the user about detected a new component through information on the screen, e-mail or other means and then to inform him about the new features that the user can activate using the new component.

Another feature supported by the present invention, the control channels in real time and recorded with the opportunity to "move through time".

Another feature supported by the present invention, remote synchronization of portable devices, including portable audio and video players, handheld computers, computers, etc. in Addition, the present invention supports capacity planning and preservation remote content on a DVR/PVR.

Functions of the digital music

The present invention supports audio recording, live or from another source. This function may be based wholly or partly on the GarageBand Apple Computer.

Further, the present invention supports the integration of services sale of music, including music store, iTunes, Napster ToGo, Yahoo! Music, etc.

Further, the present invention supports a mixing platform disc jockey, including one or more of the following functions: automatic mixing; synchronization of rhythms "one-click"; looping without navigation; automatic BPM counter; imitation playing vinyl records, including scratching, changing the pitch and playback in the reverse direction; a separate output for headphones and a preview of the song; a record kept of the sound.

Further, the present invention supports the electronic music Studio, including one or more of the following functions: program; map; filter; converting; display; input and output MIDI messages in real time.

Further, the present invention supports the built-in drum machine and a generator of the cyclic fragments.

Further, the present invention supports the function generator interactive display set of chords on the display.

In addition, the present invention supports the integration of musical instruments, including one or more of the following features: guitar tuner, chromatic and tonal; al the alternative editor settings; library of chords; the tool tablature; jam machine, metronome. This feature may provide for the joint performance and music playback, fully or partially based on eJamming software™ or other software from a third party.

As a digital media server

The present invention supports digital medicalcenter with integrated adapter digital multimedieobjekter. This function can also provide digital media server

that supports the distribution of video, audio, digital photos, data, voice and support the core technology audio compression, including MP3, AAC, Apple Lossless Compression, FLAC, Ogg Vorbis and Monkey's Audio.

With the diffusion of digital mediastorage around the house

The present invention supports providing one or more options the following functionality: audio throughout the house, including multi-zone, audiovisiva around the home; video around the home, including the multizone video broadcasting around the home; games around the house, including multi-zone distribution of the game throughout the house; visualization throughout your home, allowing you to transfer various visualization in different zones (rooms) independent playing different music (AudioCodes the deposits). In addition, this function allows you to implement a digital clock in the house and reminder function, including the conclusion of reminders or perform automated tasks; integration with Digital Jukebox (QuickTime/iTunes);

playback of multimedia files, is represented, Web broadcast programs and CD/DVD;

use alarms and reminders on the basis of the digital media content specified by a user, including Internet radio, MP3 and song list Digital Jukebox; automatically creating and sending email messages, including reminders, video mailbox.

Features of VOIP/telefoniert-PBX

The present invention supports the functions of providing voice over IP (voice over IP, VOIP), including integrated analog telephony adapter (analog telephony adapter, ATA), institutional exchanges IP-based (IP-PBX) and IP-keys. This function can also provide intellectual blocking calls, voice dialing, integration with the function of "color" signal callback service/support search of the subscriber and the management of incoming/outgoing calls.

For the purposes of processing incoming telephone calls may be implemented a function that retrieves caller ID (this feature is present in the phone the phone interface 270 (2), which includes the FXO interface that is described in a parallel application). The function may report or to display information about the caller ID in one or more user interfaces as needed. In addition, based on the information about the caller ID may be searching in the address book of the user to determine his presence in this book. If the address book matching, multimedia controller 100 may display in the user interface, the caller's name, image or other information instead of or together with the phone number. The advantage is that the user does not need to perform any action, in addition to the normal action to appeal to the telephone.

For the purposes of processing an outgoing telephone calls may be the accumulation of dialed digits after the user lifts the handset of the phone and begins to dial a number (the ability to detect DTMF tone is present in the telephone interface 270, which includes the FXS interface). In this case also searched and called number, and to determine if a call to any of the user's address book. If a match is found, the user may be given the option to call (they can be offered to the user by phone or shown on a video screen), associated with the subscriber for the call. For example, if the address book indicates that the called subscriber has support for video calls, Skype account, iChat, or similar services, the user can select any of these options to make a call. The user can select the call simply by pressing a button on your phone by selecting the option on the touch screen or any other of a multitude of user interfaces that are supported in the present invention. In this case, the user also does not need to know any special commands or complex functional steps, because he or she just use the phone in normal mode.

Can be also implemented other features that allow the user to handle the phone in the normal way, but with the ability to open or close the gate, garage door, turn on the lights, etc.

Functions with network access

The present invention supports the service of a personal assistant or Concierge to obtain, organize and display entertainment or other information within a home or other environment. Such a function may include displaying information on a screen or in another environment, user-defined; it can be information about the weather, sports, stock to which tirowka, as well as buying tickets over the network, the reservation across the network, e-mail, create a shopping list and sync with a pocket PC or other portable devices, prescriptions, and reports of traffic, including video content.

Although certain embodiments of the implementation of the present invention, described above, uses a variety of functionality provided by the operating system Mac OS X (such as Automaton, Applescript), the present invention completely does not require a specific operating system. The present invention, including, in particular, this aspect, as the programming functions can be implemented based on any desired operating system, including Windows and Linux, but not limited to.

The above description relates to specific variants of implementation of the present invention. On the other hand, it is obvious that the described embodiments of may be other changes and modifications to achieve some or all of their benefits. In addition, procedures or processes may be implemented in hardware, software, in the form of machine-readable media on which are software commands, firmware or a combination thereof. Thus, the purpose of the attached formula and the finding is to cover all such changes and modifications within the essence and scope of the invention.

1. Control system media with authoring environment for the programmable functions of this system, which includes at least one component profile containing information about a physical characteristic of a predefined audio/video components that can be connected to this system, one or more control commands that are recognized by the specified audio/video components, and one or more audio/video, performed the specified audio/video components; at least one configuration of a zone that contains information about the identification of many audio/video components in one or more predefined areas the conjunction of the specified audio/video components among themselves, and one or more types of controllers available to the user in said pre-defined zones; the configuration of the connections, which contains information about the relationship of audio/video components to each other; at least one rule of the function, which contains information about which audio audio components necessary to implement a predefined programmable functions, and how to communicate audio/video components implementing these AU the IO/audio, when implementing these pre-defined functions, and compiler configurations made with the possibility of receiving as input at least one profile component, configuration, area, configuration, connections, and rules function, and generating as output the implementation of the function describing the use of the above specific group of audio/video components to provide the specified function.

2. The system according to claim 1, characterized in that at least one profile component includes one or more physical inputs or outputs audio/video components.

3. The system according to claim 2, characterized in that the description of one or more physical inputs or outputs includes information about the type of connector and the signal type.

4. The system according to claim 1, characterized in that at least one profile component includes one or more messages that may be generated by the specified audio/video component to inform about the action or state.

5. The system according to claim 1, characterized in that at least one profile component includes information of interchangeable modules that can be installed in the specified audio/video components.

6. The system according to claim 1, characterized in that at least one profile component includes the formation of many audio/video, who can carry out the specified component.

7. The system according to claim 1, characterized in that at least one zone configuration includes a description of the user-assigned options for audio/video components are specified in a predefined area.

8. The system according to claim 1, characterized in that the configuration of compounds includes one or more physical connections between one or more inputs or outputs at least one audio/video components and one or more inputs or outputs programmable multimedia controller.

9. The system according to claim 1, characterized in that the configuration of compounds includes one or more physical connections between one or more inputs or outputs of at least two audio/video components.

10. The system according to claim 1, characterized in that at least one profile component has the form of an XML file (extensible markup language).

11. The system according to claim 1, characterized in that at least one configuration zone has the form of an XML file.

12. The system according to claim 1, characterized in that the configuration of the connection has the form of an XML file.

13. The system according to claim 1, characterized in that at least one rule function has the form of an XML file.

14. Systems is according to claim 1, characterized in that it further includes a generator workflow is configured to generate for the specified implementation functions graphical workflow that represents a graphical representation of the specified implementation.

15. The system according to claim 1, characterized in that it further includes a generator graphical workflow is configured to generate for the specified implementation functions executable program corresponding to the specified implementation.

16. The system according to claim 1, characterized in that it further includes: generating a graphical workflow that is configured to generate for the specified implementation functions graphical workflow that represents a graphical representation of the specified implementation, and the executable program corresponding to the specified implementation; graphical programming environment in which the specified graphical workflow can be viewed and changed by the user, and the user make changes to the specified graphical workflow specified executable program is automatically changed to conform with these changes.

17. The system according to claim 1, characterized in that it includes a processing subsystem containing Myung is our least two universal personal computer, having an external storage device, and the first of these computers is selected as the primary computer, and the second of these computers is selected as a secondary computer, the specified second computer has a capability to take on the role of a host computer in case of failure of the specified first computer.

18. The system according to claim 1, characterized in that the predefined function is a function of videoconferencing carried out with the cooperation of the TV, phone, Internet and telephone network of General use.