KR100755100B1 - Apparatus for versatile video service in multicast-based multi-party collaborative environments and method therefor - Google Patents

Abstract

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to video service technology in a multicast-based multi-party collaboration system for applying real-time streaming video to a remote collaboration environment using various formats of video formats. The network-based collaborative terminal supports streaming video input / output of various formats, establishes a multimedia session between video conferencing terminals in a remote location, and exchanges multimedia data information to perform a video conferencing function. According to the present invention, in order to overcome the disadvantage of using a limited format video format in a conventional video conferencing and remote collaboration support system, various formats of video formats and video programs are supported using a flexible multicast group assignment policy. In addition, the multimedia service features that can be provided in the form of session information, and spreads the session information to the video conferencing terminals connected to the same session to transmit the various types of multimedia data in advance to analyze and receive them By carrying out preparation, it is possible to provide a high quality video conference service.

High Definition Video Format, Multi-Party Collaboration Environment, Multimedia Session Announcement

Description

Apparatus and method for video service in multicast-based multi-party collaboration system

1 is a block diagram illustrating a multicast-based multi-party collaboration system for implementing a video service device according to the present invention;

FIG. 2 is a detailed block diagram illustrating a media service unit of FIG. 1, specifically, an image producer service unit.

FIG. 3 is a detailed block diagram of the media service unit of FIG. 1, specifically, the video consumer service unit. FIG.

<Explanation of symbols for main parts of the drawings>

100: collaboration terminal 102: service control unit

104/1 to 104 / n: Media service unit 200: Venue server

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for servicing multi-party video conferencing, and more particularly, to a video service apparatus and method in a multi-cast based multi-party collaboration system suitable for serving various external video programs.

Commonly used multi-party video conferencing and collaboration system can be divided into web conference system, enterprise conference system, and multi-party remote collaboration system.

The web conferencing system is designed to conduct video conferencing between individuals by connecting a USB web camera from one desktop computer to a personal computer.In the case of an enterprise conference system, a separate conferencing hardware and a dedicated camera / microphone system are provided. It was developed to support remote collaboration between limited participants.

In addition to the features of these video conferencing products, multi-party remote collaboration systems have been developed that can be used to configure a remote collaboration environment by adding sharing functions for various services and applications such as application sharing and data sharing. Grid) and VRVS.

In the conventional multi-party collaboration system, due to the limited form of video service structure, image information can be exchanged with a designated video program. For example, Polycom's widely used H.323-based video conferencing products cannot use various codecs and video programs because of the H.261 codec-dependent structure, making it difficult to meet users' demand for better quality.

Therefore, providing a flexible and scalable video service in a multilateral collaboration system means that a structure for accommodating various video codecs and video programs must be provided. For example, it must be able to support high-definition video formats such as digital video (DV) and high-definition digital video (HDV), and also need to have a connection function for running an external video program.

In accordance with the above-described requirements, the present invention provides a multicast-based multi-party collaboration capable of applying real-time streaming video of various formats to a remote collaboration environment together with a video service basically provided in a multi-party collaboration system. It is an object of the present invention to provide an image service apparatus and method in a system.

According to an embodiment of the present invention for achieving the above object, a plurality of collaboration terminals for providing video information to a user by supporting at least one video format using a multicast group assignment policy, and the plurality of collaboration terminals The present invention provides a video service device in a multicast-based multi-party collaboration system including a Venue server that interconnects and exchanges arbitrary video service information of each collaboration terminal to provide a virtual space for collaboration.

According to another embodiment for achieving the object of the present invention, the network-based collaboration terminal consisting of a plurality of video producer / receiver service unit supports at least one video format in real time to provide the user with the video information, A video service method in a multicast-based multi-party collaboration system in which video service information between network-based collaborative terminals is jointly managed by a Venue server. Requesting the multicast group address to the Venue server as many as the number of multicast group addresses required by the video transmitting program, and the image producer service unit desires the multicast group address based on the multicast group allocation policy of the Venue server. Far way Allocating a cast group address, generating service attribute information based on the assigned multicast group address, registering the generated service attribute information with the Venue server, and an optional video receiver service unit. Retrieving service property information registered in the Venue server and receiving image information requested by a user, and executing and displaying the received image information in the image receiver service unit. It provides a video service method in the system.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention.

Prior to the description of the embodiments, the matters to be considered for various image support and the purpose of the present invention for this purpose are described as follows.

First, in order to apply real-time streaming video to a remote collaboration environment using various video formats, it is necessary to consider the video codec, program type, and multicast group address allocation method for video transmission. For example, a cooperative terminal called A may provide two kinds of video services such as DV and HDV, but may support more video services such as uncompressed HD and stereo HD later. For this purpose, a method for connecting external video codecs and programs to a video service must be provided. At the same time, each video program may have a different video delivery method in terms of multicast delivery. For example, a program that delivers DV delivers a picture to one multicast group, while a program that delivers hierarchical coded pictures may deliver a layered picture to two or more multicast groups, respectively. As such, the video service must be able to handle how many multicast group addresses the video program needs to deliver the video. To this end, the present invention proposes a video service method capable of variously configuring multicast address allocation.

The second consideration is a negotiation process with a Venue server for exchanging arbitrary video service information between cooperative terminals and delivering mutual media information. Here, Venue Server plays a central role in managing the collaborative environment by providing a virtual space where participants can collaborate using the provided collaborative services. Collaborative terminals provide and use video services according to the producer-consumer model. That is, the video transmission side registers the video producer service in the Venue server, and the video service property is delivered together. On the video receiving side, the video consumer service searches for registered services from the Venue server and receives a video service matching the desired video service attribute. In such a model, a specific role and negotiation process for the negotiation process between the collaboration terminals and the Venue server should be defined.

1 is a block diagram of a multicast-based multi-party collaboration system for implementing a video service device according to the present invention, and includes a collaboration terminal 100 and a venue server 200.

As shown in FIG. 1, the collaboration terminal 100 is a software module that enables a user to use a collaboration service, and in terms of media support, the service control unit 102 and a plurality of media service units 104/1 to 104. / n). In this case, although one collaboration terminal is illustrated in FIG. 1, this is only limited as an embodiment for convenience of description and does not characterize the present invention. That is, since the Venue server 200 according to the present embodiment has to implement collaboration in a virtual collaboration space by sharing media services in terms of media support, at least one collaboration terminal is mutually centered on the Venue Server 200. It may be configured to be connected, which will be more apparent by the claims that follow.

Here, the interconnection of the collaboration terminals refers to a negotiation process for enabling the collaboration terminals participating in the same virtual collaboration space to exchange media service information with each other so that they can share media service information with each other. .

As described above, the collaboration terminal 100 includes a service control unit 102 and a plurality of media service units 104/1 to 104 / n.

The service control unit 102 manages (discovers and controls media services) the media service units 104/1 to 104 / n of the cooperative terminal 100, and negotiates with the Venue server 200. Represents media services of a collaboration node. In addition, the service control unit 102 provides a communication function for mutual communication between the Venue server 200 and the media service unit 104/1 to 104 / n.

The media service unit 104/1 to 104 / n provides various communication methods such as video, audio, whiteboard, and text chat. In the case of the media service unit 104/1 to 104 / n in the present embodiment that provides a video service, the media service unit 104/1 to 104 / n may be divided into a transmitting side and a receiving side. The calling party will be called a video receiver service unit.

FIG. 2 is a diagram showing a detailed configuration of the video producer service unit, for example, the first media service unit 104/1. The video input unit 10/1 to 10 / n and the image transmission program unit 12 / are shown in FIG. 1-12 / n), service attribute definition module 14, and service attribute generation module 16.

The video input units 10/1 to 10 / n are devices for acquiring an image for transmission from the cooperative terminal 100. For example, a digital camcorder supporting DV or HDV may be applied.

The image transmission program unit 12/1 to 12 / n transmits the image obtained from the video input unit 10/1 to 10 / n to the multicast group, and the image producer service unit 104/1. The multicast group address is requested by the Venue Server 200 as many times as the number of multicast group addresses required by the image transmission program unit 12/1 to 12 / n. In this case, the multicast group allocation policy for supporting various transmission schemes may be divided into a case of using a common multicast group and a case of using N multicast groups, as shown in Table 1 below.

If you use a common multicast group  When a plurality of video sources are mixed and delivered in one multicast using Real-time Transport Protocol (RTP) mixing, for example, a video conference tool (VIC). When using N multicast groups 1 multicast group Digital Video Transport System (DVTS), Video LAN Client (VLC) 2 multicast groups Stereo HD Transmission, Uncompressed HD Transmission 3 or more multicast groups Hierarchical coded video transmission

Based on the table 1, the Venue server 200 allocates a multicast group address according to a method desired by the video producer service unit 104/1.

Meanwhile, the service attribute definition module 14 of FIG. 2 allows a user to select an image format and a program to be sent, and the service attribute generation module 16 multicasts with the image format selected by the service attribute definition module 14. It plays a role of generating service attribute information according to Session Description Protocol (SDP) standard based on group address. At this time, the service attribute information is composed of a codec, a video application, a bandwidth, a multicast address, a provider name, and a session name, as shown in Table 2 below.

field Service attribute information v 0 o 'GIST' 31203218 31203218 203.239.52.123 s VLC i Microsoft DV / VCR Camcorder e [email protected] m video 50624 RTP / AVP 33 i RightView c IN IP4 224.1.3.121/127 b AS: 19200 m video 50624 RTP / AVP 33 i Leftview c IN IP4 224.1.3.122/127 b AS: 19200

[Table 2] is an example of service attribute information generated by the video producer service unit 104/1. In this embodiment, SDP message is a video service attribute for transmitting stereo HD video using two multicast groups. It is characterized by.

As shown in Table 2, the "o" field contains the user name, and the "s" field contains the name of the imaging tool. The "i" field contains the camera's "friendly name", and the "m" field contains the codec's unique number in the right column of RTP / AVP. It is number 33 for MPEG2-TS. The "i", "c", and "b" fields below the "m" field indicate the media description, connection information, and bandwidths required, respectively. Using two multicast groups, we create two "m" fields and their associated "I", "c", and "b" fields.

The service information generated in this way is registered in the venue server 200. In this case, the communication function provided by the service control unit 102 is used to communicate with the Venue server 200. The service registration information is notified to the Venue server 200, and the service registration information is periodically updated for validation. Use the Session Announcement Protocol (SAP) to deliver to (200).

Venue server 200 analyzes the SAP message delivered from the collaboration terminal 100 to obtain the SDP message, and again analyzes the SDP message and adds the media service attribute information obtained to the session information. Session information refers to meta information for configuring the same virtual co-working space, and session information in terms of media service refers to a list of media services provided by one session and details thereof. For example, a video producer service list, a voice service list, a whiteboard service list, and the like may be examples.

In particular, in the case of the video producer service list, as shown in [Table 1], the case of using a common multicast group and the case of using N multicast groups are stored separately. In case of a video program using a common multicast group, since all collaborative terminals use the same multicast group for video transmission, the common multicast group is used instead of registering service attribute information in the video producer service list for each sender. The service attribute information is registered in accordance with the type of video program. On the other hand, for a video program using N multicast groups, service attribute information is registered in a video producer service list for each sender.

FIG. 3 is a diagram showing a detailed configuration of the video receiver service unit, for example, the second media service unit 104/2, and includes a video input unit 20/1 to 20 / n and a video receiving program unit 22 /. 1 to 22 / n), a service attribute analysis module 24, a service loader 26, and a service viewer 28.

The video input units 20/1 to 20 / n and the video receiving program units 22/1 to 22 / n of the video receiver service unit 104/2 have the same configuration as the video sender service unit 104/1 described above. In order to avoid duplication, a detailed description will be omitted.

In FIG. 3, the service viewer 28 serves to display, in real time, session information (including a list of media services provided by all the collaboration terminals) registered in the venue server 200.

The session information displayed in the service viewer 28 is provided to the service attribute analysis module 24, which converts the session information into information that can be understood by the user and displays the information through the service viewer 28. It has a role to enable it.

When the converted session information is displayed through the service viewer 28, the user can select a media service that he wants to receive. For example, if a user wants to view DV video provided by another collaboration terminal, the user selects a DV video service property. The service viewer 28 executes the service loader 26 using the media service attribute requested by the user.

The service loader 26 performs two roles, firstly, monitoring whether the video producer service unit 104/1 continuously provides a service, and if the service is stopped, terminating the corresponding video program. Do it. For example, when the service producer service unit 104/1 transmits the SAP end message to the venue server 200, the venue server 200 deletes the corresponding video service attribute, and the video service of the venue server 200 is provided. As the attribute is deleted, the service loader 26 ends the video program.

On the other hand, the service viewer 28 periodically checks whether the video service property information being received is included in the venue server 200, and if the video service property information being received is not included in the venue server 200. The service is considered to have been suspended. If the service is being received, the video program ends.

The second role of the service loader 26 detects when the already executed video program is terminated by the user and notifies the service viewer 28 whether the video service has been received, thereby showing that the current video service is in the state of being stopped. Will. For example, if the user wants to stop the video service currently being received, the video program is terminated. The service loader 26 periodically detects whether the video program corresponding to the video service being received is being performed or is terminated. If not, the service viewer 28 notifies that the video service is stopped.

As described above, the embodiments of the present invention have been described in detail, but the present invention is not limited to these embodiments, and various modifications may be made by those skilled in the art within the spirit and scope of the present invention described in the claims below.

According to the present invention, by introducing various video formats into a multi-party video conferencing, it is possible to provide a basis for using advanced video codecs, thereby improving the quality of collaboration services of users. In other words, because it supports various video formats, even if a better codec or video program is developed, the codec can be easily changed, thereby providing a more active and active video service environment.

Claims (13)

delete delete delete A plurality of collaboration terminals that support at least one video format using a multicast group assignment policy to provide video information to a user; And a Venue server interconnecting the plurality of collaboration terminals and exchanging arbitrary video service information of each collaboration terminal to provide a virtual space for collaboration. The first collaboration terminal of the plurality of collaboration terminals, A video for acquiring arbitrary video information and requesting the multicast group address to the Venue server as many as the number of multicast group addresses, and registering the video service information generated according to the multicast group address assigned by the Venue server to the Venue server. Producer service department, A video receiver service unit for searching for video service information registered from the Venue server and receiving a video service corresponding to a desired video service property; And a service control unit for controlling the video producer service unit and the video receiver service unit and providing a communication function for mutual communication between the Venue server, the image producer service unit, and the video receiver service unit. The video receiver service unit, A service viewer for displaying in real time session information including a list of media services provided by the collaboration terminals registered in the venue server; A service property analysis module for converting the displayed session information into information understandable to a user and displaying the same through the service viewer; When a media service is selected by the user, the video producer service unit monitors whether the service is continuously provided and terminates the video program when the service is stopped, and when the already executed video program is terminated by the user. The service loader which detects this and notifies the service viewer of the reception of the video service and informs that the current video service is in the stopped state. Video service device in a multicast-based multi-party collaboration system comprising a. The method of claim 4, wherein The service viewer periodically checks whether the video service property information being received is included in the venue server, and the service service is stopped when the video service property information being received is not included in the venue server. And a video service device in a multicast-based multi-party collaboration system. delete A plurality of collaboration terminals that support at least one video format using a multicast group assignment policy to provide video information to a user; Interconnecting the plurality of collaboration terminals and providing virtual space for collaboration by exchanging arbitrary video service information of each collaboration terminal, analyzing SAP messages delivered from the plurality of collaboration terminals to obtain an SDP message; And adding the media service attribute information obtained by analyzing the obtained SDP message to the session information, and when the session information is a video producer service list, a plurality of video programs use a common multicast group to transmit a multicast address. Venue server to allocate Video service device in a multicast-based multi-party collaboration system comprising a. A plurality of collaboration terminals that support at least one video format using a multicast group assignment policy to provide video information to a user; Interconnecting the plurality of collaboration terminals and providing virtual space for collaboration by exchanging arbitrary video service information of each collaboration terminal, analyzing SAP messages delivered from the plurality of collaboration terminals to obtain an SDP message; And adding the media service attribute information obtained by analyzing the obtained SDP message to session information, and when the session information is a video producer service list, each video program multicasts using N multicast groups. Venue server to assign addresses Video service device in a multicast-based multi-party collaboration system comprising a. delete delete delete delete delete

Images