CN100418157C - Audio-visual system - Google Patents

Abstract

The invention discloses an audio-visual video system, which utilizes a video camera (CCD) on a web interface to simultaneously display images of multiple people on the screen of the web interface, so that each participant can see each other's images ; In addition, personal conversations can also be broadcast on the web interface through the microphone at the same time, so as to achieve the purpose of mixing conversations; moreover, it can also have multiple functions for uploading files, whiteboard images, drawing tools and storing meeting records on the web interface. Function.

Description

Audio-visual system

technical field

The present invention relates to a multimedia technology, especially a kind of video that allows multiple people to see online participants in the same chat room at the same time, and can support multiple people to mix and speak at the same time, and also provides drawing tools, whiteboards, and file sharing ......and other functions to solve the inconvenience of modern multinational companies and groups when holding meetings. Audio-visual video system.

Background technique

With the development of transportation and the reduction of human language barriers, the whole world is like a global village, and there are more and more multinational companies and groups. If a large company or group can have a good operating condition, its internal It is unavoidable to hold various meetings in a timely manner to communicate and promote policies; when the early technology was not so advanced, when such large multinational companies held large meetings, cadres at all levels had to travel thousands of miles from various strongholds in various countries Traveling all the way back to the head office for meetings not only wastes human resources and transportation costs, but most importantly wastes a lot of precious time, causing great inconvenience and distress.

Later, after the gradual development of science and technology, many products were gradually developed, such as: computers, the Internet, etc. were developed one after another, and some companies also began to use the Internet to convey information or hold meetings, etc., and many people I also started to use the Internet to make friends, or to chat with netizens from all over the world, etc., but at that time, due to the limited network bandwidth, they all used the pure text chat interface to conduct conversations in the form of text conversations.

For example, with the advancement of science and technology, the network bandwidth has also developed from the early 14.4k, 28.8k... to 56k, and even the speed of hundreds of K, several M of broadband network, such a fast speed As a result, all kinds of animations and online audio-visual broadcasts have become popular on the Internet, full of various animation films, real-time audio-visual news, audio-visual video systems...etc. At this time, whether it is a company or an individual user, they can use a video camera (CCD) and a microphone to conduct video and audio conversations with others. It is convenient for holding meetings, conveying messages or chatting, making friends, etc.

However, the use of the Internet to hold meetings, chat... etc. can achieve the expected effects of saving communication costs, reducing expensive long-distance or international telephone charges or transportation costs, and avoiding wasting precious time, but its operational use But it has many disadvantages, such as:

1. Most of the current systems that can provide video conferencing need to download software first, so that it can be installed on a personal computer and used, which creates an entry barrier for users.

2. Currently used video conferencing systems, such as: netmeeting and cuseeme, although they do not limit one-on-one conversations, but they are client-side software, and cannot achieve the goal of video conferencing, leading large companies to hold meetings inconvenience and trouble.

3. Currently used video conferencing systems, such as: cuseeme, although it has a one-to-many connection, but its quality is not very good, and it has no video conferencing function, and cannot meet the company's needs for holding meetings.

4. The video conferencing system with web interface currently mostly uses audio chatting instead of images, and individuals need to grab the right to speak before speaking, which cannot achieve sound mixing effects, and is not humane enough in communication. Among them, cuseeme Although there is a mixing chat room with a web interface, the sound processing is not good, and almost no one talks with voice.

Contents of the invention

In order to improve the defects of the prior art, one of the objects of the present invention is to provide an audio-visual video system, which utilizes a main router (Router) to connect with the routers (Routers) at the ISP end of the array, so that the user end can pass through the ISP end on the web interface. The router transmits and captures images from the server (server), and then broadcasts them through the main router to solve the bandwidth problem; in this way, it can provide remote users with video, audio, and text chat interfaces on the web interface.. ... and other functions to meet the needs of basic video conferencing.

The second object of the present invention is to provide an audio-visual system, wherein the audio-visual system of the present invention can use uploaded files so that all participants can see the contents of the files for discussion and research.

The third object of the present invention is to provide an audio-visual system, wherein, the audio-visual system of the present invention can use a whiteboard screen to be opened, so that any participant can scribble on the whiteboard and broadcast it to other participants. To assist the discussion and emphasis of the key points of the meeting.

The fourth object of the present invention is to provide an audio-visual system, wherein, the audio-visual system of the present invention can also open a drawing tool at the same time, so that participants can summarize or emphasize key points on shared documents and whiteboards.

The fifth object of the present invention is to provide an audio-visual system, wherein the audio-visual system of the present invention can also make the discussed documents on the computer screen, or meeting results such as whiteboard screens, into picture files or images Files etc. are stored.

The sixth object of the present invention is to provide an audio-visual system, wherein the audio-visual system of the present invention can also have a voting function for participants to vote on various event issues.

The audio-visual video system of the present invention includes: the main router is connected with the routers at the ISP end of the array, and individual users or users in public places pass through the router at the ISP end on the web interface, and the server transmits images, voices, texts and drawings, and then passes through the main router. Broadcast to the routers of each group of ISP end; among them, one client end captures the image data through the video camera and compresses it, uploads it by FTP and stores it in the folder of the server end, and uses the voice component of the client end to notify other users through the direct playback server of the server Update the screen on the client side, so that the web browsers of other clients can download the updated screen from the file folder on the server side; each client end transmits the voice data to the server end through the network connection, and the server mixes the voice data of each client end, and then transmits For each client; one client uses the Voice component to upload the text data to the direct play server of the server, and then the direct play server transmits the text data to other clients, and the other client uses the Voice component to display the text data; one user The user at the end draws on the screen of the web interface, uses the Voice component to upload the drawing data to the direct playback server of the server, and then the direct playback server transmits the drawing data to other clients, and the Voice components of other clients receive the drawing data and draw graphics.

By the above, compared with the prior art, the present invention has the following advantages:

1. The present invention can be connected to each other through the main router (Router) and the router (Router) at the ISP end of the array, so that personal or public places... and other client terminals can be connected to the server (Server) through the router on the ISP end through the web interface. Perform actions such as transmitting, capturing images, etc., and then broadcast them to the router on the ISP side through the main router, so as to solve the current bandwidth problem.

2. The present invention can use a network camera (CCD) to capture images and upload them to the web interface, so that each participant can watch the images of other participants.

3. The present invention can also receive and upload the voices of each participant to a web interface through the microphone, so that each participant can achieve the effect of multi-person mixing and talking at the same time.

4. The audio-visual system of the present invention can upload files to the web interface, so that all participants can see the contents of the files for discussion and research.

5. The audio-visual video system of the present invention can open a whiteboard image on the web interface, and allow participants to scribble on it, so as to assist the discussion and explanation of the key points of the meeting.

6. The audio-visual system of the present invention can open a drawing tool on the web interface at the same time, so that the participants can make key points, abstracts, annotations, and emphasis on the shared documents and materials and the whiteboard used.

7. The audio-visual video system of the present invention can also store the meeting results such as the discussed documents or whiteboard screens... into picture files or video files.

Description of drawings

Following is the accompanying drawing of the present invention:

Fig. 1: router connection schematic diagram of the present invention;

Fig. 2: A schematic diagram of the connection and transmission of information between the user and the server in the present invention;

Fig. 3: schematic diagram (1) of the flow chart of the audio-visual system of the present invention;

Fig. 4: Schematic diagram of the flow chart of the audio-visual system of the present invention (2);

Fig. 5: schematic diagram of the flow chart of the audio-visual system of the present invention (3);

Fig. 6: schematic diagram (four) of the flow chart of the audio-visual system of the present invention;

Figure 7: a block diagram of the online use process of the present invention;

Figure 8: a schematic diagram of the voice connection mode of the present invention;

Figure 9: Schematic diagram of the image connection method of the present invention;

Figure 10: Schematic diagram of the image operation mechanism of the present invention;

Figure 11: a schematic diagram of the text (chat) operating mechanism of the present invention;

Figure 12: Schematic diagram of the operating mechanism of the whiteboard of the present invention.

Description of component parameters in the figure:

1 Main router 2 ISP-side router

3 personal clients 4 public places clients

5 servers

Detailed ways

Below in conjunction with accompanying drawing, the present invention is described in further detail:

First of all, please refer to Fig. 1, shown in 2, the present invention utilizes a main router (Router) 1 and the router (Router) 2 of array ISP end to connect each other, make the user such as personal client terminal 3 or public place client terminal 4..., All can transmit images, sounds, texts, captured images, screen images, etc. from the server (server) 5 through the router 2 on the ISP side through the web interface, and then broadcast to other groups of ISPs through the main router 1 Router 2 at the end to solve the current bandwidth problem, and can use the bandwidth to display the images of several participants on the screen at the same time on the web interface, and allow multiple people to mix and speak at the same time, etc., in order to Can use the network to accomplish more things and achieve more goals.

Please refer to FIGS. 3-6 again. The main structure of the audio-visual video system of the present invention enables each remote user to realize a video conference with hosting function, voting function, whiteboard function, file sharing function, etc. through the web interface. Under the moderation function, the moderator has the right to change the password of the chat room, kick people out of the meeting room, specify the right to speak, and transfer the identity of the moderator to others. The designated person cannot speak, and the designated person can speak as a default value, and there is no other icon on the user or the moderator side; when the designated person can speak, the moderator will display the picture of the designated speech next to the user's CCD image designated to speak In this way, it is clear who can speak now, and the right to speak of someone can be canceled at any time to designate others to speak. Users can also ask the moderator to speak, and the moderator decides who can speak; when the designated person cannot speak, the moderator will pass restrictions The icon of the restricted speech is displayed next to the CCD image of the speaking user, so that it is clear who is restricted to speak, and the modification of the restriction can be made at any time (opening the restricted person or restricting new persons), and the restricted user can also report to the host People request to speak, and the moderator decides whether to lift the restriction. When transferring the host right, first select in the user list, ask the selected user whether they agree, if yes, transfer the right of choice to the user, if not, re-select in the user list. Under the voting function, it provides real-time voting on issues, and only one issue can exist at the same time. After setting the topic attributes, such as single-choice or multiple-choice, set the voting content, including registered or anonymous, voting duration and setting The answer options of the question, once set and sent, can not be modified again, for the participants to vote. If all the participants vote or the voting time is over, the voting ends, and the results are displayed in the text chat area and recorded in the database. for managers to view. Under the whiteboard function, a whiteboard drawing tool is provided for participants to write and draw on the whiteboard, which can increase the efficiency of meeting discussions. Under the file sharing function, users can upload the files they want to share to the server in the form of pictures to share with other participants, and allow participants to make text notes on the files or use drawing tools to mark them at the same time.

Please refer to Fig. 7 again, the audio-visual video system of the present invention, which is normally set up with a web interface, can be divided into two types: open and closed. When entering a closed conference room, a password is required. When entering the home page of the conference room , the system first asks whether DirectX 8 is installed, if not, it will ask the user to download and install it online, after the download and installation is complete, it will ask whether there is a dialog frame installed, if not, please download and install it online, if necessary After the components are complete, the meeting room can only be entered by members. If not, there is an online application service. According to the listed meeting rooms that can be accessed, users can choose the meeting room they want to join, and then select the meeting room they want to enter. At the same time, you need to enter the account number, password, and anonymous name in the meeting room. After selecting the meeting room, the system will judge whether it is the first participant. If so, you need to set the entry rules for other participants. If not, you need to follow the entry rules. After the approval action is successful, it will be determined whether there is a video camera (CCD) or not, and the image of the participants will be displayed in the conference room with a CCD image or a static image file.

In addition, please refer to Fig. 8 again, the voice connection mode of this system is to establish the voice function by the client (Client) and transmit the voice data to the server end (Server) by establishing a network connection; and Fig. 9 Shown is the image connection method of the system. It first captures the image from the video camera (CCD) and saves it as a BMP file, and then converts the BMP file into JPEG format, then establishes an FTP connection and uploads it to the server via FTP. to the image folder on the server for other participants to download images.

Also, please refer to Fig. 10 again, which is the image operation mechanism of the system, which is to capture and compress the image by the video camera (CCD) at the client (Client), and then upload and store it on the server (Server) by FTP. ), and use the Voice component on the client (Client) to notify other clients (Client) to update the screen through the Direct Play Server on the server (Server), and make the Web Browsers of other clients (Client) be played by the server Download the update screen in the folder of the server (Server); and Figure 11 shows the operation mechanism of the text (Chat) of the system. After the client (Client) delivers the content of the text (Chat) to the Voice component, it will The message is uploaded to the Direct Play Server on the server side (Server), and then it will throw the message to other people, and it will be displayed on the screen by other client side (Client) with Voice components, and Figure 12 shows the system The operation mechanism of the whiteboard is that the user of the client (Client) draws on the screen of the web interface, and the program will notify the Voice component of the drawing coordinates, and upload the message to the Direct Play Server of the server (Server), by It throws the information to the Voice components of other clients (Client), and then the Voice components hand over the received coordinates to the whiteboard program to draw, and reproduce the geometric figures through the web interface.

Claims (8)

1. video-audio system, comprise: the router by active router and array ISP end links mutually, personal user or public place user are by the router of holding by ISP on the web interface, transmit image, voice, literal and drawing by server, be broadcast to the router of respectively organizing the ISP end by active router again;

Wherein, after one user side compresses by USB PC Video Camera pick-up image data, upload and be stored in by FTP in the information kit of server end, and the Voice element that utilizes user side through server play-over other user side frame update of server notification, the web browser that makes other user sides is by down loading updating picture in the information kit of server end;

Each user side transfers to server end by network connectivity with the voice data, and server is transferred to each user side after each user side voice data is carried out the audio mixing processing;

One user side utilizes the Voice element to play-over server with what written historical materials uploaded onto the server, by play-overing server written historical materials is transferred to other user sides again, and other user sides utilize the Voice element that written historical materials is shown;

The user of one user side draws on the picture of web interface, utilize the Voice element to play-over server with what drawing data uploaded onto the server, by play-overing server drawing data is transferred to other user sides again, other user sides Voice element receives drawing data and draws figure.

2. video-audio system as claimed in claim 1 is characterized in that: described USB PC Video Camera pick-up image is deposited journey BMP shelves, again the BMP shelves are changed into jpeg format after, set up the FTP line and transfer in the image data folder that FTP uploaded and be stored in server end.

3. video-audio system as claimed in claim 1 is characterized in that: the voice data that receives each user side by microphone.

4. video-audio system as claimed in claim 1 is characterized in that: described drawing data is a drawing coordinate.

5. video-audio system as claimed in claim 1, it is characterized in that: function is presided over by this system, the host can change the chatroom password or the people is kicked out of meeting room, but the specified speech authority all can be made a speech for everyone, or the designator can make a speech, also or the designator can not make a speech, the host also can transfer the possession of and give others.

6. video-audio system as claimed in claim 1 is characterized in that: this system has voting function, and the function of immediately subject under discussion being put to the vote is provided, and in has set theme attribute and the content of voting after, the confession participant operation of voting.

7. video-audio system as claimed in claim 1 is characterized in that: this system has white boarding, and the blank drawing instrument can be provided, and writes on blank, draws for the participant, and can increase the efficient that meeting is carried out, talked about.

8. video-audio system as claimed in claim 1 is characterized in that: this system has file and shares function, documentation can be uploaded with other participants and be shared, and can allow the participant do the literal annotation or utilize drawing instrument to make marks on file simultaneously.

Images