US20030088687A1 - Method and apparatus for automatically converting source video into electronic mail messages - Google Patents
Method and apparatus for automatically converting source video into electronic mail messages Download PDFInfo
- Publication number
- US20030088687A1 US20030088687A1 US10/325,830 US32583002A US2003088687A1 US 20030088687 A1 US20030088687 A1 US 20030088687A1 US 32583002 A US32583002 A US 32583002A US 2003088687 A1 US2003088687 A1 US 2003088687A1
- Authority
- US
- United States
- Prior art keywords
- video
- electronic mail
- source
- user
- source video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims abstract description 72
- 238000012545 processing Methods 0.000 claims description 11
- 238000007726 management method Methods 0.000 claims description 10
- 230000001131 transforming effect Effects 0.000 claims description 10
- 230000004044 response Effects 0.000 claims description 5
- 238000005070 sampling Methods 0.000 claims description 4
- 238000013519 translation Methods 0.000 claims description 3
- 238000012937 correction Methods 0.000 claims description 2
- 230000001960 triggered effect Effects 0.000 claims description 2
- 238000006243 chemical reaction Methods 0.000 claims 1
- 230000008569 process Effects 0.000 description 31
- 238000004458 analytical method Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 8
- 238000013515 script Methods 0.000 description 7
- 241000283690 Bos taurus Species 0.000 description 5
- 238000004422 calculation algorithm Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 238000000605 extraction Methods 0.000 description 4
- 230000000699 topical effect Effects 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 230000009466 transformation Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000013518 transcription Methods 0.000 description 2
- 230000035897 transcription Effects 0.000 description 2
- 230000014616 translation Effects 0.000 description 2
- 241001425761 Parthenos sylvia Species 0.000 description 1
- 241000233805 Phoenix Species 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000002860 competitive effect Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/26603—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
- H04N21/25891—Management of end-user data being end-user preferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
- H04N21/4828—End-user interface for program selection for searching program descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/632—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/812—Monomedia components thereof involving advertisement data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
- H04N7/17309—Transmission or handling of upstream communications
- H04N7/17318—Direct or substantially direct transmission and handling of requests
Definitions
- the invention relates to the delivery of multimedia assets to a user. More specifically, the invention relates to a method and system for automatically identifying and transmitting video content to an electronic mail client.
- Known systems and methods for identifying and delivering video content have various disadvantages. For example, since known systems and methods for searching video typically identify entire video broadcasts or video files that are of interest to a user, a user may need to sort through a relatively large volume of irrelevant information to view a relatively small amount of relevant content. In addition, the manual labor associated with delivery of video content to a user may result in delay and/or increase the cost of delivery.
- the invention relates to a method and system for automatically identifying and transmitting video content to an electronic mail client.
- the invention relates to a method for arranging for delivery of content from a video source, including: automatically identifying a portion of at least one source video stream using a predetermined user profile; transforming the identified portion of the at least one source video stream into a destination medium; and automatically building an electronic mail message based on the destination medium and the identified portion of the at least one source video.
- the invention provides a method for arranging for the delivery of content from a video source, including: automatically identifying a portion of at least one source video stream based on relevance to a predetermined user profile; transforming the identified portion of the at least one source video stream into at least a thumbnail image and closed caption text; and automatically building an electronic mail message using the thumbnail image and the closed caption text.
- the invention provides a system for arranging the delivery of content to an electronic mail client, including: at least one video source; a user profile database; and a server coupled to the video source and the user profile database, wherein the server is configured to read profile data from the user profile database, automatically identify a portion of the at least one video source using the profile data, transform the identified portion of the at least one video source into a destination medium, and automatically build an electronic mail message using the destination medium.
- the invention provides a computer-readable storage medium configured to provide a graphical user interface for an electronic mail client, the graphical user interface including: a management feature for managing a plurality of electronic mail messages based on metadata, wherein the metadata includes at least one of broadcast source, broadcast date and duration information related to at least one corresponding source video for each of the plurality of electronic mail messages; and a view feature for viewing a selected portion of the at least one corresponding source video and a medium derived from a selected portion of the at least one corresponding source video.
- the invention provides a method for creating an electronic mail message for delivery of video information to a user including: selecting video information from at least one source video stream using user profile information; formatting the selected video information in accordance with the profile information; and populating fields of an electronic message with formatted video information and destination information in accordance with the user profile information.
- FIG. 1 demonstrates an exemplary methodology for media processing according to one embodiment of the invention.
- FIG. 2 illustrates an architecture for implementing an exemplary embodiment of the invention.
- FIG. 3 demonstrates a more specific hardware architecture according to another exemplary embodiment of the invention.
- FIG. 4 is an exemplary page view of a page viewed by a user utilizing a client according to one embodiment of the invention.
- FIG. 5 demonstrates a page view showing a content retrieval page according to the exemplary embodiment shown in FIG. 4.
- FIG. 6 is a flow diagram illustrating transformation of video source data according to one embodiment of the invention.
- FIG. 7 is a block diagram of a functional architecture for delivering video content to an electronic mail client according to one embodiment of the invention.
- FIG. 8 is a flow diagram of a process for delivering video content to an electronic mail client according to one embodiment of the invention.
- FIG. 9 is a flow diagram for mapping video metadata to an electronic mail message according to one embodiment of the invention.
- FIG. 10 is an illustration of an electronic mail message according to one embodiment of the invention.
- FIG. 11 is an illustration of an electronic mail message according to another embodiment of the invention.
- FIG. 12A is a an illustration of an exemplary graphical user interface for managing and viewing electronic mail messages having video content according to one embodiment of the invention.
- FIG. 12B is an illustration of a portion of the graphical user interface in FIG. 12A.
- the service works by recording all of the video streams of appropriate source and interest to a target audience.
- the service may record content from a collection of (or a particular one of) sports or news channels on television.
- the service may record content related to training videos, presentations or executive meetings in a business, school or other particularized environment. Recording may occur as the content is originally being broadcast (i.e., live), afterwards from recorded media, or even before the content is broadcast to its intended audience.
- the content can be segmented, analyzed and/or classified, and thereafter stored on a platform.
- the content can be broken down into its component parts, such as video, audio and/or text.
- the text can include, for example, closed caption text associated with the original transmission, text generated from an audio portion by speech recognition software, or a transcription of the audio portion created before or after the transmission. In the latter case, it becomes possible to utilize the invention in conjunction with executive speeches, conferences, corporate training, business TV, advertising, and many other sources of video which do not typically have available an associated textual basis for searching the video.
- the text provides the basis for an exemplary methodology for overcoming the above-identified problems associated with searching video in the prior art. That is, if a user wishes to search the stored content for video segments relevant to the President of the United States discussing a particular topic, then the President's name and the associated topic can be searched for within the text associated with the video segments. Whenever the President's name and the associated topic are located, an algorithm can be used to determine which portion of an entire video file actually pertains to the desired content and should therefore be extracted for delivery to the user.
- a video file comprises an entire news broadcast about a number of subjects
- the user will receive only those portions of the broadcast, if any, that pertain to the President and the particular topic desired. For example, this could include segments in which the President talks about the topic, or segments in which another talks about the topic and the President's position.
- the pertinent segments of the broadcast have been appropriately extracted, for a given user, they can be stitched together for continuous delivery to that user.
- the segments can be streamed to the user as a means of providing an easy-to-use delivery methodology for the user, and as a means of conserving bandwidth.
- Users can view the delivered multimedia asset in its entirety, skip between the assets, or view only portions of the assets, as they desire.
- a user can have access to portions of the original video file that occurred immediately before or after the extracted segments; for example, the user could choose to watch the entire original video file. Such access can be granted by including a “more” or “complete” button in a user interface.
- a profile of the user is stored which specifies criteria for searching available multimedia assets.
- the criteria may include, for example, key words and/or phrases, a source(s) of the content, etc.
- the profile can be set directly by the user via interaction with an appropriately designed graphical user interface (GUI).
- GUI graphical user interface
- the invention is capable of automatically searching the available assets on a periodic basis, and thereafter extracting, combining and delivering the compiled assets (or segments thereof, regardless of their original source) to the user.
- the invention can be utilized such that a service platform assisting in implementing the invention notifies the user whenever new multimedia assets consistent with the user's profile have been prepared.
- the invention may automatically deliver multimedia assets in accordance with a user's profile according to a predetermined schedule, such as hourly or daily. Alternatively, the invention may notify the user of the presence of desired video clips, rather than actually deliver those clips.
- the assets can be classified and indexed on-the-fly as they are received. In this way, the assets can be compared against the user's profile virtually in real-time, so that results can be provided to the user (and the user can be notified) whenever they become available. Furthermore, a user can provide criteria for a search or searches beyond those set in the user's profile.
- the identified assets can be delivered to the user in a variety of manners. For example, delivery may occur via cable or satellite television, or directly to a personal computer.
- the invention can be practiced via a plurality of platforms and networks. For example, the invention may be practiced over the Internet to reach a large consumer audience, or it may be practiced over an Intranet to reach a highly targeted business or industry target.
- the invention allows video streaming of identified video clips.
- Video streaming i.e., allowing the viewing of a video clip as it is downloaded rather than only after it is downloaded, which speeds the viewing process and largely obviates the need for video storage at the user location
- Video streaming is a communications technique that is growing in popularity with the increasing availability of both video players (especially for use with personal computers) and bandwidth to the average consumer.
- no conventional service allows users to accurately and quickly find desired clips for playing, and do not provide a ready means for providers to profit from the video streams that are provided.
- users may receive only those video clips identified by a search executed on the user's behalf. However, if a user desires, he or she may also choose to view an entire program from which the clip(s) was extracted. A user may also be allowed to choose some or all of the video clips for long-term storage, whereby the clip(s) can be archived for later use. In one embodiment, the user may store the clips at a local computer, and thereafter make the clips available to other users connected via a peer-to-peer network.
- the invention allows improved video-on-demand (VOD).
- VOD is typically defined in the cable/satellite television arena as the ability to request programming at any time and to have VCR-like controls over the content being streamed to the TV.
- the invention adds value to conventional VOD by allowing the user to demand video more accurately and completely.
- PVR personal video recorder
- Current PVR implementations are offered by TiVo and ReplayTV, and allow users great flexibility in storing programs for later viewing and/or manipulation in viewing (e.g., skipping over commercials in a television program).
- the invention provides a searching tool for allowing users to find interesting programs, even from a variety of channel sources, to thereafter be recorded and viewed using PVR technology.
- the invention permits the recording of only those portions of programs that the user desires.
- the invention contemplates recording the desired portions either by doing so directly from the program, or by recording the entire program locally and then utilizing only those portions of the program desired by the user.
- video file refers generically to any analog or digital video information, including any content associated therewith, such as multimedia content, closed caption text, etc.
- clip refers to any subsection of a video program that is selected based on a user search criterion.
- extracting refers to the use of a selected portion of the video file. Such use may include literal removal (permanent or temporary) from the context of a larger file, copying of the selected portion for external use, or any other method for utilizing the selected portion.
- a user may accurately, completely and promptly receive multimedia assets that he or she finds interesting, and may conveniently exploit the received assets in a manner best-suited to that user.
- FIG. 1 demonstrates an exemplary methodology for media processing in a digital video library (DVL) according to one embodiment of the invention.
- DVD digital video library
- Such media processing is used in implementing the invention at a user level, by capturing, segmenting and classifying multimedia assets for later use and manipulation.
- FIG. 1 and discussion of associated concepts are provided in greater detail in the following documents, which are hereby incorporated herein by reference: Shahraray B., “Scene Change Detection and Content-Based Sampling of Video Sequences,” Proc. SPIE 2419, Digital Video Compression: Algorithms and Technologies, pp.
- multimedia assets including video 105 , associated text captions 110 and corresponding audio portions 115 are imported into the system for processing.
- Content-based sampling engine 135 receives the video 105 and segments it into individual shots or video frames; this information will be combined with information extracted from the other components of the video program to enable the extraction of individual stories (i.e., video segments related to a particular topic or topics), as will be described. Additionally, this process allows a representative image for a particular story, segment or clip to be selected by engine 160 ; and second, the process allows boundaries around the story, segment or clip to be set by engine 155 .
- a database 120 of linguistic rules is used by linguistic analysis engine 140 to combine the caption information 110 with the segmented video within engines 155 and 160 , to thereby assist in the functionality of those two engines.
- information within model databases 125 and 130 is used by acoustic classification engine 145 and program identification engine 150 to provide segmentation/identification of commercials and programs, respectively.
- All of the information from engines 135 - 150 is utilized in engines 155 and 160 to discern a length of a particular video story or clip that will be associated with each topic.
- multimodal story segmentation algorithms such as those described in “Automated Generation of News Content Hierarchy By Integrating Audio, Video, and Text Information” (above) can be used to determine an appropriate length of a video clip to be associated with a particular topic.
- the algorithm can be used in conjunction with the user profile to either compare the profile information to newly-acquired content on-the-fly, or similarly determine an appropriate length for a video clip to be associated with a particular portion of the user profile.
- textual information used to identify clips of interest can be derived for example, from closed caption text that accompanies most television programs.
- Real-time closed captioning typically lags behind the audio and video by a variable amount of time from about 1 to 10 seconds.
- the embodiment of FIG. 1 is capable of using speech processing to generate very accurate word timestamps.
- a large vocabulary automatic speech recognition system can be used to generate a transcript of the audio track. While the accuracy of the automatically generated transcripts is below that of closed captions, they provide a reasonable alternative for identifying clips of interest with reduced, but acceptable, accuracy.
- a parallel text alignment algorithm can be used to import high quality off-line transcripts of the program when they are or become available.
- FIG. 2 implements an architecture for implementing an exemplary embodiment of the invention. It should be noted that the architectural elements discussed below can be deployed to a user and/or provider of multimedia assets in whole or in part, and therefore each element interfaces with one another and external components using standard, conventional interfaces.
- Video Capture/Media Analysis component 205 records and compresses broadcast TV programming. Also at component 205 , various functions can be performed on content such as scene change detection, audio analysis, and compression. These video files are shipped to the Video Storage database 210 from which they will be served when the video is streamed to the client 250 .
- Associated metadata is shipped to the Metadata database 215 .
- thumbnail images are included as part of the metadata, as well as terms and/or phrases associated with a clips(s) for categorizing the clip(s) within a topical subset.
- this video capture/media analysis process need not occur in real time. However, there is no reason why it could not occur in real time if an operator so desires and wishes to devote sufficient computational resources. In any case, it is not necessary to wait until a show is completed before indexing and searching that show.
- Video Server 220 responds to clip requests and makes the video content available to the client 250 .
- the video server 220 may download the video clips in whole or in part, stream the clips (e.g., via MPEG4 ASF or MPEG2) to the client 250 or generate the clip metadata discussed above (such as terms and/or phrases associated with a clip for categorizing the clip within a topical subset).
- DVL Server 225 handles query requests (such as how many clips are available, which shows have clips, etc.) and/or clip content requests (metadata that describes clip content including “clip pointer” to video content). Thus, it handles multimedia search (such as closed caption text) and determines the start and stop times of the clips, which are designated with “clip pointers,” as just mentioned.
- eClips server 230 handles client requests for web pages related to a service for providing eClips.
- eClips server 230 utilizes Perl Common Gateway Interface (CGI) scripts that the client navigates in order to perform the functions of the eClips service. For example, the scripts deal with login/registration related pages, home page, profile related pages, archive related pages, player pages, and administration related pages. Player scripts can be launched in a separate window.
- CGI request from the client 250 will return HTML with HTML DIVs, JavaScript, and CSS style sheets. The DIVs and CSS style sheets are used to position the various elements of the page.
- DHTML is used to dynamically load DIV content on the fly (for instance, a list of shows in an instant search pull down performed by a user).
- three databases 235 , 240 and 245 are shown as Extensible Markup Language (XML) databases.
- XML Extensible Markup Language
- Perl scripts can be utilized to access (i.e., read from and/or write to) these databases via XML.
- these three databases include show database 235 , which contains information about recorded broadcasts, Profile database 245 , which contains personal search terms and/or phrases, and Archive database 240 , which contains saved clip information (e.g., entire clips or simply clip pointers).
- eClips Client 250 includes a JavaScript that each Perl script includes in the HTML that is returned from the eClips server 230 . It is through the JavaScript that the client 250 interacts with the DVL server 225 to determine the desired content and through JavaScript that the client initiates the streaming content with the video server 220 . The JavaScript also accesses (reads) the Show and Profile XML files in those databases.
- the Video Server 220 may have a separate IP host name, and should support HTTP streaming.
- the DVL and eClips servers 225 and 230 may have the same IP host name, and may be collocated within a single machine.
- FIG. 2 the key interactions that cause video to be streamed to the client 250 are demonstrated.
- a user has logged in already and should see a list of topics determined by their profile, as well as the number of clips for each topic.
- An example of a topic could be “sports” and the keyword string associated with this topic could be football, baseball, hockey.
- the keyword string is used to search the CC text (in this case, clips that have any of these terms will be valid).
- JavaScript will send a CGI query to DVL server 225 , which generates an XML response.
- the XML is parsed into JavaScript variables on the client using the XML document object model (DOM).
- the CGI query and XML response is implemented as part of the DVL system and acts as a layer above an Index Server, which, as part of the DVL server 225 , performs text indexing of the video clips (as discussed above) that allows the user to locate a desired clip.
- the XML response will include the number of clips found for each topic. It is with these query responses that the home page knows which topics have hits and can activate the links to play the content.
- JavaScript links when clicked, can launch the player page in a separate window.
- the JavaScript may also run a query to get the list of shows with clips for a particular topic.
- the JavaScript then loops through all the shows with hits and queries the DVL server via the separate CGI script to get the clip information needed to play the clip. This information is also returned via XML and parsed via the JavaScript.
- the JavaScript loads various DIVs that depend on this information, such as hit search term found in CC text, CC text, and thumbnail.
- the player page JavaScript starts the media player with the first clip using a pointer (start time) to the video.
- start time a pointer
- eClips client 250 may reside on, for example, a user's home or business computer, a personal digital assistant (PDA), or a set-top box on a user's television set.
- Client 250 interacts with eClips server 230 as discussed above to provide the user with an interface for viewing and utilizing the video clips.
- Client 250 can be written to contain, for example, a JavaScript object that contains profile results (eClips object).
- a user using eClips client 250 running on a PC may access stored clips through a network, such as the Internet or a locally defined Intranet.
- the user defines a search criterion, either through an “instant search” feature or within a user profile. When multiple clips are found matching the user search, the clips can be stitched together and streamed to the user as one continuous program.
- eClips server periodically searches for clips matching a given user's profile, and makes the clips available to the user, perhaps by notifying the user via email of the availability of the clips.
- the architecture shown in FIG. 2 allows for video to be stored and displayed in several formats including MPEG2 (e.g., for digital television and video on demand) and MPEG4 (e.g., for streaming video on the Internet).
- MPEG2 e.g., for digital television and video on demand
- MPEG4 e.g., for streaming video on the Internet
- the video may be stored for later use by the user; in particular, a user may archive some or all of the received video and thereafter permit searching and uploading of the video from storage by other members of a peer-to-peer computer network.
- FIG. 3 demonstrates a more specific hardware architecture according to another exemplary embodiment of the invention.
- video feeds 310 are received through various sources (such as television channels CNN, ESPN and CNBC) at Video Capture/Media Analysis component 205 within Video Distribution Center 305 .
- Component 205 receives the feeds and forwards captured/analyzed results to video server 220 and/or DVL/eClips server 225 / 230 within cable Headend 325 .
- video analysis portion 315 is illustrated within component 205 , although it should be understood from FIG. 2 and the associated discussion above that component 205 may perform other media analysis such as audio analysis.
- the DVL/eClips servers 225 / 230 operate as described above in conjunction with FIG.
- HFC Hybrid Fiber Coaxial
- the feed is received at cable modem 350 via high speed data line (HSD) to a PC 360 running eClips client 250 .
- the feed could be sent to Set top box 370 atop TV 380 , where Set top box 370 runs eClips client 250 .
- the service can be streamed as high speed data (HSD) through a cable modem as MPEG4 video.
- HSD high speed data
- MPEG4 video video on demand
- FIG. 4 is an exemplary page view of a page viewed by a user utilizing an eClips client according to one embodiment of the invention.
- the user might see page view 400 just after logging in to a system implementing the invention.
- section 405 demonstrates the results of a profile search performed for the user on a given day, or over some other pre-defined period, according to the previously stored profile of that user.
- clips are listed both by topic and by number of clips related to that topic.
- the user therefore has the option of viewing one or more of the clips related to a particular topic.
- Section 405 also identifies a source for the criteria used to select the various topical clips. More specifically, on a profile page, a user can select default sources (shows) which will be searched based on the user's profile; this is referred to as a “Main” list, and would restrict any profile topic that has the Main option to search only those shows selected on the profile page. On a topic editor page, where a user is allowed to add or modify topics for searching, the user can specify this Main list, or can make Custom selections that are only valid for a particular search topic. In section 405 , the user has selected the latter option, and so a “source” is shown as Custom.
- section 410 the user additionally has the option of entering new search terms and/or phrases not related to his or her current profile, whereby the invention searches a clips database via DVL server as described above with respect to FIG. 2.
- Section 415 indicates the media sources which will be searched for the terms or phrases entered in section 410 .
- button 420 “Play all clips,” allows a user to view all currently available clips with one click.
- the user can add a new topic using button 425 .
- the user can return to a home page by clicking on button 430 (although this option is only valid when the user is on a page different from the home page 400 itself), access his profile via button 435 and access an archive of previously saved clips via button 440 .
- a user can log out of the service using button 445 .
- FIG. 5 demonstrates a page view 500 showing a content retrieval page according to the exemplary embodiment shown in FIG. 4.
- section 505 still frames of the beginning of each clip (i.e., thumbnails) within a topic can be viewed by the user.
- Section 505 can be controlled by section 515 , which allows the user to select a topic of clips to be shown, as well as section 520 , which allows a user to select a portion of the clips from that topic that will be played.
- buttons 560 and 565 a user may clear or select all of the clips being shown within a particular topic.
- Section 510 can be controlled by buttons 525 - 550 , which allow a user to skip to a previous clip with button 525 , stop the clip with button 530 , play the clip with button 535 , skip the clip with button 540 , switch to a new topic of clips with button 545 or view footage after the selected clip(s) with button 550 .
- section 510 may also include advertisements 555 , and may display a time remaining for a currently playing clip, a source of the clip, and a date and time the clip was originally broadcast.
- page 500 will play all of the clips currently available in a predetermined order (e.g., reverse chronological order, by source of content, etc.) if the user does not choose a specific topic or clip.
- Button 570 is activated when a user wants to view the clip(s) available; i.e., as shown in view 500 .
- Button 575 allows the user to send (e.g., email) the clip(s) to another user, and button 580 allows the user to save the clip(s) to an archive (i.e., the archive accessed by button 440 in FIG. 4).
- the invention can capture content from nearly any multimedia source and then use standard streaming media to deliver the appropriate associated clips, it is nearly limitless in the markets and industries that it can support.
- the invention can be packaged to address different market segments. Therefore, it should be assumed that the target markets and applications supported could fall into, for example, any or all of the Consumer, Business-to-Consumer or Business-to-Business Marketplaces. The following discussion summarizes some exemplary application categories.
- the invention can be provided as an extension to standard television programming.
- an ISP may allow consumers to sign up for this service, or the set of features provided by the invention can be provided as a premium subscription.
- a consumer would enter a set of keywords and/or phrases in the profile.
- the user may determine that only specific content sources should be monitored.
- the user profile is created or changed it would be updated in the user profile database.
- the user profile database is matched against the closed caption text.
- a consumer may be interested in sports but only want to see the specific “play of the day.”
- the consumer would enter the key words “play of the day” and then identify in the profile the specific content sources (channels or programs) that should be recorded/analyzed by the invention. For example, the consumer could choose channels that play sports games or report on sports news.
- the invention in a Business-to-Consumer offering, can be provided as an extension to standard television programming.
- both the programming and its sponsorship would be different from the consumer model above.
- a corporate sponsor or numerous corporate sponsors may offer specific types of content, or may offer an assemblage of content overlaid with advertising sponsorship.
- the sponsorship would be evident in the advertising that would be embedded in the player or in the content, since the design of the invention is modular in design and allows for customization.
- the Business-to-Consumer service model a consumer would enter a set of keywords in the profile. As the user profile is created or changed it would be updated in the user profile database. Because this model and the content provided would be underwritten by corporate sponsorship, the content provided may be limited to a proprietary set of content. As an example, if CNN were the sponsor of the service, all of the content provided may be limited to CNN's own broadcasts. In addition, it may be very evident to the consumer that the service is brought to them by CNN in that the CNN logo may be embedded in the user interface, or may be embedded in the content itself.
- the invention can be used in intra-company applications as well as extra-company applications.
- the applications supported include, as just a few examples: Business TV, Advertising, Executive Announcements, Financial News, Training, Competitive Information Services, Industry Conferences, etc.
- the invention can be used as a tool to assist employees in retrieving and viewing specific portions of content on demand.
- the user may wish to combine sources from within the business and sources outside of the business.
- a user may wish to see all clips dealing with the category “Virtual Private Networks.”
- a business may have planned a new advertising campaign talking about “Virtual Private Networks” and have an advertisement available to its internal personnel.
- there may be an internal training class that has been recorded and is available internally in which a section talks about “Virtual Private Networks.” Again, this could be another content option captured by the invention.
- one of this company's competitors may have provided a talk at an industry conference the day before about their solution for the “Virtual Private Network” area.
- the invention can provide businesses, their suppliers, their best customers, and all other members of communities of interests with specific targeted content clips that strengthen the relationships. These may include (but not be limited to) product details, new announcements, public relations messages, etc.
- financial information can be available for both professionals and potential clients to receive late-breaking information on stocks, companies and the global markets.
- the information can be from a variety of sources such as Financial News Network, Bloomberg, CNN, etc. and allow users to identify key areas of interest and to continually be up to date.
- the movie industry can use the invention to easily scan through archives of old and new movie footage that can be digitized and stored in a central repository. Sports highlights can be made available for particular games or events. Networks could maintain a library of indexed TV shows (e.g., PBS) where users can search for a particular episode/topic.
- indexed TV shows e.g., PBS
- the invention can be an information dissemination tool for finding the latest information quickly when videos are captured of talks and demonstrations in key events.
- FIG. 6 is a flow diagram illustrating transformation of video source data 610 according to one embodiment of the invention.
- FIG. 6 illustrates several alternative transformation paths to deliver content of video source 610 to destination devices 675 .
- video source data 610 may be live streaming video, delayed streaming video, or stored video data.
- Sampling function 615 processes video source data 610 to produce static images 620 .
- video source data 610 is streaming video
- capture process 623 produces a video file 625 from video source data 610 .
- Static images 620 or video files 625 are then delivered to destination devices 675 .
- FIG. 6 illustrates that demultiplexing process 645 processes video source file 610 to obtain or produce audio stream 650 .
- the flowchart shows that there are at least four options for the delivery of audio stream 650 .
- audio stream 650 can be delivered to destination devices 675 directly.
- capture process 653 can create sound file 655 from audio stream 650 for eventual delivery to destination devices 675 via link 680 .
- speech recognition process 660 can process audio stream 650 to produce text 665 . Text 665 can then be delivered to destination devices 675 .
- process 668 can further process text 665 to provide for correction of errors generated by the speech recognition process 660 , or may, either in the alternative or in combination, translate text 665 to another language to produce processed text 670 .
- Processed text 670 can then be delivered to destination devices 675 .
- FIG. 6 illustrates that extraction process 628 generates Closed Caption Text (CCT) 630 from video source data 610 .
- Process 633 corrects for errors in CCT 630 , provides language translation, and/or performs other translations to generate processed CCT 635 .
- Processed CCT 635 may be delivered directly to destination devices 675 .
- text-to-speech process 640 operates on either CCT 630 or processed CCT 635 to produce audio stream 650 , with at least all transformation paths available as described above with regard to audio stream 650 for eventual delivery to destination devices 675 . It is also possible to transform from video file 625 to sound file 655 via a demultiplexing process (not shown).
- Destination devices 675 may be or include, for example, a personal computer (PC), a tablet PC, a personal digital assistant (PDA), a smart phone, or other device capable of receiving email.
- PC personal computer
- PDA personal digital assistant
- smart phone or other device capable of receiving email.
- Transformed content may be delivered to destination devices 675 according to alternative timing schemes.
- CCT 630 , processed CCT 635 , audio stream 650 , text 665 , processed text 670 may be delivered in near real-time (e.g., where content delivery is delayed only by processing and communication overhead).
- transformed content is stored for later delivery.
- the timing for delivery of stored content may be according to a predetermined schedule, such as a set time of day.
- content can be delivered according to a set interval of time, such as every hour or other fixed period of time.
- the predetermined schedule may be specified in the user's profile data.
- the delivery of near real-time and/or stored content may be event-triggered.
- a user profile may specify that breaking headline news, special reports, and/or severe weather warnings trigger near real-time delivery of content separate from, or together with, related stored content.
- Sample process 615 , demultiplexing process 645 , extraction process 628 , text-to-speech process 640 , speech recognition process 660 , capture processes 623 and 653 , and processes 633 and 668 may be performed on a server or other network-based host computer having access to video source data 610 .
- FIG. 7 is a block diagram of a functional architecture for delivering video content to an electronic mail client according to one embodiment of the invention.
- a server 710 is configured to identify relevant content in video broadcast 705 or other video source based on user profile data 715 and deliver the relevant content in the form of a video clip or link to an email client 720 .
- server 710 provides not only access to user profile data 715 , but also is configured to perform network-based processing to identify and deliver video content.
- User profile data 715 includes subjects (or topics) of information that are relevant to an end-user receiving email at email client 720 .
- user profile data 715 includes an email address for a user.
- email client 720 is alternatively a conventional email client or an enhanced email client.
- FIG. 8 is a flow diagram of a process for delivering video content to an electronic mail client according to one embodiment of the invention.
- the process depicted in FIG. 8 is performed by the server 710 .
- the process begins with receipt of previously-specified user profile data 715 in step 805 .
- Server 710 identifies relevant portions of video broadcast 705 in step 810 , based on topical information included in the user profile data 715 .
- server 710 optionally transforms relevant portions of the video broadcast 705 according to processes depicted in FIG. 6.
- server 710 can generate closed caption text and/or image data based on video broadcast 705 .
- Server 710 automatically builds an email message in step 820 without manual intervention, and sends the email message to email client 720 in step 825 .
- one or more URL's or other links are included in the body of the email message pointing to a Web page containing the video content or to a Web page that causes a media player to be launched.
- the video content is attached to the email message as one or more multimedia files.
- one or more metafiles are attached to the email message.
- Metafiles are small text files that contain information about media files including media file location, and optionally include information such as author or artist, start time, and duration.
- metafiles are Microsoft WindowsTM Advanced Stream Redirector (.asx) files, Microsoft WindowsTM Media Audio Redirector (.wax) files, Microsoft WindowsTMMedia Redirector (.wvx) files, and Real Networks' Real Audio Metafile (.ram) files.
- the application of metafiles has many advantages. For example, because a metafile can specify several different locations for a media stream, the delivery of video content can be fault tolerant.
- a metafile can define a series of media streams to be played in sequence to form a larger, aggregate presentation from a collection of smaller video streams.
- metafiles can specify a start and a duration, shorter segments of interest can be specified within a longer media file.
- metafiles are small text files, emails having metafile attachments are more easily downloaded and stored than emails having large video files attachments, for example.
- FIG. 9 is a flow diagram for mapping video metadata to an electronic mail message according to one embodiment of the invention.
- FIG. 9 illustrates one embodiment of at least a portion of process step 820 .
- metadata 910 is associated with video source data 905 .
- Metadata 910 may include, for example, source information 915 , subject matter 920 , and broadcast date 925 .
- source information 915 is inserted into a “from” field in step 930
- subject 920 is inserted into a “subject” field in step 935
- broadcast date 925 is inserted into a “date sent” field in step 940 .
- metadata 910 can be used to automatically generate an otherwise conventional email message.
- FIG. 10 is an illustration of an electronic mail message according to one embodiment of the invention.
- FIG. 10 illustrates an email created by the process in FIG. 9.
- an email includes header information 1005 .
- Source information 915 namely “UVW NEWS,” has been inserted into “from” field 1010 .
- Subject 920 namely “MAD COW,” has been inserted into subject field 1020 .
- Broadcast date 925 namely “MON 10/1/2002, ” has been inserted into sent field 1025 .
- “JOE USER” has been inserted into “to” field 1015 .
- sent field 1025 also includes the time.
- header information 1005 includes a received field (not shown) to display the date and/or time the email was received.
- the email message in FIG. 10 has a body 1030 that includes text link 1035 and CCT 1040 .
- the word BOVINE in text link 1035 can be hyperlinked to access a video clip related to MAD COW from a Web page having an embedded media player, for example, or can be played with a media player local to the email client 720 .
- Body 1030 optionally includes multiple text links 1035 for access to a corresponding quantity of video clips.
- CCT 1040 includes CCT that has been created from a relevant video source.
- CCT 1040 includes processed CCT as described with reference to FIG. 6 above.
- FIG. 10 also illustrates an attachment area 1045 .
- attachment area 1045 includes an Icon for a metafile 1050 .
- attachment area 1045 will indicate one or more attached media files (not shown).
- text links 1035 in body 1030 , metafile(s) 1050 in attachment area 1045 and media file(s) (not shown) in attachment area 1045 are possible.
- FIG. 11 is an illustration of an electronic mail message according to another embodiment of the invention.
- an email includes header information 1105 .
- “JOE USER” has been inserted into “to” field 1115 .
- an automatically generated email message has a message body including delivery message area 1130 , topic area 1135 , and content areas 1140 and 1160 .
- video clip headers 1145 and 1165 each include source information, a search term and a date and time of original broadcast. Other video clip header information can be used.
- Content areas 1140 and 1160 also include thumbnails 1150 and 1170 , respectively, which are representative of the content of the delivered video clips.
- a user selects thumbnails 1150 and/or 1170 to launch a media player local to email client 720 to play at least a portion of relevant source video.
- the email client 720 links to a Web page having an embedded media player to play at least a portion of relevant source video.
- Content areas 1140 and 1160 optionally include CCT 1155 and 1175 , respectively, in addition to, or in the alternative of thumbnails 1150 and 1170 .
- the email message illustrated in FIG. 11 includes an attachment area having one or more metafiles 1050 and/or one or more media files.
- an embodiment of the email message illustrated in FIG. 11 includes one or more text links 1035 .
- Features of the email in FIG. 11 are optional, except that the email should include sufficient header information for delivery, and some form of content derived from the relevant source video, or links thereto.
- the email messages illustrated in FIGS. 10 and 11 can be delivered and viewed using conventional email servers and clients.
- FIG. 12A is an illustration of an exemplary graphical user interface (GUI) for managing and viewing electronic mail messages having video content according to one embodiment of the invention.
- GUI graphical user interface
- the GUI illustrated in FIG. 12A is part of an enhanced email client 720 adapted for the management and presentation of video content delivered by email.
- an enhanced email client 720 has a search area 1205 .
- search area 1205 is used for updating user profile data 715 .
- search area 1205 is used for searching within video content stored on email client 720 .
- the GUI of FIG. 12A can be viewed as having a management area and a viewing area.
- the management area includes headings 1215 , topic listings 1220 , 1230 and 1240 , and video clip data 1225 , 1235 and 1245 .
- the viewing area includes media control bar 1250 , window 1210 and CCT 1255 .
- Headings 1215 provide a framework for summarizing video clips delivered to the email client 720 .
- Other information could optionally be used.
- service provider, file size, or other information can be displayed for each video clip according to alternative headings 1215 .
- video clip data 1225 , 1235 and 1245 include check boxes for the selection of one or more video clips to be played. Other methods of selection could also be used. For example, a user could click on the name of a video clip or provide a verbal command indicating the video clip(s) to be played.
- Media control bar 1250 provides controls for playing one or more selected video clips.
- Media control bar 1250 allows for navigation between video clips and/or topics.
- media control bar 1250 allows for multiple video clips to be queued for presentation in a predetermined sequence. Exemplary features of media control bar 1250 are labeled in FIG. 12B. As shown therein, media control bar 1250 includes annotate button 1260 , next button 1265 , play bar 1270 having a slider 1275 , play button 1280 and pull down menu 1285 .
- Play bar 1270 is a graphical representation of a series of selected video clips. As illustrated, play bar 1270 represents video clips Bovine, Attorney General, and Homerun Derby that are selected in the management area. In one embodiment, play bar 1270 is color coded according to corresponding colors associated with the selected video clips and/or topics in the management area. Play bar 1270 has a slider 1275 to illustrate progression of play through each of the clips illustrated in play bar 1270 . As shown, the slider 1275 indicates that the viewing area is playing an early portion of the Bovine video clip.
- play bar 1270 can also be used to advance or retard play within the series of selected video clips. For example, a user could move slider 1275 from its illustrated position to jump to a middle portion of the Homerun Derby clip, for instance.
- Play button 1280 begins or resumes play of one or more video clips according to the menu item selected in pull down menu 1285 .
- pull down menu 1285 could contain options such as “Play All,” “Play One Clip Per Topic,” or other alternatives.
- window 1210 is a thumbnail image that is replaced by a video thumbscreen while selected video clips are being played.
- one or more local media players are launched to present the selected video clips to the user.
- selection of window 1210 can link to a Web page having an embedded media player for presenting the selected video clips to the user.
- CCT 1255 provides CCT or processed CCT corresponding to the thumbnail image or video thumbscreen in window 1210 .
- CCT 1255 automatically scrolls in synchronization with a video thumbscreen in window 1210 .
- a service for providing personalized multimedia assets such as electronic clips from video programs, based upon personal profiles.
- it uses text to ascertain the appropriate clips to extract and then assembles these clips into a single session.
- users only see the specific portions of videos that they desire. Therefore, users do not have to undertake the arduous task of manually finding desired video segments, and further don't have to manually select the specified videos one at a time. Rather, the invention generates all of the desired content automatically.
- one embodiment of the invention provides an improved system and method for automatically delivering video content via email without the delay and expense of manual alternatives.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention relates to a method and system for automatically identifying video content within source video and transmitting the video content to an electronic mail client. The transmitted video content can be streaming video, video files, and/or other medium derived from the source video. An enhanced electronic mail client is also disclosed.
Description
- This application is a continuation-in-part of
nonprovisional application 10/034,679, which was filed on Dec. 28, 2001, and claims priority to provisional application No. 60/282,204, which was filed Apr. 6, 2001, and to provisional application No. 60/296,436, which was filed Jun. 6, 2001, all of which are hereby incorporated by reference in their entireties. - 1. Field of the Invention
- The invention relates to the delivery of multimedia assets to a user. More specifically, the invention relates to a method and system for automatically identifying and transmitting video content to an electronic mail client.
- 2. Description of the Related Art
- There exists an increasing amount of information available in video format from a variety of sources. Known systems and methods for searching video content rely on a search of titles or other metadata to identify entire video broadcasts or video files of potential relevance to a user. Once identified, video content is delivered to the user via conventional methods for distribution of the video source. For example, a content provider manually directs video content to a user over closed circuit television, mails a video tape to a user, or manually generates an electronic mail (email) message with an attached video file.
- Known systems and methods for identifying and delivering video content have various disadvantages. For example, since known systems and methods for searching video typically identify entire video broadcasts or video files that are of interest to a user, a user may need to sort through a relatively large volume of irrelevant information to view a relatively small amount of relevant content. In addition, the manual labor associated with delivery of video content to a user may result in delay and/or increase the cost of delivery.
- Thus, there exists a need for systems and methods that identify video source material relevant to the interests of a user, and transmit only those portions of the source video containing relevant content to the user in an efficient manner.
- The invention relates to a method and system for automatically identifying and transmitting video content to an electronic mail client.
- In one exemplary embodiment, the invention relates to a method for arranging for delivery of content from a video source, including: automatically identifying a portion of at least one source video stream using a predetermined user profile; transforming the identified portion of the at least one source video stream into a destination medium; and automatically building an electronic mail message based on the destination medium and the identified portion of the at least one source video.
- In another embodiment, the invention provides a method for arranging for the delivery of content from a video source, including: automatically identifying a portion of at least one source video stream based on relevance to a predetermined user profile; transforming the identified portion of the at least one source video stream into at least a thumbnail image and closed caption text; and automatically building an electronic mail message using the thumbnail image and the closed caption text.
- In another embodiment, the invention provides a system for arranging the delivery of content to an electronic mail client, including: at least one video source; a user profile database; and a server coupled to the video source and the user profile database, wherein the server is configured to read profile data from the user profile database, automatically identify a portion of the at least one video source using the profile data, transform the identified portion of the at least one video source into a destination medium, and automatically build an electronic mail message using the destination medium.
- In another embodiment, the invention provides a computer-readable storage medium configured to provide a graphical user interface for an electronic mail client, the graphical user interface including: a management feature for managing a plurality of electronic mail messages based on metadata, wherein the metadata includes at least one of broadcast source, broadcast date and duration information related to at least one corresponding source video for each of the plurality of electronic mail messages; and a view feature for viewing a selected portion of the at least one corresponding source video and a medium derived from a selected portion of the at least one corresponding source video.
- In another embodiment, the invention provides a method for creating an electronic mail message for delivery of video information to a user including: selecting video information from at least one source video stream using user profile information; formatting the selected video information in accordance with the profile information; and populating fields of an electronic message with formatted video information and destination information in accordance with the user profile information.
- The features and advantages of the invention will become apparent from the following drawings and detailed description.
- The invention is described with reference to the accompanying drawings. In the drawings, like reference numbers indicate identical or functionally similar elements. Additionally, the left-most digit of a reference number identifies the drawing in which the reference number first appears.
- FIG. 1 demonstrates an exemplary methodology for media processing according to one embodiment of the invention.
- FIG. 2 illustrates an architecture for implementing an exemplary embodiment of the invention.
- FIG. 3 demonstrates a more specific hardware architecture according to another exemplary embodiment of the invention.
- FIG. 4 is an exemplary page view of a page viewed by a user utilizing a client according to one embodiment of the invention.
- FIG. 5 demonstrates a page view showing a content retrieval page according to the exemplary embodiment shown in FIG. 4.
- FIG. 6 is a flow diagram illustrating transformation of video source data according to one embodiment of the invention.
- FIG. 7 is a block diagram of a functional architecture for delivering video content to an electronic mail client according to one embodiment of the invention.
- FIG. 8 is a flow diagram of a process for delivering video content to an electronic mail client according to one embodiment of the invention.
- FIG. 9 is a flow diagram for mapping video metadata to an electronic mail message according to one embodiment of the invention.
- FIG. 10 is an illustration of an electronic mail message according to one embodiment of the invention.
- FIG. 11 is an illustration of an electronic mail message according to another embodiment of the invention.
- FIG. 12A is a an illustration of an exemplary graphical user interface for managing and viewing electronic mail messages having video content according to one embodiment of the invention.
- FIG. 12B is an illustration of a portion of the graphical user interface in FIG. 12A.
- While the invention is described below with respect to various exemplary embodiments, the invention is not limited to only those embodiments that are disclosed. Other embodiments can be implemented by those skilled in the art without departing from the spirit and scope of the invention.
- The invention solves the above-discussed problems and provides a personalized, customizable multimedia delivery service that is convenient and easy to use. In one embodiment of the invention, the service works by recording all of the video streams of appropriate source and interest to a target audience. For example, the service may record content from a collection of (or a particular one of) sports or news channels on television. In another example, the service may record content related to training videos, presentations or executive meetings in a business, school or other particularized environment. Recording may occur as the content is originally being broadcast (i.e., live), afterwards from recorded media, or even before the content is broadcast to its intended audience.
- Once the content is captured and recorded, it can be segmented, analyzed and/or classified, and thereafter stored on a platform. For example, the content can be broken down into its component parts, such as video, audio and/or text. The text can include, for example, closed caption text associated with the original transmission, text generated from an audio portion by speech recognition software, or a transcription of the audio portion created before or after the transmission. In the latter case, it becomes possible to utilize the invention in conjunction with executive speeches, conferences, corporate training, business TV, advertising, and many other sources of video which do not typically have available an associated textual basis for searching the video.
- Having obtained or generated the text, it can then be used as a basis for searching the multimedia content. In particular, the text provides the basis for an exemplary methodology for overcoming the above-identified problems associated with searching video in the prior art. That is, if a user wishes to search the stored content for video segments relevant to the President of the United States discussing a particular topic, then the President's name and the associated topic can be searched for within the text associated with the video segments. Whenever the President's name and the associated topic are located, an algorithm can be used to determine which portion of an entire video file actually pertains to the desired content and should therefore be extracted for delivery to the user. Thus, if a video file comprises an entire news broadcast about a number of subjects, the user will receive only those portions of the broadcast, if any, that pertain to the President and the particular topic desired. For example, this could include segments in which the President talks about the topic, or segments in which another talks about the topic and the President's position.
- Once the pertinent segments of the broadcast have been appropriately extracted, for a given user, they can be stitched together for continuous delivery to that user. In this way, for example, the segments can be streamed to the user as a means of providing an easy-to-use delivery methodology for the user, and as a means of conserving bandwidth. Users can view the delivered multimedia asset in its entirety, skip between the assets, or view only portions of the assets, as they desire. Moreover, a user can have access to portions of the original video file that occurred immediately before or after the extracted segments; for example, the user could choose to watch the entire original video file. Such access can be granted by including a “more” or “complete” button in a user interface.
- In one embodiment of the invention, a profile of the user is stored which specifies criteria for searching available multimedia assets. The criteria may include, for example, key words and/or phrases, a source(s) of the content, etc. The profile can be set directly by the user via interaction with an appropriately designed graphical user interface (GUI). When such a profile is available, the invention is capable of automatically searching the available assets on a periodic basis, and thereafter extracting, combining and delivering the compiled assets (or segments thereof, regardless of their original source) to the user. In one embodiment, the invention can be utilized such that a service platform assisting in implementing the invention notifies the user whenever new multimedia assets consistent with the user's profile have been prepared. In another embodiment, the invention may automatically deliver multimedia assets in accordance with a user's profile according to a predetermined schedule, such as hourly or daily. Alternatively, the invention may notify the user of the presence of desired video clips, rather than actually deliver those clips.
- The assets can be classified and indexed on-the-fly as they are received. In this way, the assets can be compared against the user's profile virtually in real-time, so that results can be provided to the user (and the user can be notified) whenever they become available. Furthermore, a user can provide criteria for a search or searches beyond those set in the user's profile.
- The identified assets can be delivered to the user in a variety of manners. For example, delivery may occur via cable or satellite television, or directly to a personal computer. The invention can be practiced via a plurality of platforms and networks. For example, the invention may be practiced over the Internet to reach a large consumer audience, or it may be practiced over an Intranet to reach a highly targeted business or industry target.
- In one embodiment, the invention allows video streaming of identified video clips. Video streaming (i.e., allowing the viewing of a video clip as it is downloaded rather than only after it is downloaded, which speeds the viewing process and largely obviates the need for video storage at the user location) is a communications technique that is growing in popularity with the increasing availability of both video players (especially for use with personal computers) and bandwidth to the average consumer. However, no conventional service allows users to accurately and quickly find desired clips for playing, and do not provide a ready means for providers to profit from the video streams that are provided.
- When streaming the identified video clips, users may receive only those video clips identified by a search executed on the user's behalf. However, if a user desires, he or she may also choose to view an entire program from which the clip(s) was extracted. A user may also be allowed to choose some or all of the video clips for long-term storage, whereby the clip(s) can be archived for later use. In one embodiment, the user may store the clips at a local computer, and thereafter make the clips available to other users connected via a peer-to-peer network.
- In another embodiment, the invention allows improved video-on-demand (VOD). VOD is typically defined in the cable/satellite television arena as the ability to request programming at any time and to have VCR-like controls over the content being streamed to the TV. The invention adds value to conventional VOD by allowing the user to demand video more accurately and completely.
- An extension to VOD is personal video recorder (PVR) technology, which allows even more control over TV programs being viewed. Current PVR implementations are offered by TiVo and ReplayTV, and allow users great flexibility in storing programs for later viewing and/or manipulation in viewing (e.g., skipping over commercials in a television program). The invention provides a searching tool for allowing users to find interesting programs, even from a variety of channel sources, to thereafter be recorded and viewed using PVR technology.
- Moreover, whereas conventional PVR records only entire programs based on a user's directions, the invention permits the recording of only those portions of programs that the user desires. In this regard, the invention contemplates recording the desired portions either by doing so directly from the program, or by recording the entire program locally and then utilizing only those portions of the program desired by the user.
- Having described various exemplary embodiments of the invention, it should be noted that the terms “video file,” “video input,” “video,” “video program” or any similar term refers generically to any analog or digital video information, including any content associated therewith, such as multimedia content, closed caption text, etc. The terms “clip,” “video clip,” “electronic clip” or “eClip” should be understood to refer to any subsection of a video program that is selected based on a user search criterion. Also, the terms “extracting,” “parsing,” “removing,” “accessing” or any similar term with respect to a video file refers to the use of a selected portion of the video file. Such use may include literal removal (permanent or temporary) from the context of a larger file, copying of the selected portion for external use, or any other method for utilizing the selected portion.
- Based on the above-described features of the invention, a user may accurately, completely and promptly receive multimedia assets that he or she finds interesting, and may conveniently exploit the received assets in a manner best-suited to that user.
- FIG. 1 demonstrates an exemplary methodology for media processing in a digital video library (DVL) according to one embodiment of the invention. Such media processing is used in implementing the invention at a user level, by capturing, segmenting and classifying multimedia assets for later use and manipulation. It should be noted that the media processing implementation of FIG. 1 and discussion of associated concepts are provided in greater detail in the following documents, which are hereby incorporated herein by reference: Shahraray B., “Scene Change Detection and Content-Based Sampling of Video Sequences,” Proc. SPIE 2419,Digital Video Compression: Algorithms and Technologies, pp. 2-13, February 1995; Shahraray B., Cox R., Haskell B., LeCun Y., Rabiner L., “Multimedia Processing for Advanced Communications Services”, in Multimedia Communications, F. De Natale and S. Pupolin Editors, pp. 510-523, Springer-Verlag, 1999; Gibbon D., “Generating Hypermedia Documents from Transcriptions of Television Programs Using Parallel Text Alignment,” in Handbook of Internet and Multimedia Systems and Applications, Borko Furht Editor, CRC Press 1998; Shahraray B. “Multimedia Information Retrieval Using Pictorial Transcripts,” in Handbook of Multimedia Computing, Borko Furht Editor, CRC Press 1998; and Huang Q., Liu Z., Rosenberg A., Gibbon D., Shahraray B., “Automated Generation of News Content Hierarchy By Integrating Audio, Video, and Text Information,” Proc. IEEE International Conference On Acoustics, Speech, and Signal Processing ICASSP'99, pp. 3025-3028, Phoenix; Ariz., May 1999.
- In FIG. 1, multimedia
assets including video 105, associated text captions 110 and correspondingaudio portions 115 are imported into the system for processing. Content-basedsampling engine 135 receives thevideo 105 and segments it into individual shots or video frames; this information will be combined with information extracted from the other components of the video program to enable the extraction of individual stories (i.e., video segments related to a particular topic or topics), as will be described. Additionally, this process allows a representative image for a particular story, segment or clip to be selected byengine 160; and second, the process allows boundaries around the story, segment or clip to be set byengine 155. - A database120 of linguistic rules is used by
linguistic analysis engine 140 to combine the caption information 110 with the segmented video withinengines model databases acoustic classification engine 145 andprogram identification engine 150 to provide segmentation/identification of commercials and programs, respectively. Once the multimedia asset(s) have been captured, segmented and classified as described above, they can be stored thereafter inDVL database 165. - All of the information from engines135-150 is utilized in
engines - As referred to above, textual information used to identify clips of interest can be derived for example, from closed caption text that accompanies most television programs. Real-time closed captioning typically lags behind the audio and video by a variable amount of time from about 1 to 10 seconds. To take this factor into account, the embodiment of FIG. 1 is capable of using speech processing to generate very accurate word timestamps.
- When closed caption text is not available, a large vocabulary automatic speech recognition system can be used to generate a transcript of the audio track. While the accuracy of the automatically generated transcripts is below that of closed captions, they provide a reasonable alternative for identifying clips of interest with reduced, but acceptable, accuracy. Alternatively, a parallel text alignment algorithm can be used to import high quality off-line transcripts of the program when they are or become available.
- FIG. 2 implements an architecture for implementing an exemplary embodiment of the invention. It should be noted that the architectural elements discussed below can be deployed to a user and/or provider of multimedia assets in whole or in part, and therefore each element interfaces with one another and external components using standard, conventional interfaces.
- In FIG. 2, Video Capture/
Media Analysis component 205 records and compresses broadcast TV programming. Also atcomponent 205, various functions can be performed on content such as scene change detection, audio analysis, and compression. These video files are shipped to theVideo Storage database 210 from which they will be served when the video is streamed to the client 250. - Associated metadata is shipped to the
Metadata database 215. Note that thumbnail images are included as part of the metadata, as well as terms and/or phrases associated with a clips(s) for categorizing the clip(s) within a topical subset. Typically, this video capture/media analysis process need not occur in real time. However, there is no reason why it could not occur in real time if an operator so desires and wishes to devote sufficient computational resources. In any case, it is not necessary to wait until a show is completed before indexing and searching that show. -
Video Server 220 responds to clip requests and makes the video content available to the client 250. For example, thevideo server 220 may download the video clips in whole or in part, stream the clips (e.g., via MPEG4 ASF or MPEG2) to the client 250 or generate the clip metadata discussed above (such as terms and/or phrases associated with a clip for categorizing the clip within a topical subset). -
DVL Server 225 handles query requests (such as how many clips are available, which shows have clips, etc.) and/or clip content requests (metadata that describes clip content including “clip pointer” to video content). Thus, it handles multimedia search (such as closed caption text) and determines the start and stop times of the clips, which are designated with “clip pointers,” as just mentioned. -
eClips server 230 handles client requests for web pages related to a service for providing eClips.eClips server 230 utilizes Perl Common Gateway Interface (CGI) scripts that the client navigates in order to perform the functions of the eClips service. For example, the scripts deal with login/registration related pages, home page, profile related pages, archive related pages, player pages, and administration related pages. Player scripts can be launched in a separate window. Each CGI request from the client 250 will return HTML with HTML DIVs, JavaScript, and CSS style sheets. The DIVs and CSS style sheets are used to position the various elements of the page. DHTML is used to dynamically load DIV content on the fly (for instance, a list of shows in an instant search pull down performed by a user). - In FIG. 2, three
databases show database 235, which contains information about recorded broadcasts,Profile database 245, which contains personal search terms and/or phrases, andArchive database 240, which contains saved clip information (e.g., entire clips or simply clip pointers). - eClips Client250, in one embodiment, includes a JavaScript that each Perl script includes in the HTML that is returned from the
eClips server 230. It is through the JavaScript that the client 250 interacts with theDVL server 225 to determine the desired content and through JavaScript that the client initiates the streaming content with thevideo server 220. The JavaScript also accesses (reads) the Show and Profile XML files in those databases. - The
Video Server 220 may have a separate IP host name, and should support HTTP streaming. The DVL andeClips servers - In FIG. 2, the key interactions that cause video to be streamed to the client250 are demonstrated. In a home page view, a user has logged in already and should see a list of topics determined by their profile, as well as the number of clips for each topic. An example of a topic could be “sports” and the keyword string associated with this topic could be football, baseball, hockey. The keyword string is used to search the CC text (in this case, clips that have any of these terms will be valid).
- When the home page is loaded, JavaScript will send a CGI query to
DVL server 225, which generates an XML response. The XML is parsed into JavaScript variables on the client using the XML document object model (DOM). The CGI query and XML response is implemented as part of the DVL system and acts as a layer above an Index Server, which, as part of theDVL server 225, performs text indexing of the video clips (as discussed above) that allows the user to locate a desired clip. The XML response will include the number of clips found for each topic. It is with these query responses that the home page knows which topics have hits and can activate the links to play the content. - These JavaScript links, when clicked, can launch the player page in a separate window. When the player page is loaded, essentially the same JavaScript can be used to recalculate the number of clips for each topic. In principle, this could be changed to calculate this only once and to pass this on to the player script thereafter. The JavaScript may also run a query to get the list of shows with clips for a particular topic. The JavaScript then loops through all the shows with hits and queries the DVL server via the separate CGI script to get the clip information needed to play the clip. This information is also returned via XML and parsed via the JavaScript. The JavaScript loads various DIVs that depend on this information, such as hit search term found in CC text, CC text, and thumbnail. Finally, the player page JavaScript starts the media player with the first clip using a pointer (start time) to the video. It should be noted that, in one embodiment of the invention, the just-described process is almost completely automated, so that dynamic clip extraction occurs when a clip is selected, and a show automatically starts and will play completely through if not interrupted by the user.
- In the architecture shown in FIG. 2, eClips client250 may reside on, for example, a user's home or business computer, a personal digital assistant (PDA), or a set-top box on a user's television set. Client 250 interacts with
eClips server 230 as discussed above to provide the user with an interface for viewing and utilizing the video clips. Client 250 can be written to contain, for example, a JavaScript object that contains profile results (eClips object). A user using eClips client 250 running on a PC may access stored clips through a network, such as the Internet or a locally defined Intranet. - In one embodiment, the user defines a search criterion, either through an “instant search” feature or within a user profile. When multiple clips are found matching the user search, the clips can be stitched together and streamed to the user as one continuous program. In another embodiment, eClips server periodically searches for clips matching a given user's profile, and makes the clips available to the user, perhaps by notifying the user via email of the availability of the clips.
- The architecture shown in FIG. 2 allows for video to be stored and displayed in several formats including MPEG2 (e.g., for digital television and video on demand) and MPEG4 (e.g., for streaming video on the Internet). As mentioned above, the video may be stored for later use by the user; in particular, a user may archive some or all of the received video and thereafter permit searching and uploading of the video from storage by other members of a peer-to-peer computer network.
- FIG. 3 demonstrates a more specific hardware architecture according to another exemplary embodiment of the invention. In FIG. 3, video feeds310 are received through various sources (such as television channels CNN, ESPN and CNBC) at Video Capture/
Media Analysis component 205 withinVideo Distribution Center 305.Component 205 receives the feeds and forwards captured/analyzed results tovideo server 220 and/or DVL/eClips server 225/230 withincable Headend 325. In FIG. 3,video analysis portion 315 is illustrated withincomponent 205, although it should be understood from FIG. 2 and the associated discussion above thatcomponent 205 may perform other media analysis such as audio analysis. The DVL/eClips servers 225/230 operate as described above in conjunction with FIG. 2 to deliver, using, for example, Hybrid Fiber Coaxial (HFC) connections, all or part of the video feeds torouting hub 330, and then throughfiber node 340 tocable modem 350 located withinuser home 355. Additional marketing and advertising (such as a commercial placed between every third clip stitched together) could be tied into the video stream in one embodiment of the invention at the Headend fromproviders 320 such as DoubleClick. - Within
user home 355 the feed is received atcable modem 350 via high speed data line (HSD) to aPC 360 running eClips client 250. Alternatively, the feed could be sent to Settop box 370 atopTV 380, whereSet top box 370 runs eClips client 250. In the example where the video clips are received viacable modem 350, the service can be streamed as high speed data (HSD) through a cable modem as MPEG4 video. When the video is received viaSet top box 370, it can be delivered as MPEG2 over video on demand (VOD) channels that could be set up in advance for a service providing the invention. - FIG. 4 is an exemplary page view of a page viewed by a user utilizing an eClips client according to one embodiment of the invention. In FIG. 4, for example, the user might see
page view 400 just after logging in to a system implementing the invention. Inpage view 400,section 405 demonstrates the results of a profile search performed for the user on a given day, or over some other pre-defined period, according to the previously stored profile of that user. Insection 405, clips are listed both by topic and by number of clips related to that topic. Insection 405, the user therefore has the option of viewing one or more of the clips related to a particular topic. -
Section 405 also identifies a source for the criteria used to select the various topical clips. More specifically, on a profile page, a user can select default sources (shows) which will be searched based on the user's profile; this is referred to as a “Main” list, and would restrict any profile topic that has the Main option to search only those shows selected on the profile page. On a topic editor page, where a user is allowed to add or modify topics for searching, the user can specify this Main list, or can make Custom selections that are only valid for a particular search topic. Insection 405, the user has selected the latter option, and so a “source” is shown as Custom. - In
section 410, the user additionally has the option of entering new search terms and/or phrases not related to his or her current profile, whereby the invention searches a clips database via DVL server as described above with respect to FIG. 2.Section 415 indicates the media sources which will be searched for the terms or phrases entered insection 410. - Also, in
page view 400,button 420, “Play all clips,” allows a user to view all currently available clips with one click. The user can add a newtopic using button 425. The user can return to a home page by clicking on button 430 (although this option is only valid when the user is on a page different from thehome page 400 itself), access his profile via button 435 and access an archive of previously saved clips viabutton 440. Finally, a user can log out of theservice using button 445. - FIG. 5 demonstrates a page view500 showing a content retrieval page according to the exemplary embodiment shown in FIG. 4. In
section 505, still frames of the beginning of each clip (i.e., thumbnails) within a topic can be viewed by the user.Section 505 can be controlled bysection 515, which allows the user to select a topic of clips to be shown, as well assection 520, which allows a user to select a portion of the clips from that topic that will be played. Withbuttons - When one or more of these clips is chosen for viewing by the user, that clip is shown in
section 510.Section 510 can be controlled by buttons 525-550, which allow a user to skip to a previous clip with button 525, stop the clip with button 530, play the clip with button 535, skip the clip withbutton 540, switch to a new topic of clips withbutton 545 or view footage after the selected clip(s) withbutton 550. Note thatsection 510 may also include advertisements 555, and may display a time remaining for a currently playing clip, a source of the clip, and a date and time the clip was originally broadcast. - In one exemplary embodiment of the invention, page500 will play all of the clips currently available in a predetermined order (e.g., reverse chronological order, by source of content, etc.) if the user does not choose a specific topic or clip.
Button 570 is activated when a user wants to view the clip(s) available; i.e., as shown in view 500.Button 575 allows the user to send (e.g., email) the clip(s) to another user, andbutton 580 allows the user to save the clip(s) to an archive (i.e., the archive accessed bybutton 440 in FIG. 4). - Having discussed various exemplary embodiments of the invention and associated features thereof, as well as potential uses of the invention, the following provides a more detailed summary of application categories in which the invention is of use.
- Generally speaking, because the invention can capture content from nearly any multimedia source and then use standard streaming media to deliver the appropriate associated clips, it is nearly limitless in the markets and industries that it can support.
- As a practical matter, the invention can be packaged to address different market segments. Therefore, it should be assumed that the target markets and applications supported could fall into, for example, any or all of the Consumer, Business-to-Consumer or Business-to-Business Marketplaces. The following discussion summarizes some exemplary application categories.
- First, as a consumer offering, the invention can be provided as an extension to standard television programming. In this model, an ISP, Cable Programming Provider, Web Portal Provider, etc., may allow consumers to sign up for this service, or the set of features provided by the invention can be provided as a premium subscription.
- In the consumer service model, a consumer would enter a set of keywords and/or phrases in the profile. In addition, as part of the preferences selected in the profile the user may determine that only specific content sources should be monitored. As the user profile is created or changed it would be updated in the user profile database. As video content is captured in the system, the user profile database is matched against the closed caption text. As an example, a consumer may be interested in sports but only want to see the specific “play of the day.” In this scenario, the consumer would enter the key words “play of the day” and then identify in the profile the specific content sources (channels or programs) that should be recorded/analyzed by the invention. For example, the consumer could choose channels that play sports games or report on sports news. When the consumer returns from work that evening, a site or channel for accessing the invention would be accessed. This consumer would then see all of the clips of programs that matched the keywords “play of the day,” meaning that this consumer would see in one session all of the content and clips matching that set of words.
- As another example, in a Business-to-Consumer offering, the invention can be provided as an extension to standard television programming. In this case, both the programming and its sponsorship would be different from the consumer model above. For example, a corporate sponsor or numerous corporate sponsors may offer specific types of content, or may offer an assemblage of content overlaid with advertising sponsorship. The sponsorship would be evident in the advertising that would be embedded in the player or in the content, since the design of the invention is modular in design and allows for customization.
- In the Business-to-Consumer service model, a consumer would enter a set of keywords in the profile. As the user profile is created or changed it would be updated in the user profile database. Because this model and the content provided would be underwritten by corporate sponsorship, the content provided may be limited to a proprietary set of content. As an example, if CNN were the sponsor of the service, all of the content provided may be limited to CNN's own broadcasts. In addition, it may be very evident to the consumer that the service is brought to them by CNN in that the CNN logo may be embedded in the user interface, or may be embedded in the content itself.
- Next, as a Business-to-Business offering, the invention can be used in intra-company applications as well as extra-company applications. The applications supported include, as just a few examples: Business TV, Advertising, Executive Announcements, Financial News, Training, Competitive Information Services, Industry Conferences, etc. In essence, the invention can be used as a tool to assist employees in retrieving and viewing specific portions of content on demand.
- In this Business-to-Business service model, a user would enter a set of keywords in the profile that would be updated in the user profile database. In this case, the content captured will be dependent upon the business audience using the service.
- In an intra-business application, the user may wish to combine sources from within the business and sources outside of the business. As an example a user may wish to see all clips dealing with the category “Virtual Private Networks.” In this example, a business may have planned a new advertising campaign talking about “Virtual Private Networks” and have an advertisement available to its internal personnel. At the same time, there may be an internal training class that has been recorded and is available internally in which a section talks about “Virtual Private Networks.” Again, this could be another content option captured by the invention. Also, one of this company's competitors may have provided a talk at an industry conference the day before about their solution for the “Virtual Private Network” area. As with the other content options, this too could be captured and available as a content option through the invention. Therefore, when our user begins a session using the invention and looks under the term “Virtual Private Networks,” there could be numerous clips available from multiple sources (internal and external) to provide this user with a complete multimedia view of “Virtual Private Networks”.
- As an extra-business tool, the invention can provide businesses, their suppliers, their best customers, and all other members of communities of interests with specific targeted content clips that strengthen the relationships. These may include (but not be limited to) product details, new announcements, public relations messages, etc.
- As further examples of applications of the invention, the following represent industry applications which may benefit from use of the invention.
- In the financial industry, financial information can be available for both professionals and potential clients to receive late-breaking information on stocks, companies and the global markets. The information can be from a variety of sources such as Financial News Network, Bloomberg, CNN, etc. and allow users to identify key areas of interest and to continually be up to date.
- In the advertising/announcements industry, advertisers would be able to target their ads to consumers based on peoples' preferences as expressed in their profiles. This is potentially a win/win situation because people would not be getting any more ads but they would be seeing more things that interest them. Advertisers could charge more for this targeted approach and thereby pay for any costs associated with the invention.
- Similarly, large companies run TV advertisements for a multitude of products, services, target markets, etc. These companies could benefit by housing these commercials on an on-line database that can be accessible to their marketing staff, the advertising agencies, and clients interested in seeing particular commercials that used specific words or product names. The invention can then allow these commercials to be easily searched and accessed.
- In the entertainment industry, the movie industry can use the invention to easily scan through archives of old and new movie footage that can be digitized and stored in a central repository. Sports highlights can be made available for particular games or events. Networks could maintain a library of indexed TV shows (e.g., PBS) where users can search for a particular episode/topic.
- In the travel industry, searches can be done on new information in the travel industry such as airlines, causes of delays, etc. In addition, the invention can be used to provide key clips from specific resorts and other potential vacation destinations.
- In the distance learning/education industry, a large variety of courses could be stored on-line. In many circumstances, a user may want to only see the salient points on a specific topic of interest. The invention can then play a key role in providing support to the user for access and retrieval of the key needed information.
- For conferences and trade events, the invention can be an information dissemination tool for finding the latest information quickly when videos are captured of talks and demonstrations in key events.
- In one embodiment, at least portions of source video are transformed to other media formats to be delivered to a user instead of, or in addition to, the identified relevant portions of the source video. FIG. 6 is a flow diagram illustrating transformation of
video source data 610 according to one embodiment of the invention. FIG. 6 illustrates several alternative transformation paths to deliver content ofvideo source 610 todestination devices 675. As used herein,video source data 610 may be live streaming video, delayed streaming video, or stored video data. -
Sampling function 615 processesvideo source data 610 to producestatic images 620. In an embodiment wherevideo source data 610 is streaming video,capture process 623 produces avideo file 625 fromvideo source data 610.Static images 620 orvideo files 625 are then delivered todestination devices 675. - FIG. 6 illustrates that
demultiplexing process 645 processes video source file 610 to obtain or produceaudio stream 650. The flowchart shows that there are at least four options for the delivery ofaudio stream 650. First,audio stream 650 can be delivered todestination devices 675 directly. Second,capture process 653 can create sound file 655 fromaudio stream 650 for eventual delivery todestination devices 675 vialink 680. Third,speech recognition process 660 can processaudio stream 650 to producetext 665.Text 665 can then be delivered todestination devices 675. Fourth,process 668 can further processtext 665 to provide for correction of errors generated by thespeech recognition process 660, or may, either in the alternative or in combination, translatetext 665 to another language to produce processedtext 670.Processed text 670 can then be delivered todestination devices 675. - In addition, FIG. 6 illustrates that
extraction process 628 generates Closed Caption Text (CCT) 630 fromvideo source data 610.Process 633 corrects for errors inCCT 630, provides language translation, and/or performs other translations to generate processedCCT 635.Processed CCT 635 may be delivered directly todestination devices 675. In the alternative, text-to-speech process 640 operates on eitherCCT 630 or processedCCT 635 to produceaudio stream 650, with at least all transformation paths available as described above with regard toaudio stream 650 for eventual delivery todestination devices 675. It is also possible to transform fromvideo file 625 to soundfile 655 via a demultiplexing process (not shown). -
Destination devices 675 may be or include, for example, a personal computer (PC), a tablet PC, a personal digital assistant (PDA), a smart phone, or other device capable of receiving email. - Transformed content may be delivered to
destination devices 675 according to alternative timing schemes. For example,CCT 630, processedCCT 635,audio stream 650,text 665, processedtext 670 may be delivered in near real-time (e.g., where content delivery is delayed only by processing and communication overhead). In other embodiments, transformed content is stored for later delivery. Moreover, the timing for delivery of stored content may be according to a predetermined schedule, such as a set time of day. In addition, or in the alternative, content can be delivered according to a set interval of time, such as every hour or other fixed period of time. The predetermined schedule may be specified in the user's profile data. In addition, or in the alternative, the delivery of near real-time and/or stored content may be event-triggered. For instance, a user profile may specify that breaking headline news, special reports, and/or severe weather warnings trigger near real-time delivery of content separate from, or together with, related stored content. -
Sample process 615,demultiplexing process 645,extraction process 628, text-to-speech process 640,speech recognition process 660, capture processes 623 and 653, and processes 633 and 668 may be performed on a server or other network-based host computer having access tovideo source data 610. - FIG. 7 is a block diagram of a functional architecture for delivering video content to an electronic mail client according to one embodiment of the invention. In the illustrated embodiment, a
server 710 is configured to identify relevant content invideo broadcast 705 or other video source based onuser profile data 715 and deliver the relevant content in the form of a video clip or link to anemail client 720. As shown,server 710 provides not only access touser profile data 715, but also is configured to perform network-based processing to identify and deliver video content.User profile data 715 includes subjects (or topics) of information that are relevant to an end-user receiving email atemail client 720. In addition,user profile data 715 includes an email address for a user. As will be discussed with reference to FIGS. 10-12B,email client 720 is alternatively a conventional email client or an enhanced email client. - FIG. 8 is a flow diagram of a process for delivering video content to an electronic mail client according to one embodiment of the invention. In one embodiment, the process depicted in FIG. 8 is performed by the
server 710. As illustrated, the process begins with receipt of previously-specifieduser profile data 715 instep 805.Server 710 identifies relevant portions ofvideo broadcast 705 instep 810, based on topical information included in theuser profile data 715. Instep 815,server 710 optionally transforms relevant portions of thevideo broadcast 705 according to processes depicted in FIG. 6. For example,server 710 can generate closed caption text and/or image data based onvideo broadcast 705.Server 710 automatically builds an email message instep 820 without manual intervention, and sends the email message to emailclient 720 instep 825. - In one embodiment of
step 820, one or more URL's or other links are included in the body of the email message pointing to a Web page containing the video content or to a Web page that causes a media player to be launched. In an another embodiment ofstep 820, the video content is attached to the email message as one or more multimedia files. In yet another embodiment ofstep 820, one or more metafiles are attached to the email message. - Metafiles are small text files that contain information about media files including media file location, and optionally include information such as author or artist, start time, and duration. Examples of metafiles are Microsoft Windows™ Advanced Stream Redirector (.asx) files, Microsoft Windows™ Media Audio Redirector (.wax) files, Microsoft Windows™Media Redirector (.wvx) files, and Real Networks' Real Audio Metafile (.ram) files. The application of metafiles has many advantages. For example, because a metafile can specify several different locations for a media stream, the delivery of video content can be fault tolerant. In addition, a metafile can define a series of media streams to be played in sequence to form a larger, aggregate presentation from a collection of smaller video streams. Also, because metafiles can specify a start and a duration, shorter segments of interest can be specified within a longer media file. Moreover, since metafiles are small text files, emails having metafile attachments are more easily downloaded and stored than emails having large video files attachments, for example.
- FIG. 9 is a flow diagram for mapping video metadata to an electronic mail message according to one embodiment of the invention. In other words, FIG. 9 illustrates one embodiment of at least a portion of
process step 820. As shown therein,metadata 910 is associated withvideo source data 905.Metadata 910 may include, for example,source information 915,subject matter 920, andbroadcast date 925. As illustrated, in order to automatically generate an email message frommetadata 910,source information 915 is inserted into a “from” field instep 930, subject 920 is inserted into a “subject” field instep 935, andbroadcast date 925 is inserted into a “date sent” field instep 940. Accordingly,metadata 910 can be used to automatically generate an otherwise conventional email message. - Many alternatives to the process flow of FIG. 9 are possible. For example, where an email is being generated with multiple video clips from multiple sources, information pertaining to a service provider may be inserted into the “from” field instead of information pertaining to any single source. In addition, the
broadcast date 925 can be inserted into the “subject” field of an electronic message. Moreover, any one or more ofsource information 915, subject 920 andbroadcast date 925 can instead be automatically inserted into the body of an electronic message instead of into conventional email header fields. - FIG. 10 is an illustration of an electronic mail message according to one embodiment of the invention. FIG. 10 illustrates an email created by the process in FIG. 9. As shown, an email includes
header information 1005.Source information 915, namely “UVW NEWS,” has been inserted into “from”field 1010. Subject 920, namely “MAD COW,” has been inserted intosubject field 1020.Broadcast date 925, namely “MON 10/1/2002, ” has been inserted into sentfield 1025. As also shown, “JOE USER” has been inserted into “to”field 1015. In one embodiment, sentfield 1025 also includes the time. In addition to, or in the alternative to sentfield 1025,header information 1005 includes a received field (not shown) to display the date and/or time the email was received. - As illustrated, the email message in FIG. 10 has a
body 1030 that includestext link 1035 andCCT 1040. The word BOVINE intext link 1035 can be hyperlinked to access a video clip related to MAD COW from a Web page having an embedded media player, for example, or can be played with a media player local to theemail client 720.Body 1030 optionally includesmultiple text links 1035 for access to a corresponding quantity of video clips.CCT 1040 includes CCT that has been created from a relevant video source. In the alternative, or in combination,CCT 1040 includes processed CCT as described with reference to FIG. 6 above. - FIG. 10 also illustrates an
attachment area 1045. As shown,attachment area 1045 includes an Icon for ametafile 1050. In an alternative embodiment,attachment area 1045 will indicate one or more attached media files (not shown). Various combinations oftext links 1035 inbody 1030, metafile(s) 1050 inattachment area 1045 and media file(s) (not shown) inattachment area 1045 are possible. - FIG. 11 is an illustration of an electronic mail message according to another embodiment of the invention. As shown, an email includes
header information 1105. Service provider information “RST ONLINE,” has been inserted into “from”field 1110; “WORLD NEWS,” has been inserted intosubject field 1120; and “MON 10/1/2002,” has been inserted into date sentfield 1125. As also shown, “JOE USER” has been inserted into “to”field 1115. - As illustrated in FIG. 11, an automatically generated email message has a message body including
delivery message area 1130,topic area 1135, andcontent areas video clip headers Content areas thumbnails thumbnails 1150 and/or 1170 to launch a media player local to emailclient 720 to play at least a portion of relevant source video. Alternatively, or in combination, when the user selectsthumbnails 1150 and/or 1170, theemail client 720 links to a Web page having an embedded media player to play at least a portion of relevant source video.Content areas CCT thumbnails - In one embodiment, the email message illustrated in FIG. 11 includes an attachment area having one or
more metafiles 1050 and/or one or more media files. In the alternative, or in combination with other features, an embodiment of the email message illustrated in FIG. 11 includes one ormore text links 1035. Features of the email in FIG. 11 are optional, except that the email should include sufficient header information for delivery, and some form of content derived from the relevant source video, or links thereto. - Advantageously, the email messages illustrated in FIGS. 10 and 11 can be delivered and viewed using conventional email servers and clients.
- FIG. 12A is an illustration of an exemplary graphical user interface (GUI) for managing and viewing electronic mail messages having video content according to one embodiment of the invention. The GUI illustrated in FIG. 12A is part of an
enhanced email client 720 adapted for the management and presentation of video content delivered by email. As illustrated, anenhanced email client 720 has asearch area 1205. In one embodiment,search area 1205 is used for updatinguser profile data 715. In another embodiment,search area 1205 is used for searching within video content stored onemail client 720. - The GUI of FIG. 12A can be viewed as having a management area and a viewing area. As illustrated, the management area includes
headings 1215,topic listings video clip data media control bar 1250,window 1210 andCCT 1255. By adjusting a boundary between the management area and the viewing area, a user can expand the management area while deleting, selecting, or otherwise managing the video clips, then expand the viewing area while viewing thumbnails, video, CCT, or otherwise viewing video and/or other multimedia content. - Headings1215 provide a framework for summarizing video clips delivered to the
email client 720. Other information could optionally be used. For example, service provider, file size, or other information can be displayed for each video clip according toalternative headings 1215. As shown,video clip data -
Media control bar 1250 provides controls for playing one or more selected video clips.Media control bar 1250 allows for navigation between video clips and/or topics. In addition, or in the alternative,media control bar 1250 allows for multiple video clips to be queued for presentation in a predetermined sequence. Exemplary features ofmedia control bar 1250 are labeled in FIG. 12B. As shown therein,media control bar 1250 includesannotate button 1260,next button 1265,play bar 1270 having aslider 1275,play button 1280 and pull downmenu 1285. -
Annotate button 1260 allows a user to associate comments or other metadata with video clips in the management area.Next button 1265 skips over the video clip queued up or being played in the viewing area.Play bar 1270 is a graphical representation of a series of selected video clips. As illustrated,play bar 1270 represents video clips Bovine, Attorney General, and Homerun Derby that are selected in the management area. In one embodiment,play bar 1270 is color coded according to corresponding colors associated with the selected video clips and/or topics in the management area.Play bar 1270 has aslider 1275 to illustrate progression of play through each of the clips illustrated inplay bar 1270. As shown, theslider 1275 indicates that the viewing area is playing an early portion of the Bovine video clip. In one embodiment,play bar 1270 can also be used to advance or retard play within the series of selected video clips. For example, a user could moveslider 1275 from its illustrated position to jump to a middle portion of the Homerun Derby clip, for instance.Play button 1280 begins or resumes play of one or more video clips according to the menu item selected in pull downmenu 1285. In addition to “Play Checked” illustrated in FIGS. 12A and 12B, pull downmenu 1285 could contain options such as “Play All,” “Play One Clip Per Topic,” or other alternatives. - In one embodiment,
window 1210 is a thumbnail image that is replaced by a video thumbscreen while selected video clips are being played. In another embodiment, one or more local media players are launched to present the selected video clips to the user. In the alternative or in combination, selection ofwindow 1210 can link to a Web page having an embedded media player for presenting the selected video clips to the user.CCT 1255 provides CCT or processed CCT corresponding to the thumbnail image or video thumbscreen inwindow 1210. In a preferred embodiment,CCT 1255 automatically scrolls in synchronization with a video thumbscreen inwindow 1210. - In conclusion, a service for providing personalized multimedia assets such as electronic clips from video programs, based upon personal profiles, has been presented. In one embodiment, it uses text to ascertain the appropriate clips to extract and then assembles these clips into a single session. Thus, users only see the specific portions of videos that they desire. Therefore, users do not have to undertake the arduous task of manually finding desired video segments, and further don't have to manually select the specified videos one at a time. Rather, the invention generates all of the desired content automatically. Moreover, one embodiment of the invention provides an improved system and method for automatically delivering video content via email without the delay and expense of manual alternatives.
- While this invention has been described in various explanatory embodiments, other embodiments and variations can be effected by a person of ordinary skill in the art without departing from the scope of the invention.
Claims (29)
1. A method for arranging for delivery of content from a video source, comprising:
automatically identifying a portion of at least one source video stream with reference to a predetermined user profile;
transforming the identified portion of the at least one source video stream into at least one destination medium; and
automatically building an electronic mail message based on the at least one destination medium and the identified portion of the at least one source video.
2. The method of claim 1 , wherein automatically identifying comprises determining a start of the identified portion of the at least one source video stream and an end of the identified portion of the at least one source video stream.
3. The method of claim 1 , wherein automatically identifying comprises determining at least one pointer to the identified portion of the corresponding at least one source video stream.
4. The method of claim 3 , wherein automatically building comprises embedding the at least one pointer in the electronic mail message.
5. The method of claim 1 , wherein transforming comprises sampling the identified portion of the at least one source video stream, and the at least one destination medium comprises at least one image.
6. The method of claim 5 , wherein automatically building comprises embedding the at least one image in the body of the electronic mail message.
7. The method of claim 1 , wherein transforming comprises extracting information from the identified portion of the at least one source video stream to yield closed caption text.
8. The method of claim 7 , wherein transforming further comprises processing the closed caption text for at least one of error correction and language translation.
9. The method of claim 7 , wherein transforming further comprises a text-to-speech conversion of the closed caption text into a sound file.
10. The method of claim 1 , wherein transforming comprises creating a video file from the identified portion of the at least one source video stream.
11. The method of claim 10 , wherein automatically building comprises attaching the video file to the electronic mail message.
12. The method of claim 1 , wherein automatically building an electronic mail message comprises inserting metadata related to the identified portion of the at least one source video stream into a header of the electronic mail message.
13. The method of claim 12 , wherein the metadata includes at least one of source information, subject and broadcast date.
14. The method of claim 1 , further comprising sending the electronic mail message.
15. The method of claim 14 , wherein sending the electronic mail message is performed according to at least one of a predetermined time and a predetermined time interval.
16. The method of claim 14 , wherein sending the electronic mail message is event-triggered.
17. A method for arranging for the delivery of content from a video source, comprising:
automatically identifying a portion of at least one source video stream based on relevance to a predetermined user profile;
transforming the identified portion of the at least one source video stream into at least a thumbnail image and closed caption text; and
automatically building an electronic mail message using the thumbnail image and the closed caption text.
18. The method of claim 17 , wherein automatically building the electronic mail message further comprises at least one of attaching the portion of the at least one source video stream and linking to the portion of the at least one source video stream.
19. A system for arranging the delivery of content to an electronic mail client, comprising:
at least one video source;
a user profile database; and
a server coupled to the video source and the user profile database, wherein the server is configured to read profile data from the user profile database, automatically identify a portion of the at least one video source using the profile data, transform the identified portion of the at least one video source into a destination medium, and automatically build an electronic mail message using the destination medium.
20. A computer-readable storage medium configured to provide a graphical user interface for an electronic mail client, the graphical user interface comprising:
a management feature for managing a plurality of electronic mail messages based on metadata, wherein the metadata includes at least one of broadcast source, broadcast date and duration information related to at least one corresponding source video for each of the plurality of electronic mail messages; and
a view feature for viewing a selected portion of the at least one corresponding source video and a medium derived from a selected portion of the at least one corresponding source video.
21. The system of claim 20 , wherein the medium derived from the selected portion of the at least one corresponding source video comprises a thumbnail image.
22. The system of claim 21 , wherein the at least one thumbnail image is a representative frame of the selected portion of the at least one corresponding source video.
23. The system of claim 20 , wherein the medium derived from the selected portion of the at least one corresponding source video comprises closed caption text.
24. The system of claim 20 , wherein the view feature comprises at least one video player.
25. A system configured to deliver content from a video source, comprising:
means for automatically identifying a portion of at least one source video stream based on relevance to a predetermined user profile;
means for transforming the identified portion of the at least one source video stream into a destination medium; and
means for automatically building an electronic mail message based on the destination medium and the identified portion of the at least one source video.
26. The system of claim 25 , further comprising means for sending the electronic mail message.
27. The method of claim 25 , wherein the means for sending the electronic mail message is configured to execute at one of a predetermined time and a predetermined time interval.
28. The method of claim 25 , wherein the means for sending the electronic mail message is configured to execute in response to a predetermined event based on the relevance to the predetermined user profile.
29. A method for creating an electronic mail message for delivery of video information to a user comprising:
selecting video information from at least one source video stream using user profile information;
formatting the selected video information in accordance with the profile information; and
populating fields of an electronic message with formatted video information and destination information in accordance with the user profile information.
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/325,830 US20030088687A1 (en) | 2001-12-28 | 2002-12-23 | Method and apparatus for automatically converting source video into electronic mail messages |
US11/513,459 US8296811B1 (en) | 2001-04-06 | 2006-08-31 | Method and apparatus for automatically converting source video into electronic mail messages |
US13/609,896 US9253519B2 (en) | 2001-04-06 | 2012-09-11 | Method and apparatus for automatically converting source video into electronic mail messages |
US14/966,747 US10462510B2 (en) | 2001-04-06 | 2015-12-11 | Method and apparatus for automatically converting source video into electronic mail messages |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/034,679 US20030163815A1 (en) | 2001-04-06 | 2001-12-28 | Method and system for personalized multimedia delivery service |
US10/325,830 US20030088687A1 (en) | 2001-12-28 | 2002-12-23 | Method and apparatus for automatically converting source video into electronic mail messages |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/034,679 Continuation-In-Part US20030163815A1 (en) | 2001-04-06 | 2001-12-28 | Method and system for personalized multimedia delivery service |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/513,459 Division US8296811B1 (en) | 2001-04-06 | 2006-08-31 | Method and apparatus for automatically converting source video into electronic mail messages |
Publications (1)
Publication Number | Publication Date |
---|---|
US20030088687A1 true US20030088687A1 (en) | 2003-05-08 |
Family
ID=21877921
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/325,830 Abandoned US20030088687A1 (en) | 2001-04-06 | 2002-12-23 | Method and apparatus for automatically converting source video into electronic mail messages |
US11/513,459 Expired - Fee Related US8296811B1 (en) | 2001-04-06 | 2006-08-31 | Method and apparatus for automatically converting source video into electronic mail messages |
US13/609,896 Expired - Fee Related US9253519B2 (en) | 2001-04-06 | 2012-09-11 | Method and apparatus for automatically converting source video into electronic mail messages |
US14/966,747 Expired - Fee Related US10462510B2 (en) | 2001-04-06 | 2015-12-11 | Method and apparatus for automatically converting source video into electronic mail messages |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/513,459 Expired - Fee Related US8296811B1 (en) | 2001-04-06 | 2006-08-31 | Method and apparatus for automatically converting source video into electronic mail messages |
US13/609,896 Expired - Fee Related US9253519B2 (en) | 2001-04-06 | 2012-09-11 | Method and apparatus for automatically converting source video into electronic mail messages |
US14/966,747 Expired - Fee Related US10462510B2 (en) | 2001-04-06 | 2015-12-11 | Method and apparatus for automatically converting source video into electronic mail messages |
Country Status (1)
Country | Link |
---|---|
US (4) | US20030088687A1 (en) |
Cited By (55)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050240596A1 (en) * | 2004-02-12 | 2005-10-27 | Bill Worthen | Managed rich media system and method |
US20060120697A1 (en) * | 2004-12-06 | 2006-06-08 | Gabriel Beged-Dov | Simultaneous audio and visual content download and playback |
US20060184431A1 (en) * | 2000-04-12 | 2006-08-17 | Music Choice | Media content delivery systems and methods |
US20060212905A1 (en) * | 2005-03-17 | 2006-09-21 | Hitachi, Ltd. | Broadcast receiving terminal and information processing apparatus |
US20070038712A1 (en) * | 2005-08-15 | 2007-02-15 | Microsoft Corporation | Acquisition of syndication feed items via an information workflow application |
US20070064743A1 (en) * | 2004-06-30 | 2007-03-22 | Bettis Sonny R | Provision of messaging services from a video messaging system based on ANI and CLID |
US20070094605A1 (en) * | 2005-10-20 | 2007-04-26 | Dietz Timothy A | System for transforming selected sections of a network, e.g. Web documents accessed from network sites, e.g. Web sites, into e-mail messages |
US20070253675A1 (en) * | 2006-04-28 | 2007-11-01 | Weaver Timothy H | Methods, systems, and products for recording media |
US20070255915A1 (en) * | 2006-04-28 | 2007-11-01 | Timothy Weaver | Methods, systems, and products for recording media |
US20070282708A1 (en) * | 2000-04-12 | 2007-12-06 | Music Choice | Cross Channel Delivery System and Method |
US20070288574A1 (en) * | 2006-06-09 | 2007-12-13 | Daren Koster | System and method of email streaming digital video for subscribers |
US20070294717A1 (en) * | 2005-07-08 | 2007-12-20 | Hill Peter N | Methods, systems, and products for conserving bandwidth |
US20080189329A1 (en) * | 2007-02-07 | 2008-08-07 | Weaver Timothy H | Methods, systems, and products for targeting media |
US20080189338A1 (en) * | 2007-02-07 | 2008-08-07 | Weaver Timothy H | Methods, systems, and products for restoring media |
US20080263160A1 (en) * | 2007-04-20 | 2008-10-23 | Samsung Electronics Co., Ltd. | Method for displaying content information and video apparatus thereof |
US20090024923A1 (en) * | 2007-07-18 | 2009-01-22 | Gunthar Hartwig | Embedded Video Player |
US20090024927A1 (en) * | 2007-07-18 | 2009-01-22 | Jasson Schrock | Embedded Video Playlists |
US20090030991A1 (en) * | 2007-07-25 | 2009-01-29 | Yahoo! Inc. | System and method for streaming videos inline with an e-mail |
US20090077603A1 (en) * | 2007-09-18 | 2009-03-19 | Kabushiki Kaisha Toshiba | Mobile terminal |
US20090089401A1 (en) * | 2007-10-01 | 2009-04-02 | Microsoft Corporation | Server-controlled distribution of media content |
US20090125951A1 (en) * | 2007-11-08 | 2009-05-14 | Yahoo! Inc. | System and method for a personal video inbox channel |
WO2010021833A3 (en) * | 2008-08-21 | 2010-04-15 | Yahoo! Inc. | System and method for context enhanced messaging |
US20100306401A1 (en) * | 2009-05-29 | 2010-12-02 | Comcast Cable Communications, Llc | Switched Multicast Video Streaming |
US8260845B1 (en) | 2007-11-21 | 2012-09-04 | Appcelerator, Inc. | System and method for auto-generating JavaScript proxies and meta-proxies |
US8285813B1 (en) * | 2007-12-05 | 2012-10-09 | Appcelerator, Inc. | System and method for emulating different user agents on a server |
US8291079B1 (en) | 2008-06-04 | 2012-10-16 | Appcelerator, Inc. | System and method for developing, deploying, managing and monitoring a web application in a single environment |
US8335982B1 (en) | 2007-12-05 | 2012-12-18 | Appcelerator, Inc. | System and method for binding a document object model through JavaScript callbacks |
WO2013082142A1 (en) * | 2011-11-28 | 2013-06-06 | Discovery Communications, Llc | Methods and apparatus for enhancing a digital content experience |
US20130185163A1 (en) * | 2004-06-07 | 2013-07-18 | Sling Media Inc. | Management of shared media content |
US8527860B1 (en) | 2007-12-04 | 2013-09-03 | Appcelerator, Inc. | System and method for exposing the dynamic web server-side |
US8566807B1 (en) | 2007-11-23 | 2013-10-22 | Appcelerator, Inc. | System and method for accessibility of document object model and JavaScript by other platforms |
US8639743B1 (en) | 2007-12-05 | 2014-01-28 | Appcelerator, Inc. | System and method for on-the-fly rewriting of JavaScript |
US8719451B1 (en) | 2007-11-23 | 2014-05-06 | Appcelerator, Inc. | System and method for on-the-fly, post-processing document object model manipulation |
US8756579B1 (en) | 2007-12-03 | 2014-06-17 | Appcelerator, Inc. | Client-side and server-side unified validation |
US8806431B1 (en) | 2007-12-03 | 2014-08-12 | Appecelerator, Inc. | Aspect oriented programming |
US8819539B1 (en) | 2007-12-03 | 2014-08-26 | Appcelerator, Inc. | On-the-fly rewriting of uniform resource locators in a web-page |
US8880678B1 (en) | 2008-06-05 | 2014-11-04 | Appcelerator, Inc. | System and method for managing and monitoring a web application using multiple cloud providers |
US8914774B1 (en) | 2007-11-15 | 2014-12-16 | Appcelerator, Inc. | System and method for tagging code to determine where the code runs |
US8938491B1 (en) | 2007-12-04 | 2015-01-20 | Appcelerator, Inc. | System and method for secure binding of client calls and server functions |
US8954989B1 (en) | 2007-11-19 | 2015-02-10 | Appcelerator, Inc. | Flexible, event-driven JavaScript server architecture |
US8954553B1 (en) | 2008-11-04 | 2015-02-10 | Appcelerator, Inc. | System and method for developing, deploying, managing and monitoring a web application in a single environment |
US20150066913A1 (en) * | 2012-03-27 | 2015-03-05 | Roku, Inc. | System and method for searching multimedia |
US20150205794A1 (en) * | 2014-01-22 | 2015-07-23 | International Business Machines Corporation | Adjusting prominence of a participant profile in a social networking interface |
US9122650B1 (en) | 2007-11-14 | 2015-09-01 | Appcelerator, Inc. | Web server based on the same paradigms as web clients |
US20170053029A1 (en) * | 2011-12-15 | 2017-02-23 | Yahoo! Inc. | Systems and methods involving features of search and/or search integration |
US9716910B2 (en) | 2004-06-07 | 2017-07-25 | Sling Media, L.L.C. | Personal video recorder functionality for placeshifting systems |
US9781473B2 (en) | 1999-05-26 | 2017-10-03 | Echostar Technologies L.L.C. | Method for effectively implementing a multi-room television system |
US20170329762A1 (en) * | 2016-05-13 | 2017-11-16 | Comcast Cable Communications, Llc | Methods and systems for matching interests with content |
US20170351669A1 (en) * | 2016-06-02 | 2017-12-07 | Hisense Co., Ltd. | Audio/video searching method, apparatus and terminal |
US9877070B2 (en) | 2004-06-07 | 2018-01-23 | Sling Media Inc. | Fast-start streaming and buffering of streaming content for personal media player |
US9998802B2 (en) | 2004-06-07 | 2018-06-12 | Sling Media LLC | Systems and methods for creating variable length clips from a media stream |
US10091354B1 (en) * | 2016-12-15 | 2018-10-02 | Sorenson Ip Holdings, Llc | Transcribing media files |
US10419809B2 (en) | 2004-06-07 | 2019-09-17 | Sling Media LLC | Selection and presentation of context-relevant supplemental content and advertising |
US20200059696A1 (en) * | 2004-04-07 | 2020-02-20 | Visible World, Llc | System And Method For Enhanced Video Selection |
US10645457B2 (en) * | 2015-06-04 | 2020-05-05 | Comcast Cable Communications, Llc | Using text data in content presentation and content search |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080183541A1 (en) * | 2007-01-26 | 2008-07-31 | Albert Wenger | Method of transmitting portions of media |
US8694506B2 (en) * | 2009-10-07 | 2014-04-08 | Lifethread, Llc | System for displaying graphical narrations |
US8379801B2 (en) * | 2009-11-24 | 2013-02-19 | Sorenson Communications, Inc. | Methods and systems related to text caption error correction |
KR102108893B1 (en) * | 2013-07-11 | 2020-05-11 | 엘지전자 주식회사 | Mobile terminal |
KR102047703B1 (en) * | 2013-08-09 | 2019-11-22 | 엘지전자 주식회사 | Mobile terminal and controlling method thereof |
US10489016B1 (en) * | 2016-06-20 | 2019-11-26 | Amazon Technologies, Inc. | Identifying and recommending events of interest in real-time media content |
US11042584B2 (en) | 2017-07-26 | 2021-06-22 | Cyberlink Corp. | Systems and methods for random access of slide content in recorded webinar presentations |
US10423727B1 (en) | 2018-01-11 | 2019-09-24 | Wells Fargo Bank, N.A. | Systems and methods for processing nuances in natural language |
US10841623B1 (en) * | 2018-07-26 | 2020-11-17 | CSC Holdings, LLC | System and method for real-time distributed MPEG transport stream analysis |
Citations (56)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5614940A (en) * | 1994-10-21 | 1997-03-25 | Intel Corporation | Method and apparatus for providing broadcast information with indexing |
US5664227A (en) * | 1994-10-14 | 1997-09-02 | Carnegie Mellon University | System and method for skimming digital audio/video data |
US5708767A (en) * | 1995-02-03 | 1998-01-13 | The Trustees Of Princeton University | Method and apparatus for video browsing based on content and structure |
US5710591A (en) * | 1995-06-27 | 1998-01-20 | At&T | Method and apparatus for recording and indexing an audio and multimedia conference |
US5805763A (en) * | 1995-05-05 | 1998-09-08 | Microsoft Corporation | System and method for automatically recording programs in an interactive viewing system |
US5821945A (en) * | 1995-02-03 | 1998-10-13 | The Trustees Of Princeton University | Method and apparatus for video browsing based on content and structure |
US5835667A (en) * | 1994-10-14 | 1998-11-10 | Carnegie Mellon University | Method and apparatus for creating a searchable digital video library and a system and method of using such a library |
US5864366A (en) * | 1997-02-05 | 1999-01-26 | International Business Machines Corporation | System and method for selecting video information with intensity difference |
US5874986A (en) * | 1996-06-26 | 1999-02-23 | At&T Corp | Method for communicating audiovisual programs over a communications network |
US5956026A (en) * | 1997-12-19 | 1999-09-21 | Sharp Laboratories Of America, Inc. | Method for hierarchical summarization and browsing of digital video |
US5999985A (en) * | 1995-04-13 | 1999-12-07 | Siemens Aktiengesellschaft | Method and apparatus for storing, searching and playback of items of information of a multimedia electronic mail system |
US6038296A (en) * | 1997-10-07 | 2000-03-14 | Lucent Technologies Inc. | Internet/intranet user interface to a multimedia messaging system |
US6061056A (en) * | 1996-03-04 | 2000-05-09 | Telexis Corporation | Television monitoring system with automatic selection of program material of interest and subsequent display under user control |
US6092107A (en) * | 1997-04-07 | 2000-07-18 | At&T Corp | System and method for interfacing MPEG-coded audiovisual objects permitting adaptive control |
US6098082A (en) * | 1996-07-15 | 2000-08-01 | At&T Corp | Method for automatically providing a compressed rendition of a video program in a format suitable for electronic searching and retrieval |
US6166735A (en) * | 1997-12-03 | 2000-12-26 | International Business Machines Corporation | Video story board user interface for selective downloading and displaying of desired portions of remote-stored video data objects |
US6233389B1 (en) * | 1998-07-30 | 2001-05-15 | Tivo, Inc. | Multimedia time warping system |
US6236395B1 (en) * | 1999-02-01 | 2001-05-22 | Sharp Laboratories Of America, Inc. | Audiovisual information management system |
US6243676B1 (en) * | 1998-12-23 | 2001-06-05 | Openwave Systems Inc. | Searching and retrieving multimedia information |
US20010013123A1 (en) * | 1991-11-25 | 2001-08-09 | Freeman Michael J. | Customized program creation by splicing server based video, audio, or graphical segments |
US6282549B1 (en) * | 1996-05-24 | 2001-08-28 | Magnifi, Inc. | Indexing of media content on a network |
US6289346B1 (en) * | 1998-03-12 | 2001-09-11 | At&T Corp. | Apparatus and method for a bookmarking system |
US6304898B1 (en) * | 1999-10-13 | 2001-10-16 | Datahouse, Inc. | Method and system for creating and sending graphical email |
US6324512B1 (en) * | 1999-08-26 | 2001-11-27 | Matsushita Electric Industrial Co., Ltd. | System and method for allowing family members to access TV contents and program media recorder over telephone or internet |
US6324338B1 (en) * | 1998-08-07 | 2001-11-27 | Replaytv, Inc. | Video data recorder with integrated channel guides |
US20010049826A1 (en) * | 2000-01-19 | 2001-12-06 | Itzhak Wilf | Method of searching video channels by content |
US20010052019A1 (en) * | 2000-02-04 | 2001-12-13 | Ovt, Inc. | Video mail delivery system |
US6345279B1 (en) * | 1999-04-23 | 2002-02-05 | International Business Machines Corporation | Methods and apparatus for adapting multimedia content for client devices |
US6363380B1 (en) * | 1998-01-13 | 2002-03-26 | U.S. Philips Corporation | Multimedia computer system with story segmentation capability and operating program therefor including finite automation video parser |
US20020038456A1 (en) * | 2000-09-22 | 2002-03-28 | Hansen Michael W. | Method and system for the automatic production and distribution of media content using the internet |
US20020052747A1 (en) * | 2000-08-21 | 2002-05-02 | Sarukkai Ramesh R. | Method and system of interpreting and presenting web content using a voice browser |
US6385306B1 (en) * | 2000-03-02 | 2002-05-07 | John Francis Baxter, Jr. | Audio file transmission method |
US6415327B1 (en) * | 1998-03-09 | 2002-07-02 | Microsoft Corporation | Automatic protocol rollover in streaming multimedia data delivery systems |
US20020093591A1 (en) * | 2000-12-12 | 2002-07-18 | Nec Usa, Inc. | Creating audio-centric, imagecentric, and integrated audio visual summaries |
US6453355B1 (en) * | 1998-01-15 | 2002-09-17 | Apple Computer, Inc. | Method and apparatus for media data transmission |
US20020138843A1 (en) * | 2000-05-19 | 2002-09-26 | Andrew Samaan | Video distribution method and system |
US6460075B2 (en) * | 1998-07-31 | 2002-10-01 | Webtv Networks, Inc. | Browser-based email system with user interface for audio/video capture |
US20020152477A1 (en) * | 1998-05-29 | 2002-10-17 | Opentv, Inc. | Module manager for interactive television system |
US6477707B1 (en) * | 1998-03-24 | 2002-11-05 | Fantastic Corporation | Method and system for broadcast transmission of media objects |
US6477565B1 (en) * | 1999-06-01 | 2002-11-05 | Yodlee.Com, Inc. | Method and apparatus for restructuring of personalized data for transmission from a data network to connected and portable network appliances |
US20020173964A1 (en) * | 2001-03-30 | 2002-11-21 | International Business Machines Corporation | Speech driven data selection in a voice-enabled program |
US6496857B1 (en) * | 2000-02-08 | 2002-12-17 | Mirror Worlds Technologies, Inc. | Delivering targeted, enhanced advertisements across electronic networks |
US6564263B1 (en) * | 1998-12-04 | 2003-05-13 | International Business Machines Corporation | Multimedia content description framework |
US6671715B1 (en) * | 2000-01-21 | 2003-12-30 | Microstrategy, Inc. | System and method for automatic, real-time delivery of personalized informational and transactional data to users via high throughput content delivery device |
US6678890B1 (en) * | 1999-03-10 | 2004-01-13 | Sony Corporation | Bidirectional transmission/reception system and method and transmission apparatus |
US6691954B1 (en) * | 2001-12-28 | 2004-02-17 | Ocean Rodeo Sports Inc. | Integrated kite control bar and controlled tension release safety device |
US6748421B1 (en) * | 1998-12-23 | 2004-06-08 | Canon Kabushiki Kaisha | Method and system for conveying video messages |
US20040117831A1 (en) * | 1999-06-28 | 2004-06-17 | United Video Properties, Inc. | Interactive television program guide system and method with niche hubs |
US6810526B1 (en) * | 1996-08-14 | 2004-10-26 | March Networks Corporation | Centralized broadcast channel real-time search system |
US20050028194A1 (en) * | 1998-01-13 | 2005-02-03 | Elenbaas Jan Hermanus | Personalized news retrieval system |
US20050076357A1 (en) * | 1999-10-28 | 2005-04-07 | Fenne Adam Michael | Dynamic insertion of targeted sponsored video messages into Internet multimedia broadcasts |
US20050076378A1 (en) * | 1999-12-16 | 2005-04-07 | Microsoft Corporation | Live presentation searching |
US6956573B1 (en) * | 1996-11-15 | 2005-10-18 | Sarnoff Corporation | Method and apparatus for efficiently representing storing and accessing video information |
US6961954B1 (en) * | 1997-10-27 | 2005-11-01 | The Mitre Corporation | Automated segmentation, information extraction, summarization, and presentation of broadcast news |
US6970915B1 (en) * | 1999-11-01 | 2005-11-29 | Tellme Networks, Inc. | Streaming content over a telephone interface |
US20050278741A1 (en) * | 1997-03-31 | 2005-12-15 | Microsoft Corporation | Query-based electronic program guide |
Family Cites Families (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5237648A (en) * | 1990-06-08 | 1993-08-17 | Apple Computer, Inc. | Apparatus and method for editing a video recording by selecting and displaying video clips |
US5758257A (en) | 1994-11-29 | 1998-05-26 | Herz; Frederick | System and method for scheduling broadcast of and access to video programs and other data using customer profiles |
GB9504376D0 (en) | 1995-03-04 | 1995-04-26 | Televitesse Systems Inc | Automatic broadcast monitoring system |
US7111009B1 (en) * | 1997-03-14 | 2006-09-19 | Microsoft Corporation | Interactive playlist generation using annotations |
US6564383B1 (en) * | 1997-04-14 | 2003-05-13 | International Business Machines Corporation | Method and system for interactively capturing organizing and presenting information generated from television programs to viewers |
GB2341502B (en) | 1998-09-08 | 2003-01-22 | Mitel Semiconductor Ltd | Image reject mixer circuit arrangements |
US6847778B1 (en) * | 1999-03-30 | 2005-01-25 | Tivo, Inc. | Multimedia visual progress indication system |
US7051357B2 (en) * | 1999-05-28 | 2006-05-23 | Intel Corporation | Communicating ancillary information associated with a plurality of audio/video programs |
US7313808B1 (en) * | 1999-07-08 | 2007-12-25 | Microsoft Corporation | Browsing continuous multimedia content |
US20050223408A1 (en) | 1999-09-13 | 2005-10-06 | Microstrategy, Incorporated | System and method for real-time, personalized, dynamic, interactive voice services for entertainment-related information |
US7181691B2 (en) | 1999-09-16 | 2007-02-20 | Sharp Laboratories Of America, Inc. | Audiovisual information management system with presentation service |
KR100350787B1 (en) | 1999-09-22 | 2002-08-28 | 엘지전자 주식회사 | Multimedia browser based on user profile having ordering preference of searching item of multimedia data |
US7149964B1 (en) * | 2000-02-09 | 2006-12-12 | Microsoft Corporation | Creation and delivery of customized content |
US20020056123A1 (en) * | 2000-03-09 | 2002-05-09 | Gad Liwerant | Sharing a streaming video |
US7673315B1 (en) * | 2000-03-30 | 2010-03-02 | Microsoft Corporation | System and method for providing program criteria representing audio and/or visual programming |
US7200857B1 (en) * | 2000-06-09 | 2007-04-03 | Scientific-Atlanta, Inc. | Synchronized video-on-demand supplemental commentary |
JP3810268B2 (en) | 2000-04-07 | 2006-08-16 | シャープ株式会社 | Audio visual system |
GB2365704B (en) | 2000-04-14 | 2002-11-06 | Actv Inc | A method and system for providing additional information to a user receiving a video or audio program |
US7047551B2 (en) * | 2000-04-28 | 2006-05-16 | Canon Kabushiki Kaisha | Information distributing method and information distributing system |
US7130790B1 (en) | 2000-10-24 | 2006-10-31 | Global Translations, Inc. | System and method for closed caption data translation |
US20020100046A1 (en) * | 2000-11-16 | 2002-07-25 | Dudkiewicz Gil Gavriel | System and method for determining the desirability of video programming events |
US20020078466A1 (en) * | 2000-12-15 | 2002-06-20 | Siemens Information And Communication Networks, Inc. | System and method for enhanced video e-mail transmission |
US20030163815A1 (en) | 2001-04-06 | 2003-08-28 | Lee Begeja | Method and system for personalized multimedia delivery service |
US20020152464A1 (en) | 2001-04-13 | 2002-10-17 | Sony Corporation | System and method for pushing internet content onto interactive television |
-
2002
- 2002-12-23 US US10/325,830 patent/US20030088687A1/en not_active Abandoned
-
2006
- 2006-08-31 US US11/513,459 patent/US8296811B1/en not_active Expired - Fee Related
-
2012
- 2012-09-11 US US13/609,896 patent/US9253519B2/en not_active Expired - Fee Related
-
2015
- 2015-12-11 US US14/966,747 patent/US10462510B2/en not_active Expired - Fee Related
Patent Citations (56)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20010013123A1 (en) * | 1991-11-25 | 2001-08-09 | Freeman Michael J. | Customized program creation by splicing server based video, audio, or graphical segments |
US5835667A (en) * | 1994-10-14 | 1998-11-10 | Carnegie Mellon University | Method and apparatus for creating a searchable digital video library and a system and method of using such a library |
US5664227A (en) * | 1994-10-14 | 1997-09-02 | Carnegie Mellon University | System and method for skimming digital audio/video data |
US5614940A (en) * | 1994-10-21 | 1997-03-25 | Intel Corporation | Method and apparatus for providing broadcast information with indexing |
US5708767A (en) * | 1995-02-03 | 1998-01-13 | The Trustees Of Princeton University | Method and apparatus for video browsing based on content and structure |
US5821945A (en) * | 1995-02-03 | 1998-10-13 | The Trustees Of Princeton University | Method and apparatus for video browsing based on content and structure |
US5999985A (en) * | 1995-04-13 | 1999-12-07 | Siemens Aktiengesellschaft | Method and apparatus for storing, searching and playback of items of information of a multimedia electronic mail system |
US5805763A (en) * | 1995-05-05 | 1998-09-08 | Microsoft Corporation | System and method for automatically recording programs in an interactive viewing system |
US5710591A (en) * | 1995-06-27 | 1998-01-20 | At&T | Method and apparatus for recording and indexing an audio and multimedia conference |
US6061056A (en) * | 1996-03-04 | 2000-05-09 | Telexis Corporation | Television monitoring system with automatic selection of program material of interest and subsequent display under user control |
US6282549B1 (en) * | 1996-05-24 | 2001-08-28 | Magnifi, Inc. | Indexing of media content on a network |
US5874986A (en) * | 1996-06-26 | 1999-02-23 | At&T Corp | Method for communicating audiovisual programs over a communications network |
US6098082A (en) * | 1996-07-15 | 2000-08-01 | At&T Corp | Method for automatically providing a compressed rendition of a video program in a format suitable for electronic searching and retrieval |
US6810526B1 (en) * | 1996-08-14 | 2004-10-26 | March Networks Corporation | Centralized broadcast channel real-time search system |
US6956573B1 (en) * | 1996-11-15 | 2005-10-18 | Sarnoff Corporation | Method and apparatus for efficiently representing storing and accessing video information |
US5864366A (en) * | 1997-02-05 | 1999-01-26 | International Business Machines Corporation | System and method for selecting video information with intensity difference |
US20050278741A1 (en) * | 1997-03-31 | 2005-12-15 | Microsoft Corporation | Query-based electronic program guide |
US6092107A (en) * | 1997-04-07 | 2000-07-18 | At&T Corp | System and method for interfacing MPEG-coded audiovisual objects permitting adaptive control |
US6038296A (en) * | 1997-10-07 | 2000-03-14 | Lucent Technologies Inc. | Internet/intranet user interface to a multimedia messaging system |
US6961954B1 (en) * | 1997-10-27 | 2005-11-01 | The Mitre Corporation | Automated segmentation, information extraction, summarization, and presentation of broadcast news |
US6166735A (en) * | 1997-12-03 | 2000-12-26 | International Business Machines Corporation | Video story board user interface for selective downloading and displaying of desired portions of remote-stored video data objects |
US5956026A (en) * | 1997-12-19 | 1999-09-21 | Sharp Laboratories Of America, Inc. | Method for hierarchical summarization and browsing of digital video |
US20050028194A1 (en) * | 1998-01-13 | 2005-02-03 | Elenbaas Jan Hermanus | Personalized news retrieval system |
US6363380B1 (en) * | 1998-01-13 | 2002-03-26 | U.S. Philips Corporation | Multimedia computer system with story segmentation capability and operating program therefor including finite automation video parser |
US6453355B1 (en) * | 1998-01-15 | 2002-09-17 | Apple Computer, Inc. | Method and apparatus for media data transmission |
US6415327B1 (en) * | 1998-03-09 | 2002-07-02 | Microsoft Corporation | Automatic protocol rollover in streaming multimedia data delivery systems |
US6289346B1 (en) * | 1998-03-12 | 2001-09-11 | At&T Corp. | Apparatus and method for a bookmarking system |
US6477707B1 (en) * | 1998-03-24 | 2002-11-05 | Fantastic Corporation | Method and system for broadcast transmission of media objects |
US20020152477A1 (en) * | 1998-05-29 | 2002-10-17 | Opentv, Inc. | Module manager for interactive television system |
US6233389B1 (en) * | 1998-07-30 | 2001-05-15 | Tivo, Inc. | Multimedia time warping system |
US6460075B2 (en) * | 1998-07-31 | 2002-10-01 | Webtv Networks, Inc. | Browser-based email system with user interface for audio/video capture |
US6324338B1 (en) * | 1998-08-07 | 2001-11-27 | Replaytv, Inc. | Video data recorder with integrated channel guides |
US6564263B1 (en) * | 1998-12-04 | 2003-05-13 | International Business Machines Corporation | Multimedia content description framework |
US6748421B1 (en) * | 1998-12-23 | 2004-06-08 | Canon Kabushiki Kaisha | Method and system for conveying video messages |
US6243676B1 (en) * | 1998-12-23 | 2001-06-05 | Openwave Systems Inc. | Searching and retrieving multimedia information |
US6236395B1 (en) * | 1999-02-01 | 2001-05-22 | Sharp Laboratories Of America, Inc. | Audiovisual information management system |
US6678890B1 (en) * | 1999-03-10 | 2004-01-13 | Sony Corporation | Bidirectional transmission/reception system and method and transmission apparatus |
US6345279B1 (en) * | 1999-04-23 | 2002-02-05 | International Business Machines Corporation | Methods and apparatus for adapting multimedia content for client devices |
US6477565B1 (en) * | 1999-06-01 | 2002-11-05 | Yodlee.Com, Inc. | Method and apparatus for restructuring of personalized data for transmission from a data network to connected and portable network appliances |
US20040117831A1 (en) * | 1999-06-28 | 2004-06-17 | United Video Properties, Inc. | Interactive television program guide system and method with niche hubs |
US6324512B1 (en) * | 1999-08-26 | 2001-11-27 | Matsushita Electric Industrial Co., Ltd. | System and method for allowing family members to access TV contents and program media recorder over telephone or internet |
US6304898B1 (en) * | 1999-10-13 | 2001-10-16 | Datahouse, Inc. | Method and system for creating and sending graphical email |
US20050076357A1 (en) * | 1999-10-28 | 2005-04-07 | Fenne Adam Michael | Dynamic insertion of targeted sponsored video messages into Internet multimedia broadcasts |
US6970915B1 (en) * | 1999-11-01 | 2005-11-29 | Tellme Networks, Inc. | Streaming content over a telephone interface |
US20050076378A1 (en) * | 1999-12-16 | 2005-04-07 | Microsoft Corporation | Live presentation searching |
US20010049826A1 (en) * | 2000-01-19 | 2001-12-06 | Itzhak Wilf | Method of searching video channels by content |
US6671715B1 (en) * | 2000-01-21 | 2003-12-30 | Microstrategy, Inc. | System and method for automatic, real-time delivery of personalized informational and transactional data to users via high throughput content delivery device |
US20010052019A1 (en) * | 2000-02-04 | 2001-12-13 | Ovt, Inc. | Video mail delivery system |
US6496857B1 (en) * | 2000-02-08 | 2002-12-17 | Mirror Worlds Technologies, Inc. | Delivering targeted, enhanced advertisements across electronic networks |
US6385306B1 (en) * | 2000-03-02 | 2002-05-07 | John Francis Baxter, Jr. | Audio file transmission method |
US20020138843A1 (en) * | 2000-05-19 | 2002-09-26 | Andrew Samaan | Video distribution method and system |
US20020052747A1 (en) * | 2000-08-21 | 2002-05-02 | Sarukkai Ramesh R. | Method and system of interpreting and presenting web content using a voice browser |
US20020038456A1 (en) * | 2000-09-22 | 2002-03-28 | Hansen Michael W. | Method and system for the automatic production and distribution of media content using the internet |
US20020093591A1 (en) * | 2000-12-12 | 2002-07-18 | Nec Usa, Inc. | Creating audio-centric, imagecentric, and integrated audio visual summaries |
US20020173964A1 (en) * | 2001-03-30 | 2002-11-21 | International Business Machines Corporation | Speech driven data selection in a voice-enabled program |
US6691954B1 (en) * | 2001-12-28 | 2004-02-17 | Ocean Rodeo Sports Inc. | Integrated kite control bar and controlled tension release safety device |
Cited By (108)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9781473B2 (en) | 1999-05-26 | 2017-10-03 | Echostar Technologies L.L.C. | Method for effectively implementing a multi-room television system |
US8332276B2 (en) | 2000-04-12 | 2012-12-11 | Music Choice | Cross channel delivery system and method |
US20060184431A1 (en) * | 2000-04-12 | 2006-08-17 | Music Choice | Media content delivery systems and methods |
US8271341B2 (en) * | 2000-04-12 | 2012-09-18 | Music Choice | Media content delivery systems and methods |
US8751324B2 (en) * | 2000-04-12 | 2014-06-10 | Music Choice | Media content delivery systems and methods |
US9171325B2 (en) | 2000-04-12 | 2015-10-27 | Music Choice | Cross channel delivery system and method |
US20130014189A1 (en) * | 2000-04-12 | 2013-01-10 | Music Choice | Media Content Delivery Systems and Methods |
US20070282708A1 (en) * | 2000-04-12 | 2007-12-06 | Music Choice | Cross Channel Delivery System and Method |
US8527604B2 (en) * | 2004-02-12 | 2013-09-03 | Unity Works Media | Managed rich media system and method |
US20050240596A1 (en) * | 2004-02-12 | 2005-10-27 | Bill Worthen | Managed rich media system and method |
US12015829B2 (en) * | 2004-04-07 | 2024-06-18 | Tivo Corporation | System and method for enhanced video selection |
US11936956B2 (en) | 2004-04-07 | 2024-03-19 | Tivo Corporation | System and method for enhanced video selection |
US20200059696A1 (en) * | 2004-04-07 | 2020-02-20 | Visible World, Llc | System And Method For Enhanced Video Selection |
US9998802B2 (en) | 2004-06-07 | 2018-06-12 | Sling Media LLC | Systems and methods for creating variable length clips from a media stream |
US9716910B2 (en) | 2004-06-07 | 2017-07-25 | Sling Media, L.L.C. | Personal video recorder functionality for placeshifting systems |
US20130185163A1 (en) * | 2004-06-07 | 2013-07-18 | Sling Media Inc. | Management of shared media content |
US9877070B2 (en) | 2004-06-07 | 2018-01-23 | Sling Media Inc. | Fast-start streaming and buffering of streaming content for personal media player |
US10123067B2 (en) | 2004-06-07 | 2018-11-06 | Sling Media L.L.C. | Personal video recorder functionality for placeshifting systems |
US10419809B2 (en) | 2004-06-07 | 2019-09-17 | Sling Media LLC | Selection and presentation of context-relevant supplemental content and advertising |
US11134299B2 (en) * | 2004-06-07 | 2021-09-28 | Sling Media L.L.C. | Selection and presentation of context-relevant supplemental content and advertising |
US20070064743A1 (en) * | 2004-06-30 | 2007-03-22 | Bettis Sonny R | Provision of messaging services from a video messaging system based on ANI and CLID |
US7725072B2 (en) * | 2004-06-30 | 2010-05-25 | Glenayre Electronics, Inc. | Provision of messaging services from a video messaging system based on ANI and CLID |
JP2008523718A (en) * | 2004-12-06 | 2008-07-03 | ヒューレット−パッカード デベロップメント カンパニー エル.ピー. | Method and system for simultaneously downloading and playing audio / video content |
WO2006062585A1 (en) * | 2004-12-06 | 2006-06-15 | Hewlett-Packard Development Company, L.P. | Simultaneous audio and visual content download and playback |
US20060120697A1 (en) * | 2004-12-06 | 2006-06-08 | Gabriel Beged-Dov | Simultaneous audio and visual content download and playback |
US20060212905A1 (en) * | 2005-03-17 | 2006-09-21 | Hitachi, Ltd. | Broadcast receiving terminal and information processing apparatus |
US20070294717A1 (en) * | 2005-07-08 | 2007-12-20 | Hill Peter N | Methods, systems, and products for conserving bandwidth |
US9432710B2 (en) | 2005-07-08 | 2016-08-30 | At&T Intellectual Property I, L.P. | Methods systems, and products for conserving bandwidth |
US20070038712A1 (en) * | 2005-08-15 | 2007-02-15 | Microsoft Corporation | Acquisition of syndication feed items via an information workflow application |
US20070094605A1 (en) * | 2005-10-20 | 2007-04-26 | Dietz Timothy A | System for transforming selected sections of a network, e.g. Web documents accessed from network sites, e.g. Web sites, into e-mail messages |
US8291182B2 (en) | 2006-04-28 | 2012-10-16 | At&T Intellectual Property I, L.P. | Methods, systems, and products for recording media |
US20100077166A1 (en) * | 2006-04-28 | 2010-03-25 | At&T Intellectual Property I, L.P. F/K/A Bellsouth Intellectual Property Corporation | Methods, systems, and products for recording media |
US8682857B2 (en) | 2006-04-28 | 2014-03-25 | At&T Intellectual Property I, L.P. | Methods, systems, and products for recording media |
US7647464B2 (en) | 2006-04-28 | 2010-01-12 | At&T Intellectual Property, I,L.P. | Methods, systems, and products for recording media to a restoration server |
US20070253675A1 (en) * | 2006-04-28 | 2007-11-01 | Weaver Timothy H | Methods, systems, and products for recording media |
US20070255915A1 (en) * | 2006-04-28 | 2007-11-01 | Timothy Weaver | Methods, systems, and products for recording media |
US20070288574A1 (en) * | 2006-06-09 | 2007-12-13 | Daren Koster | System and method of email streaming digital video for subscribers |
US20080189329A1 (en) * | 2007-02-07 | 2008-08-07 | Weaver Timothy H | Methods, systems, and products for targeting media |
US20100185613A1 (en) * | 2007-02-07 | 2010-07-22 | At&T Intellectual Property I, L.P. F/K/A Bellsouth Intellectual Property Corporation | Method, device, and computer program product for targeting media |
US7650368B2 (en) | 2007-02-07 | 2010-01-19 | At&T Intellectual Property I, L.P. | Methods, systems, and products for restoring electronic media |
US8150845B2 (en) | 2007-02-07 | 2012-04-03 | At&T Intellectual Property I, L.P. | Method, device, and computer program product for targeting media for storage to a communications device |
US7711733B2 (en) | 2007-02-07 | 2010-05-04 | At&T Intellectual Property I,L.P. | Methods, systems, and products for targeting media for storage to communications devices |
US20080189338A1 (en) * | 2007-02-07 | 2008-08-07 | Weaver Timothy H | Methods, systems, and products for restoring media |
US20080263160A1 (en) * | 2007-04-20 | 2008-10-23 | Samsung Electronics Co., Ltd. | Method for displaying content information and video apparatus thereof |
US8069414B2 (en) * | 2007-07-18 | 2011-11-29 | Google Inc. | Embedded video player |
US9553947B2 (en) | 2007-07-18 | 2017-01-24 | Google Inc. | Embedded video playlists |
US20090024923A1 (en) * | 2007-07-18 | 2009-01-22 | Gunthar Hartwig | Embedded Video Player |
US20090024927A1 (en) * | 2007-07-18 | 2009-01-22 | Jasson Schrock | Embedded Video Playlists |
US20090030991A1 (en) * | 2007-07-25 | 2009-01-29 | Yahoo! Inc. | System and method for streaming videos inline with an e-mail |
US7917591B2 (en) * | 2007-07-25 | 2011-03-29 | Yahoo! Inc. | System and method for streaming videos inline with an e-mail |
US8312501B2 (en) * | 2007-09-18 | 2012-11-13 | Fujitsu Toshiba Mobile Communications Limited | Mobile terminal |
US20090077603A1 (en) * | 2007-09-18 | 2009-03-19 | Kabushiki Kaisha Toshiba | Mobile terminal |
US20090089401A1 (en) * | 2007-10-01 | 2009-04-02 | Microsoft Corporation | Server-controlled distribution of media content |
US8671428B2 (en) | 2007-11-08 | 2014-03-11 | Yahoo! Inc. | System and method for a personal video inbox channel |
US20090125951A1 (en) * | 2007-11-08 | 2009-05-14 | Yahoo! Inc. | System and method for a personal video inbox channel |
US9122650B1 (en) | 2007-11-14 | 2015-09-01 | Appcelerator, Inc. | Web server based on the same paradigms as web clients |
US8914774B1 (en) | 2007-11-15 | 2014-12-16 | Appcelerator, Inc. | System and method for tagging code to determine where the code runs |
US8954989B1 (en) | 2007-11-19 | 2015-02-10 | Appcelerator, Inc. | Flexible, event-driven JavaScript server architecture |
US8266202B1 (en) | 2007-11-21 | 2012-09-11 | Appcelerator, Inc. | System and method for auto-generating JavaScript proxies and meta-proxies |
US8510378B2 (en) | 2007-11-21 | 2013-08-13 | Appcelerator, Inc. | System and method for auto-generating JavaScript |
US8260845B1 (en) | 2007-11-21 | 2012-09-04 | Appcelerator, Inc. | System and method for auto-generating JavaScript proxies and meta-proxies |
US8719451B1 (en) | 2007-11-23 | 2014-05-06 | Appcelerator, Inc. | System and method for on-the-fly, post-processing document object model manipulation |
US8566807B1 (en) | 2007-11-23 | 2013-10-22 | Appcelerator, Inc. | System and method for accessibility of document object model and JavaScript by other platforms |
US8756579B1 (en) | 2007-12-03 | 2014-06-17 | Appcelerator, Inc. | Client-side and server-side unified validation |
US8819539B1 (en) | 2007-12-03 | 2014-08-26 | Appcelerator, Inc. | On-the-fly rewriting of uniform resource locators in a web-page |
US8806431B1 (en) | 2007-12-03 | 2014-08-12 | Appecelerator, Inc. | Aspect oriented programming |
US8938491B1 (en) | 2007-12-04 | 2015-01-20 | Appcelerator, Inc. | System and method for secure binding of client calls and server functions |
US8527860B1 (en) | 2007-12-04 | 2013-09-03 | Appcelerator, Inc. | System and method for exposing the dynamic web server-side |
US8639743B1 (en) | 2007-12-05 | 2014-01-28 | Appcelerator, Inc. | System and method for on-the-fly rewriting of JavaScript |
US8335982B1 (en) | 2007-12-05 | 2012-12-18 | Appcelerator, Inc. | System and method for binding a document object model through JavaScript callbacks |
US8285813B1 (en) * | 2007-12-05 | 2012-10-09 | Appcelerator, Inc. | System and method for emulating different user agents on a server |
US9148467B1 (en) | 2007-12-05 | 2015-09-29 | Appcelerator, Inc. | System and method for emulating different user agents on a server |
US8291079B1 (en) | 2008-06-04 | 2012-10-16 | Appcelerator, Inc. | System and method for developing, deploying, managing and monitoring a web application in a single environment |
US8880678B1 (en) | 2008-06-05 | 2014-11-04 | Appcelerator, Inc. | System and method for managing and monitoring a web application using multiple cloud providers |
WO2010021833A3 (en) * | 2008-08-21 | 2010-04-15 | Yahoo! Inc. | System and method for context enhanced messaging |
KR101351199B1 (en) | 2008-08-21 | 2014-01-14 | 야후! 인크. | System and method for context enhanced messaging |
CN102187362A (en) * | 2008-08-21 | 2011-09-14 | 雅虎公司 | System and method for context enhanced messaging |
US8386506B2 (en) | 2008-08-21 | 2013-02-26 | Yahoo! Inc. | System and method for context enhanced messaging |
US8954553B1 (en) | 2008-11-04 | 2015-02-10 | Appcelerator, Inc. | System and method for developing, deploying, managing and monitoring a web application in a single environment |
US20100306401A1 (en) * | 2009-05-29 | 2010-12-02 | Comcast Cable Communications, Llc | Switched Multicast Video Streaming |
US11831962B2 (en) | 2009-05-29 | 2023-11-28 | Tivo Corporation | Switched multicast video streaming |
US10200762B2 (en) | 2009-05-29 | 2019-02-05 | Comcast Cable Communications, Llc | Switched multicast video streaming |
US8782267B2 (en) * | 2009-05-29 | 2014-07-15 | Comcast Cable Communications, Llc | Methods, systems, devices, and computer-readable media for delivering additional content using a multicast streaming |
US10681432B2 (en) | 2011-11-28 | 2020-06-09 | Discovery Communications, Llc | Methods and apparatus for enhancing a digital content experience |
US9729942B2 (en) | 2011-11-28 | 2017-08-08 | Discovery Communications, Llc | Methods and apparatus for enhancing a digital content experience |
WO2013082142A1 (en) * | 2011-11-28 | 2013-06-06 | Discovery Communications, Llc | Methods and apparatus for enhancing a digital content experience |
US20170053029A1 (en) * | 2011-12-15 | 2017-02-23 | Yahoo! Inc. | Systems and methods involving features of search and/or search integration |
US10387503B2 (en) * | 2011-12-15 | 2019-08-20 | Excalibur Ip, Llc | Systems and methods involving features of search and/or search integration |
US20150066913A1 (en) * | 2012-03-27 | 2015-03-05 | Roku, Inc. | System and method for searching multimedia |
US20210279270A1 (en) * | 2012-03-27 | 2021-09-09 | Roku, Inc. | Searching and displaying multimedia search results |
US12088890B2 (en) | 2012-03-27 | 2024-09-10 | Roku, Inc. | Searching and displaying multimedia search results |
US9519645B2 (en) * | 2012-03-27 | 2016-12-13 | Silicon Valley Bank | System and method for searching multimedia |
US11681741B2 (en) * | 2012-03-27 | 2023-06-20 | Roku, Inc. | Searching and displaying multimedia search results |
US10261999B2 (en) * | 2012-03-27 | 2019-04-16 | Roku, Inc. | Searching multimedia based on trigger events |
US10425493B2 (en) | 2014-01-22 | 2019-09-24 | International Business Machines Corporation | Adjusting prominence of a participant profile in a social networking interface |
US20150207900A1 (en) * | 2014-01-22 | 2015-07-23 | International Business Machines Corporation | Adjusting prominence of a participant profile in a social networking interface |
US9749433B2 (en) * | 2014-01-22 | 2017-08-29 | International Business Machines Corporation | Adjusting prominence of a participant profile in a social networking interface |
US10938928B2 (en) | 2014-01-22 | 2021-03-02 | Airbnb, Inc. | Adjusting prominence of a participant profile in a social networking interface |
US10938929B2 (en) | 2014-01-22 | 2021-03-02 | Airbnb, Inc. | Adjusting prominence of a participant profile in a social networking interface |
US10326851B2 (en) | 2014-01-22 | 2019-06-18 | International Business Machines Corporation | Adjusting prominence of a participant profile in a social networking interface |
US9749432B2 (en) * | 2014-01-22 | 2017-08-29 | International Business Machines Corporation | Adjusting prominence of a participant profile in a social networking interface |
US20150205794A1 (en) * | 2014-01-22 | 2015-07-23 | International Business Machines Corporation | Adjusting prominence of a participant profile in a social networking interface |
US11770589B2 (en) | 2015-06-04 | 2023-09-26 | Comcast Cable Communications, Llc | Using text data in content presentation and content search |
US10645457B2 (en) * | 2015-06-04 | 2020-05-05 | Comcast Cable Communications, Llc | Using text data in content presentation and content search |
US20170329762A1 (en) * | 2016-05-13 | 2017-11-16 | Comcast Cable Communications, Llc | Methods and systems for matching interests with content |
US12108093B2 (en) * | 2016-05-13 | 2024-10-01 | Comcast Cable Communications, Llc | Methods and systems for matching interests with content |
US20170351669A1 (en) * | 2016-06-02 | 2017-12-07 | Hisense Co., Ltd. | Audio/video searching method, apparatus and terminal |
US10091354B1 (en) * | 2016-12-15 | 2018-10-02 | Sorenson Ip Holdings, Llc | Transcribing media files |
Also Published As
Publication number | Publication date |
---|---|
US20160100209A1 (en) | 2016-04-07 |
US8296811B1 (en) | 2012-10-23 |
US20130042283A1 (en) | 2013-02-14 |
US9253519B2 (en) | 2016-02-02 |
US10462510B2 (en) | 2019-10-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10462510B2 (en) | Method and apparatus for automatically converting source video into electronic mail messages | |
US8151298B2 (en) | Method and system for embedding information into streaming media | |
US8060906B2 (en) | Method and apparatus for interactively retrieving content related to previous query results | |
US20240007696A1 (en) | Systems and methods for using video metadata to associate advertisements therewith | |
US7281260B2 (en) | Streaming media publishing system and method | |
US8589973B2 (en) | Peer to peer media distribution system and method | |
EP1999953B1 (en) | Embedded metadata in a media presentation | |
US20030097301A1 (en) | Method for exchange information based on computer network | |
US20070079321A1 (en) | Picture tagging | |
US20080284910A1 (en) | Text data for streaming video | |
US20030074671A1 (en) | Method for information retrieval based on network | |
BR112016006860B1 (en) | APPARATUS AND METHOD FOR CREATING A SINGLE DATA FLOW OF COMBINED INFORMATION FOR RENDERING ON A CUSTOMER COMPUTING DEVICE | |
US20050144305A1 (en) | Systems and methods for identifying, segmenting, collecting, annotating, and publishing multimedia materials | |
WO2003014949A9 (en) | Method, system, and computer program product for producing and distributing enhanced media | |
CN101395627A (en) | Improved advertising with video ad creatives | |
JP2005512233A (en) | System and method for retrieving information about a person in a video program | |
Hunter et al. | Building and indexing a distributed multimedia presentation archive using SMIL | |
IES20030840A2 (en) | Multimedia management | |
Mohan | Text-based search of TV news stories | |
US10389779B2 (en) | Information processing | |
Begeja et al. | eClips: A new personalized multimedia delivery service | |
US20190182517A1 (en) | Providing Enrichment Data That is a Video Segment | |
IE20030840U1 (en) | Multimedia management |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: AT&T CORP., NEW YORK Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BEGEJA, LEE;GIBBON, DAVID CRAWFORD;LIU, ZHU;AND OTHERS;REEL/FRAME:013618/0987;SIGNING DATES FROM 20021211 TO 20021220 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |