WO2020147507A1

WO2020147507A1 - Display device and display method

Info

Publication number: WO2020147507A1
Application number: PCT/CN2019/126701
Authority: WO
Inventors: 王大勇; 陈验方; 黄玖法
Original assignee: 青岛海信电器股份有限公司
Priority date: 2019-01-16
Filing date: 2019-12-19
Publication date: 2020-07-23

Abstract

Disclosed are a display device and a display method. The display device comprises: a display, the display being configured to display a user interface, wherein the user interface comprises one or a plurality of different projects which are laid out, and a selector indicating that a project is selected, and the selector moves its position in the user interface based on user input, so as to select different projects; and a controller communicating with the display, wherein the controller is configured to execute presentation of the user interface, comprising: responding to the user input which instructs the selector to move, and determining the position of the selector in a first user interface, such that a project at the position is selected; and responding to residence time of the selector on the position exceeding a preset threshold value, while maintaining display of the first user interface, displaying, in a size smaller than the first user interface, a second user interface which is associated with the selected project on the position, and enabling the selector to move to the second user interface.

Description

Display device and display method

This disclosure claims the priority of the following Chinese patent applications:

On January 16, 2019, it filed a Chinese patent application with the application number of 201910038951.0 and the invention title of "A Window Display Method and Smart TV";

On January 16, 2019, it filed a Chinese patent application with the application number of 201910039794.5 and the invention title of "A method for pre-launching an application and a smart TV";

The priority of the Chinese patent application filed with the Chinese Patent Office on April 1, 2019, the application number is 201910258277.7, and the invention title is "a display device".

The entire content of the aforementioned Chinese patent application is incorporated into this disclosure by reference.

Technical field

The present invention relates to the field of display technology, in particular to a display device and a display method.

Background technique

Display devices usually provide users with browsing and using functions of a large number of resources to meet various needs of users. However, when a user quickly finds a resource of interest among a large number of resources, especially when the user does not know the functions provided by these resources, the user needs to go through the operation process of starting the resource, browsing the content information of the resource, and closing the resource many times. Choosing interesting resources from these resources results in cumbersome operations and low user experience.

Summary of the invention

The present disclosure provides a display device and a display method to improve user experience based on multi-user interface display.

Other characteristics and advantages of the present disclosure will become apparent through the following detailed description, or partly learned through the practice of the present disclosure.

According to a first aspect of the present disclosure, there is provided a display device including: a display configured to display a user interface, wherein the user interface includes a layout of one or more different items, and a selector indicating that the item is selected , The selector moves its position in the user interface based on the user input to select different items; a controller in communication with the display, the controller is configured to perform presentation of the user interface:

In response to the user input instructing to move the selector, the position of the selector in the first user interface is determined so that the item at the position is selected; in response to the dwell of the selector at the position When the time exceeds the preset threshold, while maintaining the display of the first user interface, the second user interface associated with the item selected at the position is displayed in a size smaller than the size of the first user interface, and the selection is made Move the device to the second user interface.

In some exemplary embodiments, the controller is further configured to execute: setting the display attribute of the second user interface to transparent, so as to keep the first user interface visible.

In some exemplary embodiments, the controller is further configured to execute: in response to a user input instructing to move the selector on the second user interface, determining that the selector is in the second user The position in the interface such that the item at the position is selected.

In some exemplary embodiments, the controller is further configured to execute: in response to a user input that the item selected by the selector is triggered, displaying a third user interface associated with the triggered item, the first The size and position of the third user interface are the same as the second user interface.

In some exemplary embodiments, the controller is further configured to execute: in response to a user input of moving the second user interface, moving the second user interface to a target in the first user interface position.

In some exemplary embodiments, the controller is further configured to execute: zooming the second user interface in response to a user input for zooming the second user interface.

In some exemplary embodiments, the controller is further configured to execute: in response to a user input of displaying the second user interface in a full screen, changing the size of the second user interface so that the second user interface Cover the first user interface.

In some exemplary embodiments, the controller is further configured to execute: setting the display attribute of the second user interface to opaque, so that the first user interface is invisible.

In some exemplary embodiments, the controller is further configured to execute: in response to a user input to close the second user interface, close the second user interface, and move the selector to the The second user interface displays the items selected in the first user interface.

In some exemplary embodiments, the second user interface includes one or more items, and one item in the second user interface is selected by the selector.

In some exemplary embodiments, the first user interface and the second user interface correspond to the same task stack, and the task stack is used to store tasks in response to user operations on the first user interface and in response to the first user interface. 2. User-operated tasks on the user interface.

According to a second aspect of the present disclosure, there is provided a display method including: in response to a user input instructing to move a selector on a first user interface, determining the position of the selector in the first user interface so that all The item at the position is selected; in response to the residence time of the selector at the position exceeding a preset threshold, while maintaining the display of the first user interface, it is displayed in a size smaller than that of the first user interface A second user interface associated with the item selected at the location, and the selector is moved to the second user interface.

According to a third aspect of the present disclosure, there is provided a machine-readable non-volatile storage medium having computer instructions stored thereon. The computer instructions are implemented when executed by a controller: The user input of the selector determines the position of the selector in the first user interface so that the item at the position is selected; in response to the residence time of the selector at the position exceeds a preset Threshold, while maintaining the display of the first user interface, display the second user interface associated with the item selected at the position in a size smaller than the size of the first user interface, and move the selector to the selected item Said on the second user interface.

It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the scope of the present disclosure.

BRIEF DESCRIPTION

In order to more clearly explain the technical solutions in the embodiments of the present disclosure, the drawings required in the description of the embodiments will be briefly described below. Obviously, the drawings in the following description are only some embodiments of the present disclosure. Those of ordinary skill in the art can obtain other drawings based on these drawings without creative work.

FIG. 1A shows a schematic diagram of an operation scene between a display device 200 and a control device 100 according to an embodiment of the present disclosure;

FIG. 1B shows a configuration block diagram of the control device 100 in FIG. 1A according to an embodiment of the present disclosure;

FIG. 1C shows a configuration block diagram of the display device 200 in FIG. 1A according to an embodiment of the present disclosure;

FIG. 1D shows a block diagram of the architecture configuration of the operating system in the memory of the display device 200 according to an embodiment of the present disclosure;

2A-2G illustrate schematic diagrams of a GUI 400 provided by the display device 200 by way of example;

3A-3E illustrate schematic diagrams of a GUI 400 provided by the display device 200 by way of example;

4A-4D illustrate schematic diagrams of a GUI 400 provided by the display device 200 by way of example;

5A-5C exemplarily show a flowchart of a method of displaying a graphical user interface provided by the device 200.

detailed description

In order to make the purpose, technical solutions and advantages of the exemplary embodiments of the present disclosure clearer, the technical solutions in the exemplary embodiments of the present disclosure will be described clearly and completely with reference to the accompanying drawings in the exemplary embodiments of the present disclosure. The described exemplary embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments.

Based on the exemplary embodiments shown in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present disclosure. In addition, although the disclosure in the present disclosure is introduced according to one or several exemplary examples, it should be understood that various aspects of these disclosures can also be individually constituted as a complete technical solution.

It should be understood that the terms "first", "second", "third", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or Priority. It should be understood that the data used in this way can be interchanged under appropriate circumstances, for example, it can be implemented according to an order other than those given in the illustration or description of the embodiment of the present disclosure.

In addition, the terms "including" and "having" and any variations of them are intended to cover but not exclusively include. For example, a product or device including a series of components need not be limited to those clearly listed, but may include Other components that are not clearly listed or are inherent to these products or equipment.

The term "module" used in the present disclosure refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can perform functions related to the element.

The term "gesture" used in the present disclosure refers to a user's behavior that expresses expected ideas, actions, goals, or results through a change of hand shape or hand movement and other actions.

FIG. 1A exemplarily shows a schematic diagram of an operation scene between the display device 200 and the control device 100. As shown in FIG. 1A, the control device 100 and the display device 200 can communicate in a wired or wireless manner.

Among them, the control device 100 is configured to control the display device 200, which can receive operation instructions input by the user, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, and act as an intermediary for the interaction between the user and the display device 200 effect. For example, the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operations.

The control device 100 may be a remote control 100A, such as a handheld touch remote control, which replaces most of the physical built-in hard keys in a general remote control with a user interface in a touch screen. The remote controller generally uses infrared protocol communication, Bluetooth protocol communication, and other short-distance communication methods to connect to the display device, and controls the display device 200 through wireless or other wired methods. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, etc. For example, the user can control the display device 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, and power on/off keys on the remote control. Function.

The control device 100 may also be a smart device, such as a mobile terminal 100B, a tablet computer, a computer, a notebook computer, etc. For example, an application program running on a smart device is used to control the display device 200. The application can be configured to provide users with various controls on the screen associated with the smart device through an intuitive user interface (UI).

Exemplarily, the mobile terminal 100B may install a software application with the display device 200, realize connection communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication. For example, the mobile terminal 100B can establish a control instruction protocol with the display device 200, and by operating various function keys or virtual buttons of the user interface provided on the mobile terminal 100B, the functions of the physical keys arranged in the remote control 100A can be realized. The audio and video content displayed on the mobile terminal 100B can also be transmitted to the display device 200 to realize the synchronous display function.

The display device 200 can be implemented as a TV, and can provide a broadcast receiving TV function and a computer-supported smart network TV function. Examples of display devices include digital TV, Internet TV, smart TV, Internet Protocol Television (IPTV), and so on.

The display device 200 may be a liquid crystal display, an organic light emitting display, or a projection display device. The specific display device type, size and resolution are not limited.

The display device 200 also performs data communication with the server 300 through multiple communication methods. Here, the display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (Wireless Local Area Network, WLAN), and other networks. The server 300 may provide various contents and interactions to the display device 200. For example, the display device 200 can send and receive information, such as receiving electronic program guide (EPG) data, receiving software program updates, or accessing a remotely stored digital media library. The server 300 can be one group or multiple groups, and can be one or more types of servers. The server 300 provides other network service content such as video on demand and advertising services.

Fig. 1B exemplarily shows a configuration block diagram of the control device 100. As shown in FIG. 1B, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, an output interface 150, and a power supply 160.

The controller 110 includes a random access memory (RAM) 111, a read only memory (ROM) 112, a processor 113, a communication interface, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication cooperation between internal components, and external and internal data processing functions.

Exemplarily, when an interaction of a user pressing a button arranged on the remote control 100A or an interaction of touching a touch panel arranged on the remote control 100A is detected, the controller 110 may control to generate a signal corresponding to the detected interaction, and This signal is sent to the display device 200.

The memory 120 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110. The memory 120 can store various control signal instructions input by the user.

The communicator 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110. For example, the control device 100 sends a control signal (such as a touch signal or a button signal) to the display device 200 via the communicator 130, and the control device 100 can receive the signal sent by the display device 200 via the communicator 130. The communicator 130 may include an infrared signal interface 131 and a radio frequency signal interface 132. For example, in the case of an infrared signal interface, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 via the infrared sending module. For another example: in the case of a radio frequency signal interface, a user input instruction needs to be converted into a digital signal, and then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency transmitting terminal.

The user input interface 140 may include at least one of a microphone 141, a touch panel 142, a sensor 143, a button 144, etc., so that the user can input user instructions for controlling the display device 200 to the control device through voice, touch, gesture, pressing, etc. 100.

The output interface 150 outputs a user instruction received by the user input interface 140 to the display device 200, or outputs an image or voice signal received by the display device 200. Here, the output interface 150 may include an LED interface 151, a vibration interface 152 that generates vibrations, a sound output interface 153 that outputs sounds, a display 154 that outputs images, and the like. For example, the remote controller 100A can receive output signals such as audio, video, or data from the output interface 150, and display the output signals as images on the display 154, as audio on the sound output interface 153, or as vibration on the vibration interface 152. form.

The power supply 160 is used to provide operating power support for each element of the control device 100 under the control of the controller 110. The form can be battery and related control circuit.

FIG. 1C exemplarily shows a block diagram of the hardware configuration of the display device 200. As shown in FIG. 1C, the display device 200 may further include a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a memory 260, a user interface 265, a video processor 270, and a display 275. , Audio processor 280, audio input interface 285, power supply 290.

The tuner and demodulator 210 receives broadcast television signals through wired or wireless means, and can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the television selected by the user from multiple wireless or cable broadcast television signals The audio and video signals carried in the frequency of the channel, as well as additional information (such as EPG data).

The tuner and demodulator 210 can be selected by the user and controlled by the controller 250 to respond to the frequency of the television channel selected by the user and the television signal carried by the frequency.

The tuner and demodulator 210 can receive signals in various ways according to different broadcasting formats of TV signals, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or Internet broadcasting; and according to different modulation types, it can be digital modulation or analog Modulation method; and according to different types of received TV signals, analog signals and digital signals can be demodulated.

In some other exemplary embodiments, the tuner demodulator 210 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs a TV signal after modulation and demodulation, and is input to the display device 200 through the external device interface 240.

The communicator 220 is a component used to communicate with external devices or external servers according to various types of communication protocols. For example, the display device 200 may transmit content data to an external device connected via the communicator 220, or browse and download content data from an external device connected via the communicator 220. The communicator 220 may include a network communication protocol module such as a WIFI module 221, a Bluetooth communication protocol module 222, and a wired Ethernet communication protocol module 223 or a near field communication protocol module, so that the communicator 220 can receive the control device 100 according to the control of the controller 250 Control signals, and implement the control signals as WIFI signals, Bluetooth signals, radio frequency signals, etc.

The detector 230 is a component of the display device 200 for collecting signals from the external environment or interacting with the outside. The detector 230 may include an image collector 231, such as a camera, a camera, etc., which can be used to collect external environment scenes to adaptively change the display parameters of the display device 200; and to collect user attributes or interact with the user gestures to achieve Display the function of interaction between the device and the user. It may also include a light receiver 232 for collecting the ambient light intensity to adapt to changes in display parameters of the display device 200 and so on.

In some other exemplary embodiments, the detector 230 may also include a temperature sensor. For example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image. Exemplarily, when the temperature is relatively high, the display device 200 can adjust the display image color temperature to be colder; when the temperature is relatively low, the display device 200 can adjust the display image color temperature to be warmer.

In some other exemplary embodiments, the detector 230 may also include a sound collector, such as a microphone, which may be used to receive a user's voice, such as a voice signal of a control instruction for the user to control the display device 200; or, may be used to collect The environmental sound of the environmental scene type is recognized, so that the display device 200 can adapt to the environmental noise.

The external device interface 240 is a component that provides the controller 210 to control data transmission between the display device 200 and external devices. The external device interface 240 can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG). ) And other data.

Among them, the external device interface 240 may include: a high-definition multimedia interface (HDMI) terminal 241, a composite video blanking synchronization (CVBS) terminal 242, an analog or digital component terminal 243, a universal serial bus (USB) terminal 244, and a component. Any one or more of terminals (not shown in the figure), red, green and blue (RGB) terminals (not shown in the figure), etc.

The controller 250 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 260.

As shown in FIG. 1C, the controller 250 includes a random access memory (RAM) 251, a read only memory (ROM) 252, a graphics processor 253, a CPU processor 254, a communication interface 255, and a communication bus 256. Among them, the RAM 251, the ROM 252, the graphics processor 253, and the CPU processor 254 communication interface 255 are connected via a communication bus 256.

ROM252, used to store various system startup instructions. For example, when the power-on signal is received, the power of the display device 200 starts to start, and the CPU processor 254 runs the system start instruction in the ROM 252, and copies the operating system stored in the memory 260 to the RAM 251 to start the operating system. After the operating system is started up, the CPU processor 254 copies various application programs in the memory 260 to the RAM 251, and then starts to run and start various application programs.

The graphics processor 253 is used to generate screen images of various graphics objects, such as icons, images, and operation menus. The graphics processor 253 may include an arithmetic unit, which is used to perform operations by receiving various interactive instructions input by the user, and then display various objects according to display attributes; and includes a renderer, which is used to generate various objects obtained based on the arithmetic unit, and perform operations. The rendered result is displayed on the display 275.

The CPU processor 254 is configured to execute operating system and application program instructions stored in the memory 260. And according to the received user input instructions, to execute various applications, data and content processing, so as to finally display and play various audio and video content.

In some exemplary embodiments, the CPU processor 254 may include multiple processors. The multiple processors may include one main processor and multiple or one sub-processors. The main processor is configured to perform some initialization operations of the display device 200 in the display device preloading mode, and/or, to display screen operations in the normal mode. Multiple or one sub-processor, used to perform an operation in the standby mode of the display device.

The communication interface 255 may include the first interface to the nth interface. These interfaces may be network interfaces connected to external devices via a network.

The controller 250 may control the overall operation of the display device 200. For example, in response to receiving a user input command for selecting a GUI object displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user input command.

Among them, the object can be any one of the selectable objects, such as a hyperlink or an icon. The operation related to the selected object, for example, the operation of displaying the page connected to the hyperlink, document, image, etc., or the operation of executing the program corresponding to the icon. The user input command for selecting the GUI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.

The memory 260 is used to store various types of data, software programs or application programs for driving and controlling the operation of the display device 200. The memory 260 may include volatile and/or nonvolatile memory. The term "memory" includes the memory 260, the RAM 251 and ROM 252 of the controller 250, or the memory card in the display device 200.

In some embodiments, the memory 260 is specifically used to store operating programs for driving the controller 250 in the display device 200; to store various application programs built in the display device 200 and downloaded from external devices by the user; and to store configuration provided by the display 275 Data such as various GUIs, various objects related to the GUI, and visual effect images of the selector used to select GUI objects.

In some embodiments, the memory 260 is specifically used to store the drivers and related data of the tuner and demodulator 210, the communicator 220, the detector 230, the external device interface 240, the video processor 270, the display 275, the audio processor 280, etc. , External data (such as audio and video data) received from the external device interface or user data (such as button information, voice information, touch information, etc.) received from the user interface.

In some embodiments, the memory 260 specifically stores software and/or programs used to represent an operating system (OS). These software and/or programs may include, for example, kernels, middleware, application programming interfaces (APIs), and/or application. Exemplarily, the kernel can control or manage system resources and functions implemented by other programs (such as the middleware, API, or application program); at the same time, the kernel can provide an interface to allow middleware, API, or application program access control To control or manage system resources.

FIG. 1D exemplarily shows a block diagram of the architecture configuration of the operating system in the memory of the display device 200. The operating system architecture from top to bottom is the application layer, the framework layer and the kernel layer.

Application layer, system built-in applications and non-system-level applications belong to the application layer. Responsible for direct interaction with users. The application layer may include multiple applications, such as live TV applications, video-on-demand applications, media center applications, screenshot applications, and so on.

Live TV applications can provide live TV through different sources. For example, a live TV application may use input from cable TV, wireless broadcasting, satellite services, or other types of live TV services to provide TV signals. And, the live TV application can display the video of the live TV signal on the display device 200.

Video-on-demand applications can provide videos from different storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, video on demand can come from the server side of cloud storage, and from the local hard disk storage that contains stored video programs.

Media center applications can provide various multimedia content playback applications. For example, the media center may be different from live TV or video on demand, and users can access various images or audio and video stored in the memory through the media center application.

The screenshot application can take a screenshot of the current display on the monitor, and mark the identifiers (such as people, channel logos, buildings, etc.) contained in the screenshot image, such as the identification frame, name, etc., to provide users with a display Display function of various identifiers contained in the screen. The currently displayed screen can be at least one of text, image, and video.

The framework layer is responsible for providing the API required by the application layer. For example, live TV applications, video-on-demand applications, and media center applications can call decoders to decode audio and video through the interface provided by the framework layer. For another example, the screenshot application can call the screenshot image of the currently displayed screen that has been intercepted through the interface provided by the framework layer.

The kernel layer provides core system services, such as file management, memory management, process management, network management, system security authority management and other services. The kernel layer may be implemented as a kernel based on various operating systems, for example, a kernel based on the Android operating system.

The kernel also provides communication between system software and hardware, and provides device driver services for various hardware, such as: providing display drivers for monitors, camera drivers for cameras, button drivers for remote controls, and WIFI modules WiFi driver, audio driver for audio output interface, power management driver for power management (PM) module, etc.

The user interface 265 receives various user interactions. Specifically, it is used to send the user's input signal to the controller 250, or to transmit the output signal from the controller 250 to the user. Exemplarily, the remote control 100A may send input signals such as a power switch signal, a channel selection signal, and a volume adjustment signal input by the user to the user interface 265, and then the user interface 265 transfers to the controller 250; or the remote control 100A may Receive output signals such as audio, video, or data output from the user interface 265 through the controller 250, and display the received output signal or output the received output signal as audio or vibration.

In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the display 275, and the user interface 265 receives the user input command through the GUI. Specifically, the user interface 265 may receive user input commands for controlling the position of the selector in the GUI to select different objects.

Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user interface 265 recognizes the sound or gesture through the sensor to receive the user input command.

The video processor 270 is used to receive external video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal. The video signal displayed or played directly on the display 275.

For example, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

Among them, the demultiplexing module is used to demultiplex the input audio and video data stream, such as input MPEG-2 stream (based on the compression standard of digital storage media moving images and voice), then the demultiplexing module will demultiplex it Multiplexed into video signals and audio signals, etc.

The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

An image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to user input or by itself, so as to generate an image signal for display.

The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of the input 60Hz video to a frame rate of 120Hz or 240Hz, and the usual format is realized by such as frame interpolation.

The display formatting module is used to change the signal output by the frame rate conversion module into a signal conforming to the display format such as a display, for example, format the signal output by the frame rate conversion module to output RGB data signals.

The display 275 is used to receive the image signal output from the video processor 270 to display video, image and menu control interface. For example, the display may display the video in the broadcast signal received from the tuner and demodulator 210, may also display the video input from the communicator 220 or the external device interface 240, and may also display the image stored in the memory 260. The display 275 simultaneously displays a user manipulation interface UI generated in the display device 200 and used to control the display device 200.

And, the display 275 may include a display screen component for presenting a picture and a driving component for driving image display. Alternatively, if the display 275 is a projection display, it may also include a projection device and a projection screen.

The audio processor 280 is used to receive external audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing. The audio signal to be played.

Exemplarily, the audio processor 280 may support various audio formats. Such as MPEG-2, MPEG-4, Advanced Audio Coding (AAC), High Efficiency AAC (HE-AAC) and other formats.

The audio output interface 285 is used to receive audio signals output from the audio processor 280. For example, the audio output interface can output audio in a broadcast signal received via the tuner demodulator 210, can also output audio input via the communicator 220 or the external device interface 240, and can also output audio stored in the memory 260. The audio output interface 285 may include a speaker 286, or an external audio output terminal 287 output to a generator of an external device, such as a headphone output terminal.

In some other exemplary embodiments, the video processor 270 may include one or more chips. The audio processor 280 may also include one or more chips.

And, in some other exemplary embodiments, the video processor 270 and the audio processor 280 may be separate chips, or they may be integrated with the controller 250 in one or more chips.

The power supply 290 is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 250. The power supply 290 may be a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200.

According to the above description, taking the icons of multiple applications (including icons of applications such as TV Assistant, Settings, Music, etc.) displayed on the display of a smart TV as an example, in a scenario, the user uses the remote control to move the focus to the TV On the icon of the assistant application, press the confirmation key (OK key) of the remote control to open the user interface of the application in full screen mode. According to the items displayed in the interface of the application, it is found that the application is not currently running For applications, you need to close the interface of the application and perform the above operations again to select the application that needs to be run currently. The above operations are tedious and time-consuming, which affects user experience. Especially when the TV assistant application is currently in a cold start state (that is, it is started for the first time), it requires a longer startup time, so that the user can wait for a period of time before viewing the user interface of the TV assistant application on the display screen.

In order to solve the above problems, the present disclosure provides a display method and a display device applying the method, which can simplify user operations and improve user experience.

The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

2A-2G show schematic diagrams of a GUI 400 provided by the display device 200 by way of example. Among them, GUI is the abbreviation of Graphical User Interface, that is, graphical user interface.

In the GUI shown in FIGS. 2A-2G, the display device may provide a GUI 400 to the display. The GUI 400 includes a first GUI in which a plurality of different items are arranged, and a selector indicating that any item in the GUI 400 is selected. For example, the GUI shown in FIG. 2A includes a first GUI 41 that arranges the items 411 to 415, and a selector 42 that indicates that the item 411 is selected.

It should be noted that an item refers to a visual object displayed in the GUI provided by the display device 200 to represent corresponding content such as icons, thumbnails, and links. If the project is a movie or TV series, the project can be displayed as a poster of the movie or TV series. If the item is music, the poster of the music album can be displayed. For example, when the project is an application, it can be displayed as the icon of the application, or a screenshot of the content of the application captured when the application was executed most recently. For example, when the project is a user's access history, it can be displayed as a screenshot of the content during the recent execution.

The presentation of items is usually diversified. For example, the item may include at least one of text content and an image for displaying thumbnails related to the text content. For another example, the item may be at least one of the text and icon of the application.

It should also be noted that the selector can move the position of the selector in the GUI through the input of the user operating the control device to change the selection of different items. For example, the focus object can be selected or controlled by controlling the movement of the focus object displayed in the display device according to the user's input through the control device. For example, the user can use the arrow keys on the control device to control the movement of the focus object between items to select and control items.

The identification forms of selectors are usually diverse. For example, in FIG. 2A, the position of the focus object is realized or identified by enlarging the border of the item 411. For another example, in FIG. 2D, a thick line is drawn on the edge of the item 431 to realize or identify the position of the focus object. In addition, the position of the focused object can also be identified by changing at least one of the border line, size, color, transparency, outline, font, etc. of the text or image of the focused item.

In the GUI shown in Figures 2A-2G, items 411 to 415 are provided on the display. Items 411 to 415 correspond to the icons and names of settings, music, TV assistant, video, and file applications. These items can be activated based on user input To display its corresponding content details. For example, the TV assistant application program corresponding to item 413 can be activated based on the user pressing the confirm key on the control device when the selector 42 moves to the position of item 413 in FIG. 2C, so that the TV assistant application program shown in FIG. 4D is displayed in full screen. Content detail information.

In FIG. 2A, the first GUI 41 is displayed in full screen, and the selector 42 indicates that the item 411 is selected. When the user presses the right direction key on the control device, as shown in FIG. 2B, the display device can move the position of the selector 42 in response to the input right direction instruction, so that the selector 42 indicates that the item 412 is selected, then the item 412 The frame is enlarged and displayed, and the frame of the item 411 is restored to be the same as the other items 413 to 415, to prompt the user that the current item 412 is selected by the selector 42.

In FIG. 2B, when the selector 42 moves from the position of the item 411 to the position of the item 412 and stays at the position of the item 412 for a short time, the user continues to press the right direction key on the control device, as shown in FIG. 2C, a display The device can move the position of the selector 42 in response to the inputted right direction instruction, so that the selector 42 indicates that the item 413 is selected, the frame of the item 413 is enlarged and displayed, and the frame of the item 412 is restored to be the same as other items 411, 414-415. It is assumed that the user is prompted that the current item 413 is selected by the selector 42.

In some embodiments, in FIG. 2C, after the selector 42 moves from the position of the item 412 to the position of the item 413 and stays at the position of the item 413 for a long time, the display device still does not continue to receive the input of the user operating the control device. At this time, as shown in FIG. 2D, the display device can display the second GUI 43 associated with the item 413 in the upper right corner of the first GUI 41 in a size smaller than that of the first GUI 41, so that the user can preview the item 413 in the second GUI 43 in advance. Details of the content. For example, the style and content of the TV assistant application program interface are provided in the second GUI 43. Wherein, the size of the second GUI 43 can be preset.

In FIG. 2D, while the second GUI 43 is displayed, the selector 42 is moved to the second GUI 43, for example, the selector 42 is moved to the item 431 in the second GUI 43, so that the user can continue to browse the items 414 in the second GUI 43. Details of the content. The first GUI 41 remains displayed, and the item 413 in the first GUI 41 can be distinguished from other items 411 to 412, 414 to 415. For example, the item 413 is displayed with a thick line on the edge; the display state when the selector is selected can also be maintained For example, the frame of the item 413 is enlarged and displayed; thus, the user can be prompted that the currently displayed second GUI 43 is associated with the item 413.

It should be noted that the above description is based on the example that the selector selects the item 431 on the second GUI by default. The position of the selector in the second GUI can be preset, and it can be any item in the second GUI.

In some embodiments, in FIG. 2C, when the selector 42 moves from the position of the item 412 to the position of the item 413 and stays at the position of the item 413 for a short time, the user continues to press the right direction key on the control device, as shown in FIG. As shown in 2E, the display device can move the position of the selector 42 in response to the inputted right direction instruction, so that the selector 42 indicates that the item 414 is selected, the frame of the item 414 is enlarged and displayed, and the frame of the item 413 is restored to the other items 411~ 412 and 415 are the same, and the user is prompted that the current item 414 is selected by the selector 42.

In some embodiments, in FIG. 2E, when the selector 42 moves from the position of the item 413 to the position of the item 414 and stays at the position of the item 414 for a long time, the display device still does not continue to receive input from the user to operate the control device. At this time, as shown in FIG. 2F, the display device can display the second GUI 44 associated with the item 414 in the upper right corner of the first GUI 41 with a size smaller than that of the first GUI 41, so that the user can preview the item 414 in the second GUI 44 in advance. Details of the content. Among them, the size of the second GUI 44 can be preset.

In FIG. 2F, while the second GUI 44 is displayed, the selector 42 is moved to the second GUI 44, so that the user can continue to browse the content detail information of the item 414 in the second GUI 44. The first GUI 41 remains displayed, and the item 414 in the first GUI 41 can be distinguished from the other items 411 to 413 and 415 in its display state. For example, the item 414 is displayed with a thick line on the edge, or the display state when the selector is selected, for example The frame of the item 414 is enlarged and displayed, so that the user can be prompted that the currently displayed second GUI 44 is associated with the item 414.

In some embodiments, in FIG. 2E, when the selector 42 moves from the position of the item 413 to the position of the item 414 and stays at the position of the item 414 for a short time, the user continues to press the right direction key on the control device, as shown in FIG. As shown in 2G, the display device can move the position of the selector 42 in response to the inputted right direction instruction, so that the selector 42 indicates that the item 415 is selected, the frame of the item 415 is enlarged and displayed, and the frame of the item 414 is restored to the other items 411~ 413 is the same, because the user is prompted that the current item 415 is selected by the selector 42.

In other embodiments, in the GUI shown in FIG. 2D, the second GUI 43 provides detailed content information corresponding to the item 413. For example, the content detail information of the TV assistant application provided in the second GUI 43 includes items 431 to 434. These items 431 to 434 can also be activated based on the user pressing the confirmation key on the control device when the selector 42 moves to the corresponding item position in FIG. 2D, so as to switch to the second sub GUI associated with the corresponding item. In this way, It can enable the user to switch between the content detail information of the TV assistant application, so that the user can further confirm whether they are interested in the functions provided by the TV assistant application.

For example, in FIG. 2D, the selector 42 indicates that the item 431 in the second GUI 43 is selected. When the user presses the confirmation key on the control device, as shown in FIG. 3A, the display device can display the second GUI 4310 associated with the item 431 in response to the input instruction to activate the item 431, instead of the second GUI43. For example, the content information corresponding to the memory speed increase option is displayed in the second GUI 4310.

For another example, in FIG. 2D, the selector 42 indicates that the item 431 in the second GUI 43 is selected. When the user presses the right direction key on the control device, as shown in FIG. 3B, the display device can move the position of the selector 42 in the second GUI 43 in response to the input right direction instruction, so that the selector 42 indicates that the item 432 is select. When the user continues to press the confirmation key on the control device, as shown in FIG. 3C, the display device may display the second GUI 4320 associated with the item 432 in response to the input instruction to activate the item 432, instead of the second GUI43. For example, the content information corresponding to the garbage cleaning option is displayed in the second GUI 4320.

For another example, in FIG. 3B, the selector 42 indicates that the item 432 in the second GUI 43 is selected. When the user presses the right direction key on the control device, as shown in FIG. 3D, the display device can move the position of the selector 42 in the second GUI 43 in response to the input right direction instruction, so that the selector 42 indicates that the item 433 is select. When the user continues to press the confirmation key on the control device, as shown in FIG. 3E, the display device may respond to the input instruction to activate the item 433 and display the second sub GUI 4330 associated with the item 433 to replace the second GUI 43. For example, the content information corresponding to the security check and kill option is displayed in the second GUI 4330.

In still other embodiments, in the GUI shown in FIGS. 2D and 3A-3E, when the user presses a specific button on the control device (the specific button can be pre-designated), the display device can control the second GUI 43 on the first GUI 41 At least one of the display position and the display size of the, so that the second GUI can be flexibly moved or zoomed based on user needs to improve user satisfaction.

For example, in Figure 2D, when the user presses the channel minus button on the control device, as shown in Figure 4A, the display device can control the second GUI 43 to move a preset distance to the left in response to the input key instruction; when the user continues to press the control The channel minus key on the device, as shown in FIG. 4B, the display device can control the second GUI 43 to continue to move to the left by a preset distance in response to the input key instruction.

For another example, in FIG. 4A, when the user presses the channel plus key on the control device, as shown in FIG. 4C, the display device can control the second GUI 43 to move down a preset distance in response to the input key instruction, and at the same time zoom in on the preset multiple.

In still other embodiments, in the GUI shown in FIGS. 2D and 3A-3E, when the user presses a specific button on the control device (the specific button can be preset), the display device may control the second GUI to be displayed in full screen. When the user is interested in the second GUI associated with the project in the first GUI, the quick start of the project can be realized without the user noticing it.

For example, in FIG. 2D, when the user presses the channel plus key on the control device, as shown in FIG. 4D, the display device can control the full-screen display of the second GUI 43 associated with the item 413 in response to the input key instruction, instead of the first A GUI 41 to provide users with the function of using item 413. Here, compared with "the selector 42 is activated based on the user pressing the confirmation key on the control device when the selector 42 is moved to the position of the item 413 in FIG. 2C, and the content detail information of the item 413 shown in FIG. 4D is displayed in full screen", the item 413 has been activated in advance, so the content detail information of item 413 can be directly displayed in full screen, thereby avoiding that the item 413 requires a long start time and the user can wait for a period of time to watch the content detail of item 413 shown in FIG. 4D information.

In still other embodiments, in the GUI shown in FIGS. 2D and 3A-3E, when the user presses a specific button on the control device (the specific button can be preset), the display device can control the second GUI to no longer be displayed to When the user is not interested in the second GUI associated with the item in the first GUI, the user is allowed to continue browsing other items in the first GUI.

For example, in FIG. 2D, when the user presses the return key on the control device, as shown in FIG. 2C, the display device can respond to the input return instruction, no longer display the second GUI 43, and move the selector 42 to the item 413.

For another example, in FIG. 3B, when the user presses the return button on the control device or continuously presses the return button on the control device, as shown in FIG. 2C, the display device may respond to the input return instruction and no longer display the second GUI 43 and cause The selector 42 moves to the item 413.

As described in the above embodiment, when the display device provides a large number of items, the display device can provide the user with a GUI associated with the item based on the time the selector stays at the position of a certain item, so that the user can preview the content of the item in advance Detailed information; and by controlling the selector, you can further browse between the content details of the project, so that users can quickly determine whether they are interested in the project, without having to start the project multiple times, browse the content information of the project, and close the project. process.

Further, in the process of providing the user with the GUI associated with the item, the display device can control the display position and display size of the GUI associated with the item on the display based on the user input, so as to facilitate the user’s needs. The user previews the content details of the item.

Furthermore, after the user previews the content details of the item, when it is determined that the function provided by the item needs to be used, since the GUI associated with the item has been activated in advance, the display device can control the item based on user input. The associated GUI is displayed in full screen on the monitor, which can realize the non-sense start of the project, which undoubtedly makes the user obviously feel that the start of the project is accelerated.

In combination with the method shown in FIG. 5A, the method includes the following steps S51 to S56:

Step S51: Display a first GUI including a plurality of items and a selector indicating that any item is selected. For example, the first GUI 41 including the items 411 to 415 shown in FIG. 2A and the selector 42 indicating that the item 411 is selected are displayed.

Step S52: Receive a movement instruction to move the selector input by the user through the control device. For example, the user presses the right direction key on the control device to instruct to move the selector to the right.

Step S53: In response to the input movement instruction, determine the actual position of the selector in the first GUI.

Step S54: It is judged whether the residence time of the selector at the actual position exceeds the preset duration; if so, step S55 is executed; otherwise, step S56 is executed.

Step S55: Display the second GUI associated with the item selected at the actual position in a size smaller than the first GUI, and move the selector to the second GUI. Wherein, the size of the second GUI can be preset.

Optionally, in this step, the display attribute of the second GUI can also be set to transparent, so that the first GUI can remain visible.

Step S56: Keep the item at the actual position selected by the selector.

For example, in the GUI shown in FIG. 2C, it is determined that the selector 42 stays at the position of the item 413 in the first GUI 41. When it is calculated that the residence time of the selector 42 at the position of the item 413 exceeds the preset duration (eg 300ms), as shown in FIG. 2D, the upper right corner of the first GUI 41 is displayed in a preset size smaller than the size of the first GUI 41 The second GUI 43 is associated with the item 413, and the selector is moved to the item 431 in the second GUI 43. When the residence time of the calculating selector 42 at the position of the item 413 does not exceed the preset duration (for example, 300 ms), as shown in FIG. 2C, the selector 42 is kept to select the item 413, and the frame of the item 413 is enlarged and displayed.

In addition, the method may also include:

Step S57: Receive an instruction of the second GUI input by the user through the control device. The instruction can be used to instruct to move the second GUI or instruct to zoom the second GUI or to instruct to move and zoom the second GUI. For example, the user presses the channel plus/minus key on the control device to send the instruction to the display device.

Step S58: In response to the input instruction, control at least one of the display position and display size of the second GUI on the first GUI.

Here, the corresponding relationship between the key value and the related operation of controlling the second GUI can be pre-stored in the display device. For example, the key value of the channel minus key corresponds to controlling the second GUI to move 200 pixels to the left. As in FIG. 2D, when the user presses the channel minus key on the control device, as shown in FIG. 4A, the display device can control the second GUI 43 to move a preset distance to the left in response to the input key instruction. Another example is that the key value of the channel plus key correspondingly controls the second GUI to move down 100 pixels and/or zoom in 1.5 times. As in FIG. 4A, when the user presses the channel plus key on the control device, as shown in FIG. 4C, the display device can control the second GUI 43 to move down a preset distance in response to the input key instruction, and at the same time zoom in by a preset multiple.

In the following, taking the operating system stored in the memory of FIG. 1D as the Android system as an example, the above steps S53 to S55 will be described in detail in conjunction with the method shown in FIG. 5B.

Step S531: The framework layer detects the actual position of the selector in the first GUI based on the movement instruction of the movement selector transmitted by the key driver in the kernel layer.

For example, in Figure 2B, when the user presses the right direction key on the control device, the key driver in the kernel layer first converts the key value corresponding to the right direction key into an instruction to move the selector to the right, and then The instruction to move the selector to the right is passed to the framework layer for the framework layer to detect the position where the selector will move in the first GUI. As shown in FIG. 2C, the selector 42 moves to the item 413 position.

Step S541: The software program corresponding to the first GUI judges whether the residence time of the selector at the actual position exceeds the preset duration; if so, step S551 is executed, otherwise, step S56 is executed.

For example, in FIG. 2C, the software program corresponding to the first GUI is a homepage application, and the homepage application determines whether the stay time of the selector 42 at the position of the item 413 exceeds the preset duration.

Step S551: The software program corresponding to the first GUI sends a start request for activating the selected item at the actual location to the framework layer;

Step S552: The framework layer determines whether the startup request carries information indicating that the second GUI associated with the selected item is displayed in a small window; if so, step S553 is executed; otherwise, the process ends.

Step S553: According to the information, start the second GUI associated with the selected item and display the second GUI in a small window.

Continuing with the above example, when the homepage application determines that the selector 42 stays at the position of item 413 for longer than the preset time, the homepage application sends to the framework layer a startup request to activate the TV assistant application (i.e. item 413). The startup request It carries information for instructing to use a small window to display the TV assistant application. Then, when the framework layer determines that the start request carries the information, it starts the TV assistant application and displays it in a small window determined based on the information.

Furthermore, taking the Android system as an example, the first GUI corresponds to ActivityA, and the second GUI corresponds to ActivityB (Activity is one of the four most important components of the Android system, and one activity can correspond to a graphical user interface) as an example, that is, start The request is a request sent by ActivityA to start ActivityB as an example to briefly introduce.

Specifically, with reference to the method shown in FIG. 5C, step S553 further includes S5531 to S5535:

Step S5531: Detect whether the information in the startup request includes a parameter for instructing ActivityB to adopt a small window display mode; if so, perform step S5532; otherwise, end the process.

Step S5532: Keep ActivityA in a visible state.

Step S5533: Detect whether the information in the startup request carries parameters for indicating the display size and display position of the small window; if so, execute step S5534; otherwise, end the process.

Step S5534: Determine the display size and display position of the small window.

Step S5535: ActivityB is started and displayed in a small window.

Here, the parameter used to instruct ActivityB to adopt a small window display mode, for example, may be FLAG_ADJUST.

If the information in the startup request contains this parameter, modify the flag in the Activity Task corresponding to ActivityB, that is, force the theme of ActivityB (theme is a display attribute of the user interface) to be transparent, so according to the current Android system rules, the Android system does not Will change ActivityA from the visible state to the invisible state, so that ActivityA remains visible.

Next, the parameters used to indicate the display size and display position of the small window, for example, can be WIN_ENABLED_RIGHT_TOP_4.

If the information in the startup request carries this parameter, the mBounds of the display window corresponding to ActivityB is calculated according to the window adjustment parameter (_4) (the boundary size is one-fourth of the size of the display screen, that is, the width and height of the display window are respectively the display One quarter of the width and height of the screen, such as mBounds[0,1920/4,0,1080/4]), according to the window position parameter (_RIGHT_TOP), determine the position of the mBounds corresponding to the display window of ActivityB in the display screen (the The location is on the upper right side of the display);

Finally, ActivityB is started and displayed in a small window that determines the display size and display position.

It should be noted that, for example, the border size of the display window corresponding to ActivityB can be one-third, one-quarter, or one-fifth of the size of the display screen, and the position of the display window corresponding to ActivityB can be the upper left and upper right of the display. Square, bottom left, or bottom right.

Combining the border size and display position, ActivityB corresponds to the display area of the display window can have 12 kinds, for example, the display window corresponding to ActivityB is located at the upper left of the display screen, and the border size is one-third of the display size; ActivityB corresponds to the display window Located at the top left of the display screen, the border size is one-fourth of the size of the display screen; ActivityB corresponds to the display window located at the top left of the display screen, and the border size is one-fifth of the screen size; ActivityB corresponds to the display window located at the bottom of the display screen At the top right, the border size is one-third of the size of the display; the display window corresponding to ActivityB is located at the top right of the display, and the border size is one-fourth of the size of the display; the display window corresponding to ActivityB is located at the top right of the display with the border The size is one-fifth of the size of the display; the display window corresponding to ActivityB is located at the bottom left of the display, and the border size is one-third of the size of the display; the display window corresponding to ActivityB is located at the bottom left of the display, and the border size is the display One-fourth of the size; ActivityB corresponds to the display window at the bottom left of the display, and the border size is one-fifth of the size of the display; ActivityB corresponds to the display window at the bottom right of the display, and the border size is one-third of the display size One; ActivityB corresponds to the display window located at the bottom right of the display screen, and the border size is one-fourth of the size of the display screen; ActivityB corresponds to the display window located at the bottom right of the display screen, and the border size is one fifth of the display screen size.

It should be noted that the task currently displayed in the foreground in the Android system is the task at the top of a task stack. Here, since ActivityA and ActivityB are under the same task stack, the task corresponding to ActivityB is located at the top of the task stack after ActivityB is started. Accordingly, the task corresponding to ActivityA is located at the top of the sub-stack of the task stack (that is, under the task corresponding to ActivityB). ), so you can control the selector to switch from ActivityA to ActivityB. Further, on ActivityB, you can further perform other operations by controlling the selector, such as starting other activities. Exemplarily, the second sub GUI 4310 shown in FIG. 3A, the second sub GUI 4320 shown in FIG. 3C, and the second sub GUI 4330 shown in FIG. 3E may be started.

As described in the above embodiment, the method for implementing the graphical user interface of the project preview function can be implemented by the multi-window effect provided by the Android system. Since Android 7.0 and later versions support multitasking stack, it can realize the function of displaying different activities in multiple windows. However, systems before Android 7.0 do not support multitasking stacks, and cannot achieve the above-mentioned multi-window display of different activities.

Therefore, in this embodiment, by modifying the Activity startup attributes and window display in the Android system, it is intended to achieve a multi-window display effect in one task stack without being restricted by the Android system version.

Exemplarily, in a system prior to Android 7.0, when ActivityB is started on ActivityA, the display area of ActivityB corresponds to the full screen by default, and thus only one full-screen window displaying ActivityB is displayed. Therefore, in this embodiment, in order to achieve a multi-window display effect under a task stack, the display area of ActivityB is limited to the area defined by the specified boundary mBounds range, and the display area of ActivityA remains unchanged, so that ActivityA and ActivityB correspond to different displays. window.

Furthermore, in systems prior to Android 7.0, since ActivityB is overlaid on ActivityA, the life cycle of ActivityA enters the Pause state; and when the theme of ActivityB is opaque, the Android system will change ActivityA from the visible state to not Visible status, resulting in unable to display ActivityA. Therefore, in this embodiment, the theme of ActivityB is made transparent, so that according to the current Android system rules, ActivityA is still visible, so that both ActivityA and ActivityB are displayed.

In addition, in conjunction with the display device shown in FIG. 1C, some components in the display device can execute:

The display is used for displaying a first GUI including a plurality of items, and a selector indicating that any item is selected. For example, the first GUI 41 including the items 411 to 415 shown in FIG. 2A and the selector 42 indicating that the item 411 is selected are displayed.

The user interface is used to receive user input. For example, the user interface may receive an instruction from the user to control the selector to move to the right in the GUI by pressing the right direction key on the control device, so as to change the position of the selector in the GUI.

Controller, used to execute:

Determine the actual position of the selector in the first GUI based on the user input indicating the movement of the selector;

When the residence time of the calculated selector in the actual position in the first GUI exceeds the preset threshold, the display of the first GUI is maintained, and the selected value at the actual position is displayed in a preset size smaller than the size of the first GUI. The second GUI associated with the item, and the selector is moved to the second GUI. For example, in the GUI shown in FIG. 2C, it is determined that the selector 42 stays at the position of the item 413 in the first GUI 41. When it is calculated that the residence time of the selector 42 at the position of the item 413 exceeds the preset duration (eg 300ms), as shown in FIG. 2D, the upper right corner of the first GUI 41 is displayed in a preset size smaller than the size of the first GUI 41 The second GUI 43 is associated with the item 413, and the selector is moved to the item 431 in the second GUI 43.

When the residence time of the calculated selector at the actual position in the first GUI does not exceed the preset threshold, the display state of the selected item is maintained at the actual position while maintaining the display of the first GUI. For example, in the GUI shown in FIG. 2C, it is determined that the selector 42 stays at the position of the item 413 in the first GUI 41. When the residence time of the calculating selector 42 at the position of the item 413 does not exceed the preset duration (for example, 300 ms), as shown in FIG. 2C, the selector 42 is kept to select the item 413, and the frame of the item 413 is enlarged and displayed.

In some embodiments, the controller is also used to execute:

By performing at least one of a moving operation and a zooming operation of the second GUI based on the user input; the moving operation indicates a change in the position of the second GUI on the first GUI, and the zooming operation instructs the second GUI to zoom in and out according to a preset size . For example, in FIG. 2D, when the user presses the channel minus button on the control device, as shown in FIG. 4A, the display device can control the second GUI 43 to move a preset distance to the left in response to the input key instruction. For another example, in FIG. 4A, when the user presses the channel plus key on the control device, as shown in FIG. 4C, the display device can control the second GUI 43 to move down a preset distance in response to the input key instruction, and at the same time zoom in on the preset multiple.

In some embodiments, the controller is also used to execute:

By executing the closing of the second GUI based on the user input, and returning the selector to select the item selected in the first GUI before the second GUI is displayed. For example, in FIG. 2D, when the user presses the return key on the control device, as shown in FIG. 2C, the display device can respond to the input return instruction, no longer display the second GUI 43, and move the selector 42 to the item 413.

Although the preferred embodiments of the present invention have been described, those skilled in the art can make additional changes and modifications to these embodiments once they learn the basic inventive concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present invention.

Obviously, those skilled in the art can make various changes and modifications to the embodiments of the present invention without departing from the spirit and scope of the embodiments of the present invention. In this way, if these modifications and variations of the embodiments of the present invention fall within the scope of the claims of the present invention and their equivalent technologies, the present invention is also intended to include these modifications and variations.

Claims

A display device, including:

A display configured to display a user interface, the user interface including a layout of one or more different items, and a selector indicating that the item is selected, the selector moving its position in the user interface based on user input, To select different said items;

A controller in communication with the display, the controller being configured to perform presentation of a user interface:

In response to a user input instructing to move the selector, determining the position of the selector in the first user interface so that the item at the position is selected;

In response to the residence time of the selector at the position exceeding a preset threshold, while maintaining the display of the first user interface, display the same size as the one selected at the position in a size smaller than that of the first user interface. A second user interface associated with the item, and the selector is moved to the second user interface.
The display device of claim 1, the controller is further configured to execute:

The display attribute of the second user interface is set to transparent, so as to keep the first user interface visible.
The display device of claim 1, the controller is further configured to execute:

In response to a user input instructing to move the selector on the second user interface, the position of the selector in the second user interface is determined so that the item at the position is selected.
The display device of claim 1, the controller is further configured to execute:

In response to the user input that the item selected by the selector is triggered, a third user interface associated with the triggered item is displayed, and the third user interface has the same size and position as the second user interface.
The display device of claim 1, the controller is further configured to execute:

In response to a user input of moving the second user interface, the second user interface is moved to a target location in the first user interface.
The display device of claim 1, the controller is further configured to execute:

In response to a user input to zoom the second user interface, zoom the second user interface.
The display device of claim 1, the controller is further configured to execute:

In response to a user input of displaying the second user interface in a full screen, the size of the second user interface is changed so that the second user interface covers the first user interface.
The display device of claim 7, wherein the controller is further configured to execute:

The display attribute of the second user interface is set to opaque to make the first user interface invisible.
The display device of claim 1, the controller is further configured to execute:

In response to the user input of closing the second user interface, the second user interface is closed, and the selector is moved to the selected item in the first user interface before the second user interface is displayed.
8. The display device according to any one of claims 1-9, the second user interface includes one or more items, and one item in the second user interface is selected by the selector.
The display device according to any one of claims 1-9, the first user interface and the second user interface correspond to the same task stack, and the task stack is used to store a user responding to the first user interface The task of the operation, and the task of responding to the user operation on the second user interface.
A display method including:

In response to a user input instructing to move the selector on the first user interface, determining the position of the selector in the first user interface so that the item at the position is selected;

In response to the residence time of the selector at the position exceeding a preset threshold, while maintaining the display of the first user interface, display the same size as the one selected at the position in a size smaller than that of the first user interface. A second user interface associated with the item, and the selector is moved to the second user interface.
A machine-readable non-volatile storage medium with computer instructions stored thereon, and the computer instructions are implemented when executed by a controller:

In response to a user input instructing to move the selector on the first user interface, determining the position of the selector in the first user interface so that the item at the position is selected;

In response to the residence time of the selector at the position exceeding a preset threshold, while maintaining the display of the first user interface, display the same size as the one selected at the position in a size smaller than that of the first user interface. A second user interface associated with the item, and the selector is moved to the second user interface.