TWM570489U - Smart store shopping system - Google Patents
Smart store shopping system Download PDFInfo
- Publication number
- TWM570489U TWM570489U TW107208961U TW107208961U TWM570489U TW M570489 U TWM570489 U TW M570489U TW 107208961 U TW107208961 U TW 107208961U TW 107208961 U TW107208961 U TW 107208961U TW M570489 U TWM570489 U TW M570489U
- Authority
- TW
- Taiwan
- Prior art keywords
- checkout
- image
- product
- facial image
- payment
- Prior art date
Links
Landscapes
- Cash Registers Or Receiving Machines (AREA)
Abstract
Description
本新型是有關於一種智慧商店購物系統,特別是會自動偵測消費者所選購的商品之智慧商店購物系統。The present invention relates to a smart store shopping system, and in particular to a smart store shopping system that automatically detects products purchased by consumers.
當消費者到商店購買商品時,在自行選擇所要購買的商品後,多是透過店員操作銷售點終端(POS,Point of Sales)來進行商品的結帳與費用收取,或是等待店員製作咖啡或其他現泡飲品。但隨著科技的進步,現已出現各種不同形式且不需要額外配置店員來進行結帳的智慧商店出現。When a consumer goes to the store to purchase a product, after selecting the product to be purchased by himself, the POS (Point of Sales) is used to perform checkout and fee collection of the product, or wait for the clerk to make coffee or Other fresh drinks. But with the advancement of technology, there are now a variety of different forms of smart stores that do not require additional staff to checkout.
例如有透過指紋或掌紋辨識,或是手機會員帳號做為商店進出之辨識機制,以了解進店之消費者資訊。當消費者選購完商品後,則是再透過自助結帳櫃台,經由掃描商品上所貼附的RFID標籤等方式進行結帳。For example, identification by fingerprint or palm print, or mobile phone member account as an identification mechanism for store access, to understand the consumer information into the store. When the consumer purchases the product, it then checks the account through the self-checkout counter and scans the RFID tag attached to the product.
本新型於一實施例中提供一種智慧商店購物系統,包括辨識進出裝置、虛擬購物車模組、動態追蹤裝置以及結帳裝置。辨識進出裝置會拍攝拍攝進入智慧商店之消費者之入場臉部影像,分析入場臉部影像以建立並傳送購物代碼。虛擬購物車模組通信連接辨識進出裝置,虛擬購物車模組接收並傳送購物代碼。動態追蹤裝置通信連接虛擬購物車模組,於接收購物代碼後,拍攝並追蹤對應該購物代碼之該消費者的一身體影像,並偵測身體影像所對應之消費者所選購的至少一商品資料,並將至少一商品資料對應購物代碼傳送至虛擬購物車模組。In an embodiment, the present invention provides a smart store shopping system, including a recognition entry and exit device, a virtual shopping cart module, a dynamic tracking device, and a checkout device. The recognition access device captures the incoming facial image of the consumer entering the smart store and analyzes the incoming facial image to create and transmit the shopping code. The virtual shopping cart module communication connection recognizes the access device, and the virtual shopping cart module receives and transmits the shopping code. The dynamic tracking device communicates with the virtual shopping cart module, and after receiving the shopping code, captures and tracks a body image of the consumer corresponding to the shopping code, and detects at least one product selected by the consumer corresponding to the body image. Data, and at least one product data corresponding to the shopping code is transmitted to the virtual shopping cart module.
結帳裝置通信連接虛擬購物車模組,結帳裝置拍攝結帳臉部影像及商品影像,將結帳臉部影像傳送至虛擬購物車模組。接著,自虛擬購物車模組接收相同於結帳臉部影像之入場臉部影像所對應之購物代碼的至少一商品資料。結帳裝置將分析商品影像以取得並顯示商品資訊,並於接收結帳訊號後,計算商品資訊之結帳金額。在完成請款後,比對完成請款的商品資訊及至少一商品資料。並且,將對應至已完成請款之商品資訊的至少一商品資料建立付款註記,將未對應至已完成請款之商品資訊的至少一商品資料建立未付款註記,再將付款註記及未付款註記傳送至虛擬購物車模組。The checkout device communicates with the virtual shopping cart module, and the checkout device takes the checkout face image and the product image, and transmits the checkout face image to the virtual shopping cart module. Then, at least one product data corresponding to the shopping code corresponding to the entrance facial image of the checkout facial image is received from the virtual shopping cart module. The checkout device will analyze the product image to obtain and display the product information, and calculate the checkout amount of the product information after receiving the checkout signal. After completing the payment, compare the product information of the payment and at least one product information. And, a payment note is created corresponding to at least one product data corresponding to the product information of the completed payment, and an unpaid note is created for at least one product data that does not correspond to the product information of the completed payment, and the payment note and the unpaid note are added. Transfer to the virtual shopping cart module.
透過上述的智慧商店購物系統,當消費者進入智慧商店中時,即會為消費者建立一購物代碼以啟動虛擬購物車模組,並將購物代碼做為虛擬購物車的消費者代碼。並且,在一入店後即拍攝的身體影像並對應購物代碼,以在智慧商店中追蹤消費者的動線及動態。消費者於智慧商店中進行的商品選購動作後,動態追蹤裝置將辨識所選購的商品資訊,並將此選購的商品資訊對應消費者的購物代碼傳送至虛擬購物車模組中儲存。也就是說,消費者在智慧商店中的所有選購行為,將自動進行辨識並加入虛擬購物車中。最後,結帳後則會比對結帳時的實體商品與虛擬購物車中原記錄之選購商品資訊是否相同,並針對已結帳及未結帳之商品資訊分別進行註記。Through the smart store shopping system described above, when the consumer enters the smart store, a shopping code is created for the consumer to launch the virtual shopping cart module, and the shopping code is used as the consumer code of the virtual shopping cart. Moreover, the body image taken after entering the store and corresponding to the shopping code to track the movement and dynamics of the consumer in the smart store. After the consumer purchases the product in the smart store, the dynamic tracking device will identify the purchased product information, and transmit the purchased product information to the virtual shopping cart module for storage. In other words, all purchase behaviors of consumers in the smart store will be automatically identified and added to the virtual shopping cart. Finally, after checkout, it compares whether the physical commodity at the time of checkout is the same as the original commodity information recorded in the virtual shopping cart, and separately notes the commodity information that has been settled and unchecked.
藉此,消費者可以透過拍攝臉部影像以進入店內進行消費,並利用追蹤身體影像記錄消費者所選購的物品。於選購完成,可在自助結帳櫃台透過結帳裝置進行結帳。經由所拍攝的臉部影像及身體影像,可記錄消費者於店內所選購的商品資訊為何,並儲存所選購的商品。進一步,也可以利用所拍攝的臉部影像及身體影像,追蹤分析自消費者進入智慧商店至離開智慧商店過程中的購物行為,以辨識消費者在選購時所拿取的商品是否皆已進行付款,做到雙重比對的功能。In this way, consumers can capture facial images to enter the store for consumption, and use tracking body images to record items purchased by consumers. After the purchase is completed, checkout can be made through the checkout device at the self-checkout counter. Through the captured facial images and body images, it is possible to record the information of the products purchased by the consumer in the store and store the purchased products. Further, it is also possible to use the captured facial images and body images to track and analyze the shopping behavior from the time when the consumer enters the smart store to leave the smart store to identify whether the products taken by the consumer during the purchase have been carried out. Payment, double matching function.
以下在實施方式中詳細敘述本新型之詳細特徵以及優點,其內容足以使任何熟悉相關技藝者瞭解本新型之技術內容並據以實施,且根據本說明書所揭露之內容、申請專利範圍及圖式,任何熟習相關技藝者可輕易地理解本新型相關之目的及優點。The detailed features and advantages of the present invention are described in detail in the following detailed description of the embodiments of the present invention. Any related art and related art can easily understand the related purposes and advantages of the present invention.
請參閱圖1至圖2,圖1為本新型一實施例智慧商店購物系統之示意圖,圖2為本新型一實施例智慧商店購物系統之方塊示意圖。本實施例之智慧商店系統包括辨識進出裝置10、虛擬購物車模組20、動態追蹤裝置30以及結帳裝置40。智慧商店購物系統中的全部模組或裝置可以透過一個主機進行資料之處理或控制,也可以是分別以多個主機來執行各個模組與裝置。虛擬購物車模組20分別通信連接辨識進出裝置10、動態追蹤裝置30及結帳裝置40。Please refer to FIG. 1 to FIG. 2 . FIG. 1 is a schematic diagram of a smart store shopping system according to an embodiment of the present invention. FIG. 2 is a block diagram of a smart store shopping system according to an embodiment of the present invention. The smart store system of the present embodiment includes a recognition entry and exit device 10, a virtual shopping cart module 20, a dynamic tracking device 30, and a checkout device 40. All modules or devices in the smart store shopping system can process or control data through a host, or can execute modules and devices by multiple hosts. The virtual shopping cart module 20 communicably connects the identification access device 10, the dynamic tracking device 30, and the checkout device 40, respectively.
當消費者要進入智慧商店1進行消費時,辨識進出裝置10拍攝進入智慧商店1之消費者之入場臉部影像。在分析此入場臉部影像後,依據入場臉部影像建立購物代碼,並將入場臉部影像與購物代碼傳送至虛擬購物車模組20。在本實施例中,取得入場臉部影像後可利用影像分析技術,透過分析取得臉部特徵資料等方式,來區分不同的臉部影像。所使用的可以為現已習知之影像分析辨識技術,在此便不再贅述。When the consumer wants to enter the smart store 1 for consumption, the recognition entry and exit device 10 captures the entrance facial image of the consumer entering the smart store 1. After analyzing the incoming facial image, a shopping code is created based on the incoming facial image, and the incoming facial image and the shopping code are transmitted to the virtual shopping cart module 20. In this embodiment, after obtaining the facial image, the image analysis technology can be used to obtain different facial images by analyzing facial feature data. The image analysis and identification technology that has been used can be used, and will not be described here.
在本實施例中,虛擬購物車模組20可以結合智慧商店1中所設置的主機來執行,亦可以單獨設置之主機來實現。虛擬購物車模組20會接收並儲存來自辨識進出裝置10的入場臉部影像及購物代碼。當虛擬購物車模組20接收到入場臉部影像及購物代碼,即會於虛擬購物車模組20中依據購物代碼為消費者建立個人專屬的虛擬購物車,以便進行後續的商品選購記錄。隨後,會將購物代碼傳送至動態追蹤裝置30,以啟動動態追蹤裝置30開始對消費者進行動線與動態追蹤。In this embodiment, the virtual shopping cart module 20 can be implemented in combination with a host set in the smart store 1, or can be implemented by a separately set host. The virtual shopping cart module 20 receives and stores the incoming facial image and shopping code from the identification access device 10. When the virtual shopping cart module 20 receives the entrance facial image and the shopping code, the virtual shopping cart module 20 creates a personal exclusive virtual shopping cart for the consumer according to the shopping code, so as to perform subsequent merchandise purchase records. The shopping code is then transmitted to the dynamic tracking device 30 to initiate the dynamic tracking device 30 to begin dynamic and dynamic tracking of the consumer.
動態追蹤裝置30於接收購物代碼後,將拍攝並開始追蹤對應購物代碼之消費者的身體影像,並偵測身體影像所對應之消費者所選購的至少一商品資料。並將至少一商品資料對應購物代碼傳送至虛擬購物車模組20。After receiving the shopping code, the dynamic tracking device 30 will capture and start tracking the body image of the consumer corresponding to the shopping code, and detect at least one product data selected by the consumer corresponding to the body image. And transmitting at least one product data corresponding to the shopping code to the virtual shopping cart module 20.
舉例來說,當消費者於智慧商店1中,從貨架上拿取一個商品後,動態追蹤裝置30將會辨識所拿取的商品資料,並且依據身體影像得知拿取此商品的消費者的購物代碼,接著就將商品資料與購物代碼相關連,並傳送至虛擬購物車模組20。此時,在虛擬購物車模組20中此消費者的虛擬購物車中即會儲存有所選購的一筆商品資料。若是消費者在拿取後又放回貨架,則動態追蹤裝置30亦會對應辨識,而將此移除資訊通知虛擬購物車模組20,以刪除虛擬購物車中原記錄已選購的商品資料。動態追蹤裝置30會持續追蹤消費者於智慧商店1中的所有動線與動態直至消費者離開智慧商店1為止。For example, when the consumer picks up an item from the shelf in the smart store 1, the dynamic tracking device 30 will recognize the product data taken, and learn from the body image that the consumer who took the product The shopping code is then associated with the shopping code and transmitted to the virtual shopping cart module 20. At this time, in the virtual shopping cart module 20, the consumer's virtual shopping cart stores an optional item of merchandise. If the consumer puts it back on the shelf, the dynamic tracking device 30 will also identify the content, and notify the virtual shopping cart module 20 of the removal information to delete the purchased product data in the virtual shopping cart. The dynamic tracking device 30 will continue to track all the movements and dynamics of the consumer in the smart store 1 until the consumer leaves the smart store 1.
當消費者完成選購後,則可利用結帳裝置40進行結帳。消費者利用結帳裝置40拍攝結帳臉部影像及商品影像。此時,結帳裝置40會將結帳臉部影像傳送至虛擬購物車模組20,並自虛擬購物車模組20接收相同於結帳臉部影像之入場臉部影像所對應之購物代碼的至少一商品資料。在此,比對是否為相同臉部影像的方式可以是透過影像分析利用臉部特徵資料的方式來分析辨識,或各種習知的辨識方式,在此不多加贅述。When the consumer completes the purchase, the checkout device 40 can be used for checkout. The consumer uses the checkout device 40 to take a checkout face image and a product image. At this time, the checkout device 40 transmits the checkout face image to the virtual shopping cart module 20, and receives the shopping code corresponding to the entrance face image of the checkout face image from the virtual shopping cart module 20. At least one product information. Here, the manner of whether the comparison is the same facial image may be the analysis and recognition by using the facial feature data through image analysis, or various conventional identification methods, which are not described here.
結帳裝置40亦分析商品影像以取得並顯示商品資訊,於接收結帳訊號後,計算商品資訊之結帳金額。並於完成請款後,比對完成請款的商品資訊及至少一商品資料。將對應至已完成請款之該商品資訊的至少一商品資料建立付款註記,將未對應至已完成請款之商品資訊的至少一商品資料建立未付款註記,並將付款註記及未付款註記傳送至虛擬購物車模組20。The checkout device 40 also analyzes the product image to obtain and display the product information, and after receiving the checkout signal, calculates the checkout amount of the product information. After completing the payment, compare the product information of the payment and at least one product information. Forming a payment note for at least one product data corresponding to the product information of the completed payment, establishing an unpaid note for at least one product data that does not correspond to the product information of the completed payment, and transmitting the payment note and the unpaid note To the virtual shopping cart module 20.
在消費者利用結帳裝置40拍攝所選購的商品的商品影像並完成結帳後,結帳裝置40將會就已結帳商品跟原虛擬購物車中已選購之商品進行比對,確認哪些商品已經完成結帳,哪些商品尚未完成結帳。After the consumer photographs the product image of the purchased product by the checkout device 40 and completes the checkout, the checkout device 40 compares the checked goods with the purchased products in the original virtual shopping cart, and confirms Which items have been settled and which items have not yet been settled.
藉此,消費者可以透過拍攝臉部影像及身體影像即在店內進行消費,並於選購完成,可在自助結帳櫃台透過結帳裝置40進行結帳。經由所拍攝的臉部影像及身體影像,可記錄消費者於店內所選購的商品資訊為何,並儲存所選購的商品。進一步,也可以利用所拍攝的臉部影像及身體影像,追蹤分析自消費者進入智慧商店1至離開智慧商店1過程中的購物行為。另外,也可以辨識消費者在選購時所拿取的商品是否皆已進行付款,做到雙重比對的功能。In this way, the consumer can purchase the facial image and the body image by purchasing the facial image and the body image, and after the purchase is completed, the checkout device 40 can perform the checkout at the self-checkout counter. Through the captured facial images and body images, it is possible to record the information of the products purchased by the consumer in the store and store the purchased products. Further, it is also possible to track and analyze the shopping behavior from the time when the consumer enters the smart store 1 to leave the smart store 1 by using the captured facial image and body image. In addition, it is also possible to identify whether the products taken by the consumer at the time of purchase have been paid for, and the function of double comparison is achieved.
進一步應用時,可以在辨識進出裝置10於消費者要離開智慧商店1時拍攝一離場臉部影像,並傳送離場臉部影像至虛擬購物車模組20。虛擬購物車模組20則會根據離場臉部影像確認相同於離場臉部影像之入場臉部影像所對應之購物代碼的至少一商品資料是否有未付款註記,若有則傳送未結帳通知至辨識進出裝置。也就是說,對於要離場的消費者一樣進行臉部影像的拍攝及辨識,並確認於對應此消費者的虛擬購物車中是否有被註記為未結帳之商品,若有則傳送未結帳通知的提醒至辨識進出裝置10。In further application, an image of the exit face can be taken when the consumer enters the smart store 1 and the exit face image is transmitted to the virtual shopping cart module 20. The virtual shopping cart module 20 confirms whether at least one of the product data corresponding to the shopping code corresponding to the entrance facial image of the exiting facial image has an unpaid annotation according to the outgoing facial image, and if not, transmits the unpaid checkout Notify to identify the access device. In other words, the face image is captured and recognized in the same way as the consumer who wants to leave the field, and it is confirmed whether there is an unmarked item in the virtual shopping cart corresponding to the consumer, and if so, the transfer is not completed. The reminder of the account notification is recognized to the entry and exit device 10.
當辨識進出裝置10接收到此通知後,可以利用螢幕顯示、燈號警示、聲音警示或其他各種提示手段,來提示消費者有尚未結帳之商品,請於完成結帳或將商品歸放至原位後再行離開等。When the identification access device 10 receives the notification, the screen display, the light alarm, the audible alarm or other various prompting means may be used to prompt the consumer to have the goods that have not been settled. Please complete the checkout or place the goods on the screen. Leave it in place before leaving.
接著,將就辨識進出裝置10做進一步的說明。請同時參閱圖1至圖3,圖3為本新型一實施例辨識進出裝置之示意圖。辨識進出裝置10包括辨識攝影機11、匣門12、顯示裝置13及控制器14。在本實施例的圖1及圖3中是以設置二組辨識進出裝置10為例示,但在其他實施例中也可以視空間及客流量的需求,僅裝設一組辨識進出裝置10或是裝設更多的辨識進出裝置10。而每一組辨識進出裝置10包括二個辨識攝影機11,用以拍攝入場及離場時的臉部影像。但在其他實施態樣中,也可以僅設置一個辨識攝影機11,並利用旋轉或移動結構,使得辨識攝影機11可以拍攝不同方向的臉部影像。Next, the entry and exit device 10 will be further described. Please refer to FIG. 1 to FIG. 3 simultaneously. FIG. 3 is a schematic diagram of the identification access device according to an embodiment of the present invention. The identification access device 10 includes an identification camera 11, a trick 12, a display device 13, and a controller 14. In FIG. 1 and FIG. 3 of the embodiment, the two sets of identification access devices 10 are exemplified, but in other embodiments, only one set of identification access devices 10 may be installed depending on the space and passenger flow requirements. More identification access devices 10 are installed. Each group of identification access devices 10 includes two identification cameras 11 for capturing facial images when entering and leaving the field. However, in other embodiments, it is also possible to provide only one identification camera 11 and utilize a rotating or moving structure so that the recognition camera 11 can capture facial images in different directions.
控制器14連接辨識攝影機11、閘門12與顯示裝置13。辨識攝影機11拍攝取得入場臉部影像,並交由控制器14進行影像分析。隨後,控制器14會將根據入場臉部影像建立購物代碼,並傳送購物代碼至虛擬購物車模組20。同時,將控制閘門12開啟以讓消費者進入智慧商店進行消費。在本實施例中,還可以結合會員資料來進行辨識,以記錄各會員的消費資料或是依會員的帳號來進行扣款結帳,詳細將於後進行說明。但無論是否為會員,皆可以透過拍攝臉部影像的方式,給予購物代碼並建立虛擬購物車,以於智慧商店1內進行購物。The controller 14 is connected to the identification camera 11, the shutter 12, and the display device 13. The recognition camera 11 captures an image of the entrance face and submits it to the controller 14 for image analysis. Subsequently, the controller 14 will create a shopping code based on the incoming facial image and transmit the shopping code to the virtual shopping cart module 20. At the same time, the control gate 12 is opened to allow the consumer to enter the smart store for consumption. In this embodiment, the member information can also be used for identification, to record the consumption data of each member or to perform the debit settlement according to the member's account number, which will be described later in detail. However, whether it is a member or not, the shopping code can be given and a virtual shopping cart can be created by taking a facial image to purchase in the smart store 1.
當消費者完成結帳要離場時,亦需通過辨識進出裝置10。辨識攝影機11將拍攝取得離場臉部影像,並交由控制器14進行影像分析。當控制器14接收離場臉部影像時,會傳送離場臉部影像至虛擬購物車模組20,進行前述的比對確認。如果有接收到未結帳通知時,控制器14將控制顯示裝置13顯示一警示訊息並控制閘門12關閉。此警示訊息可以為文字、圖案、數字、音效等,本新型不以此為限。例如可以於顯示裝置13上顯示「您尚有xx商品未完成結帳,請將商品歸還原位,或進行結帳」。When the consumer completes the checkout to leave the venue, it is also necessary to identify the access device 10. The recognition camera 11 will take an image of the exit face and take it to the controller 14 for image analysis. When the controller 14 receives the exit face image, the exit face image is transmitted to the virtual shopping cart module 20, and the aforementioned comparison confirmation is performed. If an unchecked notification is received, the controller 14 will control the display device 13 to display an alert message and control the shutter 12 to close. The warning message can be text, graphics, numbers, sound effects, etc., and the present invention is not limited thereto. For example, it may be displayed on the display device 13 that "you still have xx items that have not been settled, please return the items to the original position, or perform checkout."
接下來將說明對於已有註冊為會員之消費者來店消費時的進行方式。本實施例的智慧商店購物系統可以包括會員伺服器50通信連接辨識進出裝置10。會員伺服器50包括資料庫51以及驗證模組52。資料庫51中儲存有複數會員資料,各會員資料可包括會員編號、姓名、性別、出生年月日、卡片資料、臉部影像以及支付帳戶資料。驗證模組52連接資料庫51。Next, the manner in which the consumer who has registered as a member comes to the store will be explained. The smart store shopping system of the present embodiment may include a member server 50 communication connection identification access device 10. The member server 50 includes a database 51 and a verification module 52. The database 51 stores a plurality of member materials, and each member data may include a member number, a name, a gender, a date of birth, card information, facial images, and payment account information. The verification module 52 is connected to the database 51.
當消費者要進入智慧商店1而至辨識進出裝置10進行臉部拍攝後,辨識進出裝置10可將此入場臉部影像傳送至會員伺服器50。會員伺服器50在接收到入場臉部影像時,將比對資料庫51中各會員資料的臉部影像。當在所有會員的臉部影像中比對到與入場臉部影像相同的臉部影像時,即找出對應的會員資料。隨後,會員伺服器50傳送對應臉部影像之會員編號至辨識進出裝置10。辨識進出裝置10將可以使用會員編號以做為此消費者的購物代碼。When the consumer wants to enter the smart store 1 and recognizes the entry and exit device 10 for face shooting, the recognition access device 10 can transmit the incoming facial image to the member server 50. When receiving the facial image, the member server 50 compares the facial images of the member materials in the database 51. When the same facial image as the entrance facial image is compared in the facial images of all members, the corresponding member information is found. Subsequently, the member server 50 transmits the member number corresponding to the face image to the recognition access device 10. The identification entry and exit device 10 will be able to use the membership number to make a shopping code for this consumer.
如此,對於已是會員的消費者來說,可以利用會員編號來與消費行為與記錄相關聯,甚至將該些記錄都對應儲存於資料庫51中,以便對會員的消費習性進行分析。甚至,會員亦可以回顧自己過往的消費內容。舉例來說,會員伺服器50可以將消費者進入智慧商店1的時間對應會員資料儲存為入場時間,以記錄各會員進入智慧商店1的日期時間等。也可以將在智慧商店1內的選購過程(例如購買動線、選購物品、原欲選購但最後又未購買的商品等)對應會員資料儲存於資料庫51。藉此,可以將此做為會員的消費時間或習性分析,而可以進行更進一步的應用。例如若消費者幾乎都於特定時間至智慧商店1購買咖啡,則可以在此特定時間之前提示咖啡相關的優惠活動或訊息。或是對於消費者曾經購買過或有想購買的商品,也可以在有促銷時提示消費者相關的優惠活動資訊,以更增加消費者來店消費之意願。Thus, for a consumer who is already a member, the member number can be used to associate with the consumer behavior and record, and even the records are stored in the database 51 in order to analyze the consumption habits of the member. Even members can review their past consumption content. For example, the member server 50 may store the time corresponding member information of the consumer entering the smart store 1 as the entry time to record the date and time of each member entering the smart store 1 and the like. It is also possible to store the member information in the shopping process in the shopping process in the smart store 1 (for example, purchasing a moving line, purchasing an item, a product originally purchased but not yet purchased). In this way, this can be used as a member's consumption time or habit analysis, and can be further applied. For example, if the consumer purchases the coffee almost at a specific time to the smart store 1, the coffee-related offer or message can be prompted before the specific time. Or for products that consumers have purchased or want to buy, they can also prompt consumers for relevant promotional information when there is a promotion, so as to increase the willingness of consumers to shop.
接著,請繼續參閱圖1及圖2,本實施例之動態追蹤裝置30包括複數攝影機31及處理器32。攝影機31設置於智慧商店1中,用以拍攝並取得消費者的身體影像及選購的至少一商品影像。複數攝影機31可以設置於智慧商店1中的任意位置,甚至是貨架上等皆可以設置攝影機31。藉此,無論消費者走至智慧商店1的任意位置,都可以被攝影機31所拍攝。Next, referring to FIG. 1 and FIG. 2, the dynamic tracking device 30 of the present embodiment includes a plurality of cameras 31 and a processor 32. The camera 31 is disposed in the smart store 1 for capturing and acquiring a body image of the consumer and at least one product image purchased. The plurality of cameras 31 can be placed at any position in the smart store 1, and even the camera 31 can be provided on the shelf. Thereby, regardless of the position where the consumer walks to the smart store 1, it can be photographed by the camera 31.
處理器32連接攝影機31。攝影機31會持續拍攝智慧商店1中的影像,並將所有影像傳送至處理器32進行分析處理。處理器32在接收攝影機31的影像後,會分析影像中被消費者所拿取的商品影像以取得對應的商品資料,並根據身體影像,將此商品資料對應消費者的購物代碼傳送至虛擬購物車模組20。此時,消費者的虛擬購物車中即會增加此一商品資料做為已選購商品。The processor 32 is connected to the camera 31. The camera 31 continuously captures the images in the smart store 1 and transmits all the images to the processor 32 for analysis processing. After receiving the image of the camera 31, the processor 32 analyzes the product image captured by the consumer in the image to obtain the corresponding product data, and transmits the product data corresponding to the consumer's shopping code to the virtual shopping according to the body image. Car module 20. At this point, the consumer's virtual shopping cart will add this product information as an already purchased product.
另外,若是消費者將商品放回貨架而不要購買時,處理器32分析攝影機31所拍攝的影像為將商品置回貨架時,亦會進行分析影像中被消費者所放回的商品影像以取得對應的商品資料,並根據身體影像,將刪除此商品資料的訊息,對應消費者的購物代碼傳送至虛擬購物車模組20。如此,可即時更新消費者的虛擬購物車中的商品資料。In addition, if the consumer returns the product to the shelf without purchasing, the processor 32 analyzes the image captured by the camera 31 to return the product to the shelf, and also analyzes the image of the product returned by the consumer in the image to obtain Corresponding product data, and according to the body image, the message of the product data is deleted, and the shopping code corresponding to the consumer is transmitted to the virtual shopping cart module 20. In this way, the product data in the consumer's virtual shopping cart can be instantly updated.
在其他實施例中,除了使用上述全靠攝影機31來拍攝並進行影像分析的方式外,也可以利用在貨架上設置重量感測器,當消費者拿商品時即可以因重量改變,而感應到對應位置的商品被選購,進而確定消費者所選購的商品。再配合攝影機31所拍攝到的消費者身體影像,而確定購買此商品的消費者身份,以對消費者的虛擬購物車進行商品資料的增減。In other embodiments, in addition to the above-mentioned manner of taking the image by the camera 31 and performing image analysis, it is also possible to use a weight sensor on the shelf, which can be sensed when the consumer takes the product. The products in the corresponding locations are purchased to determine the products purchased by the consumers. In conjunction with the consumer body image captured by the camera 31, the consumer identity of the product is determined to increase or decrease the product data of the consumer's virtual shopping cart.
另外,在本實施例中,還可以再設置多媒體裝置60通信連接動態追蹤裝置30。消費者可以利用多媒體裝置60來操作各種要繳費的帳單資訊,或是購買各種票券等。當多媒體裝置60接收繳費資訊(例如要繳的帳單費用、購買的票券的待繳費費用)後,傳送繳費資訊至動態追蹤裝置30。動態追蹤裝置30會依據操作多媒體裝置60時所拍攝到的身體影像,將繳費資訊對應此身體影像所對應的購物代碼傳送至虛擬購物車模組20。如此,可將此繳費資訊增加至消費者的虛擬購物車中。當消費者在進行結帳時,若忘了輸入此繳費資訊進行繳費,亦可以利用結帳裝置40提醒消費者有待繳費資訊,是否要進行繳費等。In addition, in the embodiment, the multimedia device 60 can be further provided to communicate with the dynamic tracking device 30. The consumer can use the multimedia device 60 to operate various billing information to be paid, or to purchase various tickets and the like. When the multimedia device 60 receives the payment information (for example, the bill fee to be paid, the toll fee for the purchased ticket), the payment information is transmitted to the dynamic tracking device 30. The dynamic tracking device 30 transmits the payment information corresponding to the shopping code corresponding to the body image to the virtual shopping cart module 20 according to the body image captured when the multimedia device 60 is operated. In this way, the payment information can be added to the consumer's virtual shopping cart. When the consumer is in the process of checking out, if he forgets to input the payment information to pay the fee, the checkout device 40 can also be used to remind the consumer of the information to be paid, whether to pay the fee or the like.
接著,請參閱圖1、圖2及圖4,圖4為為本新型一實施例結帳裝置之示意圖。本實施例之結帳裝置40包括一第一攝影機41、一第二攝影機42、一觸控螢幕43以及一控制模組44。控制模組44則是連接第一攝影機41、第二攝影機42及觸控螢幕43。第一攝影機41用以拍攝並取得結帳臉部影像,並由控制模組44分析結帳臉部影像。隨後,控制模組44會將此結帳臉部影像傳至虛擬購物車模組20,以進行前述的結帳及比對虛擬購物車中是否有尚未結帳的商品資料。消費者若不是已註冊之會員,則僅能利用儲值卡、信用卡等方式進行結帳扣款。但若是會員的話,則可以有更多的付款方式,接下來將詳細說明。Next, please refer to FIG. 1, FIG. 2 and FIG. 4. FIG. 4 is a schematic diagram of a checkout device according to an embodiment of the present invention. The checkout device 40 of the embodiment includes a first camera 41, a second camera 42, a touch screen 43, and a control module 44. The control module 44 is connected to the first camera 41, the second camera 42, and the touch screen 43. The first camera 41 is used to capture and obtain a checkout facial image, and the control module 44 analyzes the checkout facial image. Subsequently, the control module 44 transmits the checkout facial image to the virtual shopping cart module 20 to perform the foregoing checkout and compare the unfilled merchandise materials in the virtual shopping cart. If the consumer is not a registered member, he/she can only use the stored value card, credit card, etc. to settle the charge. However, if you are a member, you can have more payment methods, which will be explained in detail.
在消費者為會員的情況下,控制模組44在取得結帳臉部影像後,可再傳送到會員伺服器50,以確認欲結帳的消費者是否為會員,若是則接收對應結帳臉部影像的會員之支付帳戶資料。在此,是以傳送結帳臉部影像至會員伺服器50比對確認是否為會員,除此之外,亦可以透過由將結帳臉部影像傳至虛擬購物車模組20後,所接收到的購物代碼來分析是否為會員,若是則至會員伺服器50取得對應購物代碼(即會員編碼)的會員的支付帳戶資料。In the case that the consumer is a member, the control module 44 can transmit the checkout facial image to the member server 50 to confirm whether the consumer to be settled is a member, and if so, receive the corresponding checkout face. Member account payment account information. Here, it is determined whether the member is sent to the member server 50 by comparing the checkout face image to the member server. In addition, it can also be received after the checkout face image is transmitted to the virtual shopping cart module 20. The shopping code to analyze whether it is a member, and if so, to the member server 50 to obtain the payment account information of the member corresponding to the shopping code (ie, the member code).
隨後,將要購買的商品透過第二攝影機42拍攝並取得商品影像。控制模組44接收並分析自第二攝影機42取得的商品影像以取得商品資訊,並傳送商品資訊至觸控螢幕43進行顯示。當觸控螢幕43接收到結帳訊號後,控制模組44將根據商品資訊計算結帳金額,且依據支付帳戶資料進行請款。當控制模組44於完成請款後,可控制觸控螢幕43顯示結帳完成資訊。Subsequently, the product to be purchased is photographed through the second camera 42 and the product image is obtained. The control module 44 receives and analyzes the product image acquired from the second camera 42 to obtain product information, and transmits the product information to the touch screen 43 for display. After the touch screen 43 receives the checkout signal, the control module 44 calculates the checkout amount based on the product information, and makes a payment according to the payment account information. After the control module 44 completes the payment, the touch screen 43 can be controlled to display the checkout completion information.
舉例來說,當消費者入店後,則可以選購想購買之商品,於選購完成後,即可至結帳裝置40進行結帳。當要結帳時,消費者可以先藉由觸碰觸控螢幕43以啟動結帳,也可以經由第一攝影機41於感測到有消費者站立於特定位置經過特定時間後,自動啟動結帳。當結帳程序啟動後,第一攝影機41將拍攝消費者的臉部以取得結帳臉部影像。控制模組44則會分析結帳臉部影像,並將結帳臉部影像傳送到會員伺服器50以接收對應結帳臉部影像之支付帳戶資料。控制模組44接收到支付帳戶資料後將先暫存此資料以供隨後結帳請款使用。For example, when the consumer enters the store, he or she can purchase the product to be purchased, and after the purchase is completed, the checkout device 40 can perform the checkout. When the bill is to be settled, the consumer can start the checkout by touching the touch screen 43 first, or automatically start the checkout after the user has sensed that the consumer has stood at a specific location for a certain period of time via the first camera 41. . When the checkout process is initiated, the first camera 41 will capture the face of the consumer to obtain a checkout facial image. The control module 44 analyzes the checkout facial image and transmits the checkout facial image to the member server 50 to receive payment account information corresponding to the checkout facial image. After receiving the payment account information, the control module 44 will temporarily store the data for subsequent settlement and payment.
接著,在完成臉部辨識程序後,消費者可以將要購買的商品放置於結帳掃描區45,第二攝影機42即會拍攝結帳掃描區45以取得商品影像。控制模組44則會接收並分析自第二攝影機42取得的商品影像以取得商品資訊,並傳送商品資訊至觸控螢幕43進行顯示。消費者可以透過觸控螢幕43確認所辨識之商品資訊是否正確。並且若是有商品不想購買了,也可以透過觸控螢幕43刪除不想購買的商品,或是增加要購買商品的數量。Then, after the face recognition process is completed, the consumer can place the item to be purchased in the checkout scanning area 45, and the second camera 42 will take the checkout scanning area 45 to obtain the product image. The control module 44 receives and analyzes the product image acquired from the second camera 42 to obtain product information, and transmits the product information to the touch screen 43 for display. Consumers can confirm whether the identified product information is correct through the touch screen 43. And if there is a product that does not want to be purchased, the touch screen 43 can also be used to delete the item that is not desired to be purchased, or to increase the quantity of the item to be purchased.
當所有要購買的商品皆輸入完成後,消費者即可透過觸控螢幕43輸入結帳訊號。此結帳訊號可以為顯示於觸控螢幕43上的選項按鍵讓消費者進行點選。當消費者輸入結帳訊號後,控制模組44將根據商品資訊計算結帳金額,且依據先前所接收到的支付帳戶資料來進行請款。當控制模組44於完成請款後,將控制觸控螢幕43顯示結帳完成資訊。When all the items to be purchased are input, the consumer can input the checkout signal through the touch screen 43. The checkout signal can be selected by the consumer for the option button displayed on the touch screen 43. After the consumer inputs the checkout signal, the control module 44 calculates the checkout amount based on the commodity information, and performs the payment according to the previously received payment account information. When the control module 44 completes the payment, the control touch screen 43 displays the checkout completion information.
在一些實施例中,也可以於消費者輸入結帳訊號時,同時比對要結帳的商品資訊,以及由虛擬購物車模組20所接收到的商品資料。若是有存在於商品資料中的商品,而存在要結帳的商品資訊中時,也可以於此時跳出提示,提醒消費者尚有該些商品待結帳。In some embodiments, when the consumer inputs the checkout signal, the merchandise information to be checked out and the merchandise data received by the virtual shopping cart module 20 may also be compared. If there is a product existing in the product data, and there is a product information to be checked out, a prompt may be displayed at this time to remind the consumer that the goods are still to be settled.
在本實施例中,會員資料中的支付帳戶資料可為一雲端帳戶資料,雲端帳戶資料可對應至一金融帳戶、一儲值卡片帳戶或一記帳帳戶。舉例來說,雲端帳戶資料若是設定對應至金融帳戶,在進行結帳請款時,即會向金融帳戶之銀行伺服器傳送請款請求,當接收到回傳的請款成功訊號後,即完成請款。雲端帳戶資料若是設定對應至儲值卡片帳戶,在進行結帳請款時,即會向儲值卡片帳戶的之卡片伺服器確認是否還有足夠之儲值金額供扣款,若有即會向卡片伺服器傳送請款請求,當接收到回傳的請款成功訊號後,即完成請款。In this embodiment, the payment account information in the member profile may be a cloud account profile, and the cloud account profile may correspond to a financial account, a stored value card account, or a billing account. For example, if the cloud account information is set to correspond to the financial account, the payment request will be sent to the bank account of the financial account when the checkout payment is made, and the payment request is completed after receiving the returned payment success signal. Please pay. If the cloud account data is set to correspond to the stored value card account, when the checkout payment is made, the card server of the stored value card account will be confirmed whether there is enough stored value for the deduction, if any, The card server transmits the request for payment, and upon receiving the successful payment of the payment, the payment is completed.
雲端帳戶資料若是設定對應至記帳帳戶,在進行結帳請款時,即會向記帳帳戶的之伺服器傳送結帳金額。若是結帳金額符合伺服器之記帳條件,伺服器則將於記帳帳戶中儲存為一記帳金額,並且向結帳裝置40傳送請款成功訊號。當結帳裝置40接收到回傳的請款成功訊號後,即完成請款。在此,記帳帳戶可以設定為連結至消費者的薪資帳戶,伺服器可以設定為定時(例如每個月5號)至薪資帳戶取得對應目前儲存於記帳帳戶中的記帳金額的款項。並且,伺服器於確認取得記帳金額之款項後,可將記帳帳戶中之記帳金額歸零。If the cloud account data is set to correspond to the billing account, the checkout amount will be sent to the server of the billing account when the checkout payment is made. If the checkout amount meets the billing conditions of the server, the server will store the billing amount as a billing amount and transmit the payment success signal to the checkout device 40. When the checkout device 40 receives the returned payment success signal, the payment is completed. Here, the billing account can be set to be linked to the consumer's payroll account, and the server can be set to timed (eg, number 5 per month) to the payroll account to obtain a payment corresponding to the billing amount currently stored in the billing account. Moreover, after the server confirms the payment of the billing amount, the server can zero the billing amount in the billing account.
在其他實施例中,支付帳戶資料也可為一行動支付資訊或一信用卡資料。當結帳裝置40要進行請款時,則是根據行動支付資訊或信用卡資料向對應的機關或銀行進行請款。In other embodiments, the payment account information may also be an action payment information or a credit card information. When the checkout device 40 is to make a payment, the payment is made to the corresponding institution or bank based on the action payment information or credit card information.
雖然本新型以前述之實施例揭露如上,然其並非用以限定本新型,任何熟習相像技術者,在不脫離本新型之精神和範圍內,當可作些許之更動與潤飾,因此本新型之專利保護範圍須視本說明書所附之申請專利範圍所界定者為準。Although the present invention is disclosed above in the foregoing embodiments, it is not intended to limit the present invention. Any one skilled in the art can make some modifications and retouchings without departing from the spirit and scope of the present invention. The scope of patent protection shall be subject to the definition of the scope of the patent application attached to this specification.
1‧‧‧智慧商店1‧‧‧Smart Store
10‧‧‧辨識進出裝置 10‧‧‧ID access device
11‧‧‧辨識攝影機 11‧‧‧ID camera
12‧‧‧匣門 12‧‧‧匣
13‧‧‧顯示裝置 13‧‧‧Display device
14‧‧‧控制器 14‧‧‧ Controller
20‧‧‧虛擬購物車模組 20‧‧‧Virtual Shopping Cart Module
30‧‧‧動態追蹤裝置 30‧‧‧Dynamic tracking device
31‧‧‧攝影機 31‧‧‧ camera
32‧‧‧處理器 32‧‧‧ processor
40‧‧‧結帳裝置 40‧‧‧Checkout device
41‧‧‧第一攝影機 41‧‧‧First camera
42‧‧‧第二攝影機 42‧‧‧Second camera
43‧‧‧觸控螢幕 43‧‧‧ touch screen
44‧‧‧控制模組 44‧‧‧Control Module
45‧‧‧結帳掃描區 45‧‧‧Checkout scanning area
50‧‧‧會員伺服器 50‧‧‧Member server
51‧‧‧資料庫 51‧‧‧Database
52‧‧‧驗證模組 52‧‧‧ verification module
60‧‧‧多媒體裝置 60‧‧‧Multimedia devices
[圖1] 為本新型一實施例智慧商店購物系統之示意圖; [圖2] 為本新型一實施例智慧商店購物系統之方塊示意圖; [圖3] 為本新型一實施例辨識進出裝置之示意圖;以及 [圖4] 為本新型一實施例結帳裝置之示意圖。1 is a schematic diagram of a smart shop shopping system according to an embodiment of the present invention; [FIG. 2] is a block diagram of a smart shop shopping system according to an embodiment of the present invention; [FIG. 3] FIG. 3 is a schematic diagram of a recognition access device according to an embodiment of the present invention; And [Fig. 4] is a schematic view of a checkout device of an embodiment of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107208961U TWM570489U (en) | 2018-07-02 | 2018-07-02 | Smart store shopping system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW107208961U TWM570489U (en) | 2018-07-02 | 2018-07-02 | Smart store shopping system |
Publications (1)
Publication Number | Publication Date |
---|---|
TWM570489U true TWM570489U (en) | 2018-11-21 |
Family
ID=65035456
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW107208961U TWM570489U (en) | 2018-07-02 | 2018-07-02 | Smart store shopping system |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWM570489U (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110390271A (en) * | 2019-06-28 | 2019-10-29 | 联想(北京)有限公司 | A kind of self-service method and apparatus |
CN111932329A (en) * | 2019-05-13 | 2020-11-13 | 庄连豪 | Visual image-taking shopping system and implementation method thereof |
TWI724530B (en) * | 2019-02-01 | 2021-04-11 | 開曼群島商創新先進技術有限公司 | Offline self-service settlement method, device and system |
-
2018
- 2018-07-02 TW TW107208961U patent/TWM570489U/en unknown
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI724530B (en) * | 2019-02-01 | 2021-04-11 | 開曼群島商創新先進技術有限公司 | Offline self-service settlement method, device and system |
CN111932329A (en) * | 2019-05-13 | 2020-11-13 | 庄连豪 | Visual image-taking shopping system and implementation method thereof |
CN110390271A (en) * | 2019-06-28 | 2019-10-29 | 联想(北京)有限公司 | A kind of self-service method and apparatus |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108780596B (en) | Information processing system | |
JP6653813B1 (en) | Information processing system | |
US20080040278A1 (en) | Image recognition authentication and advertising system | |
US20080040277A1 (en) | Image Recognition Authentication and Advertising Method | |
JP7225434B2 (en) | Information processing system | |
CN111222870B (en) | Settlement method, device and system | |
KR20200035800A (en) | System for security and automatic payment in manned or unmanned store | |
JP2016181100A (en) | Information processing system, commodity registration apparatus, settlement apparatus, information processing method, and program | |
JP7524388B2 (en) | Information processing device, store system, program | |
TWM570489U (en) | Smart store shopping system | |
TWM560067U (en) | Smart shop system | |
US20130338823A1 (en) | Vending system and method of selling commercial products | |
JP2006221515A (en) | Pos system | |
TWI760521B (en) | Smart store shopping system and purchasing method using thereof | |
CN108171286B (en) | Unmanned selling method and system | |
JP6836256B2 (en) | Information processing system | |
JP2023162229A (en) | Monitoring device and program | |
JP2023026684A (en) | Register system, gate system and device | |
JP2021179927A (en) | Sales system, settlement device and program | |
TW201933214A (en) | Smart store system and purchasing method using thereof | |
JP7582308B2 (en) | Store system, information processing device, information processing method, and program | |
JP7563573B2 (en) | Information processing device, information processing method, and program | |
US9390623B2 (en) | Time analysis at a banking system controlled by data bearing records | |
JP2020077275A (en) | Commodity settlement system, commodity conveying cart and commodity settlement method | |
US20230142558A1 (en) | Frictionless Retail Stores and Cabinets |