A self-checkout device is disclosed. The self-checkout device comprises a detection plate adapted to allow placement of product(s) thereon, and one or more cameras positioned to have a Field-of-View encompassing the detection plate, the one or more cameras configured to provide a video footage. The self-checkout device further comprises a motion detection module configured to detect presence of motion in the video footage; a sequence selection module configured to select a sequence of video frames over a time interval corresponding to the detection of the presence of motion in the video footage; an appearance interpretation module configured to register one or more products present in the sequence of video frames; a billing module configured to fetch prices of the registered one or more products, generate a total bill based on the fetched prices, and process a payment for the total bill; and a controller module facilitating communications therebetween.
Legal claims defining the scope of protection, as filed with the USPTO.
. A self-checkout device comprising:
. The self-checkout device of, wherein the appearance interpretation module comprises:
. The self-checkout device of, wherein the appearance interpretation module employs a machine learning model to facilitate the detection, cropping, embedding, and identifying processes.
. The self-checkout device of, wherein the expert system module is further configured to determine if any one of the identified one or more objects is a weight-dependent loose product item from the one or more products.
. The self-checkout device offurther comprising a weighing module configured to activate a weighing scale unit to measure a weight of the weight-dependent loose product item from the one or more products placed on the detection plate, and wherein the billing module is configured to generate the total bill based on the measured weight of the weight-dependent loose product item.
. The self-checkout device offurther comprising a barcode processing module configured to detect one or more barcodes in the selected sequences of video frames and decode the detected barcodes corresponding to the registered one or more products, and wherein the billing module is configured to fetch prices of the registered one or more products based on the decoded barcodes.
. The self-checkout device offurther comprising a guidance module operatively connected to a design display unit, the guidance module configured to activate the design display unit to display a design on the detection plate to provide visual guidance to a user for optimal placement of products on the detection plate.
. The self-checkout device offurther comprising a concave mounting member disposed upright with respect to the detection plate, wherein the one or more cameras are mounted on the concave mounting member.
. The self-checkout device of, wherein the concave mounting member houses an illumination device to illuminate the detection plate.
. The self-checkout device of, wherein the one or more cameras comprises a first camera and a second camera oriented at different angles to capture the video footage of the products from multiple perspectives.
. The self-checkout device of, wherein the billing module is further configured to generate an itemized list based on the registered one or more products.
. The self-checkout device offurther comprising a display screen configured to display the itemized list and the total bill.
. The self-checkout device offurther comprising an admin module configured to support updates to configuration of the self-checkout device, including a product database thereof.
. The self-checkout device of, wherein the self-checkout device operates as a standalone device.
. A method implemented by a self-checkout device, the method comprising:
. The method according tofurther comprising:
. The method according tofurther comprising:
. The method according tofurther comprising:
. The method according tofurther comprising receiving a payment for the total bill.
. A computer-program product having machine-readable instructions stored therein, which when executed by one or more processing units, cause the one or more processing units to perform a method according to.
Complete technical specification and implementation details from the patent document.
This application is a continuation of U.S. patent application Ser. No. 18/357,335 filed on Jul. 24, 2023, which claims priority to and the benefit of U.S. Provisional Patent Application Ser. No. 63/394,677, filed Aug. 3, 2022, the entire disclosure of which is hereby incorporated by reference.
The present disclosure generally relates to a self-checkout (SCO) device that allows customers to easily register one or more products, by placing the product(s) thereon, where the product(s) are each identified, their individual prices are determined and the total sum payable for the product(s) is calculated.
In a traditional retail environment, a customer selects various items for purchase and brings those items to a store clerk for checkout. Over the past few decades, retail point of sale systems have been greatly automated to expedite the checkout process. Computer-based point-of-sale systems are now the norm in the retail environment. However, in the end, such point-of-sale systems may still be operated by the store clerk. The labor hours attributable to servicing checkout counters contributes greatly to overall expense of a retail establishment. Reducing or eliminating the amount of time taken for the store clerk to handle and scan the goods purchased by a customer can substantially reduce the labor required in the retail establishment and thereby alleviate a currently growing problem.
Towards reducing operating expenses, some businesses have implemented self-checkout systems that substitute for store clerks at each checkout terminal. Self-checkout systems are terminals which are operated by a customer itself without the direct aid of the store clerk. The self-checkout system typically includes a barcode (RFID or other identifier) reader (also known as a scanner); a weighing scale for weighing items such as fruit and vegetables; and an interactive screen for choosing a product from a predefined list or entering a product code for a product that does not have a scannable identifier (for example fresh produce such as fruit, vegetables, meat, bakery items etc.). The self-checkout system typically further includes a payment system, usually accepting cash and card transactions (or other touchless payment mechanisms).
In the case of a fixed self-checkout system, the customer brings product(s) they wish to purchase to a fixed point in the store. The customer then presents the product(s) to the self-checkout system and causes the self-checkout system to register and thereby form a record of the presented product(s). Specifically, the customer presents each product individually to the self-checkout system, by either scanning each product individually with a self-checkout scanner (or a scanner gun of the self-checkout system if available) which detects and interprets identifiers (i.e., barcodes, RFID tags etc.) present on the product(s). The self-checkout system then consolidates the details of the registered items, computes the total cost, and facilitates the payment process for the customer.
That said, the existing self-checkout systems often still require a high degree of intervention from the store clerk. Further, the existing self-checkout systems suffers from various issues, such as, poor user interface, not being able to process multiple items at once, not able to guide the customer for positioning of items thereon, and the like. For example, in high-throughput sales environments such as convenience stores or express lanes at grocery stores or lunch or grab-and-go sections, customers are often in a hurry and need to register and pay for their products quickly. However, these same customers may present a plurality of products for registration by the self-checkout system. The necessity of separately registering each of these products introduces delays in the sales transaction. These delays are further exaggerated in the event a customer needs to register a product that do not have a scannable identifier, such as an item whose price depends on its weight like a bunch of bananas or a lunch-bowl. To register such presented product, a customer may be required to use a touchscreen component of the self-checkout system to manually search through one or more lists of products to find and select a matching product. Alternatively, the customer may use the touchscreen component to manually enter a product code for such presented product. In either case, the process of registering such a product can be quite slow and cumbersome. These delays are a significant inconvenience and potentially a deterrent for customers who are short of time and want to quickly pay for their purchases and move on.
The present disclosure has been made in view of such considerations, and it is an object of the present disclosure to provide a self-checkout device that creates a fast, easy, innovative experience for shoppers in convenience stores or express lanes at grocery stores, for example, lunch or grab-and-go sections, by reducing delays and inconvenience in high-throughput sales environments caused by the necessity of registering each of a plurality of products in a sales transaction.
In an aspect of the present disclosure, a self-checkout device is disclosed. The self-checkout device comprises a detection plate adapted to allow placement of product(s) thereon. The self-checkout device further comprises one or more cameras positioned to have a Field-of-View encompassing at least the detection plate, the one or more cameras configured to provide a video footage. The self-checkout device further comprises a motion detection module configured to detect presence of motion in the video footage; a sequence selection module configured to select a sequence of video frames over a time interval corresponding to the detection of the presence of motion in the video footage; an appearance interpretation module configured to register one or more products present in the sequence of video frames; a billing module configured to fetch prices of the registered one or more products, generate a total bill based on the fetched prices, and process a payment for the total bill; and a controller module operatively connected to the one or more cameras and communicatively coupled with the motion detection module, the sequence selection module, the appearance interpretation module and the billing module to control operations thereof and facilitating communications therebetween.
In one or more embodiments, the appearance interpretation module comprises an object detection module configured to analyze the sequence of video frames to detect one or more objects therein; a cropping module configured to isolate the detected one or more objects in the sequence of video frames and to extract visual features of the detected one or more objects; an embedding module configured to convert the extracted visual features of the detected one or more objects into an embedded feature vector; and an expert system module configured to compare the embedded feature vector with pre-stored feature vectors in an embedding database, and to identify the detected one or more objects based on the comparison. Herein, the identified one or more objects are registered as the one or more products.
In one or more embodiments, the expert system module is further configured to determine if any one of the identified one or more objects is a weight-dependent loose product item from the one or more products.
In one or more embodiments, the self-checkout device further comprises a weighing module configured to activate a weighing scale unit to measure a weight of the weight-dependent loose product item from the one or more products placed on the detection plate. Herein, the billing module is configured to generate the total bill based on the measured weight of the weight-dependent loose product item.
In one or more embodiments, the self-checkout device further comprises a barcode processing module configured to detect one or more barcodes in the selected sequences of video frames and decode the detected barcodes corresponding to the registered one or more products. Herein, the billing module is configured to fetch prices of the registered one or more products based on the decoded barcodes.
In one or more embodiments, the self-checkout device further comprises a guidance module operatively connected to a design display unit. The guidance module is configured to activate the design display unit to display a design on the detection plate to provide visual guidance to a user for optimal placement of product(s) on the detection plate.
In one or more embodiments, the self-checkout device further comprises a concave mounting member disposed upright with respect to the detection plate. Herein, the one or more cameras are mounted on the concave mounting member.
In one or more embodiments, the concave mounting member houses an illumination device to illuminate the detection plate.
In one or more embodiments, the one or more cameras comprises a first camera and a second camera oriented at different angles to capture the video footage of the product(s) from multiple perspectives.
In one or more embodiments, the billing module is further configured to generate an itemized list based on the registered one or more products.
In one or more embodiments, the self-checkout device further comprises a display screen configured to display the itemized list and the total bill.
In one or more embodiments, the self-checkout device further comprises an admin module configured to support updates to configuration of the self-checkout device, including a product database thereof.
In one or more embodiments, the appearance interpretation module employs a machine learning model to facilitate the detection, cropping, embedding, and identifying processes.
In one or more embodiments, the self-checkout device operates as a standalone device.
In another aspect, a method implemented by a self-checkout device is disclosed. The method comprises receiving, from one or more cameras, a video footage of a detection plate of the self-checkout device. The method further comprises detecting a presence of motion in the video footage by processing thereof. The method further comprises selecting a sequence of video frames over a time interval corresponding to the detection of the presence of motion in the video footage. The method further comprises detecting and decoding one or more barcodes visible in the sequence of video frames. The method further comprises calculating a total bill corresponding with the decoded one or more barcodes. The method further comprises displaying the total bill on a display screen of the self-checkout device.
In one or more embodiments, the method also comprises detecting items visible in the sequence of video frames in an event where one or more barcodes are not visible therein. The method further comprises distinguishing between sales items and non-sales items of the detected items. The method further comprises issuing a first alert on detection of one or more non-sales items, the first alert comprising a message to remove the non-sales items placed on the detection plate of the self-checkout device.
In one or more embodiments, the method also comprises determining a distribution of detected sales item(s) on the detection plate of the self-checkout device. The method further comprises issuing a second alert on detecting that the determined distribution of the detected sales item(s) is unsuitable.
In one or more embodiments, the method also comprises cropping from each of the plurality of video frames one or more regions substantially surrounding each detected sales item. The method further comprises generating from each of the cropped one or more regions, an embedding representation of the sales item visible therein. The method further comprises comparing the generated embedding representation with a record of embedding representations of products to find a matched record of embedded representations of products. The method further comprises determining a price corresponding with the matched record of embedded representations of products. The method further comprises calculating a total bill as sum of determined price corresponding with the matched record of embedded representations of products for all of the detected sales items. The method further comprises displaying the total bill on the display screen.
In one or more embodiments, the method also comprises receiving a payment for the total bill.
In another aspect, a computer-program product having machine-readable instructions stored therein is disclosed, which when executed by one or more processing units, cause the one or more processing units to perform steps of the aforementioned method.
The foregoing summary is illustrative only and is not intended to be in any way limiting. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features will become apparent by reference to the drawings and the following detailed description.
In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure. It will be apparent, however, to one skilled in the art that the present disclosure is not limited to these specific details.
Reference in this specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. The appearance of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Further, the terms “a” and “an” herein do not denote a limitation of quantity, but rather denote the presence of at least one of the referenced items. Moreover, various features are described which may be exhibited by some embodiments and not by others. Similarly, various requirements are described which may be requirements for some embodiments but not for other embodiments.
Unless specified otherwise in the following description, the terms “perform”, “calculate”, “computer-assisted”, “compute”, “establish”, “generate”, “configure”, “reconstruct”, and the like preferably relate to operations and/or processes and/or processing steps that change and/or generate data and/or convert the data into other data, wherein the data may be represented or be present in particular in the form of physical variables, for example in the form of electrical impulses. The expression “computer” should in particular be interpreted as broadly as possible in order in particular to cover all electronic devices having data processing properties. Computers may thus for example be personal computers, servers, programmable logic controllers (PLCs), hand-held computer systems, pocket PC devices, mobile radio devices and other communication devices able to process data in a computer-assisted manner, processors and other electronic data processing devices.
Moreover, in particular a (relevant) person skilled in the art, with knowledge of the method claim/method claims, is of course aware of all routine possibilities for realizing products or possibilities for implementation in the prior art, and so there is no need in particular for independent disclosure in the description. In particular, these customary realization variants known to the person skilled in the art can be realized exclusively by hardware (components) or exclusively by software (components). Alternatively and/or additionally, the person skilled in the art, within the scope of his/her expert ability, can choose to the greatest possible extent arbitrary combinations according to embodiments of the invention for hardware (components) and software (components) in order to implement realization variants according to embodiments of the invention.
Embodiments described herein may be discussed in the general context of computer-executable instructions residing on some form of computer-readable storage medium, such as program modules, executed by one or more computers or other devices. By way of example, and not limitation, computer-readable storage media may comprise non-transitory computer-readable storage media and communication media; non-transitory computer-readable media include all computer-readable media except for a transitory, propagating signal. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types. The functionality of the program modules may be combined or distributed as desired in various embodiments.
Some portions of the detailed description that follows are presented and discussed in terms of a process or method. Although steps and sequencing thereof are disclosed in figures herein describing the operations of this method, such steps and sequencing are exemplary. Embodiments are well suited to performing various other steps or variations of the steps recited in the flowchart of the figure herein, and in a sequence other than that depicted and described herein. Some portions of the detailed descriptions that follow are presented in terms of procedures, logic blocks, processing, and other symbolic representations of operations on data bits within a computer memory. These descriptions and representations are the means used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. In the present application, a procedure, logic block, process, or the like, is conceived to be a self-consistent sequence of steps or instructions leading to a desired result. The steps are those utilizing physical manipulations of physical quantities. Usually, although not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated in a computer system. It has proven convenient at times, principally for reasons of common usage, to refer to these signals as transactions, bits, values, elements, symbols, characters, samples, pixels, or the like.
In some implementations, any suitable computer usable or computer readable medium (or media) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer-usable, or computer-readable, storage medium (including a storage device associated with a computing device) may be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable medium may include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a digital versatile disk (DVD), a static random access memory (SRAM), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, a media such as those supporting the internet or an intranet, or a magnetic storage device. Note that the computer-usable or computer-readable medium could even be a suitable medium upon which the program is stored, scanned, compiled, interpreted, or otherwise processed in a suitable manner, if necessary, and then stored in a computer memory. In the context of the present disclosure, a computer-usable or computer-readable storage medium may be any tangible medium that can contain or store a program for use by or in connection with the instruction execution system, apparatus, or device.
In some implementations, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. In some implementations, such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. In some implementations, the computer readable program code may be transmitted using any appropriate medium, including but not limited to the internet, wireline, optical fiber cable, RF, etc. In some implementations, a computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
In some implementations, computer program code for carrying out operations of the present disclosure may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. However, the computer program code for carrying out operations of the present disclosure may also be written in conventional procedural programming languages, such as the “C” programming language, PASCAL, or similar programming languages, as well as in scripting languages such as JavaScript, PERL, or Python. In present implementations, the used language for training may be one of Python, Tensorflow, Bazel, C, C++. Further, decoder in user device (as will be discussed) may use C, C++ or any processor specific ISA. Furthermore, assembly code inside C/C++ may be utilized for specific operation. Also, ASR (automatic speech recognition) and G2P decoder along with entire user system can be run in embedded Linux (any distribution), Android, IOS, Windows, or the like, without any limitations. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the internet using an Internet Service Provider). In some implementations, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGAs) or other hardware accelerators, micro-controller units (MCUs), or programmable logic arrays (PLAs) may execute the computer readable program instructions/code by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present disclosure.
In some implementations, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus (systems), methods and computer program products according to various implementations of the present disclosure. Each block in the flowchart and/or block diagrams, and combinations of blocks in the flowchart and/or block diagrams, may represent a module, segment, or portion of code, which comprises one or more executable computer program instructions for implementing the specified logical function(s)/act(s). These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the computer program instructions, which may execute via the processor of the computer or other programmable data processing apparatus, create the ability to implement one or more of the functions/acts specified in the flowchart and/or block diagram block or blocks or combinations thereof. It should be noted that, in some implementations, the functions noted in the block(s) may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
In some implementations, these computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function/act specified in the flowchart and/or block diagram block or blocks or combinations thereof.
In some implementations, the computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed (not necessarily in a particular order) on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions/acts (not necessarily in a particular order) specified in the flowchart and/or block diagram block or blocks or combinations thereof.
Furthermore, in the following detailed description of the present disclosure, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure. However, it will be understood that the present disclosure may be practiced without these specific details. In other instances, well-known methods, procedures, components, and circuits have not been described in detail so as not to unnecessarily obscure aspects of the present disclosure.
Referring to, in combination, illustrated are different diagrammatic views of a self-checkout device, in accordance with one or more exemplary embodiments of the present disclosure. The self-checkout deviceis a device for use in a high-throughput sales environment and which is configured to provide an interface that allows customers to pay for services or goods without direct employee assistance (unless required). In case of use of the self-checkout device, the customer assumes responsibility for registering products they wish to purchase and then paying for them. For purposes of the present disclosure, the process of registering one or more products with the self-checkout devicerefers to the process by which each product is presented to the self-checkout deviceduring a transaction, to cause the self-checkout deviceto form a record of the presented product(s) and to calculate the total bill thereof. For further clarity, this process can be broken into a connected sequence of events, henceforth called episodes. For example, the process in which a customer registers one of their chosen products at the self-checkout devicewill be referred to henceforth as an “Product Registration Episode”; and the process in which the customer pays for all of the registered products will be referred to henceforth as a “Payment Episode”.
Also, for purposes of the present disclosure, products that do not have a scannable identifier will be referred to henceforth as “loose products”. For further clarity, a loose product item whose price depends on its weight will be referred to henceforth as a “weight-dependent loose product item”. For example, a weight-dependent loose product item could include a bunch of bananas or a lunch-bowl. A person skilled in the art will understand that the discussed examples of loose product items and weight-dependent loose product items are provided for explanation purposes only. In particular, a person skilled in the art will understand that the present disclosure is in no way limited to the above-mentioned examples. On the contrary, the present disclosure is operable to register any product item which does not possess a scannable identifier and whose price may or may not be dependent on the product item's weight. For consistency, the process of registering a loose product item will be referred to henceforth as a “Loose Product Registration Episode”.
As illustrated, the self-checkout deviceincludes a stand unitand an interaction unit. The interaction unitincludes a detection plateand a display screen(as better shown in). As illustrated in, the stand unitis coupled with the interaction unitin the self-checkout deviceof the present disclosure. In particular, as better shown in, the stand unitincludes a concave mounting member, a bottom endof which is mounted on a base member. As shown, the concave mounting memberis disposed upright with respect to the interaction unit(specifically, the detection platetherein). The base membermay include a stand mating structure (not shown) to permit the coupling of the stand unitwith the interaction unit, as described later in more detail. In the present examples, the concave mounting memberand the base memberare either or both formed from a metal or plastics material. Both the concave mounting memberand the base memberhas a non-reflective surface. Preferably, the surface of the concave mounting memberand the base memberis light absorbing. Even more preferably, surfaces of the concave mounting memberand the base memberis black in color.
Referring to, illustrated is an exploded view of the stand unitshowing various components thereof, in accordance with one or more exemplary embodiments of the present disclosure. As shown, an inner surfaceof the concave mounting memberprovides a recess which is configured to house an illumination device (not shown). In an example, the illumination device may include a plurality of light emitting diodes (LEDs). Preferably, the illumination device includes a plurality of RGB (red, green, blue) LEDs to increase the illumination of components proximal thereto (such as, the interaction unitand more specifically the detection plate(as shown in) and product(s) placed thereon (as will be discussed later)). In the present configuration, the illumination device is further configured to reduce glare and impact of ambient lighting in the environment around the self-checkout device. The stand unitfurther includes a light diffusing case member. As illustrated, the light diffusing case memberis concave in shape. Herein, the curvature of the light diffusing case membersubstantially matches that of the concave mounting member. In an example, the light diffusing case memberis formed from any of a polycarbonate, acrylic or polymethyl methacrylate (PMMA), polystyrene or other suitable plastics material. The light diffusing case memberis preferably white in color and may be provided with an opal or translucent surface finish. The skilled person will acknowledge that the above materials and surface finishes for the light diffusing case memberare provided for explanation purposes only. In particular, the skilled person will acknowledge that the self-checkout deviceof the present disclosure is in no way limited to the use of these materials or surface finishes for the light diffusing case member. On the contrary, the present disclosure is operable with any material or surface finish which permits the diffusing of the light from the illumination device. In use, the light diffusing case memberis mounted on the inner surfaceof the concave mounting memberso that the light diffusing case membereffectively forms a cap on the top of the inner surfaceof the concave mounting member. In this way, the illumination device is sandwiched between the inner surfaceof the concave mounting memberand the light diffusing case member. Thus, the illumination device effectively forms a back-lighting member for the light diffusing case member.
Further, as illustrated, the stand unitincludes one or more cameras. Specifically, the one or more cameras includes a first cameraand a second cameraoriented at different angles to capture the video footage of the product(s) from multiple perspectives. In general, the cameras,are positioned to have a Field-of-View encompassing at least the detection plateof the interaction unit. In the present configuration, the first camerais mounted on the inner surfaceof the concave mounting memberat an upper endthereof. Specifically, the first camerais mounted on the concave mounting memberin a downwards facing orientation so that its Field-of-View encompasses a top-down view of a region beneath it and one or more objects contained in that region. Preferably the first camerais an RGB-D camera. For example, the first cameramay include a time-of-flight (TOF) sensor, a structured light sensor or a stereoscopy sensor. The skilled person will acknowledge that the above examples are provided for illustration purposes only. In particular, the skilled person will acknowledge that the self-checkout device of the present disclosure is not limited to the above examples. On the contrary, the present disclosure is operable with any one or more sensors whose output signals provide a three dimensional representation of a viewed scene. Further, preferably, the first camerahas a 4K or comparable resolution. Also, preferably, the first cameraincludes an effective autofocus facility. Further, the second camerais mounted on the inner surfaceof the concave mounting memberat an elevation approximately half-way between that of the upper endand the bottom endof the concave mounting member. In such case, the light diffusing case memberis provided with an aperturewhich is disposed at a position substantially matching that of the second camera, when the light diffusing case memberis mounted on the concave mounting member. Herein, the apertureensures that the view of the second camerais not obscured by the light diffusing case member. Preferably, the second cameraincludes an RGB camera. Further preferably, the second camerahas a 4K or comparable resolution. Further, preferably, the second camerahas an effective autofocus facility.
Referring to, in combination, the base memberof the stand unitis mechanically coupled with the interaction unit. Specifically, the base memberis attachable to any one of sides of the interaction unitby a reciprocal mating structure (not shown) including a stand unit mating structure (not shown) and a corresponding interaction unit mating structure (not shown) respectively formed in the base memberand the said one or more of the sides of the interaction unit. The reciprocal mating structure may include one or more of a tongue and groove arrangement between corresponding sides of the base memberand the interaction unit; or a slot or other recess in any one or more of the sides of the interaction unit, the slot or recess being configured to receive at least part of a corresponding side of the base member. The skilled person will understand that the above coupling means are provided for explanation purposes only. In particular, the skilled person will understand that the present disclosure is not limited to the above coupling mechanisms. On the contrary, the present disclosure is operable with any mechanism for coupling the base memberwith the interaction unitwhich is sufficiently robust to hold the base memberin a fixed position relative to the interaction unitfor prolonged periods and on receipt of knocks and bumps from users of the self-checkout deviceand objects being positioned on the interaction unit. It will also be recognized that the coupling of the base memberwith the interaction unitneed not be achieved mechanically. Instead, the base membermay, for example, be magnetically coupled with the interaction unit. The coupling mechanism is further configured so that, when coupled with the interaction unit, the base memberis oriented so that the arc of the concave mounting memberis curved inwards towards the interaction unit. Herein, the said interaction unit mating structure includes an interaction unit contact point (not shown), which is configured such that the coupling of the interaction unitwith the base membercauses the said interaction unit contact point to contact a stand unit contact point (not shown) mounted on an outer surface of the base memberat the said stand unit mating structure, to support electrical and communication coupling between the cameras,of the stand unitand a control circuit (to be described later) of the base member. Further, the cameras,and the illumination device are respectively communicably and electrically coupled with the said stand unit contact point.
In another embodiment, the concave mounting membermay include two spaced apart substantially matching arcuate members (not shown) mounted in parallel in upright positions from the interaction unit. The arcuate members are joined periodically by a plurality of cross-bars (not shown) to provide support and structural reinforcement and stability to the two arcuate members. In the present embodiment, the cameras,are respectively supported on an upper and mid-elevation of the cross-bars.
Referring now to, illustrated is a depiction of the self-checkout device, in accordance with an alternate embodiment of the present disclosure. As shown in, the self-checkout devicemay have the stand unitmounted on a lateral side (herein, left side) of the interaction unitin contrast to a rear side of the self-checkout device(as shown and explained in reference to). In yet another embodiment, two stand unitsmay be provided (not illustrated) which may be mechanically coupled with the interaction unit. Specifically, the base memberof each of two stand unitsare attachable to any two one or more of the sides of the interaction unitby one or more reciprocal mating structures including the stand unit mating structure of each stand unit and a corresponding interaction unit mating structure respectively formed in the base memberand any two of one or more of the sides of the interaction unit. As discussed, the interaction unit mating structure includes the interaction unit contact point, which, in this case, is configured such that the coupling of the interaction unitwith the two base memberscauses the interaction unit contact point to contact each of the stand unit contact points, to support electrical and communication coupling between the cameras of the two stand unitsand the control circuits (to be described later) of the two base members. This embodiment is particularly useful in difficult ambient conditions (lighting, glare, extraneous elements, etc.), as it doubles the number of cameras of the self-checkout deviceand increases the amount and variety of illumination thereof. This improves the reliability of detecting products placed on the self-checkout deviceby at least 10%.
illustrates an exploded view of the interaction unitshowing various components thereof, in accordance with one or more exemplary embodiments of the present disclosure. Referring to, in combination with, as shown, the interaction unitincludes the detection plateand the display screen. Herein, the detection plateis adapted to allow placement of product(s) thereon. In one example, an upper surface of the detection plateis configured to be square shaped with dimensions of 39 cm by 39 cm. However, the skilled person will acknowledge that the above configuration of the upper surface of the detection plateis provided for explanation purposes only. In particular, the skilled person will acknowledge that the self-checkout deviceof the present disclosure is not limited to the above-mentioned configuration of the upper surface of the detection plate. On the contrary, the present disclosure is operable with any size or shape of the upper surface of the detection platesufficient to accommodate the placement thereon of a plurality of products (not shown) without their being stacked on top of each other or their crowding so that a view by the cameras,for identifying feature(s) of a product is not occluded by the other products. For example, the detection platemay have an increased size, such as 50 cm by 50 cm, to accommodate more products thereon, without departing from the spirit and the scope of the present disclosure.
Unknown
October 23, 2025
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.