Automated Retail Store and System

This application is a divisional of U.S. application Ser. No. 18/044,933, filed Mar. 10, 2023, which is a national phase application of PCT/CN2021/127961, filed Nov. 1, 2021, which claims priority to and the benefit of Hong Kong Application No. 22021036045.3, filed Aug. 4, 2021, each of which is incorporated herein in its entirety.

The present invention relates to an unmanned store, and in particular, an automated storage and retailing system for providing scheduled handling of customer orders at a single retail site (e.g. at a shop location or retail facility).

Retail stores are an essential part of our society, allowing consumers to easily purchase goods they need for everyday life. However, the density of items stocked in a typical store is not efficiently optimised. For example, the height of shelves is typically only the reachable height of a typical customer, and extra aisle space needs to be reserved for customer walkways. Thus, the physical and space constraints of a store places limitations on the range, quantity and type of items that the store can offer to customers, and also affects the customer's shopping experience.

As customers adapt to changing circumstances and priorities, customer purchaser behaviour has evolved with a growing emphasis on availability, flexibility and convenience. In particular, customers value the choice of buying from a wide range of quality items, receiving their purchased items as soon as possible, and to make a purchase in a way (and at a time) that is easy and most convenient for the customer. Traditional physical stores run by staff can only satisfy some of these objectives. For example, it is almost impossible to run a store continuously 24 hours a day without needing extra staff, which adds to cost.

Online shopping sites provide an alternative shopping experience. Customers can remotely order from a wide selection of items (anywhere and at any time) through an online shopping platform. However, some human involvement is still required in the fulfilment process (e.g. to pick, pack or deliver the ordered items), which if not properly managed, can result in errors or delay.

Various automated shop solutions have been proposed. For example, Robomart Inc. has created an autonomous grocery store on wheels that offers customers the ability to pick their own groceries at home checkout-free. But the variety of groceries are limited by vehicle size and this retail business is limited by the traffic development of the city, for instance, underdeveloped roads and busy traffic. Amazon Go and 7-Eleven Signature are examples of stores that have automated the check-out process. It offers customers to walk around the shop, select and purchase groceries without requiring a cashier system. But it still requires manpower to refill, re-stock groceries to shelves and to remove the expired groceries from shelves.

Various kinds of automated convenience store have also been proposed, which generally are either robotic vending machines or vending machines that are integrated with a number of robotic components. It only offers customers instant shopping service to pick their items (e.g. soft drinks, groceries), but still requires manpower to re-stock groceries to shelves and to remove the expired groceries from shelves.

The present invention aims to address one or more of the above problems.

According to one aspect of the present invention, there is provided a retail system including:

According to another aspect of the present invention, there is provided an automated retail store system for providing automated storage of multiple items and scheduled handling of a customer order for said items at a single retail site, including:

Preferably, the automated retail store system is adapted to make use of an innovative rack storage system, robotics, 3D-vision, locker system, and backend software to sort, store, retrieve, restock merchandise items as well as to manage inventory of the system.

According to another aspect of the present invention, there is provided a retail site having an automated retail store system as described above.

According to another aspect of the present invention, there is provided a retail management system including:

The present invention differs from both the vending machine automated store, and the above mentioned automated retail concept. This present invention requires neither service personnel nor cashiers in the store, the purchase orders are completed by smartphone-related technologies and automation is applied to replace the traditional features of a store.

The present invention is truly unmanned, robotic and fully-automated to recognize, sort, refill, re-stock all groceries into the pre-defined shelves and are stored as first-in first-out (FIFO) principle. All purchased/ordered groceries are retrieved from different shelves and are gathered to the customer e-locker using fully automated robotic technology.

On store stock management, the unmanned store periodically performs stock check on all the stock in the system. Items which have expired (or are close to expiry) can be automatically retrieved from shelves to a reject container box automatically.

is a block diagram of a retail systemaccording to a representative embodiment of the present invention. The retail systemcomprises of a retail management systemthat communicates with and controls one or more automated retail store systemstoover a communications network. Each automated retail store systemis setup at a single retail site and may be configured to operate as a single autonomous automated store. Preferably, each retail site is at a different location that is physically spaced apart from each other. A retail site refers to a physical location at which items from a single automated retail store systemcan be purchased and retrieved. For example, a single automated retail storemay be configured to operate within a predefined retail space (such as the space in commercial premises that can be used to operate a traditional shop or store). The physical components of each automated retail store systemcan be configured to maximise the use of such retail space.

In this specification, a communications network (e.g.,,) refers to any means of wired or wireless data communications between two or more electronic devices (e.g. between the retail management systemand automated retail store system). For example, the communications networkmay include one or more of a public network (e.g. the Internet), a private network (e.g. a virtual private network), a wide area network (WAN), public switched telephone network (PSTN), a mobile telecommunications network (e.g. a GSM™, CDMA™, UMTS™, LTE™, LTE-A™ network), and a direct physical connection or communications channel that enable data communications between different electronic devices. In, items,,may refer to different communications networks, or to different communication paths over the same communications network.

According to one aspect of the present invention as shown in, there is provided a retail management systemconfigured for receiving customer orders via a communications network. The retail management systemis also configured for controlling one or more automated retail store systemsto fulfil such customer orders in the manner described below.

According to a representative embodiment of the invention as shown in, the retail management systemmay include the following components: an automated retail store management system, an inventory material exchange system (IMAX), an order information exchange system (OIX), one or more courier client devices, an online shopping platform, one or more customer client devices, a user management systemand an electronic payment system. These components may be configured to implement one or more of the following features described below according to different exemplary aspects of different representative embodiments of the present invention.

According to one exemplary embodiment, the retail management systemincludes an online shopping platformthat is configured to provide an online store (or online ordering system). The online shopping platformincludes a content management system (CMS) (including a management platform) for providing an online store from which customers can browse items that customers can order from the online store, and browse sales promotions relating to one or more of such items. The online shopping platformcommunicates with one or more customer client devices(e.g. a personal electronic device such as a mobile phone, computing tablet or personal computer) which a customer uses to interact with the online shopping platform. A customer may control an application (e.g. an online shopping application or web browser) on the customer client deviceto view and order items from the online shopping platform. For example, this may involve the customer providing user input to the application on the customer client devicefor requesting information on one or more items from the online shopping platform. The online shopping platformis configured to respond such a request by providing item information to the application, which the application uses to generate a user interface display on the customer client deviceto present information on the one or more requested items that can be ordered via the online shopping platform. The application on the customer client deviceis configured to receive further user input from the customer representing a selection of one or more items that the customer wishes to order using the online shopping platform. Such items can be items from either a specific automated retail store systemthat is adapted to store a variety of different items and/or from a network of one or more supply warehouses or physical retail stores (together referred to as the supply warehouse) from which such the ordered items can be shipped.

In the context of the present invention, an item refers to a physical object that can be ordered from an automated retail store system. For example, an item could be any consumable product that is independently packaged as a single unit that can be individually transported, retrieved and/or dispensed (e.g. a carton of milk, a canned beverage, a bag of rice, etc.). In the context of the present invention, an order represents a set of one or more items that a customer has selected and purchased using the online shopping platform.

According to one representative embodiment of the invention, in the process of the customer placing an order via the online shopping platform, the customer may select to browse items and/or order items only from a selected automated retail store system. In such a scenario, the online shopping platformmay be configured to perform a stock availability checking process to determine the items and their current quantities available at the selected automated retail store system. The online shopping platformmay be configured so that (based on the stock availability checking process) customers can only order quantities of items that are actually available at the selected automated retail store system. For example, if the selected automated retail store systemhas only six units of a particular item, the combined orders from one or more customers for that item from the selected automated retail storemust not exceed six units for that particular item. Preferably, the stock availability checking process is performed when the online shopping platformgenerates and provides item information in response to a request (e.g. from a customer client device) for information on one or more items from the online shopping platform. The stock availability checking process may be also be performed during (or at any time before) a customer attempts to add a selected quantity of a selected item to the customer's order. The online shopping platformwill require the customer to provide a pickup time at which the customer will retrieve the ordered items from the selected automated retail store.

Alternatively, according to another representative embodiment, the online shopping platformmay be configured such that customers are not limited to ordering quantities of items that are actually available at the selected automated retail store systemat the time of placing the order. Instead, the combined orders from customers for a particular item from the selected automated retail storemay exceed the actual quantity of such items at the selected automated retail store. The online shopping platformmay be configured to perform a stock availability checking process as described above. If the online shopping platformreceives a customer's order where the required quantity for an ordered item exceeds the actual quantity of that item at the selected automated retail store(e.g. determined by the stock availability checking process), the online shopping platformmay be configured to retrieve a restocking time estimate (e.g. generated by the automated retail store management system) representing an estimated amount of time required for restocking at least the required quantity of the ordered item to the selected automated retail store system. The online shopping platformmay be configured to perform a pickup time checking process to determine whether the pickup time provided by the customer would occur before the time required to restock at least the required quantity of the ordered item to the selected automated retail store system, and if so, the online shopping platformmay be configured to prompt the customer to select a later pickup time.

According to yet another representative embodiment of the invention, in the process of the customer placing an order via the online shopping platform, the customer may browse and/or order any items available via the online shopping platform(i.e. not limited to items available from any particular automated retail store system). The online shopping platformmay be configured to perform a stock availability checking process to determine the items and their current quantities available at the supply warehouse. In such a scenario, the online shopping platformis configured so that the quantities of items that can be ordered correspond to the quantities of those items actually available from the supply warehouse.

According to yet another representative embodiment of the invention, in the process of the customer placing an order via the online shopping platform, the customer may order items using an approach described in any one or more of the above representative embodiments. For example, some of the ordered items (e.g. items which a customer requires urgently) may be ordered for pickup from a selected automated retail store system, while the remaining ordered items (e.g. less urgent or bulky items) are ordered for delivery from the supply warehouse to the customer.

In the above scenarios, the stock availability checking process involves the online shopping platformcommunicating with the automated retail store management systemto determine (e.g. based on stock data retrieved from the IMAX) a quantity of a selected item that is currently available at a selected automated retail store systemor in the supply warehouse. The IMAXincludes a database that stores stock data representing a currently available quantity (e.g. number of units) of each item at a particular supply location (e.g. an automated retail store systemor the supply warehouse). Preferably, each item is represented by a unique item identifier (e.g. item number). Preferably, each supply location is represented by a unique store or location identifier (e.g. a store number). The IMAXmanages the inventory of items in each of the automated retail stores systemand also the inventory items in a network of one or more supply warehouses or physical retail stores (collectively referred to as a supply warehouse). The automated retail store management systemcommunicates with the IMAXto send and receive stock movement information of inventory from all (or at least one or more of) the automated retail store systemsof the retail system.

In the process of placing an order using the online shopping platform, the customer uses a customer client deviceto select one or more items to be ordered, which are temporarily added to a virtual shopping cart such that the selected items are associated with a unique identifier for the customer's order. Once a customer has finished selecting the items to be order, the online shopping platformgenerates and transmits order information to the automated retail store management system. Preferably, the order information for each customer order includes one or more of the following:

Preferably, according to one representative embodiment, any items in the order that are associated with a unique store identifier are treated as an order for items from the selected automated retail store systemassociated with that unique store identifier. This association is determined based on customer input provided in the process of the customer placing an order via the online shopping platform. The selected automated retail store systemwill retrieve such ordered items before the pickup time, an example of which will be described in more detail below.

, according to one representative embodiment, any items in the order that are not associated with a unique store identifier are treated as an order for items from the supply warehouse. This is also determined based on customer input provided in the process of the customer placing an order via the online shopping platform. Such items will be fulfilled by the supply warehouse and shipped to a delivery location specified by the customer.

The online shopping platformcommunicates with the user management systemto carry out a customer verification process. According to one representative embodiment of the invention, this verification process preferably begins by the online shopping platformproviding the customer identification information (e.g. a unique user identification number obtained based on input from the customer and/or information received from a customer client devicecontrolled by the customer) to the user management systemto verify an identity of the customer. The verification process may request further verification information from the customer (e.g. ask the customer to provide a username and/or password associated with the user identification number, request the customer to provide a confirmation code sequence or click on a verification URL link that has been separately sent to a previously verified email address or mobile phone number of the customer). Once an identity of the customer has been verified, the online shopping platformcommunicates with the customer client deviceto obtain payment information from the customer for the ordered items. The customer may provide payment information (e.g. credit card number) via the customer client device, or alternatively, direct the online shopping platformto retrieve such payment information stored as part of a user profile in association with the customer's identification information. The online shopping platformthen communicates with the electronic payment systemto process the customer's payment information for the items ordered.

According to one representative embodiment of the invention, after the electronic payment systemhas successfully processed the customer's payment information for the order, the online shopping platformsends the order information to the automated retail store management systemto process the order. The automated retail store management systemprovides centralised control of all (or at least one or more of) the automated retail store systemsof the retail system. The automated retail store management systemis configured to perform one or more of the following operations: (i) analyse order information received from the online shopping platform; (ii) generate, based on the order information received, control data and/or signals representing one or more executable jobs for each automated retail store systems; (iii) calculate the restock quantities and schedules for all (or at least one or more of) the automated retail store systemsof the retail system; (iv) serve as a communications bridge between the automated retail store systemsof the retail systemand any outside systems.

If the automated retail store management systemdetermines that the received order information for a customer's order includes one or more ordered items to be picked up from a selected automated retail store system, the automated retail store management systemgenerates (based on the order information) control data and/or signals representing one or more control messages for controlling one or more operations performed by the selected automated retail store system. Each control message includes information representing one or more predefined executable jobs, where each executable job refers to a set of one or more instructions and/or control signals for controlling the operation(s) of one or more internal components of the selected automated retail store systemto perform a predetermined task (or alternatively, a predetermined sequence of multiple predetermined tasks). For example, an executable job may include instructions and/or control signals for controlling a store control systemto control the retrieval systemto retrieve a specified quantity of a particular item from the corresponding storage channel of storage shelf,,,and place the retrieve item(s) into one or more available (e.g. empty) delivery containers. Another executable job may be for controlling the store control systemto control the conveyor systemto move a delivery container to an available compartment in the storage rackor customer locker compartment. Another executable job may be for controlling the store control systemto control a state of an access barrier for providing access to a customer locker compartment.

The automated retail store management systemsends the generated one or more control messages to the selected automated retail store systemidentified in the order information. The store control systemof the selected automated retail store system, in response to receiving the order information, controls the operation of one or more internal components of the selected automated retail store systemto perform one or more specific actions (e.g. mechanical actions, receive sensor data input etc.) corresponding to each predetermined task in each executable job. For example, based on the control message(s) received, the selected automated retail store systemmay be controlled to retrieve the items identified in the order information and place the retrieved items into one or more delivery containers for the customer to pickup from the selected automated retail store systembefore (e.g. by or within a predetermined period of time before) the pickup time indicated in the order information.

According to one representative embodiment of the invention, the automated retail store management systemmay determine (e.g. based on stock data received from the IMAXand/or response messages received from the store control systemof a selected automated retail store system) whether a selected automated retail store systemdoes not have all of the ordered items, or does not have sufficient quantities of one or more ordered items, or request one or more items to be restocked in the system(i.e. shortfall items). Based on the above data/messages, the automated retail store management systemdetermines an availability of one or more of such shortfall items from an alternative supply location such as the supply warehouse and/or from one or more other automated retail store systemsproximate to (e.g. with a predetermined travel time or travel distance from) the selected automated retail store system.

For example, according to a representative embodiment of the invention:

The automated retail store management systemthen selects one or more of the above delivery options (a), (b), (c) or (d) that can deliver the shortfall items to the selected automated retail store systembefore the pickup time in the order information. The automated retail store management systemthen further selects one or more of the selected delivery options based on predetermined criteria (e.g. based on item availability in, delivery time from, and/or travel distance from the alternative supply location for each selected delivery option), and for each delivery option generates suborder information for the supply warehouse and/or the relevant automated retail store systemto retrieve the required quantities of the order items to fulfil the customer's order. Each said suborder information may include a scheduled pickup time (set before the pickup time in said order) for a courier to pickup from the alternative supply location the items retrieved based on the suborder information by the scheduled pickup time, and load these items into the selected automated retail store systembefore the pickup time.

The automated retail store management systemalso generates delivery instructions that are transmitted to a courier client device. The delivery instructions configure the courier client device(e.g. through a courier application installed on the courier client device) to display delivery information for a courier to pickup the shortfall items from the locations identified in selected delivery option, and deliver these items to the selected automated retail store systembefore the pickup time in the order information selected by the customer.

If the automated retail store management systemdetermines (e.g. based on stock data for a particular item received from the IMAX, and/or response messages received from a selected automated retail store systemrepresenting a restock request for one or more specific item(s) or indicating a quantity of a specific item in that store) that a quantity of any particular item at the selected automated retail store systemis less than a predetermined threshold stock level for that item, the automated retail store management systemgenerates and sends to the supply warehouse a restock request message containing restock order information representing one or more items (and a restocking quantity for each such item) for restocking the selected automated retail store system. For example, the threshold stock level may be a predetermined quantity of an item (e.g. a minimum number of units or percentage of stock) that should be available at the selected automated retail store system. The restocking quantity of an item may be determined based on information obtained from the IMAX, such as a current quantity of that item available at the selected automated retail store systemand/or a predetermined (e.g. maximum) quantity of that item which can be stored at the selected automated retail store system. Preferably, the automated retail store management systemdetermines whether restocking of any items at a selected automated retail store systemis required (in the manner described above) on a periodic basis (e.g. on a daily or weekly basis or according to a predetermined schedule).

When the supply warehouse is ready to deliver the items specified in a restock request message (referred to as restock items) to the selected automated retail store system, the supply warehouse updates the information stored in the OIXto include details of the restock items delivered from the supply warehouse to the selected automated retail store system(referred to as a restock delivery).

The automated retail store management systemmay generate restocking instructions that are sent to the courier client deviceof a courier assigned to deliver the restock items to the selected automated retail store system. The restocking instructions may include: (i) delivery information for configuring a user interface of a courier client device(e.g. through a courier application installed on the courier client device) to display directions or instructions for a courier to pickup and deliver specific restocking items to the selected automated retail store system; and/or (ii) item organisation information for configuring a user interface of a courier client device(e.g. through a courier application installed on the courier client device) to display to the courier directions or instructions for preparing or reorganising one or more of the items being delivered for restocking the selected automated retail store system. For example, if the OIXindicates that a restock delivery includes two 6-packs of soft drink, but the selected automated retail store systemonly requires 8 units of the soft drink to be restocked, the reorganised item information (in this example) could include directions or instructions for the courier to disassemble the two 6-packs of soft drink and only provide the required number of units for restocking that item at the selected automated retail store system. The item organisation information for each item in a restock delivery may be generated based on a quantity of that item at the selected store(obtained from the IMAX) and the quantity and packaging of the restock items being delivered to the selected automated retail store systemin a restock delivery (obtained from the OIX).

The courier application on the courier client devicealso provides an interface for providing the one or more of the following kinds of instructions to a courier (e.g. based on information from the automated retail store management system, IMAXand/or OIX): (i) sorting and/or organising the restock items in different delivery or restocking containers; (ii) remote control to operate an access barrier (e.g. a door) to a locker compartment at an automated retail store system; and (iii) to retrieve containers (e.g. delivery containers, restocking containers, reject containers, etc.) and items from an automated retail store systemback to the supply warehouse.

The courier application can interact with different systems of the retail management systemas follows: (i) receive, from the automated retail store management system, restock order information to execute a restock delivery; (ii) send reorganised item information to the automated retail store management systemfor updating the IMAX(where the courier provides reorganised item information representing a quantity or number of units of each restock item actually provided to restock a particular automated retail store system); (iii) send instructions to the automated retail store management systemfor operating an access barrier of an automated retail store system; and (iv) receive instructions from the automated retail store management systemto return containers and related items to the warehouse.

According to one representative embodiment of the invention, if the automated retail store management systemreceives a request from a specific automated retail store systemto restock a particular item, or determines that after fulfilling a particular customer order a particular item in a specific automated retail store systemwill need to be restocked, the automated retail store management systemsends a restock request message to the supply warehouse representing one or more items to be restocked.

Preferably, when the supply warehouse receives a restock request message from the automated retail store management system, the supply warehouse arranges the purchase of additional items for the supply warehouse, or to retrieve existing items stored in the supply warehouse corresponding to the items identified in the restock request message. The automated retail store management systemmanages the restocking of items for each automated retail store systembased on information received from the OIX. The OIXcommunicates with an inventory management system of the supply warehouse and provides an interface for the automated retail store management systemto receive updates on status of items identified in the restock message that have been ordered. The OIXmay generate and send a restock response message to the automated retail store management systembased on the restock order information (e.g. setting out the items in the restock request message that have been ordered or retrieved, delivery dates of ordered items, etc.). The OIXmay generate and send a response message to the automated retail store management systemwhen the items in the restock request message have arrived (or have been retrieved) and are ready for delivery to a specified automated retail store system. The automated retail store management system, in response to receiving such a restock response message from the OIX, may then generate delivery information that are transmitted to a courier client device. The delivery information configures the courier client deviceto display delivery directions or instructions for a courier to pickup the items to be restocked from the supply warehouse and deliver to a specified automated retail store system.

Preferably, the automated retail store management system, IMAX, OIX, online shopping platform, user management system, electronic payment systemand store control systemmay each be implemented by one or more data processing or control components on separate servers, or on the same server. Each such component may be implemented either in the form of: (i) one or more software modules corresponding to a set of computer-readable instructions stored in memoryfor controlling the operation of a processorto implement methods and processes according to the present invention; or (ii) data processing circuitry/components (e.g. a microcontroller, ASIC or FPGA) adapted to implement methods and processes according to the present invention; or (iii) a combination of software modules and data processing circuitry/components as described above that work in cooperation with each other to implement the methods and processes according to the present invention.

A server refers to a dedicated computer (e.g. with an exemplary internal structure as shown in) that is adapted to handle significant volumes of data processing and exchange between internal components of the computer as well as with other devices or clients (e.g.,) or systems (e.g.) over a communications network,,. A server also refers to a plurality of dedicated computers (as described above) that are adapted to communicate with each other and work together as a single apparatus. A server includes suitable operating system software (e.g. Microsoft™ Windows Server™, Ubuntu™, Red Hat™ Enterprise Linux™, or the like) to handle network communications as well as data communications and coordination between internal components of the server.

A client (e.g.,) refers to any electronic device that can communicate with a server over a communications network/. For example, a client may include a conventional personal computer (e.g. with an exemplary internal structure as shown in), mobile phone, personal digital assistant, tablet computing device, or a similar or equivalent device. The client includes suitable operating system software (e.g. Microsoft™ Windows™, MacOS™, iOS™, Android™, or the like) to handle network communications as well as data communications and coordination between internal components of the client.

According to one representative embodiment of the invention, the retail management systemconsists of an automated retail store management systemconfigured to communicate with and control one or more automated retail store systemsto.

According to another representative embodiment of the invention, the retail management systemincludes at least one automated retail store management system, each configured to communicate with and control a different group of one or more different automated retail store systemsto. Preferably, the above automated retail store management systemis configured to communicate with and control one or both of an IMAXand OIX. Preferably, the above automated retail store management systemis configured to communicate with one or more courier client devicesvia a communications network.