Method and System for Determining a Position of a Plurality of Lidar Sensors for Industrial Risky Zones

The present disclosure is directed, in general, to computer-aided design, visualization, and manufacturing (“CAD”) systems, product lifecycle management (“PLM”) systems, product data management (“PDM”) systems, production environment simulation, and similar systems, that manage data for products and other items (collectively, “Product Data Management” systems or PDM systems). These systems may include components that facilitate the design and simulated testing of product structures and product manufacture.

In industrial manufacturing, many facilities are often densely “populated” for example by several robots, by other pieces of equipment and by moving or mobile entities e.g. like humans or AGV vehicles. The hazards for mobile entities and for equipment is a well-known critical issue. In order to prevent such hazards, the typical traditional solution consists in erecting safety fences around the risky zones of industrial facilities.

Modern industry is trying to remove the need of such safety fences for example by employing smaller and slower robots or by using new technological means for the big and powerful robots.

For example, light-detection and ranging (“Lidar or LiDAR”) sensors can be employed for safety coverage so that traditional fences can be removed. Lidar sensors positioned along risky zone boundaries can be used to detect the passage of a mobile entity across such risky zones and activate correspondent emergency actions e.g. such signaling, ringing alarms, generating emergency stop signal, robot stopping etc.

However, risky zones usually contain moving and fixed industrial objects which may block the detection coverage of the Lidar sensors. Therefore, unfortunately, current known techniques do not provide industrial workers with reliable and optimal solutions for determining where to position the Lidar sensors on the risky zone boundary for Lidar-based safety setups.

Improved techniques for determining the positions of Lidar sensors for reliably detecting risky zone crossings in industrial environments are desirable.

Various disclosed embodiments include methods, systems, and computer readable mediums for determining a position of a plurality of Lidar sensors for reliably detecting a crossing of a risky zone in an industrial environment; wherein the risky zone comprises a set of moving objects and a set of fixed objects and wherein a crossing of the risky zone by a mobile entity has to be detected by at least one Lidar sensor. A method includes receiving data on the geometry of the risky zone on whose boundary the plurality of sensors are to be positioned, data on the set of moving objects within the zone and data on the set of fixed objects within the zone. The method further includes receiving data on a total swept volume combining all swept volumes of all motion operations of all moving objects of the cell. The method further includes receiving data on a minimal size of a mobile entity whose crossing of the zone is to be detected; hereinafter minimal detectable size. The method further includes receiving or determining data for configuring the plurality of Lidar sensors. The method further includes determining a set of zone obstacle shapes as the superimposition of the total swept volume shape and of the fixed object set shape; whereby a zone obstacle located between a given sensor and a given entity portion has the effect of blocking the sensor detection of said entity portion. The method further includes creating a set of zone sections or slices comprising sections or slices of the zone boundary and of the set of obstacle shapes. The method further includes, determining, for each zone slice, a position of a set of configured sensors on the boundary slice so that any crossing of the risky zone slice by a mobile entity larger than the minimal detectable size is detectable by at least one configured sensor even by taking into account the combined detection blockage effects of the set of obstacles shape slices.

The foregoing has outlined rather broadly the features and technical advantages of the present disclosure so that those skilled in the art may better understand the detailed description that follows. Additional features and advantages of the disclosure will be described hereinafter that form the subject of the claims. Those skilled in the art will appreciate that they may readily use the conception and the specific embodiment disclosed as a basis for modifying or designing other structures for carrying out the same purposes of the present disclosure. Those skilled in the art will also realize that such equivalent constructions do not depart from the spirit and scope of the disclosure in its broadest form.

Before undertaking the DETAILED DESCRIPTION below, it may be advantageous to set forth definitions of certain words or phrases used throughout this patent document: the terms “include” and “comprise,” as well as derivatives thereof, mean inclusion without limitation; the term “or” is inclusive, meaning and/or; the phrases “associated with” and “associated therewith,” as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like; and the term “controller” means any device, system or part thereof that controls at least one operation, whether such a device is implemented in hardware, firmware, software or some combination of at least two of the same. It should be noted that the functionality associated with any particular controller may be centralized or distributed, whether locally or remotely. Definitions for certain words and phrases are provided throughout this patent document, and those of ordinary skill in the art will understand that such definitions apply in many, if not most, instances to prior as well as future uses of such defined words and phrases. While some terms may include a wide variety of embodiments, the appended claims may expressly limit these terms to specific embodiments.

1 9 FIGS.through , discussed below, and the various embodiments used to describe the principles of the present disclosure in this patent document are by way of illustration only and should not be construed in any way to limit the scope of the disclosure. Those skilled in the art will understand that the principles of the present disclosure may be implemented in any suitably arranged device. The numerous innovative teachings of the present application will be described with reference to exemplary non-limiting embodiments.

Previous techniques do not enable to determine a position of a plurality of Lidar sensors for risky zones in optimal and efficient manners. For example, previous techniques are based on manual/not-automatic positioning, on trial and errors and require too much time and effort.

The embodiments disclosed herein provide numerous technical benefits, including but not limited to the following examples.

Embodiments enable to compute the quantity of needed Lidar sensors for covering an industrial risky zone.

Embodiments enable to determine where to place each Lidar sensors in order to get full safety coverage of a risky zone to prevent hazards on human life or equipment.

Embodiments enable to determine where to place each Lidar sensors in automatic and efficient manner.

Embodiments are based on the real robotic tasks performed by robots operating within the risky zone.

Embodiments ensure a safe and optimal coverage by Lidar sensors of a working station.

Embodiments are based on swept volumes and, therefore, the found solutions are independent from time.

Embodiments enable to digitally plan and validate Lidar based safety setups for working stations.

1 FIG. 100 100 102 104 106 106 108 110 110 111 illustrates a block diagram of a data processing systemin which an embodiment can be implemented, for example as a PDM system particularly configured by software or otherwise to perform the processes as described herein, and in particular as each one of a plurality of interconnected and communicating systems as described herein. The data processing systemillustrated can include a processorconnected to a level two cache/bridge, which is connected in turn to a local system bus. Local system busmay be, for example, a peripheral component interconnect (PCI) architecture bus. Also connected to local system bus in the illustrated example are a main memoryand a graphics adapter. The graphics adaptermay be connected to display.

112 106 114 106 116 116 118 120 122 120 126 Other peripherals, such as local area network (LAN)/Wide Area Network/Wireless (e.g. WiFi) adapter, may also be connected to local system bus. Expansion bus interfaceconnects local system busto input/output (I/O) bus. I/O busis connected to keyboard/mouse adapter, disk controller, and I/O adapter. Disk controllercan be connected to a storage, which can be any suitable machine usable or machine readable storage medium, including but are not limited to nonvolatile, hard-coded type mediums such as read only memories (ROMs) or erasable, electrically programmable read only memories (EEPROMs), magnetic tape storage, and user-recordable type mediums such as floppy disks, hard disk drives and compact disk read only memories (CD-ROMs) or digital versatile disks (DVDs), and other known optical, electrical, or magnetic storage devices.

116 124 118 Also connected to I/O busin the example shown is audio adapter, to which speakers (not shown) may be connected for playing sounds. Keyboard/mouse adapterprovides a connection for a pointing device (not shown), such as a mouse, trackball, trackpointer, touchscreen, etc.

1 FIG. Those of ordinary skill in the art will appreciate that the hardware illustrated inmay vary for particular implementations. For example, other peripheral devices, such as an optical disk drive and the like, also may be used in addition or in place of the hardware illustrated. The illustrated example is provided for the purpose of explanation only and is not meant to imply architectural limitations with respect to the present disclosure.

A data processing system in accordance with an embodiment of the present disclosure can include an operating system employing a graphical user interface. The operating system permits multiple display windows to be presented in the graphical user interface simultaneously, with each display window providing an interface to a different application or to a different instance of the same application. A cursor in the graphical user interface may be manipulated by a user through the pointing device. The position of the cursor may be changed and/or an event, such as clicking a mouse button, generated to actuate a desired response.

One of various commercial operating systems, such as a version of Microsoft Windows™, a product of Microsoft Corporation located in Redmond, Wash. may be employed if suitably modified. The operating system is modified or created in accordance with the present disclosure as described.

112 130 100 100 130 140 100 100 LAN/WAN/Wireless adaptercan be connected to a network(not a part of data processing system), which can be any public or private data processing system network or combination of networks, as known to those of skill in the art, including the Internet. Data processing systemcan communicate over networkwith server system, which is also not part of data processing system, but can be implemented, for example, as a separate data processing system.

2 FIG. 1 FIG. 100 illustrates a flowchart for determining a position of a plurality of Lidar sensors for reliably detecting a crossing of a risky zone in an industrial environment in accordance with disclosed embodiments. Such method can be performed, for example, by systemofdescribed above, but the “system” in the process below can be any apparatus configured to perform a process as described.

The risky zone comprises a set of moving objects and a set of fixed objects. The crossing of the risky zone by a mobile entity has to be detected by at least one Lidar sensor.

205 At act, it is received data on the geometry of the risky zone on whose boundary the plurality of sensors are to be positioned, data on the set of moving objects within the zone and data on the set of fixed objects within the zone.

210 At act, it is received data on a total swept volume combining all swept volumes of all motion operations of all moving objects of the cell. In embodiments, the total swept volume is generated departing from data of motion operations of the moving object set via a virtual simulation system. Examples of virtual simulation system include, but are not limited to, Computer Assisted Robotic tools, Process Simulate (a product of Siemens PLM software suite), robotic simulations tool, and other system for industrial simulation. For example, a CAR tool generates the total swept volume within a risky robotic zone by simulating all the received robotic operations of all the operating robots.

215 At act, it is received data on a minimal size of a mobile entity whose crossing of the zone is to be detected; hereinafter minimal detectable size. Examples of mobile entities include but are not limited by a human or an AGV vehicle. Examples of minimal detectable size may be the size of a human hand or the size of a head.

220 At act, it is received or determined data for configuring the plurality of Lidar sensors.

225 At act, it is determined a set of zone obstacle shapes as the superimposition of the total swept volume shape and of the fixed object set shape. A zone obstacle located between a given Lidar sensor and a given entity portion has the effect of blocking the sensor detection of said entity portion.

230 At act, it is created a set of zone slices comprising slices of the zone boundary and of the set of obstacle shapes.

235 At act, for each zone slice, determining a position of a set of configured sensors on the boundary slice so that any crossing of the risky zone slice by a mobile entity larger than the minimal detectable size is detectable by at least one configured sensor even when taking into account the combined detection blockage effects of the set of obstacles shape slices.

In embodiments, the sensors position is determined via optimization algorithms. As the skilled person easily appreciates, the choice of the optimization and of the type of algorithm depend on the given and received parameters and on the variables to be determined and/or optimized. For example, in embodiments, the number of sensors and their configuration is given and the optimization then consists in finding the optimal position of the sensors for which the zone-crossing detection of a minimal size entity is guaranteed. In other embodiments, the number of sensors or the sensors configurations are to be determined and the optimization then consists in finding the optimal number, position, configuration of the sensors for which the zone-crossing detection of a minimal size entity is guaranteed.

In embodiments, the sensor set position may be determined by applying a ML trained module. The input of the ML trained module comprises at least data on the zone boundary slice, data on the obstacle shape set, data on minimal detectable size. The output of the training module comprises at least the position of the set of configured sensors. In embodiments, the ML trained module is trained with input training dataset comprising at least data on the zone boundary slice, data on the obstacle shapes slices and output training dataset comprises at least the position of the configured sensor set on the zone boundary. In embodiments, the obstacles shapes slices for the training dataset may comprise randomly defined shapes.

In embodiments, the sensor set position may be determined by applying a genetic algorithm.

In embodiments, the number of sensors is received or predefined. In other embodiments, the number of sensors is to be determined. In embodiments, in case the step of determining the sensor set position returns no valid outcome, fine tunings may be applied by increasing the number of sensors and/or by changing the sensor configuration data.

In embodiments, the terms “received/receive/receiving”, as used herein, can include retrieving from storage, receiving from another device or process, receiving via an interaction with a user or otherwise.

3 9 FIGS.to In exemplary embodiments, the main algorithm phases and steps for determining a position of a plurality of Lidar sensors for reliably detecting a crossing of a risky zone in an industrial environment are illustrated below with the help of.

3 FIG. 301 302 301 301 302 302 302 301 302 302 302 is a drawing schematically illustrating an example of an industrial risky zone. The boundaryof the risky zoneis delimited by a fence. The risky zonecomprises two robots and other equipments, devices or objects whereby some industrial objects are moving and whereby some other industrial objects are not moving and therefore are at fixed positions. The depicted fence on the zone boundaryis hereinafter pictured for illustration purposes and therefore is to be intended as the boundary of the risky zone and not as a physical fence blocking the crossings to mobile entities. Therefore, the zone boundarycan be seen as an “invisible Lidar safety fence” and not a physical fence. This zone boundarydelimits the risky zone. The Lidar sensors (not shown) are to be positioned on the zone boundary. For example, the sensors can be placed on the floor or mounted on poles, posts and/or tripods at different heights so that the zone boundary is conveniently not delimited by a physical fence but rather by a partially invisible zone boundarywhich is sensor covered. Whenever a mobile entity like human personnel or an AGV vehicle is crossing this boundarythe Lidar sensor (not shown) shall be able to detect such a crossing so that a Lidar based safety station can be planned in an industrial facility.

i) loading the virtual study on the CAR tool; ii) for each robotic operation, creating the swept volume (SV); iii) creating a set of Lidar sensors; 4 FIG. iv) combining the virtual representations of the study, of the swept volume, of the Lidar sensors in a combined three-dimensional (“3D”) model where fixed objects and swept volume are superimposed (see); 5 6 FIGS.and v) creating a set of sections of «2D slices» comprising zone to cover, sensors, slices of swept volumes+equipments (see); 7 FIG. 8 FIG. 9 FIG. vi) applying an algorithm (see) to determine the Lidar positions based on the above data and on received minimal detectable size of a detectable mobile entity. The lidar positioning algorithm module may be based on ML algorithms (see ML training data type examples of) and/or genetic algorithms (see). Algorithm embodiments may include on or more of the following main phases:

302 302 3 FIG. In the first phase i), the data received of virtual study is loaded on the CAR tool. For example, the virtual study comprises a virtual description of the risky zoneas shown in. The risky zone comprises moving objects like robots and fixed equipment objects like a table base. The virtual study comprises a virtual description of the geometry of the risky zone boundary.

In the second phase ii), for each robotic operation of each robot, the total swept volume is generated. In embodiments, the swept volume is generated by the CAR tool by taking into account all robotic operations of the robots and by taking into account all the swept volumes of other moving industrial objects and devices. In other embodiments, the total swept volume may be retrieved from storage or received from an external source without the need of a CAR tool for generating it.

In the third phase iii), a set of N Lidar sensors is created according to received configuration data and their position is yet to be determined along the boundary of the risky zone. In embodiments, the number N of sensors is received from storage or via an interaction with user or otherwise. In other embodiments, the sensor number N is to be computed via the algorithm. Examples of Lidar configuration data include, but are not limited by, detection range, coverage sector in degrees, number of rays or angles between rays and other Lidar parameters.

401 401 403 404 403 405 4 FIG. 4 FIG. 4 FIG. In the fourth phase iv), a combined 3D virtual representationis generated by combining the virtual data received or generated during the previous phases i)-iv) as schematically exemplified in the drawing of.is a drawing schematically illustrating the industrial risky zonewith swept volume and a Lidar sensor in accordance with exemplary embodiments. The swept volumeof the two robots can be generated within the CAR tool by taking into account the motion volumes of the two robots with all possible robotic operations of the robotic cell. Examples of robotic operations include, but is not limited by, welding, drilling, lasering, cutting, coating, cleaning, picking, measuring and other operations. In exemplary embodiments, data describing robotic operation may comprise robotic targets e.g. <cartesian+robotic configuration> or <joint values>; commands to be performed on those robotic targets; whereby the data may be provided in form of a text file or in form of 3D virtual objects comprising such data. In, one exemplary Lidar sensoris depicted with a black circle and a sector of a set of beam arrays departing from it. The robotic swept volumeor the fixed objectsacts as obstacles by blocking the detection reach of the sensor beam, thus reducing the area covered by the sensor.

505 506 506 506 508 401 401 505 506 401 303 5 FIG. 5 FIG. In the fifth phase v), the combined 3D virtual representation is slicedinto a set of section slices. In the illustrated embodiments the sliceshave a 2D shape, in other embodiments (not shown) they may have a 3D shape.schematically illustrates 2D sliceswith obstaclestaken from the combined 3D modelof the risky zone. On the upper part of, it is depicted a front view of the risky zone combined modelwhereby the horizontal linesillustrate a representation of the slicestaken at different heights on the combined 3D modelwhere also the swept volumeis depicted. In embodiments, the Lidar position problem is solved as a mathematical optimization problem departing from the 3D zone model via section slicing into 2D or into 3D section or slices.

5 FIG. 4 FIG. 4 FIG. 4 FIG. 506 506 507 508 505 506 401 507 302 507 508 508 404 On the below part of, four sketches of different 2D slicesare shown for illustration purposes. Each sliceinclude a zone boundary lineand three obstacleswhich—in each slice—present different shapes depending on the heights at which the slice cutsare made. For example, slice cuts may be made departing at a height of 20 cm and repeating each cut every 15 cm until the height of 140 cm is reached. It is noted that the four slicesare pictorial representations for illustration purposes only and do not directly correspond to the shapes of the zone 3D modelof. For example, the boundary linehas an elliptic shape even when the boundaryinhas a polygonal shape and the boundary shapeof each slice may change depending on the height where the cut is made. Similarly, the obstacle slicesare pictorial representations for illustration purposes of the fixed objects slices or from the swept volume slices without direct correspondence to the swept volume and the fixed objects of the 3D models of. The obstaclesare filled with a dashed pattern and block the sensor detection of the beam of a Lidar sensor.

6 FIG. 404 507 404 In the sixth phase vi), an algorithm for determining the optimal position of the set of Lidar sensors is applied.is a drawing schematically illustrating a risky zone slice/section comprising Lidar sensors and obstacle slices. The N Lidar sensorsare positioned along the zone boundaryat positions yet to be determined in a way that a crossing of a mobile entity (not shown) of minimal size is detectable by at least one beam of one Lidar sensor.

610 507 507 610 6 FIG. In embodiments, users may conveniently be enabled to provide inputs and exclude selected portions of the zone boundary where sensors cannot be placed for example reflecting areas of the station where, preferably, equipments shall not be placed. In such case, the algorithm is enabled to compute the sensors positions on the zone boundary outside the excluded boundary portions and provides corresponding outcome positions. An example of excluded zone portionis shown with a dashed line. Therefore, in the pictorial embodiment representation of, the zone boundarywhere the Lidar sensors can be applied is the continuous line ofwith the exclusion of the dashed line portion.

Examples of algorithms that can be applied to optimize the position of the Lidar sensors include, but are not limited to, Machine Learning algorithms e.g. reinforcement learning, genetic algorithms, other optimization algorithms and a combination thereof.

7 FIG. 701 schematically illustrates the input/output of a modulefor determining a position of a plurality of Lidar sensors in accordance with disclosed embodiments.

LP 701 703 702 701 507 508 404 701 703 702 The module Mdetermines at least the positions of each Lidar sensor provided as output data. In embodiments, the position of a Lidar sensor may be defined by position and orientation coordinates (X, Y, Z, RX, RY, RZ). In embodiments, the input dataof the Lidar positioning modulemay comprise one or more of the following data: 2D geometry of the risky zone area; 2D shapes of the obstaclesper relevant height of the slice cut; configuration data for the Lidar sensors(e.g. coverage sector in degrees or radians, number of rays or angles between rays); number N of Lidar sensors, minimal detectable size of a mobile entity. In embodiments, the algorithm performed by the LiDAR position modulecomputes output databased on received input dataand based on an heuristic approach by ignoring uncovered areas smaller than predefined sizes. In embodiments, with the heuristic approach, the algorithm considers “uncovered” areas that are too small to be entered by a human or any other mobile entity as if those small areas are “covered” so that full coverage is achieved. In embodiments, small fractions of not covered areas whereby a mobile entity of minimal detectable size cannot enter are heuristically considered by the algorithm as if full sensor coverage were achieved.

702 701 701 703 702 702 701 703 In embodiments, the input dataof the lidar position computation modulecomprise the number N of Lidar sensors. In other embodiments, the sensor number N is computed by the moduleand therefore is comprised in the output dataand not in the input data. In summary, the number of sensors N may be part of the input data—e.g. the user asks the lidar position modulewhere to position the N Lidar sensors—or the sensor number N is part of the output data—e.g. the user asks how many sensors shall be utilized and where shall they be positioned.

As the skilled person easily appreciates, in embodiments, the zone slices may have a 2D or 3D shape depending on the format of the heights of the slice cuts.

505 506 506 In embodiments, where the heights for cutting a sliceare in number format (e.g. 45 cm), the resulting sliceshave 2D shapes and the optimization algorithm solves a 2D problem. In other embodiments, where the height for cutting a slice (not shown) are in numerical range/interval format (e.g. 44-46 cm), the resulting sliceshave a 3D shape so that the optimization algorithm solves a 3D problem.

702 703 In embodiments, input datacomprise a virtual study, Lidar configuration. In embodiments, the output datacomprise Lidar positions for safety coverage whereby obstacles from swept volumes for each moving objects and from fixed objects are taken into account.

LP In an exemplary embodiment, the module Mfor Lidar positioning comprises steps to solve a ML algorithm, e.g. a reinforcement learning problem. For example, assume that the number N of Lidar sensors is to be determined, the states may consist in changing the number of Lidar and their positions and the reward function consists in higher scores for larger covered areas and for smaller numbers of sensors (optional). Heuristically, in embodiments, small fractions of not covered areas that humans cannot physically enter can be considered as if those areas were fully covered.

8 FIG. 801 508 802 808 In embodiments, the training data set for training the ML algorithm may be collected from real case scenarios or they may be synthetically generated—with or without using a simulation system.is a drawing schematically illustrating exemplary slices for ML training dataset in accordance with disclosed embodiments. The upper zone sliceis an example of slice where the obstaclesare generated by slicing a 3D model of a risky zone with swept volume. The bottom zone sliceis an example of slice where the obstaclesare fake obstacles synthetically generated for example according to various criteria which can be user defined or learned from collected data of historical facility cells.

801 801 701 In a first exemplary embodiment of synthetic data generation, the main training data generations phases include one or more of the steps of: using several virtual robots; defining a position for each robot; for each robot, generating some random tasks (e.g. locations); playing simulation and generating the swept volume; slicing the swept volume to a plurality of 2D slices; export each SV sliceto a different test case; for each test case, defining sensors data plus area to cover and running the algorithm and collecting the output dataset as training data for the Artificial Intelligence (AI) algorithm modeling the Lidar position module.

802 808 802 701 In a second exemplary embodiment of synthetic data generation, it includes the steps of generating a “fake” list of 2D drawing sliceswith fake obstacles, and such slicesare used as training dataset to train the AI algorithm. Advantageously, there is no need of using a simulation and/or defining virtual robot(s). Advantageously this second exemplary embodiment may be a faster way to generate the training data set for the AI algorithm model for the Lidar position module.

LP In an exemplary embodiment, the module for Lidar positioning Mcomprises steps to solve a genetic algorithm problem. In embodiments, the sequence or chain of items, the gonium, is the list of Lidar sensors of a single solution. In embodiments, according to a first technique, each item—a Lidar sensor—is evaluated by how net coverage it adds to the coverage of the previous sensors. In embodiments, according to a second technique, each solution, a sequence of Lidar sensors, is evaluated by how much total coverage it achieves. Embodiments may include a combination of the first and the second technique.

9 FIG. 506 404 508 404 508 is a drawing schematically illustrating an exemplary of genetic algorithm usage for determining the Lidar sensors position in accordance with disclosed embodiments. A representation of a 2D slices of risky zonescomprise Lidar sensors, obstaclesas previously described. The sensors SA, SBhave coverage sectors (in degrees or radians) whose detection areas is blocked by the obstacle.

901 902 903 404 B A B C A B A C A B For example, assume that, for a first sensor SA at a given position (X, Y, Z, RX, RY, RY), its coverage area is computedand results of being 25% of the total risky area to be covered. Addinga second sensor Sat another position with computed coverage 20%, it brings in an additional net coverage of 5% (=25%−20%). The total coverage areaof the two sensors S, Sis therefore 30% (25%+5%). For example, assume that there is a third sensor S(not shown), the value of the first sensor Sis its coverage area, the value of the second sensor is Sis its coverage area, minus the area covered by the previous sensor S, the value of the third sensor is Sis its coverage area minus the coverage area of the combination of sensors Sand S. In this manner, the gonium of the sensors with larger coverage is passed to the next generation, also with some mutations in order not to provide a solution that is more global and not too local. At each iteration, the genetic algorithm keeps trying and evaluating different positions of the sensors. The algorithm starts with N number of sensors and try to reach a full zone coverage. In embodiments, if no solution is found, the number of sensors is increased to N+1 and the algorithm tries again until full coverage is reached. Heuristically, in embodiments, small fractions of not covered areas that humans cannot physically enter can be considered as if those areas were fully covered. In embodiments, unlike in the case of the reinforcement learning algorithm where the provide solution can be seen as a single holistic solution, with the genetic algorithm, each sensor or sensor sequence or a combination thereof is evaluated separately. In fact, typically in the reinforcement learning algorithm the order of the sensor sequence has typically no influence or value, with the genetic algorithm, the order plays an important to evaluate what is the value of adding each additional sensor of top the other existing Lidar sensors.

In summary, Table 1 below provides a high-level comparison of the features of the AI-based approach versus the genetic algorithm approach for computing the position of the Lidar sensors in accordance with embodiments.

TABLE 1 high-level comparison the AI-based algorithm vs the genetic algorithm AI-based approach Genetic approach Training Needed Not needed (dataset, time effort) Speed Fast It takes time Accuracy It depends on the training Accurate dataset Outcome Same result Different results Point of view All the sensors are seen as a Each sensor is evaluated single holistic solution separately

701 702 703 702 703 702 Examples of algorithms of the moduleincludes but are not limited by AI/ML algorithms, genetic algorithms or any other algorithm which given the input datasolves and optimizes the output solutionvia an heuristic approach for small uncovered areas. In embodiments, the modulemay comprise a set of submodules which may also run a plurality of algorithms for example, in parallel, by collecting the results, by analyzing them all and by returning a pool of optimal chosen solutions. In embodiments, the modulecan start by applying the ML algorithm and use its outcome result as a use case of the genetic algorithm i.e. the genetic algorithm considers the ML algorithm outcome as one of the leading options and tries to find a better one.

Of course, those of skill in the art will recognize that, unless specifically indicated or required by the sequence of operations, certain steps in the processes described above may be omitted, performed concurrently or sequentially, or performed in a different order.

100 Those skilled in the art will recognize that, for simplicity and clarity, the full structure and operation of all data processing systems suitable for use with the present disclosure is not being illustrated or described herein. Instead, only so much of a data processing system as is unique to the present disclosure or necessary for an understanding of the present disclosure is illustrated and described. The remainder of the construction and operation of data processing systemmay conform to any of the various current implementations and practices known in the art.

It is important to note that while the disclosure includes a description in the context of a fully functional system, those skilled in the art will appreciate that at least portions of the present disclosure are capable of being distributed in the form of instructions contained within a machine-usable, computer-usable, or computer-readable medium in any of a variety of forms, and that the present disclosure applies equally regardless of the particular type of instruction or signal bearing medium or storage medium utilized to actually carry out the distribution. Examples of machine usable/readable or computer usable/readable mediums include: nonvolatile, hard-coded type mediums such as read only memories (ROMs) or erasable, electrically programmable read only memories (EEPROMs), and user-recordable type mediums such as floppy disks, hard disk drives and compact disk read only memories (CD-ROMs) or digital versatile disks (DVDs).

Although an exemplary embodiment of the present disclosure has been described in detail, those skilled in the art will understand that various changes, substitutions, variations, and improvements disclosed herein may be made without departing from the spirit and scope of the disclosure in its broadest form.

None of the description in the present application should be read as implying that any particular element, step, or function is an essential element which must be included in the claim scope: the scope of patented subject matter is defined only by the allowed claims.