Video Processing in Modular Display System and Method

This application claims the benefit of and priority to U.S. Provisional Patent Application Ser. No. 63/433,646 filed on Dec. 19, 2022 and entitled “Modular Display with Integrated on Camera Feature Sets,” which is expressly incorporated herein by reference. This application is a continuation of and claims priority to U.S. application Ser. No. 18/545,800, filed Dec. 19, 2023, which is a continuation-in-part of and claims priority to each of the following applications: U.S. application Ser. No. 18/322,279, filed May 23, 2023; U.S. application Ser. No. 18/351,243, filed Jul. 12, 2023; U.S. application Ser. No. 18/216,459, filed Jun. 29, 2023; U.S. application Ser. No. 18/217,201, filed Jun. 30, 2023; U.S. application Ser. No. 18/217,261, filed Jun. 30, 2023; U.S. application Ser. No. 18/217,268, filed Jun. 30, 2023; and U.S. application Ser. No. 18/233,115, filed Aug. 11, 2023, the contents of each of which are expressly incorporated herein by reference.

This disclosure relates to a video processing system, and particularly to a video processing system that generates and/or uses a serialized video protocol for delivering video data to a display system. As disclosed herein, the video processing system, in particular, provides a simplified data path from which a display system may read data for eventual display by one or more display components. Also disclosed is a method of reading data from a video data stream such that specific devices viewing the video data stream may read only that data which pertains to itself and allow all data untouched to pass through it, even data that pertains to itself.

1 3 FIGS.and There are several methods by which video data may be delivered to a display. Generally, related Light-Emitting Diode (LED) systems are based upon a topology where a processor takes in the desired video data via, for example, an HDMI or SDI cable and performs various calculations and remapping functions on the video data. After these calculations are performed, the data is usually compressed before sending the results, via an ethernet or ethernet-like cable, to a breakout box. Depending on the LED tile resolution and the available bandwidth, one often needs to manually calculate (see calculations below) how many LED tiles one can connect in a loop from any single cable coming from an output of the breakout box. Ethernet or ethernet-like cables are then distributed over a number of LED tiles based on the results of the calculations, as shown in.

4 FIG. The LED tiles often comprise multiple LED Display Modules (LDMs). The LDMs are usually mounted to a mechanical frame electrically connected to the hub board (a.k.a., hub card). The hub card serves as an electrical interface between the LDMs, a power supply, an ethernet or ethernet-like cable, and the receiver card (). The receiver card may be analogized to the heart of the LED tile and contains the digital logic for driving the LEDs. The LDMs usually have a multiplexing layout wherein LEDs are connected on one side to the multiplexing and on the other side to Constant Current Drivers (CCDs).

The calculation to determine how many LED tiles one can connect in a loop from any single ethernet or ethernet-like cable from the breakout box, as mentioned above, may be performed according to the following process:

the total amount of bits needed for one LED tile per frame would be 512×512×3 RGB colors×12 bit/color=9,427,184 bits; the total amount of bits available at 60 Hz is 9,427,184 bits×60 Hz=566,231,040 bits; using a 1 Gbps ethernet an ethernet or ethernet-like cable to transmit the video data limits the number of displays that can be connected via said cable to 1,000,000,000/566,231,040=1.74 LED tiles. Assuming that there is a video data signal of 60 Hz which is configured for a 12-bit color depth RGB 512×512 pixel LED tile:

It is noted that this even calculation is optimistic as it doesn't contain any overhead of the ethernet encoding and overhead for sending frames, preambles, and so on. The actual calculation is even lower with an input of a 120 Hz video signal, (usually this vertical frame refresh rate is used for showing 3D video), then Gigabit ethernet cannot be used as the minimal necessary bandwidth is 1.44 Gbps for these kinds of tiles. (The later proposed system as disclosed herein is then really the world's first high resolution processing system that can display 3D for high resolution tiles.)

The inventors of the present application have found that for these kind of applications, traditional processor topologies using ethernet or ethernet-like protocols will need to use much more expensive, high-bandwidth transmissions, such as 10 Gbps ethernet physical layer (ethernet phy) chipsets and interconnect or even use expensive fiber connection and cabling. But still then the inventors of the present application have found the significant problem that this topology—apart from being expensive—will suffer from other drawbacks such as higher latency, the difficulty of configuring the individual LED tiles and increase of processing complexity in related systems.

Some traditional processor manufacturers might also use “compression algorithms” applied to the tile ethernet or ethernet-like data streams to get below the restricted bandwidth, but this introduces pixel artifacts and (sometimes) frame artifacts, which are extremely undesirable. One example is issuing YUV video stream instead of an RGB video stream (RGB->YUV). Some even use comparison to previous video frames and hence introduce frame delay. But again, these methods provide unsatisfactory results.

An object of the invention is to provide a video processing system that generates and/or uses a serialized video protocol for delivering video data to a display system. In particular, the aim is that the video processing system provides a simplified data path from which the display system may read data for eventual display by one or more display components. The aim is also to provide a method of reading data from a video data stream such that specific devices viewing the video data stream may read only that data which pertains to itself and allow all data untouched to pass through it, even data that pertains to itself (passing through).

According to an aspect of the invention, an active receiver card is provided for a display comprising one or more tiles, and wherein each tile comprises a plurality of pixels. The active receiver card is configured to be electrically connected to one of the one or more tiles of the display. The active receiver comprises: a processor; a first interface configured to receive a broadcast serialized video data stream as input from a video processing system; and a second interface configured to output control signals used to control the plurality of pixels of the one tile of the display. The word “active” in active receiver card, particularly refers to the fact that it comprises a processor. The active receiver card is considered as a smart device since it comprises a processor. In other words, the processor makes the receiver card an active device, which does all the work in order to get the right, required or intended image on the screen or display. The video processing system as referred to, is an external system or external equipment, meaning that it is physically present outside of the display. According to the aspect, the video processing system is merely intended to capture video images. Hence, according to an embodiment, the functionality of the video image processing system could be incorporated in a first tile of the display. Such video images are delivered to the video processing system, which results in the broadcast serialized video data stream. Such broadcast serialized video data stream, may comprise only video images (coming in or passing through at e.g. 6.2 or 12.5 Gbps (or more) bandwidth), in a downstream communication, i.e. towards the display (or an active receiver card thereof). Alternatively, such broadcast serialized video data stream, may comprise, in addition to video images, also communication information (coming in or passing through at e.g. 20 Mbps bandwidth), in a downstream communication, i.e. towards the display. Or else, such broadcast serialized video data stream, may comprise, in addition to video images, communication information (coming in or passing through at e.g. 20 Mbps bandwidth), in a downstream communication, i.e. towards the display, as well as communication information (coming in or passing through at e.g. 20 Mbps bandwidth), in an upstream communication (in a direction opposite to the downstream direction), i.e. (from the display back) towards the video processing system. The processor of the active receiver card is configured to extract from the received broadcast serialized video data stream video image data pertaining to the tile of the display, and based thereon, the active receiver card is configured to output the control signals used to control the plurality of pixels of the tile of the display. When the broadcast serialized video data stream arrives at a tile of the display, the active receiver card of that tile “knows” (because of having the processor therein) what image and information comprised in such video data stream is intended for that tile, and hence the active receiver card “knows” what that tile has to display. It is noted that such video data stream may also comprises what image and information is intended for other tiles, and what has to be displayed by these other tiles. The active receiver card may be configured to receive through the first interface the broadcast serialized video data stream, wherein the broadcast serialized video data stream may comprise data not pertaining to the tile of the display, or wherein the broadcast serialized video data stream may comprise data pertaining to other tiles.

The active receiver card may receive the broadcast serialized video data stream as asymmetrical communication between the active receiver card and the video processing system. With asymmetrical communication is meant that for example the video images, all or not combined with communication information, in downstream communication are coming in or passing through at (much) higher bandwidth (e.g. 6.2 or 12.5 Gbps) than for example communication information returning back, in upstream communication at (much) lower bandwidth (at e.g. 20 Mbps). The active receiver card may be configured to operate asymmetrically with the video processing system such that the serialized video data stream transmitted downstream from the video processing system is transmitted at a higher bandwidth than a bandwidth of data transmitted upstream to the video processing system. It is also possible that there is no communication information returned back, hence resulting also in an asymmetric communication. The active receiver card may be configured to receive through the first interface the broadcast serialized video data stream without requiring return communication or without confirmation to the video processing system.

The tile may comprise a board onto which the plurality of pixels of the tile are provided, and wherein such board may comprise per pixel one or more light-emitting elements (LEEs), such as for example LEDs. The second interface may be directly or indirectly electrically connected to such board. In case the second interface being directly electrically connected, the active receiver card may be mounted directly onto the tile (and hence, e.g. without the need of a hub board for an indirect connection). According to an embodiment, the tile may comprise one or more boards, e.g. LED boards, onto which the plurality of pixels can be provided, and wherein such board may comprise per pixel one or more light-emitting elements (LEEs), such as for example LEDs. In case of more than one boards, e.g. four LED boards, the second interface of the active receiver card may be indirectly electrically connected to each of the (four LED) boards, for example via a hub board, connecting the active receiver card with the (four LED) boards.

The active receiver card may further comprise a non-volatile memory that stores at least one (x,y) coordinate of a pixel of the plurality of pixels of one of the tiles of the display that corresponds to said pixel mounted on the board of one of the tiles, the at least one (x,y) coordinate corresponding to a particular (x,y) pixel coordinate of said one of the tiles. The processor of the active receiver card may be configured to determine a coordinate (a,b) out of the serialized video data stream, and compare the determined coordinate (a,b) to the at least one (x,y) coordinate of said pixel of the plurality of pixels.

The processor of the active receiver card may be configured to extract a corresponding pixel value from the serialized video data stream. The processor of the active receiver card may be configured to perform at least one mathematical operation on the corresponding pixel value. The processor of the active receiver card may be configured to convert an outcome of the at least one mathematical operation to an output that can be interfaced with the second interface (e.g. for adapting brightness). The processor of the active receiver card may be configured to send corresponding signals to said board of the tile comprising the plurality of pixels of said tile and per pixel comprising one or more LEEs, to light up the LEEs in correspondence with the outcome of the at least one mathematical operation.

According to an aspect of the invention, a method is provided for controlling with an active receiver card a plurality of pixels of a tile of a display, the active receiver card being electrically connected to the tile of the display, the method comprising: (i) receiving by a first interface a broadcast serialized video data stream as input from a video processing system; (ii) extracting by a processor of the active receiver card, from the received broadcast serialized video data stream, video image data pertaining to the tile of the display; and (iii) based on the extracted video image data pertaining to the tile, outputting, by a second interface of the active receiver card, control signals used to control the plurality of pixels of the tile of the display.

According to an aspect of the invention, a modular display system is provided, configured to broadcast a serialized video data stream, comprising: a display for displaying the serialized video data stream, wherein the display comprising a plurality of tiles, comprising at least a first tile and a second tile; and a video processing system configured to output the serialized video data stream as a plurality of portions of the serialized video data stream, each of the plurality of portions of the serialized video data stream pertaining to a corresponding one of the plurality of tiles, such that the plurality of portions of the broadcast serialized video data stream comprises at least a first portion of the serialized video data stream comprising video image data pertaining to the first tile of the display and a second portion of the serialized video data stream comprising video image data pertaining to the second tile of the display; wherein the video processing system outputs both the first portion of the serialized video data stream and the second portion of the serialized video data stream combined as a single broadcast data stream to a first active receiver card corresponding to the first tile of the display and to a second active receiver card corresponding to the second tile of the display.

According to an aspect of the invention, a video processing system is provided comprising: a video processor configured to output video data to be displayed by a display as a video image, the video data being output by the video processor is a serialized digital video stream, resembling the complete relevant video information to be displayed.

According to an aspect of the invention, an active receiver card is provided for a display, the active receiver comprising: a processor; a first interface configured to receive a broadcast serialized video data stream as input from a video processing system, wherein the active receiver card is configured to be electrically connected to a tile of a display; wherein the active receiver card further comprises a second interface configured to output control signals used to control a plurality of pixels of the tile of the display; wherein the processor of the active receiver card is configured to extract from the received broadcast serialized video data stream video image data pertaining to the tile of the display, and based thereon, the active receiver card is configured to output the control signals used to control a plurality of pixels of the tile of the display.

According to an aspect of the invention, a method is provided for controlling with an active receiver card pixels of tile of a display the active receiver card being electrically connected to a tile of the display, the method comprising: receiving by a first interface a broadcast serialized video data stream as input from a video processing system; extracting by a processor of the active receiver card, from the received broadcast serialized video data stream, video image data pertaining to the tile of the display; and based on the extracted video image data pertaining to the tile, outputting, by a second interface of the active receiver card, control signals used to control a plurality of pixels of the tile of the display.

According to an aspect of the invention, a video processing system is provided comprising: a video processor configured to broadcast a serialized video data stream to be displayed by a display, the video data being output by the video processor as a plurality of portions of the serialized video data stream, each of the plurality of portions of the serialized video data stream pertaining to a corresponding one of a plurality of tiles of the display, including at least a first tile and a second tile, such the plurality of portions of the broadcast serialized video data stream include at least a first portion of the serialized video data stream including video image data pertaining to the first tile of the display and a second portion of the serialized video data stream that includes video image data pertaining to the second tile of the display, wherein the video processor outputs both the first portion of the serialized video data stream and the second portion of the serialized video data stream combined as a single broadcast data stream to an active first receiver card corresponding to the first tile of the display and to a second active receiver card corresponding to the second tile of the display.

According to an aspect of the invention, an active receiver card is provided comprising: a processor; a first interface configured to receive input from a video processing system; and a second interface configured to output signals to a plurality of pixels of a display tile corresponding to the active receiver card, wherein the active receiver card is configured to be connected to a tile of a display comprising a plurality of tiles, wherein the active receiver card is configured to receive a plurality of portions of the video data from the video processing system, each of the plurality of portions of video data corresponding to one of the plurality of tiles of the display, and wherein the active receiver card is configured to retrieve pixel data relating to the plurality of pixels of the display tile, and based thereon, is configured to output signals to light individual pixels of the display tile.

According to an aspect of the invention, a video processing system is provided comprising: a video processor configured to output video data to be displayed by a display as a video image, the video data being output by the video processor as a plurality of portions of the video data to be displayed by a corresponding plurality of tiles of the display, such that a first tile displays a first portion of the video image based on a first portion of the video data and a second tile displays a second portion of the video based on a second portion of the video data, wherein the video processor outputs both the first portion of the video data and the second portion of the video data to each of the first tile and the second tile.

According to an aspect of the invention, a video processing method is provided comprising: outputting video data to be displayed by a display as a video image, the video data being output by a video processor as a plurality of portions of the video data to be displayed by a corresponding plurality of tiles of the display, such that a first tile displays a first portion of the video image based on a first portion of the video data and a second tile displays a second portion of the video based on a second portion of the video data, wherein outputting the video data includes outputting both the first portion of the video data and the second portion of the video data to each of the first tile and the second tile.

Further, in view of the above Background, and the problems with related video processing systems and methods identified by the inventors of the present invention, an aim of the disclosure is to provide a simple, for example, serialized, video protocol for transmitting video data to all LED tiles of a display at once instead of using ethernet or ethernet-like protocols that need to send individual (personalized) data to each of the individual tiles in an LED display. In contrast to current systems, in an embodiment of the system and methods disclosed herein, all LED tiles see or are provided the entire video data transmission of the full relevant image to be displayed and hence, the tile processor may read that part of the video data that pertains to itself and simply display it. In fact, this means that the complex logic, which is typically associated with expensive, centralized video processors, is instead distributed all over the display. This might, at first, seem less cost effective. However, the impact of this decentralization on performance is immense as this non-centralized system enables the execution of more calculations and implementation of more complex algorithms since the pixels which need processing locally in the receiver card will always be less compared to the amount of pixels that are needed for full screen processing as done in related approaches. Further, by using a simple video protocol, the system (frame) latency can be reduced significantly (see later).

According to a first aspect of the invention, a video processor is provided that is configured to send a video data stream, wherein data is communicated downstream from the video processor in a higher amount than the data communicated upstream to the video processor. This may be termed an “asymmetrical” video data stream, in that the that the downstream communication (to the tiles) is of a bandwidth, data rate, or bitrate that is significantly higher than the upstream communication (back to processor). The ratio of the asymmetrical video data stream (downstream to upstream) communication may be, for example, greater than 1, or approximately, 1.05 to 1; 1.1 to 1; 1.5 to 1; 2 to 1; 3 to 1; 4 to 1; 5 to 1; 6 to 1; 7 to 1; 8 to 1; 9 to 1; 10 to 1; 15 to 1; 20 to 1; 30 to 1; 40 to 1; 50 to 1; 60 to 1; 70 to 1; 80 to 1; 90 to 1; 100 to 1; or greater, including, but not limited to, 150 to 1; 200 to 1; 300 to 1; 400 to 1; 500 to 1; 600 to 1; 700 to 1; 800 to 1; 900 to 1; 1,000 to 1; 1,500 to 1; 2,000 to 1; 3,000 to 1; 4,000 to 1; 5,000 to 1; 10,000 to 1; 20,000 to 1; 30,000 to 1; 50,000 to 1; 100,000 to 1; 200,000 to 1; 300,000 to 1; 400,000 to 1; 500,000 to 1; 1,000,000 to 1; 2,000,000 to 1; 5,000,000 to 1; 10,000,000 to 1; or greater. Further, the ratio of the asymmetrical video data stream (downstream to upstream) communication may be in the range of greater than 1-2 to 1; 1.1 to 1-5 to 1; 1.1 to 1-10 to 1; 1.1 to 1-20 to 1; 1.1 to 1-50 to 1; 1.1 to 1-100 to 1; 1.5 to 1-5 to 1; 1.5 to 1-10 to 1; 1.5 to 1-20 to 1; 1.5 to 1-50 to 1; 1.5 to 1-100 to 1; 2 to 1-5 to 1; 2 to 1-10 to 1; 2 to 1-20 to 1; 2 to 1-50 to 1; 2 to 1-100 to 1; 2 to 1-1,000 to 1; 2 to 1-5,000 to 1; 2 to 1-10,000 to 1; 5 to 1-10 to 1; 5 to 1-20 to 1; 5 to 1-50 to 1; 5 to 1-100 to 1; 5 to 1-1,000 to 1; 5 to 1-5,000 to 1; 5 to 1-10,000 to 1; 10 to 1-20 to 1; 10 to 1-50 to 1; 10 to 1-100 to 1; 10 to 1-1,000 to 1; 10 to 1-5,000 to 1; 10 to 1-10,000 to 1; 10 to 1-50,000 to 1; 10 to 1-100,000 to 1; 100 to 1-1,000 to 1; 1,000 to 1-10,000 to 1; 1,000 to 1-100,000 to 1; 1,000 to 1-1,000,000 to 1.

The order of the data communicated need not be communicated sequentially (e.g., pixel N followed by pixel N−1, then N−2, etc.) or in other words linearly, but may be communicated out of order as long as the order the data is in is predetermine and fixed (e.g., it is predetermined and fixed that pixel N comes first, then pixel N−5, then pixel N−2, etc.). Additionally, a display is configured to display at least a part of the data communicated along the video data stream. Further, at least one receiver card is connected to or configured to receive a signal from the video processor, wherein the receiver card comprises a video transceiver/reclocker configured to capture data from the video data stream that is specific to said receiver card and to allow all video data from the video data stream to pass through said receiver card. The receiver card may further comprise non-volatile memory, volatile memory, an embedded processor, logic to mitigate the effects of synchronization banding when capturing in high-speed sync, a video/LED processor, and an interface between the receiver card and a hub board.

Additionally, individual pixel light generation may start and stop after a predefined start and stop period. The display may immediately update at the beginning of the start period. The start of the start and stop period may be based on the vertical sync signal or a programmable time to wait after a vertical sync signal. The stop of the start and stop period may be calculated by digitally measuring the time between two consecutive vertical sync signals or by calculating a fraction of the measurement between two consecutive vertical sync signals. Also, multiple pixel light generations may start and stop during the time between two vertical sync signals. Further, the start and stop conditions may be derived from a vertical sync signal and a measured camera shutter time. This embodiment may also have sync-banding capabilities.

The data communicated along the video data stream may be made up of at least 8-bit RGB pixel data but may be more or less than 8-bits. Further, the data communicated along the video data stream may be uncompressed. Additionally, the data communicated along the video data stream may also contain serialized communication data for communication with the display (typically an LED display). The display may use Pulse Width Modulation (PWM) schemes, multiplexing schemes, or active matrix schemes.

According to a second aspect of the invention, an embodiment may comprise at least two electrical interfaces. The first electrical interface may receive a video data stream, wherein the order of the data communicated along the video data stream need not be communicated sequentially as long as the data is in a predetermined and fixed order; the second electrical interface may be electronically connected directly or indirectly with a board containing one or more LEDs. Additionally, the embodiment may comprise non-volatile memory that stores at least one (x, y) coordinate of a pixel that corresponds to one LED that is mounted on the LED board. This (x, y) coordinate also corresponds to a particular pixel coordinate.

According to an embodiment, digital logic (or a processor, a controller, or other circuitry) may be implemented to determine an (a, b) coordinate pair out of data communicated along the video data stream and compare the (a, b) coordinate with an (x, y) coordinate. The digital logic may also (i) retrieve the corresponding pixel data from the data communicated along the video data stream, (ii) perform at least one mathematical operation on the retrieved data, (iii) convert the outcome of the mathematical operation to logic that can interface with the second electrical interface, and/or (iv) send corresponding signals to the board containing one or more LEDs to light up the LED in correspondence with the outcome of the mathematical operation.

According to another embodiment, a system is provided having at least three electrical interfaces, the first electrical interface being capable of receiving the data communicated along the video data stream; the second electrical interface being capable of sending the data communicated along the video data stream; and/or the third electrical interface being connected directly or indirectly with a board containing one or more LEDs. Digital logic (or a processor, a controller, or other circuitry) may be present that connects the first electrical interface to the second electrical interface. There may also be digital logic, a processor, a controller, or other circuitry to change predetermined data in the video data stream before it is presented to the second electrical interface, for example, to perform autoconfiguration, i.e., automatically detect how many tiles are present and how they need to be positioned. Additionally, the data presented to the second electrical interface may be significantly different than the data presented to the third electrical interface.

According to another embodiment, a video processing system may have at least five electrical interfaces. The first and second electrical interfaces being capable of receiving the data communicated along the video data stream with downstream communication; the third and fourth interfaces being capable of sending the data communicated along the video data stream with downstream communication; the fifth electrical interface is electronically connected directly or indirectly with a board containing one or more LEDs. There may be digital logic, a processor, a controller, or other circuitry that connects the first electrical interface to the third or fourth electrical interface and the second electrical interface to the third or fourth electrical interface. The digital logic may also (i) change predetermined data in the video data stream, received from the first and second electrical interfaces, (ii) determine activity on the first and second electrical interfaces, and (iii) retrieve pixel data from either or both of the first and the second electrical interfaces.

In an embodiment, at least one mathematical operation may be performed on the retrieved pixel data. Such operations include, but are not limited to, correction of the brightness, gamma correction, color correction, or subdelta correction. Other operations may include a calibration, a content-dependent calibration, a time-dependent calibration, a scaling function, and/or a rotation function.

Similar to the first aspect of the invention, this second aspect may perform at least one mathematical operation on the retrieved pixel data. Such operations include, but are not limited to, correction of the brightness, gamma, color, and subdelta of the display. Other operations still include calibrating the display dependent on the content of the digital serialized video data stream or the timing of the stream. Further operations may include scaling or rotation of the video data.

According to one embodiment, digital logic may be present to determine a predefined start to light up the LEDs within one video frame and/or to determine a predefined stop to light up the LEDs. Further, non-volatile memory may be included to store the predefined start and the predefined stop. The digital logic, a processor, a controller, or other circuitry may also read the non-volatile memory and, at power-up, read the non-volatile memory to determine the predefined start and the predefined stop. Multiple such starts and stop s may be used in one image frame.

According to yet another embodiment, the video processing system may comprise volatile memory to at least store pixel information before or after the performance of the aforementioned mathematical operation. Digital logic, a processor, a controller, or other circuitry may also perform (i) gamma correction, (ii) calibration, (iii) autodetection, (iv) the reading and writing of data to and from volatile memory, and (v) the storing of measurement data instead of calibration data.

In a third aspect of the invention, a video data stream, wherein the order of the data communicated along the video data stream need not be communicated sequentially as long as the data is in a predetermined and fixed order, is generated by a laptop, Personal Computer (PC), or any other existing device that has a graphical engine or Graphics Processing Unit (GPU) incorporated therein. The Graphical User Interface (GUI) for adjusting screen settings may also be integrated in the existing GUI of the graphical engines of the existing device with a graphical engine or GPU. The aforementioned mathematical operations may be a part of the GPU system for rendering content to be displayed on the LEDs.

According to an embodiment, the video data stream may also contain an upstream communication channel to individual communicate with one or more LEDs or LED tiles via an active receiver card. The data communicated along the video data stream may also be replaced by partially rendered data.

According to fourth aspect of the invention, a computing device is provided for a display system comprising a display, wherein the computing device is configured to broadcast a serialized video data stream to a plurality of active receiver cards, each of the plurality of active receiver cards being electrically connected respectively to a corresponding tile of the display, the display including a plurality of tiles, each of the active receiver cards being respectively configured to output control signals used to control a plurality of pixels of the tile of the display corresponding to said active receiver card, wherein the serialized video data stream broadcast by the computing device includes in a serialized format video image data pertaining to each of the plurality of tiles of the display.

According to an embodiment, the computing device is a computer, personal computer, laptop, or a device having a graphical engine incorporated therein. According to an embodiment, the computing device broadcasts the serialized video data stream to the plurality of active receiver cards as an asymmetrical communication between the computing device and the active receiver card. According to an embodiment, the computing device broadcasts the serialized video data stream to the plurality of active receiver cards without requiring return communication or without confirmation from the plurality of active receiver cards to the computing device. According to an embodiment, the computing device broadcasts the serialized video data stream to the plurality of active receiver cards such that the broadcast serialized video data stream includes video image data pertaining to a first of said tiles of the display and not pertaining to at least a second of said tiles of the display and the video image data pertaining to a first of said tiles is received by both a first active receiver card corresponding and electrically connected to the first tile of the display and a second active receiver card corresponding to and electrically connected to the second tile of the display. According to an embodiment, the computing device broadcasts the serialized video data stream to the plurality of active receiver cards such that the serialized video data stream transmitted downstream from the computing device is transmitted at a higher bandwidth than a bandwidth of data transmitted upstream to the video processor.

According to an embodiment, the computing device is configured to control a LED display, such that the serialized video data stream broadcast by the computing device includes the video image data pertaining to LEDs of the plurality of tiles of the LED display.

According to fifth aspect of the invention display system comprising: a computing device in accordance with fourth aspect; a display including a plurality of tiles; and a plurality of active receiver cards, each of the plurality of active receiver cards being electrically connected respectively to a corresponding tile of the plurality of tiles of the display, each of the active receiver cards being respectively configured to output control signals used to control a plurality of pixels of the tile of the display corresponding to said active receiver card.

According to an embodiment, each of the active receiver cards comprises a non-volatile memory that stores at least one (x,y) coordinate of a pixel of the plurality of pixels of the first tile of the display that corresponds to one LED that is mounted on an LED board of the first tile, the at least one (x,y) coordinate corresponding to a particular (x,y) pixel coordinate.

According to an embodiment, each of the active receiver cards comprises a processor configured to determine a coordinate (a,b) out of the serialized video data stream, and compare the determined coordinate (a,b) to the at least one (x,y) coordinate of a pixel of the plurality of pixels.

The processor of each of the active receiver cards may be configured to extract a corresponding pixel value from the serialized video data stream.

The processor of each of the active receiver card may be configured to perform at least one mathematical operation on the corresponding pixel value.

The processor of the active receiver card may be configured to convert an outcome of the at least one mathematical operation to an output of the active receiver card.

The processor of the active receiver card may be configured to send corresponding signals to a board of the first tile containing one or more LEDs, to light up the LEDs in correspondence with the outcome of the at least one mathematical operation.

According to sixth aspect of the invention, a method is provided for displaying video images on a display system comprising a display with a plurality of tiles, each of the tiles of the display system being respectively controlled with an active receiver card that is electrically connected to a tile of the display, the method comprising: broadcasting with a computing device a serialized video data stream to a plurality of active receiver cards, each of the plurality of active receiver cards being electrically connected respectively to a corresponding tile of the display, the display including a plurality of tiles, each of the active receiver cards being respectively configured to output control signals used to control a plurality of pixels of the tile of the display corresponding to said active receiver card, wherein the serialized video data stream broadcast by the computing device includes in a serialized format video image data pertaining to each of the plurality of tiles of the display.

According to an embodiment, the computing device is a computer, personal computer, laptop, or a device having a graphical engine incorporated therein. According to an embodiment, the computing device broadcasts the serialized video data stream to the plurality of active receiver cards as an asymmetrical communication between the computing device and the active receiver card. According to an embodiment, the computing device broadcasts the serialized video data stream to the plurality of active receiver cards without requiring return communication or without confirmation from the plurality of active receiver cards to the computing device. According to an embodiment, the computing device broadcasts the serialized video data stream to the plurality of active receiver cards such that the broadcast serialized video data stream includes video image data pertaining to a first of said tiles of the display and not pertaining to at least a second of said tiles of the display and the video image data pertaining to a first of said tiles is received by both a first active receiver card corresponding and electrically connected to the first tile of the display and a second active receiver card corresponding to and electrically connected to the second tile of the display. According to an embodiment, the computing device broadcasts the serialized video data stream to the plurality of active receiver cards such that the serialized video data stream transmitted downstream from the computing device is transmitted at a higher bandwidth than a bandwidth of data transmitted upstream to the video processor.

According to an embodiment, the computing device is configured to control a LED display, such that the serialized video data stream broadcast by the computing device includes the video image data pertaining to LEDs of the plurality of tiles of the LED display.

One can appreciate that in addition to the aspects of the invention as mentioned above, other aspects of the invention implementing single elements or a combination of the elements of the various aspects mentioned are possible.

This patent application builds further on the same Applicant's earlier filed U.S. patent application Ser. No. 16/895,872, filed at the USPTO on Jun. 8, 2020, and U.S. patent application Ser. No. 17/865,096, filed at the USPTO on Jul. 14, 2022, which claims the benefit of priority to U.S. Provisional Patent Application 63/221,822, which was filed at the USPTO on Jul. 14, 2021, the contents of each of which are incorporated herein by reference. But this disclosure further focuses on the system and integration of the “on camera feature sets”, which means for on camera use of a display system (herewith e.g. a camera recording what is displayed on the display system, for instance in a studio environment) and herewith taking into account the required specifications. However, particular focus is made on the display system (and not necessarily on the camera or the use thereof, although the camera or its use could be part of embodiments described with the invention). The display system is modular in this case, as this is most complex to handle (as compared to non-modular). With modular display system is meant here that just one display can be considered, or a plurality of displays can be combined to appear together as one (large) screen or unity. Hence, the display system can be as small or as big as wanted, or as the particular application of the display system requires. Nevertheless, it can also be done on non-modular displays. One of the aims of this disclosure is to provide a method, implementation, and chipset that provides: a) Reduction of system latency by altering display topology, to protect base serial digital video link and all its features; b) Redundancy of high bandwidth low latency systems; and/or c) Directly driven by graphical card.

1 FIG. 1 FIG. 100 170 130 110 120 112 140 150 330 330 150 160 330 illustrates topologies according to the prior-art by which a systempasses video data to an array of LED display tiles. Related LED systems in general are currently based upon similar system topologies. A processortakes in the desired video image from a cameraor computer sourcebased upon, for example, HDMI or SDI cables,and performs one or more calculations and/or remapping functions onto this original image and puts it over an ethernet or an ethernet-like cable or fiber cable, usually also performing compression before it sends the ethernet or ethernet-like signal to a breakout box. Dependent on the LED tileresolution and available bandwidth, one needs to calculate manually (see calculation example in the background of the invention) how many LED tilesone can connect in loop through from one cable coming from one output of the breakout box. Numerous ethernet cablesare distributed over a several amount of LED tiles. Unlike the system ofand unlike traditional systems, as described in more detail below, the system, video processor, active reader card, and methods disclosed herein do not need or require the breakout box.

2 2 a c FIGS.- 2 a FIG. 2 b FIG. 2 c FIG. 330 330 210 240 330 250 330 210 250 210 240 210 250 330 illustrate and present the rear side of an LED tileas used in related systems and nomenclature thereof.shows the LED tilewith the “backpack”, which contains the receiver card, still connected to the electrical interfaces of the LED tile, which includes the hub board.shows the LED tilewithout the “backpack”, thus exposing the hub boardunderneath.shows the “backpack”opened, but not removed, exposing the receiver cardon the “backpack”and the hub boardon the LED tile.

3 FIG. 1 FIG. 300 300 330 130 330 310 330 illustrates a box diagram of a related modular LED display systemsimilar to. These related systemshave low flexibility. Usually, a complicated user interface is needed to configure the images that need to be sent to the correct LED tiles. Further, this system topology has an enormous influence on the processing power that is needed in the video processorto reconfigure all IP addresses or MAC addresses of the LED tilesdynamically. One needs to always reposition the video datain the memory of the processor for the necessary LED tiles.

150 240 1 3 FIGS.and 5 FIG. One of the simplest video compression techniques is converting RGB signals to YUV signals (component video). This technique does not introduce significant delay but has a negative impact on display performance. Other compression techniques-especially those that use comparative parts of frame techniques-introduce one frame of delay. Previous frames may be stored. This is compared to the actual frame and the derived information of the difference is sent the next frame; not only the compression itself has a negative effect on latency, but also the decompression of the data. Heavy compression can, dependent on computing power, introduce at least two frames of delay. Decompression logic can be part of, e.g., the breakout boxes, as can be seen in. If this part does not include decompression, then it needs to be included in the receiver card(). As an LED display uses RGB LEDs, most of the video processing happens in the RGB space, so YUV may be or is often converted to RGB and for the sake of this document, this is considered a decompression, although it has less impact on latency (because it can go very quickly from YUV to RGB). It is noted that, e.g., 4:2:2 decompression introduces at least one to two lines of delay.

It is noted that this excludes even the frame delay introduced by video scaling and/or rotation algorithms to scale, e.g., a 1920×1080 video canvas size to 180×720 or perform a rotation.

4 FIG. 4 FIG. 330 220 250 250 220 420 430 240 420 430 240 240 220 410 250 410 440 240 240 240 450 240 illustrates how related LED tilesare typically configured. An amount of LED Display modules(also called LDMs-LED boards with usually a simple mechanical housing) are plugged into a mechanical frame and electrical contact is made with a “hub board” or “hub card”. Here, four LDMs are shown, but the number of LDMs may be more or less than four. The hub boardis in fact an electrical interface between the LDMs, a power supply, and ethernet (RJ45) cable ports,and the receiver card. However, these cable ports,are not limited to connecting just ethernet cables, which are simply an example. Other types of cabling may be used to connect to the receiver card depending on the receiver card'sarchitecture. The receiver cardis the heart of the LED tile and contains the logic for driving the LEDs. The LDMsusually have a multiplexing layout wherein LEDs are connected on one side to the multiplexing and on the other side to CCDs or constant current drivers. Also shown inare the wired and/or wireless connectionsto the hub board. These connectionsprovide access points to additional hardware such as gyroscopes, accelerometers, and much more. Additionally, non-volatile memoryis provided on the receiver card. The receiver cardinterfaces with the hub boardvia the hub board interfacebuilt into the receiver card.

5 FIG. 240 300 420 430 510 310 420 430 530 310 550 560 250 450 240 440 570 1380 580 illustrates the components of receiver cardsof related systems. The cable ports,are connected to an ethernet physical layer(a.k.a. ethernet “phy”) to facilitate physical layer functions. Datareceived via the cable ports,needs to be depacketized by the ethernet depacketizerso that the data can be used. The datais then decompressed in the video decompressorwhere the video/LED processortakes that resultant data and sends it to the hub boardvia the hub board interface. The receiver card, as mentioned previously, also has non-volatile memoryto, for example, to store MAC addresses; volatile memoryto, for example, store incoming ethernet data packets; and an embedded processor.

6 FIG. 600 300 620 330 140 illustrates an embodiment of the proposed modular display system. The proposed system overcomes the problems of related systemswith much less processing needed in the video processorand much less latency. From a user point of view, people installing the screens and LED tilesmay use cheap, low bandwidth cables, such as Cat5E Ethernet cables. CAT5e cables, also known as Category 5e or Category 5 Enhanced, is a network cable standard ratified in 1999. CAT5e offers significantly improved performance over the old CAT5 standard, including up to 10 times faster speeds and a significantly greater ability to traverse distances without being impacted by crosstalk. CAT5e cables are typically 24-gauge twisted pair wires, which can support Gigabit networks at segment distances up to 100 m. Similarly, CAT6 cables may also be used. CAT6 is a standardized twisted pair cable for Ethernet that is backward compatible with CAT5/5e and CAT3 cable standards. Like CAT5e, CAT6 cables support Gigabit Ethernet segments up to 100 m, but they also allow for use in 10-Gigabit networks over a limited distance. Both CAT5e and CAT6 can handle speeds of up to 1000 Mbps, or a Gigabit per second.

640 645 640 610 620 640 630 630 630 According to a preferred embodiment, a digital high speed serial protocol is used (e.g., coax express) to transmit a video data streamusing a transmission line, for example, one or more coaxial cables. The video data streamis the resulting video stream of the video datahaving passed the video processing system. It is noted that the present disclosure is generally not limited to a specific type or cable or standard. It is noted that an HDMI connection is also a possibility, but the cable connections may be deemed not rugged or durable enough for most installations. In summary, what a (serialized) simple video protocol is used for transmitting the video data streamto a plurality of the LED tiles, and preferably to all LED tilesat once, for example, as a broadcast transmission protocol, instead of using ethernet or ethernet-like protocols that needs to send individual (personalized) data to each of the individual LED tilesin the LED screen. Such a broadcast serialized simple video protocol does not require addressing to one or more specific tiles or to one or more receiver cards corresponding to the one or more tiles of the display. In other words, the serialized simple video protocol for transmitting the serialized video data stream can be unaddressed. Or the serialized video stream data may be addressed or transmitted to one or more groups (plurality) of tiles collectively, which may be all or a subset of all tiles of the system (i.e., for example, multicast or anycast).

640 630 640 630 640 630 720 640 630 130 720 720 640 144 6 FIG. Further, the video data streammay be transmitted to two or more of the individual LED tilesdirectly, such that video data streamis transmitted in parallel to at least two or more of the LED tiles, or the LED tilesmay be arranged to receive the video data streamin a serial arrangement, as shown in. Or, in another embodiment, one or more of the LED tiles may be arranged to receive the video data stream in parallel and one or more of the LED tiles may be arranged to receive the video data stream in series. In contrast to current or relevant systems, more than one, some, most, or indeed, in a preferred embodiment, all LED tilesin the proposed system see or receive the “full” video transmission of the full image and hence, a tile processor (comprised in, and also referred to as active receiver card)needs to extract or in other words, read out or take out from the video data streamjust that part of the video that pertains to that specific LED tile, and simply display it by outputting control signals that control pixels of the tile. In fact, this means that the complex logic is distributed all over the display instead of centralizing all the logic in an expensive processor. At first glance, this might seem as less cost effective. But the impact on performance is immense, as this non-centralized approach enables a performance of (many) more calculations and implementation of more complex algorithms as the pixels which need processing locally in the active receiver cardwill be less compared to the amount of pixels that are needed for full screen processing as done in related LED processing approaches. By the active receiver cardextracting, or in other words reading out of the video data streamthat part that pertains to the specific LED tile corresponding to the active receiver card, it should be noted that ‘pertaining’ does not necessarily mean that the amount of pixels extracted from the data stream is exactly the same amount as the amount of pixels that need to be controlled, or that extracted video data is necessarily received in a predetermined group or order. In a preferred case, it is true that the amount of pixels extracted from the data stream is exactly the same amount as the amount of pixels that need to be controlled. But it may be the case, in another embodiment, that, for example, the tile has an array of 12 by 12 pixels, which would in the preferred embodiment mean data related to the 144 pixels should be extracted from the stream. But suppose it may also be the case that, in another embodiment that only 10 by 10 pixels is extracted and used an interpolation scheme in the processing to really compute.

645 640 630 330 250 300 240 720 330 250 630 720 640 6 FIG. 7 FIG. Although a transmission lineis shown inas a wired line, according to another embodiment the video data streamis transmitted wireless to one or more of the individual LED tiles. Additionally, according to a preferred embodiment, the topology of related LED tileswill not be touched, or, more specifically, their hub board'swill not be touched so that a swap with related systemsand receiver cardswith our new “real processing cards”() is rather easy. Hence, a retrofit of the existing LED tilefleet is also made possible without making any mechanical nor electrical changes to the hub board. Further on, by using a simple or simplified protocol, system (frame) latency can be reduced significantly, as described in greater detail below. In a preferred embodiment, each tileof the display has one respective, corresponding active receiver card. However, in another embodiment, two or more tiles can have (share) an active receiver card that receive the video streamand extracts the part of the video that pertains to each of the tiles sharing the active receiver card, with the active receiver card controlling each of the tiles through output control signals based on the extracted video data. Or alternatively, in another embodiment, it may be considered that one tile can have two corresponding active receiver cards, such that two or more active receiver cards extract data pertaining to the tile and output control signals to the tile, for example, each of the active receiver cards controlling a separate portion (e.g., area) of the tile, or different pixels, or different subpixels (e.g., colors) of the tile.

330 630 Although only LED displays, with their respective LED tiles,, are mentioned above and below, the concepts of this disclosure could easily be configured to work with most or other types of displays-especially those that are configured to display images based on an array of pixels and their respective pixel data. For example, Liquid Crystal Displays (LCDs) implement an array of pixels like that of an LED display. Other examples of displays implementing an array of pixels would be resistive or capacitive touch displays such as those used in smart devices and even Cathode-Ray Tube (CRT) displays. More examples, although inherently included as LED displays, are Active Matrix Organic Light Emitting Diode (AMOLED) displays, Organic Light Emitting Diode (OLED) displays, Full-array LED displays, Mini-LED displays, Micro-LED displays, Quantum LED (QLED) displays, Quantum Dot-OLED (QD-OLED) displays, and more.

7 FIG. 4 FIG. 720 630 630 330 720 720 450 650 710 730 420 430 300 710 730 640 710 730 420 illustrates an embodiment of the proposed active receiver cardconnected to an LED tile. Note that the layout, as mentioned above, of the overall LED tileis similar to that of related LED tile configurations(), however, a key difference is the proposed active receiver card. This active receiver cardaccording to this embodiment uses a similar hub board interfaceto connect to the hub boardbut uses interfaces,that allow for higher bandwidth than the interfaces,of related systems. These interfaces,may be, but are not limited to, connecting with transmission line, such as one or more coaxial cables, for the transmission of the video data stream. By “higher bandwidth”, it is noted that the ratio of the comparative bandwidth of interfaces,with the interfaces, may be greater by a factor of 1.5 to 1, 2 to 1, 3 to 1, 4 to 1, 5 to 1, 10 to 1, 100 to 1, 1,000 to 1. The control signals output by the active receiver card are used to control a plurality of pixels of the tile of the display, in a preferred embodiment, travel over a control board and that control board interfaces to a LED board that has drivers that generate PWM or relevant signals to light up the LEDs.

8 FIG. 9 c FIG. 720 630 600 640 640 710 640 810 620 720 620 720 720 620 710 730 710 730 630 640 560 560 630 720 650 450 630 720 440 570 580 240 720 820 630 720 720 630 630 720 640 630 640 630 630 640 640 630 illustrates an embodiment of an active receiver cardwith its components, to be used or integrated in a display tileof which a plurality being part of the proposed modular display system. The incoming data, comprising broadcast serialized video data stream(e.g. at 6.2 or 12.5 Gbps bandwidth) and for example also including one-way or two-way communication information (e.g. at 20 Mbps bandwidth), is seen or received first by interface, which passes the datato the video transceiver/reclocker. According to an embodiment, a one-way communication comprises a downstream communication from the video processing systemto the active receiver cardwith/for delivering information. According to an embodiment, a two-way communication comprises a downstream communication from the video processing systemto the active receiver cardwith/for delivering information, and an upstream communication from the active receiver cardback to the video processing systemfor example with returned information. Hence, the two-way communication goes in two directions (back and forward), whereas the one-way communication goes only in one direction (forward towards the tiles). It is also noted that here, in this embodiment, two interfacesfor the input of data, and two interfacesfor the output of data are illustrated, in case e.g. there are two video streams to pass simultaneously (such as e.g. further discussed within the chapter of ‘Redundancy’). According to an embodiment, only one interfacefor the input and only one interfacefor the output are present. Data needed by any specific LED tilewill be read from the overall dataand sent to the video/LED processor. After passing through the video/LED processor, the resultant data for the tilein particular connected to the active receiver card, is sent to the hub boardvia the hub board interface, for eventually controlling the plurality of pixels comprised in the tile, i.e. for example controlling what has to be emitted by the pixels (in terms of e.g. image, color, light output, brightness etc.). The proposed active receiver cardalso has non-volatile memory, volatile memory, and an embedded processorfor performing many of the same tasks as related receiver cards. The active receiver cardmay further include syncbanding logiccapable of mitigating the effects of banding when data is captured using, for example, motion picture camera systems. Additionally, all data, including the data read by the specific LED tile, is allowed to pass through the active receiver card, and to leave the present active receiver cardand the present tile, to consecutively go to a next active receiver card of a next tile of the display system. This step allows other LED tiles, and their active receiver cards, to analyze the dataand read the data specific to each tilerespectively. This process is performed so that all the (video) datacan be seen by each LED tileof a display, wherein each LED tilereads only the (video) datarelated to itself while all of the (video) datato pass through to other LED tiles.

20 FIG. 600 640 610 620 640 645 600 620 660 660 630 640 710 720 630 645 640 720 560 720 560 670 630 720 450 630 630 560 640 730 720 730 640 630 720 640 630 660 640 660 illustrates a further embodiment of the proposed modular display system, in accordance with the invention. Again here, the video data streamis the resulting video stream (or broadcast serialized video data stream, comprising all or not one-way or two-way communication information) of the video datahaving passed the video processing system. In order to transmit the video data stream, a transmission lineis again provided. The modular display systemcomprises, in addition to the video processing system, a display. The displaycomprises a plurality of tiles, here for example eight tiles. The tiles can be connected both mechanically and electrically. Each tilemay comprise one or more LED boards. The overall incoming datais seen or received first by (input) interfaceof the active receiver cardof a tilebeing connected to the transmission line. The dataherewith passes through, within the active receiver card, e.g. via a video transceiver/reclocker towards the video/LED processorof the active receiver card. After or when passing through the video/LED processor, the resultant data and/or control signalsfor the tilein particular connected to the active receiver card, are sent to the interface, to be sent to the pixels and/or LEDs of the one or more LED boards of the tile, and for eventually controlling the plurality of pixels and/or LEDs comprised in the tile(and mounted on the one or more LED boards), i.e. for example controlling what has to be emitted by the pixels and/or LEDs (in terms of e.g. image, color, light output, brightness etc.). Having passed the video/LED processor, the video data streamis further passing through (with the overall data) towards interface, and hence leaves the active receiver cardvia this output interface. The video data streamnow further continues to next neighboring tile, also having an active receiver card, and thus following the same principle again for controlling the plurality of pixels and/or LEDs comprised in this next neighboring tile. The video data streamfurther follows from one tile to another, further proceeding the control of the plurality of pixels and/or LEDs for each tile of the display. After having passed all the tilesof the display, the video data streammay exit the display, for example to another neighboring display (not shown).

9 a FIG. 4 5 FIGS.and 330 300 420 430 240 240 920 922 924 926 330 922 924 924 926 912 922 924 924 illustrates the redundancy between LED tilesin related systems. In related systems, usually 2 ethernet (or ethernet-like) ports,are being used on a receiver card(see). One can use the open port of a receiver card(last in a chain of a branch of a tree) to also input the data needed for that particular branch of the tree. Here, four LED tiles,,,, which individually are the same LED tilesdescribed above, but are given specific names here for exemplary purposes, are shown in one such branch. If, e.g., the cable between Tile Band Tile Cis damaged, then still Tile Cand Tile Dreceive data from the redundant data ethernet link. However, if the cable between Tile Band Tile Calso breaks, Tile Cdoes not see or receive any data and remains black. So, a fault tolerance of one cable is obtained.

9 b FIG. 9 a FIG. 953 954 955 956 930 931 953 940 931 940 953 954 940 955 956 942 illustrates an embodiment of the proposed solution to the link break of. The proposed active system described comprises at least five electrical interfaces which can use the firstand secondelectrical interfaces as inputs and mirror the same data on the thirdand fourthelectrical interfaces. This is the case wherein the data inis exactly the same as the redundant data in. If one cable is broken, e.g., between the first electrical interfaceand Tile A, then the tile will still show data because the redundant data ininterface remains viable. Tile Adoes not see any activity on the first electrical interfaceand will use the data from the second electrical interface. So, Tile Awill keep on showing the image. The thirdand fourthelectrical interfaces will then be driven by data received from the second electrical interface, so that both output channels are active to the next tile, e.g., Tile B. This in fact means full redundancy as N cables may be damaged in an N tile system (but of course, not both cables may be damaged in between two consecutive tiles).

9 c FIG. 9 b FIG. 15 FIG. 953 954 640 955 956 640 620 620 630 640 957 330 953 955 956 955 956 640 953 954 953 954 953 954 illustrates a generalized embodiment implementing redundant data features. In the active LED video processing system embodied here, there are at least five electrical interfaces (the same electrical interfaces as described above for). The firstand secondelectrical interfaces being capable of receiving a high bandwidth linear digital serialized video data stream with downstream communication. The thirdand fourthelectrical interfaces being capable of sending a high bandwidth linear digital serialized video data stream with downstream communication. This high bandwidth linear digital serialized video data stream may be thought of as with downstream communication, wherein datais communicated downstream from a video processorin a significantly higher amount than the data communicated upstream to the video processor(this is referred to as being asymmetrical), and wherein the order of the data communicated need not be communicated sequentially (linearly) as long as the data is in a predetermined and fixed order such that each LED tile“knows” exactly where in the incoming datathat segment specific to it is (see discussion on). An example of high bandwidth could be a bandwidth greater than 5 Gbps but could more or less than that amount, for example, 3 Gbps, 6.2 Gbps, or 12.5 Gbps. A fifth electrical interfaceis electronically connected directly or indirectly with a board containing one more LED tiles. Digital logic is provided to connect the first electrical interfaceto the thirdor fourthelectrical interface, to connect the second electrical interface to the thirdor fourthelectrical interface. Moreover, digital logic is provided to change predetermined data in the serialized video data stream, received from the firstand secondelectrical interfaces. Digital Logic may determine activity on the firstand secondelectrical interfaces. Digital logic can retrieve pixel data from either or both of the firstand the secondelectrical interfaces. As used herein and throughout this disclosure, “digital logic” or “a processor” are used interchangeably to refer generally to what is understood to be hardware digital logic, digital logic circuitry, control circuitry, or other circuitry or controlling circuitry, a microprocessor, or one or more processors, controllers or computing devices that operate based on received or stored instructions, such hardware being formed of one or more integrated circuits or otherwise, which may be implemented on a single metal-oxide-semiconductor integrated circuit chip or otherwise, which may include electronic components, for example, transistors, diodes, resistors, gates, relays, switches, amplifiers, inverters, buffers, and/or capacitors, etc., that are used to receive, process, perform logical operations on, and/or store signals, data, and/or information, including digital and/or analog signals, or continuous or non-continuous signals, and output one or more signals based thereon.

953 954 950 951 720 In an embodiment, the firstand secondelectrical interfaces can be used in parallel. This means that two streams arrive,in the active receiver card. If the two streams contain different video information, then the active bandwidth is doubled. Examples of this include, but are not limited to, a channel that uses odd pixels and the other channel using even pixels; or one channel can be the top of the image, the other the bottom of the image; also left/right (eye) is a possibility.

950 951 720 In an embodiment, one can use the first channelfor one video feed, the second channelfor another video feed (e.g., from a camera) and perform source switching in the active receiver cardor even show two different images superimposed onto each other or even switch images in one single frame, e.g., show another image during camera shutter opening time.

It is noted that herewith a substantial improvement over related systems and methods, for example, whereas related systems and methods, such as GhostFrame™ doubles the frequency showing two subsequent different images every frame.

300 1920 Frame rate conversion Ethernet or ethernet-like packaging transmission Video compression techniques Related LED processing systemshave inherent frame delay by design. Frame delay is defined at the time the video updates its content (at vertical sync). Each vertical sync a new image is presented over the video stream, starting with line 1 and its amount of pixels, e.g., then issuing a horizontal sync indicating a new line is presented at the video stream, again for the same length of pixels. This is repeated until all lines are shown, e.g., 1080 lines, and then subsequently issuing another vertical synchronization signal. For live and studio events it is extremely important to reduce the latency as much as possible. For example, at a live event wherein an LED screen is used, one does not want the sound of the performer to come earlier to the audience whilst the screen is still displaying images of the performer “moments/frames” earlier. This can be extremely annoying and disturbing. The same is true wherein, e.g., in a studio environment, wherein an LED screen is used for displaying special effects and background, wherein the special effects come later in time compared to the actors' movement. Frame delay is introduced due to multiple video processing methods:

10 FIG. 1010 310 300 310 1020 illustrates the effect of latency in video processing. When the cameracaptures an image or video, the dataneeds to be processed, and usually is according to the related systemdescribed above, in order to then be displayed. The steps of this process, with current technology, cannot be done instantaneously. Rather, the datais captured and then displayed at a later time on a display. In reality, a latency of 50 milliseconds between capturing an image and displaying said image is common.

310 240 A related video technique is to, e.g., convert video with a frame rate of 75 Hz to 60 Hz. This means that instead of sending dataevery 13.3 milliseconds, the video is only updated at 16.66 milliseconds. It is noted that this is sometimes also used in compression techniques. Usually, the frame rate is down-converted to a standard, e.g., 60 Hz, frame rate used by related receiver cards. The full scope of explanation is out of the scope of this document, but it can be done in a very simple way, wherein part of the frame is repeated in the next frame, which introduces a very awful repetition of part of the frames and introducing motion artefacts in the image. Other more complex algorithms try to interpolate within the frames. This means that full frames need to be stored and out of 2 frames the motion is attempted to be estimated. This means that, with a good estimation, at least some latency is introduced (waiting for enough video frame information to derive a better new frame/motion estimation).

11 FIG. 1120 1130 1110 1140 1110 1140 illustrates a timing diagram between two vertical synchronizations of a display. Two LED tiles, Tile Xand Tile Yare given as examples of two parts that make up a display.andshow the same screen but between two different vertical sync cycles: between vertical sync cycles A and B () and between vertical sync cycles B and C (), respectively.

12 FIG. 1220 1230 1210 1240 1210 1240 1220 1230 310 1210 310 130 310 1380 1220 1220 1230 1210 1220 1210 1240 illustrates the timing differences between two LED tiles,during vertical synchronization cycles.andshow the same screen but between two different vertical sync cycles: between vertical sync cycles A and B () and between vertical sync cycles B and C (), respectively. Here, Tile Xand Tile Yneed to receive video dataaccording to their respective position on the Screen Display. Before anything can happen, one needs to wait a time ta before all video data informationhas been received (and stored) in the video processorof related systems. After this period, the video data informationfor that particular tile can be fully processed and packaged and made ready for ethernet or ethernet-like protocol that uses packages(in ethernet they sometimes call them “frames”). Data for Tile Xcan be sent during time tb during this time of sending data from Tile X, the data of Tile Ycannot be sent. This can only be sent during time tc. Most systems even wait until vertical sync B to start sending all tile data during Frame A already introducing one frame of delay. Time tc represents the continuation of the vertical sync as it moves down display A. Time Tb represents the time just after vertical sync B begins during which the data from Tile Xis sent from display A. Likewise, Tc represents the time just after vertical sync C as it moves down display B.

240 1220 1380 1380 1380 240 310 1220 1220 1230 1380 1380 12 FIG. On the receiver side (the ‘receiver card’part), e.g., Tile Xneeds to wait until all packetsare received. It is further noted here that not all packetsmight arrive in the same order as they have been sent and, in the case of a system wherein ethernet switches and routers are used, packetscan get lost or might not arrive in the same order. Hence a buffer in the receiver cardis used. It is only at that point that the full video datameant for Tile Xcan be processed. But since all tile data, meaning data form Tile Xand Tile Ycomes in in a random order, one needs to make sure (and wait) for a certain time before they can show their content synchronously. Most related systems try to estimate the time (sync processing, using, e.g., PID estimators when a new sync packeted signal will arrive). It is only then when the respective tiles reliably can start showing the content. This, again, means introduction of frame delay (because of waiting, you get delay). It is noted that this is only the simple case wherein packetsdo not get lost and wherein there is no ethernet congestion so that all packetsarrive. The above timing schedule is depicted in.

13 FIG. 1310 1320 1330 1340 1350 1370 1360 1310 1320 1390 1330 1340 1350 1370 310 illustrates the standard IEEE 802.3 Ethernet Frame Format with its respective parts. At least 26 bytes are “wasted”,,,,,containing no video information. These 26 bytes comprise the following: the preamble(7 bytes); the start frame delimiter(1 byte); the ethernet header(14 bytes), which itself comprises the destination address(6 bytes), the source address(6 bytes), and the length indicator(2 bytes); and the frame check sequence(CRC) (4 bytes). The video dataitself can be of varying byte lengths, for example, between 46 and 1500 bytes.

13 FIG. 1380 1340 1330 330 330 130 1380 330 1380 130 330 330 330 240 1380 130 As one can see in, ethernet packetscontain a source addressand destination address. In most cases these addresses are MAC (Media access control address) addresses. For detailed information, this can also be found here: en.wikipedia.org, which is herein incorporated by reference as available as of Dec. 18, 2022. Apart from the overhead, using this system also has a significant drawback. The processor must know at first which MAC addresses are in the network (i.e., how many LED tilesthere are and what address they have). It also needs to remember their position in the image. Retrieving its position can be done by querying the LED tilefor its position or retrieve it from a non-volatile storage locally in the processorsystem. It is only after this sequence that the processor can start sending ethernet packetsto this particular LED tile. The packetsare then derived from the position in the video image and composed/computed locally in the processor. Most existing systems do not store the position of the LED tilein local non-volatile memory of the tile. In fact, most systems consider the LED tiles(and its receiver cards) as dumb devices that just need to execute on receipt of the data packetsto show the video. All is centralized in the expensive video processor. Hence, if a processor fails, and a replacement processor must be fully reconfigured to having all settings exactly the same as the failed processor, e.g., it needs to know what to send where, how many tiles are there etc., before an image can be displayed.

330 330 3 FIG. Also, the topology is ethernet based, meaning that there is no way of determining an LED tile'sposition in the ethernet tree (). One can only find out that there are a particular amount of tiles over the full network. One needs to manually position (using a user interface) all LED tilesat the correct position on the video canvas.

1 3 FIGS.and 5 FIG. 130 310 330 330 240 310 420 430 240 1380 1380 560 240 570 1380 310 440 240 580 130 330 450 220 250 440 220 130 As seen earlier in the text, existing commercially available processing systems () have a fully centralized system around an expensive video processordevice that sends individual tile video datato the respective LED tiles. The tiles act as “slave” devices wherein the data is distributed in a tree like topology. The LED tilescontain a receiver cardthat interprets this data. Full details can be seen in. Blocksandrepresent two ethernet ports. In fact, only one ethernet port may be enough, but usually a second is added to loop though the ethernet network and to have (limited) redundancy in the system. The receiver cardfurther contains logic to store and count the Ethernet packets. Once all packetsare received, when using decompression, the video is decompressed. Subsequently, this data is then used by the video/LED processor. These cardsusually have volatile memoryto store the ethernet data packetscontaining video data. Further, there is also non-volatile memoryto store at least the MAC address (i.e., unique address of the receiver card, serial number, and perhaps some other settings). Also, in most cases an embedded processoris used to control the internal settings and respond to communication packets sent by the processor. As one can see, there's a lot of overhead before the video can even be processed. This usually encompasses gamma correction and generates data for the constant current drivers which reside on the LED tiles. This data is “transported” over the hub board interface(to an LED modulevia the Hub board). In some cases, the non-volatile memoryalso contains correction data and/or calibration data for the LEDs used. This memory can also reside on the LDMs. This data is not always computed locally but sent by the processor. This is called calibration data which is derived from measurement data.

720 720 1380 710 730 620 330 220 640 720 620 720 330 440 720 620 7 8 FIGS.and In comparison to the above, an active receiver cardis provided. Herein, “active” means that the receiver cardperforms an active computation and the actively takes out (or in other words, extracts or reads out) that part of the video data stream it needs to display. And as a further example, the active receiver card does not—or does not necessarily have to—wait for packets, but actively gets in the full video data stream received on either/both interfaces,() (between video processorand LED tile/module,) on which it actively performs tasks which are described later. These interfaces see the full or approximately the full high bandwidth digital serialized video data stream. In other words, every active receiver cardhooked up to the video processorsees the full video image. Due to its active nature, the active receiver cardsystem takes out that part of the video it needs to display. This position depends on the physical location of the particular LED tilein the screen and image and is also dependent on the number of pixels (horizontal, vertical, or shaped) it has. These parameters are locally stored in the non-volatile memoryresiding also on the active receiver card. Further, these parameters only change when the system (video processor) is instructed by the user to be changed.

15 FIG. 13 FIG. 1500 1570 1580 1570 1580 1550 1560 1550 1560 1530 1540 1500 640 1512 1516 1518 720 720 720 330 illustrates a proposed data package format. It further illustrates an ideal ethernet or ethernet-like data package formatand a realistic ethernet or ethernet-like data package format. Note that each packet as seen in both the idealand realisticethernet or ethernet-like data package formats contain the information from. These individual packetsare sent consecutively, but in reality, the order of in which these packetsarrive is often not as they were sent; hence, a buffer is used to hold the data before reordering all the packets properly and commencing a vertical sync cycle. Both the idealand the realisticethernet or ethernet-like data package formats contain SYNC packetsand Comm packets. The data package formatfor the digital serialized video data streamhas communication slots embedded within it, e.g., Data LINE 1, Data LINE 2, and Data Last Line. It is through these communication slots that the active receiver cardreceives, e.g., updates on its physical position within the overall display. Because the active receiver cardis active, it also “knows” how many pixels it has on the canvas and how they are spaced over the video canvas. By consequence, the active receiver cardactively takes out the representative RGB video values it needs to display according to the LED tileposition.

1500 300 640 640 630 600 640 630 640 640 630 600 An important improvement of the proposed data packet formatover related systemsis that the video datamay come in any order. The video datamay come linearly (i.e., the data for pixel 3 comes after the data for pixel 2 which comes after the data for pixel 1 and so forth) or, for example, the information for the last LED tilein a systemmay be in the middle of the video data steam, but as long as the order of the information is predetermined and fixed (i.e., all the LED tilesof a system already “know” where the video data specific to themselves resides within the video data stream), then the tile may pick out the data specific to it from the middle of the stream and display it. This holds true for all the LED tiles regardless of (i) their own order within an LED tile array or (ii) the position of their respective data within the video data stream. The above is simply an example, but the information for the last LED tilein a systemmay come first, or second, or in the middle, or last—the order does not matter as long as it is predetermined and fixed.

16 FIG. 16 FIG. 640 1520 720 1520 1610 1680 1612 1520 1680 1680 1680 1960 1520 1614 1680 630 illustrates an example of how the video data streammay be implemented. Assume a command is embedded in Comm downstrthat tells all active receiver cardsnot to send any embedded Comm downstrdata. This command would be communicated via Comm Ato the Nth Tile. This means that the Comm Bdata stream does not contain the Comm downstr, as shown in. It is known that only the Nth Tilereceives communication. The Nth Tile is assigned and addressed, e.g., as Tile N. Tile Nwill remember its address and, since it has received an address already, can apply logic in such way that it does not listen anymore to an addressing command. Also, this addressing command will tell the logic to now pass through all communication “Comm B after giving address to Tile N.” Hence, Tile N+1will be the only tile that will listen to an “assign address command with address N+1.” It will then not listen to any address command anymore and will pass through all Comm downstronto Comm C. So, this is a way to address all tiles in a link. If there's also an upstream channel, a “reply, e.g., can be sent. Tile Nsends that it was successfully addressed. If there are, e.g., N+1 tiles, the addressing command for Tile n+2 will not send an acknowledge signal as it is not in the link or data stream. Hence, the control logic can also count how many LED tilesare on this particular link. It is noted that SOF here means start of Frame; EOL means end of Line. For a system containing counter logic, the two ‘indicators’ can be used to determine how many pixels are in one line and how many lines are in one frame.

630 640 At this point, it may be known how many tilesare on the linkand they are all addressed.

330 330 330 In an ethernet tree-based system it can be determined how many tilesare hooked up to the system (e.g., by having every tilebroadcast their MAC address), but it may not be known their position in the full link or tree. So, intrinsically related systems can never be auto-configurable (unless sensors are put on the sides of a tile).

330 330 According to the invention, since all tilessee the video and since they can be auto-addressed, the processor does not even need to know how many tilesthere are on the link. It just needs to send the digital serialized video stream.

17 17 a b FIGS.- 17 a FIG. 17 b FIG. 1710 630 1720 630 630 630 720 440 illustrate two possible embodiments of the proposed video processing system. Two simple rectangular configurations are shown. In, a 2×2 configurationof LED tilesis shown. And in, a 2×6 configurationof LED tilesis shown. For simple rectangular configurations-if we now tell the tileshow the link was made and how many tiles horizontally and vertically there are, an auto-positioning system can be devised, assigning all start (x, y) configurations to the tiles. This logic can also reside in the active receiver cardsas they have a non-volatile memorywherein is stored how many LEDs horizontally and vertically there are (or more complex if any non-rectangular shape is known). They know their address and they know (by, e.g., the address number) what position they are in the link and if we tell the tiles where the link starts, and how many tiles we have horizontally and vertically, then they can compute their own start (x, y) position.

1510 1520 16 FIG. It is noted that this system can change position of tiles certainly in one frame as each digital serialized video data stream has at least one communication slot between two SOFs(Start Of Frame), as for example depicted in. It is also noted that this Comm downstrcan contain metadata, e.g., to use other brightness or to use other gamma curves as specified in HDMI 2.1 standard.

According to an embodiment, in the metadata, also (x,y,z) coordinates (or a “coordinate set”) of, e.g., a camera moving arbitrarily in front of a studio screen or a user can be embedded to be sent to the tiles. Since the tiles “know” at what physical location they are, the calibration data can be changed in real-time (e.g., to correct for viewing angle). The system for real-time color and brightness correction dependent on viewing angle is already described in U.S. patent application Ser. No. 16/895,872, filed at the USPTO on Jun. 8, 2020, and U.S. patent application Ser. No. 17/865,096, filed at the USPTO on Jul. 14, 2022, which claims the benefit of priority to U.S. Provisional Patent Application 63/221,822, which was filed at the USPTO on Jul. 14, 2021, the contents of each of which are incorporated herein by reference.

720 440 630 630 630 620 720 Because the active receiver cardshave a non-volatile memory, all tilescan remember their settings at start-up. There is local intelligence whereas the individual settings of the tilesare locally stored within each tile. As a result, switching video processorsis rather easy (as opposed to related systems) as long as a processor sends the video data stream and subsequently the active receiver cardsjust take out that part of the video it needs to display linked with all other settings such as brightness gamma curves etc.

720 720 It is further noted, that due to the intelligence, the active receiver cardcan also contain logic to measure time between vertical sync pulses. According to the timings received, it can optimize clocks, data, and bit depths to maximally fill the time the LEDs light up during one VSYNC period. A filter can be applied in such a way that variations in VSYNC measurements are detected (within a small margin), and consequently all relevant timings and settings are updated and calculated by the active receiver card. This happens after recalculation immediately.

18 FIG. 1800 130 620 1810 720 1810 640 630 620 130 1810 illustrates a next level LED display systembased on the concepts of the present disclosure. The system as described enables even a further step wherein a “display-system” does not need to be hooked up to a screen processor,. Any system that transmits (or in other words “speaks”) the right digital serialized video data stream (with or even without) downstream communication can be hooked up directly to, e.g., a computer or laptop wherein the graphical engine/cardof that computer is hooked up to the display. The logic for configuration (setup) can also reside in the active receiver cards. Alternatively, this logic can be added into the graphical enginewith a user interface wherein the display settings are integral part of the graphical engine settings. It is noted that HDMI and display port can also be seen as high bandwidth linear digital serialized video data streamsalthough they use multiple lanes for serializing data. The above in fact means that the modular LED tilescan be treated just as one display (monitor, TV set, projector, gaming consoles, set top boxes, video switchers, etc.) without the need of any screen processor,. Some graphical cardseven have multiple outputs, so they can drive multiple monitors in parallel. Now just replace the word “monitor” by modular LED screen.

1810 720 1810 1810 18 FIG. In a further embodiment, some graphical computations for generating an image on a display make use of “mathematical” operations as well. The wording is best known from gaming consoles but is also gaining much traction in VR/AR applications. Mathematical functions such as clipping, rasterization, fragment shading, texturizing, texture mapping, are typically done in GPUs(Graphical processing Units). A step further is that the active receiver cardscan be part of this GPUfunctionality (the GPU is part of gaming and VR/AR engines). Inwe added in, a GPU which is an intrinsic part of a PC, Game console, set-top box etc.

19 FIG. 19 FIG. 1900 720 1810 1910 330 1920 630 1910 illustrates a further embodiment of a next level LED display system, wherein the graphics processing functionality is globalized. Since the active receiver cardsare active, they can also include part of the GPUfunctionality and become part of the “Global” GPU system. The PC contains the GPU master (GPU-m)and the tileseach have their own GPU slaves (GPUs). Since LED tilescontain far fewer pixels, they can perform all their own processing and/or mathematical functions for pixels in parallel (e.g., clipping of GPU, e.g., shading), meaning that the “render power” of the GPUdoes not need to be that high or it can be kept the same, but adding extra functionality. Also, latency and performance will not be limited by the size of the canvas anymore (e.g., 1920×1080). Some functions (as in) are done in parallel over 12 tiles, as is shown in this example, hence increasing performance by a factor of 12 or even reducing latency by a factor of 12.

This disclosure provides various examples, embodiments, and features which, unless expressly stated or which would be mutually exclusive, should be understood to be combinable with other examples, embodiments, or features described herein.

In addition to the above, further embodiments and examples include the following:

1. An active receiver card for a display, the active receiver comprising: a processor; a first interface configured to receive a serialized video data stream as input from a video processing system, the serialized video data stream including a plurality of portions of the serialized video data stream, each of the plurality of portions of the serialized video data stream pertaining to a corresponding one of a plurality of tiles of the display, including at least a first tile and a second tile, such the plurality of portions of the serialized video data stream include at least a first portion of the serialized video data stream including video image data pertaining to the first tile of the display and a second portion of the serialized video data stream that includes video image data pertaining to the second tile of the display; wherein the active receiver card is configured to be electrically connected to the first tile of the plurality of tiles of the display; wherein the active receiver card further comprises a second interface configured to output control signals to a plurality of pixels of the first tile of the plurality of tiles of the display; wherein the active receiver card is configured to extract from the received serialized video data stream the first portion of the serialized video data stream that includes the video image data pertaining to the first tile of the display, and based thereon, the active receiver card is configured to output the control signals to the plurality of pixels of the first tile of the plurality of tiles of the display.

2. The active receiver card according to any one or a combination of one or more of 1 above and 3-12 below, wherein the active receiver card receives both the first portion of the serialized video data stream and the second portion of the serialized video data stream in a linear manner such that the first portion of the serialized video data stream is received in a periodic order before the second portion of the serialized video data stream.

3. The active receiver card according to any one or a combination of one or more of 1-2 above and 3-12 below, wherein the active receiver card is configured to receive through the first interface all of the plurality of portions of the serialized video data stream pertaining to each of plurality of tiles of the display.

4. The active receiver card according to any one or a combination of one or more of 1-3 above and 4-12 below, wherein the active receiver card is configured to receive through the first interface all of the plurality of portions of the serialized video data stream pertaining to each of plurality of tiles of the display in a predetermined order.

5. The active receiver card according to any one or a combination of one or more of 1-4 above and 6-12 below, wherein the second interface is directly or indirectly electrically connected to a board of the first tile of the plurality of tiles of the display, the board containing one or more LEDs.

6. The active receiver card according to any one or a combination of one or more of 1-5 above and 7-12 below, wherein the active receiver card is configured to operate asymmetrically with the video processing system such that the serialized video data stream transmitted downstream from the video processing system is transmitted at a higher bandwidth than a bandwidth of data transmitted upstream to the video processor.

7. The active receiver card according to any one or a combination of one or more of 1-6 above and 8-12 below, further comprising a non-volatile memory that stores at least one (x,y) coordinate of a pixel of the plurality of pixels of the first tile of the display that corresponds to one LED that is mounted on an LED board of the first tile, the at least one (x,y) coordinate corresponding to a particular (x,y) pixel coordinate.

8. The active receiver card according to any one or a combination of one or more of 1-7 above and 9-13 below, wherein the processor of the active receiver card is configured to determine a coordinate (a,b) out of the serialized video data stream, and compare the determined coordinate (a,b) to the at least one (x,y) coordinate of a pixel of the plurality of pixels.

9. The active receiver card according to any one or a combination of one or more of 1-8 above and 10-12 below, wherein the processor of the active receiver card is configured to extract a corresponding pixel value from the serialized video data stream.

10. The active receiver card according to any one or a combination of one or more of 1-9 above and 11-12 below, wherein the processor of the active receiver card is configured to perform at least one mathematical operation on the corresponding pixel value.

11. The active receiver card according to any one or a combination of one or more of 1-10 above and 12 below, wherein the processor of the active receiver card is configured to convert an outcome of the at least one mathematical operation to an output that can be interfaced with the second interface.

12. The active receiver card according to any one or a combination of one or more of 1-11 above, wherein the processor of the active receiver card is configured to send corresponding signals to a board of the first tile containing one or more LEDs, to light up the LEDs in correspondence with the outcome of the at least one mathematical operation.

1. A method for controlling with an active receiver card pixels of a display having a plurality of tiles, the active receiver card being electrically connected to a first tile of the plurality of the tiles of the display, the method comprising: receiving by a first interface of the active receiver card a serialized video data stream as input from a video processing system, the serialized video data stream including a plurality of portions of the serialized video data stream, each of the plurality of portions of the serialized video data stream pertaining to a corresponding one of a plurality of tiles of the display, including at least a first tile and a second tile, such the plurality of portions of the serialized video data stream include at least a first portion of the serialized video data stream including video image data pertaining to the first tile of the display and a second portion of the serialized video data stream that includes video image data pertaining to the second tile of the display; extracting, by a processor of the active receiver card, from the received serialized video data stream received by the first interface, the first portion of the serialized video data stream that includes the video image data pertaining to the first tile of the display; and outputting control signals, by a second interface of the active receiver card, to a plurality of pixels of the first tile of the plurality of tiles of the display.

2. The method according to any one or a combination of one or more of 1 above and 3-11 below, wherein the active receiver card receives both the first portion of the serialized video data stream and the second portion of the serialized video data stream in a linear manner such that the first portion of the serialized video data stream is received in a periodic order before the second portion of the serialized video data stream.

3. The method according to any one or a combination of one or more of 1-2 above and 4-11 below, wherein the active receiver card is configured to receive through the first interface all of the plurality of portions of the serialized video data stream pertaining to each of plurality of tiles of the display.

4. The method according to any one or a combination of one or more of 1-3 above and 5-11 below, wherein the active receiver card operates asymmetrically with the video processing system such that the serialized video data stream transmitted downstream from the video processing system is transmitted at a higher bandwidth than a bandwidth of data transmitted upstream to the video processor.

5. The method according to any one or a combination of one or more of 1-4 above and 6-11 below, further comprising storing by a non-volatile memory of the active receiver card at least one (x,y) coordinate of a pixel of the plurality of pixels of the first tile of the display that corresponds to one LED that is mounted on an LED board of the first tile, the at least one (x,y) coordinate corresponding to a particular (x,y) pixel coordinate.

6. The method according to any one or a combination of one or more of 1-5 above and 7-11 below, further comprising determining by the processor of the active receiver card a coordinate (a,b) out of the serialized video data stream, and compare the determined coordinate (a,b) to the at least one (x,y) coordinate of a pixel of the plurality of pixels.

7. The method according to any one or a combination of one or more of 1-6 above and 8-11 below, further comprising the processor of the active receiver card extracting a corresponding pixel value from the serialized video data stream.

8. The method according to any one or a combination of one or more of 1-7 above and 9-11 below, further comprising the processor of the active receiver card performing at least one mathematical operation on the corresponding pixel value.

9. The method according to any one or a combination of one or more of 1-8 above and 10-11 below, wherein the processor of the active receiver card is configured to perform at least one mathematical operation on the corresponding pixel value.

10. The method according to any one or a combination of one or more of 1-9 above and 11 below, wherein the processor of the active receiver card is configured to convert an outcome of the at least one mathematical operation to an output that can be interfaced with the second interface.

11. The method according to any one or a combination of one or more of 1-10 above, wherein the processor of the active receiver card is configured to send corresponding signals to a board of the first tile containing one or more LEDs, to light up the LEDs in correspondence with the outcome of the at least one mathematical operation.

A hardware storage device having stored thereon computer executable instructions which, when executed by one or more processors of a video processing system configure the one or more processors to perform the method according to any one or a combination of two or more of 1-11 above.

A video processing system comprising: a video processor configured to output a serialized video data stream to be displayed by a display, the video data being output by the video processor as a plurality of portions of the serialized video data stream, each of the plurality of portions of the serialized video data stream pertaining to a corresponding one of a plurality of tiles of the display, including at least a first tile and a second tile, such the plurality of portions of the serialized video data stream include at least a first portion of the serialized video data stream including video image data pertaining to the first tile of the display and a second portion of the serialized video data stream that includes video image data pertaining to the second tile of the display, wherein the video processor outputs both the first portion of the serialized video data stream and the second portion of the serialized video data stream combined as a single data stream to a first receiver card corresponding to the first tile of the display and to a second receiver card corresponding to the second tile of the display.

According to another embodiment, a video processing system comprises: a video processor configured to output video data to be displayed by a display as a video image, the video data being output by the video processor is a serialized digital video stream containing the full relevant display information to be displayed by a plurality of tiles of the display.

An (LED) video processing system is configured to use an asymmetrical high bandwidth (e.g. >5 Gbps) linear digital serialized video data stream with downstream communication and upstream communication. The video processing system comprises at least one display (LED tile) that receives the above asymmetrical high bandwidth linear digital serialized video (signal) and displays a (pre-defined) part of this digital serialized video data stream wherein the individual LED light generation starts and stops after a predefined start and stop period. Asymmetrical should be understood to mean here that the downstream communication (to the tiles) bandwidth is higher and preferably significantly higher than the upstream communication (back to processor). Linear here should be understood to mean that pixel 2 always comes after pixel 1 and line 2 always comes after line 1.

In a broader sense, pixels or lines don't need to come in sequential order, but the order is fixed in a predetermined fashion, e.g. pixel n, subsequently pixel n−5, then pixel n−2 etc.

The system comprises at least one display (LED tile) that receives the above asymmetrical high bandwidth linear digital serialized video and displays a (pre-defined) part of this digital serialized video data stream wherein the individual LED light generation starts and stops after a predefined start and stop period. Sync-banding may also be included. If start=0, the display immediately updates.

The system according to any or a combination of one or more the above or below embodiments, wherein the digital serialized video data stream is made from at least 8 BIT RGB pixel data.

The system according to any or a combination of one or more the above or below embodiments, wherein the start is the vertical sync signal.

The system according to any or a combination of one or more the above or below embodiments, wherein the start is a programmable time to wait after vertical sync signal.

The system according to any or a combination of the above or below embodiments, wherein the stop is calculated by digitally measuring the time between two consecutive vertical sync signals.

5 The system according to any or a combination of one or more the above or below embodiments, where the stop is a fraction of the measurement performed in claim.

The system according to any or a combination of one or more the above or below embodiments, wherein multiple start and stop light generation is performed during one frame (=the time between 2 vertical sync signals).

The system according to any or a combination of one or more the above or below embodiments, wherein start and stop signals are derived by vertical sync signal and a measured camera shutter time.

The system according to any or a combination of one or more the above or below embodiments, wherein the digital serialized video data stream is uncompressed.

The system according to any or a combination of the above claims, wherein the digital serialized video data stream contains also serialized communication data for communication with the LED tiles.

The system according to any or a combination of one or more the above or below embodiments, wherein the display is LED based using PWM and multiplexing scheme.

The system according to any or a combination of one or more the above or below embodiments, wherein the display is LED based using active matrix.

An active loop through may also be considered and included in the systems described herein. Active meaning that the video data stream is received in the receiver card and directly sent out again with modifications to the communication.

A heartbeat pulse in the digital serialized video data stream to auto-detect may also be considered if the link is still operational.

13 FIG. A ‘minimal’ overhead may also be considered as we don't need preamble, source address, destination address length etc., such as depicted in the frame format of.

The communication channel could be ‘repacked ethernet packages’. In fact it doesn't necessarily matter what is sent as long as processor and active receiver cards recognize commands correctly. For e.g. updating firmware or sending large amounts of data to the tiles, this doesn't necessarily need to use the dedicated communication slot. Instead of sending RGB data in the video data stream, one can just send the data as is and one tells the receiver card to ‘take out and store’ the data it needs (like a ‘pick and go’ principle). This system can then use the full downstream bandwidth.

In another group of embodiments for a receiver card, an active receiver card, for example, of an active LED video processing system, comprises at least two electrical interfaces. The first interface being capable of receiving a high bandwidth linear digital serialized video data stream. (This may be at least 24 bit RGB uncompressed with downstream communication.) The second interface is electronically connected directly or indirectly with a board containing one more LEDs.

The active receiver card may further comprise a non-volatile memory that stores at least one (x,y) coordinate of a pixel that corresponds to one LED that is mounted on the LED board. This (x,y) coordinate also corresponds to a particular (x,y) pixel coordinate (having (local) non-volatile memory or having means for reading non-volatile memory. Memory can reside locally, on hub board or on LED boards, and can derive calibration data therefrom. Once this is done, performing retargeting can be added (=calibration from calculated data instead of measured data).)

The active receiver card may include digital logic or a processor to (this can be FPGA logic or a combination of embedded controller and digital logic. In fact, an embedded controller is an embodiment of (complex) digital logic) determine (a,b) coordinates out of the high bandwidth linear digital serialized video data stream, and compare (a,b) coordinate with (x,y) coordinate.

The active receiver card may include digital logic or a processor to retrieve the corresponding pixel data from the high bandwidth linear digital serialized video data stream. The active receiver card may include digital logic or a processor to at least perform one mathematical operation on the value retrieved (The mathematical operation can be done in the embedded controller if it is performed fast enough).

The active receiver card may include digital logic or a processor to convert the outcome of the above mathematical operation to logic that can interface with the second interface.

The active receiver card may include digital logic or a processor being capable to send corresponding signals on the board containing one or more LEDs, to light up the LED in correspondence with the outcome of the mathematical operation.

The link may be at least 24 bit RGB uncompressed.

The active receiver card may include at least three electrical interfaces, the first interface being capable of receiving a high bandwidth linear digital serialized video data stream with downstream communication, the second interface being capable of sending a high bandwidth linear digital serialized video data stream with downstream communication, and the third interface being electronically connected directly or indirectly with a board containing one or more LEDs

The active receiver card may include digital logic or a processor to connect the first interface to the second interface.

The active receiver card may include digital logic or a processor to change predetermined data in the serialized video data stream, before it is presented to the second interface (which may be to perform autoconfiguration, i.e. automatically detect how many tiles are present, and how they need to be positioned). The last one may be to perform the auto configuration.

The system according to any or a combination of the above or below embodiments, wherein there are at least five electrical interfaces

The system according to any or a combination of the above or below embodiments, wherein the first and second interfaces being capable of receiving a high bandwidth linear digital serialized video data stream with downstream communication.

The system according to any or a combination of the above or below embodiments where the third and fourth interfaces being capable of sending a high bandwidth linear digital serialized video data stream with downstream communication.

The system according to any or a combination of the above or below embodiments, further comprising a fifth interface that is electronically connected directly or indirectly with a board containing one more LEDs

The active receiver card may include digital logic or a processor to connect the first interface to the third or fourth interface

The active receiver card may include digital logic or a processor to connect the second interface to the third or fourth interface

The active receiver card may include digital logic or a processor to change predetermined data in the serialized video data stream, received from first and second interface.

The active receiver card may include digital logic or a processor to determine activity on the first and second interface.

The active receiver card may include digital logic or a processor to retrieve pixel data from either or both first and second interface.

The system according to any or a combination of the above or below embodiments, wherein the mathematical operation comprises at least one of the following: Brightness correction; Gamma correction; Color correction; Subdelta correction; Calibration; Content dependent calibration; Time dependent calibration; Scaling function; and/or Rotation function.

The system according to any or a combination of the above or below embodiments, that further comprises (sync-banding logic).

The system according to any or a combination of the above or below embodiments, that further comprises digital logic or a processor to determine predefined start to light up the LEDs within one video frame.

The system according to any or a combination of the above or below embodiments, that further comprises digital logic or a processor to determine predefined end to light up the LEDs

The system according to any or a combination of the above or below embodiments, that further comprises non-volatile memory to store the predefined start and predefined end and/or

The system according to any or a combination of the above or below embodiments, that further comprises digital logic or a processor to read the non-volatile memory and at power up read the non-volatile memory for determine the predefined start and predefined end.

The system according to any or a combination of the above or below embodiments, wherein multiple starts and stops are being used in one image frame.

The system according to any or a combination of the above or below embodiments, wherein the data presented to the second interface is significantly different form data presented to the third interface.

The system according to any or a combination of the above or below embodiments, wherein the system also comprises: Volatile memory to at least store pixel information before or after the mathematical operation; Logic gamma correction; Logic for calibration; Logic for autodetection; Logic for reading and writing to non-volatile memory; and/or Logic for storing measurement data instead of calibration data.

The system according to any or a combination of the above or below embodiments, further adding in direct PC driven.

The system according to any or a combination of the above or below embodiments, wherein the high bandwidth linear digital serialized video data stream is generated by a laptop, pc or any other existing device that has graphical engine in it.

The system according to any or a combination of the above or below embodiments, wherein the high bandwidth linear digital serialized video data stream is generated by a laptop, pc or any other existing device that has a graphical engine incorporated. The system may be directly PC driven.

The system according to any or a combination of the above or below embodiments, wherein the high bandwidth linear digital serialized video data stream also contains upstream communication channel to individually ‘talk’ to LED tiles with the active receiver cards.

The system according to any or a combination of the above or below embodiments, wherein the GUI for adjusting screen settings is integrated in the existing GUI of the graphical engines of the laptop, PC, game console, etc.

The system according to any or a combination of the above or below embodiments, wherein the serialized video data is replaced by partially render data. (It could be that the serialized video date stream is not meant anymore for sending video, but for sending ‘render input data’. In most cases this means that the necessary bandwidth can be reduced. E.g. one can be part of ‘video data’ and some ‘texture data’ and the intelligent card will perform the necessary functionality to complete the action for all its pixels.)

The system according to any or a combination of the above or below embodiments, wherein the mathematical operations are part of GPU system for rendering the content to be displayed on the LEE's.

1. A video processing system comprising: a video processor configured to output video data to be displayed by a display as a video image, the video data being output by the video processor as a plurality of portions of the video data to be displayed by a corresponding plurality of tiles of the display, such that a first tile displays a first portion of the video image based on a first portion of the video data and a second tile displays a second portion of the video based on a second portion of the video data, wherein the video processor outputs both the first portion of the video data and the second portion of the video data to each of the first tile and the second tile.

2. The video processing system according to any one or a combination of two or more of 1 above and 3-10 below, wherein the video processor serially outputs both the first portion of the video data and the second portion of the video data to each of the first tile and the second tile.

3. The video processing system according to any one or a combination of two or more of 1-2 above and 4-10 below, wherein the video processor serially outputs both the first portion of the video data and the second portion of the video data to each of the first tile and the second tile in a linear manner such that the first portion of the video data is output to each of the first tile and the second tile in a periodic order before the second portion of the video data is output to each of the first tile and the second tile.

4. The video processing system according to any one or a combination of two or more of 1-3 above and 5-10 below, wherein the video processor outputs a respective portion of the video data for each of the plurality of tiles, and the video processor outputs all of the respective portions of the video data to each of the plurality of tiles.

5. The video processing system according to any one or a combination of two or more of 1-4 above and 6-10 below, wherein the video processor outputs all of the respective portions of the video data to each of the plurality of tiles in a predetermined order.

6. The video processing system according to any one or a combination of two or more of 1-5 above and 7-10 below, wherein the video processor uses an asymmetric video stream such that the video data transmitted downstream from the video processor at a higher bandwidth than a bandwidth of data transmitted upstream to the video processor.

7. The video processing system according to any one or a combination of two or more of 1-6 above and 8-10 below, wherein the video processor is configured to output the video data to be displayed by an LED display having a plurality of LED tiles.

8. The video processing system according to any one or a combination of two or more of 1-7 above and 9-10 below, further comprising a display comprising a plurality of tiles, including a first tile and a second tile.

9. The video processing system according to any one or a combination of two or more of 1-8 above and 10 below, wherein the first tile and the second tile are each configured to start and stop respectively displaying the first portion of the video image based on the first portion of the video data and the second portion of the video based on the second portion of the video data after a predefined start period and a stop period.

10. The video processing system according to any one or a combination of two or more of 1-9 above, further comprising a plurality of active receiver cards, each of the plurality of tiles having a respective one of the active receiver cards, wherein each of the plurality of active receiver cards is configured to receive each of the plurality of portions of the video data and based thereon, is configured to output signals to light individual pixels of the respective tile.

1. A video processing method comprising: outputting video data to be displayed by a display as a video image, the video data being output by a video processor as a plurality of portions of the video data to be displayed by a corresponding plurality of tiles of the display, such that a first tile displays a first portion of the video image based on a first portion of the video data and a second tile displays a second portion of the video based on a second portion of the video data, wherein outputting the video data includes outputting both the first portion of the video data and the second portion of the video data to each of the first tile and the second tile.

2. The video processing method according to any one or a combination of two or more of 1 above and 3-8 below, wherein outputting the video data includes serially outputting both the first portion of the video data and the second portion of the video data to each of the first tile and the second tile.

3. The video processing method according to any one or a combination of two or more of 1-2 above and 4-8 below, wherein outputting the video data includes serially outputting both the first portion of the video data and the second portion of the video data to each of the first tile and the second tile in a linear manner such that the first portion of the video data is output to each of the first tile and the second tile in a periodic order before the second portion of the video data is output to each of the first tile and the second tile.

4. The video processing method according to any one or a combination of two or more of 1-3 above and 5-8 below, wherein outputting the video data includes outputting a respective portion of the video data for each of the plurality of tiles, and the video processor outputs all of the respective portions of the video data to each of the plurality of tiles.

5. The video processing method according to any one or a combination of two or more of 1-4 above and 6-8 below, wherein outputting the video data includes using an asymmetric video stream such that the video data transmitted downstream from the video processor at a higher bandwidth than a bandwidth of data transmitted upstream to the video processor.

6. The video processing method according to any one or a combination of two or more of 1-5 above and 7-8 below, wherein the display is an LED display having a plurality of LED tiles.

7. The video processing method according to any one or a combination of two or more of 1-6 above and 8 below, further comprising displaying the first portion of the video image by the first tile and displaying the second portion of the video image by the second tile, wherein the first tile and the second tile each start and stop respectively displaying the first portion of the video image based on the first portion of the video data and the second portion of the video based on the second portion of the video data after a predefined start period and a stop period.

8. The video processing method according to any one or a combination of two or more of 1-7 above, further comprising receiving the plurality of portions of the video data by a plurality of active receiver cards, each of the plurality of tiles having a respective one of the active receiver cards, wherein each of the plurality of active receiver cards is configured to receive each of the plurality of portions of the video data, and the method further comprising respectively outputting, by each of the plurality of active receiver cards, output signals to light individual pixels of the respective tile.

A hardware storage device having stored thereon computer executable instructions which, when executed by one or more processors of a video processing system configure the one or more processors to perform the method according to any one or a combination of two or more of 1-8 above.

An active receiver card comprising: a processor; a first interface configured to receive input from a video processing system; and a second interface configured to output signals to a plurality of pixels of a display tile corresponding to the active receiver card, wherein the active receiver card is configured to be connected to a tile of a display comprising a plurality of tiles, wherein the active receiver card is configured to receive a plurality of portions of the video data from the video processing system, each of the plurality of portions of video data corresponding to one of the plurality of tiles of the display, and wherein the active receiver card is configured to retrieve pixel data relating to the plurality of pixels of the display tile, and based thereon, is configured to output signals to light individual pixels of the display tile.

6 FIG. 1. A video processing system (e.g., as shown in) comprising: a video processor configured to send a video data stream with downstream communication, wherein the video data is communicated downstream from the video processor in a higher amount than the data communicated upstream to the video processor, and wherein the order of the data communicated need not be communicated sequentially starting as long as the data is in a predetermined and fixed order; at least one display connected to said video processor that displays at least a part of the data from the video data stream sent either to or from said video processor; and at least one receiver card comprising: a video transceiver/reclocker configured to capture data from the video data stream that is specific to said receiver card and to allow data from the video data stream that is not specific to said receiver card to pass through said receiver card.

2. The video processing system according to any one or a combination of two or more of 1 above and 3-13 below, wherein the at least one receiver card further comprises digital logic to mitigate the effects of syncbanding.

3. The video processing system according to any one or a combination of two or more 1-2 above and 4-13 below, wherein the video data stream sent by said video processor is made from at least 8-bit RGB pixel data.

4. The video processing system according to any one or a combination of two or more 1-3 above and 5-13 below, wherein individual pixel light generation starts and stops after a predefined start and stop period, and wherein at the beginning of said start period said at least one display immediately updates.

5. The video processing system according to any one or a combination of two or more 1-4 above and 6-13 below, wherein the start of said start and stop period is based on a vertical sync signal.

6. The video processing system according to any one or a combination of two or more 1-5 above and 7-13 below, wherein the start of said start and stop period is based on a programmable time to wait after a vertical sync signal.

7. The video processing system according to any one or a combination of two or more 1-6 above and 8-13 below, wherein the stop of said start and stop period is based on a calculation that digitally measures the time between two consecutive vertical sync signals.

8. The video processing system according to any one or a combination of two or more 1-7 above and 9-13 below, wherein the stop of said start and stop period is a fraction of the measurement of time between two consecutive vertical sync signals.

9. The video processing system according to any one or a combination of two or more 1-8 above and 10-13 below, wherein multiple pixel light generations start and stop during the time between two vertical sync signals.

10. The video processing system according to any one or a combination of two or more 1-9 above and 11-13 below, wherein the start and the stop of said start and stop period are derived from a vertical sync signal and a measured camera shutter time.

11. The video processing system according to any one or a combination of two or more 1-10 above and 12-13 below, wherein the data communicated along said video data stream is uncompressed.

12. The video processing system according to any one or a combination of two or more 1-11 above and 13 below, wherein the video data steam sent by said processor contains serialized communication data for communication with said at least one display.

13. The video processing system according to any one or a combination of two or more 21-32 above, wherein the display is LED based, and wherein the display uses Pulse Width Modulation (PWM), multiplexing, or active matrix schemes.

14. A method of video processing, said method comprising the steps of: providing an asymmetrical high bandwidth linear digital serialized video data stream to at least one display; generating a start condition, which determines when to start individual pixel light generation; generating a stop condition, which determines when to stop individual pixel light generation; and updating the display when the start condition is met.

15. The method according to any one or a combination of two or more 14 above and 16-19, further comprising the step of retrieving pixel data from the high bandwidth linear digital serialized video data stream.

16. The method according to any one or a combination of two or more 14-15 above and 17-19, further comprising the step of performing at least one mathematical operation on the retrieved pixel data.

17. The method according to any one or a combination of two or more 14-16 above and 18-19 below, further comprising the step of correcting at least one of the settings selected from the group consisting of brightness, gamma, color, and subdelta.

18. The method according to any one or a combination of two or more 14-17 above and 19 below, further comprising the step of providing a downstream communication channel to individually communicate with pixels on the at least one display.

19. The method according to any one or a combination of two or more 34-38 above, further comprising the step of providing an upstream communication channel to individually communicate with pixels on the at least one display.

20. A hardware storage device having stored thereon computer executable instructions which, when executed by one or more processors of a computer system of a video processing system comprising an asymmetrical high bandwidth linear digital serialized video data stream and at least one display, configure the video processing system to perform the following for providing video data to the at least one display: retrieve corresponding pixel data for the at least one display from the high bandwidth linear digital serialized video data stream; perform at least one mathematical operation on the retrieved pixel data; and convert the outcome of the above mathematical operation to logic that can interface with the video processing system;

21. The hardware storage device of 20 above, further configuring the video processing system to perform the following for providing video data to the at least one display: determine a start condition to light up at least one pixel of the at least one display; and determine a stop condition to light up at least one pixel of the at least one display.

22. An video processing system comprising: at least a first electrical interface and a second electrical interface, wherein the first electrical interface is capable of receiving a video data stream with downstream communication, wherein the order of the data communicated along the video data stream need not be communicated sequentially as long as the data is in a predetermined and fixed order, and wherein the second electrical interface is electronically connected directly or indirectly with a board containing one or more LEDs; a receiver card, wherein the receiver card does not wait for data packets but actively receives the full data stream received on either or both the first and the second electrical interface; non-volatile memory that stores at least a first coordinate set of a pixel that corresponds to one LED, wherein said first coordinate set also corresponds to a particular pixel coordinate; digital logic to: determine a second coordinate set out of the data communicated along the video data stream; and compare the first coordinate set with the second coordinate set; digital logic to retrieve the corresponding pixel data from the data communicated along the video data stream; digital logic to perform at least one mathematical operation on the value retrieved from the data communicated along the video data stream; and digital logic to convert the outcome of said at least one mathematical operation to logic that can interface with the second electrical interface, wherein all the above digital logic is capable of sending corresponding signals on said board containing one or more LEDs to light up at least one of the LEDs in correspondence with the outcome of the mathematical operation.

23. The video processing system according to any one or a combination of two or more 22 above and 24-35 below, wherein there are at least three electrical interfaces, wherein the first electrical interface is capable of receiving the data communicated along the video data stream with downstream communication, and wherein the second electrical interface is capable of sending the data communicated along the video data stream with downstream communication, and wherein the third electrical interface is electronically connected directly or indirectly with a board containing or more LEDs, and further comprising: digital logic that connects the first electrical interface to the second electrical interface; and digital logic that changes predetermined data in the video data stream before it is presented to the second electrical interface.

24. The video processing system according to any one or a combination of two or more 22-23 above and 25-35 below, wherein the data presented to the second electrical interface is different from data presented to the third electrical interface.

25. The video processing system according to any one or a combination of two or more 22-24 above and 26-35 below, wherein there are at least five electrical interfaces, wherein the first and second electrical interfaces are capable of receiving the data communicated along the video data stream with downstream communication, and wherein the third and fourth electrical interfaces are capable of sending the data communicated along the video data stream with downstream communication, and wherein the fifth electrical interface is electronically connected directly or indirectly with a board containing one or more LEDs, and further comprising: digital logic to connect the first electrical interface to the third or fourth electrical interface; digital logic to connect the second electrical interface to the third or fourth electrical interface; digital logic that changes predetermined data in the video data stream received from the first and second electrical interfaces; digital logic to determine activity on the first and second electrical interfaces; and digital logic to retrieve pixel data from either or both of the first and the second electrical interfaces.

26. The video processing system according to any one or a combination of two or more 22-25 above and 27-35 below, wherein the mathematical operation comprises at least one of the following: brightness correction; gamma correction; color correction; subdelta correction; calibration; content dependent calibration; time dependent calibration; a scaling function; and/or a rotation function.

27. The video processing system according to any one or a combination of two or more 22-26 above and 28-35 below, further comprising: digital logic to determine a predefined start to light up the LEDs within one video frame; digital logic to determine a predefined stop to light up the LEDs; non-volatile memory to store the predefined start and the predefined stop; and digital logic to read the non-volatile memory and at power-up read the non-volatile memory to determine the predefined start and the predefined stop.

28. The video processing system according to any one or a combination of two or more 22-27 above and 29-35 below, wherein multiple starts and multiple stops are used in one image frame.

29. The video processing system according to any one or a combination of two or more 22-48 above and 30-35 below, further comprising: volatile memory to, at the least, store pixel information before or after the mathematical operation; digital logic for gamma correction; digital logic for calibration; digital logic for autodetection; digital logic for reading and writing to non-volatile memory; and/or digital logic for storing measurement data instead of calibration data.

30. The video processing system according to any one or a combination of two or more 22-29 above and 31-35 below, wherein the video data stream is generated by a laptop, personal computer, or any other existing device that has a graphical engine incorporated therein.

31. The video processing system according to any one or a combination of two or more 22-30 above and 32-35 below, wherein the Graphical User Interface (GUI) for adjusting display settings is integrated into the existing GUI of devices that have graphical engines incorporated therein.

32. The video processing system according to any one or a combination of two or more 22-31 above and 33-35 below, wherein the video data stream further comprises: an upstream communication channel to individually communicate to the board containing one or more LEDs with at least one active receiver card.

33. The video processing system according to any one or a combination of two or more 22-32 above and 34-35 below, wherein the data communicated along the video data stream is replaced by partially rendered data.

34. The video processing system according to any one or a combination of two or more 22-33 above and 35 below, wherein the mathematical operations are part of a Graphics Processing Unit (GPU) system for rendering the content to be display on the board containing one or more LEDs.

35. The video processing system according to any one or a combination of two or more 22-34 above, wherein the coordinate set comprises three-dimensional coordinate information.

1. An active receiver card for a display, the active receiver comprising: a processor; a first interface configured to receive a broadcast serialized video data stream as input from a video processing system, the broadcast serialized video data stream including a plurality of portions of the serialized video data stream, each of the plurality of portions of the serialized video data stream pertaining to a corresponding one of a plurality of tiles of the display, including at least a first tile and a second tile, such the plurality of portions of the serialized video data stream include at least a first portion of the serialized video data stream including video image data pertaining to the first tile of the display and a second portion of the serialized video data stream that includes video image data pertaining to the second tile of the display; wherein the active receiver card is configured to be electrically connected to the first tile of the plurality of tiles of the display; wherein the active receiver card further comprises a second interface configured to output control signals to a plurality of pixels of the first tile of the plurality of tiles of the display; wherein the active receiver card is configured to extract from the received serialized video data stream the first portion of the serialized video data stream that includes the video image data pertaining to the first tile of the display, and based thereon, the active receiver card is configured to output the control signals to the plurality of pixels of the first tile of the plurality of tiles of the display.

2. The active receiver card according to any one or a combination of two or more of 1 above and 3-12 below, wherein the active receiver card receives both the first portion of the broadcast serialized video data stream and the second portion of the serialized video data stream in a linear manner such that the first portion of the serialized video data stream is received in a periodic order before the second portion of the serialized video data stream.

3. The active receiver card according to any one or a combination of two or more of 1-2 above and 4-12 below, wherein the active receiver card is configured to receive through the first interface all of the plurality of portions of the broadcast serialized video data stream pertaining to each of plurality of tiles of the display.

4. The active receiver card according to any one or a combination of two or more of 1-3 above and 5-12 below, wherein the active receiver card is configured to receive through the first interface all of the plurality of portions of the broadcast serialized video data stream pertaining to each of plurality of tiles of the display in a predetermined order.

5. The active receiver card according to any one or a combination of two or more of 1-4 above and 6-12 below, wherein the second interface is directly or indirectly electrically connected to a board of the first tile of the plurality of tiles of the display, the board containing one or more LEDs.

6. The active receiver card according to any one or a combination of two or more of 1-5 above and 7-12 below, wherein the active receiver card is configured to operate asymmetrically with the video processing system such that the broadcast serialized video data stream transmitted downstream from the video processing system is transmitted at a higher bandwidth than a bandwidth of data transmitted upstream to the video processor.

7. The active receiver card according to any one or a combination of two or more of 1-6 above and 8-12 below, further comprising a non-volatile memory that stores at least one (x,y) coordinate of a pixel of the plurality of pixels of the first tile of the display that corresponds to one LED that is mounted on an LED board of the first tile, the at least one (x,y) coordinate corresponding to a particular (x,y) pixel coordinate

8. The active receiver card according to any one or a combination of two or more of 1-7 above and 9-12 below, wherein the processor of the active receiver card is configured to determine a coordinate (a,b) out of the broadcast serialized video data stream, and compare the determined coordinate (a,b) to the at least one (x,y) coordinate of a pixel of the plurality of pixels.

9. The active receiver card according to any one or a combination of two or more of 1-8 above and 10-12 below, wherein the processor of the active receiver card is configured to extract a corresponding pixel value from the broadcast serialized video data stream.

10. The active receiver card according to any one or a combination of two or more of 1-9 above and 11-12 below, wherein the processor of the active receiver card is configured to perform at least one mathematical operation on the corresponding pixel value.

11. The active receiver card according to any one or a combination of two or more of 1-10 above and 12 below, wherein the processor of the active receiver card is configured to convert an outcome of the at least one mathematical operation to an output that can be interfaced with the second interface.

12. The active receiver card according to any one or a combination of two or more of 1-11 above, wherein the processor of the active receiver card is configured to send corresponding signals to a board of the first tile containing one or more LEDs, to light up the LEDs in correspondence with the outcome of the at least one mathematical operation.

1. A method for controlling with an active receiver card pixels of a display having a plurality of tiles, the active receiver card being electrically connected to a first tile of the plurality of the tiles of the display, the method comprising: receiving by a first interface of the active receiver card a broadcast serialized video data stream as input from a video processing system, the broadcast serialized video data stream including a plurality of portions of the broadcast serialized video data stream, each of the plurality of portions of the serialized video data stream pertaining to a corresponding one of a plurality of tiles of the display, including at least a first tile and a second tile, such the plurality of portions of the serialized video data stream include at least a first portion of the serialized video data stream including video image data pertaining to the first tile of the display and a second portion of the serialized video data stream that includes video image data pertaining to the second tile of the display; extracting, by a processor of the active receiver card, from the received serialized video data stream received by the first interface, the first portion of the serialized video data stream that includes the video image data pertaining to the first tile of the display; and outputting control signals, by a second interface of the active receiver card, to a plurality of pixels of the first tile of the plurality of tiles of the display.

2. The method according to any one or a combination of two or more of 1 above and 3-8 below, wherein the active receiver card receives both the first portion of the broadcast serialized video data stream and the second portion of the broadcast serialized video data stream in a linear manner such that the first portion of the broadcast serialized video data stream is received in a periodic order before the second portion of the broadcast serialized video data stream.

3. The method according to any one or a combination of two or more of 1-2 above and 4-8 below, wherein the active receiver card is configured to receive through the first interface all of the plurality of portions of the broadcast serialized video data stream pertaining to each of plurality of tiles of the display.

4. The method according to any one or a combination of two or more of 1-3 above and 5-8 below, wherein the active receiver card operates asymmetrically with the video processing system such that the broadcast serialized video data stream transmitted downstream from the video processing system is transmitted at a higher bandwidth than a bandwidth of data transmitted upstream to the video processor.

5. The method according to any one or a combination of two or more of 1-4 above and 6-8 below, further comprising storing by a non-volatile memory of the active receiver card at least one (x,y) coordinate of a pixel of the plurality of pixels of the first tile of the display that corresponds to one LED that is mounted on an LED board of the first tile, the at least one (x,y) coordinate corresponding to a particular (x,y) pixel coordinate.

6. The method according to any one or a combination of two or more of 1-5 above and 7-8 below, further comprising determining by the processor of the active receiver card a coordinate (a,b) out of the serialized video data stream, and compare the determined coordinate (a,b) to the at least one (x,y) coordinate of a pixel of the plurality of pixels.

7. The method according to any one or a combination of two or more of 1-6 above and 8 below, further comprising the processor of the active receiver card extracting a corresponding pixel value from the serialized video data stream.

8. The method according to any one or a combination of two or more of 1-7 above, further comprising the processor of the active receiver card performing at least one mathematical operation on the corresponding pixel value.

A video processing system comprising: a video processor configured to output a broadcast serialized video data stream to be displayed by a display, the video data being output by the video processor as a plurality of portions of the broadcast serialized video data stream, each of the plurality of portions of the serialized video data stream pertaining to a corresponding one of a plurality of tiles of the display, including at least a first tile and a second tile, such the plurality of portions of the broadcast serialized video data stream include at least a first portion of the serialized video data stream including video image data pertaining to the first tile of the display and a second portion of the serialized video data stream that includes video image data pertaining to the second tile of the display, wherein the video processor outputs both the first portion of the serialized video data stream and the second portion of the serialized video data stream combined as a single data stream to a first receiver card corresponding to the first tile of the display and to a second receiver card corresponding to the second tile of the display.

An active receiver card for a display, the active receiver comprising: a processor; a first interface configured to receive a broadcast serialized video data stream as input from a video processing system, wherein the active receiver card is configured to be electrically connected to a first tile of a display; wherein the active receiver card further comprises a second interface configured to output control signals to a plurality of pixels of the first tile of the display; wherein the active receiver card is configured to extract from the received serialized video data stream video image data pertaining to the first tile of the display, and based thereon, the active receiver card is configured to output the control signals to the plurality of pixels of the first tile.

An active receiver card for a display, the active receiver comprising: a processor; a first interface configured to receive a broadcast serialized video data stream as input from a video processing system, wherein the active receiver card is configured to be electrically connected to a first tile of a display; wherein the active receiver card further comprises a second interface configured to output control signals to a plurality of pixels of the first tile of the display; wherein the active receiver card is configured to extract from the received broadcast serialized video data stream video image data pertaining to the first tile of the display, the received serial video data stream including additional data not pertaining to the first tile of the display such that the by extracting the video image data pertaining to the first tile of the display, at least some of the additional data of the received serial video data stream is not extracted by the active receiver card, and based on the extracted video image data pertaining to the first tile, the active receiver card is configured to output the control signals to the plurality of pixels of the first tile.

660 630 630 720 560 710 640 620 720 630 660 720 450 630 660 560 720 640 630 660 720 630 660 1. An active receiver card for a display () comprising one or more tiles (), each tile () comprising a plurality of pixels, the active receiver () comprising: a processor (); and a first interface () configured to receive a broadcast serialized video data stream () as input from a video processing system (); wherein the active receiver card () is configured to be electrically connected to a tile () of the display (); wherein the active receiver card () further comprises a second interface () configured to output control signals used to control the plurality of pixels of the tile () of the display (); wherein the processor () of the active receiver card () is configured to extract from the received broadcast serialized video data stream () video image data pertaining to the tile () of the display (), and based thereon, the active receiver card () is configured to output the control signals used to control the plurality of pixels of the tile () of the display ().

720 720 640 720 620 2. The active receiver card () according to any one or two or more of 1 above and 3-13 below, wherein the active receiver card () receives the broadcast serialized video data stream () as asymmetrical communication between the active receiver card () and the video processing system ().

720 720 710 640 620 3. The active receiver card () according to any one or two or more of 1-2 above and 4-13 below, wherein the active receiver card () is configured to receive through the first interface () the broadcast serialized video data stream () without requiring return communication or without confirmation to the video processing system ().

720 720 710 640 640 630 660 630 4. The active receiver card () according to any one or two or more of 1-3 above and 5-13 below, wherein the active receiver card () is configured to receive through the first interface () the broadcast serialized video data stream (), the broadcast serialized video data stream () including data not pertaining to the tile () of the display (), or including data pertaining to other tiles ().

720 630 630 5. The active receiver card () according to any one or two or more of 1-4 above and 6-13 below, wherein the tile () comprises a board onto which the plurality of pixels of said tile () are provided, and wherein said board comprises per pixel one or more light-emitting elements (LEEs), such as for example LEDs.

720 450 6. The active receiver card () according to any one or two or more of 1-5 above and 7-13 below, wherein the second interface () is directly or indirectly electrically connected to said board.

720 720 620 640 620 620 7. The active receiver card () according to any one or two or more of 1-6 above and 8-13 below, wherein the active receiver card () is configured to operate asymmetrically with the video processing system () such that the serialized video data stream () transmitted downstream from the video processing system () is transmitted at a higher bandwidth than a bandwidth of data transmitted upstream to the video processing system ().

720 630 660 630 630 8. The active receiver card () according to any one or two or more of 1-7 above and 9-13 below, further comprising a non-volatile memory that stores at least one (x,y) coordinate of a pixel of the plurality of pixels of one of the tiles () of the display () that corresponds to said pixel mounted on said board of said one of the tiles (), the at least one (x,y) coordinate corresponding to a particular (x,y) pixel coordinate of said one of the tiles ().

720 560 720 640 9. The active receiver card () according to any one or two or more of 1-8 above and 10-13 below, wherein the processor () of the active receiver card () is configured to determine a coordinate (a,b) out of the serialized video data stream (), and compare the determined coordinate (a,b) to the at least one (x,y) coordinate of said pixel of the plurality of pixels.

720 560 720 640 10. The active receiver card () according to any one or two or more of 1-9 above and 11-13 below, wherein the processor () of the active receiver card () is configured to extract a corresponding pixel value from the serialized video data stream ().

720 720 11. The active receiver card () according to any one or two or more of 1-10 above and 12-13 below, wherein the processor of the active receiver card () is configured to perform at least one mathematical operation on the corresponding pixel value.

720 720 450 12. The active receiver card () according to any one or two or more of 1-11 above and 13 below, wherein the processor of the active receiver card () is configured to convert an outcome of the at least one mathematical operation to an output that can be interfaced with the second interface ().

720 560 720 630 13. The active receiver card () according to any one or two or more of 1-12 above, wherein the processor () of the active receiver card () is configured to send corresponding signals to said board of the tile () comprising the plurality of pixels of said tile and per pixel comprising one or more LEEs, to light up the LEEs in correspondence with the outcome of the at least one mathematical operation.

720 630 660 720 630 660 710 640 620 560 720 640 630 660 630 450 720 630 660 1. A method for controlling with an active receiver card () a plurality of pixels of a tile () of a display (), the active receiver card () being electrically connected to the tile () of the display (), the method comprising: receiving by a first interface () a broadcast serialized video data stream () as input from a video processing system (); extracting by a processor () of the active receiver card (), from the received broadcast serialized video data stream (), video image data pertaining to the tile () of the display (); and based on the extracted video image data pertaining to the tile (), outputting, by a second interface () of the active receiver card (), control signals used to control the plurality of pixels of the tile () of the display ().

600 640 660 640 660 630 620 640 640 640 630 640 640 660 640 660 620 640 640 660 660 A modular display system () configured to broadcast a serialized video data stream (), comprising: a display () for displaying the serialized video data stream (), wherein the display () comprising a plurality of tiles (), comprising at least a first tile and a second tile; and a video processing system () configured to output the serialized video data stream () as a plurality of portions of the serialized video data stream (), each of the plurality of portions of the serialized video data stream () pertaining to a corresponding one of the plurality of tiles (), such that the plurality of portions of the broadcast serialized video data stream () comprises at least a first portion of the serialized video data stream () comprising video image data pertaining to the first tile of the display () and a second portion of the serialized video data stream () comprising video image data pertaining to the second tile of the display (); wherein the video processing system () outputs both the first portion of the serialized video data stream () and the second portion of the serialized video data stream () combined as a single broadcast data stream to a first active receiver card corresponding to the first tile of the display () and to a second active receiver card corresponding to the second tile of the display ().

Certain terms are used throughout the description and claims to refer to particular methods, features, or components. As those having ordinary skill in the art will appreciate, different persons may refer to the same methods, features, or components by different names. This disclosure does not intend to distinguish between methods, features, or components that differ in name but not function. The figures are not necessarily drawn to scale. Certain features and components herein may be shown in exaggerated scale or in somewhat schematic form and some details of conventional elements may not be shown or described in interest of clarity and conciseness.

Although various example embodiments have been described in detail herein, those skilled in the art will readily appreciate in view of the present disclosure that many modifications are possible in the example embodiments without materially departing from the concepts of present disclosure. Accordingly, any such modifications are intended to be included in the scope of this disclosure. Likewise, while the disclosure herein contains many specifics, these specifics should not be construed as limiting the scope of the disclosure or of any of the appended claims, but merely as providing information pertinent to one or more specific embodiments that may fall within the scope of the disclosure and the appended claims. Any described features from the various embodiments disclosed may be employed in combination. In addition, other embodiments of the present disclosure may also be devised which lie within the scopes of the disclosure and the appended claims. Each addition, deletion, and modification to the embodiments that falls within the meaning and scope of the claims is to be embraced by the claims.

Certain embodiments and features may have been described using a set of numerical upper limits and a set of numerical lower limits. It should be appreciated that ranges including the combination of any two values, e.g., the combination of any lower value with any upper value, the combination of any two lower values, and/or the combination of any two upper values are contemplated unless otherwise indicated. Certain lower limits, upper limits and ranges may appear in one or more claims below. Any numerical value is “about” or “approximately” the indicated value, and takes into account experimental error and variations that would be expected by a person having ordinary skill in the art.