Patentable/Patents/US-12603091-B2
US-12603091-B2

Immersive collaboration of remote participants via media displays

PublishedApril 14, 2026
Assigneenot available in USPTO data we have
Inventorsnot available in USPTO data we have
Technical Abstract

An immersive digital experience for video conferencing simulates common presence of a virtual participant in a local environment. Such simulation may include (i) using a transparent media display having a portion of its pixels projecting the virtual participant's body image while keeping at least a portion of the background transparent (e.g., to visible light), (ii) disposing sensor(s) (e.g., camera) behind the transparent media display at the gaze of the participant, and/or (iii) using added virtual overlays (e.g., of plants, memorabilia, and/or furniture) to the virtual image (e.g., that are consistent with the local environment), e.g., to provide a sense of depth ranging from the overlays to the virtual participant projection and to the background showing through the transparent media display.

Patent Claims

Legal claims defining the scope of protection, as filed with the USPTO.

1

. An apparatus for digital collaboration, the apparatus comprising:

2

. The apparatus for digital collaboration ofwherein the one or more controllers are further configured to adjust a transparency of the electrochromic display based, at least in part, on an element selected from the group consisting of: a position of a sun, a weather condition, images displayed on the media display, and a reading from one or more sensors.

3

. The apparatus for digital collaboration ofwherein the electrochromic display comprises a camera configured for capturing an image of the local user.

4

. The apparatus for digital collaboration ofwherein the camera is configured for a focus that is greater than the distance between the camera and the electrochromic display to avoid capturing images displayed on the media display.

5

. The apparatus for digital collaboration ofwherein the electrochromic display comprises a wireless charger.

6

. The apparatus of, wherein a position of the depiction of the remotely located remote user is based on the depiction of the object.

7

. A method for digital collaboration, the method comprising:

8

. The method for digital collaboration offurther comprising displaying on the electrochromic display, within the redacted portion, a virtual overlay based on the first location.

9

. The method for digital collaboration offurther comprising adjusting a transparency of the electrochromic display based, at least in part, on an element selected from the group consisting of: a position of a sun, a weather condition, images displayed on the media display, and a reading from one or more sensors.

10

. The method for digital collaboration offurther comprising capturing an image of the local user with a camera built into the electrochromic display.

11

. The method for digital collaboration offurther comprising setting the camera with a focus that is greater than the distance between the camera and the electrochromic display to avoid capturing images displayed on the electrochromic display.

Detailed Description

Complete technical specification and implementation details from the patent document.

An Application Data Sheet is filed concurrently with this specification as part of the present application. Each application that the present application claims benefit of or priority to as identified in the concurrently filed Application Data Sheet is incorporated herein by reference in its entirety and for all purposes. This application is also related to: U.S. patent application Ser. No. 17/249,148, filed Feb. 22, 2021, titled “CONTROLLING OPTICALLY-SWITCHABLE DEVICES,” and to U.S. patent application Ser. No. 16/946,947, filed Jul. 13, 2020, titled “AUTOMATED COMMISSIONING OF CONTROLLERS IN A WINDOW NETWORK,” each of which patent applications is incorporated herein by reference in its entirety and for all purposes.

This disclosure relates generally to improved digital experience that provides users an enhanced immersive experience, which simulates common presence of a virtual participant (and optional related virtual auxiliary content) and physically present participants in a conference.

Various facilities (e.g., buildings) have windows installed, e.g., in their facades. The windows provide a way to view an environment external to the facility. In some facilities, the window may take a substantial portion (e.g., more than about 30%, 40%, 50%, or 80% of a surface area) of a facility facade. Users may request utilization of at least a portion of the window surface area to view various media. The media may be for entertainment, educational, safety, health, and/or work purposes. The media may facilitate processing, presenting, and/or sharing data. The media may be or the purpose of conducting a conference such as in the form of a video conference with one or more remote parties. At times, a user may want to optimize usage of an interior space of the facility to visualize the media (e.g., by using the window surface area). The media may comprise an electronic media, digital media, and/or optical media. A user may request viewing the media with an ability to view through at least a portion of the window (e.g., with minimal impact on visibility through the window). The media may be displayed via a display that is at least partially transparent (e.g., to visible light). At times viewing the media may require a tinted (e.g., darker) backdrop, At times, a user may want to augment external views and/or projections of the display with overlays, augmented reality, and/or lighting.

At times, interactions over conventional video conferencing feel unnatural and/or distant. For example, it may be difficult to make pupil to pupil eye contact, e.g., because of the arrangement of each of the cameras being offset from the direction of the participants' gaze toward the display. The image may appear flat and/or detached from the real surrounding. Surroundings of the participant at the other end of a video conference may be disjointed from a local surroundings. When auxiliary text and/or graphic materials are shared and displayed by participant(s) at a first location, live updating of the materials has required cumbersome passing of control over the content from participant(s) at a first location to participant(s) at a distant second location (e.g., at another room, another building, or otherwise at another facility).

The user interaction may occur by way of media display construct(s) and imaging device(s). The imaging device may be associated with one or more interactive targets in an enclosure. The interactive target(s) can comprise an optically switchable device (e.g., tintable window of a facility), projected media, environmental appliance, sensor, emitter, and/or any other apparatus that is communicatively coupled to a network in an enclosure, which network facilitates power and/or communication.

In some embodiments, included in these device(s) are optically switchable window(s). The development and deployment of optically switchable windows for enclosures (e.g., buildings and other facilities) have increased as considerations of energy efficiency and system integration gain momentum. Electrochromic windows are a promising class of optically switchable windows. Electrochromism is a phenomenon in which a material exhibits a reversible electrochemically-mediated change in one or more optical properties when stimulated to a different electronic state. Electrochromic materials and the devices made from them may be incorporated into, for example, windows for home, commercial, or other use. The color, shade, hue, tint, transmittance, absorbance, and/or reflectance of electrochromic windows can be changed, e.g., by inducing a change in the electrochromic material. For example, by applying a voltage across the electrochromic material. Such capabilities can allow for control over the intensities of various (e.g., visible light) wavelengths of light that may pass through the window. One area of interest is control systems for driving optical transitions in optically switchable windows to provide requested lighting conditions, e.g., while reducing the power consumption of such devices and/or improving the efficiency of systems with which they are integrated.

Various aspects disclosed herein alleviate as least part of the shortcomings and/or materialize at least part of the aspirations related to digital collaboration of participants located remotely from one another.

Various embodiments herein relate to methods, systems, software and networks for providing an immersive experience, which simulates common presence of a virtual participant(s) and/or related virtual auxiliary content, and present (e.g. local) participant(s) in conference (e.g., enabled by video conferencing). Such simulation may include (i) using an at least partially transparent media display having a portion of its projecting entities (e.g., pixels) projecting the virtual participant's image and/or (e.g., select) virtual auxiliary content, while keeping at least a portion of the background at least partially transparent (e.g., to visible light), (ii) optionally disposing optical sensor(s) (e.g., included in a camera) behind the transparent media display at the gaze of the participant, and (iii) optionally using added virtual overlays (e.g., plants, furniture) to the virtual image that are consistent with the local environment, which virtual overlays appear perspectively close to the local participants, e.g., to provide a sense of depth ranging from the overlays to the virtual participant projection and/or to the background showing through the transparent media display. Placement of the optical sensor(s) (e.g., camera) behind and at the gaze of the real participant, may allow the participant to view the virtual participant while simultaneously being photographed at the real (e.g., actual) participant's gaze (e.g., focal point). The transparent media display can include touchscreen functionality, e.g., for shared access to any auxiliary documents (e.g., a virtual whiteboard), e.g., making it seem as if the users are sharing the same physical document in real time.

In another aspect, a method for digital collaboration, the method comprises:

In some embodiments, the second processor is operatively coupled to an other sensor configured to capture to at least one second user in the second location. In some embodiments, the communication link comprises a machine to machine communication. In some embodiments, the portion of the media stream which is suppressed comprises a region around an other portion of the media stream which depicts the second user. In some embodiments, the first media display comprises a transparent display, and wherein the portion of the media stream which is suppressed facilitates at least partial viewing of the first location of the first user through the transparent display. In some embodiments, the transparent display facilitates transmission of at least about 30% of light in the visible spectrum therethrough. In some embodiments, the transparent display facilitates transmission of from about 20% to about 90% of light in the visible spectrum therethrough. In some embodiments, the first media display is coupled to a tintable window. In some embodiments, the tintable window alters visibility, color, transmission, and/or reflectance of visible light. In some embodiments, the tintable window comprises an electrochromic device. In some embodiments, the electrochromic device is included in an insulated glass unit configured for installation in an enclosure. In some embodiments, the transparent display spans at least about 30% of an area of the tintable window. In some embodiments, the transparent display spans from about 10% to about 100% of an area of the tintable window. In some embodiments, the tintable window is coupled to a control system configured for adjusting a tint of the tintable window. In some embodiments, the control system comprises, or is operatively coupled to, a building management system. In some embodiments, the control system comprises a distributed network of controllers. In some embodiments, the control system comprises a hierarchical control system in which a master controller is configured to control one or more local controllers. In some embodiments, the control system comprises a controller that is included in a device ensemble, wherein the device ensemble is disposed in an enclosure. In some embodiments, the device ensemble comprises (i) sensors or (ii) a sensor and an emitter. In some embodiments, the device ensemble is disposed in a fixture (e.g., framing portion, ceiling, or wall). In some embodiments, the device ensemble is disposed in a non-fixture (e.g., a furniture, a billboard, or another tangible and movable asset). In some embodiments, the device ensemble comprises (i) a plurality of processors or (ii) a plurality of circuit boards. In some embodiments, the method further comprises (C) displaying on the first media display at least one virtual object which depicts a furnishing that spatially appears to be disposed between (i) the first user and (ii) the media stream displayed on the first media display. In some embodiments, the at least one virtual object is displayed so that it provides an apparent depth which is in front of an apparent depth of the depiction of the second user. In some embodiments, the at least one virtual object is configured to flank a depiction of the at least one second user at least during a portion of streaming the media stream of the at least one second user. In some embodiments, the sensor is an image sensor associated with the first media display, which sensor is configured to capture a first user of the at least one first user, for generating an other media stream to be communicated via the communication link to the second media display, which other media stream is associated with the first location, which first user gazes towards the first media display. In some embodiments, the method further comprises adjusting the capture location to focus on a central, or on a substantially central, position (i) between pupils of a first user of the at least one first user, (ii) between brows of the first user, and/or (iii) at the end of a nose bride of the first user. In some embodiments, the position is vertically aligned, horizontally aligned, or both vertically and horizontally aligned. In some embodiments, adjustment of the capture location is performed manually at least in part. In some embodiments, adjustment of the capture location is performed automatically. In some embodiments, adjustment of the capture location is based at least in part on image processing, machine learning, and/or artificial intelligence. In some embodiments, adjustment of the capture location is controlled by at least one controller. In some embodiments, adjustment of the capture location is controlled by a control system configured to control at least one other device of a facility in which the first media display is disposed. In some embodiments, the method further comprises using the sensor for generating the other media stream from a capture location which corresponds to a gazing region of the first user directed towards the first media display. In some embodiments, the sensor is movable with respect to the first media display, the method further comprising adjusting the capture location to match the gazing region of the first user. In some embodiments, adjustment of the capture location is performed manually at least in part. In some embodiments, adjustment of the capture location is performed automatically according to a captured image of the first user. In some embodiments, the first user is disposed on a first side of the media display, and wherein the capture location of the sensor is disposed on a second side of the first media display that is at least partially transparent to visible light, such that the media stream depicts the first user using images passing through the transparent display of the first media display, which first side is an opposite of the first media display relative to the second side. In some embodiments, the first media display that is at least transparent to visible light is configured to allow at least a portion of the visible light to pass therethrough. In some embodiments, the first media display is configured to allow visible light to pass therethrough when the first media display is nonoperational and/or when the first media display is operational. In some embodiments, the sensor is mounted on a movable carriage driven by the at least one controller. In some embodiments, the first media display is coupled to a tintable window. In some embodiments, the tintable window is an integrated glass unit, and wherein the movable carriage is (i) configured for planar motion, and (ii) disposed in an interior of the integrated glass unit. In some embodiments, the first media display includes a transparent substrate integrating a plurality of light emitting pixels, and wherein the sensor comprises a plurality of sensels disposed on the transparent substrate. In some embodiments, comprising displaying on the first media display and/or the second media display a shared auxiliary content at a region of the first media display and/or at a region of the second media display. In some embodiments, (i) the region of the first media excludes depictions of the at least one second user and/or (ii) the region of the second media excludes depictions of the at least one second user. In some embodiments, the shared auxiliary content is updatable by the at least one first user, by the at least one second user, or by both the at least one first user and the at least one second user. In some embodiments, the region displaying the shared auxiliary content is configured to facilitate touchscreen capability for modifying the shared auxiliary content. In some embodiments, the shared auxiliary content is digitally stored in storage which is responsive to the at least one first user and/or to the at least one second user via an auxiliary communication link. In some embodiments, at least one of the first media display and the second media display, is disposed in an individual portal laid out within an enclosure. In some embodiments, at least one of the first media display and the second media display, is disposed in a small group pod laid out within an enclosure. In some embodiments, at least one of the first media display and the second media display, is disposed in a large group zone laid out within an enclosure. In some embodiments, at least one of the first media display and the second media display, is disposed on a freestanding panel laid out within an enclosure. In some embodiments, at least one of the first media display and the second media display, is disposed in an activity hub laid out within an enclosure. In some embodiments, the method further comprises displaying, with the second media display at the second location, an other media stream of the at least the one first user sent to the second media display from the first media display via the communication link, wherein a first portion of the other media stream is suppressed from being displayed on the second media display that is at least partially transparent to visible light, to facilitate viewing of at least a portion of the second location through a portion of the second media display corresponding to the other media stream that is suppressed. In some embodiments, the other media stream of the at least one second user includes a video stream captured by an other sensor associated with the second media display, and wherein the other sensor captures the video stream from a second capture location which corresponds to a gazing region of a second user of the at least one second user, on the second media display.

In another aspect, an apparatus for digital collaboration, the apparatus comprises at least one controller configured to perform, or direct performance of, of any of the methods disclosed above.

In another aspect, an apparatus for digital collaboration, the apparatus comprises at least one controller configured to: (A) operatively couple to a first processor that is operatively coupled to a first media display disposed at a first location occupied by at least one first user, which operatively coupling of the first processor is via a communication link to a second processor that is operatively coupled to a second media display disposed at a second location occupied by at least one second user; and (B) direct the first media display to display a media stream of the at least one second user sent to the first processor from the second processor via the communication link, wherein a first portion of the media stream is suppressed from being displayed on the first media display that is at least partially transparent to visible light, which suppression enables viewing of at least a portion of the first location through a portion of the first media display corresponding to the media stream that is suppressed.

In some embodiments, the at least one controller comprises circuitry. In some embodiments, the first processor is included in a control system which comprises, or is operatively coupled to, a building management system. In some embodiments, the first processor is included in a control system which comprises a distributed network of controllers. In some embodiments, the first processor is included in a control system which comprises a hierarchical control system in which a master controller is configured to control one or more local controllers. In some embodiments, the first processor is included in a device ensemble, wherein the device ensemble is disposed in an enclosure. In some embodiments, the device ensemble comprises (i) sensors or (ii) a sensor and an emitter. In some embodiments, the device ensemble is disposed in a fixture (e.g., framing portion, ceiling, or wall). In some embodiments, the device ensemble is disposed in a non-fixture (e.g., a furniture, a billboard, or another tangible and movable asset). In some embodiments, the device ensemble comprises (i) a plurality of processors or (ii) a plurality of circuit boards. In some embodiments, the apparatus further comprises a tintable window which alters visibility, color, transmission, and/or reflectance of visible light, wherein the first processor is configured for adjusting a tint of the tintable window. In some embodiments, the apparatus further comprises the tintable window comprises an electrochromic device. In some embodiments, the apparatus further comprises the electrochromic device is included in an insulated glass unit configured for installation in an enclosure.

In another aspect, a non-transitory computer readable product instructions for digital collaboration, the non-transitory computer readable product instructions, when read by one or more processors, cause the one or more processors to execute, or direct execution, of any of the methods disclosed above.

In another aspect, a non-transitory computer readable product instructions for digital collaboration, the non-transitory computer readable product instructions, when read by one or more processors, cause the one or more processors to execute one or more operations, comprises: directing a first media display disposed at a first location, to display a media stream of the at least one second user disposed at a second location, which media stream is sent to a first processor operatively coupled to the first media display, from a second processor operatively coupled to the second media display, which media stream is sent via a communication link, wherein a first portion of the media stream is suppressed from the displaying on the first media display that is at least partially transparent to visible light, which suppression enables viewing of at least a portion of the first location through a portion of the first media display corresponding to the media stream that is suppressed, which one or more processors are operatively coupled to the first processor that is operatively coupled to the first media display disposed at the first location occupied by at least one first user, which operatively coupling of the first processor is via the communication link to the second processor operatively coupled to the second media display disposed at the second location occupied by the at least one second user.

In some embodiments, the product instructions are embedded in one of more non-transitory computer readable media. In some embodiments, the product instructions are included in a program product.

In another aspect, a system for digital collaboration, the system comprises a network configured to facilitate one or more operations of any of the methods disclosed above.

In some embodiments, facilitating one or more operations comprises operatively coupling to one or more devices, operatively coupling to one or more apparatuses, operatively coupling to one or more systems, facilitate communication and/or facilitate power transmission.

In another aspect, a system for digital collaboration, the system comprises:

In some embodiments, the network is configured for transmission of the media stream at least in part by being configured to enable transmission of a protocol of the media stream. In some embodiments, the network is operatively coupled to a hierarchical control system at least partially disposed in an enclosure which includes the first location. In some embodiments, the network is at least partly disposed in a facility and is capable of transmitting power and communication signals. In some embodiments, the network is configured to connect to a plurality of devices in the facility. In some embodiments, (i) at least two of the plurality of devices are of different type and/or (ii) at least two of the plurality of devices are of the same type. In some embodiments, the plurality of devices includes processors, controllers, sensors, emitters, receivers, transmitters, and/or device ensembles. In some embodiments, the plurality of devices includes a controller operatively coupled to a tintable window for operatively controlling the tintable window. In some embodiments, the plurality of devices includes a controller operatively coupled to control a lighting device, a tintable window, a sensor, an emitter, a media display, a dispenser, a processor, a power source, a security system, a fire alarm system, a sound media, an antenna, a radar, a controller, a heater, a cooler, a vent, or a heating ventilation and air conditioning system (HVAC). In some embodiments, the communication signals include cellular communication signals. In some embodiments, the network is configured to transmit at least fourth (4G) or at least fifth (5G) generation cellular communication. In some embodiments, the network is configured for transmission of power and communication signals using coaxial cables, optical wires, and/or twisted wires. In some embodiments, the network is configured of transmitting power and communication signals on a single cable. In some embodiments, the network is the first network installed in a facility. In some embodiments, the network is disposed at least in an envelope of a facility. In some embodiments, the network is configured to transmit two or more communication types on a single wire. In some embodiments, the communication types comprise cellular communication, video communication, control communication, or other data stream.

In another aspect, a method for digital collaboration, the method comprising using a sensor to capture a media stream of at least the one first user disposed in a first location, which sensor is associated with a first media display disposed in the first location, and is configured to obtain the media stream of at least one first user through the first media display that is at least partially transparent to visible light.

In some embodiments, the method further comprises establishing a communication link between (i) a first processor operatively coupled to the first media display and (ii) a second processor operatively coupled to a second media display disposed at a second location occupied by at least one second user. In some embodiments, the communication link comprises a machine to machine communication. In some embodiments, the communication link is configured to facilitate transmission of the media stream. In some embodiments, the method further comprises transmitting the media stream for display on the second media display. In some embodiments, the method further comprises using the sensor for generating the media stream from a capture location which corresponds to a gazing region of the first user directed towards the first media display. In some embodiments, the method further comprises adjusting the capture location to focus on a central, or on a substantially central, position (i) between pupils of a first user of the at least one first user, (ii) between brows of the first user, and/or (iii) at the end of a nose bride of the first user. In some embodiments, the position is vertically aligned, horizontally aligned, or both vertically and horizontally aligned. In some embodiments, adjustment of the capture location is performed manually at least in part. In some embodiments, adjustment of the capture location is performed automatically. In some embodiments, adjustment of the capture location is based at least in part on image processing, machine learning, and/or artificial intelligence. In some embodiments, adjustment of the capture location is controlled by at least one controller. In some embodiments, adjustment of the capture location is controlled by a control system configured to control at least one other device of a facility in which the first media display is disposed. In some embodiments, the sensor is movable with respect to the first media display, the method further comprising adjusting the capture location to match the gazing region of the first user. In some embodiments, the adjusting of the capture location is performed manually at least in part. In some embodiments, adjustment of the capture location is performed automatically according to a captured image of the first user. In some embodiments, the first user is disposed on a first side of the media display, and wherein the capture location of the sensor is disposed on a second side the first media display that is at least partially transparent to visible light, such that the first media stream depicts the first user using images passing through the transparent display of the first media display, which first side is an opposite of the first media display relative to the second side. In some embodiments, the sensor is mounted on a movable carriage driven by at least one controller. In some embodiments, the first media display is coupled to a tintable window. In some embodiments, the tintable window is an integrated glass unit, and wherein the movable carriage is (i) configured for planar motion, and (ii) disposed in an interior of the integrated glass unit. In some embodiments, the first media display includes a transparent substrate integrating a plurality of light emitting pixels, and wherein the sensor comprises a plurality of sensels disposed on the transparent substrate. In some embodiments, the first media display is coupled to a tintable window. In some embodiments, the tintable window alters visibility, color, hue, transmission, and/or reflectance of visible light. In some embodiments, the tintable window comprises an electrochromic device. In some embodiments, the electrochromic device is included in an insulated glass unit configured for installation in an enclosure. In some embodiments, the transparent display spans at least about 30% of an area of the tintable window. In some embodiments, the transparent display spans from about 10% to about 100% of an area of the tintable window. In some embodiments, the tintable window is coupled to a control system configured for adjusting a tint of the tintable window. In some embodiments, the control system comprises, or is operatively coupled to, a building management system. In some embodiments, the control system comprises a distributed network of controllers. In some embodiments, the control system comprises a hierarchical control system in which a master controller that is configured to control one or more local controllers. In some embodiments, the control system comprises a controller that is included in a device ensemble, wherein the device ensemble is disposed in the enclosure. In some embodiments, the device ensemble comprises (i) sensors or (ii) a sensor and an emitter. In some embodiments, the device ensemble is disposed in a fixture (e.g., framing portion, ceiling, or wall). In some embodiments, the device ensemble is disposed in a non-fixture (e.g., a furniture, a billboard, or another tangible and movable asset). In some embodiments, the device ensemble comprises (I) a plurality of processors or (ii) a plurality of circuit boards. In some embodiments, at least one of the first media display and the second media display, is disposed in an individual portal laid out within an enclosure. In some embodiments, at least one of the first media display and the second media display, is disposed in a small group pod laid out within an enclosure. In some embodiments, at least one of the first media display and the second media display, is disposed in a large group zone laid out within an enclosure. In some embodiments, at least one of the first media display and the second media display, is disposed on a freestanding panel laid out within an enclosure. In some embodiments, at least one of the first media display and the second media display, is disposed in an activity hub laid out within an enclosure.

In another aspect, an apparatus for digital collaboration, the apparatus comprises at least one controller configured to perform, or direct performance of, of any of the methods disclosed above.

In another aspect, an apparatus for digital collaboration, the apparatus comprises at least one controller configured to: (A) operatively couple to a sensor that is (i) configured for capturing a media stream (ii) associated with a first image display, (iii) is disposed in a first location in which the first image display is disposed, and (iv) configured to obtain the media stream through the first media display that is at least partially transparent to visible light; and (B) direct the sensor to capture the media stream in the first location.

In some embodiments, the first media display is operatively coupled to a first processor, which first location is occupied by at least one first user, which first processor is operatively coupled via a communication link to a second processor operatively coupled to a second media display disposed at a second location occupied by at least one second user. In some embodiments, the at least one controller is configure to direct transmission of the media stream for display by the second media display.

In another aspect, a non-transitory computer readable product instructions for digital collaboration, the non-transitory computer readable product instructions, when read by one or more processors, causes the one or more processors to execute, or direct execution, of any of the methods disclosed above.

In another aspect, a non-transitory computer readable product instructions for digital collaboration, the non-transitory computer readable product instructions, when read by one or more processors, causes the one or more processors to execute one or more operations comprises: directing a sensor to capture a media stream in a first location, which one or more processors are operatively coupled to the sensor that is (i) configured for capturing a media stream (ii) associated with a first image display, (iii) is disposed in a first location in which the first image display is disposed, and (iv) configured to obtain the media stream through the first media display that is at least partially transparent to visible light.

In some embodiments, the product instructions are embedded in one of more non-transitory computer readable media. In some embodiments, the product instructions are included in a program product.

In another aspect, a system for digital collaboration, the system comprises a network configured to facilitate one or more operations of any of the methods disclosed above.

In some embodiments, facilitating one or more operations comprises operatively coupling to one or more devices, operatively coupling to one or more apparatuses, operatively coupling to one or more systems, facilitate communication and/or facilitate power transmission.

In another aspect, a system for digital collaboration, the system comprises:

In some embodiments, the network is configured for transmitting the media stream at least in part by being configured to enable transmission of a protocol of the media stream. In some embodiments, the network is configured to operatively coupled to a hierarchical control system at least partially disposed in an enclosure which includes the first location. In some embodiments, the network is at least partly disposed in a facility and is capable of transmitting power and communication signals. In some embodiments, the network interconnects a plurality of devices in the facility. In some embodiments, the plurality of devices includes processors, controllers, sensors, emitters, receivers, transmitters, and/or device ensembles. In some embodiments, the plurality of devices includes a controller operatively coupled to a tintable window for operatively controlling the tintable window. In some embodiments, the plurality of devices includes a controller operatively coupled to control a lighting device, a tintable window, a sensor, an emitter, a media display, a dispenser, a processor, a power source, a security system, a fire alarm system, a sound media, an antenna, a radar, a controller, a heater, a cooler, a vent, or a heating ventilation and air conditioning system (HVAC). In some embodiments, the communication signals include cellular communication signals. In some embodiments, the network is configured to transmit at least fourth (4G) or at least fifth (5G) generation cellular communication. In some embodiments, the network is configured for transmission of power and communication signals using coaxial cables, optical wires, and/or twisted wires. In some embodiments, the network is capable of transmitting both power and communication signals in a single cable. In some embodiments, the network is the first network installed in a facility. In some embodiments, the network is disposed at least in an envelope of a facility. In some embodiments, the network is configured to transmit two or more communication types on a single wire. In some embodiments, the communication types comprise cellular communication, video communication, control communication, or other data stream.

In another aspect, a device for interactive digital communication comprising: a frame configured to frame a supportive structure, a media display, and one or more sensors configured for image capturing.

In some embodiments, the frame includes curved and/or straight portions. In some embodiments, at least one corner (e.g., four corners) of the frame are curved. In some embodiments, the supportive structure comprises an opaque or a transparent portion. In some embodiments, the supportive structure is a window such as a tintable window. In some embodiments, the display is a transparent display. In some embodiments, the transparent display is configured to project a redacted image. In some embodiments, the display is configured to project a higher intensity image by a portion of the projecting entities (e.g., pixels) of the media display, and project a relatively reduced intensity image on an other portion of the projecting entities. In some embodiments, the reduced intensity comprises no projection (e.g., zero intensity). In some embodiments, the reduce intensity projection facilitates viewing through the media display. In some embodiments, the device further comprises lighting (e.g., fluorescent, incandescent, and/or LED). The lighting may be a strip disposed above (e.g., immediately above may be in a direction against the gravitational center. Immediately above may be contacting the display) the display. In some embodiments, the lighting comprises a lighting strip. In some embodiments, the device comprises a ledge. In some embodiments, the ledge is configured to act as a table. In some embodiments, the ledge is disposed immediately below the display (e.g., immediately below may be in a direction towards the gravitational center. Immediately below may be contacting the display). In some embodiments, the device is configured to operatively couple (e.g., connect) to a communication and/or power network (e.g. comprising wired and/or wireless coupling). The display may be configured to project images (e.g., stream video images), e.g., of participants and/or any auxiliary content. The display is configured to project overlays (e.g., virtual objects). In some embodiments, the device and/or display is operatively coupled to an app that facilitates a user to configure the display and/or its projection. For example, facilitate choosing overlays and/or adjusting the one or more sensors. In some embodiments, the one or more sensors are operatively coupled to an actuator. The one or more sensors can be stationary or mobile. A user may adjust position of the one or more sensors (e.g., camera) to align with a facial user of the user, e.g., such that an image taken by the one or more sensors will coincide with the user's face (e.g., pupils).

In another aspect, a method for digital collaboration, the method comprises: moving a media display with respect to a wall portion of a digital collaboration unit, which media display is at least partially transparent to visible light, which digital collaboration unit comprises (i) a physical work surface disposed adjacent to the media display and configured to be disposed between the media display and a user of the media display, and/or (ii) lighting disposed adjacent to the media display and configured to project light onto the user and/or across the media display and towards a gravitational center.

In some embodiments, moving of the media display is based at least in part on a position of at least one bodily feature and/or body portion of the user. In some embodiments, moving of the media display comprises a movement with respect to the gravitational center. In some embodiments, the bodily portion comprises a nose, eyebrows, eyes, pupils, a head, a chin, lips, a nose bridge, or ears. In some embodiments, the method further comprises using a sensor to capture a media stream of the user disposed in a location adjacent to the media display, which sensor is associated with the digital collaboration unit. In some embodiments, the sensor is configured to be located on an opposite side of the media display from the user of the media display. In some embodiments, moving the media display includes the media display being movable to a height above a floor of at least an average person in a sitting and/or standing position. In some embodiments, including moving the physical work surface and/or the lighting in coordination with movement of the media display, or vice versa. In some embodiments, the coordination of the movement of the physical work surface and/or the lighting with movement of the media display comprises vertical movement relative to the gravitational center. In some embodiments, the method including moving the physical work surface and/or the lighting without coordination with movement of the media display, or vice versa. In some embodiments, the movement of the physical work surface and/or the lighting comprises a vertical movement relative to the gravitational center.

In another aspect, an apparatus for digital collaboration, the apparatus comprises at least one controller configured to: (a) operatively coupled to the media display, and (b) perform, or direct performance of, any of the methods disclosed above.

In another aspect, a non-transitory computer readable program instructions for digital collaboration, the non-transitory computer readable program instructions, when read by one or more processors operatively coupled to the media display, cause the one or more processors to execute, or direct execution of, any of the methods disclosed above.

In another aspect, a system for digital collaboration, the system comprises: a network configured to operatively coupled to the media display, and transmit one or more signals facilitating the method of any disclosed above.

In another aspect, an apparatus for digital collaboration, the apparatus comprises one or more controllers comprising circuitry, which at least one controller is configured to: (a) operatively couple to a media display; and (b) move, or direct movement of, the media display with respect to a wall portion of a digital collaboration unit, which media display is at least partially transparent to visible light, which digital collaboration unit comprises (i) a physical work surface disposed adjacent to the media display and configured to be disposed between the media display and a user of the media display, and/or (ii) lighting disposed adjacent to the media display and configured to project light onto the user and/or across the media display and towards a gravitational center.

In some embodiments, the at least one controller comprises a hierarchical control system having at least three levels of hierarchy. In some embodiments, the at least one controller comprises a controller disposed in a device ensemble having a housing enclosing at least one sensor. In some embodiments, the device ensemble comprises another sensor, an emitter, or a transceiver. In some embodiments, the at least one controller comprises a microcontroller. In some embodiments, the at least one controller is configured to utilize, or direct utilization of, artificial intelligence for predictive control. In some embodiments, the at least one controller comprises a controller disposed in, or attached to, a fixture of a facility.

In another aspect, a non-transitory computer readable program instructions for digital collaboration, the non-transitory computer readable program instructions, when read by one or more processors operatively coupled to a media display, cause the one or more processors to execute operations comprises: moving, or directing movement of, the media display with respect to a wall portion of a digital collaboration unit, which media display is at least partially transparent to visible light, which digital collaboration unit comprises (i) a physical work surface disposed adjacent to the media display and configured to be disposed between the media display and a user of the media display, and/or (ii) lighting disposed adjacent to the media display and configured to project light onto the user and/or across the media display and towards a gravitational center.

In some embodiments, the one or more processors comprises a hierarchical system of processors having at least three levels of hierarchy. In some embodiments, the one or more processors comprises a processor disposed in a device ensemble having a housing enclosing at least one sensor. In some embodiments, the device ensemble comprises another sensor, an emitter, or a transceiver. In some embodiments, the processor comprises a graphic processing unit. In some embodiments, the operations comprise utilizing, or directing utilization of, an artificial intelligence computational scheme for prediction of a second attribute. In some embodiments, the one or more processors comprises a processor disposed in, or attached to, a fixture of a facility. In some embodiments, the one or more processors comprises a processor disposed externally to a facility. In some embodiments, externally to the facility comprises a cloud server. In some embodiments, the operations comprise remotely updating, or directing remote update, from a source external to a facility.

In another aspect, a system for digital collaboration, the system comprises: a network configured to: (a) operatively couple to a media display; and (b) transmit one or more signals that facilitate moving the media display with respect to a wall portion of a digital collaboration unit, which media display is at least partially transparent to visible light, which digital collaboration unit comprises (i) a physical work surface disposed adjacent to the media display and configured to be disposed between the media display and a user of the media display, and/or (ii) lighting disposed adjacent to the media display and configured to project light onto the user and/or across the media display and towards a gravitational center.

In some embodiments, the network is configured to transmit communication and power on a single cable. In some embodiments, the network is configured to transmit communication protocols, wherein at least two of the communication protocols are different. In some embodiments, the communication protocols comprise at least a fourth generation, or a fifth generation cellular communication protocol. In some embodiments, the communication protocols facilitate cellular, media, control, security, and/or other data communication. In some embodiments, the communication protocols comprise a control protocol that comprises building automation control protocol. In some embodiments, the network is configured to operatively couple to one or more antennas, and optionally wherein the one or more antennas comprise a distributed antenna system. In some embodiments, the network is configured to facilitate remote software updates from a source external to the facility.

In another aspect, an apparatus for digital collaboration, the apparatus comprises: a digital collaboration unit having a wall portion and a media display that is configured to be moveable with respect to the wall portion, which media display is at least partially transparent to visible light, which digital collaboration unit comprises (i) a physical work surface disposed adjacent to the media display and configured to be disposed between the media display and a user of the media display, and/or (ii) lighting disposed adjacent to the media display and configured to project light onto the user and/or across the media display and towards a gravitational center.

In some embodiments, the physical work surface and/or the lighting is configured to be moveable in coordination with movement of the media display, or vice versa. In some embodiments, the movement is in at least a vertical direction relative to the gravitational center. In some embodiments, the physical work surface and/or the lighting is configured to be moveable without coordination with movement of the media display, or vice versa. In some embodiments, the movement is in at least a vertical direction relative to the gravitational center. In some embodiments, movement of the display relative to the wall portion is based at least in part on a position of at least one bodily feature and/or body portion of the user. In some embodiments, movement of the media display comprises a movement with respect to the gravitational center. In some embodiments, the bodily portion comprises a nose, eyebrows, eyes, pupils, a head, a chin, lips, a nose bridge, or ears. In some embodiments, the apparatus further comprises a sensor configured to capture a media stream of the user disposed in a location adjacent to the media display, which sensor is associated with the digital collaboration unit. In some embodiments, the sensor is located on an opposite side of the media display from the user of the media display. In some embodiments, movement of the media display includes the media display being configured to be moveable to a height above a floor of at least an average person in a sitting and/or standing position.

In another aspect, an apparatus for digital collaboration, the apparatus comprises: a first digital collaboration unit comprising a first wall portion including a media display that is at least partially transparent, which media display is configured to be moveable with respect to the first wall portion, which first digital collaboration unit further comprises (i) a second wall portion configured to be moveable to selectively hinder viewing onto the media display and/or onto a first user disposed in the first digital collaboration unit, and/or (ii) at least two sensors mounted spaced apart from each other as part of the first wall portion of the first digital collaboration unit, which at least two sensors are configured to capture an image of the first user located in the first digital collaboration unit.

In some embodiments, the first digital collaboration unit is located in a facility having walls defining a room and the first wall portion is disposed within the room and is configured to be a partition. In some embodiments, first wall portion is shorter than the walls of the room. In some embodiments, the first wall portion is of at least a height of an average person. In some embodiments, movement of the second wall portion comprises a swiveling motion, or a sliding motion. In some embodiments, movement of the media display is based at least in part on a position of at least one bodily feature and/or body portion of the first user. In some embodiments, movement of the media display comprises a movement with respect to a gravitational center. In some embodiments, the bodily portion comprises a nose, eyebrows, eyes, pupils, a head, a chin, lips, a nose bridge, or ears. In some embodiments, at least one of the at least two sensors is located on an opposite side of the media display from the first user of the media display. In some embodiments, movement of the media display includes the media display being moveable to a height above a floor or at least an average person in a sitting and/or standing position. In some embodiments, the apparatus further including (i) a physical work surface disposed adjacent to the media display and configured to be dispose between the media display and the first user of the media display, and/or (ii) lighting disposed adjacent to the media display and configured to project light onto the first user and/or across the media display and towards a gravitational center; and wherein the physical work surface and/or the lighting is configured to be moveable in coordination with movement of the media display, or vice versa. In some embodiments, the movement of the physical work surface and/or the lighting is in at least a vertical direction relative to the gravitational center. In some embodiments, the apparatus further including (i) a physical work surface disposed adjacent to the media display and configured to be dispose between the media display and the first user of the media display, and/or (ii) lighting disposed adjacent to the media display and configured to project light onto the first user and/or across the media display and towards a gravitational center; and wherein the physical work surface and/or the lighting is configured to be moveable without coordination with movement of the media display, or vice versa. In some embodiments, the movement of the physical work surface and/or the lighting is in at least a vertical direction relative to the gravitational center.

In another aspect, a method for digital collaboration, the method comprises: moving a media display with respect to a first wall portion of a first digital collaboration unit, which media display is at least partially transparent, which first digital collaboration unit comprises (i) a second wall portion and/or (ii) at least two sensors mounted spaced apart from each other as part of the first wall portion of the first digital collaboration unit, which at least two sensors are configured to capture an image of a first user located in the first digital collaboration unit; and moving the second wall portion to selectively hinder viewing onto the media display and/or onto the first user disposed in the first digital collaboration unit.

Patent Metadata

Filing Date

Unknown

Publication Date

April 14, 2026

Inventors

Unknown

Want to explore more patents?

Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.

Citation & reuse

Analysis on this page is generated by Patentable — an AI-powered patent intelligence platform. AI-generated summaries, explanations, and analysis may be reused with attribution and a visible link back to the canonical URL below. Patent abstracts and claims are USPTO public domain.

Cite as: Patentable. “Immersive collaboration of remote participants via media displays” (US-12603091-B2). https://patentable.app/patents/US-12603091-B2

© 2026 Patentable. All rights reserved.

Patentable is a research and drafting-assistant tool, not a law firm, and does not provide legal advice. Documents we generate are drafts for review by a licensed patent attorney.