Systems, Methods and Computer Programs for a Microscope System and for Determining a Transformation Function

1. A system for a microscope system, the system comprising one or more processors and one or more storage devices, wherein the system is configured to: obtain first imaging sensor data from a first imaging sensor of a microscope of the microscope system and second imaging sensor data from a second imaging sensor of the microscope, the first imaging sensor data comprising sensor data on light sensed in a first plurality of mutually separated wavelength bands, the second imaging sensor data comprising sensor data on light sensed in a second plurality of mutually separated wavelength bands, wherein the wavelength bands of the first plurality of mutually separated wavelength bands or of the second plurality of mutually separated wavelength bands are wavelength bands that are used for fluorescence imaging, wherein the system is configured to use the first and the second imaging sensor to perform reflectance imaging; and generate a composite color image based on the first imaging sensor data and based on the second imaging sensor data, the composite color image being based on a plurality of color channels, wherein the composite color image is generated using a transformation function to define a transformation to be performed between the imaging sensor data and the composite color image, such that the composite color image is generated using sensor data on light sensed in each wavelength band of the first and second plurality of mutually separated wavelength bands.

2. The system according to claim 1, wherein the transformation is based on a set of transformation factors that each define a transformation to be performed between the imaging sensor data on light sensed in a wavelength band and a color channel of the composite color image.

3. The system according to claim 2, wherein the set of transformation factors comprises one transformation factor for each combination of wavelength band and color channel, and/or wherein the set of transformation factors provide a transformation between the imaging sensor data of each wavelength band of the first and second plurality of mutually separated wavelength bands and each of the color channels of the composite color image.

4. The system according to claim 1, wherein the composite color image comprises three color channels, wherein each of the color channels is generated based on a transformation of the imaging sensor data of each wavelength band of the first and second plurality of mutually separated wavelength bands, the transformation being performed using the transformation function.

5. The system according to claim 1, wherein the transformation function is implemented by a transformation matrix, wherein the system is configured to transform the imaging sensor data of each wavelength band of the first and second plurality of mutually separated wavelength bands using the transformation matrix.

6. The system according to claim 1, wherein the system is configured to provide a display signal to a display of the microscope system using an interface of the system, to cause the display to show the composite color image.

7. A microscope system comprising the system according to claim 1 and the microscope with the first and second imaging sensor, wherein one of the first and the second imaging sensor is an imaging sensor that is adapted to provide a fluorescence imaging functionality of the microscope system.

8. A system for determining a transformation function, the system comprising one or more processors and one or more storage devices, wherein the system is configured to: obtain first imaging sensor data of a reference object from a first imaging sensor of a microscope and second imaging sensor data of the reference object from a second imaging sensor of the microscope, the first imaging sensor data comprising sensor data on light sensed in a first plurality of mutually separated wavelength bands, the second imaging sensor data comprising sensor data on light sensed in a second plurality of mutually separated wavelength bands, wherein the wavelength bands of the first plurality of mutually separated wavelength bands or of the second plurality of mutually separated wavelength bands are wavelength bands that are used for fluorescence imaging; obtain a composite reference image of the reference object, the composite reference image being a reflectance image comprising a plurality of color channels; and determine the transformation function by determining a set of transformation factors that provide an approximate transformation between the imaging sensor data of each wavelength band of the first and second plurality of mutually separated wavelength bands and each of the color channels of the composite reference image, wherein the transformation factors provide a one-to-one transformation between an intensity of light measured in one of the wavelength bands of the first and second plurality of mutually separated wavelength bands and a respective color channel of the color channels of the composite reference image, and wherein the transformation function is based on the set of transformation factors.

9. The system according to claim 8, wherein the system is configured to identify a set of transformation factors that yields a lower mismatch between the composite reference image and a transformed image that is generated based on the set of transformation factors than at least one other set of transformation factors.

10. The system according to claim 9, wherein the composite reference image of the reference image defines a plurality of colors of a plurality of portions of the reference object, the plurality of colors comprising a pre-defined first subset of colors and a second subset of colors, wherein the system is configured to identify a set of transformation factors that yields a lower mismatch between the composite reference image and a transformed image that is generated based on the set of transformation factors than at least one other set of transformation factors for the pre-defined first subset of colors.

11. The system according to claim 10, wherein the pre-defined first subset of colors are colors that are present as colors of organic tissue in a surgical setting.

12. The system according to claim 10, wherein the system is configured to identify a set of transformation factors that reduces a mismatch value representing the mismatch between the composite reference image compared to at least one other set of transformation factors, wherein the mismatch value is calculated for the colors of the plurality colors, wherein a mismatch for a color of the pre-defined first subset of colors has a higher impact on the mismatch value than a mismatch for a color of the second subset of colors.

13. A method for a microscope system, the method comprising: obtaining first imaging sensor data from a first imaging sensor of a microscope of the microscope system and second imaging sensor data from a second imaging sensor of the microscope, the first imaging sensor data comprising sensor data on light sensed in a first plurality of mutually separated wavelength bands, the second imaging sensor data comprising sensor data on light sensed in a second plurality of mutually separated wavelength bands, wherein the wavelength bands of the first plurality of mutually separated wavelength bands or of the second plurality of mutually separated wavelength bands are wavelength bands that are used for fluorescence imaging, wherein the system is configured to use the first and the second imaging sensor to perform reflectance imaging; and generating a composite color image based on the first imaging sensor data and based on the second imaging sensor data, the composite color image being based on a plurality of color channels, wherein the composite color image is generated using a transformation function to define a transformation to be performed between the imaging sensor data and the composite color image, such that the composite color image is generated using sensor data on light sensed in each wavelength band of the first and second plurality of mutually separated wavelength bands.

14. A non-transitory, computer-readable medium comprising a program code that, when the program code is executed on a processor, a computer, or a programmable hardware component, causes the processor, computer, or programmable hardware component to perform the method of claim 13.

15. A method for determining a transformation function, the method comprising: obtaining first imaging sensor data of a reference object from a first imaging sensor of a microscope and second imaging sensor data of the reference object from a second imaging sensor of the microscope, the first imaging sensor data comprising sensor data on light sensed in a first plurality of mutually separated wavelength bands, the second imaging sensor data comprising sensor data on light sensed in a second plurality of mutually separated wavelength bands, wherein the wavelength bands of the first plurality of mutually separated wavelength bands or of the second plurality of mutually separated wavelength bands are wavelength bands that are used for fluorescence imaging; obtaining a composite reference image of the reference object, the composite reference image being a reflectance image comprising a plurality of color channels; and determining the transformation function by determining a set of transformation factors that provide an approximate transformation between the imaging sensor data of each wavelength band of the first and second plurality of mutually separated wavelength bands and each of the color channels of the composite reference image, wherein the transformation factors provide a one-to-one transformation between an intensity of light measured in one of the wavelength bands of the first and second plurality of mutually separated wavelength bands and a respective color channel of the color channels of the composite reference image, and wherein the transformation function is based on the set of transformation factors.

16. A non-transitory, computer-readable medium comprising a program code that, when the program code is executed on a processor, a computer, or a programmable hardware component, causes the processor, computer, or programmable hardware component to perform the method of claim 15.