Systems and Methods for Processing Electronic Images for Physiology-Compensated Reconstruction

This application is a continuation of and claims the benefit of priority to U.S. Application No. Ser. No. 18/059,154, filed on Nov. 28, 2022, which claims priority to U.S. Provisional Application No. 63/283,630, filed Nov. 29, 2021, each of which are incorporated herein by reference in their entirety.

Embodiments include methods and systems for image reconstruction and, more particularly, methods and systems for physiology-compensated reconstruction.

Medical imaging pipelines may collect measurements and produce images of subject anatomy reconstructed from the measurements. The reconstructed images may be used by downstream tasks. Such downstream tasks may include, for example, analysis and/or interpretation. Analysis may include, for example, creation of model(s) and/or simulation(s). Existing reconstruction methods may assume that a subject is motionless throughout the acquisition. Such assumption may produce errors in the reconstruction. Therefore, a need exists for methods and systems for physiology-compensated reconstruction.

The background description provided herein is for the purpose of generally presenting the context of the disclosure. Unless otherwise indicated herein, the materials described in this section are not prior art to the claims in this application and are not admitted to be prior art, or suggestions of the prior art, by inclusion in this section.

According to certain aspects of the disclosure, systems and methods are disclosed for incorporating user inputs in a medical imaging pipeline.

In an example, a computer-implemented method for medical measurement reconstruction may comprise: receiving a measurement acquisition signal; based on the received measurement acquisition signal, creating a plurality of representations of the measurement acquisition signal, wherein each of the plurality of representations relates to a different aspect of the measurement acquisition signal; modifying one or more of the plurality of representations; and generating an output signal including the modified one or more of the plurality of representations.

Any of the methods, systems, or devices disclosed herein may include any of the following features. The output signal may include a reconstruction of the measurement acquisition signal or wherein the output signal is used to generate a reconstruction of the measurement acquisition signal. The measurement acquisition signal may include a medical imaging signal. The plurality of representations may include a representation of at least one of anatomy, motion, or a physiological process. The plurality of representations may be created based on known information about the at least one of the anatomy, the motion, or the physiological process. The method may further comprise determining whether a stop condition is satisfied and, upon determining the stop condition is not satisfied, iterating at least one of the receiving, the creating, the modifying, or the generating step. The method may further comprise reconstructing an image using an estimate of dynamics. The plurality of representations may include at least one of a body lumen, an attenuation map, a cardiac chamber, a cardiothoracic motion field, a myocardial territory, or a flow of contrast agent. The method may further comprise modifying the representation based on a presence of an implanted hardware. The modifying the one or more of the plurality of representations may address an artifact in the measurement acquisition signal.

In another example, a system for processing electronic images for medical measurement reconstruction may comprise: a data storage device storing instructions for medical measurement reconstruction; and a processor configured to execute the instructions to perform operations comprising: receiving a measurement acquisition signal; based on the received measurement acquisition signal, creating a plurality of representations of the measurement acquisition signal, wherein each of the plurality of representations relates to a different aspect of the measurement acquisition signal; modifying one or more of the plurality of representations; and generating an output signal including the modified one or more of the plurality of representations.

In a further example, a non-transitory computer-readable medium may store instructions that, when executed by one or more processors, cause the one or more processors to perform computer-implemented method for medical measurement reconstruction, the method comprising: receiving a measurement acquisition signal; based on the received measurement acquisition signal, creating a plurality of representations of the measurement acquisition signal, wherein each of the plurality of representations relates to a different aspect of the measurement acquisition signal; modifying one or more of the plurality of representations; and generating an output signal including the modified one or more of the plurality of representations.

Additional objects and advantages of the techniques presented herein will be set forth in part in the description that follows, and in part will be apparent from the description, or may be learned by practice of the techniques presented herein. The objects and advantages of the techniques presented herein will be realized and attained by means of the elements and combinations particularly pointed out in the appended claims.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Medical imaging (or other medical measurement gathering) may involve acquiring data using medical imaging equipment. For example, medical imaging modalities may include computed tomography (“CT”) (such as, for example, coronary computed tomography angiography (“CCTA”)). magnetic resonance imaging (“MRI”), positron emission tomography (“PET”), ultrasound, electrocardiography, and/or X-ray, or any combination thereof. Data may be acquired using various acquisition protocols, to be selected by a user. Acquired data may be reconstructed in order to transform the data into an image that is interpretable by a human. Such images may be analyzed and/or interpreted by a user or an automated computer system. A medical imaging pipeline may include any of the steps above (acquisition, reconstruction, analysis, and/or interpretation), as well as any other steps.

Sufficient reconstruction quality may be needed for downstream tasks to execute successfully. Reconstruction quality may be degraded by, for example, reconstruction artifacts, which may result from violations of reconstruction method assumptions by processes concurrent with the acquisition. A source of reconstruction artifacts may be patient physiology, including time-dependent changes in patient anatomy. Conventional reconstruction methods may assume infinite temporal resolution of the imaging system: the acquired measurements (and reconstructions thereof) may correspond to the patient anatomy at an instant in time, essentially independent of physiology.

However, imaging system temporal resolution may be finite, and the acquisition may occur over a period of time during which concurrent physiological processes may significantly alter anatomical configuration. For example, cardiac motion may occur during acquisition of measurements. Consequently, influences of anatomy and physiology may become entangled in the acquired measurements, and the instantaneous acquisition assumption may be violated, which may lead to reconstruction artifacts.

Compensation of the influences of these processes may be performed by an approach in which a reconstruction method may mitigate or eliminate corresponding reconstruction artifacts. For example, prior knowledge and/or estimation of subject motion (e.g., cardiac motion) during the acquisition may be used to mitigate appearance of image artifacts otherwise due to that motion. Systems and methods described herein may provide a system or method that compensates for cardiac motion using known, patient-specific cardiac physiology. For example, certain embodiments may provide a system or method that accounts for medical image acquisition and reconstruction artifacts due primarily to subject physiology, such as cardiac motion. Such artifacts may degrade reconstruction accuracy and may introduce uncertainty in downstream applications. Embodiments of the disclosure may include application of knowledge of subject physiology to mitigate this uncertainty. Certain embodiments may be used in connection with certain embodiments disclosed in U.S. patent application Ser. No. 15/852,183, filed Dec. 22, 2017 and published as U.S. Patent Application Publication No. 2018/0182096, which is incorporated herein by reference in its entirety.

In some examples, physiology-compensated reconstruction methods may eliminate an assumption of infinite temporal resolution and may reformulate the reconstruction problem as one of isolating the independent influences of anatomy and physiology, thereby addressing/eliminating a source of corresponding reconstruction artifacts. Isolation may be enabled by incorporating prior knowledge of each factor that allows the influence of one factor to be estimated independently of the others. The disclosed systems and methods for physiology-compensated computed tomography reconstruction utilize prior knowledge of cardiac anatomy, motion, and/or one or more other physiological processes concurrent with the acquisition.

1 FIG. 1 FIG. 1 FIG. 100 140 140 120 130 110 120 130 120 depicts an example of an environmentin which such a computer system may be implemented as server systems. In addition to server systems, the environment offurther includes a plurality of physiciansand third party providers, any of which may be connected to an electronic network, such as the Internet, through one or more computers, servers, and/or handheld mobile devices. In, physiciansand third party providersmay each represent a computer system, as well as an organization that uses such a system. For example, a physicianmay be a hospital or a computer system of a hospital.

120 130 120 130 120 130 140 110 Physiciansand/or third party providersmay create or otherwise obtain medical images, such as images of the cardiac, vascular, and/or organ systems, of one or more patients. Physiciansand/or third party providersmay also obtain any combination of patient-specific information, such as age, medical history, blood pressure, blood viscosity, and other types of patient-specific information. Physiciansand/or third party providersmay transmit the patient-specific information to server systemsover the electronic network.

140 160 120 130 160 140 140 150 150 Server systemsmay include one or more storage devicesfor storing images and data received from physiciansand/or third party providers. The storage devicesmay be considered to be components of the memory of the server systems. Server systemsmay also include one or more processing devicesfor processing images and data stored in the storage devices and for performing any computer-implementable process described in this disclosure. Each of the processing devicesmay be a processor or a device that include at least one processor.

140 In some embodiments, server systemsmay comprise and/or utilize a cloud computing platform with scalable resources for computations and/or data storage, and may run an application for performing methods described in this disclosure on the cloud computing platform. In such embodiments, any outputs may be transmitted to another computer system, such as a personal computer, for display and/or storage.

Other examples of computer systems for performing methods of this disclosure include desktop computers, laptop computers, and mobile computing devices such as tablets and smartphones.

140 A computer system, such as server systems, may include one or more computing devices. If the one or more processors of the computer system is implemented as a plurality of processors, the plurality of processors may be included in a single computing device or distribute among a plurality of computing devices. If a computer system comprises a plurality of computing devices, the memory of the computer system may include the respective memory of each computing device of the plurality of computing devices.

2 FIG. 200 202 204 202 204 202 204 depicts an exemplary medical imaging workflow. Measurements/data may be acquired in acquisition phase, and images may be interpreted and analyzed, and user input may be provided, in image phase. The arrow extending from acquisition phaseto image phasemay represent reconstruction of the measurements acquired in acquisition phaseinto images utilized in image phase.

202 210 212 214 210 212 212 214 210 212 214 216 Various factors may contribute to the measurements acquired in acquisition phase. Exemplary factors include patient state, device properties, and preparation protocol. Patient statemay include various factors, including but not limited to patient position, variabilities in patient anatomy, patient bodily processes (e.g., heartbeats, bloodflow, inhalation/exhalation), patient demographic data, patient physiological characteristics, and/or patient movement. Device propertiesmay include any property of an acquisition device (e.g., scanner). Device propertiesmay include, for example, a modality, a manufacturer, a calibration, and/or measurement collection parameters (e.g., settings). Preparation protocolmay include, for example, any steps taken by a patient or medical provider in advance of or during acquisition of the measurements. The patient state, device properties, and/or preparation protocol(along with other factors) may contribute to the measurements obtained and the projectionsobtained. The projections may include two-dimensional, projected images/measurements obtained.

202 204 203 As represented by the arrow from acquisition phaseto image phase, during reconstruction, a reconstruction algorithm (or other methodology) may be applied in order to generate images with which a user may interact. Examples of reconstruction algorithms may include those described in one or more of the following U.S. Patents, which are incorporated herein by reference in their entirety: U.S. Pat. No. 8,917,925, entitled “Systems and Methods for Data and Model-Driven Image Reconstruction and Enhancement,” issued Dec. 23, 2014, and/or U.S. Pat. No. 10,789,706, entitled “Systems and Methods for Medical Acquisition Processing and Machine Learning for Anatomical Assessment,” issued Sep. 29, 2020.

204 230 230 234 238 234 230 234 238 238 238 234 CT Following reconstruction, image phasemay include viewing/manipulating one or more reconstructed image, segmenting the reconstructed imageto generate an anatomic model, and/or preparing an analysisusing anatomic model. Although singular nouns may be used to describe reconstructed image, model, and analysis, it will be appreciated that such terms, as well as for any other term herein unless otherwise specified, may be singular or plural. Analysismay include, for example, determining/simulating/calculating an FFR. Analysismay include any type of analysis/interpretation generated according to any suitable type of method. Segmenting the reconstructed image to generate an anatomic modelmay include any of the techniques of the following U.S. Patents: U.S. Pat. No. 8,315,812, entitled “Method and System for Patient-Specific Modeling of Blood Flow,” issued Nov. 20, 2012; U.S. Pat. No. 9,773,219, entitled “Systems and Methods for Using Geometry Sensitivity Information for Guiding Workflow,” issued Sep. 26, 2017; U.S. Pat. No. 10,600,181, entitled “Systems and Methods for Probabilistic Segmentation in Anatomical Image Processing,” issued Mar. 24, 2020; U.S. Pat. Nos. 9,304,982; and/or 9,304,982, entitled “Systems and Methods for Validating and Correcting Automated Medical Image Annotations,” issued Apr. 5, 2016.

2 FIG. 230 232 232 210 212 214 232 230 236 234 240 238 240 238 CT CT As shown in, reconstructed imagemay include artifact(s). Artifact(s)may result from various sources, including from variabilities in any of patient state, device properties, and/or preparation protocol. Artifactof reconstructed imagemay be propagated to produce an induced uncertainty(e.g., an induced geometric uncertainty) of anatomic model, which may in turn, produce analysis uncertaintyof analysis. In an example, analysis uncertaintymay include an induced FFRuncertainty where analysisis an FFRanalysis.

204 202 203 250 250 204 230 234 238 250 202 As shown by the arrow from image phaseto acquisition phaseand to the arrow representing reconstruction, feedbackmay be utilized. Feedbackmay be provided at any of the stages of image phase(reconstructed image, anatomic model, and/or analysis). Feedbackmay be utilized to make adjustments to any aspect of acquisition phaseor to a reconstruction process (e.g., a reconstruction algorithm).

3 6 FIGS.- 3 6 FIGS.- 3 FIG. 4 6 FIG.- depict exemplary methods for physiology-compensated reconstruction. The methods ofare not mutually exclusive, and the steps of the methods may be combined in any suitable combination.may represent a general example method, andmay illustrate particular examples. Each of the methods may be computer-implemented. The steps of the methods described herein are not exclusive; the methods may include additional or alternative step within the scope of the disclosure. Certain embodiments may use known information about latent anatomy and physiology to improve reconstruction of measured anatomy and physiology. Certain reconstruction methods may generally incorporate non-physiological prior knowledge of one or more aspects of the acquisition to ensure mathematical “well-posedness” and improve accuracy.

300 302 202 202 304 302 304 3 FIG. Methodofmay begin with step, in which one or more primary acquisition signals are received. The primary acquisition signals may be received in acquisition phase, depicted above. The acquisition signals may be acquired using any of the modalities described above, with any of the inputs of acquisition phase. Optionally, in step, one or more secondary acquisition signals may be received. The secondary acquisition signal(s) may be received from a same measurement modality as the modality producing the signals of stepor from a different type of modality. Alternatively, stepmay be omitted.

306 306 306 306 306 In step, the received primary acquisition signal(s) and/or secondary acquisition signal(s) (or other input(s)) may be processed into individual representations of one or more of different aspects of the acquisition signal(s), including, for example, anatomy, motion, or one or more physiological processes. In other words, stepmay identify and process component(s) of the primary and/or secondary signals. Stepmay utilize known details of a joint representation of an anatomy for which measurements are obtained, motion, and/or physiological processes to decompose the joint representation into individual representations. Stepmay include using known information about motion, anatomy, and/or physiological processes. Each of a plurality of individual representations generated in stepmay pertain to a different aspect of the received acquisition signal(s). The known details may arise from manual operator input, from a catalog of information, and/or from machine learning techniques. The known details may be population-based and/or may be patient-specific. In some examples, patient-specific details may be derived from a population-based data source. For example, a machine learning model may be trained based on population-based data, and the trained machine learning model may be applied to a specific patient.

308 306 Optionally, in step, the individual representations of stepmay be modified. For example, one or more of a known task, population, physical law, etc. may be used to modify one or more of the representations. In some examples, a trained machine learning model may be utilized to modify the representation. Such modifications may be utilized to address an imaging artifact or other error in the individual representation. In some examples, the modification(s) may correct or compensate for an imaging artifact.

310 310 312 314 300 302 304 302 304 306 308 302 304 In step, it may be determined whether a condition is satisfied. Stepmay include comparing one or more metrics to a threshold value. If the condition is satisfied in step, at stepthe process of methodmay be ended and at least one signal may be output. The output signal(s) may include a primary signal related to the received primary acquisition signal in step. Additionally or alternatively, the output signal(s) may include a secondary signal related to the received secondary signal in step. The output signal(s) may further additionally or alternatively include derivative signal(s) that combine the primary signal(s) received in stepand the secondary signal(s) received in step. The output signal(s) may include one or more of the individual representation(s) created in stepor may aggregate the individual representation(s). The output signal(s) may incorporate the modification(s) of step. The output signal(s) may include a reconstruction or may be used to generate a reconstruction of the primary and/or secondary signal(s) received in stepsand.

316 300 300 300 306 308 3 FIG. If, in step, the condition(s) are not satisfied, one or more steps of methodmay be iterated. The dashed lines ofrepresent that the iteration may initiate with any of the steps of methodand may vary as methodfurther iterates. Further measurements may be acquired (using modified measurement collection parameters, if necessary), further individual representation(s) may be created, and/or further modification(s) may be performed. For example, in a forward model, known details of the measurement acquisition equipment may be utilized to, if necessary, process the original representation(s) created in stepor the modified representations(s) created in stepinto suitable formats, obtain estimates of one or more input signals, compute error with respect to measured input signals, update inputs/representations, and repeat as necessary.

306 308 212 Known information used in stepand other steps described herein (including, e.g., step) may include various categories of knowledge. The known information described herein additionally or alternatively may be used in other reconstruction steps. For example, information may be known regarding a measurement-gathering system (e.g., imaging system). Such information may include device properties. Known information regarding the measurement-gathering system may be used for, for example, model-based iterative reconstruction. For example, known information such as a specification of mathematical models of scanner properties (e.g., geometry, optics, detector response, etc.) may be utilized for iterative reconstruction. Known X-ray physics may be utilized for statistical iterative reconstruction. Such information may include details of x-ray attenuation (e.g., statistical modeling of attenuation measurements via Poisson distribution).

Other types of known information may include known information about the imaged entity (e.g., known details of patient anatomy). Known information of the imaged entity, in some examples, may be utilized for regularized iterative reconstruction. Such prior knowledge may include prior knowledge of measurable anatomy, including, for example, homogeneity of tissue attenuation or composition expressed as total-variation penalty applied to reconstructed intensities. Additionally or alternatively, known-component reconstruction may utilize known information relating to one or more of existence, geometry, or composition of implant hardware (e.g., of a pacemaker device). Further, additionally or alternatively, motion-compensated reconstruction may utilize prior knowledge of measurable physiology, including, for example, specification of a motion model and instantiation thereof for a specific acquisition and/or reconstruction.

4 6 FIGS.- illustrate exemplary contexts for the systems and methods herein disclosed. In some examples, models of, or physical laws governing, physiological processes may be employed in reconstruction of CCTA images to regularize estimates of anatomical composition and/or motion.

4 FIG. 400 400 depicts an exemplary methodrelated to contrast agent transport simulation. In reconstructed CCTA images, contrast attenuation gradients in vessels may encode information about blood flow and/or the morphological impact of disease thereon. This information can be compared with transluminal attenuation gradient (TAG) and/or transluminal attenuation flow encoding (TAFE). Contrast agent transport may be modeled via the advection-diffusion equation. A reconstructed image of contrast-filled vessels may exhibit attenuation values consistent with contrast agent transport. Methodmay incorporate contrast agent transport simulation to provide consistency, as well as to directly estimate attributes of the dynamic process of interest (e.g., blood flow velocity).

402 402 302 304 In step, one or more acquisition signal(s) may be acquired. Stepmay include any of the aspects of steps,, described above. In some examples, the acquired signal may be a sinogram signal. Alternative types of signals may additionally or alternatively be utilized.

404 406 402 404 406 406 In steps, and, the signal(s) received in stepmay be processed. In step, the image may be reconstructed using a current estimate of dynamics (e.g., vessel dynamics). The dynamics may be estimated using any suitable method. In step, the image may be portioned into body (e.g., coronary) lumen(s) and background. The partitioning of stepmay utilize any known partitioning methods.

408 410 404 406 408 410 408 410 408 410 Stepsandmay include modifying the reconstruction of stepsand. Stepsandmay include use any of the types of known information described above. Stepsandare merely exemplary, and other modification steps may performed within the scope of the disclosure. Stepmay include estimating an attenuation map, such as a coronary attenuation map. In examples, the coronary attenuation map may be estimated using an advection-diffusion simulation. The simulation domain may include an image partition corresponding to a coronary lumen. In step, the background attenuation map may be modified. For example, the background may be optimized using iterative reconstruction techniques. The iterative reconstruction may be used to, for example, fix a coronary attenuation map.

400 412 414 400 416 400 418 400 418 400 As described below, steps of methodmay then be iterated, including using any of the iteration steps discussed above. For example, in step, it may be determined whether a condition is satisfied. If, in step, the condition has been satisfied, the methodmay be stopped in step. An output of methodmay include data, recommendation(s), action(s), image(s), or any other type of output from a computing device. In step, if the condition has not been satisfied, one or more steps of methodmay be iteratively performed. As discussed above, the dotted lines in the arrows from the iteration step indicate that some, all, or none of the steps may be iterated, and iteration may begin/end at any suitable step. The iteration may continue until the condition in stepis satisfied or until methodotherwise completes.

5 FIG. 2 FIG. 500 204 depicts another methodrelated to motion-compensated myocardial perfusion. Reconstructed CCTA images may exhibit motion artifacts across multiple scales due to coronary and/or cardiac motion. Motion artifacts may introduce implausible attenuation values in dynamic structures or structures in close proximity. Such attenuation values may, as shown in, result in proliferated errors in image phase. Cardiac motion estimation may be challenging in the presence of severe motion artifacts often observed in reconstructions at non-quiescent cardiac phases. Cardiac motion may be modulated by the electro-mechanics of the heart. A motion-compensated reconstruction method that incorporates an electromechanical simulation of the heart may utilize an ECG acquisition concurrent with image acquisition to estimate cardiac motion.

502 502 302 304 402 502 500 In step, one or more acquisition signal(s) may be acquired. Stepmay include any of the aspects of steps,,, described above. In some examples, stepmay include receiving a plurality of signals. One (or ore) of the signals may be a primary signal and one (or more) of the signals may be a secondary signal (as discussed with respect to method). Alternatively, each of the received signals may be a primary signal. In some examples, the acquired signal(s) may be a sinogram signal and an ECG signal. Alternative types of signals may additionally or alternatively be utilized.

504 506 502 504 506 506 In steps, and, the signal(s) received in stepmay be processed. In step, the image may be reconstructed using a current estimate of dynamics (e.g., vessel dynamics and/or cardiac dynamics). The dynamics may be estimated using any suitable method. In step, the image may be portioned into cardiac chamber(s) and background. The partitioning of stepmay utilize any known partitioning methods.

508 504 506 508 508 508 Stepmay include modifying the reconstruction of stepsand. Stepmay include use any of the types of known information described above. Stepis merely exemplary, and other modification steps may performed within the scope of the disclosure. Stepmay include estimating cardiothoracic motion field via electro-mechanical simulation. A simulation domain may include an image partition corresponding to cardiac chambers. Any suitable simulation techniques may be utilized.

500 510 512 500 514 500 516 500 514 500 As described below, steps of methodmay then be iterated, including using any of the iteration steps discussed above. For example, in step, it may be determined whether a condition is satisfied. If, in step, the condition has been satisfied, the methodmay be stopped in step. An output of methodmay include data, recommendation(s), action(s), image(s), or any other type of output from a computing device. In step, if the condition has not been satisfied, one or more steps of methodmay be iteratively performed. As discussed above, the dotted lines in the arrows from the iteration step indicate that some, all, or none of the steps may be iterated, and iteration may begin/end at any suitable step. The iteration may continue until the condition in stepis satisfied or until methodotherwise completes.

6 FIG. 600 500 300 400 600 depicts another methodrelated to cardiac electromechanical motion simulation. The description of method(or methods,) also may apply to methodin any aspect. Myocardial hypo-attenuation in a territory supplied by a stenosed coronary artery may be indicative of a perfusion defect. However, hypo-attenuation may be obscured by reconstruction artifacts. A reconstruction method that incorporates motion-estimation and territory-estimation may produce a reconstructed image exhibiting increased sensitivity to hypo-attenuation due to perfusion defect(s).

602 602 302 304 402 502 In step, one or more acquisition signal(s) may be acquired. Stepmay include any of the aspects of steps,,,, described above. In some examples, the acquired signal may be a sinogram signal. Alternative types of signals may additionally or alternatively be utilized.

604 606 606 602 604 606 608 In steps,, and, the signal(s) received in stepmay be processed. In step, the image may be reconstructed using a current estimate of dynamics (e.g., vessel dynamics and/or cardiac dynamics). The dynamics may be estimated using any suitable method. In step, the image may be partitioned into coronary lumen(s), cardiac chamber(s), and/or background. In step, myocardial territories and/or flow of contrast agent thereto may be estimated/simulated.

610 612 604 606 608 610 612 610 612 608 612 Stepsandmay include modifying the reconstruction of steps,, and. Stepsandmay include use any of the types of known information described above. Stepsandare merely exemplary, and other modification steps may performed within the scope of the disclosure. Stepmay include estimating a myocardial attenuation map via territory modeling and contrast agent concentration evolution. Any suitable estimation method may be utilized. In step, a background attenuation map may be modified. For example, the background attenuation may be modified via iterative reconstruction, as discussed below.

600 614 616 600 618 600 620 600 614 600 As described below, steps of methodmay then be iterated, including using any of the iteration steps discussed above. For example, in step, it may be determined whether a condition is satisfied. If, in step, the condition has been satisfied, the methodmay be stopped in step. An output of methodmay include data, recommendation(s), action(s), image(s), or any other type of output from a computing device. In step, if the condition has not been satisfied, one or more steps of methodmay be iteratively performed. As discussed above, the dotted lines in the arrows from the iteration step indicate that some, all, or none of the steps may be iterated, and iteration may begin/end at any suitable step. The iteration may continue until the condition in stepis satisfied or until methodotherwise completes.

302 304 402 502 602 302 304 402 502 602 Any of the exemplary methods and systems disclosed herein may include any of the following aspects, in any combination. Inputs (e.g., inputs of steps,,,,) may include a sinogram. The sinogram input may include multi-source, multi-detector, multi-energy, and/or longitudinal measurements (or reconstructions thereof). The inputs of,,,, andmay additionally or alternatively include primary or ancillary acquisitions, such as, for example, ECG, scout films, non-contrast imaging, calcium imaging, and/or any other suitable type of imaging or other measurement).

408 508 608 306 404 504 604 Any of the simulations described herein (e.g., the simulations of steps,,) may include simulations of cardiac electro-mechanics, contrast agent transport, fluid-structure interaction, and/or solid or deformation mechanics. Any of the reconstructions disclosed herein (e.g., the reconstructions of steps,,,) may include reconstructions of cardiothoracic anatomy, such as cardiac chambers, coronary vessels, pulmonary vessels, and/or microvasculature. Any of the reconstructions or simulations may be modified by a presence of implanted hardware.

7 FIG. 700 720 720 720 720 710 As shown in, devicemay include a central processing unit (CPU). CPUmay be any type of processor device including, for example, any type of special purpose or a general-purpose microprocessor device. As will be appreciated by persons skilled in the relevant art, CPUalso may be a single processor in a multi-core/multiprocessor system, such system operating alone, or in a cluster of computing devices operating in a cluster or server farm. CPUmay be connected to a data communication infrastructure, for example a bus, message queue, network, or multi-core message-passing scheme.

700 740 730 730 Devicemay also include a main memory, for example, random access memory (RAM), and also may include a secondary memory. Secondary memory, e.g. a read-only memory (ROM), may be, for example, a hard disk drive or a removable storage drive. Such a removable storage drive may comprise, for example, a floppy disk drive, a magnetic tape drive, an optical disk drive, a flash memory, or the like. The removable storage drive in this example reads from and/or writes to a removable storage unit in a well-known manner. The removable storage may comprise a floppy disk, magnetic tape, optical disk, etc., which is read by and written to by the removable storage drive. As will be appreciated by persons skilled in the relevant art, such a removable storage unit generally includes a computer usable storage medium having stored therein computer software and/or data.

730 700 700 In alternative implementations, secondary memorymay include similar means for allowing computer programs or other instructions to be loaded into device. Examples of such means may include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an EPROM or PROM) and associated socket, and other removable storage units and interfaces, which allow software and data to be transferred from a removable storage unit to device.

700 760 760 700 760 760 760 760 700 Devicealso may include a communications interface (“COM”). Communications interfaceallows software and data to be transferred between deviceand external devices. Communications interfacemay include a modem, a network interface (such as an Ethernet card), a communications port, a PCMCIA slot and card, or the like. Software and data transferred via communications interfacemay be in the form of signals, which may be electronic, electromagnetic, optical or other signals capable of being received by communications interface. These signals may be provided to communications interfacevia a communications path of device, which may be implemented using, for example, wire or cable, fiber optics, a phone line, a cellular phone link, an RF link or other communications channels.

700 750 The hardware elements, operating systems, and programming languages of such equipment are conventional in nature, and it is presumed that those skilled in the art are adequately familiar therewith. Devicemay also include input and output portsto connect with input and output devices such as keyboards, mice, touchscreens, monitors, displays, etc. Of course, the various server functions may be implemented in a distributed fashion on a number of similar platforms, to distribute the processing load. Alternatively, the servers may be implemented by appropriate programming of one computer hardware platform.

Throughout this disclosure, references to components or modules generally refer to items that logically may be grouped together to perform a function or group of related functions. Like reference numerals are generally intended to refer to the same or similar components. Components and/or modules may be implemented in software, hardware, or a combination of software and/or hardware.

The tools, modules, and/or functions described above may be performed by one or more processors. “Storage” type media may include any or all of the tangible memory of the computers, processors or the like, or associated modules thereof, such as various semiconductor memories, tape drives, disk drives and the like, which may provide non-transitory storage at any time for software programming.

Software may be communicated through the Internet, a cloud service provider, or other telecommunication networks. For example, communications may enable loading software from one computer or processor into another. As used herein, unless restricted to non-transitory, tangible “storage” media, terms such as computer or machine “readable medium” refer to any medium that participates in providing instructions to a processor for execution.

One or more techniques presented herein may enable a user, to better interact with a digital image of a glass slide that may be presented on a screen, in a virtual reality environment, in an augmented reality environment, or via some other form of visual display. One or more techniques presented herein may enable a natural interaction closer to traditional microscopy with less fatigue than using a mouse, keyboard, and/or other similar standard computer input devices.

The controllers disclosed herein may be comfortable for a user to control. The controllers disclosed herein may be implemented anywhere that digital healthcare is practiced, namely in hospitals, clinics, labs, and satellite or home offices. Standard technology may facilitate connections between input devices and computers (USB ports, Bluetooth (wireless), etc.) and may include customer drivers and software for programming, calibrating, and allowing inputs from the device to be received properly by a computer and visualization software.

The foregoing general description is exemplary and explanatory only, and not restrictive of the disclosure. Other embodiments of the invention may be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. It is intended that the specification and examples be considered as exemplary only.

Instructions executable by one or more processors may also be stored on a non-transitory computer-readable medium. Therefore, whenever a computer-implemented method is described in this disclosure, this disclosure shall also be understood as describing a non-transitory computer-readable medium storing instructions that, when executed by one or more processors of a computer system, configure and/or cause the one or more processors to perform the computer-implemented method. Examples of non-transitory computer-readable media include random-access memory (RAM), read-only memory (ROM), solid-state storage media (e.g., solid state drives), optical storage media (e.g., optical discs), and magnetic storage media (e.g., hard disk drives). A non-transitory computer-readable medium may be part of the memory of a computer system or separate from any computer system.

A computer system may include one or more computing devices. If a computer system includes a plurality of processors, the plurality of processors may be included in a single computing device or distributed among a plurality of computing devices. A processor may be a central processing unit (CPU), a graphics processing unit (GPU), or another type of processing unit. The term “computational device,” as used in this disclosure, is interchangeable with “computing device.” An “electronic storage device” may include any of the non-transitory computer-readable media described above.