Systems and methods are provided for producing a rendered drawing or rendering from a detailed image of an object (e.g. photograph) resulting in a rendering that is photogrammetric and that preserves detail in the said image of said object. The combination of the metric nature and image detail preservation in a rendering resulting from the process enhances the usefulness of the rendering to users. The invention is useful in particular for large format renderings such as wire frame style drawings used for blueprints in the architecture, engineering and construction industry (AEC industry) when used for existing structures. The processes combine graphic arts techniques with photogrammetric techniques to preserve, fully or partially, information about an object as captured in image detail of said object and to present said information in photogrammetrically correct rendering, which rendering may be incorporated into drawings useful to and/or familiar to end users of said drawings.
Legal claims defining the scope of protection, as filed with the USPTO.
1. A method performed on a computer for the production of photogrammetric renderings of an object from an image of the object, the method comprising: processing the image by a photogrammetric process to produce a photogrammetric image; and processing the photogrammetric image by a graphic arts rendering process to provide a processed two-dimensional image that comprises a version in which texture detail related to mortar joints on the object has been selectively removed while selectively enhancing texture detail related to stone surfaces on the object, wherein the graphic arts rendering process: processes original texture data of the object from the photogrammetric image to generate processed texture data that enhances one or more features of the stone surfaces on the object; and generates the processed two-dimensional image by fabricating a rendering of the object that portrays the processed texture data and is based entirely on the original texture data.
2. The method of claim 1 , wherein the image comprises at least one of a photograph, stereo photograph, metric photograph, orthophotograph, rectified image, drawing, painting, print, film, color separation negative, and positive.
3. The method of claim 1 , wherein the photogrammetric processing comprises a rectification of the image for at least one of a camera lens distortion, image receptor plane effect, optical effect, distortion due to image receptor plane variance, distortion of the image, and damage of the image.
4. The method of claim 1 , wherein the image includes multiple planar faces of the object that are processed separately to achieve separate rectified images of more than one plane of the object.
5. The method of claim 1 , wherein a plurality of images are used during the photogrammetric process and the processing comprises: separately correcting each individual image of the plurality of images to form a plurality of photogrammetrically-corrected images; and joining the plurality of photogrammetrically-corrected images together into the photogrammetric image.
6. The method of claim 1 , wherein the graphic arts rendering process comprises at least one of changing contrast, changing hue, changing saturation, changing color balance, converting to grayscale, finding edges (regions of change in texture or contrast or color), and tracing.
7. The method of claim 1 , wherein the photogrammetric process produces the photogrammetric image by generating an orthogonal version of the image.
8. The method of claim 1 , wherein the graphic arts rendering process: determines at least one of a midtone balance tonal threshold of the image and a highlight balance tonal threshold of the image; and processes the original texture data by isolating the at least one midtone balance tonal threshold and highlight balance tonal threshold.
9. The method of claim 1 , wherein the processed texture data comprises texture detail that is reproducible as one color art while still visually indicating the original texture detail.
10. The method of claim 1 , wherein the graphic arts rendering process: extracts the original texture data of the object from the photogrammetric image.
11. The method of claim 1 , wherein the graphic arts rendering process: determines a shadow balance tonal threshold of the image; and processes the original texture data by isolating the at least one shadow balance tonal threshold.
12. The method of claim 1 , wherein the processing the image by the photogrammetric process and the processing the photogrammetric image by the graphic arts rendering process are performed autonomously by a computer.
13. The method of claim 1 , wherein the graphic arts rendering process comprises at least one of masking, separating to color channels, and applying mathematical actions on color channels including adding, subtracting, equalizing, indexing, multiplying, and inverting.
14. A method comprising: processing a first image by a photogrammetric process, wherein the first image partially depicts an object, and wherein the photogrammetric process produces a first orthogonal image of the object; processing one or more additional images by the photogrammetric process, wherein the one or more additional images depicts at least part of the object not depicted by the first image, and wherein the photogrammetric process produces one or more additional orthogonal images of the object; and processing the first orthogonal image and the one or more additional orthogonal images by a graphic arts rendering process to produce a processed orthogonal two-dimensional image, wherein the graphic arts rendering process is operable to: insert, for an area of the object not depicted by the first image, an indication of original texture of that area taken from the one or more additional orthogonal images, such that the indication is correctly located on the object and the object is more fully depicted; and preserve at least a portion of detail related to stone surfaces of the object while partially or fully eliminating at least a portion of detail related to mortar joints of the object.
15. The method of claim 14 , wherein the processing the first image by the photogrammetric process and the processing the first orthogonal image by the graphic arts rendering process are performed autonomously by a computer.
16. The method of claim 14 , wherein the first image partially depicts an object because of an obstruction obscuring the object.
17. The method of claim 14 , wherein the first image comprises at least one of a photograph, stereo photograph, metric photograph, orthophotograph, rectified image, drawing, painting, print, film, color separation negative, and positive.
18. The method of claim 14 , wherein the photogrammetric processing comprises a rectification of the first image for at least one of a camera lens distortion, image receptor plane effect, optical effect, distortion due to image receptor plane variance, distortion of the first image, and damage of the first image.
19. The method of claim 14 , wherein the first image includes multiple planar faces of the object that are processed separately to achieve separate rectified images of more than one plane of the object.
20. The method of claim 14 , wherein the graphic arts rendering process comprises at least one of changing contrast, changing hue, changing saturation, changing color balance, converting to grayscale, finding edges (regions of change in texture or contrast or color), tracing, masking, separating to color channels, and applying mathematical actions on color channels including adding, subtracting, equalizing, indexing, multiplying, and inverting.
21. The method of claim 14 , wherein the graphic arts rendering process is operable to: determine at least one of a midtone balance tonal threshold of the first image and a highlight balance tonal threshold of the first image; and process original texture data by isolating the at least one midtone balance tonal threshold and highlight balance tonal threshold.
22. The method of claim 14 , wherein the graphic arts rendering process is operable to: extract original texture data of the object from the first orthogonal image.
23. The method of claim 14 , wherein the graphic arts rendering process is operable to: determine a shadow balance tonal threshold of the first image; and process original texture data by isolating the at least one shadow balance tonal threshold.
24. A method performed on a computer for the production of photogrammetric renderings of an object from an image of the object, the method comprising: processing the image by a photogrammetric process to produce a photogrammetric image; and processing the photogrammetric image by a graphic arts rendering process to provide a processed two-dimensional image comprises a version in which texture detail related to stone surfaces on the object has been selectively removed while selectively enhancing texture detail related to mortar joints on the object, wherein the graphic arts rendering process: processes original texture data of the object from the photogrammetric image to generate processed texture data that enhances one or more features of the stone surfaces on the object; and generates the processed two-dimensional image by fabricating a rendering of the object that portrays the processed texture data and is based entirely on the original texture data.
25. The method of claim 24 , wherein the image comprises at least one of a photograph, stereo photograph, metric photograph, orthophotograph, rectified image, drawing, painting, print, film, color separation negative, and positive.
26. The method of claim 24 , wherein the photogrammetric processing comprises a rectification of the image for at least one of a camera lens distortion, image receptor plane effect, optical effect, distortion due to image receptor plane variance, distortion of the image, and damage of the image.
27. The method of claim 24 , wherein the image includes multiple planar faces of the object that are processed separately to achieve separate rectified images of more than one plane of the object.
28. The method of claim 24 , wherein a plurality of images are used during the photogrammetric process and the processing comprises: separately correcting each individual image of the plurality of images to form a plurality of photogrammetrically-corrected images; and joining the plurality of photogrammetrically-corrected images together into the photogrammetric image.
29. The method of claim 24 , wherein the graphic arts rendering process comprises at least one of changing contrast, changing hue, changing saturation, changing color balance, converting to grayscale, finding edges (regions of change in texture or contrast or color), and tracing.
30. The method of claim 24 , wherein the graphic arts rendering process comprises at least one of masking, separating to color channels, and applying mathematical actions on color channels including adding, subtracting, equalizing, indexing, multiplying, and inverting.
31. The method of claim 24 , wherein the photogrammetric process produces the photogrammetric image by generating an orthogonal version of the image.
32. The method of claim 24 , wherein the graphic arts rendering process: determines at least one of a midtone balance tonal threshold of the image and a highlight balance tonal threshold of the image; and processes the original texture data by isolating the at least one midtone balance tonal threshold and highlight balance tonal threshold.
33. The method of claim 24 , wherein the processed texture data comprises texture detail that is reproducible as one color art while still visually indicating the original texture detail.
34. The method of claim 24 , wherein the graphic arts rendering process: extracts the original texture data of the object from the photogrammetric image.
35. The method of claim 24 , wherein the graphic arts rendering process: determines a shadow balance tonal threshold of the image; and processes the original texture data by isolating the at least one shadow balance tonal threshold.
36. The method of claim 24 , wherein the processing the image by the photogrammetric process and the processing the photogrammetric image by the graphic arts rendering process are performed autonomously by a computer.
37. A method comprising: processing a first image by a photogrammetric process, wherein the first image partially depicts an object, and wherein the photogrammetric process produces a first orthogonal image of the object; processing one or more additional images by the photogrammetric process, wherein the one or more additional images depicts at least part of the object not depicted by the first image, and wherein the photogrammetric process produces one or more additional orthogonal images of the object; and processing the first orthogonal image and the one or more additional orthogonal images by a graphic arts rendering process to produce a processed orthogonal two-dimensional image, wherein the graphic arts rendering process is operable to: insert, for an area of the object not depicted by the first image, an indication of original texture of that area taken from the one or more additional orthogonal images, such that the indication is correctly located on the object and the object is more fully depicted; and preserve at least a portion of detail related to mortar joints of the object while partially or fully eliminating at least a portion of detail related to stone surfaces of the object.
38. The method of claim 37 , wherein the processing the first image by the photogrammetric process and the processing the first orthogonal image by the graphic arts rendering process are performed autonomously by a computer.
39. The method of claim 37 , wherein the first image partially depicts an object because of an obstruction obscuring the object.
40. The method of claim 37 , wherein the first image comprises at least one of a photograph, stereo photograph, metric photograph, orthophotograph, rectified image, drawing, painting, print, film, color separation negative, and positive.
41. The method of claim 37 , wherein the photogrammetric processing comprises a rectification of the first image for at least one of a camera lens distortion, image receptor plane effect, optical effect, distortion due to image receptor plane variance, distortion of the first image, and damage of the first image.
42. The method of claim 37 , wherein the first image includes multiple planar faces of the object that are processed separately to achieve separate rectified images of more than one plane of the object.
43. The method of claim 37 , wherein the graphic arts rendering process comprises at least one of changing contrast, changing hue, changing saturation, changing color balance, converting to grayscale, finding edges (regions of change in texture or contrast or color), tracing, masking, separating to color channels, and applying mathematical actions on color channels including adding, subtracting, equalizing, indexing, multiplying, and inverting.
44. The method of claim 37 , wherein the graphic arts rendering process is operable to: determine at least one of a midtone balance tonal threshold of the first image and a highlight balance tonal threshold of the first image; and process original texture data by isolating the at least one midtone balance tonal threshold and highlight balance tonal threshold.
45. The method of claim 37 , wherein the graphic arts rendering process is operable to: extract original texture data of the object from the first orthogonal image.
46. The method of claim 37 , wherein the graphic arts rendering process is operable to: determine a shadow balance tonal threshold of the first image; and process original texture data by isolating the at least one shadow balance tonal threshold.
47. A method performed on a computer for the production of photogrammetric renderings of an object from an image of the object, the method comprising: processing the image by a photogrammetric process to produce a photogrammetric image; and processing the photogrammetric image by a graphic arts rendering process to provide a processed two-dimensional image, wherein the graphic arts rendering process: processes original texture data of the object from the photogrammetric image to generate processed texture data that comprises less data than the original texture data but still conveys information related to an actual texture of the object; preserves at least a portion of detail related to stone surfaces of the object while partially or fully eliminating at least a portion of detail related to mortar joints of the object; and generates the processed two-dimensional image by fabricating a rendering of the object that portrays the processed texture data and is based entirely on the actual texture of the object.
48. The method of claim 47 , wherein the photogrammetric processing comprises a rectification of the image for at least one of a camera lens distortion, image receptor plane effect, optical effect, distortion due to image receptor plane variance, distortion of the image, and damage of the image.
49. The method of claim 47 , wherein a plurality of images are used during the photogrammetric process and the processing comprises: separately correcting each individual image of the plurality of images to form a plurality of photogrammetrically-corrected images; and joining the plurality of photogrammetrically-corrected images together into the photogrammetric image.
50. The method of claim 47 , wherein the graphic arts rendering process comprises at least one of changing contrast, changing hue, changing saturation, changing color balance, converting to grayscale, finding edges (regions of change in texture or contrast or color), tracing, masking, separating to color channels, and applying mathematical actions on color channels including adding, subtracting, equalizing, indexing, multiplying, and inverting.
51. The method of claim 47 , wherein the photogrammetric process produces the photogrammetric image by generating an orthogonal version of the image.
52. The method of claim 47 , wherein the graphic arts rendering process: determines at least one of a midtone balance tonal threshold of the image and a highlight balance tonal threshold of the image; and processes the original texture data by isolating the at least one midtone balance tonal threshold and highlight balance tonal threshold.
53. The method of claim 47 , wherein the processing the image by the photogrammetric process and the processing the photogrammetric image by the graphic arts rendering process are performed autonomously by a computer.
54. The method of claim 47 , wherein the graphic arts rendering process: determines a shadow balance tonal threshold of the image; and processes the original texture data by isolating the at least one shadow balance tonal threshold.
55. A method performed on a computer for the production of photogrammetric renderings of an object from an image of the object, the method comprising: processing the image by a photogrammetric process to produce a photogrammetric image; and processing the photogrammetric image by a graphic arts rendering process to provide a processed two-dimensional image, wherein the graphic arts rendering process: processes original texture data of the object from the photogrammetric image to generate processed texture data that comprises less data than the original texture data but still conveys information related to an actual texture of the object; preserves at least a portion of detail related to mortar joints of the object while partially or fully eliminating at least a portion of detail related to stone surfaces of the object; and generates the processed two-dimensional image by fabricating a rendering of the object that portrays the processed texture data and is based entirely on the actual texture of the object.
56. The method of claim 55 , wherein the photogrammetric processing comprises a rectification of the image for at least one of a camera lens distortion, image receptor plane effect, optical effect, distortion due to image receptor plane variance, distortion of the image, and damage of the image.
57. The method of claim 55 , wherein a plurality of images are used during the photogrammetric process and the processing comprises: separately correcting each individual image of the plurality of images to form a plurality of photogrammetrically-corrected images; and joining the plurality of photogrammetrically-corrected images together into the photogrammetric image.
58. The method of claim 55 , wherein the graphic arts rendering process comprises at least one of changing contrast, changing hue, changing saturation, changing color balance, converting to grayscale, finding edges (regions of change in texture or contrast or color), tracing, masking, separating to color channels, and applying mathematical actions on color channels including adding, subtracting, equalizing, indexing, multiplying, and inverting.
59. The method of claim 55 , wherein the photogrammetric process produces the photogrammetric image by generating an orthogonal version of the image.
60. The method of claim 55 , wherein the graphic arts rendering process: determines at least one of a midtone balance tonal threshold of the image and a highlight balance tonal threshold of the image; and processes the original texture data by isolating the at least one midtone balance tonal threshold and highlight balance tonal threshold.
61. The method of claim 55 , wherein the processing the image by the photogrammetric process and the processing the photogrammetric image by the graphic arts rendering process are performed autonomously by a computer.
62. The method of claim 55 , wherein the graphic arts rendering process: determines a shadow balance tonal threshold of the image; and processes the original texture data by isolating the at least one shadow balance tonal threshold.
Cooperative Patent Classification codes for this invention. Click any code to explore related patents in that topic.
May 4, 2007
June 5, 2012
Browse 5M+ US patents with plain-English claim translations and AI-generated analysis.