{"id":2420,"date":"2019-07-18T16:12:10","date_gmt":"2019-07-18T04:12:10","guid":{"rendered":"http:\/\/blogs.lincoln.ac.nz\/gis\/?p=2420"},"modified":"2023-05-07T03:23:26","modified_gmt":"2023-05-07T03:23:26","slug":"enhance","status":"publish","type":"post","link":"https:\/\/blogs.lincoln.ac.nz\/gis\/enhance\/","title":{"rendered":"Enhance!"},"content":{"rendered":"<p><em>In remote sensing analysis, the higher the image resolution the more valuable the asset.\u00a0 In this post we cover pansharpening, the process of using high resolution panchromatic imagery to improve the resolution of coarser multispectral imagery.<\/em><\/p>\n<p>I&#8217;m not a big fan of all those CSI-type shows, especially when it comes to their treatment of images.\u00a0 All they need to do it utter &#8220;<a href=\"https:\/\/tvtropes.org\/pmwiki\/pmwiki.php\/Main\/EnhanceButton\" target=\"_blank\" rel=\"noopener noreferrer\">Enhance!<\/a>&#8221; and the killer&#8217;s reflection in the victim&#8217;s eye suddenly becomes visible &#8211; cue the chase and lots of gunfire.\u00a0 Here&#8217;s a <a href=\"https:\/\/www.youtube.com\/watch?v=e1H6QSmzAtM\" target=\"_blank\" rel=\"noopener noreferrer\">good compilation<\/a> of such instances and here&#8217;s <a href=\"https:\/\/www.youtube.com\/watch?v=PaMdXjTn9rc\" target=\"_blank\" rel=\"noopener noreferrer\">a welcome antidote<\/a>.<\/p>\n<p>The idea that the resolution of an image and somehow be magically increased to improve detail is mostly a fantasy &#8211; though there is one thing that comes close in remote sensing: pansharpening.\u00a0 With this technique, we can basically use a high resolution black and white image to increase the resolution of a coarser multispectral image.\u00a0 there&#8217;s a lot to unpack in that and we started the <a href=\"http:\/\/blogs.lincoln.ac.nz\/gis\/wavelengths\/\" target=\"_blank\" rel=\"noopener noreferrer\">conversation about imagery in a previous post<\/a>.\u00a0 There we saw that imagery captures reflected energy at various wavelengths and resolutions.\u00a0 Looking at <a href=\"https:\/\/landsat.gsfc.nasa.gov\/landsat-data-continuity-mission\/\" target=\"_blank\" rel=\"noopener noreferrer\">Landsat-8<\/a> satellite data may be a bit helpful here.<\/p>\n<figure id=\"attachment_2423\" aria-describedby=\"caption-attachment-2423\" style=\"width: 1440px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/landsat.gsfc.nasa.gov\/wp-content\/uploads\/2013\/01\/ldcm_2012_COL.png\" rel=\"https:\/\/landsat.gsfc.nasa.gov\/wp-content\/uploads\/2013\/01\/ldcm_2012_COL.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-2423 size-full\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/ldcm_2012_COL.png\" alt=\"\" width=\"1440\" height=\"810\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/ldcm_2012_COL.png 1440w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/ldcm_2012_COL-300x169.png 300w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/ldcm_2012_COL-1024x576.png 1024w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/ldcm_2012_COL-768x432.png 768w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/ldcm_2012_COL-1200x675.png 1200w\" sizes=\"auto, (max-width: 1440px) 100vw, 1440px\" \/><\/a><figcaption id=\"caption-attachment-2423\" class=\"wp-caption-text\"><em>Landsat-8 satellite<\/em><\/figcaption><\/figure>\n<p>This satellite captures multispectal imagery across <a href=\"https:\/\/landsat.gsfc.nasa.gov\/landsat-8\/landsat-8-bands\/\" target=\"_blank\" rel=\"noopener noreferrer\">11 bands<\/a>\u00a0(this link provides a great band-by-band discussion, by the way.\u00a0 Well worth a read) &#8211; summarised in the figure below:<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/Landsat-8-band-designations.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2424\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/Landsat-8-band-designations.jpg\" alt=\"\" width=\"1180\" height=\"606\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/Landsat-8-band-designations.jpg 1180w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/Landsat-8-band-designations-300x154.jpg 300w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/Landsat-8-band-designations-1024x526.jpg 1024w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/Landsat-8-band-designations-768x394.jpg 768w\" sizes=\"auto, (max-width: 1180px) 100vw, 1180px\" \/><\/a><\/p>\n<p>The\u00a0visible (to our remotely sensing eyes) blue, green, red bands are 2, 3 and 4 respectively and vegetation mapping is made a lot more useful with band 5, near infrared.\u00a0 Note band 8, panchromatic and, more specifically, note the resolution.\u00a0 Band 8 is at 15 m while most of the rest are at 30 m.\u00a0 In general, panchromatic sensors have higher resolutions than the multispectral sensors.\u00a0 Here&#8217;s another way to look at those bands, in terms of wavelengths:<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/all_Landsat_bands.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2425\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/all_Landsat_bands.png\" alt=\"\" width=\"1585\" height=\"756\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/all_Landsat_bands.png 1585w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/all_Landsat_bands-300x143.png 300w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/all_Landsat_bands-1024x488.png 1024w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/all_Landsat_bands-768x366.png 768w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/all_Landsat_bands-1536x733.png 1536w\" sizes=\"auto, (max-width: 1585px) 100vw, 1585px\" \/><\/a><\/p>\n<p>Perhaps I&#8217;ll break down the different sensors in another post but for now\u00a0we&#8217;re focused on bands 2, 3, 4, 5 and 8.\u00a0 We can take advantage of the higher resolution of band 8 to increase the resolution of the ones we&#8217;re most interested in.\u00a0 Here&#8217;s where pansharpening comes in and there are a range of algorithms that do the heavy lifting.<\/p>\n<p>Let&#8217;s take a closer look at the Mt Grand satellite image we looked at <a href=\"http:\/\/blogs.lincoln.ac.nz\/gis\/wavelengths\/\" target=\"_blank\" rel=\"noopener noreferrer\">previously <\/a>&#8211; here I&#8217;ll zoom in on particular area with a bit of detail\u00a0and show both the RGB image on the left (2 m) and the\u00a0 panchromatic (black and white) image (0.5 m) on the right<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/combo.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2426\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/combo.jpg\" alt=\"\" width=\"780\" height=\"445\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/combo.jpg 780w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/combo-300x171.jpg 300w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/combo-768x438.jpg 768w\" sizes=\"auto, (max-width: 780px) 100vw, 780px\" \/><\/a><\/p>\n<p>Hopefully you can clearly see the resolution differences.\u00a0 In ArcGIS there are <a href=\"http:\/\/desktop.arcgis.com\/en\/arcmap\/10.3\/manage-data\/raster-and-images\/fundamentals-of-panchromatic-sharpening.htm\" target=\"_blank\" rel=\"noopener noreferrer\">several pansharpening methods<\/a> to choose from: Brovey, ESRI, Gram-Schmidt, IHS and Simple Mean.\u00a0 I won&#8217;t go into the gory details of how they work but feel free to check the link above if you really can&#8217;t get to sleep without knowing.<\/p>\n<p>As might be expected, there&#8217;s a tool that does the work for us, surprisingly enough called <a href=\"http:\/\/desktop.arcgis.com\/en\/arcmap\/latest\/tools\/data-management-toolbox\/create-pansharpened-raster-dataset.htm\" target=\"_blank\" rel=\"noopener noreferrer\">Create Pansharpened Raster D<\/a>ataset (the <a href=\"http:\/\/blogs.lincoln.ac.nz\/gis\/a-new-window-on-the-world-arcgis-pro\/\" target=\"_blank\" rel=\"noopener noreferrer\">ArcGIS Pro<\/a> version below &#8211; &#8220;channel&#8221; = band):<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/Tool.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2428\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/Tool.jpg\" alt=\"\" width=\"411\" height=\"523\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/Tool.jpg 411w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/Tool-236x300.jpg 236w\" sizes=\"auto, (max-width: 411px) 100vw, 411px\" \/><\/a><\/p>\n<p>For the Mt Grand image, I tried all of the above methods and the IHS method seemed to work the best (i.e. looked the most realistic, colour-wise).\u00a0 For the above area, the output looks like this:<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/IHS.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-2427\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/IHS.jpg\" alt=\"\" width=\"426\" height=\"488\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/IHS.jpg 426w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2019\/07\/IHS-262x300.jpg 262w\" sizes=\"auto, (max-width: 426px) 100vw, 426px\" \/><\/a><\/p>\n<p>The result is a 0.5 m resolution multispectral image (even though it looks a little &#8220;ghosty&#8221;), ready for further analysis.<\/p>\n<p>With remote sensing, resolution is paramount, so what I&#8217;ve been able to do here is fuse a high resolution panchromatic image with a lower resolution multispectral image to get the best of both worlds.\u00a0 All well and good, but what next?\u00a0 The value of multispectral data goes beyond just giving us a pretty picture.\u00a0 In later posts we&#8217;ll look at how we can now build on this image to do some vegetation and land cover mapping.\u00a0 These will include image classification and vegetation indicies so stay tuned &#8211; it should really &#8220;enhance&#8221; your mapping abilities.<\/p>\n<p>C<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In remote sensing analysis, the higher the image resolution the more valuable the asset.\u00a0 In this post we cover pansharpening, the process of using high resolution panchromatic imagery to improve the resolution of coarser multispectral imagery. I&#8217;m not a big fan of all those CSI-type shows, especially when it comes to their treatment of images.\u00a0 [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-2420","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/posts\/2420","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/comments?post=2420"}],"version-history":[{"count":2,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/posts\/2420\/revisions"}],"predecessor-version":[{"id":4968,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/posts\/2420\/revisions\/4968"}],"wp:attachment":[{"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/media?parent=2420"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/categories?post=2420"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/tags?post=2420"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}