{"id":3102,"date":"2021-07-23T10:58:31","date_gmt":"2021-07-22T22:58:31","guid":{"rendered":"http:\/\/blogs.lincoln.ac.nz\/gis\/?p=3102"},"modified":"2023-05-07T02:59:27","modified_gmt":"2023-05-07T02:59:27","slug":"json-and-the-argonauts","status":"publish","type":"post","link":"https:\/\/blogs.lincoln.ac.nz\/gis\/json-and-the-argonauts\/","title":{"rendered":"JSON and the Argonauts"},"content":{"rendered":"<p><em>We look at extracting data from the Christchurch City Councils SmartView maps.<\/em><\/p>\n<p>As local government uses maps to make their data more and more available, we&#8217;ll look in this post at extracting some useful data from the Christchurch City Councils <a href=\"https:\/\/smartview.ccc.govt.nz\/\" target=\"_blank\" rel=\"noopener noreferrer\">SmartView <\/a>maps.\u00a0 Let start with a quick look at what&#8217;s available:<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/splash.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3134\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/splash.jpg\" alt=\"\" width=\"805\" height=\"905\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/splash.jpg 805w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/splash-267x300.jpg 267w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/splash-768x863.jpg 768w\" sizes=\"auto, (max-width: 805px) 100vw, 805px\" \/><\/a><\/p>\n<p>You can type in an address int the Search window or click on one of the subsections &#8211; let&#8217;s go to Find section and see what&#8217;s there:<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Find.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3135\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Find.jpg\" alt=\"\" width=\"800\" height=\"889\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Find.jpg 800w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Find-270x300.jpg 270w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Find-768x853.jpg 768w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/a><\/p>\n<p>Clicking on any one of these takes you eventually to a map &#8211;\u00a0Fruit trees\u00a0look\u00a0interesting, yes?<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/FruitTrees.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3140\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/FruitTrees.jpg\" alt=\"\" width=\"807\" height=\"940\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/FruitTrees.jpg 807w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/FruitTrees-258x300.jpg 258w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/FruitTrees-768x895.jpg 768w\" sizes=\"auto, (max-width: 807px) 100vw, 807px\" \/><\/a><\/p>\n<p>This shows us locations and additional information if we click on a tree point. While this is great stuff, I might like to use this layer in my analysis, but in its current form, it is shackled to the browser.\u00a0 How could I extract it?<\/p>\n<p>I&#8217;ll admit at the start that I had no idea how to do this, let alone that SmartView was a thing until some of my ERST606 students brought it to my attention (hat tip to Estela and Grace, as well as the <a href=\"https:\/\/en.wikipedia.org\/wiki\/Argonauts\" target=\"_blank\" rel=\"noopener noreferrer\">Argonauts<\/a>).\u00a0 There&#8217;s always something new to learn with GIS.\u00a0 Anyway, here&#8217;s how; gird your loins &#8211; it gets a bit involved.<\/p>\n<p>First navigate up to the top level page where we clicked on Find.\u00a0 Right-click somewhere\u00a0on the blue area\u00a0and choose &#8220;Inspect&#8221; &#8211; you&#8217;ll get a funny looking window at the right:<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Inspect-1.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3139\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Inspect-1.jpg\" alt=\"\" width=\"1641\" height=\"940\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Inspect-1.jpg 1641w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Inspect-1-300x172.jpg 300w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Inspect-1-1024x587.jpg 1024w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Inspect-1-768x440.jpg 768w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Inspect-1-1536x880.jpg 1536w\" sizes=\"auto, (max-width: 1641px) 100vw, 1641px\" \/><\/a><\/p>\n<p>Select <strong>Network<\/strong> tab from the top menu and make sure <strong>XHR<\/strong> is selected:<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/xhr.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3138\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/xhr.jpg\" alt=\"\" width=\"558\" height=\"165\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/xhr.jpg 558w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/xhr-300x89.jpg 300w\" sizes=\"auto, (max-width: 558px) 100vw, 558px\" \/><\/a><\/p>\n<p>On the SmartView page, click <strong>Find<\/strong> &gt;\u00a0<strong>Fruit Tree<\/strong>s.\u00a0 In one of the windows, an item called &#8220;map_feature.php&#8230;&#8221; appears (<em>NB &#8211; I had to use (gulp) Edge to do this &#8211; please don&#8217;t tell anyone I used Edge by choice<\/em>):<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Inspect2.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3141\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Inspect2.jpg\" alt=\"\" width=\"555\" height=\"360\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Inspect2.jpg 555w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Inspect2-300x195.jpg 300w\" sizes=\"auto, (max-width: 555px) 100vw, 555px\" \/><\/a><\/p>\n<p>Right-click on this and choose &#8216;Copy link address&#8217;<\/p>\n<p>Paste this link in a new tab\u00a0 and\u00a0bunch of text appears:<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Text.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3142\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Text.jpg\" alt=\"\" width=\"1917\" height=\"479\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Text.jpg 1917w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Text-300x75.jpg 300w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Text-1024x256.jpg 1024w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Text-768x192.jpg 768w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Text-1536x384.jpg 1536w\" sizes=\"auto, (max-width: 1917px) 100vw, 1917px\" \/><\/a><\/p>\n<p>Talk about gobbeldygook &#8211; what a mess.\u00a0 But there&#8217;s gold in them thar characters &#8211; on closer inspection, useful bits appear:<\/p>\n<ul>\n<li>Coordinates:\u00a0<a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/coords-1.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3144\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/coords-1.jpg\" alt=\"\" width=\"155\" height=\"22\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/coords-1.jpg 155w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/coords-1-150x22.jpg 150w\" sizes=\"auto, (max-width: 155px) 100vw, 155px\" \/><\/a><\/li>\n<li>Tree names:\u00a0<a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Name.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3145\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/Name.jpg\" alt=\"\" width=\"203\" height=\"19\" \/><\/a><\/li>\n<li>Display colours:\u00a0<a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/rgb.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3147\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/rgb.jpg\" alt=\"\" width=\"114\" height=\"24\" \/><\/a><\/li>\n<li>An odd one:\u00a0<a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/EPSG.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3146\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/EPSG.jpg\" alt=\"\" width=\"143\" height=\"20\" \/><\/a>\u00a0&#8211; more on this later<\/li>\n<\/ul>\n<p>This kind of file is what&#8217;s known as a <a href=\"https:\/\/fileinfo.com\/extension\/json\" target=\"_blank\" rel=\"noopener noreferrer\">JSON<\/a> file (JavaScript Object Notation) &#8211; it&#8217;s basically a text file format for exchanging data in a lighter, more portable way.\u00a0 We could, for instance, convert a polygon layer to a JSON file and send that off, knowing that all the features and their geometries are recorded in text format.\u00a0 It&#8217;s sort of human readable, but takes a bit of practice to decode.\u00a0 In any event, Pro can work with them.<\/p>\n<p>Select all this text\u00a0and copy it\u00a0 into a text file using something like Notepad or WordPad.\u00a0 Save the file, giving it a .json extention, e.g. &#8220;fruittrees.json&#8221;.<\/p>\n<p>In Pro now, use the <a href=\"https:\/\/pro.arcgis.com\/en\/pro-app\/latest\/tool-reference\/conversion\/json-to-features.htm\" target=\"_blank\" rel=\"noopener noreferrer\">JSON To Features<\/a> tool\u00a0 &#8211; the Input JSON is the fruittrees.json file and enter a name for the Output feature class in a geodatabase (or you could save it as a shapefile):<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/tool.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3148\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/tool.jpg\" alt=\"\" width=\"362\" height=\"198\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/tool.jpg 362w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/tool-300x164.jpg 300w\" sizes=\"auto, (max-width: 362px) 100vw, 362px\" \/><\/a><\/p>\n<p>Click &#8216;Run&#8217; and voila they should appear as points!<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/OnMap.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3149\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/OnMap.jpg\" alt=\"\" width=\"1549\" height=\"883\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/OnMap.jpg 1549w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/OnMap-300x171.jpg 300w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/OnMap-1024x584.jpg 1024w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/OnMap-768x438.jpg 768w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2021\/07\/OnMap-1536x876.jpg 1536w\" sizes=\"auto, (max-width: 1549px) 100vw, 1549px\" \/><\/a><\/p>\n<p>Nice!\u00a0 This worked for most of the choices in Find, but not all; Street Art, for instance, didn&#8217;t, but with a bit of perseverance I&#8217;m sure you can get them to work too.<\/p>\n<p>This is a bit involved to get at some data but sometimes one must be prepared to do what&#8217;s necessary to get points on the map.<\/p>\n<p>C<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We look at extracting data from the Christchurch City Councils SmartView maps. As local government uses maps to make their data more and more available, we&#8217;ll look in this post at extracting some useful data from the Christchurch City Councils SmartView maps.\u00a0 Let start with a quick look at what&#8217;s available: You can type in [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-3102","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/posts\/3102","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/comments?post=3102"}],"version-history":[{"count":1,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/posts\/3102\/revisions"}],"predecessor-version":[{"id":4078,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/posts\/3102\/revisions\/4078"}],"wp:attachment":[{"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/media?parent=3102"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/categories?post=3102"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/tags?post=3102"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}