{"id":99,"date":"2013-04-10T02:05:12","date_gmt":"2013-04-10T02:05:12","guid":{"rendered":"http:\/\/www.lincoln.ac.nz\/conversation\/gis\/?p=99"},"modified":"2023-05-07T00:24:55","modified_gmt":"2023-05-07T00:24:55","slug":"data-data-everywhere-but-what-about-what-i-need","status":"publish","type":"post","link":"https:\/\/blogs.lincoln.ac.nz\/gis\/data-data-everywhere-but-what-about-what-i-need\/","title":{"rendered":"Data, data everywhere, but what about what I need?"},"content":{"rendered":"<p><em>This post outlines the data currently available on our network.<\/em><\/p>\n<p>Those of you who have done any work with GIS will know how important the right data are. \u00a0Spatial analysis is very much a garbage in-garbage out process so making sure you&#8217;ve got good data to start out with is crucial. \u00a0Last week&#8217;s post was about getting data off the internet; this week&#8217;s is about letting you know what data we&#8217;ve already got on campus.<\/p>\n<p>All of our data reside on the network, usually referred to as the J: drive (click <a title=\"How can I get some data?\" href=\"http:\/\/blogs.lincoln.ac.nz\/gis\/how-can-i-get-some-data\/\" target=\"_blank\" rel=\"noopener\">here<\/a> to see how to map to the J: drive and make a connection in ArcCatalog). \u00a0Once connected we can browse through the data using ArcCatalog:<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2013\/04\/Catalog.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-833\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2013\/04\/Catalog.jpg\" alt=\"Catalog\" width=\"993\" height=\"582\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2013\/04\/Catalog.jpg 993w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2013\/04\/Catalog-300x176.jpg 300w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2013\/04\/Catalog-768x450.jpg 768w\" sizes=\"auto, (max-width: 993px) 100vw, 993px\" \/><\/a><\/p>\n<p>On the right you can see five folders &#8211; the Data folder is the important one for today&#8217;s post. \u00a0Inside that folder all of our datasets can be found, organised in folders by the name of the dataset. \u00a0At last count we had over 30 datasets.<\/p>\n<p>With ArcCatalog you can select layers in the left-hand window (the Catalog Tree) and preview them (the map as well as the table) in the Right-hand window, using the Preview tab. \u00a0The map or table can be selected at the bottom.<\/p>\n<p><a href=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2013\/04\/Catalog2.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-834\" src=\"https:\/\/d-blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2013\/04\/Catalog2.jpg\" alt=\"Catalog2\" width=\"925\" height=\"634\" srcset=\"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2013\/04\/Catalog2.jpg 925w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2013\/04\/Catalog2-300x206.jpg 300w, https:\/\/blogs.lincoln.ac.nz\/gis\/wp-content\/uploads\/sites\/3\/2013\/04\/Catalog2-768x526.jpg 768w\" sizes=\"auto, (max-width: 925px) 100vw, 925px\" \/><\/a><\/p>\n<p>I struggle with finding a way of covering all the data available without putting you to sleep, so I think I&#8217;ll just hit the highlights, or the most commonly used datasets. \u00a0I&#8217;ll break this down by General Data that might used to create decent maps and Specific Purpose Datasets. \u00a0Most of these are national scale data collected by various ministries, government departments or CRIs. \u00a0At this point you should be taping your eyelids open &#8211; not many pretty pictures from here on in.<\/p>\n<p><strong>General Data<\/strong><\/p>\n<ul>\n<li>Administrative_Boundaries &#8211; shapefiles of the regions and TLAs<\/li>\n<li>Coastline &#8211; line and polygon shapefiles of the New Zealand coastline<\/li>\n<li>KiwImagery &#8211; a selection of imagery from the <a href=\"http:\/\/kiwimage.govt.nz\/\" target=\"_blank\" rel=\"noopener\">KiwImage project<\/a>; multispectral, panchromatic and pansharpened (for you remote sensists out there) &#8211; warning: large file sizes ahead. \u00a0The Pansharpend folder has gorgeous high resolution images of the 1:50,000 scale toposheets (I would recommend you use the jp2 versions)<\/li>\n<li>Orthophotos &#8211; a selection of colour orthophotos (images that have been corrected for various distortions) for the North and South Island in either New Zealand Map Grid (NZMG) or Transverse Mercator (NZTM)<\/li>\n<li>Postal_Code_Network_2006 &#8211; points and polygons of postal code areas<\/li>\n<li>SPOT_data &#8211; imagery from the SPOT satellite (some imagery is not georeferenced)<\/li>\n<li>SpotMaps &#8211; Background information on the SPOT data &#8211; some nice whole-island images in the SPOTMapsImagery folder (in NZTM)<\/li>\n<li>Topoimages &#8211; TIF images of the 1:50K and 1:250K topomaps from LINZ. \u00a0If you don&#8217;t know which map sheet you need, add the topo50 Sheet Index.shp layer and that will tell you which sheet goes where (look at the PRIME attribute to give you the right sheet). \u00a0I often add that layer, make the polygons hollow (i.e. no fill colour) and label it withe PRIME attribute.<\/li>\n<li>Toposhapefiles &#8211; shapefiles of all the features that can be seen on the 1:50K topomaps, so things like roads, rivers, ski lifts, quarries, the list goes on. \u00a0Note that there layers are all at the national scale so you probably want to clip out just the portions that you need. \u00a0There are some nice, general interest layers for the country in the AWNZ context folder.<\/li>\n<li>World_Data &#8211; various generic data in Latitude\/Longitude<\/li>\n<\/ul>\n<p><span style=\"color: #000000\"><strong>Specific Purpose Datasets<\/strong><\/span><\/p>\n<p><span style=\"color: #000000\">Jeez &#8211; where do I start?<\/span><\/p>\n<ul>\n<li><a href=\"http:\/\/www.asurequality.com\/capturing-information-technology-across-the-supply-chain\/agribase-database-for-nz-rural-properties.cfm\" target=\"_blank\" rel=\"noopener\">AgriBase<\/a>2006 &#8211; a polygon layer of self-reported farms from 2006. \u00a0Attributes include farm type. \u00a0We&#8217;re working on getting an updated version of this one.<\/li>\n<li>Bank_Peninsula_Wind_Data &#8211; a 500 m x 500 m raster grid of average annual wind speeds (m\/sec) for Banks Peninsula<\/li>\n<li>CensusData &#8211; shapefiles and spreadsheets from the <a href=\"http:\/\/www.lincoln.ac.nz\/conversation\/gis\/2013\/03\/10\/mapping-the-census\/\" target=\"_blank\" rel=\"noopener\">2006 Census<\/a><\/li>\n<li>Christchurch &#8211; a collection of Christchurch specific data including bus routes, contours from post-earthquake (0.5 m intervals!), 2m contours, road, soils and zoning<\/li>\n<li>Darfield Earthquake &#8211; mostly imagery post-September 2010.<\/li>\n<li>Digital_Elevation_Models &#8211; North and South Island 25 m x 25 m DEM, plus some hillshade layers.<\/li>\n<li>DOC_data &#8211; back country huts (not quite sure why we&#8217;ve got that&#8230;)<\/li>\n<li><a href=\"http:\/\/www.doc.govt.nz\/conservation\/land-and-freshwater\/freshwater\/freshwater-ecosystems-of-new-zealand\/\" target=\"_blank\" rel=\"noopener\">Freshwater_Ecosystems_of_NZ<\/a> &#8211; this dataset will require a separate post to cover it all, but basically an enormous amount of data related to freshwater across the country &#8211; have a nosey.<\/li>\n<li><a href=\"http:\/\/www.mfe.govt.nz\/issues\/land\/land-cover-dbase\/\" target=\"_blank\" rel=\"noopener\">Land Cover Database<\/a> 2 and 3 &#8211; MfE commissioned a regular updating of this layer, which shows vegetation (land cover) across the country based on satellite imagery (mapped at a 1:50K scale). \u00a0We&#8217;ve now had three versions of this and so can track land cover changes from roughly 2001\/02. \u00a0Roughly 50+ land cover classes.<\/li>\n<li><a href=\"http:\/\/www.mfe.govt.nz\/publications\/ser\/lenz-apr03.html\" target=\"_blank\" rel=\"noopener\">Land_Environment_of_NZ<\/a> &#8211; 25 m raster grids across the country that looks for areas with common environmental conditions at four levels of resolution. \u00a0This layer also needs its own post but have a look at the LENZ_Technical_Guide.pdf for a better understanding of what it&#8217;s all about (use Windows Explorer to look in that folder).<\/li>\n<li><a href=\"http:\/\/lris.scinfo.org.nz\/layer\/76-nzlri-land-use-capability\/\" target=\"_blank\" rel=\"noopener\">Land_Resource_Inventory<\/a> &#8211; the grandaddy of NZ&#8217;s spatial layers. \u00a0The LRI is a polygon layer (1:50K scale) that groups land areas based on five parameters (soil, slope, geology, erosion potential and vegetation, plus a Land Use Classification code with rates the land based on suitability for agriculture. \u00a0This folder also contains the Fundamental Soil Layers (fsl) which uses the same polygons but includes soil phyiscal and chemical parameters, including texture. \u00a0Look for a separate post on these layers at a theatre near you.<\/li>\n<li><a href=\"http:\/\/link.springer.com\/chapter\/10.1007%2F978-3-540-77800-4_24\" target=\"_blank\" rel=\"noopener\">Landform_Elements <\/a>&#8211; 25 m raster grid of different landforms, such as ridge, shoulder, valley, footslope, etc.<\/li>\n<li>Landuse_maps_2010 &#8211; maps changes in land use for the South Island<\/li>\n<li><a href=\"http:\/\/www.mfe.govt.nz\/issues\/climate\/lucas\/\" target=\"_blank\" rel=\"noopener\">LUCAS_Landuse_Change_Map<\/a> &#8211; Land Use and Carbon Analysis System<\/li>\n<li>NZMG_data &#8211; there are plenty of people still doing analysis in NZMG so these are some legacy layers (topomaps, toposhapefiles, imagery, among others)<\/li>\n<li><a href=\"http:\/\/www.niwa.co.nz\/our-science\/freshwater\/tools\/rec\" target=\"_blank\" rel=\"noopener\">River_Environment_Classification<\/a> &#8211; line shapefiles of stream reaches throughout the country, grouper\u00a0hierarchically\u00a0on catchment characteristics (climate, source of flow, geology, landcover, network position, valley landform)<\/li>\n<li>South Island Climate Data &#8211; raster grids of climate parameters (annual and monthly rainfall, temperature, wind speed (500 m grids, so fairly coarse).<\/li>\n<\/ul>\n<p>Pshew! \u00a0Still with me? There were quite of few of those datasets that I&#8217;ve not looked at for a while. \u00a0This has been a very cursory overview of our available data which probably raises more questions than it answers. \u00a0What we really need is a searchable database &#8211; I&#8217;ll add that to the list of things to do&#8230;<\/p>\n<p>I can see lots of possibilities for posts that follow on from this: detail on specific datasets, clipping, other sources of data, projecting into different coordinate systems, among others. \u00a0What would you like to hear more about? \u00a0What datasets are we missing?<\/p>\n<p>C<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This post outlines the data currently available on our network. Those of you who have done any work with GIS will know how important the right data are. \u00a0Spatial analysis is very much a garbage in-garbage out process so making sure you&#8217;ve got good data to start out with is crucial. \u00a0Last week&#8217;s post was [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2,4],"tags":[],"class_list":["post-99","post","type-post","status-publish","format-standard","hentry","category-faqs","category-common-how-to-questions"],"_links":{"self":[{"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/posts\/99","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/comments?post=99"}],"version-history":[{"count":1,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/posts\/99\/revisions"}],"predecessor-version":[{"id":3991,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/posts\/99\/revisions\/3991"}],"wp:attachment":[{"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/media?parent=99"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/categories?post=99"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.lincoln.ac.nz\/gis\/wp-json\/wp\/v2\/tags?post=99"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}