what is nvs?
DESCRIPTION
What is NVS?. >77 000 Relev é s. >19 000 permanent plots. Formulation: Evolution of NVS. How does NVS store data?. Purpose-built archival facility Metadata database (XML) NVS database (SQL) Associated electronic files and resources. Metadata and data. What? Where? When? Who? - PowerPoint PPT PresentationTRANSCRIPT
Slide 1What is NVS?
I am going to give you a brief introduction to the National Vegetation Survey or “NVS” databank.
1
Relevés
The NVS databank has archival facilities for both physical data and electronic data. It is recognised as a Nationally Significant Database and curates plot-based vegetation data. Data is held at varying access levels which are set by the data owners. Data may be public access, restricted access or confidential. Restricted access data requires that permission be sought from the data owner before it is released.
The data held in NVS spans greater than 50 years and covers a broad range of habitats throughout New Zealand. In particular indigenous forests and grasslands are strongly represented. There are some standard methods for the collection of data that have been used through time. The two maps on this slide show the locations for which we have electronic data for two standard methods: the Relevee or Recce inventory and permanent plot methods. The NVS data holds more than 77 000 records of the Recce inventory type. This data type describes a vegetation composition and structure. The second map shows the location of more than 19 000 permanent plots. Some of these plots have been measured multiple times over a span of years.
2
Standardised methods for inventory and monitoring of native vegetation developed
Late 1960s
Late 1980s
Process for centrally archiving electronic and hard copy data formalised
1998
2001
2003
2006
2008
2009
3
The NVS databank has a long history which began with efforts by the NZFS. Early field data was entered on punch cards. By late 1980s substantial electronic and hard copy data had accumulated around the country and it was recognised that there was a risk of data loss due to government restructuring. This lead to the formulation of a central system that became the National Vegetation Survey databank. The FRST recognised the importance of NVS by according it Nationally Significant database status in 1998. At this time electronic data was using DOS and Fortran based systems for data storage and retrieval. In 2001 the first stage of technological development into a relational database was begun.
Over time the focus for NVS widened to be across agency. To ensure that data is archived and used to maximum benefit NVS needs to be very outward looking. Expectations of end users were changing so it was decided that it was best to take stock and undertake a formal assessment of end-user needs to set our direction and future priorities.
Recent developments include the building of an archive, a new database system and the NVS Express tool for data entry and to replace outdated analysis programs.
How does NVS store data?
Purpose-built archival facility
Metadata database (XML)
NVS database (SQL)
Associated electronic files and resources
NVS archives data in a variety of ways. A purpose-built archive was constructed in 2003, which is temperature & humidity controlled. This is were physical copies of data such as maps, field data sheets, aerial photographs and photographic slides are stored.
For every survey stored in NVS there is a metadata record which contains information about how it was carried out. This information is stored in an xml format metadata database. A subset of this information for each survey is displayed on the NVS website.
Electronic data is stored in the NVS database, which is a relational SQL database.
In addition we store a variety of associated electronic resources such as digital image files or word documents.
4
What?
Where?
When?
Who?
Why?
How?
The provision of metadata for data provided to NVS is very important as data is meaningless out of context. Data providers are asked for a range of information for the datasets that they provide. This includes details on the locations, the dates, methodology and the people involved. Amongst other things, uch information allows data to be used for temporal analysis, merged with other data measured using the same methods and the relocation of sites for remeasurement purposes. Metadata is especially important in the historical context of legacy NVS storage of data.
5
How the information content of data and metadata degrades over time. Source: Michener et al. 1997.
This graph is from an article in Ecological Applications by (William) Michener and colleagues. It illustrates how the information content of metadata and data degrades over time. This illustrates that there is a strong case for archiving data soon after it’s collection, when the most information is available. As time passes, information is progressively lost about specific details and general details. Accidents may destroy the data or the main contact for the data may retire. You may have experienced this in action if you have ever taken over a new job and found a pile of data under your new desk…
Michener, William K., James W. Brunt, John J. Helly, Thomas B. Kirchner, and Susan G. Stafford. 1997. NONGEOSPATIAL METADATA FOR THE ECOLOGICAL SCIENCES. Ecological Applications 7:330–342. [doi:10.1890/1051-0761(1997)007[0330:NMFTES]2.0.CO;2]
6
Recce inventory (Hurst & Allen 2007)
Permanent plot method (Hurst & Allen 2007)
presently supported in the Main NVS database UI:
EBEX21 (Richardson et al. 2004)
Carbon Monitoring System or LUCAS (Payton et al. 2004)
examples of other standard methods:
Wraight 20 x 20m quadrat (Wiser & Rose 1997)
Scott height frequency (Wiser & Rose 1997)
The NVS database has been configured for some of the standard methodologies that are in use. These include Permanent plot methods for forests and Recce inventory methods as described in the latest manuals produced by Hurst & Allen in 2007. The main database also supports other methods, such as those developed for carbon monitoring projects such as EBEX21 and LUCAS. Over the next few years we intend to migrate data stored in other formats into the new NVS database and develop the capability to enter those formats. Examples include grassland methodology such as the Wraight quadrats and Scott height frequency.
7
All vegetation types as per Hurst & Allen 2007
The Recce inventory is a Reconnaissance description, used to describe the composition & structure of vegetation. The earlier versions of this method were set down by Allen in 1979; Allen & McLennan in 1983 and Allen in 1992, culminating in the latest methods manual by Hurst & Allen in 2007.
A Recce inventory can be used to describe vegetation of all types. Plant species are recorded within height tiers with associated cover estimates. There are standard sets of height tiers for either woody or non-woody vegetation types, as shown in the diagrams. In addition, various site characteristics such as altitude, aspect, and slope are also recorded.
8
Permanent 20 x 20m plots as per Hurst & Allen 2007
There is a long history of measurement of permanent forest plots in New Zealand. The earlier versions of protocols were described by Allen in 1979, Allen & McLennan in 1983, Allen in 1992 & 1993, culminating in the present methods manual by Hurst & Allen in 2007.
This methods permanently marks out 20 x 20m plots, which is further divided into 16 5 x 5m sub plots for ease of measurement. All trees on the plot are tagged and measured and saplings are counted. There are a further 24 49cm radius sub plots on which seedlings are tallied in height classes. A Recce description is also measured on the plot.
This method allows for multiple measurements of the plot to be carried out and compared over time.
9
What other methods should be able to be entered via NVS Express?
NVS Express is a stand-alone software tool designed for the entry and analysis of vegetation data collected using standard methodologies. It is freely available to be downloaded from the NVS website.
NVS Express presently comes pre-loaded with the methods required for entering permanent plot and Recce inventory data. In the future we intend to add additional standard methods. Please contact the NVS team if you wish to recommend any particular methods that are widely used and would be useful to have pre-loaded in NVS Express.
10
Various information on the data available in NVS can be found on the NVS website: nvs.landcareresearch.co.nz
On the home page there are three main groups of resources. Under Introduction & policy you can find general background information on NVS. Under Resources there is methods information such as manuals and plotsheets, in addition to a schematic of the NVS data model and some FAQ.
Under Data there is information on how to deposit and request data from NVS. In addition there are some basic searches for data. The search metadata databank allows viewing and searching of summarised metadata information on all surveys or datasets held by NVS.
11
Clicking on the search metadata databank will take you to this screen. Clicking a conservancy will show you all the datasets held in that area.
12
This screen shot shows the datasets which are within the West Coast region, listed on the left hand side.
13
Alternatively you can do a basic text search to look for datasets. In this example I have typed in arawhata and come up with a list of 6 surveys that have arawhata in a searchable field.
14
By pressing the plus symbol next to a survey you are shown all the methods measured. Double-clicking on a particular method will then display the summarised metadata for that method. From here you can make a request through the website by adding a particular method to a request cart.
15
Here is an example of the request cart, the results of which will be emailed through to the NVS database administrator. Note that if a dataset status is restricted you will be asked to request permission from the data owner as part of the request process.
16
Got to NVS home page
2. Search for a particular species – press ‘NVS Plant Names & Maps’
17
This takes you to a page that allows you to both download the NVS code list and search for species. I have typed in the genus Libocedrus to see what records NVS holds.
18
The search results show the Libocedrus species that have six-letter NVS codes: Libocedrus bidwillii, Libocedrus plumosa and the Libocedrus genus. The kowhai icon beside the name links to the NZ Plant Names database record for the taxon. The NZ map icon links to a display of NVS records for the taxon.
19
I have clicked on the NZ map beside the Libocedrus bidwillii name. The NZ map displayed shows the NZMS 260 map squares for which there are datbase records for the species. Clicking on one of the map squares displays the list of records. For this example I have clicked on map sheet M32. Libocedrus bidwillii occurs on two surveys: Hope 1975-76 and Waiau 1980-81. Clicking on the collection number or dataset name will open the metadata record for the method.
20
Creating a new NVS website
what should it be like?
We are looking to redevelop the NVS website. If you have any feedback on the current website or suggestions for new features please contact the NVS team. We can be contacted via email at [email protected].
21
I am going to give you a brief introduction to the National Vegetation Survey or “NVS” databank.
1
Relevés
The NVS databank has archival facilities for both physical data and electronic data. It is recognised as a Nationally Significant Database and curates plot-based vegetation data. Data is held at varying access levels which are set by the data owners. Data may be public access, restricted access or confidential. Restricted access data requires that permission be sought from the data owner before it is released.
The data held in NVS spans greater than 50 years and covers a broad range of habitats throughout New Zealand. In particular indigenous forests and grasslands are strongly represented. There are some standard methods for the collection of data that have been used through time. The two maps on this slide show the locations for which we have electronic data for two standard methods: the Relevee or Recce inventory and permanent plot methods. The NVS data holds more than 77 000 records of the Recce inventory type. This data type describes a vegetation composition and structure. The second map shows the location of more than 19 000 permanent plots. Some of these plots have been measured multiple times over a span of years.
2
Standardised methods for inventory and monitoring of native vegetation developed
Late 1960s
Late 1980s
Process for centrally archiving electronic and hard copy data formalised
1998
2001
2003
2006
2008
2009
3
The NVS databank has a long history which began with efforts by the NZFS. Early field data was entered on punch cards. By late 1980s substantial electronic and hard copy data had accumulated around the country and it was recognised that there was a risk of data loss due to government restructuring. This lead to the formulation of a central system that became the National Vegetation Survey databank. The FRST recognised the importance of NVS by according it Nationally Significant database status in 1998. At this time electronic data was using DOS and Fortran based systems for data storage and retrieval. In 2001 the first stage of technological development into a relational database was begun.
Over time the focus for NVS widened to be across agency. To ensure that data is archived and used to maximum benefit NVS needs to be very outward looking. Expectations of end users were changing so it was decided that it was best to take stock and undertake a formal assessment of end-user needs to set our direction and future priorities.
Recent developments include the building of an archive, a new database system and the NVS Express tool for data entry and to replace outdated analysis programs.
How does NVS store data?
Purpose-built archival facility
Metadata database (XML)
NVS database (SQL)
Associated electronic files and resources
NVS archives data in a variety of ways. A purpose-built archive was constructed in 2003, which is temperature & humidity controlled. This is were physical copies of data such as maps, field data sheets, aerial photographs and photographic slides are stored.
For every survey stored in NVS there is a metadata record which contains information about how it was carried out. This information is stored in an xml format metadata database. A subset of this information for each survey is displayed on the NVS website.
Electronic data is stored in the NVS database, which is a relational SQL database.
In addition we store a variety of associated electronic resources such as digital image files or word documents.
4
What?
Where?
When?
Who?
Why?
How?
The provision of metadata for data provided to NVS is very important as data is meaningless out of context. Data providers are asked for a range of information for the datasets that they provide. This includes details on the locations, the dates, methodology and the people involved. Amongst other things, uch information allows data to be used for temporal analysis, merged with other data measured using the same methods and the relocation of sites for remeasurement purposes. Metadata is especially important in the historical context of legacy NVS storage of data.
5
How the information content of data and metadata degrades over time. Source: Michener et al. 1997.
This graph is from an article in Ecological Applications by (William) Michener and colleagues. It illustrates how the information content of metadata and data degrades over time. This illustrates that there is a strong case for archiving data soon after it’s collection, when the most information is available. As time passes, information is progressively lost about specific details and general details. Accidents may destroy the data or the main contact for the data may retire. You may have experienced this in action if you have ever taken over a new job and found a pile of data under your new desk…
Michener, William K., James W. Brunt, John J. Helly, Thomas B. Kirchner, and Susan G. Stafford. 1997. NONGEOSPATIAL METADATA FOR THE ECOLOGICAL SCIENCES. Ecological Applications 7:330–342. [doi:10.1890/1051-0761(1997)007[0330:NMFTES]2.0.CO;2]
6
Recce inventory (Hurst & Allen 2007)
Permanent plot method (Hurst & Allen 2007)
presently supported in the Main NVS database UI:
EBEX21 (Richardson et al. 2004)
Carbon Monitoring System or LUCAS (Payton et al. 2004)
examples of other standard methods:
Wraight 20 x 20m quadrat (Wiser & Rose 1997)
Scott height frequency (Wiser & Rose 1997)
The NVS database has been configured for some of the standard methodologies that are in use. These include Permanent plot methods for forests and Recce inventory methods as described in the latest manuals produced by Hurst & Allen in 2007. The main database also supports other methods, such as those developed for carbon monitoring projects such as EBEX21 and LUCAS. Over the next few years we intend to migrate data stored in other formats into the new NVS database and develop the capability to enter those formats. Examples include grassland methodology such as the Wraight quadrats and Scott height frequency.
7
All vegetation types as per Hurst & Allen 2007
The Recce inventory is a Reconnaissance description, used to describe the composition & structure of vegetation. The earlier versions of this method were set down by Allen in 1979; Allen & McLennan in 1983 and Allen in 1992, culminating in the latest methods manual by Hurst & Allen in 2007.
A Recce inventory can be used to describe vegetation of all types. Plant species are recorded within height tiers with associated cover estimates. There are standard sets of height tiers for either woody or non-woody vegetation types, as shown in the diagrams. In addition, various site characteristics such as altitude, aspect, and slope are also recorded.
8
Permanent 20 x 20m plots as per Hurst & Allen 2007
There is a long history of measurement of permanent forest plots in New Zealand. The earlier versions of protocols were described by Allen in 1979, Allen & McLennan in 1983, Allen in 1992 & 1993, culminating in the present methods manual by Hurst & Allen in 2007.
This methods permanently marks out 20 x 20m plots, which is further divided into 16 5 x 5m sub plots for ease of measurement. All trees on the plot are tagged and measured and saplings are counted. There are a further 24 49cm radius sub plots on which seedlings are tallied in height classes. A Recce description is also measured on the plot.
This method allows for multiple measurements of the plot to be carried out and compared over time.
9
What other methods should be able to be entered via NVS Express?
NVS Express is a stand-alone software tool designed for the entry and analysis of vegetation data collected using standard methodologies. It is freely available to be downloaded from the NVS website.
NVS Express presently comes pre-loaded with the methods required for entering permanent plot and Recce inventory data. In the future we intend to add additional standard methods. Please contact the NVS team if you wish to recommend any particular methods that are widely used and would be useful to have pre-loaded in NVS Express.
10
Various information on the data available in NVS can be found on the NVS website: nvs.landcareresearch.co.nz
On the home page there are three main groups of resources. Under Introduction & policy you can find general background information on NVS. Under Resources there is methods information such as manuals and plotsheets, in addition to a schematic of the NVS data model and some FAQ.
Under Data there is information on how to deposit and request data from NVS. In addition there are some basic searches for data. The search metadata databank allows viewing and searching of summarised metadata information on all surveys or datasets held by NVS.
11
Clicking on the search metadata databank will take you to this screen. Clicking a conservancy will show you all the datasets held in that area.
12
This screen shot shows the datasets which are within the West Coast region, listed on the left hand side.
13
Alternatively you can do a basic text search to look for datasets. In this example I have typed in arawhata and come up with a list of 6 surveys that have arawhata in a searchable field.
14
By pressing the plus symbol next to a survey you are shown all the methods measured. Double-clicking on a particular method will then display the summarised metadata for that method. From here you can make a request through the website by adding a particular method to a request cart.
15
Here is an example of the request cart, the results of which will be emailed through to the NVS database administrator. Note that if a dataset status is restricted you will be asked to request permission from the data owner as part of the request process.
16
Got to NVS home page
2. Search for a particular species – press ‘NVS Plant Names & Maps’
17
This takes you to a page that allows you to both download the NVS code list and search for species. I have typed in the genus Libocedrus to see what records NVS holds.
18
The search results show the Libocedrus species that have six-letter NVS codes: Libocedrus bidwillii, Libocedrus plumosa and the Libocedrus genus. The kowhai icon beside the name links to the NZ Plant Names database record for the taxon. The NZ map icon links to a display of NVS records for the taxon.
19
I have clicked on the NZ map beside the Libocedrus bidwillii name. The NZ map displayed shows the NZMS 260 map squares for which there are datbase records for the species. Clicking on one of the map squares displays the list of records. For this example I have clicked on map sheet M32. Libocedrus bidwillii occurs on two surveys: Hope 1975-76 and Waiau 1980-81. Clicking on the collection number or dataset name will open the metadata record for the method.
20
Creating a new NVS website
what should it be like?
We are looking to redevelop the NVS website. If you have any feedback on the current website or suggestions for new features please contact the NVS team. We can be contacted via email at [email protected].
21