Saturday, March 7, 2015

PLSS CadNSDI - Metadata at a Glance

This is the second of a series of documents that describe the contents of the PLSS CadNSDI data set.

The Metadata at a Glance is an unlikely first feature class to select to use but the information in this feature class will rapidly show the data stewards and currency of features in the rest of the data set.  As the PLSS CadNSDI expands and more locally sourced control and divisions are incorporated into the data set, there will be increasing numbers of contributors.  This is the feature class that can be used to quickly and easily see updates. 

The Metadata at a Glance is a geographic representation of the data stewards and currency or vintage.  The initial or baseline data set is based on PLSS Townships in PLSS areas. In non-PLSS areas the metadata at a glance is based on a data steward defined polygons such as a city or county or other units. The identification of the data steward is a general indication of the agency that will be responsible for updates and providing the authoritative data sources. In the shared environment of the NSDI the data steward for an area is the primary coordinator or agency responsible for making updates or causing updates to be made. The data stewardship polygons are defined and provided by the data steward.

The standard attributes for this feature class are listed in the table.

FieldName
Type
Length
Description
AliasName
PLSSID
String
50
Concatenation of the principal meridian, township, range, and duplication code that form a unique id.
Township Identifier
TWNSHPLAB
String
25
Township label that is used for cartographic output or web display.
Township Label
STEWARD
String
50
Data steward for the cadastral reference data. The data steward is responsible for the authoritative data
Data Steward
REVISEDDATE
Date
8
The last date of any revision in the data steward defined polygon
Revised Date
STATEABBR
String
2
The two letter postal abbreviation for the state
State Abbreviation
STWRDPLYID
String
50
This is a unique identifier for the stewardship polygon.
Stewardship Polygon ID
STWRDPLYTP
String
50
This is the type of polygon for the metadata at a glance. Examples include PLSS Township, Survey Township, County or City
Stewardship Polygon Type
STWRDLAB
String
50
This is a label for the stewardship polygon for cartographic purposes
Stewardship Label


In the figure below a portion of the Idaho PLSS CadNSDI is shown illustrating an area where there are three data stewards.




The PLSS Township was selected as the initial unit of maintenance for this feature class because typically PLSS data is updated on a Township basis.  

In the image below the polygons are shaded with the Data Steward and labeled with the last revised date.  This figure is from the Mississippi PLSS CadNSDI.



The initial data set reflects the nationwide collection and standardization efforts.  As this data set continues to be updated the analysis and information in the Metadata at a Glance will grow, the unit of maintenance will become better defined, and more granular.  Potential expanded attributes data stewards may consider will be links to contributor geospatial metadata, statements of overall accuracy, and aggregated or compiled date.  Individual users may want to add fields to track download or access dates.  All of these expansions are compliant with the standard intent.

The analysis that can be done and the functions this feature class can support for data set management are numerous, especially in shared maintenance and web service environments.


This feature class is the manifestation of the metadata for aggregated data described in this blog http://nationalcad.blogspot.com/2015/03/metadata-for-aggregated-data-sets.html

Friday, March 6, 2015

PLSS CadNSDI - What’s in the Database

This is the first of a series of documents that will describe the contents of the PLSS CadNSDI data set.

What is the PLSS CadNSDI?

The CadNSDI or the Cadastral Publication Data Standard is the cadastral data component of the NSDI.  This is the publication guideline for cadastral data that is intended to provide a common format, naming conventions, domains, structure and content for cadastral information that can be made available across jurisdictional boundaries, providing consistent and uniform cadastral data to meet business need that includes connections to the source information from the data stewards or data custodians.  The data stewards determine which data are published and should be contacted for any questions on data content or for additional information.  The cadastral publication data is data provided by cadastral data producers in a standard form on a regular basis.  Cadastral publication data has two primary components, land parcel data and cadastral reference data.  It is important to recognize that the publication data are not the same as the operation and maintenance or production data.  The production data is structured to optimize maintenance processes, is integrated with internal agency operations, and contains much more detail than the publication data.  The publication data is a subset of the more complete production data and is reformatted to meet a national standard so data can be integrated across jurisdictional boundaries and be presented in a consistent and standard form nationally.

The PLSS CadNSDI is the standardized form of the CadNSDI containing PLSS data.  This publication format provides a suggested minimum.  It is fully compliant with the intent of the standard for a data producer to include additional feature classes.  For example, there could be an added feature classes for recently monumented corners or mining claim lodes.
Similarly, it is fully compliant with the intent of the standard to add attributes to any feature class.  For example some jurisdictions identify corners that are photo-identifiable in the PLSSCorners Feature Class. It is also compliant to extend the length of any fields in the feature classes.  The field sizes are suggested minimum lengths.

Data sets will contain only available information.  A data steward cannot publish what is not collected.  For example, some states will have township and first division level data; others will also include second division polygons.  Some data sets have PLSSPoints and others do not. Over time it is expected that the content of all data sets will be developed and grow to be more similar in completeness.

The two most common question or comments about this standardized data have been
1.     There are too many features class, attributes, etc.
2.     There are not enough features, attributes, etc.

The Cadastral Subcommittee, through its consensus data standard development process, has agreed that this level of detail supports most business processes and is the best compromise between too many and too few.

What does the PLSS CadNSDI Contain?

The PLSS Cad NSDI database has this structure.



The Parcel Feature Data Set is included but it has not been populated for any of the CadNSDI data sets.  The Cadastral Reference Feature Data Set is the primary focus of the standardized data.

Summary
These are the cadastral reference features that provide the basis and framework for parcel mapping and for other mapping.
Description
These are the cadastral reference features that provide the basis and framework for parcel mapping and for other mapping. This feature data set contains PLSS and Other Survey System data. The other survey systems include subdivision plats and those types of survey reference systems. This feature data set also include feature classes to support the special conditions in Ohio.

The Cadastral Reference Feature Data Set has the following feature classes




Each of these feature classes will be described more fully in other documents. 

The Cadastral Reference Local contains localized data that has not yet been integrated into the standardized data sets.  Typically these are localized data such as a portion of a county or a national forest area, where more accurate information or more complete information has been identified but the data steward has not incorporated this into the standardized data.  It is provide as a reference or as a notice that more current information may be available, although it is not in the standardized form and has not been fully evaluated.  After the localized data is incorporated into the standard it is removed from the Cadastral Reference Local Feature Data Set.  Feature classes will not have standardized names, but will include the localized data contributor in the name.  For example the following is an example from the Michigan PLSS CadNSDI, with BLM, Kent County and Oakland County PLSS Points submitted in the Cadastral Reference Local Feature Data Set.




Tuesday, March 3, 2015

Metadata for Aggregated Data Sets

Aggregated or "rolled up" data is a compilation of locally sourced data assembled into a single, often standardized data set.  This often occurs at the state level such as state standardized address or parcel data.

Many consumers of aggregated data use it as produced and need no additional information about it.  Some users need additional information from local providers or need information about how source data was generated or fitness for use and need locally sourced metadata.

Metadata for a compiled or aggregated data set might describe the compilation process, any data transformation or standardization by the aggregator, and the identity of source contributors.  This could be accomplished with current metadata tools and standards, but it could be lengthy and tedious to maintain.

Another approach could be to develop metadata about each contributor and their source data set and then link those individual metadata records from the compiled metadata.  It may be difficult to associate which record in the compiled file matches which metadata file, and it may be challenging to maintain, but it could be accomplished with the current tools and standard formats.

A third approach, and one that is advocated in the PLSS Cadastral Publication standard, is to develop a spatial feature, termed metadata at a glance, that provides the geometry of the extent for each contributor, the date the source information was added to the compiled data set, the identified custodian or steward for the data, and a link to the contributors metadata about their source data.  The compiled metadata record describes how the data are aggregated and focuses on describing the compiled product, but the metadata at a glance directs users to original sources. 

Using this metadata at a glance approach, the geographic extent for each contributor can be easily viewed and the last update and perhaps an accuracy summary can be seen at a glance.  The compiled data set metadata will focus on the methods and standards of aggregation and compilation.  The currency and contributors will be readily visible and accessible through the metadata at a glance.  Links to source custodians and source data can be found from the metadata at a glance. 


Spatially enabled geospatial metadata.

Thursday, May 29, 2014

Aereo, ABC and Parcel Data

-->
In late April the Supreme Court heard arguments on if Aereo, a company with thousands of small (tiny actually) digital antennas, could collect programs broadcasted over the air, package them and distribute the freely collected information over the internet, for a price.  The data is compiled onto cloud storage and can be consumed for a price on any screen. 

Several news articles called this a disruptive business model  (http://freakonomics.com/2014/04/28/whats-at-stake-in-the-aereo-case-maybe-the-future-of-the-cloud/). The issue at hand was could Aereo take the freely broadcasted signals and sell them through cloud services.  The problem being that ABC and other broadcasters sell those same signals to cable and dish networks for a fairly significant amount.

In my opinion there are many elements of this case that are similar to parcel data, of course.  Many states and counties and cities produce parcel data for their internal use and then “broadcast” or provide the data freely.  As we have seen time and time again, commercial vendors assemble that free data, repackage it, and sell it.

Most recently for example, a firm sent out a notice that users could purchase high-resolution aerial photography for southeastern Ohio (www.emap-int.com).  This is the part of Ohio with the Utica Oil Shale fracking activities.  But this very same product is freely available through the State of Ohio OGROP program http://ogrip.oit.ohio.gov/ProjectsInitiatives/OSIPDataDownloads.aspx.

So why is capturing freely broadcast programming and reselling it disruptive and taking freely available GIS data and reselling it not disruptive?  Maybe neither are disruptive, maybe it’s just the American free market.