This page (revision-23) was last changed on 31-Mar-2015 17:23 by Alison Bennett

This page was created on 17-Sep-2012 14:56 by Alison Bennett

Only authorized users are allowed to rename pages.

Only authorized users are allowed to delete pages.

Page revision history

Version Date Modified Size Author Changes ... Change note
23 31-Mar-2015 17:23 14 KB Alison Bennett to previous
22 28-Mar-2015 16:48 14 KB Suzy Blake to previous | to last
21 28-Mar-2015 16:36 14 KB Suzy Blake to previous | to last

Page References

Incoming links Outgoing links
SectionB.7
SectionB.7

Version management

Difference between version and

At line 1 changed one line
[{TableOfContents title='B.7 Management of data standards - FISH'}]
[{TableOfContents title='B.7 Data standards for the Historic Environment'}]
At line 3 changed 2 lines
!!!B.7 Management of data standards - FISH
Management and development of data standards for the historic environment is co-ordinated through FISH, the Forum on Information Standards in Heritage (see [http://fishforum.weebly.com/]). All of the major heritage bodies in the UK, including ALGAO, are involved in the steering committee of the Forum, which meets twice a year.
!!!B.7 Data standards for the Historic Environment
!!B.7.1 What are data standards?
Data standards can be simply defined as an agreed statement of "what information should be recorded, in what manner, to achieve a particular objective". The objectives for historic environment managers are set out elsewhere in this manual. This section describes;
* the value that shared data standards add to historic environment recording,
* data standards that are in current use,
* how HER officers can get involved in shaping the future direction of data standards to ensure that they meet the needs of the profession.
At line 10 added 22 lines
!!B.7.2 Why are data standards needed?
Collection and recording of historic environment information is an expensive, and in some cases unrepeatable, process. It is essential that the information contained within HERs can be readily retrieved and understood by anyone and increasingly important that data from different HERs can be compared. Data standards ensure that information is recorded in a consistent and retrievable way so that the maximum benefit for the users of data is obtained from the investment.
The benefits offered include:
* __Reliability__: As standard procedures are tried and tested, if they are sensibly applied they will work well.
* __Consistency__: Data standards promote consistency in recording of information, which ensures that records can be retrieved easily, so that all known relevant information is available when needed.
* __Expertise__: Historic environment data standards incorporate the accumulated expertise and experience of several decades. Their adoption builds this experience into an information system, reducing the risk associated with developing a system from scratch.
* __Compatibility__: No one organisation holds all the data relating to a particular site or area. There are usually other organisations with an interest who may have useful data. When recorded to common standards, data held in different databases can be shared and exchanged much more easily. This is increasingly important as new ways of accessing data remotely are developed.
* __Communication__: Data standards assist in communication of concepts involved in the historic environment both between HER staff and between HER staff and their software consultants and organisations within and beyond the sector.
* __Benchmarking__: Data standards perform a crucial role in providing an independent benchmark against which HER data quality can be assessed.
* __Staff skills__: Adoption of common data standards enable staff to become familiar with systems more quickly when changing jobs and enable employers to recruit staff with relevant skills. They also facilitate organisation of training through events such as conferences and seminars.
* __Information system development__: No information system lasts indefinitely. At some point data needs to be migrated from one system to its successor. Standards simplify the process of specification of new information systems and migration is greatly simplified if standards are consistent within the data.
!!B.7.3 MIDAS Heritage and FISH Terminology
This section describes the purpose of the central standard for historic environment recording (MIDAS Heritage) and the use of standardised terminology in its application.
MIDAS Heritage is a British cultural heritage standard for recording information on buildings, monuments, archaeological sites, shipwrecks and submerged landscapes, parks and gardens, battlefields, artefacts and ecofacts. The data standard suggests the minimum level of information needed for recording heritage assets and covers the procedures involved in understanding, protecting and managing these assets. It also provides guidelines on how to support effective sharing of knowledge, data retrieval and long-term preservation of data.
The use of standardised terminology alongside MIDAS Heritage allows consistent indexing practice which facilitates accurate and fast information retrieval. The main terminology used by HERs was originally held together as a national heritage reference dataset known as ['INSCRIPTION'|Glossary#INSCRIPTION|target='_blank'] which comprised of a series of [wordlists|Glossary#Wordlist|target='_blank'] and [thesauri|Glossary#Thesaurus|target='_blank'] developed by various heritage bodies, both national and regional. These word lists and thesauri are now managed and maintained by the national heritage organisations and the [FISH Terminology Working Group|http://fishforum.weebly.com/fish-terminology-working-groups.html|target='_blank'].
Further information about these are available online via the [Forum on Information Standards in Heritage (FISH) website|http://fishforum.weebly.com/|target='_blank'].
At line 7 changed 2 lines
[{Image src='fig9.png' width='750px' alt='Figure 9: The FISH web site www.fish-forum.info is the starting point for finding out about data standards for the historic environment.'}]
''Figure 9: The FISH web site [http://fishforum.weebly.com/] is the starting point for finding out about data standards for the historic environment.''
[{Image src='fig5.jpg' alt='Figure 7: The logo for the Forum on Information Standards in Heritage.'}]
''Figure 7: The logo for the Forum on Information Standards in Heritage.''
At line 11 changed 5 lines
!!B.7.1 How to get involved
There are several ways in which HER officers can become involved in the work of FISH
!E-mail discussion list
The easiest way to get involved is to join the free open membership e-mail discussion list run by FISH (see the website for details of how to join). List members may ask questions, raise issues that require attention, seek advice and will receive news about data standards issues, conferences and meetings. The e-mail discussion list is also host to ‘e-conferences’ - specially focused discussion on particular standards related topics. These are announced in advance on the list.
!MIDAS Heritage
Developed from data standardisation work in the 1980s and early 1990s, the first edition of the standard, [MIDAS – A Manual and Data Standard for Monument Inventories|Bibliography#Lee 1998|target='_blank'], was published by the Royal Commission on the Historical Monuments of England (RCHME) in 1998. The organisation merged with English Heritage (now Historic England) in 1999 and development work in 2004 extended MIDAS to cover GIS type data as well as watercraft and aircraft recording. An updated version, MIDAS Heritage, was published in 2007 in collaboration with other UK heritage organisations including the [RCAHMS|Glossary#RCAHMS|target='_blank'] and [RCAHMW|Glossary#RCAHMW|target='_blank']. The standard was developed for and on behalf of the FISH and is maintained and updated by them in collaboration with Historic England, RCAHMS, RCAHMW and other contributing heritage organisations. MIDAS Heritage is available as a free downloadable electronic from the [Historic England website|https://content.historicengland.org.uk/images-books/publications/midas-heritage/midas-heritage-2012-v1_1.pdf/|target='_blank'].
At line 17 changed 5 lines
!Candidate term submission
As HERs expand the scope of their content, there is a continuing need for the addition of new terms to the existing wordlists. HER officers can get directly involved in standards development by submitting candidate terms – suggested additions to one of the controlled vocabularies or thesauri listed in INSCRIPTION. The different vocabularies are maintained by a network of different working groups and standards bodies. Details of the appropriate contact for submission of candidate terms and information about special procedures for submitting terms will appear in the INSCRIPTION website. However in general candidate term submission will involve:-
*Identifying a term or an idea that is not covered by the existing list.
*Describing when the candidate term should be used (a ‘scope note’).
*Providing background information, such as examples of record where the candidate term would be appropriate, or published sources which use the term.
%%image-caption
[{Image src='MIDAS_Heritage_logo.png' alt='Figure 8: The logo of MIDAS Heritage, the national data standard for the content of historic environment records.'}]
''Figure 8: The logo of MIDAS Heritage, the national data standard for the content of historic environment records.''
/%
At line 23 changed 2 lines
!Peer review participation
FISH, as the co-ordinating body for the development of data standards, is particularly concerned to ensure that new data standards meet the needs of the historic environment sector. To do this newly developed standards will in most cases be circulated in draft form for peer review. This is an opportunity for HER staff to identify concerns, express support and to play a part in shaping an emerging standard. All peer reviews will be announced via the FISH email discussion list (and often via other email discussion lists). It is vital that HER staff participate in this process. Only by participation can effective and relevant data standards be developed.
__''What is in MIDAS Heritage?''__
At line 26 changed one line
__Relevant links__
MIDAS Heritage is a content standard in that it defines the individual facts or ‘units of information’ that should be included in a standardised record of, for example, a monument or archaeological event. It is also an open data standard, in that although information schemes are described the exact structure in which data is to be recorded is not defined, so that MIDAS Heritage can be applied to a range of information systems. It is set out as a series of closely integrated data standards, rather than one single standard and is designed to be used in conjunction with separate standards covering specific types of applications or projects, which will give the necessary data elements. Examples include [SPECTRUM|http://www.collectionstrust.org.uk/spectrum/the-spectrum-standard|target='_blank'] (for artefacts), [UK Gemini Discovery Metadata Standard|http://www.agi.org.uk/join-us/agi-groups/standards-committee/uk-gemini|target='_blank'] (for GIS), and [CIDOC Conceptual Reference Model|http://cidoc-crm.org/|target='_blank'] (for concepts and relationships). MIDAS Heritage complies with the [UK e-Government Metadata Standard|http://www.esd.org.uk/standards/egms/|target='_blank'] (e-GMS), which is based on [Dublin Core|Glossary#Dublin Core|target='_blank'].
At line 28 changed one line
[www.fish-forum.info|www.fish-forum.info] the website for the Forum on Information Standards in Heritage.
The MIDAS Heritage data standard has a three-level structure with six main themes, each containing several Information Groups, which in turn contain a number of Information Units.
At line 30 changed 7 lines
From this page you can:
*Consult current versions of the FISH standards [MIDAS|https://www.jiscmail.ac.uk/cgi-bin/filearea.cgi?LMGT1=FISH&a=get&f=/MIDAS_Heritage/web_midasupdates.htm] and [INSCRIPTION|http://www.fish-forum.info/inscript.htm]
*Participate in discussion via our [email discussion list|http://www.jiscmail.ac.uk/cgi-bin/wa.exe?SUBED1=fish&A=1] run by JISCmail.
*View [recent discussion|http://www.jiscmail.ac.uk/lists/fish.html] and [download files|http://www.jiscmail.ac.uk/files/FISH/] from the forum archives.
*Find out more about the [contributing organizations|http://www.fish-forum.info/contrib.htm] that direct the work of the forum.
*View our [Terms of Reference|http://www.fish-forum.info/terms.htm]
*View [what's new from FISH|http://fishforum.weebly.com/news.html]
* __Level 1: Themes__ - Describe the main subject areas at the broadest level
* __Level 2: Information Groups__ - Outline the specific standard which should be included in any entry covering a particular subject
* __Level 3: Units of Information__ - Provide the basic 'facts' or items that make up an entry
At line 38 changed one line
See also [ADS Guides to Good Practice|http://guides.archaeologydataservice.ac.uk/]
The six main themes and the information groups within each are set out in the diagram below:
At line 40 changed 3 lines
\\
%%panel-box
!Panel 4: Tools for indexing and retrieval: 1. Wordlists
%%image-caption
[{Image src='MIDAS_Themes.png' alt='Figure 9: An overview of the structure of the MIDAS Heritage themes and information groups.'}]
''Figure 9: An overview of the structure of MIDAS Heritage themes and information groups.''
/%
At line 44 changed one line
Westshire HER designed a database and transferred its records from the original card index. The card index had built up over a number of years and was maintained by several different members of staff. As part of the computerization the HER officer decided to standardise the terminology used to index site types in the database.
__''Who should use MIDAS Heritage?''__
At line 46 changed one line
As each site was recorded the site type was checked against the HER's wordlist. If the site type did not appear on the wordlist it was added and the list amended. Where a site type already existed on the list the HER Officer checked the consistency of the spelling and removed any abbreviations prior to indexing the type in the __MONUMENT TYPE__ field within the new database record.
MIDAS Heritage is intended for a wider audience than just the HER community and is recommended reading for anyone involved in inventory projects. Worked examples in the manual cover, for example, its application to academic research databases and voluntary sector thematic surveys. The same requirement for standards exists for these other sectors if the maximum value is to be obtained from their efforts. This is of course particularly important if the intention exists to deposit the results of these surveys with the local HERs.
At line 48 changed one line
Below is a sample of the monument types that had been recorded on the HER card index.
In addition to the data standard itself, MIDAS includes a manual to assist those managing and maintaining an inventory of the historic environment. HER staff should not only be familiar with MIDAS themselves but should also recommend its use to local societies working in their area.
At line 50 removed 8 lines
|Altar|Tomb Barrow
|Barrow|Round Cemetery
|Disc Barrow|Tumulus
|Gravestone|Graveyard
|Headstone|L. Barrow
|Long Barrow|Mausoleum
|R.C. Cemetery|Round-Barrow
|Tomb|Tombstone
At line 59 changed 6 lines
The HER Officer rewrote the wordlist taking the decision to use rules to ensure that the wordlist isconsistent. These were:
*Natural word order
*No abbreviations
*No punctuation
*Include Preferred and Non-Preferred terms
The revised wordlist that was developed for the computerization appears below. Preferred terms appear in upper case, Non-Preferred in mixed case.
!FISH Terminology
Effective searching of HERs relies on the quality of indexing. Good indexing ensures effective retrieval of records relevant to a search; poor indexing means that records will be overlooked.
At line 66 changed 9 lines
|ALTAR TOMB| |
|BARROW|use for| Tumulus
|CEMETERY|use for| Graveyard, R.C. Cemetery
|DISC BARROW| |
|GRAVESTONE|use for|Headstone
|LONG BARROW|use for|L.Barrow
|MAUSOLEUM| |
|TOMB|use for|Tombstone
|ROUND BARROW|use for|Barrow, Round
Most HER information systems support indexing using standardised terminologies built into the actual software. These include simple lists, such as types of legal protection for a monument, more complex hierarchical lists such at the [Thesaurus of Event Types|Glossary#Thesaurus of Event Types|target='_blank'] or full indexing thesauri such as the English Heritage [Thesaurus of Monument Types|Glossary#Thesaurus of Monument Types|target='_blank'] (see [Panel 4|SectionB.8#Panel4ToolsForIndexingAndRetrieval1.Wordlists] and [Panel 5|SectionB.8#Panel5ToolsForIndexingAndRetrieval2.Thesauri] in [Section B.8|SectionB.8] for examples of wordlists and heirarchical thesauri).
At line 76 changed one line
The new wordlist included all the old terms but only those which were Preferred could be used to index in the new database. Any Non-Preferred terms were included as a guide to which term to use for indexing.
The main terminologies ([wordlists|Glossary#Wordlist|target='_blank'] and [thesauri|Glossary#Thesaurus|target='_blank']) used by HERs were originally held together as a national heritage reference dataset known as ['INSCRIPTION'|Glossary#INSCRIPTION|target='_blank']. These are now managed and maintained by the national heritage organisations and the [FISH Terminology Working Group|http://fishforum.weebly.com/fish-terminology-working-groups.html|target='_blank'].
At line 78 changed 2 lines
The computer records were indexed using the new wordlist and as a result information retrieval was improved. A request from a user for all information about Barrows could now be answered by a relatively simple search of the database, rather than following a long trawl through the card index.
/%
These worlists and thesauri are recommended for use in conjunction with MIDAS Heritage units of information. For each case where MIDAS Heritage recommends the use of a controlled terminology, a suitable indexing terminology has been developed by one or more of the partners in the Forum on Information Standards in Heritage. Details about each of the available wordlists and thesauri, along with downloadable versions (in either PDF and CSV format) can be found on the [FISH website|http://fishforum.weebly.com/download-fish-terminology.html|target='_blank']. They are also available to browse online via the [Historic England website|http://thesaurus.historicengland.org.uk/frequentuser.htm|target='_blank'].
At line 81 removed 3 lines
\\
%%panel-box
!Panel 5: Tools for Indexing and retrieval: 2. Thesauri
At line 85 changed 6 lines
Like a wordlist, a thesaurus is used to standardise terminology and help the user to choose terms to enter into database fields. However, unlike a wordlist, a thesaurus:
*allows terms, related by a similar subject, to be grouped together into hierarchies and crossreferenced to other groups of terms which may be relevant to the subject.
*provides the user with a single Preferred term to use where there is a choice of terms with the same or similar meaning e.g. __BARROW__ use for Tumulus.
*through the use of hierarchies, allows terms to be selected at a general or specific level, depending on the level of indexing required.
*is a dynamic tool, which can be developed by the addition, amendment and deletion of terms,
relationships or hierarchies as dictated by individual needs.
!!B.7.4 The FISH Interoperability Toolkit
Interoperability is the ability to reuse data created in one software application in another. It is essential if efficient sharing of data between HERs and their users is to become a reality. Interoperability relies on data standards that are understood and shared within the HER community such as MIDAS Heritage and FISH Terminologies, plus technical standards to support the creation of data files that different software packages will be able to process.
At line 92 changed 3 lines
__Example__
Westshire HER acquired the HBSMR Software from exeGesIS SDM Ltd and migrated all their records
from the old database. A similar search to that carried out using terms from the wordlist can now be done using the thesaurus built into the software.
To provide HER managers and their IT advisors with the technical tools needed to make interoperability possible the Forum on Information Standards in Heritage have developed a ‘toolkit’ of protocols and formats aimed at HERs and their technical advisors. It is based upon MIDAS Heritage and incorporates the HER benchmark Level 1 standard. Online validation of data against controlled terminologies is supported.
At line 96 changed one line
This allows the user to either search for a specific term, e.g. __ROUND BARROW__ or to carry out a search using the "Broad Term" of __BARROW__ and asking for all the records indexed with its "Narrow Terms". This search would retrieve any records indexed with any of the terms listed below, but would only require one search instead of twenty!
Whereas MIDAS Heritage and FISH Terminologies are aimed at HER staff, the Toolkit is aimed at IT specialists and software developers. HER staff should familiarise themselves with the functions that the Toolkit supports, but are advised to contact their IT support staff for discussion of how the Toolkit might be implemented in their systems.
At line 98 changed 20 lines
*BARROW
**BANK BARROW
**CHAMBERED BARROW
***CHAMBERED LONG BARROW
***CHAMBERED ROUND BARROW
**D SHAPED BARROW
**LONG BARROW
***CHAMBERED LONG BARROW
***OVAL BARROW
**POND BARROW
**RING BARROW
**ROUND BARROW
***BELL BARROW
***BELL DISC BARROW
***BOWL BARROW
***CHAMBERED ROUND BARROW
***DISC BARROW
***PLATFORM BARROW
***SAUCER BARROW
**SQUARE BARROW
The toolkit consists of four main components which check, map and verify content before exchange of textual and geographical information between systems.
At line 119 changed 2 lines
Using a thesaurus also allows the indexer the flexibility of indexing at either the general level (where the only information known is that a __BARROW__ exists) or the more specific level (where investigation shows the monument to be a __CHAMBERED ROUND BARROW__).
/%
* ''The XML Mapping Tool''
This tool allows the user to upload their own non-MIDAS XML schema (or sample file) use a visual mapping tool to map between this file and MIDAS XML and then carry out a transformation. The mapping itself is stored in an XSL file under a user specific login for later reuse in this system or it can be exported to allow the transformation to be carried out elsewhere. This tool currently requires an additional Login process.
* ''The Toolkit Data Validator''
This online application validates the content of MIDAS XML files. The presence or absence of data required by standards such as the English HER Level 1 Benchmark is checked. Reports are issued on compliance and a watermark is embedded in a new XML file for download.
* ''The Concordance Tool''
This online application parses two MIDAS XML files to find updated records. Reference and New XML files are checked for the updated or new records. Reporting consists of description and two automatically generated XML files. The first one consists of only the differences between the two files (i.e. new or updated records only) and the second one consists of Reference XML file plus new records and updated records.
* ''The Geospatial Tool''
This tool reads a valid XML file, finds coordinates in OSGB36 format and adds additional spatial elements for the same coordinates in WGS84 format. If the original coordinate format is WGS84 decimal degrees then additional elements in OSGB36 are added
Further information on the FISH Interoperability Toolkit can be accessed online at [http://archaeologydataservice.ac.uk/fishtoolkit/|http://archaeologydataservice.ac.uk/fishtoolkit/|target='_blank'] or [http://fishforum.weebly.com/fish-toolkit.html|http://fishforum.weebly.com/fish-toolkit.html|target='_blank'].
This page (revision-23) was last changed on 31-Mar-2015 17:23 by Alison Bennett Top