This page (revision-50) was last changed on 12-May-2016 15:24 by Chris Martin

This page was created on 17-Sep-2012 14:49 by Alison Bennett

Only authorized users are allowed to rename pages.

Only authorized users are allowed to delete pages.

Page revision history

Version Date Modified Size Author Changes ... Change note
50 12-May-2016 15:24 16 KB Chris Martin to previous
49 11-May-2016 12:47 16 KB Chris Martin to previous | to last
48 21-Apr-2016 16:51 16 KB Stephanie Leith to previous | to last
47 28-Mar-2015 14:46 16 KB Suzy Blake to previous | to last
46 28-Mar-2015 14:44 16 KB Suzy Blake to previous | to last
45 28-Mar-2015 14:35 16 KB Suzy Blake to previous | to last
44 28-Mar-2015 14:32 16 KB Suzy Blake to previous | to last
43 27-Mar-2015 14:16 16 KB Suzy Blake to previous | to last
42 27-Mar-2015 14:15 16 KB Suzy Blake to previous | to last
41 27-Mar-2015 14:10 16 KB Suzy Blake to previous | to last

Page References

Incoming links Outgoing links
SectionB.5
SectionB.5

Version management

Difference between version and

At line 6 changed one line
As information services, HERs make full use of a range of computer software from databases and GIS, to scanning and image handling software, as well as word processing and spreadsheet software. HERs are generally heavily dependent on digital resources. Databases and GIS hold information about monuments and development control processes. Fieldwork reports will usually be held as digital copies which may be held in a digital document storage software and linked to the HER database.
As information services, HERs make full use of a range of computer software from databases and GIS, to scanning and image handling software, as well as word processing and spreadsheet software. HERs are generally heavily dependent on digital resources. Databases and GIS hold information about monuments, archaeological events, sources of information and often development control processes. Fieldwork reports will often be held as digital copies which may be held in a digital document storage software and linked to the HER database.
At line 8 changed one line
HERs will often still have physical documents, book and maps which need to be stored, though storage space for many HERs is continually being reduced, putting even greater emphasis on scanning and other digital solutions. This increases the need for appropriate data standards. Data Standards are covered in more detail in subsequent sections ([B.7|SectionB.7], [B.8|SectionB.8], [B.9|SectionB.9], [C.7|SectionC.7], and [C.10|SectionC.10]).
HERs will often still have physical documents, books and maps which need to be stored, though storage space for many HERs is continually being reduced, putting even greater emphasis on scanning and other digital solutions. This increases the need for appropriate data standards. Data Standards are covered in more detail in subsequent sections ([B.7|SectionB.7], [B.8|SectionB.8], [B.9|SectionB.9], [C.7|SectionC.7], and [C.10|SectionC.10]).
At line 13 changed one line
During the 1980s SMRs were developing bespoke systems in Superfile, dbase or other programming languages based on the [AN32|Glossary#AN32|target='_blank'] recording form promoted by English Heritage. When the OS Archaeology Division transferred to the RCHME in 1983, the OS card index and the National Archaeological Record (NAR) began to be computerised. Recording standards and data dictionaries were actively developed by the RCHME for its own computer records. Following the transfer of the lead role for SMRs to the RCHME in 1989 came the publication by the RCHME and ACAO of ''Recording England's Past'' ([RCHME and ACAO 1993a|Bibliography#RCHME and ACAO 1993a|target='_blank'] and [RCHME and ACAO 1993b|Bibliography#RCHME and ACAO 1993b|target='_blank']), the first document to promote both a data dictionary and reference data lists for use by SMRs.
During the 1980s SMRs were developing bespoke systems in Superfile, dbase or other programming languages based on the [AN32|Glossary#AN32|target='_blank'] recording form promoted by English Heritage. When the OS Archaeology Division transferred to the RCHME in 1983, the OS card index and the National Archaeological Record (NAR) began to be computerised. Recording standards and data dictionaries were actively developed by the RCHME for its own computer records. Following the transfer of the lead role for SMRs to the [RCHME|Glossary#RCHME|target='_blank'] in 1989 came the publication by the RCHME and [ACAO|Glossary#ACAO|target='_blank'] of ''Recording England's Past'' ([RCHME and ACAO 1993a|Bibliography#RCHME and ACAO 1993a|target='_blank'] and [RCHME and ACAO 1993b|Bibliography#RCHME and ACAO 1993b|target='_blank']), the first document to promote both a data dictionary and reference data lists for use by SMRs.
At line 15 changed one line
During the 1990s much work was undertaken by the RCHME's Data Standards Unit (now part of English Heritage) in partnerships with English Heritage and ALGAO to develop the data model for recording SMR-type information. The event-monument-source data model began to be introduced in the early 1990s when it was adopted by the RCHME for its MONARCH database, by English Heritage in its data standard for urban archaeological databases and by Northamptonshire SMR and a few others. Throughout the 1990s there was considerable discussion about this data model led by Glenn Foard, Steve Catney, Neil Lang, Nigel Clubb and Steve Stead. The establishment of the Data Standards Working Party, now known as FISH (the Forum for Information Standards in Heritage), a group dedicated to developing data standards for monument inventories, can be seen as a direct result of the general climate of discussion and debate (see also [B.8|SectionB.8]).
During the 1990s much work was undertaken by the RCHME's Data Standards Unit (now part of [Historic England|Glossary#Historic England|target='_blank']) in partnerships with English Heritage and [ALGAO|Glossary#ALGAO UK|target='_blank'] to develop the data model for recording SMR-type information. The event-monument-source data model began to be introduced in the early 1990s when it was adopted by the RCHME for its [MONARCH|Glossary#MONARCH|target='_blank'] database, by English Heritage in its data standard for urban archaeological databases and by Northamptonshire SMR and a few others. Throughout the 1990s there was considerable discussion about this data model led by Glenn Foard, Steve Catney, Neil Lang, Nigel Clubb and Steve Stead. The establishment of the Data Standards Working Party, now known as [FISH|Glossary#FISH|target='_blank'] (the Forum for Information Standards in Heritage), a group dedicated to developing data standards for monument inventories, can be seen as a direct result of the general climate of discussion and debate (see also [B.8|SectionB.8]).
At line 17 changed one line
The modern generation of HER databases aims to comply with the MIDAS data standard published by the RCHME in 1998 ([Lee 1998|Bibliography#Lee 1998|target='_blank']). These databases enable information about monuments, events, sources and the management process to be recorded with equal weight. Nationally agreed reference datasets, such as the English Heritage Thesaurus of Monument Types and other lists published in INSCRIPTION, are incorporated into the databases (see also [B.7.3|http://archaeologydataservice.ac.uk/ifp/Wiki.jsp?page=SectionB.7#section-SectionB.7-B.7.3MIDASAndINSCRIPTION]). Features of the systems, such as pull-down lists and validated entry to key index fields, help to ease the adoption of data standards and promote consistency between HER systems. In general professional applications developers have produced these systems and, as a result, they incorporate features such as data-input forms, standard queries and reports that ease their day-to-day use by HER officers.
The modern generation of HER databases aim to comply with the [MIDAS|Glosssary#MIDAS|target='_blank] data standard published by the RCHME in 1998 ([Lee 1998|Bibliography#Lee 1998|target='_blank']). These databases enable information about monuments, buldings, landscapes, events, sources and the management process to be recorded with equal weight. The HBSMR software developed by exeGesIS SDM Ltd in partnership with the RCHME and ALGAO is one example of a MIDAS-compliant database that is now being used by many HERs. Other HER managers have bespoke systems based on MIDAS which have either been developed by IT consultants or in house by the host authority's own IT department. These can be web or server-based solutions which use a variety of software applications (e.g. Microsoft Access, [Oracle|Glossary#Oracle Database|target='_blank'] or [SQL Server|Glossary#SQL Server|target='_blank']) and are often networked to allow access to multiple users. Such database systems are now commonly linked to GIS and often also support links to other digital objects such as images, reports and research data.
At line 19 changed one line
One would anticipate that a modern HER database would be capable of being linked to GIS and would support links to other digital objects such as images and research data. The HBSMR software developed by exeGesIS SDM Ltd in partnership with the RCHME and ALGAO is one example of a MIDAS-compliant database that is now being used by many HERs. Other HER managers have worked with IT consultants such as Oxford ArchDigital to develop HER systems based on MIDAS.
In deciding which which database platform to use HER managers will need to consider what functionailty they require as well as issues such as stability of software programs, performance, robustness, backup management and security. Server-based relational database management systems([RDBMS|Glossary#RDBMS|target=_blank']) such as SQL Server or Oracle will generally speaking suit very large databases with a high number of concurrent users, as they also have better stability, performance, security and backup procedures. However, desktop applications are generally easier to use, give more control over the database and have a cheaper license costs, perhaps suiting smaller databases with fewer concurrent users. exeGesIS SDM Ltd has developed a SQL Server backed version of their HBSMR software.
At line 21 changed one line
A decision may also need to be made as to which database platform to use. Some HERs use web-based platforms, such as Oxford ArchDigital’s TOAD system. Many HER databases use software applications such as Microsoft Access or other database packages designed primarily for desktop use, such as exeGesIS’s HBSMR software. Where the database is networked to allow multiple access to shared files for users, the host organisation’s IT support can be distrustful of the stability of software programs such as these, and be reluctant to provide support. Their concerns centre on issues of performance, robustness, backup management and security. HER managers may find themselves pressurised to move to a server-based relational database management system (RDBMS) such as SQL Server or Oracle. Generally speaking, server-based RDBMSs will suit very large databases with a high number of concurrent users, as they also have better stability, performance, security and backup procedures. However desktop applications are generally easier to use, give the HER manager more control over the database and have a cheaper license cost, suiting smaller databases with fewer concurrent users. exeGesIS SDM Ltd has developed a SQL Server backed version of their HBSMR software.
As in England the four Welsh Historic Environment Records had their origins in paper records in the 1970s, but from the early 1980s moved through various computer driven systems until the mid 2000s. In 2004 the four Welsh Archaeological Trusts, who curate the HERs, embarked on a collaborative venture which culminated in an open source, MIDAS compliant, web based database system, running in MySQL, having an integrated web GIS and image management system, to accommodate all four Regional HERs. The software, which continues to develop, has an integrated public front end, accessible through the [Archwilio|http://www.archwilio.org.uk|target='_blank'] web site, and also delivers HER data through an android app. The software has the advantage of general accessibility through any internet browser and no ongoing licensing costs. The system is now managed by the [HEROS|http://heros.software|target='_blank'] (Historic Environment Record Open System) partnership.
At line 23 changed one line
Scottish SMRs as a rule received their core data as a download from the National Monuments Record for Scotland. Software was either developed in house, or latterly has been purchased from commercial software companies. The biggest issue faced in Scotland was getting the Scottish local authorities to accept the need for development of an SMR/HER in the absence of a statutory requirement, East Dunbartonshire and City of Dundee are still without this essential level of provision. Historic Scotland is currently working with the Councils to address this problem.
Scottish SMRs as a rule received their core data as a download from the National Monuments Record for Scotland. Software was either developed in house, or latterly has been purchased from commercial software companies.
At line 25 added 4 lines
Nationally agreed terminology ([thesauri|Glossary#Thesaurus|target='_blank']) can be incorporated into database systems (through features such as controlled terminology fields, standard queries and reports), to facilitate their day-to-day use by HER officers and ensure consistency of recording (see [B.7|SectionB.7]). The terminology is now largely the responsibility of FISH and the [FISH Terminology Working Group|Glossary#FISH Terminology Working Group|target='_blank'], although some of the word-lists are managed behalf of FISH by Historic England. Some of the most commonly used are available to view online via the [Historic England website|http://thesaurus.historicengland.org.uk/|target='_blank'], or are downloadable from the [FISH website|http://fishforum.weebly.com/download-fish-terminology.html|target='_blank'] in a variety of formats including PDF, XLS and CSV files.
More recently some of the cultural heritage thesauri and vocabularies produced by Historic England, the [RCAHMS|Glossary#RCAHMS|target='_blank'], the [RCAHMW|Glossary#RCAHMW|target='_blank'], the [ADS|Glossary#ADS|target='_blank'] and the University of South Wales have been made freely available as [Linked Open Data|Glossary#Linked Data|target='_blank'] as an outcome of the [AHRC|Glossary#AHRC|target='_blank'] funded [SENESCHAL Project|Glossary#SENESCHAL|target='_blank']. The project aims to make vocabularies available online as [Semantic Web|Glossary#Semantic Web|target='_blank'] resources, beginning with current [Heritage Data|http://www.heritagedata.org/blog/|target='_blank'], with the intention of making other vocabularies available over time.
At line 28 changed one line
Popular image management software combines tools for cataloguing image files with tools for reproducing images at a variety of scales. Digital image cataloguing is a rapidly developing field and it is worth ensuring that whatever software is used can support the emerging cataloguing standards. In some circumstances this may mean following formal images standards such as the Visual Resources Association Core data standard, especially if the images within the HER form part of a wider image collection held by a local authority ([Grout et al 2000|Bibliography#Grout et all 2000|target='_blank']). If the HER is involved in creating images it makes sense for the master image to be captured at high resolution in terms of colour depth and pixels, even though the file sizes will be large. This is because many image-processing techniques effectively lose information, either through loss of true colour depth or through sampling of pixels. The master copy can be used to retain all this information, while flexible derivatives may be used for different purposes. This does however accentuate the need for strict file naming conventions which image management software should facilitate.
Popular image management software combines tools for cataloguing image files with tools for reproducing images at a variety of scales. Digital image cataloguing is a rapidly developing field and it is worth ensuring that whatever software is used can support the emerging cataloguing standards. In some circumstances this may mean following formal image standards such as the [Visual Resources Association Core data standard|http://www.loc.gov/standards/vracore/|target='_blank'], especially if the images within the HER form part of a wider image collection held by a local authority ([Grout et al 2000|Bibliography#Grout et all 2000|target='_blank']). If the HER is involved in creating images it makes sense for the master image to be captured at high resolution in terms of colour depth and pixels, even though the file sizes will be large. This is because many image-processing techniques effectively lose information, either through loss of true colour depth or through sampling of pixels. The master copy can be used to retain all this information, while flexible derivatives may be used for different purposes. This does however accentuate the need for strict file naming conventions which image management software should facilitate.
At line 32 changed 2 lines
!!B.5.3 Archaeological science (see also [B.4.4|http://archaeologydataservice.ac.uk/ifp/Wiki.jsp?page=SectionB.4#section-SectionB.4-B.4.4InclusionOfArchaeologicalScienceDataInHERs])
Many HERs also have access to a range of scientific data, and again the processes of education and management are facilitated where these can be integrated into the HER database. Different types of information may be linked in a variety of different ways: geophysical data for example may be integrated into the GIS; microscopy and radiographs be linked to an image management system and scientific reports linked through ‘grey literature reports’ and the like. Much scientific data, especially site-based recording should in fact be considered as any other archaeological intervention. Tools like OASIS and the FISH toolkit provide mechanisms by which such data can be supplied to HERs. These standards are discussed in more detail in section [B.6|SectionB.6], [B.7|SectionB.7].
!!B.5.3 Archaeological science (see also [B.4.4|SectionB.4#B.4.4InclusionOfArchaeologicalScienceDataInHERs])
Many HERs also have access to a range of scientific data, and again the processes of research, education and management are facilitated where these can be integrated into the HER database. Different types of information may be linked in a variety of different ways: geophysical data for example may be integrated into the GIS; microscopy and radiographs be linked to an image management system and scientific reports can be incorporated into grey literature or other published reports or linked directly as a source in their own right. Much scientific data, especially site-based recording should in fact be considered as any other archaeological information. Tools like [OASIS|http://oasis.ac.uk/pages/wiki/Main|target='_blank'] and the [FISH toolkit|http://fishforum.weebly.com/fish-toolkit.html|target='_blank'] provide mechanisms by which such data can be supplied to HERs. These standards are discussed in more detail in section [B.6|SectionB.6], [B.7|SectionB.7].
At line 35 changed one line
A number of scientific disciplines have begun to experiment with very large, dedicated computing infrastructures to process, package and distribute data derived from sensitive recording devices. Devices like radio telescopes or experimental reactors produce prodigious quantities of data that is of interest to small but very specialised audiences around the world, who require dedicated resources to share and explore their data sets. These infrastructures combine protocols for the exchange of information with an investment in hardware, and are intended for foster a new generation of ‘E-science’ or ‘E-research’. For example, a programme called UKLight is dedicated providing dark-fibre networks between a select group of research centres in the UK, while in the US a ‘National Lamba Rail’ is being constructed to connect the major research institutions. Such developments have had little or no impact on archaeology so far but are likely to become more important in the future. The development and refinement of data standards are likely to be pre-requisite for participating in such systems.
A number of scientific disciplines have begun to experiment with very large, dedicated computing infrastructures to process, package and distribute data derived from sensitive recording devices. Devices like radio telescopes or experimental reactors produce prodigious quantities of data that is of interest to small but very specialised audiences around the world, who require dedicated resources to share and explore their data sets. These infrastructures combine protocols for the exchange of information with an investment in hardware, and are intended for foster a new generation of ‘E-science’ or ‘E-research’. For example, a programme called UKLight is dedicated providing dark-fibre networks between a select group of research centres in the UK, while in the US a ‘National Lambda Rail’ is being constructed to connect the major research institutions. Such developments have had little or no impact on archaeology so far but are likely to become more important in the future. The development and refinement of data standards are likely to be pre-requisite for participating in such systems.
At line 37 changed 2 lines
!!B.5.4 OASIS and data exchange procurement
The OASIS project was developed in response to the need to provide a single unified index to archaeological investigations, a means of accessing the associated grey literature, and an online method by which the index could be maintained. A major achievement of the project was to integrate the AIP records with the Excavation Index to provide a single concorded list, in 1998. The concordance programme delivered a fully unified record for archaeological interventions in England. Where a fuller electronic copy of a report is available on-line, either on the ADS server or on the web site of the contractor or HER it is possible to include the URL of the resource as a bibliographic reference. As curators begin to require deposition of digital reports and as they make them available on the Internet it will be possible to build up an online virtual library of grey literature, directly linked from the index. The OASIS project, FISH toolkit and allied data standards are discussed in more detail in sections [C.7.3|http://archaeologydataservice.ac.uk/ifp/Wiki.jsp?page=SectionC.7#section-SectionC.7-C.7.3OASISOnLineAccesSToTheIndexOfArchaeologicalInvestigationS] and [B.7|SectionB.7].
!!B.5.4 OASIS (see also [C.7.3|SectionC.7#C.7.3 OASIS (On-line AccesS to the Index of archaeological investigationS)])
The OASIS project was developed in response to the need to provide a single unified index to archaeological investigations, a means of accessing the associated grey literature and as an online method by which the index could be maintained. The index relates largely to developer funded fieldwork, but also allows the indexing of fieldwork undertaken by local societies, volunteers and academic institutions. A major achievement of the project was to integrate the [AIP|Glossary#AIP|target='_blank'] records with the [Excavation Index|Glossary#Excavation Index|target='_blank'] to provide a single concorded list, in 1998. The concordance programme delivered a fully unified record for archaeological interventions in England.
The OASIS data capture form was originally designed to help in the flow of information from data producers, such as contracting units and community groups, through to local and national data managers, such as HERs and NMRs. The resulting information can be validated by the relevant NMR (English Heritage's Excavation Index and the RCAHMS' [CANMORE|Glossary#Canmore|target='_blank'] records) or HER and is passed onto the ADS for inclusion in its online searchable catalogue [ArchSearch|http://archaeologydataservice.ac.uk/archsearch/browser.jsf|target='_blank'] and either provide direct web links through to the grey literature reports or at least act as a pointer to the physical holding place of a report or archive. Grey literature reports are also being made available directly through the ADS [Grey Literature Library|http://archaeologydataservice.ac.uk/archives/view/greylit/|target='_blank'], where there are now over 30,000 unpublished reports available.
The OASIS system is currently being reviewed by ADS with the aim of bringing the underlying technology up to date and provide a more flexible system for the variety of individuals and organisations who use it, from contractors and curators to museums and local societies. The OASIS project is discussed in more detail in section [C.7.3|SectionC.7#C.7.3 OASIS (On-line AccesS to the Index of archaeological investigationS)].
!!B.5.5 GIS (see also [C.11|SectionC.11] and [B.6|SectionB.6])
Almost all HERs now make use of Geographical Information Systems (GIS) which allow the capture, storage, manipulation, analysis, management and presentation of spatial information relating to the historic environment. These often link directly to the HER database but can also be stand-alone or integrated into corporate GIS systems. The most commonly used software are ArcGIS (ESRI) and MapInfo (Pitney Bowes), although there are numerous other systems available. More recently improved reliability and the development of functionality within free to use open source GIS software (for example systems such as QGIS) has meant that these are beginning to offer a viable alternative. More detail on the use of data in HERs can be found in section [C.11|SectionC.11] and [B.6|SectionB.6].
This page (revision-50) was last changed on 12-May-2016 15:24 by Chris MartinTop