## **Abstract** The dataset was derived by the Bioregional Assessment Programme. This dataset was derived from multiple datasets. You can find a link to the parent datasets in the Lineage Field in this metadata statement. The History Field in this metadata statement describes how this dataset was derived. The difference between NSW Office of Water GW licences - CLM v2 and v3 is that an additional column has been added, 'Asset Class' that aggregates the purpose of the licence into the set classes for the Asset Database. Also the 'Completed_Depth' has been added, which is the total depth of the groundwater bore. These columns were added for the purpose of the Asset Register. The aim of this dataset was to be able to map each groundwater works with the volumetric entitlement without double counting the volume and to aggregate/ disaggregate the data depending on the final use. This has not been clipped to the CLM PAE, therefore the number of economic assets/ relevant licences will drastically reduce once this occurs. The Clarence Moreton groundwater licences includes an extract of all licences that fell within the data management acquisition area as provided by BA to NSW Office of Water. Aim: To get a one to one ratio of licences numbers to bore IDs. Important notes about data: Data has not been clipped to the PAE. No decision have been made in regards to what purpose of groundwater should be protected. Therefore the purpose currently includes groundwater bores that have been drilled for non-extractive purposes including experimental research, test, monitoring bore, teaching, mineral explore and groundwater explore No volume has been included for domestic & stock as it is a basic right. Therefore an arbitrary volume could be applied to account for D&S use. Licence Number - Each sheet in the Original Data has a licence number, this is assumed to be the actual licence number. Some are old because they have not been updated to the new WA. Some are new (From_Spreadsheet_WALs). This is the reason for the different codes. WA/CA - This number is the 'works' number. It is assumed that the number indicates the bore permit or works approval. This is why there can be multiple works to licence and licences to works number. (For complete glossary see here http://registers.water.nsw.gov.au/wma/Glossary.jsp). Originally, the aim was to make sure that the when there was more than more than one licence to works number or mulitple works to licenes that the mulitple instances were compelte. Clarence Moreton worksheet links the individual licence to a works and a volumetric entitlement. For most sites, this can be linked to a bore which can be found in the NGIS through the HydroID. (\\wron\Project\BA\BA_all\Hydrogeology\_National_Groundwater_Information_System_v1.1_Sept2013). This will allow analysis of depths, lithology and hydrostratigraphy where the data exists. We can aggregate the data based on water source and water management zone as can be seen in the other worksheets. Data available: Original Data: Any data that was bought in from NSW Offcie of Water, includes Spatial locations provided by NoW- This is a exported data from the submitted shape files. Includes the licence (LICENCE) numbers and the bore ID (WORK_NUO). (Refer to lineage NSW Office of Water Groundwater Entitlements Spatial Locations). Spreadsheet_WAL - The spread sheet from the submitted data, WLS-EXTRACT_WALs_volume. (Refer to Lineage NSW Office of Water Groundwater Licence Extract CLM- Oct 2013) WLS_extracts - The combined spread sheets from the submitted data, WLS-EXTRACT . (Refer to Lineage NSW Office of Water Groundwater Licence Extract CLM- Oct 2013) Aggregated share component to water sharing plan, water source and water management zone ## **Dataset History** The difference between NSW Office of Water GW licences - CLM v2 and v3 is that an additional column has been added, 'Asset Class' that aggregates the purpose of the licence into the set classes for the Asset Database. Where purpose = domestic; or domestic & stock; or stock then it was classed as 'basic water right'. Where it is listed as both a domestic/stock and a licensed use such as irrigation, it was classed as a 'water access right.' All other take and use were classed as a 'water access right'. Where purpose = drainage, waste disposal, groundwater remediation, experimental research, null, conveyancing, test bore - these were not given an asset class. Monitoring bores were classed as 'Water supply and monitoring infrastructure' Depth has also been included which is the completed depth of the bore. Instructions Procedure: refer to Bioregional assessment data conversion script.docx 1) Original spread sheets have mulitple licence instances if there are more than one WA/CA number. This means that there are more than one works or permit to the licence. The aim is to only have one licence instance. 2) The individual licence numbers were combined into one column 3) Using the new column of licence numbers, several vlookups were created to bring in other data. Where the columns are identical in the original spreadsheets, they are combined. The only ones that don't are the Share/Entitlement/allocation, these mean different things. 4) A hydro ID column was created, this is a code that links this NSW to the NGIS, which is basically a ".1.1" at the end of the bore code. 5) All 'cancelled' licences were removed 6) A count of the number of works per licence and number of bores were included in the spreadsheet. 7) Where the ShareComponent = NA, the Entitlement = 0, Allocation = 0 and there was more than one instance of the same bore, this means that the original licence assigned to the bore has been replaced by a new licence with a share component. Where these criteria were met, the instances were removed 8) a volume per works ensures that the volume of the licence is not repeated for each works, but is divided by the number of works Bioregional assessment data conversion script Aim: The following document is the R-Studio script for the conversion and merging of the bioregional assessment data. Requirements: The user will need R-Studio. It would be recommended that there is some basic knowledge of R. If there isn't, the only thing that would really need to be changed is the file location and name. The way that R reads files is different to windows and also the locations that R-Studio read is dependent on where R-Studio is originally installed to point. This would need to be completed properly before the script can be run. Procedure: The information below the dashed line is the script. This can be copied and pasted directly into R-Studio. Any text with '\#' will not be read as a script, so that can be added in and read as an instruction. -------------------------------------------------------------------------------------------------------------------------------------- \#\#\#\#\#\#\#\#\#\#\# \# 18/2/2014 \# Code by Brendan Dimech \# \# Script to merge extract files from submitted NSW bioregional \# assessment and convert data into required format. Also use a 'vlookup' \# process to get Bore and Location information from NGIS. \# \# There are 3 scripts, one for each of the individual regions. \# \#\#\#\#\#\#\#\#\#\#\#\# \# CLARENCE MORTON \# Opening of files. Location can be changed if needed. \# arc.file is the exported \*.csv from the NGIS data which has bore data and Lat/long information. \# Lat/long weren't in the file natively so were added to the table using Arc Toolbox tools. arc.folder = '/data/cdc_cwd_wra/awra/wra_share_01/GW_licencing_and_use_data/Rstudio/Data/Vlookup/Data' arc.file = "Moreton.csv" \# Files from NSW came through in two types. WALS files, this included 'newer' licences that had a share component. \# The 'OTH' files were older licences that had just an allocation. Some data was similar and this was combined, \# and other information that wasn't similar from the datasets was removed. \# This section is locating and importing the WALS and OTH files. WALS.folder = '/data/cdc_cwd_wra/awra/wra_share_01/GW_licencing_and_use_data/Rstudio/Data/Vlookup/Data' WALS.file = "GW_Clarence_Moreton_WLS-EXTRACT_4_WALs_volume.xls" OTH.file.1 = "GW_Clarence_Moreton_WLS-EXTRACT_1.xls" OTH.file.2 = "GW_Clarence_Moreton_WLS-EXTRACT_2.xls" OTH.file.3 = "GW_Clarence_Moreton_WLS-EXTRACT_3.xls" OTH.file.4 = "GW_Clarence_Moreton_WLS-EXTRACT_4.xls" newWALS.folder = '/data/cdc_cwd_wra/awra/wra_share_01/GW_licencing_and_use_data/Rstudio/Data/Vlookup/Products' newWALS.file = "Clarence_Moreton.csv" arc <- read.csv(paste(arc.folder, arc.file, sep="/" ), header =TRUE, sep = ",") WALS <- read.table(paste(WALS.folder, WALS.file, sep="/" ), header =TRUE, sep = "\t") \# Merge any individual WALS and OTH files into a single WALS or OTH file if there were more than one. OTH1 <- read.table(paste(WALS.folder, OTH.file.1, sep="/" ), header =TRUE, sep = "\t") OTH2 <- read.table(paste(WALS.folder, OTH.file.2, sep="/" ), header =TRUE, sep = "\t") OTH3 <- read.table(paste(WALS.folder, OTH.file.3, sep="/" ), header =TRUE, sep = "\t") OTH4 <- read.table(paste(WALS.folder, OTH.file.4, sep="/" ), header =TRUE, sep = "\t") OTH <- merge(OTH1,OTH2, all.y = TRUE, all.x = TRUE) OTH <- merge(OTH,OTH3, all.y = TRUE, all.x = TRUE) OTH <- merge(OTH,OTH4, all.y = TRUE, all.x = TRUE) \# Add new columns to OTH for the BORE, LAT and LONG. Then use 'merge' as a vlookup to add the corresponding \# bore and location from the arc file. The WALS and OTH files are slightly different because the arc file has \# a different licence number added in. OTH <- data.frame(OTH, BORE = "", LAT = "", LONG = "") OTH$BORE <- arc$WORK_NO\[match(OTH$LICENSE.APPROVAL, arc$LICENSE)\] OTH$LAT <- arc$POINT_X\[match(OTH$LICENSE.APPROVAL, arc$LICENSE)\] OTH$LONG <- arc$POINT_Y\[match(OTH$LICENSE.APPROVAL, arc$LICENSE)\] \# The same process for the WALS files. No merging because there is only one WALS file. WALS <- data.frame(WALS, BORE = "", LAT = "", LONG = "") WALS$BORE <- arc$WORK_NO\[match(WALS$LINKED.TO.WA.CA, arc$LICENSE)\] WALS$LAT <- arc$POINT_X\[match(WALS$LINKED.TO.WA.CA, arc$LICENSE)\] WALS$LONG <- arc$POINT_Y\[match(WALS$LINKED.TO.WA.CA, arc$LICENSE)\] \# Merging of the WALS and OTH files. ALL <- merge(OTH, WALS, all.y = TRUE, all.x = TRUE) \# Conversion to new dataset format. new.WALS <- data.frame(LICENSE.APPROVAL = ALL$LICENSE.APPROVAL, BORE = ALL$BORE, HYDROCODE = "", \# Hydrocodes and Countbores I couldn't get working. COUNTBORES = "" , \# This was done in Excel. STATUS = ALL$STATUS, CATEGORY= ALL$CATEGORY, LINKED.TO.WA.CA = ALL$LINKED.TO.WA.CA, LINKED.TO.AL= ALL$LINKED.TO.AL, WATER.SHARING.PLAN = ALL$WATER.SHARING.PLAN, WATER.SOURCE = ALL$WATER.SOURCE, WATER.MANAGEMENT.ZONE = ALL$WATER.MANAGEMENT.ZONE, PURPOSE= ALL$PURPOSE , SHARE.COMPONENT = ALL$SHARE.COMPONENT , ENTITLEMENT= ALL$ENTITLEMENT, ALLOCATION= ALL$ALLOCATION, VOL.PER.BORE = "", \# I couldn't get working either. LAT = ALL$LAT, LONG = ALL$LONG, check.names= TRUE ) \# Exporting out to \*.csv newWALS.location = paste(newWALS.folder ,"/", newWALS.file, sep = "") write.csv(new.WALS, file = newWALS.location) ## **Dataset Citation** Bioregional Assessment Programme (2014) CLM16gwl NSW Office of Water_GW licence extract linked to spatial locations_CLM_v3_13032014. Bioregional Assessment Derived Dataset. Viewed 28 September 2017, http://data.bioregionalassessments.gov.au/dataset/4b0e74ed-2fad-4608-a743-92163e13c30d. ## **Dataset Ancestors** * **Derived From** [NSW Office of Water Groundwater Entitlements Spatial Locations](https://data.gov.au/data/dataset/0f4da0d0-9e82-42f3-84da-1148e0b730c1) * **Derived From** [CLM16gwl NSW Office of Water Groundwater Licence Extract Clarence Moreton- Oct 2013](https://data.gov.au/data/dataset/d9bd77b6-5bc3-4832-a212-0e8f5ba48076) * **Derived From** [CLM16gwl NSW Office of Water, GW licence extract linked to spatial locations in CLM v2 28022014](https://data.gov.au/data/dataset/ed68451f-8e24-4fed-988d-0aef12a997ee)