34 results

Developing automated data cleansing and validation processes for fisheries catch and effort data

Project number: 2017-085
Project Status:
Current
Budget expenditure: $397,750.00
Principal Investigator: Karina C. Hall
Organisation: Department of Primary Industries and Regional Development (NSW)
Project start/end date: 21 Dec 2017 - 29 Jun 2020
Contact:
FRDC

Need

During a recent national Fisheries Statistics Working Group meeting, data managers from all Australian states highlighted and discussed the likely high prevalence of inaccurate or fraudulent data supplied by fishers and accrued through data-entry errors. Current data quality control measures in each jurisdiction are largely heterogeneous, undocumented and often rely on manual checks by clerks or analysts that are labour intensive and costly and not routinely executed. Because many of these checks occur during manual data entry of paper-based records, these are likely to become obsolete as reliance on electronic reporting increases, with data entered directly by fishers through online portals or mobile applications.

There is a need to develop automated data cleansing and diagnostic procedures that can be applied post-hoc or retrospectively to large fisheries databases to detect and flag errors and outliers and provide subsets of reliable catch and effort data for stock assessments and other analyses. This project will contribute towards addressing these issues, by developing automated processes to routinely assess newly entered fisheries catch and effort data for errors, retrospectively quantify error rates in existing data and assess their likely influence on the outputs of stock assessment analyses. The outcomes will help improve the quality and accuracy of catch and effort data used in routine stock assessments, and in turn lead to more sustainable management of wild capture fisheries resources.

Objectives

1. Review existing data quality control and cleansing processes applied to fisheries catch and effort databases in all state and commonwealth jurisdictions.
2. Develop a suite of generic algorithmic and statistical approaches to detect and flag different error types (e.g., anomalous, missing and outlying values) in fisheries catch and effort relational databases.
3. Trial the above approaches with several case-study fisheries datasets to assess the performance of different data cleansing approaches, quantify error rates and types and assess the sensitivity of catch and effort statistics to these errors and outliers.
4. On the basis of the above findings, recommend a standard national approach for data cleansing and validation of fisheries catch and effort data.
5. Customise and integrate the generic approaches into NSW fisheries database systems to implement automated data cleansing processes.
6. Extend the results of the project to fishers and industry representatives to encourage greater accuracy in fisheries catch and effort data reporting.
Industry
Industry
PROJECT NUMBER • 1985-063
PROJECT STATUS:
COMPLETED

Analysis of fish pricing in New South Wales: relationships between prices at auction and retail and between prices at Sydney and regional centres

In this Miscellaneous Bulletin a research project funded by the Fishing Industry Research Committee is reported. The aim of this project was to derive price spreads for the major fish species marketed in Sydney. Weekly auction-retail price spreads for fifteen categories of fish and two categories of...
ORGANISATION:
Department of Primary Industries and Regional Development (NSW)
Industry
PROJECT NUMBER • 2004-220
PROJECT STATUS:
COMPLETED

Aquafin CRC: feed technology for temperate fish species

The report is presented in two volumes Aquafin CRC – Feed Technology Temperature Fish Species: Volume 1: Feeding Strategies and Volume 2: Diet Development. The volumes share common background, need, overall objectives, benefits and adoption, further development, planned outcomes,...
ORGANISATION:
Department of Primary Industries and Regional Development (NSW)
Industry
Environment
PROJECT NUMBER • 1998-215
PROJECT STATUS:
COMPLETED

Coastal floodplain management in eastern Australia: barriers to fish and invertebrate recruitment in acid sulphate soil catchments

Estuarine habitats, and in particular coastal floodplains and wetlands, provide essential nursery habitat for a large number of fish and prawn species, many of which are commercially and recreationally significant. Human activities on coastal land, such as those associated with grazing and...
ORGANISATION:
Department of Primary Industries and Regional Development (NSW)

Ballast water investigations

Project number: 1976-018
Project Status:
Completed
Budget expenditure: $0.00
Organisation: Department of Primary Industries and Regional Development (NSW)
Project start/end date: 28 Dec 1978 - 31 Dec 1978
Contact:
FRDC

Objectives

1. Collect background data on shipping operations to establish the incidence of magnitude of ballast water discharge.
2. Determine the influence of season on species composition and survival of the introduced organisms.
3. Establish practicable methods of control

Final report

Final Report • 8.44 MB
1976-018-DLD.pdf

Summary

Ships' ballast water was sampled on 28 occasions in four ports between November, 1976, and October, 1978.

 

A 100.,u plankton net was hand hauled vertically 5 times in each tank. Eight non indigenous species were obtained: 6 copepods, 
1 mysid and 1 amphipod. A further 14 species of copepod and 4 non­copepod taxa were found which have an Indopacific distribution. Twenty one copepods and twenty noncoepods could not be identified to species level which meant their zoogeographic affinities were undeterminable. The role of factors such as amount of water imported, _hull position, port of loading, voyage duration, mid ocean exchange, pumping survival and salinity and temperature shock was briefly examined.

 

Sediments in the bottom of ballast water tanks were examined on 9 occasions. Eight non indigenous species, 8 cosmopolitan species and twenty seven other taxa were found indicating a new potential vector for the dissemination of aquatic biota.

 

No evidence was obtained to indicate successful colonisation had taken place via either ballast water or ballast mud. However, because the identification and distribution of indigenous fauna are so poorly known it is equally impossible to conclude that successful colonisation has not taken place. The need to protect local species from predators, competitors and parasites requires that a sterilization policy be adopted. Preliminary estimates of the amount of sodium hypochlorite (liquid) and calcium hypochlorite (solid) required to kill animals in ballast tanks were made. 

People
PROJECT NUMBER • 1995-175
PROJECT STATUS:
COMPLETED

Strategic Plan for Research and Development of the Oyster Industry in NSW

The NSW oyster industry is one of the states oldest and most valuable fishery, with a farm gate value of more than $27 million in 1994/ 5. It has an impressive history covering more than a hundred years of farming the native Sydney rock oyster Saccostrea commercialis but has experienced a decline...
ORGANISATION:
Department of Primary Industries and Regional Development (NSW)
Adoption
PROJECT NUMBER • 2016-052
PROJECT STATUS:
COMPLETED

Developing and road testing a novel and robust method for trading off ecological interventions for the recovery of native fish communities

The Murray-Darling Basin Plan water recovery objectives through the Sustainable Diversion Limit (SDL) show outstanding potential to be accelerated through complementary measures. A complementary measures program encompasses a range of non-flow related investments to achieve ecological...
ORGANISATION:
Department of Primary Industries and Regional Development (NSW)
People
View Filter

Organisation