80 results

Developing automated data cleansing and validation processes for fisheries catch and effort data

Project number: 2017-085
Project Status:
Current
Budget expenditure: $397,750.00
Principal Investigator: Karina C. Hall
Organisation: Department of Primary Industries and Regional Development (NSW)
Project start/end date: 21 Dec 2017 - 29 Jun 2020
Contact:
FRDC

Need

During a recent national Fisheries Statistics Working Group meeting, data managers from all Australian states highlighted and discussed the likely high prevalence of inaccurate or fraudulent data supplied by fishers and accrued through data-entry errors. Current data quality control measures in each jurisdiction are largely heterogeneous, undocumented and often rely on manual checks by clerks or analysts that are labour intensive and costly and not routinely executed. Because many of these checks occur during manual data entry of paper-based records, these are likely to become obsolete as reliance on electronic reporting increases, with data entered directly by fishers through online portals or mobile applications.

There is a need to develop automated data cleansing and diagnostic procedures that can be applied post-hoc or retrospectively to large fisheries databases to detect and flag errors and outliers and provide subsets of reliable catch and effort data for stock assessments and other analyses. This project will contribute towards addressing these issues, by developing automated processes to routinely assess newly entered fisheries catch and effort data for errors, retrospectively quantify error rates in existing data and assess their likely influence on the outputs of stock assessment analyses. The outcomes will help improve the quality and accuracy of catch and effort data used in routine stock assessments, and in turn lead to more sustainable management of wild capture fisheries resources.

Objectives

1. Review existing data quality control and cleansing processes applied to fisheries catch and effort databases in all state and commonwealth jurisdictions.
2. Develop a suite of generic algorithmic and statistical approaches to detect and flag different error types (e.g., anomalous, missing and outlying values) in fisheries catch and effort relational databases.
3. Trial the above approaches with several case-study fisheries datasets to assess the performance of different data cleansing approaches, quantify error rates and types and assess the sensitivity of catch and effort statistics to these errors and outliers.
4. On the basis of the above findings, recommend a standard national approach for data cleansing and validation of fisheries catch and effort data.
5. Customise and integrate the generic approaches into NSW fisheries database systems to implement automated data cleansing processes.
6. Extend the results of the project to fishers and industry representatives to encourage greater accuracy in fisheries catch and effort data reporting.
Environment
Environment
PROJECT NUMBER • 1994-053
PROJECT STATUS:
COMPLETED

An assessment of the impact of offshore recreational fishing in NSW waters on the management of commercial fisheries

Conflict between the recreational and commercial sectors has long been a fisheries management problem. This conflict has been escalating in recent years as both sectors attempt to maximise catches. Consequently, there is increasing pressure being applied to fisheries managers to make appropriate...
ORGANISATION:
Department of Primary Industries and Regional Development (NSW)
People
Environment
PROJECT NUMBER • 2019-021
PROJECT STATUS:
CURRENT

Integrating recreational fishing information into harvest strategies for multi-sector fisheries

This interim report provides an update on workshops with recreational fishers, scientists and managers to investigate recreational fishing objectives for three stocks of recreational importance in NSW – Mulloway, Yellowtail Kingfish, and Snapper. The study forms part of a broader research...
ORGANISATION:
Department of Primary Industries and Regional Development (NSW)
Environment
PROJECT NUMBER • 2007-038
PROJECT STATUS:
COMPLETED

Study of ghost fishing in the NSW rock lobster fishery

This project concerns an assessment of the significance ghost fishing in the NSW Rock Lobster Fishery and potential modifications to fishing gears and practices that could minimise trap loss and consequent ghost fishing of the target species, Eastern Rock Lobster, Sagmariasus verreauxi. The...
ORGANISATION:
Department of Primary Industries and Regional Development (NSW)
Environment
PROJECT NUMBER • 1985-074
PROJECT STATUS:
COMPLETED

The fisheries and biology of snapper, Chrysophrys auratus, in New South Wales

The snapper, Chrysophrys auratus, is an economically valuable common property resource that occurs in large numbers in New South Wales waters. Allegations of a resource decline in this major target species of both commercial and recreational fishermen have led to conflict over fishing access and...
ORGANISATION:
Department of Primary Industries and Regional Development (NSW)
Environment
Environment
PROJECT NUMBER • 1985-071
PROJECT STATUS:
COMPLETED

Redfish tagging study, New South Wales

The purpose of this report is to describe the methods used for tagging redfish and discuss the results achieved by the various segments of the project. In conjunction with the tagging study, data on commercial catches of redfish, fishing effort and catch length frequency were also analysed, and the...
ORGANISATION:
Department of Primary Industries and Regional Development (NSW)
View Filter

Organisation