231 results

Developing automated data cleansing and validation processes for fisheries catch and effort data

Project number: 2017-085
Project Status:
Current
Budget expenditure: $397,750.00
Principal Investigator: Karina C. Hall
Organisation: Department of Primary Industries and Regional Development (NSW)
Project start/end date: 21 Dec 2017 - 29 Jun 2020
Contact:
FRDC

Need

During a recent national Fisheries Statistics Working Group meeting, data managers from all Australian states highlighted and discussed the likely high prevalence of inaccurate or fraudulent data supplied by fishers and accrued through data-entry errors. Current data quality control measures in each jurisdiction are largely heterogeneous, undocumented and often rely on manual checks by clerks or analysts that are labour intensive and costly and not routinely executed. Because many of these checks occur during manual data entry of paper-based records, these are likely to become obsolete as reliance on electronic reporting increases, with data entered directly by fishers through online portals or mobile applications.

There is a need to develop automated data cleansing and diagnostic procedures that can be applied post-hoc or retrospectively to large fisheries databases to detect and flag errors and outliers and provide subsets of reliable catch and effort data for stock assessments and other analyses. This project will contribute towards addressing these issues, by developing automated processes to routinely assess newly entered fisheries catch and effort data for errors, retrospectively quantify error rates in existing data and assess their likely influence on the outputs of stock assessment analyses. The outcomes will help improve the quality and accuracy of catch and effort data used in routine stock assessments, and in turn lead to more sustainable management of wild capture fisheries resources.

Objectives

1. Review existing data quality control and cleansing processes applied to fisheries catch and effort databases in all state and commonwealth jurisdictions.
2. Develop a suite of generic algorithmic and statistical approaches to detect and flag different error types (e.g., anomalous, missing and outlying values) in fisheries catch and effort relational databases.
3. Trial the above approaches with several case-study fisheries datasets to assess the performance of different data cleansing approaches, quantify error rates and types and assess the sensitivity of catch and effort statistics to these errors and outliers.
4. On the basis of the above findings, recommend a standard national approach for data cleansing and validation of fisheries catch and effort data.
5. Customise and integrate the generic approaches into NSW fisheries database systems to implement automated data cleansing processes.
6. Extend the results of the project to fishers and industry representatives to encourage greater accuracy in fisheries catch and effort data reporting.
Environment
Environment
People
PROJECT NUMBER • 2022-153
PROJECT STATUS:
COMPLETED

Fishing and Aquaculture Workforce Capability Framework

In 2023 RM Consulting Group (RMCG) was contracted by FRDC to develop a Fisheries and Aquaculture (F&A) Workforce Capability Framework (hereafter referred to as the Framework) that would be used as a high-level, standardised tool across all F&A sectors. The FRDC and other groups in leadership...
ORGANISATION:
RM Consulting Group (RMCG)
Blank
Industry
PROJECT NUMBER • 2017-012
PROJECT STATUS:
COMPLETED

Investigating social acceptance for the wild catch commercial fishing industry of Southeast Queensland

This research project aimed to develop an engagement strategy that would assist the Southeast Queensland (SEQ) wild catch commercial fishing industry to gain social acceptance, or a Social Licence to Operate (SLO). SLO is needed to maintain access to the resource and market confidence. A scan of...
ORGANISATION:
University of the Sunshine Coast (USC)
People
Communities
PROJECT NUMBER • 2016-400
PROJECT STATUS:
COMPLETED

Sustainable Fishing Families: Developing industry human capital through health, wellbeing, safety and resilience

This project conducted the first national survey of the health, safety and wellbeing of the Australian professional fishing industry in 2017. The results of the survey provide a baseline for the state of the wild-catch industry members across a range of indicators, including reported physical and...
ORGANISATION:
Deakin University Geelong Waterfront Campus
View Filter

Species

Organisation