20,690 results
Industry

Developing automated data cleansing and validation processes for fisheries catch and effort data

Project number: 2017-085
Project Status:
Current
Budget expenditure: $397,750.00
Principal Investigator: Karina C. Hall
Organisation: Department of Primary Industries and Regional Development (NSW)
Project start/end date: 21 Dec 2017 - 29 Jun 2020
Contact:
FRDC

Need

During a recent national Fisheries Statistics Working Group meeting, data managers from all Australian states highlighted and discussed the likely high prevalence of inaccurate or fraudulent data supplied by fishers and accrued through data-entry errors. Current data quality control measures in each jurisdiction are largely heterogeneous, undocumented and often rely on manual checks by clerks or analysts that are labour intensive and costly and not routinely executed. Because many of these checks occur during manual data entry of paper-based records, these are likely to become obsolete as reliance on electronic reporting increases, with data entered directly by fishers through online portals or mobile applications.

There is a need to develop automated data cleansing and diagnostic procedures that can be applied post-hoc or retrospectively to large fisheries databases to detect and flag errors and outliers and provide subsets of reliable catch and effort data for stock assessments and other analyses. This project will contribute towards addressing these issues, by developing automated processes to routinely assess newly entered fisheries catch and effort data for errors, retrospectively quantify error rates in existing data and assess their likely influence on the outputs of stock assessment analyses. The outcomes will help improve the quality and accuracy of catch and effort data used in routine stock assessments, and in turn lead to more sustainable management of wild capture fisheries resources.

Objectives

1. Review existing data quality control and cleansing processes applied to fisheries catch and effort databases in all state and commonwealth jurisdictions.
2. Develop a suite of generic algorithmic and statistical approaches to detect and flag different error types (e.g., anomalous, missing and outlying values) in fisheries catch and effort relational databases.
3. Trial the above approaches with several case-study fisheries datasets to assess the performance of different data cleansing approaches, quantify error rates and types and assess the sensitivity of catch and effort statistics to these errors and outliers.
4. On the basis of the above findings, recommend a standard national approach for data cleansing and validation of fisheries catch and effort data.
5. Customise and integrate the generic approaches into NSW fisheries database systems to implement automated data cleansing processes.
6. Extend the results of the project to fishers and industry representatives to encourage greater accuracy in fisheries catch and effort data reporting.
Environment
PROJECT NUMBER • 2012-035
PROJECT STATUS:
COMPLETED

Bio-Security Awareness Workshop

Queensland Aquaculture Industries Federation (Inc) (QAIF) represents the major land based aquaculture sectors in Australia. Members believe that as the industry grows in scale, geographical spread and develops breeding stock re distant from the original wild sector genetics, it is becoming more...
ORGANISATION:
Queensland Aquaculture Industries Federation
Environment
PROJECT NUMBER • 2019-103
PROJECT STATUS:
COMPLETED

Strategic Planning Workshop for Yellowtail Kingfish Stock Assessment in South-Eastern Australia

The project facilitated cross-jurisdictional and cross-sectoral discussions on aspects of the Eastern Australia biological stock of Yellowtail Kingfish. Several knowledge gaps relating to biological and life-history parameters, as well as reliable data on the recreational fishery across all...
ORGANISATION:
Department of Primary Industries and Regional Development (NSW)
Environment
PROJECT NUMBER • 1986-127
PROJECT STATUS:
COMPLETED

A biological study of east coast tunas and billfishes with particular emphasis on yellowfin tuna (Thunnus albacares)

The East Coast Tunas and Billfishes Research Program was funded by the Fishing Industry Research Trust Account (FIRTA F86/127) from July 1986 to June 1988. The objectives of the program were to identify the stock(s) exploited by the east coast tuna and billfish fisheries, examine the structure of...
ORGANISATION:
Department of Agriculture Fisheries and Forestry
Industry
People
PROJECT NUMBER • 1999-354
PROJECT STATUS:
COMPLETED

QFISH Foresight Project - a strategic planning and futuring project designed to create a strong coordinated commitment by all stakeholders to an agreed vision of the fisheries of the future

The establishment in 1997of the Fishing Industry Development Council (FIDC), a peak fishing advisory body, set the scene for an examination of where Queensland’s fisheries and the fishing industry sectors were heading in the longer term. The FIDC is a high level consultative forum...
ORGANISATION:
Department of Primary Industries (QLD)
Environment
PROJECT NUMBER • 1986-096
PROJECT STATUS:
COMPLETED

Diseases of prawns in aquaculture: to develop procedures to detect pathogens of prawns shipped interstate

This project found and described a baculovirus similar to Monodon Baculovirus (MBV) that was called Plebejus Baculovirus (PBV) as it was in eastern king prawns (Penaeus plebejus). It later found it in Australian cultured Penaeus monodon. The project investigated other conditions, particularly...
ORGANISATION:
University of Queensland (UQ)
View Filter

Species

Organisation