Victoria child protection worker uses ChatGPT for safeguarding report
Victoria’s child protection agency has been ordered to ban the use of AI tools after a social worker used ChatGPT to write a child protection report, which resulted in the submission of sensitive data and the generation of a number of inaccuracies.
The Victorian Information Commissioner’s Office (OVIC) received reports of the incident in December last year after the Department of Families, Equity and Housing (DFFH) discovered that a social worker was suspected of having written a protection request report using ChatGPT.
The report was used in the Children’s Court in a case involving a child who had moved families following sexual offences.
Today, OVIC found that the DFFH failed to “take reasonable steps” to protect the child’s personal data and ensure accurate reporting.
Although the outcome for the child did not change, it determined that “a significant amount of personal and sensitive information” had been entered into ChatGPT, meaning it was disclosed to OpenAI out of control of the DFFH.
She also found that the report contained inaccurate data “that downplayed the risks to the child in this case.”
“What is particularly concerning is that the report describes a child’s doll – which was reported to child protection as having been used by the child’s father for sexual purposes – as an asset notable of parents’ efforts to meet the child’s developmental needs with “age-appropriate” measures. toys,” Victoria Information Commissioner Sean Morrison said.
Investigations highlighted several points indicating that ChatGPT could have been used for the report. Ultimately, the worker admitted to using ChatGPT for the report to “save time and present the work in a more professional manner.” The worker never admitted to submitting sensitive data.
OVIC investigated the department further and found 100 cases where ChatGPT could have been used in drafting safeguarding-related documents.
Additionally, from July to December 2023, it was determined that almost 900 employees (nearly 13% of department employees) accessed ChatGPT.
Following the findings, OVIC ordered the DFFH to effectively ban the use of generative AI tools like ChatGPT, requiring the department to block access to generative AI websites. The blockage will last two years, starting November 5.
OVIC has not completely ruled out the use of this technology, but it should be used specifically to ensure the safety of vulnerable children.
“The Deputy Commissioner believes that there may be some specific use cases where the risk is less than others, but that child protection, by its nature, requires the highest standards of care “, said OVIC.
“Any request to change specified actions relating to child protection personnel, information or activities should be accompanied by the highest standards of verifiable evidence. »
