Skip to content
Skip to content

Before an AI Answers Your Patients' Calls

Patients should know they are speaking to an AI, know whether the call is recorded, know what happens to what they say, and be able to reach a person. None of that is difficult, but all of it has to be decided and written down before the system goes live. This checklist covers what a practice needs in place first.

General guidance to structure your own preparation, not legal advice. Work through it with whoever owns privacy in the practice. Your ticks are saved in this browser.

AI Disclosure and Consent Checklist

What to have in place before an AI answers a patient call.

0 of 30 complete0%

Your ticks are saved in this browser, so you can work through the list over several sessions.

01Disclosure and recording notice

0/6

The words patients hear, agreed and identical everywhere.

02Privacy Act collection notice and policy

0/5

An AI phone system is a new way of collecting, and usually a new recipient.

03Data residency, retention and access

0/7

Every processing step, in writing, before go-live.

04Opt-out and the path to a human

0/5

The exit must work, or nothing else on this list matters to the patient.

05Staff training and incident process

0/7

The people who will be asked about the AI need to know the answers first.

General guidance only: this is not legal advice and is not exhaustive. Privacy obligations, surveillance devices laws and record retention requirements vary by jurisdiction and change over time. Obtain professional advice for your circumstances and confirm the current position with the OAIC and any relevant professional body.

The Principles Behind the List

Everything here follows from three ideas: patients are told the truth about who they are talking to, the practice remains accountable for the information, and there is always a way to reach a person.

Say it is an AI, early and plainly

Australia's AI Ethics Principles include transparency, and the Voluntary AI Safety Standard sets out guardrails for organisations using AI, including being open with people about AI-enabled interactions. In practice that means the greeting says it is an AI assistant before the patient says anything of substance, in words a patient would understand.

Accountability stays with the practice

Under the Privacy Act 1988 and the Australian Privacy Principles, engaging a supplier to handle calls does not move your obligations for the health information collected on those calls. The practice needs to know where the information goes, who can access it and how long it is kept, and needs it in writing.

The exit to a person must work

Complaints about AI phone systems are rarely about the AI itself. They are about being unable to get past it. A patient who says they want to speak to a person should be transferred or called back by a defined route, and that route needs to be tested, including after hours.

The Five Areas

Grouped so each section can be given to the person best placed to settle it: practice manager, privacy officer, clinical lead or the supplier.

1

Disclosure and recording notice

The exact words patients hear about the AI and about recording, and where else they appear.

2

Collection notice and privacy policy

What the Privacy Act requires patients to be told about collection, and how your existing documents change.

3

Data residency, retention and access

Where call data is stored and processed, how long it is kept, and who can reach it.

4

Opt-out and the path to a human

How a patient reaches a person, in hours and after hours, and how that is tested.

5

Staff training and incidents

What staff need to know before go-live, and what happens when something goes wrong.

The Items Practices Most Often Miss

Four things that come up repeatedly and are easier to settle before go-live than to retrofit after a patient complaint.

Recording notice is separate from privacy

If calls are recorded, the obligation to tell the caller arises under state and territory surveillance devices and listening devices legislation, separately from the Privacy Act. The rules differ by jurisdiction. The safe practical position is a clear recording notice at the start of every recorded call, and a written check of the law that applies where your practice operates.

  • State whether calls are recorded, and for what purpose, at the start of the call
  • Check the surveillance devices or listening devices law in your state or territory
  • Decide whether recording is on by default or only for certain call types
  • Confirm the supplier can turn recording off where you decide it should be

The collection notice needs updating

APP 5 requires an entity collecting personal information to take reasonable steps to notify the individual of certain matters, including the purposes of collection and whether the information is likely to be disclosed to overseas recipients. An AI phone system is a new way of collecting, and often a new recipient. Your existing collection notice and privacy policy were probably written before it existed.

  • Add the AI phone system and its supplier to the practice privacy policy
  • State whether call content is disclosed to any overseas recipient
  • Make the notice available where patients will see it: website, waiting room, on request
  • Keep the previous version so you can show what changed and when

Residency means every processing step

A supplier may store recordings in Australia and still send the audio overseas for transcription or to a model provider. APP 8 governs cross-border disclosure. Ask for the full processing chain in writing, including sub-processors, and treat any step outside Australia as a disclosure you need to assess and describe to patients.

  • Get a written list of every location where audio, transcripts or summaries are processed
  • Ask whether the speech, language or model providers are sub-processors and where they are
  • Confirm in writing whether call content is used to train any shared model
  • Record the reasoning behind your decision so it is defensible later

Staff find out on day one

Reception and clinical staff are the people patients will ask about the AI, complain to about it, and receive escalations from it. If they were not trained before go-live, the practice has a system nobody can explain. Training is short, but it has to cover what the AI does, what it must never do, and what to do when a patient wants out.

  • Brief every staff member on what the system does and does not do
  • Give reception a one-page answer to the question, is this a robot
  • Define what an escalated call looks like when it lands on a staff member
  • Tell staff how to report a call the system handled badly

Next Steps

Healthcare AI Privacy Checklist

The wider privacy and governance list for any supplier touching health information.

Open the checklist

AI Healthcare Compliance Guide

The longer written guide to the Australian regulatory landscape for practices.

Read the guide

Healthcare AI Vendor Questions

Twenty-six questions to put to any supplier before you sign.

See the questions

Frequently Asked Questions

Do we have to tell patients they are speaking to an AI?

You should, and the practical case is as strong as the principled one. Australia's AI Ethics Principles include transparency and explainability, and the Voluntary AI Safety Standard published by the Department of Industry, Science and Resources sets out guardrails for organisations deploying AI, including informing people when they are interacting with it. Beyond that, a patient who discovers partway through a call that they were not talking to a person loses trust in the practice, not the supplier. State it at the start, in plain words, every call. This is general information and not legal advice.

What should the disclosure wording say?

Three things, briefly: that the caller is speaking to an AI assistant for the practice, whether the call is recorded, and that they can ask for a person at any time. Keep it under a couple of sentences so patients hear it rather than tune it out. Agree the wording with whoever owns privacy in the practice, write it down, and use the same words in the after-hours greeting and on the website so there is one version of the truth.

Is a call recording notice required?

Where calls are recorded, notice obligations arise under state and territory surveillance devices or listening devices legislation, and the specifics differ between jurisdictions. The Privacy Act separately requires notice of collection under APP 5. The safe practical position is to tell every caller at the start of the call that it is recorded and why, and to have checked the law in the state or territory where your practice operates. If you decide not to record, confirm the supplier has recording switched off and can show you that it is.

What does data residency mean for a phone AI?

It means where every step of processing happens, not only where recordings are stored. A call passes through telephony, speech recognition, a language model and a transcript store, and each may sit in a different place with a different provider. APP 8 imposes obligations when personal information is disclosed to an overseas recipient. Ask the supplier for the full chain in writing and decide, with reasons recorded, whether any overseas step is acceptable for health information. All plans on this site include Australian data residency, and you should still ask us for the written detail.

How should the opt-out to a person work?

A patient who asks for a person should get one by a route that has been defined and tested. In hours that usually means a transfer to reception or a callback within a stated time. After hours it means the escalation path in your after-hours protocol, and for anything urgent, the emergency direction. The route should also trigger on distress or confusion, not only on the words, speak to a person. Test it yourself, including at night, before go-live and every quarter after.

Is this checklist legal advice?

No. It is a practical list to help a practice prepare, drawn from general Australian privacy principles and published AI guidance. It is not exhaustive and cannot account for your jurisdiction, practice type or the specific product you are considering, and obligations change over time. For a decision with real consequence, and letting a system handle patient calls is one, obtain advice from a qualified professional and confirm the current position with the OAIC and any relevant professional body.

Sources and further reading

Want Every Item Answered in Writing?

Disclosure wording, recording settings, the full processing chain, retention periods and the opt-out route. We answer all of it in writing before any practice goes live, and that is the standard to hold any supplier to.