Why does a black box in Word or Preview not count as redaction?
A PDF keeps text and graphics in separate layers. A filled rectangle is a graphic: it is painted over the text, and the text object underneath is untouched. Copy and paste, a text extractor or a search index reads the layer, not the picture, so the "hidden" words come straight back.
This is not a theoretical problem. Court filings, police reports and corporate disclosures have all leaked this way, and the recovery method is Ctrl+A, Ctrl+C. The rule is simple: if you can still select it, it is still there.
What does proper redaction actually change?
Redact PDF removes the character objects inside the area you drew, then draws the black box in their place. The rest of the page — text, images, links, bookmarks — is left exactly as it was, so the document stays searchable and selectable everywhere you did not redact.
Because the characters are deleted rather than covered, the file also stops matching a search for them. That is the test worth doing before the document leaves your hands.
What about the data you cannot see on the page?
Redaction deals with the visible text. A PDF also carries an author name, the software that made it, creation and edit dates, and sometimes an XMP block holding earlier versions of those fields. None of that shows on the page, and all of it travels with the file.
For a document going outside the organization, clear the metadata after redacting, and run the privacy scanner over the result: it looks for emails, phone numbers, card and ID numbers, hidden text and scripts, and tells you where they are.
When is redaction the wrong tool?
If a document has more sensitive text than clean text, extracting the few paragraphs you want into a new file is safer than blacking out the rest — there is less to miss.
If the PDF is a scan, the words are pixels, not text. A box over a scan really does hide what is beneath it, but nothing is being deleted, because there is nothing selectable there to delete. Flatten the file afterwards so the box cannot be moved or deleted by the person who receives it.