Interview coding can be accelerated by suggested themes, but a model may flatten minority perspectives, misread sarcasm or invent explanatory motives not stated by participants.
The workable objective is not to remove every human touch. It is to produce a specific, inspectable output with known sources, clear ownership and an escalation path. The method below is intended for research analysts, UX teams, program evaluators. It can be implemented with approved documents, office software or a restricted AI assistant; no feature or licensing tier is assumed.
Decide whether AI belongs in this process
Create a research question and a coding protocol before using AI. Consent, transcript accuracy, confidential identifiers and the legitimate purpose of analysis must be settled first.
Before evaluating vendors, write a one-sentence acceptance test: who needs the result, which facts must be correct, what may be omitted, and what must never happen. Compare the result against the current procedure, including the cost of review. If ordinary software can reliably solve the task, adding a language model introduces an unnecessary failure mode.
A practical implementation workflow
1. Establish the real input and the authority to use it
Transcribe interviews using an approved process and correct specialist vocabulary, names and speaker attribution.
Before making a tool request, distinguish facts drawn from the source system from instructions written by staff. Record which materials are approved, who owns the process and what might be missing. If the evidence cannot be trusted, defer the experiment rather than trying to fix uncertainty with prompt wording.
2. Design an inspectable assisted step
Define a preliminary coding rubric with examples and an “unclear” category rather than forcing every statement into a theme.
Make the proposed output visible alongside the evidence the reviewer needs. Separate transformation of information from the authority to send, publish, decide or change a record. Where a step involves sensitive information or irreversible consequences, require a more restrictive control path.
3. Define quality criteria and exception routes
Ask AI for coding suggestions with line references, then have researchers check counterexamples and disagreements across participants.
Use difficult examples from the actual task distribution, not only clean demonstrations. Include missing context, conflicting records and requests that must be declined. Record false positives, false negatives and work passed back to the original team so the trial measures total work rather than the model response alone.
4. Review, decide and retain the evidence
Document coding revisions, saturation limitations, outlier themes and the boundaries of what the sample supports in the final synthesis.
The accountable human should be able to correct, reject and trace the result without searching through a raw conversation. Archive the approved artifact, source version and decision using organizational retention rules. Recheck the workflow when the data source, model behavior or business policy changes.
Approval checkpoints, privacy and controls
Restrict access to raw recordings and personal data. Review any publication excerpt for consent, context and potential re-identification.
Set an explicit release gate for the output: a draft can be accepted internally, but any external message, business-system write, financial consequence or decision about a person needs the authorization appropriate to its risk. Record the role of the approver rather than relying on the assistant’s confidence. Access should be scoped to the least information needed for the particular task.
What can go wrong
Generated themes may privilege majority language and reduce socially sensitive accounts to generic labels. Agreement with a model is not independent inter-rater reliability.
A transparent chain from question to retrieved source to supported claim is more important than a long polished answer. Uncertainty should survive the writing process.
Illustrative workflow, not a tested case study
A transit agency studies rider interviews; the analyst uses AI to suggest accessibility themes, then retains dissenting comments that contradict the dominant narrative.
To make this example an actual pilot, the organization would select representative historical cases, remove or protect personal information, agree on expected outputs before testing, and record reviewer edits. A fabricated success rate is less useful than a small set of well-documented failures that the team can learn from.
Measure outcomes rather than plausible productivity
- Coding Agreement: define the denominator and measurement period in advance; compare with a valid non-AI baseline and record corrections.
- Missed Minority Themes: define the denominator and measurement period in advance; compare with a valid non-AI baseline and record corrections.
- Untraceable Quotations: define the denominator and measurement period in advance; compare with a valid non-AI baseline and record corrections.
- Analyst Correction Time: define the denominator and measurement period in advance; compare with a valid non-AI baseline and record corrections.
- Consent Compliance: define the denominator and measurement period in advance; compare with a valid non-AI baseline and record corrections.
Keep three ledgers separate: process quality, staff time and full operating cost. Cost includes the service or seats, security review, training, integration, human checks, support and possible rework. Do not treat time released as realized revenue or wage savings unless the organization can demonstrate that conversion.
Limits, alternatives and regional applicability
Manual qualitative analysis software and trained multi-coder review may be preferable for sensitive or methodologically rigorous projects.
Research ethics, privacy and publication rules vary by institution, participant population and jurisdiction.
Primary-source context and applicability
- UNESCO issued human-centered guidance on generative AI in education and research on 7 September 2023.
- The NIST AI RMF 1.0 was released on 26 January 2023 and is voluntary, risk-management guidance.
- The ICO describes its AI data protection guidance as best practice and legal interpretation, not a statutory code; the page was under review when checked.
- The OECD AI Principles, adopted in 2019 and updated in 2024, emphasize human rights, transparency, robustness and accountability.
These dated institutional publications and vendor documents establish the limited context stated above. They do not constitute proof that the suggested workflow is effective or compliant in every organization.
Tool and model availability, enterprise agreements, data-handling terms, feature switches and pricing change frequently. This article deliberately does not claim a current price, unlimited entitlement, universal release date or a tested superiority of one vendor. Confirm product, tier and geography from dated first-party documentation before purchase; use the AI 10 price ledger for price snapshots.
This guide is an editorial operating method, not a product benchmark, a controlled experiment, a legal opinion or a promise of savings.
Sources & Further Reading
- Guidance for generative AI in education and research (7 September 2023) — UNESCO. Publication/version: 2023-09-07. Applicable context: global: education principles. Source checked 2026-10-25.
- AI Risk Management Framework 1.0 (January 26, 2023) — NIST. Publication/version: 2023-01-26. Applicable context: global: voluntary guidance. Source checked 2026-10-25.
- AI and Data Protection: About this Guidance — UK Information Commissioner’s Office. Publication/version: unknown; page under revision. Applicable context: United Kingdom. Source checked 2026-10-25.
- OECD AI Principles, updated 2024 — OECD. Publication/version: 2024. Applicable context: global: policy principles. Source checked 2026-10-25.