Audience
- Analysts working with feedback, enquiries, reports or survey responses.
- Developers beginning to add language features to business applications.
- Project and operations professionals who can work with simple Python examples.
AI & technology
Understand how AI works with language and explore practical text-analysis applications.
Turn unstructured text into information that a business can use. This module follows a realistic customer-feedback problem from an untidy collection of messages to a small, evaluated language-analysis application. You will explore why the wording, context and quality of the source material matter as much as the model.
Practical exercises connect language concepts with decisions: which enquiries need attention, which subjects recur, and which facts can be extracted reliably. You will compare simple rules, conventional text models and language-model approaches, then explain your choice using evidence from a held-out evaluation set. The emphasis is an understandable workflow that a colleague can inspect and improve.
Explore the focus and practical output of each teaching session. Open individual sessions below, or expand the complete plan.
Translate customer-feedback needs into classification, extraction and search tasks with distinct success measures.
Practical output: A problem brief and initial evaluation questions.
Inspect sources, document permissions and sample messages that represent the intended operating context.
Practical output: A corpus inventory and sampling rationale.
Compare tokenisation, normalisation and cleaning choices using abbreviations, negation and mixed-format messages.
Practical output: A reproducible text-preparation notebook.
Create a category guide and resolve disagreement between two readers of the same message.
Practical output: An annotation guide with reviewed examples.
Use keywords and simple rules to establish a reference point before introducing a learned model.
Practical output: A baseline classifier with documented shortcomings.
Explore word counts, TF–IDF and vector similarity through a small search and classification exercise.
Practical output: A comparison of document representations.
Separate training and evaluation data, fit a supervised model and inspect its predictions.
Practical output: A first model and reproducible data split.
Read a confusion matrix and discuss how false positives and missed cases affect different users.
Practical output: A precision, recall and error-analysis report.
Identify named entities and structured fields, then validate extracted values against explicit rules.
Practical output: A structured extraction workflow with checks.
Use embeddings to compare meaning and inspect cases where semantic similarity gives misleading matches.
Practical output: A small semantic-search experiment.
Design a constrained classification or extraction prompt and compare its results with your baseline.
Practical output: A prompt specification and comparison table.
Test ambiguous, multilingual and out-of-scope messages and design an appropriate review or abstention route.
Practical output: An edge-case suite and review policy.
Connect preparation, prediction and reporting into a usable prototype, with a visible audit trail.
Practical output: A working feedback-analysis workbench.
Demonstrate the workflow, explain remaining errors and justify which improvements deserve the next investment.
Practical output: A final demonstration and improvement backlog.
Apply the learning
Build a prototype that organises incoming feedback into useful categories and extracts selected facts. Choose a manageable question, such as identifying delivery concerns or recurring training needs. Your final recommendation must show how the evidence supports the proposed use, including cases that require a person to review the result.
Use anonymised, public or suitable synthetic material where workplace information is confidential. The issued assessment brief confirms the required evidence.
Teaching and the relevant course certificate are provided through Kent Business College in the UK. Completion requirements are set out in the module information; attendance alone should not be assumed to meet every assessment requirement.
No. Prompting is one method within a wider process covering data preparation, representations, classification, extraction and evaluation.
The module focuses on applying and evaluating existing methods. Training a large language model from scratch is outside its scope.
Yes, where you have permission and can remove confidential or personal information. A synthetic or public dataset can be used instead.