1.2 How do large language models work?
How do large language models work?
Training
The AI model is pre-trained on a large dataset, typically of general texts or images. For specialized AI models, they may be trained on a specific dataset of subject or domain specific data. The AI analyses the data, looking for patterns, themes, relationships and other characteristics that can be used to generate new content.
For example, early models of GPT (the LLM used by both ChatGPT and Copilot) were trained on hundreds of gigabytes of text data, including books, articles, websites, publicly available texts, licensed data, and human-generated data.
Human intervention can occur at all stages of the training.
Humans may:
- Create and modify the initial dataset, removing messy or problematic data
- Assess the quality of output from the AI model
The model is then released for use and can be accessed by users
Generation
LLMs generate text in response to a user-provided prompt.
Prompting
A user provides a prompt, asking the AI model to perform a specific task, generate text, produce an image, or create other types of content.
Prompt: Tell me a joke about higher education.
Tokenization
The AI breaks the prompt into tokens (words or parts of words or other meaningful chunks) and analyses these tokens in order to understand the meaning and context of what is being asked.
Token Breakdown: ["Tell", "me", "a", "joke", "about", "higher",
"education", "."]
NOTE: words might also be broken into subword tokens like “high”, “er”, “edu”, “cation”]
These tokens are then converted into vectors (numerical values) that represented the position of the token in relationship to other tokens, representing how likely they are to occur in sequence.
Prediction
The LLM analyses the vectors and, based on the patterns and other information learned in training, the AI model will start to predict a response to the prompt based on the probability of response tokens appearing in sequence.
For example, in responding to our request to generate a joke, the most likely starting token may be “Why”, “What”, “Here’s” etc.
Output
After predicting a sequence of tokens, the LLM decodes the tokens back into natural language (words and sentences readable by a human). The complete response is shared with the user.
✅ “Why did the student bring a ladder to class? To reach higher education!”
The user can then submit a follow-up request referencing the original request or output. This is called iteration.
For more a more detailed introduction to Generative AI, see this video from Google:
For a more in-depth look at how LLMs function, see this article from the Financial Times:
What are the Limitations of Large Language Models?
Generative AI is evolving quickly but still has certain limitations. Large Language Models (LLMs) are constrained by the data upon which they are trained and the methods through which they are trained. It’s important to be aware of the limitations of the tools that you’re using, especially if currency or accuracy is important for the tasks that you’re using Generative AI to complete.
- Currently, LLMs function as pattern replicators, which means they generate output based on averages or probabilities of patterns.
- LLMs are susceptible to hallucinations or the creation of nonsensical words, phrases, or ideas. This can also result in the generation of non-existent references
. - LLMs do not fact-check, meaning that the information that they share is not guaranteed to be accurate or logical.
- Many LLMs are pre-trained and have knowledge cut-off dates, meaning that data may be out of date or inaccurate. However, ongoing advancements, including the ability to access and process information in real time, have allowed some models to overcome this limitation by having the added ability to perform a web search.
- LLMs are susceptible to reproducing biases found in their data sets, including but not limited to biases based on human biases that may be embedded in historical records, cultures, patterns of research, societal norms, and any other elements reflected in the text data used for their training. This will be discussed more in the Ethics section.
[POTENTIAL CHATBOT INTERFACE: GPT that analyses the steps above for any given input]
Large Language Models are trained on massive amounts of text to allow them to learn patterns and relationships which allows them to generate new text. This training is completed before the LLM is released to the public.
A prompt is the text that is provided to the system providing instructions on the desired output or the task being requested.
Examples of prompts:
For text-to-text:
Write a detailed case study demonstrating environmental racism in a Canadian context for a class of first year university students at a Canadian university.
Summarize the key themes of Orwell’s 1984 in a bulleted list and simple English.
For text-to-image
Generate a photorealistic depiction of Six Grandfathers Mountain before it was carved into Mount Rushmore.
A subset of Deep Learning that can use learned rules or patterns to generate new content.
Large Language Models (LLMs) are computational models that are trained on huge datasets of text to recognize common patterns and relationships in natural language. They can be used for generating texts that mimic human language.
Generative models are subject to generating nonsensical outputs, such as words or phrases that don’t exist, grammatically incorrect text, references to articles or resources that don’t exist, or warped images. These are called Hallucinations.
