
What is generative AI? A practical guide to AI for business
Generative AI is artificial intelligence that creates new text, images, audio or code from a plain-language prompt, using patterns learned from vast amounts of data. Arke Technologies, in Johannesburg, helps South African organisations use it safely and plan AI for business innovation beyond generative AI.
What is generative AI? A practical guide to AI for business
Last reviewed: September 2026 · , 14 min read
Generative AI is artificial intelligence that creates new text, images, audio or code from a plain-language prompt, using patterns learned from vast amounts of data. Arke Technologies, in Johannesburg, helps South African organisations use it safely and plan AI for business innovation beyond generative AI.
Last reviewed: September 2026 · , 14 min read
On this page
Generative AI meaning, in simple terms
Last reviewed: September 2026.
What is generative AI in simple terms? It is software that has studied an enormous amount of text, images or code and learned the patterns so well that it can produce new material in the same style. Ask it for a summary, a letter, a lesson plan or a piece of code, and it writes one, predicting piece by piece what should come next.
That points to the most important part of the generative AI meaning: it produces what is likely, not what is verified. A model does not look facts up unless it is connected to a source. It is very good at language and structure, and it can be fluent and wrong at the same time. A formal generative AI definition says the same thing more stiffly: models that learn the patterns in their training data and generate new data with similar characteristics.
This introduction to generative AI is written for the people who approve budgets, policies and projects: executives, IT and finance leaders, procurement officers, municipal managers and school leaders. It is one of our insights and guides.

AI vs generative AI: where it fits
AI vs generative AI is a question of scope. Artificial intelligence is the whole field of computers performing tasks that normally need human intelligence; generative AI is one branch of it. Most business AI used to be predictive: it classified, scored and forecast. Generative AI creates, and it reached mass use after ChatGPT's public release in November 2022.
| Term | What it is | What it produces | Business example |
|---|---|---|---|
| Artificial intelligence | The broad field of machines performing tasks that need intelligence | Predictions, decisions, content and actions | Everything below |
| Machine learning | AI that learns patterns from data rather than following written rules | Scores, classifications and forecasts | Flagging an unusual payment for review |
| Deep learning | Machine learning with many-layered neural networks | Recognition of images, speech and text | Reading scanned invoices |
| Generative AI | Deep-learning models that create new content | Text, images, audio, video and code | Drafting a reply from a policy document |
| Large language models (LLMs) | Generative models trained mainly on text | Language and code | An assistant that summarises a tender |
So AI versus generative AI is not a contest: generative AI is part of AI. Machine learning versus generative AI is not a contest either, because generative models are built with machine learning; the practical choice is between predicting and producing, and many useful systems do both. Natural language processing (NLP), the older discipline of getting computers to work with human language, now relies heavily on large language models, which is why NLP and generative AI overlap.
How generative AI works
01.
Training
A model learns from very large collections of text, images or code, adjusting billions of internal settings, called parameters, until its predictions are good.
02.
Refinement
Developers tune it with examples of good answers and with human feedback, so that it follows instructions and declines harmful requests.
03.
Prompting
You give it an instruction and, ideally, the material to work from.
04.
Generation
It produces output one small piece, called a token, at a time, each the most suitable continuation of what came before.
05.
Grounding
In business, the model is connected to approved sources through retrieval-augmented generation (RAG), so that it answers from your documents and cites them rather than relying on memory.
Most language models use the transformer architecture, which Google researchers published in 2017; most image generators use diffusion models, which build a picture by removing noise step by step.
What are foundation models in generative AI?
Foundation models are very large models trained on broad data that can be adapted to many tasks, rather than built for one. Researchers at Stanford University coined the term in 2021. A single foundation model can draft a letter, summarise a report, translate, classify and write code, because it learned general patterns rather than one job.
Claude, from Anthropic, and Gemini, from Google, are foundation models, and so are open-weight models whose parameters anyone can download and run on their own hardware. Open source generative AI is a looser term than it sounds: some "open" models publish their weights but not their training data or code, so check the licence before you build on one.
We build with Claude, with Gemini through Google Cloud's Vertex AI and with open-weight models, choosing the model for each job. Where data must stay on infrastructure you control, see private AI and AI infrastructure.
Types of generative AI
| Type | What it creates | Business uses | Watch |
|---|---|---|---|
| Text and language | Drafts, summaries, answers and translations | Correspondence, reports, knowledge search | Invented facts and citations |
| Images | Illustrations, concepts and edited photos | Marketing concepts, presentations | Copyright, likeness and brand use |
| Audio and voice | Speech and voice-overs | Accessible content, training material | Voice cloning and consent |
| Video | Short clips and animations | Training and explainer videos | Deepfakes and disclosure |
| Code | Functions, tests and scripts | Software development and data work | Security review of generated code |
| Multimodal | Mixed inputs and outputs, such as reading a photo and answering in text | Reading forms, charts and photographed documents | Accuracy on poor scans |
Generative AI examples for South African organisations
Generative AI examples are easiest to judge in your own sector. Each generative AI example below uses the model to read and write, with a person responsible for the result:
| Sector | Generative AI example | Who stays responsible |
|---|---|---|
| Municipalities and departments | Summarising long public submissions; drafting replies to ratepayer queries from the tariff policy | The official who signs |
| Schools, colleges and universities | Drafting parent letters and differentiated worksheets; lecturer administration within an academic-integrity policy | Teachers and lecturers, who assess learners |
| Finance teams | Variance commentary and first drafts of board packs | The finance team, which owns the numbers |
| Legal and compliance | A first-pass review of contracts against a checklist | A qualified person, who gives the advice |
| Service desks | Replies to tickets drafted from the knowledge base | The technician who sends them |
| Procurement | Summaries of tender responses against the evaluation criteria | The bid committee, which decides |
| Marketing | Draft copy and image concepts | Marketing, which approves claims under the Consumer Protection Act |
One example from our own business: the customer assistant we built for Server Hub, our hardware division, works in off, draft or automatic modes, with staff approving drafts (Server Hub commerce platform). For professional services firms, AtlasOS, our practice platform, includes AI-assisted advisory that gives staff conversational access to overdue tasks, compliance risks and client summaries without replacing their judgement; visit the AtlasOS site (opens atlaspractice.app).
Google generative AI, Microsoft Copilot and the tools you already license
Many organisations already pay for generative AI without using it well. Google generative AI comes to business users as Gemini: inside Google Workspace apps such as Gmail and Docs and, for developers, through Vertex AI on Google Cloud. Is Copilot generative AI? Yes: Microsoft 365 Copilot is a generative AI assistant built on large language models and grounded in the emails, files, chats and meetings each user can already open.
That last point is the risk. An assistant sees what its user can see, so years of loose sharing in SharePoint, OneDrive or Google Drive can surface the wrong document to the wrong person. Fix permissions first; our Microsoft 365 Copilot readiness work starts there. If you are still choosing a platform, compare Microsoft 365 vs Google Workspace, and see what each costs to run in our Microsoft 365 pricing and Google Workspace pricing guides.
What is hallucination in generative AI? The risks to manage
The issues with generative AI are well understood, and each has a control:
Hallucination. A hallucination is a confident, fluent answer that is false: an invented figure, case or citation. South Africa's draft national AI policy was withdrawn in April 2026 after fictitious references were found in it (SAnews, April 2026), which shows how easily unchecked output reaches an official document. Ground models in approved sources and check what goes out.
Personal information. POPIA applies to prompts. Section 72 limits sending personal information abroad, including to a model hosted overseas, and section 71 restricts decisions based solely on automated processing.
Data leakage. Staff pasting client, patient or learner data into free tools may hand it to a provider whose terms allow it to be kept. Approve tools and publish an acceptable-use policy.
Bias. Outputs can reflect bias in the training data, which matters in hiring, credit and public services.
Copyright. The law on training data and on who owns generated work is unsettled in several countries, so review generated images and copy before publishing.
Environmental impact. Training and running large models uses substantial electricity, and data centres use water for cooling. Choosing smaller models where they perform as well, and generating only what is needed, lowers both cost and footprint.
See South Africa's national AI policy and our AI governance service for the controls in practice.
AI for business innovation beyond generative AI
Generative AI is the most visible form of AI, not the only useful one. Much of the value in AI for business innovation beyond generative AI comes from quieter techniques that predict, detect and optimise, often on data you already hold:
| Technique | What it does | Example | Related service |
|---|---|---|---|
| Predictive analytics and forecasting | Estimates what is likely to happen | Demand, cash flow or equipment failure | Data, analytics and BI |
| Classification and anomaly detection | Sorts items and flags the unusual | Billing records that disagree with meter readings | Municipal revenue enhancement |
| Document intelligence | Extracts data from forms, invoices and scans | Supplier invoices captured into the finance system | Document intelligence and OCR |
| Optimisation | Finds the best plan within constraints | Delivery routes, staff rosters and stock levels | Custom software development |
| AI agents | Plan and carry out multi-step tasks | Triaging a shared mailbox and opening cases | AI agents vs generative AI |
| Data analytics and generative AI together | Plain-language questions over trusted data | "Which suppliers were paid late last quarter?" answered from the finance system | Power BI consulting |
The strongest programmes combine them: predictive models decide where to look, generative AI explains what was found in plain language, and a person decides what to do. How AI fits a wider change programme is covered in our digital transformation guide.
How to introduce generative AI in your organisation
01.
Find the reading and writing
List the tasks where staff read, summarise or draft the most.
02.
Set the rules first
An acceptable-use policy, the approved tools and the data that may never go into a prompt.
03.
Fix permissions and sources
Clean up sharing, and choose the documents the model may answer from.
04.
Choose the approach
Buy assistants in your office suite, configure them, build models into your own systems, or host your own model.
05.
Pilot against a baseline
A small group doing real work, with time saved and accuracy measured.
06.
Train by role, then scale, with a monthly review of usage, cost and incidents.
Our AI consulting and implementation team runs this with you, and our generative AI and LLM integration service builds the connections to your documents and systems.
What generative AI costs
Last reviewed: September 2026.
Generative AI costs come in four parts. Assistants inside office suites are licensed per user per month. Models used through an API are billed per token, so cost follows the volume and length of what you process. Connecting a model to your documents and systems is a project. Hosting your own model means buying GPU hardware once or paying for cloud capacity, and every option needs someone to run and review it.
The total depends on how many people get a seat, how much text you process, how many systems the model must reach, how sensitive the data is and how much testing the use demands. We quote each phase after discovery, so that you can fund a pilot before anything larger, and we estimate usage costs from your real volumes. GPU servers and AI workstations for private deployments come from Server Hub, our hardware division.
Governance, procurement and continuity
Governance. AI recommends; people decide. Every AI action is logged, reviewable and reported monthly, with change control for prompts, sources and model versions.
Compliance. POPIA controls, including data minimisation, encryption in transit and at rest, access controls and audit logging; ISO 27001-aligned security; King IV Principle 12 reporting; PFMA or MFMA documentation for public bodies. We never train models on client data without explicit consent.
Procurement. Level 1 B-BBEE contributor, giving 135% procurement recognition (sworn affidavit available on request); company documents, CSD supplier number and SARS tax compliance status on request.
Continuity. You own your data, credentials and documentation. We choose the model for each job and design integrations so that one model can be replaced by another as the market moves.
Related services
Related guides
- Microsoft 365 vs Google Workspace
- Microsoft 365 plans for organisations, and what they really cost to run
- Google Workspace pricing in South Africa
- South Africa's national AI policy explained
- AI agents vs generative AI: what is the difference?
- Digital transformation: a guide for South African organisations
Related work
Last reviewed: September 2026 · , 14 min read
Put generative AI to work, safely
Tell us which documents your teams read and write most, and book an AI readiness session.
Book an AI readiness sessionRelated services
Related guides
- Microsoft 365 vs Google Workspace
- Microsoft 365 plans for organisations, and what they really cost to run
- Google Workspace pricing in South Africa
- South Africa's national AI policy explained
- AI agents vs generative AI: what is the difference?
- Digital transformation: a guide for South African organisations
Related work
Get our guides by email
Plain, sourced guides for the people who decide on and buy technology, sent to your inbox.
Frequently asked questions
What is generative AI in simple terms? Show answer Hide answer
Generative AI is software that learns the patterns in huge amounts of text, images or code and uses them to create new content on request. Ask for a summary, a letter or a piece of code and it writes one, predicting what should come next. It produces what is likely rather than what is verified, so people should check its output.
What is the difference between AI and generative AI? Show answer Hide answer
Artificial intelligence is the whole field of computers performing tasks that need intelligence; generative AI is the branch that creates new content. Most earlier business AI predicted or classified, for example scoring a credit risk or flagging an unusual payment. Generative AI writes, draws or codes. Many useful systems combine both, with a person making the decision.
What are foundation models in generative AI? Show answer Hide answer
Foundation models are large AI models trained on broad data that can be adapted to many tasks, such as drafting, summarising, translating and coding. Claude from Anthropic and Gemini from Google are examples, as are open-weight models you can run yourself. Businesses rarely train their own; they connect a foundation model to their own documents and systems.
What are some generative AI examples at work? Show answer Hide answer
Common generative AI examples at work include drafting correspondence, summarising long documents and meetings, answering staff questions from policy documents, producing first drafts of reports and creating image concepts for marketing. In each case the model drafts and a person checks. The strongest examples involve heavy reading and writing and a clear source of truth.
Is Copilot generative AI? Show answer Hide answer
Yes. Microsoft 365 Copilot is a generative AI assistant built on large language models and grounded in the emails, files, chats and meetings each user can already open. Because it sees what its user can see, permissions and sharing should be cleaned up before rollout, so that it cannot surface documents people should never have been able to open.
What is hallucination in generative AI? Show answer Hide answer
A hallucination is a confident, fluent output that is false, such as an invented statistic, court case or reference. It happens because models generate plausible text rather than look facts up. Connecting the model to approved sources, requiring citations and having a person check anything that leaves the organisation are the main defences.
What does AI for business innovation beyond generative AI look like? Show answer Hide answer
Beyond generative AI, business innovation comes from AI that predicts, detects and optimises: forecasting demand, flagging billing anomalies, extracting data from documents, planning routes and rosters, and agents that complete multi-step tasks. These techniques often run on data you already hold, and they pair well with generative AI, which explains the results in plain language.
Is generative AI safe to use under POPIA? Show answer Hide answer
Generative AI can be used lawfully under POPIA if personal information is protected. Use business editions with proper data terms, keep personal information out of unapproved tools, document any processing outside South Africa under section 72, and keep a person responsible for decisions that substantially affect someone. An acceptable-use policy and staff training make the rules stick.
Put generative AI to work, safely
Tell us which documents your teams read and write most, and book an AI readiness session. We will show where generative AI fits, where other AI does better and what each would cost to run.