Free lesson · Module 1, lesson 5 of 6

What LLMs do well and badly

Sort ten everyday tasks into ones an assistant does well (drafting, summarising, explaining, translating) and ones it gets wrong (exact facts, recent events, arithmetic, your private data), and say why for each.

The video for this lesson is being prepared

About 10 minutes, narrated in English, Hindi and Odia. The notes and the quiz below are open now.

Lesson notes

For the student

A chat assistant learned the patterns of language from a huge amount of text. It writes from those patterns and does not look anything up. That one fact explains both columns below.

What it usually does well (still worth reading)

  • Drafting: a leave letter, a shop message or a notice, from your points
  • Summarising: long text you paste in, cut to the key points; the facts should come from your text, so check the summary against it
  • Explaining: a topic in plain words, at your level
  • Translating: between languages it saw plenty of; English to Hindi usually comes out well, Odia may need a closer read

What it often gets wrong (check before you use it)

  • Exact facts: it can state a wrong date, a wrong name or a book that does not exist, as smoothly as a right one (module 5 shows why, and how to check)
  • Recent events: it learned from text up to some point in time, so later news may be missing unless the app searches the web for you
  • Arithmetic: the digits of a total are predicted like any other text, not calculated; short sums often come out right, long or exact ones can be wrong. Some apps hand sums to a calculator or a small program, but you cannot always tell
  • Your private data: it does not know your marks, your bank balance or your office files unless you give them (module 5 says what never to give). Some apps can connect to your files or remember earlier chats; it still knows only what it is given

The question that sorts any task

  • Is the job shaping words, or supplying a fact?
  • Shaping words you give it, or common ideas: usually good; read it once
  • An exact fact, a recent event or a long sum: check it with a calculator, an official page or a person who knows
  • Anything about you: it knows only what you type

The ten-task sort from the lesson

  • Does well (6): a leave letter, summarising a pasted circular, explaining a loan, a recipe into Hindi, ideas for a farewell speech, a more polite message
  • Gets wrong (4): the exact total of 40 prices (arithmetic), today's train delays (recent), her bank balance (private), the exact year a law was passed (exact fact)

The trap

  • Wrong: it is a computer, so its sums are right; it read so much, so it knows today's news; it sounds sure, so the fact is right; it knows my marks and my account
  • Right: use it to draft, summarise, explain and translate; check long sums with a calculator; check dates, names and news at the source; give it the text it needs, then read the reply

Try it

  • In your notes file, write ten tasks you might bring to a chat assistant this month, at work, at college or at home
  • Sort them into two columns, does well and gets wrong, and write the reason next to each in a few words (shaping words, exact fact, recent event, sum, private data)
  • Pick one task from each column and ask a chat assistant. Read the does-well reply once. For the gets-wrong reply, check it: a calculator for a sum, an official page or a newspaper for a fact or a date
  • Did the check change anything? Write one line on what you found

Lesson quiz

Checked in your browser. Nothing is sent or saved.

5 questions

Question 1 · easy

Which list holds the four kinds of jobs a chat assistant is usually good at?

Question 2 · easy

Meena teaches Class 6 in Puri. She wants help from a chat assistant with four tasks. Which one is it usually good at?

Question 3 · medium

Asha is a tailor in Bhubaneswar. She asks a chat assistant to add 18 customer payments and give the month's exact total. The reply shows a neat total in rupees. What should she do?

Question 4 · medium

Ravi, a clerk in Angul, pastes a six-page circular on new office timings and asks for five key points. Why is this task usually safe?

Question 5 · hard

Sanjay, a college student in Jajpur, lists six tasks for a chat assistant:
- 1. Turn his points into a leave application
- 2. The exact cut-off marks of an exam, announced this week
- 3. Explain what a fixed deposit is, in simple words
- 4. The total of 35 expenses, to the exact rupee
- 5. Put a hostel notice from English into Hindi
- 6. His college roll number

How many go in the gets wrong column?

How a language model learns: patterns from textNext: The words everyone uses: model, parameters, training, inference, GPT