# Draft message to co-presenter

Placeholders in `[brackets]`. Three lengths — pick one.

---

## Short (recommended)

> Hi [Name],
>
> Materials for our LLM session at the summer school are at **https://sfb1709.jeffai.net** —
> slides, the notebook, and a phone-friendly version. Everything downloadable from there.
>
> Open `slides/deck.html` in a browser — single file, nothing to install. Six acts,
> ~45 min: tokens → embeddings → attention → sampling → hallucination → what it
> means for our work. All examples are myeloid, all clinical text synthetic.
>
> `notebook/llm_workshop.ipynb` is the hands-on half. It assumes no coding ability —
> everything runs on Shift+Enter with sliders and text boxes, so people can follow
> along or take it home. There's also a no-install version that opens on a phone,
> handy if Colab is a problem — it's linked from that page. `README.md` has the timings.
>
> Could you take the last ~15 minutes? Anything that doesn't overlap — fine-tuning
> vs RAG, evaluation, EU AI Act, or multimodal would all follow on well.
>
> [Your name]

---

## Full version

**Subject:** LLM session for the SFB1709 summer school — materials ready, ~15 min to fill

Hi [Name],

I've put together the materials for our *Basics of LLMs and how they work* session
at the summer school. Everything is at **https://sfb1709.jeffai.net** (and as a zip from there).

**What's there**

- `slides/deck.html` — the presentation. Just open it in a browser; it's a single
  self-contained file, works offline, no install or server needed.
- `notebook/llm_workshop.ipynb` — the hands-on part. Written for people who don't
  code: every cell is one line, and all the interaction is sliders and text boxes.
  It also explains itself, so anyone can take it home and work through it alone.
- `web/explore.html` — a no-install version that opens on a phone, in case Colab
  or the wifi lets us down.
- `notebook/llm_workshop_advanced.ipynb` + `solutions.ipynb` — the code-first
  version for anyone who wants to dig in.
- `README.md` — run-book with timings and talking points.

**Structure** — six acts, about 45 minutes, slides and notebook mirroring each other:
tokens → embeddings → attention → sampling → hallucination and grounding → what it
means for our work. The clinical examples are all myeloid (AML, MDS, MPN, CMML,
transplant) so it should land with this audience rather than feeling generic.

A few things I think will land well:

- The tokenizer widget is live — you can type into it during the talk. `t(9;22)(q34;q11)`
  costs 12 tokens for 16 characters.
- `no FLT3-ITD mutation detected` and `FLT3-ITD mutation detected` score **0.985**
  cosine similarity. Clinically opposite, numerically almost identical.
- `AML` vs `acute myeloid leukaemia` scores **0.178** in the standard general-purpose
  embedding model — it doesn't know they're the same disease.
- The default embedding model in most tutorials silently reads only the first half
  of our notes and raises no error. That one's immediately useful to anyone in the
  room building retrieval.

Every figure in the slides comes from an actual model run, not an illustration, and
all the clinical text is synthetic — written for this session, no patient data.

**Could you take the last ~15 minutes?** Anything that doesn't overlap works. My
suggestions, roughly in order of how well they'd follow on:

1. **Fine-tuning vs prompting vs RAG** — when each is worth it. I only cover the last.
2. **Evaluation** — I stop at "measure the error rate" without saying how.
3. **Regulatory** — EU AI Act high-risk obligations, what clinical validation means
   for a system whose output changes when you re-prompt it.
4. **Multimodal** — the obvious next question from this audience is morphology and
   flow cytometry.

Happy with any of those, or something else entirely if you'd rather.

**One thing to know:** the notebook's final section calls our Heidelberg LiteLLM
endpoint. If it's not reachable (e.g. from Colab), it automatically falls back to
recorded responses and says so clearly on screen — so the session can't break. I'll
confirm which way it goes before the day.

Let me know what you'd like to take and I'll adjust my timings to fit.

[Your name]

---

## Shorter version (Slack / Teams)

> Hi [Name] — materials for the LLM session are at https://sfb1709.jeffai.net.
>
> `slides/deck.html` opens straight in a browser (self-contained, works offline).
> `notebook/llm_workshop.ipynb` is the hands-on half — no coding needed, sliders and
> text boxes. `README.md` has the run-book and timings.
>
> Six acts, ~45 min: tokens → embeddings → attention → sampling → hallucination →
> implications. All examples are myeloid, all clinical text is synthetic.
>
> Could you take the last ~15? Good options that don't overlap: fine-tuning vs RAG,
> evaluation methodology, EU AI Act / regulatory, or multimodal. Whatever you fancy.
>
> Shout if you want to run through it beforehand.
