RAS ACADEMY
HomeCourses
Log inSign up
RAS ACADEMY
CoursesAboutContactHelp

Terms of Use|Privacy Policy

LLM Engineering & Assurance

Intermediate8h 20m · 25 lessonsAI1000

A hands-on course in building, deploying, integrating and assuring large language models.

llmmachine-learningpytorchairagvllm

Invitation only

Peek at free lessons now — full access arrives by invitation.

Explore what’s unlocked below. When you’re invited, the rest of the course opens up.

Preview free lessons

LLM Engineering: From Scratch to Assurance is a hands-on course designed to give learners a practical understanding of how Large Language Models work, how they are built, and how they can be deployed in real-world applications. Starting from the fundamentals of tokens, embeddings, attention, and transformers, participants will build a small language model from scratch and gain an intuitive understanding of the key components behind modern LLMs.

The course then moves from theory into engineering practice, covering model inference, deployment, APIs, performance optimisation, structured outputs, and tool calling. Through practical exercises, learners will build and integrate LLM-powered systems, progressing from a minimal model to a functional application that can interact with external tools and services.

The final part focuses on evaluating and assuring LLM systems for reliable and responsible deployment. Learners will explore hallucination, robustness, security, adversarial testing, red teaming, and evaluation techniques, with applications across defence, government, healthcare, finance, and other regulated or safety-critical sectors. The course concludes with a hands-on capstone where participants build, deploy, evaluate, and assure a complete LLM system.

No learning outcomes listed yet.

  • Basic programming experience
  • preferably with Python.
  • Basic understanding of machine learning concepts.
  • Familiarity with Python libraries such as NumPy and PyTorch is helpful but not required.
  • Basic knowledge of neural networks is recommended.
  • Basic command-line and Git experience is helpful.
  • No prior experience building or training LLMs is required.

Lessons

0/25 done

module 1 - Foundations

  • 1LLM Fundamentals: From Text to IntelligencePreview
  • Tokens, Embeddings & Positional Encoding
  • Attention & the Transformer Architecture
  • Training, Inference & Next-Token Prediction
  • Hands-On: Build a Tiny Language Model
  • Module 2 - Build an LLM

    • Building a Tokenizer & Dataset
    • Implementing Self-Attention
    • Building a Minimal Transformer
    • Training, Loss & Optimisation
    • Hands-On: Train Your Own Mini-LLM

    Module 3 - Deploy & Integrate LLMs

    • LLM Inference & Model Serving
    • APIs, Quantisation & Performance
    • Prompting, Structured Output & Context
    • Tool Calling & Function Calling
    • Hands-On: Build a Tool-Using LLM

    Module 4 - Evaluate & Assure LLMs

    • LLM Evaluation: What Does “Good” Mean?
    • Hallucination, Grounding & Reliability
    • Safety, Security & Adversarial Testing
    • Red Teaming & Failure Analysis
    • Hands-On: Build an LLM Evaluation Pipeline

    Module 5 - Apply LLMs to Real-World Systems

    • RAG & Knowledge-Grounded LLMs
    • Agents, Tools & Human-in-the-Loop
    • LLM System Architecture & Production Deployment
    • LLM Assurance in Defence & Regulated Sectors
    • Capstone: Build, Deploy & Assure an LLM System