Posts in: Tutorials

How alpha, rank, and learning rate affect model accuracy, and whether rank-stabilized LoRA helps.

Sora, Make-a-Video and Imagen Video explained.

Tensor parallelism, from beginner to expert using PyTorch.

How to measure activation memory in PyTorch, and why the choice of activation function matters.

Let’s compare how Mistral-7b-instruct-v0.2 and Llama 2-7B-chat perform on some basic LLM prompts.

An introduction to activation memory, and how it affects GPU memory consumption during model training.

Using HPE’s AI platform to develop an early brain cancer detection machine learning model.

LLM Alignment using Direct Preference Optimization, an alternative to RLHF

How to Finetune Mistral-7B using HuggingFace + Determined

A gentle introduction to large language model prompting methods and terminology.