> ## Documentation Index
> Fetch the complete documentation index at: https://wwwpoc.ibm.com/llms.txt
> Use this file to discover all available pages before exploring further.

# LM Studio

> Learn how to run Granite models with LM Studio.

## Overview

In this guide, we'll be using [LM Studio](https://lmstudio.ai/) to run a Granite
model locally in few simple steps.

LM Studio is a beginner-friendly desktop application for running Large Language
Models (LLMs) and Embedding models locally on Mac, Windows, and Linux. It
provides both a familiar chat interface and a built-in local server for using
models programmatically in your code. The app features easy model browsing and
downloading from Hugging Face, plus the ability to chat with PDF and Word
documents.

## Step 1: Download and start LM Studio

Visit [https://lmstudio.ai](https://lmstudio.ai) and download the latest version of LM Studio
compatible with your operating system. Once the download is complete, install
and launch the application.

<img src="https://mintcdn.com/ibmgranite/m3dncz2KrKeb3pcV/granite/docs/images/lmstudio/granite-lm-studio-step1.png?fit=max&auto=format&n=m3dncz2KrKeb3pcV&q=85&s=4fba7cb63bd197fc4e440abaf5ef8d20" alt="Granite LM Studio step 1" width="3094" height="2120" data-path="granite/docs/images/lmstudio/granite-lm-studio-step1.png" />

## Step 2: Search and download Granite

Use the search bar in LM Studio to find Granite. A list of compatible models
will be displayed. In this guide, we will select and download the Granite 4 H Tiny
model. Please note that this is a large file, so the download may take some time
to complete.

<img src="https://mintcdn.com/ibmgranite/m3dncz2KrKeb3pcV/granite/docs/images/lmstudio/granite-lm-studio-step2.png?fit=max&auto=format&n=m3dncz2KrKeb3pcV&q=85&s=d6d14403a4ae6ff824f48e37bc70442c" alt="Granite LM Studio step 2" width="3094" height="2120" data-path="granite/docs/images/lmstudio/granite-lm-studio-step2.png" />

## Step 3: Load the model and start prompting

After the download is complete, load the Granite 4 H Tiny model in LM Studio. You
can now begin using the model by entering your prompts and exploring its
capabilities!

<img src="https://mintcdn.com/ibmgranite/m3dncz2KrKeb3pcV/granite/docs/images/lmstudio/granite-lm-studio-step3.png?fit=max&auto=format&n=m3dncz2KrKeb3pcV&q=85&s=17db45c6a83e2d8c2968335f32fc1e4b" alt="Granite LM Studio step 3" width="3094" height="2120" data-path="granite/docs/images/lmstudio/granite-lm-studio-step3.png" />

<img src="https://mintcdn.com/ibmgranite/m3dncz2KrKeb3pcV/granite/docs/images/lmstudio/granite-lm-studio-step4.png?fit=max&auto=format&n=m3dncz2KrKeb3pcV&q=85&s=986095d07268c3014fc65d929f25f8db" alt="Granite LM Studio step 4" width="3094" height="2120" data-path="granite/docs/images/lmstudio/granite-lm-studio-step4.png" />

## Step 4 (advanced): Tap into the developer settings

Head over to the developer tab (underneath the chat tab) to easily manage a
local LLM server running on localhost, or on your local network. Press Ctrl /
Cmd + L to open the model loader. You can load one or more models into memory
and tweak their settings such as context length, GPU offload amount, or default
system prompt.

Once you load models into memory they will be accessible via an OpenAI-like
interface. Read more about this in
[LM Studio docs](https://lmstudio.ai/docs/api).

<img src="https://mintcdn.com/ibmgranite/m3dncz2KrKeb3pcV/granite/docs/images/lmstudio/granite-lm-studio-step5.png?fit=max&auto=format&n=m3dncz2KrKeb3pcV&q=85&s=cc53e9e0853c6b151f8c580ff6e0cdbd" alt="Granite LM Studio step 5" width="3094" height="2120" data-path="granite/docs/images/lmstudio/granite-lm-studio-step5.png" />
