> ## Documentation Index
> Fetch the complete documentation index at: https://docs.daydream.live/llms.txt
> Use this file to discover all available pages before exploring further.

# StreamDiffusion V2

> Streaming inference pipeline and autoregressive video diffusion model

# StreamDiffusion V2 Pipeline

[StreamDiffusionV2](https://streamdiffusionv2.github.io/) is a streaming inference pipeline and autoregressive video diffusion model from the creators of the original [StreamDiffusion](https://github.com/cumulo-autumn/StreamDiffusion) project.

The model is trained using [Self-Forcing](https://self-forcing.github.io/) on Wan2.1 1.3b with modifications to support streaming.

### At a Glance

|                    |              |
| :----------------- | :----------- |
| **Base Model**     | Wan2.1 1.3B  |
| **Estimated VRAM** | \~20GB       |
| **Training**       | Self-Forcing |
| **LoRA Support**   | 1.3B LoRAs   |
| **VACE Support**   | Yes          |
| **T2V / V2V**      | Yes / Yes    |

***

## Examples

The following examples include timeline JSON files with the prompts used so you can try them as well.

### Evolution

<video autoPlay muted loop playsInline className="w-full rounded-xl" src="https://mintcdn.com/dd/AAjWd4fLnLXCaBsy/images/scope/reference/pipelines/streamdiffusion-v2/evolution.mp4?fit=max&auto=format&n=AAjWd4fLnLXCaBsy&q=85&s=940bcb0c825c898ea52e2a4564985b9f" data-path="images/scope/reference/pipelines/streamdiffusion-v2/evolution.mp4" />

<Card title="Timeline JSON file" icon="file-code" href="/workflows/scope/pipelines/streamdiffusion-v2/timeline-evolution.json">
  Download the timeline to try this example
</Card>

### Feline

<video autoPlay muted loop playsInline className="w-full rounded-xl" src="https://mintcdn.com/dd/AAjWd4fLnLXCaBsy/images/scope/reference/pipelines/streamdiffusion-v2/feline.mp4?fit=max&auto=format&n=AAjWd4fLnLXCaBsy&q=85&s=a2c218bf7db1e2a64025fceb87f2e217" data-path="images/scope/reference/pipelines/streamdiffusion-v2/feline.mp4" />

<Card title="Timeline JSON file" icon="file-code" href="/workflows/scope/pipelines/streamdiffusion-v2/timeline-feline.json">
  Download the timeline to try this example
</Card>

### Prey

<video autoPlay muted loop playsInline className="w-full rounded-xl" src="https://mintcdn.com/dd/AAjWd4fLnLXCaBsy/images/scope/reference/pipelines/streamdiffusion-v2/prey.mp4?fit=max&auto=format&n=AAjWd4fLnLXCaBsy&q=85&s=958fd4b32c0cf69d7de3661c73f59a84" data-path="images/scope/reference/pipelines/streamdiffusion-v2/prey.mp4" />

<Card title="Timeline JSON file" icon="file-code" href="/workflows/scope/pipelines/streamdiffusion-v2/timeline-prey.json">
  Download the timeline to try this example
</Card>

***

## Resolution

The generation will be faster for smaller resolutions resulting in smoother video. Scope currently will use the input video's resolution as the output resolution. The visual quality will be better at **832x480** which is the resolution that the model was trained on, but you may need a more powerful GPU in order to achieve a higher FPS.

***

## Seed

The seed parameter in the UI can be used to reproduce generations. If you like the generation for a certain seed value, input video and sequence of prompts you can re-use that value later with those same input video and prompts to reproduce the generation.

***

## Prompting

The model works better with long, detailed prompts. A helpful technique to extend prompts is to take a base prompt and then ask a LLM chatbot (eg. ChatGPT, Claude, Gemini, etc.) to write a more detailed version.

If your base prompt is:

```
"A cartoon dog jumping and then running."
```

Then, the extended prompt could be:

```
"A cartoon dog with big expressive eyes and floppy ears suddenly leaps into the frame, tail wagging, and then sprints joyfully toward the camera. Its oversized paws pound playfully on the ground, tongue hanging out in excitement. The animation style is colorful, smooth, and bouncy, with exaggerated motion to emphasize energy and fun. The background blurs slightly with speed lines, giving a lively, comic-style effect as if the dog is about to jump right into the viewer."
```

***

## Offline Generation

A test [script](https://github.com/daydreamlive/scope/blob/main/src/scope/core/pipelines/streamdiffusionv2/test.py) can be used for offline generation.

If the model weights are not downloaded yet:

```bash theme={null}
# Run from scope directory
uv run download_models --pipeline streamdiffusionv2
```

Then:

```bash theme={null}
# Run from scope directory
uv run -m scope.core.pipelines.streamdiffusionv2.test
```

This will create an `output.mp4` file in the `streamdiffusionv2` directory.

***

## See Also

### Other Pipelines

<Card title="LongLive" href="/scope/reference/pipelines/longlive">
  Smooth prompt transitions and extended generation from Nvidia
</Card>

<Card title="Krea Realtime" href="/scope/reference/pipelines/krea-realtime">
  14B model for highest quality generation
</Card>

<Card title="RewardForcing" href="/scope/reference/pipelines/reward-forcing">
  Reward-matched training for improved output quality
</Card>

<Card title="MemFlow" href="/scope/reference/pipelines/memflow">
  Memory bank for long-context consistency
</Card>
