Running Stable Diffusion Inference with FP32 and FP16 on Intel® Data Center GPU Flex Series using Intel® Extension for TensorFlow*

Overview

This document has instructions for running Stable Diffusion inference using Intel® Extension for TensorFlow* with Intel® Data Center GPU Flex Series.

Requirements

Item	Detail
Host machine	Intel® Data Center GPU Flex Series 170
Drivers	GPU-compatible drivers need to be installed: Download Driver
Software	Docker*

Get Started

Quick Start Scripts

Script name	Description
run_model.sh	Runs online inference for FP32,FP16 precisions on Flex series 170

Run Using Docker

Set up Docker Image

docker pull intel/generative-ai:tf-flex-gpu-stable-diffusion-inference

Run Docker Image

The Stable Diffusion inference container contains scripts, models and libraries needed to run FP32 and FP16 inference. You will need to provide an output directory where log files will be written.

export PRECISION=<provide fp32 or fp16 as precision input>
export OUTPUT_DIR=<path to output directory>

IMAGE_NAME=intel/generative-ai:tf-flex-gpu-stable-diffusion-inference
SCRIPT=run_model.sh

docker run \
  --device=/dev/dri \
  --ipc=host \
  --privileged \
  --env PRECISION=${PRECISION} \
  --env OUTPUT_DIR=${OUTPUT_DIR} \
  --env http_proxy=${http_proxy} \
  --env https_proxy=${https_proxy} \
  --env no_proxy=${no_proxy} \
  --volume ${OUTPUT_DIR}:${OUTPUT_DIR} \
  --rm -it \
  $IMAGE_NAME \
  /bin/bash $SCRIPT

Documentation and Sources

GitHub* Repository

Support

Support for Intel® Extension for TensorFlow* is found via the Intel® AI Analytics Toolkit. Additionally, the Intel® Extension for TensorFlow* team tracks both bugs and enhancement requests using GitHub issues. Before submitting a suggestion or bug report, please search the GitHub issues to see if your issue has already been reported.

License Agreement

LEGAL NOTICE: By accessing, downloading or using this software and any required dependent software (the “Software Package”), you agree to the terms and conditions of the software license agreements for the Software Package, which may also include notices, disclaimers, or license terms for third party software included with the Software Package. Please refer to the license file for additional details.