Due to the costs associated with GPUs, including their startup times, a higher-performance GPU does not necessarily mean faster image generation speeds. Here are some recommendations:
If you are using the SDXL model and generating images larger than 1024*1024, we strongly recommend using the A10G. If you're using the SD 1.5 model, you can use either the T4 or A10G.
If you need to generate videos, we recommend using the A100.
The following are our test results for generating a 512x512 image using the SD 1.5 model with the default workflow (note that the times listed are average times; actual results may vary slightly):
GPU | Time |
T4 | 29.6s |
L4 | 33.5s |
A10G | 22.8s |
A100(40G) | 26.3s |
SDXL model test results:
GPU | Time |
T4 | 63.7s |
L4 | 54s |
A10G | 44.8s |
A100(40G) | 43s |
Test results for generating videos using the SVD model:
GPU | Time |
T4 | 323.3s |
L4 | 200.08s |
A10G | 135.3s |
A100(40G) | 52.8s |