Inputs
Note: When a reference image is provided, the first image in the batch is upscaled to the requested
width and height using bilinear interpolation and encoded with the VAE. That reference latent is attached to the positive conditioning, while a zero-filled latent of the same shape is attached to the negative conditioning. When audio_encoder_output is provided, the audio embeddings are interpolated and attached to the positive conditioning, while a zero-filled audio embedding is attached to the negative conditioning. If either optional input is omitted, zero-filled placeholder tensors are used: a zero reference latent of shape [batch_size, 16, 1, height // 8, width // 8] and/or zero audio embeddings of shape [batch_size, latent_t + 1, 8, 5, 1280], where latent_t = ((length - 1) // 4) + 1.
Outputs
This documentation was AI-generated. If you find any errors or have suggestions for improvement, please feel free to contribute! Edit on GitHub
Source fingerprint (SHA-256):
db674a4a00729a8715988030083e2858f958cd21de73bbbe4ed6d76f5f539419