Generative Semantic Nursing

Generative Semantic Nursing is a task of intervening the generative process on the fly during inference time to improve the faithfulness of the generated images. It works by carefully manipulating of latents during the denoising process of a pre-trained text-to-image diffusion model.

Source: Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models