PersonaHOI

January 13, 2025 · View on GitHub

This is the official repository for the paper "PersonaHOI: Effortlessly Improving Personalized Face with Human-Object Interaction Generation" (arxiv). Our components seamlessly integrate into existing personalized face generation models, such as FastComposer, IP-Adaptor, and PhotoMaker. We extend our gratitude to the developers of these excellent frameworks for their foundational contributions.

Personalized Face with Human-Object Interaction (HOI) Generation

Figure 1: Overview of PersonaHOI

Overview of PersonaHOI illustrating how it improves personalized face generation by incorporating human-object interactions.

Integrating General Personalization with HOI

Figure 2: Examples of General Personalization with HOI

Examples of integrating general personalization with HOI across diverse scenarios. From top to bottom, the rows illustrate Style+HOI, Context+HOI, and Accessory+HOI.

Integrating ControlNet into PersonaHOI

Figure 3: Integrating ControlNet into PersonaHOI

Examples of integrating ControlNet into the baseline FastComposer within our PersonaHOI framework to provide precise HOI layout.

Codes coming soon