Skip to content

Conversation

@clementchadebec
Copy link
Collaborator

What does this PR do?

Fixes # (issue)

Before submitting

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

sayakpaul and others added 30 commits January 23, 2025 08:22
* Add IP-Adapter example to Flux docs

* Apply suggestions from code review

Co-authored-by: Sayak Paul <[email protected]>

---------

Co-authored-by: Sayak Paul <[email protected]>
We already set the unet to requires grad false at line 506

Co-authored-by: Aryan <[email protected]>
* add pipeline_stable_diffusion_xl_attentive_eraser

* add pipeline_stable_diffusion_xl_attentive_eraser_make_style

* make style and add example output

* update Docs

Co-authored-by: Other Contributor <[email protected]>

* add Oral

Co-authored-by: Other Contributor <[email protected]>

* update_review

Co-authored-by: Other Contributor <[email protected]>

* update_review_ms

Co-authored-by: Other Contributor <[email protected]>

---------

Co-authored-by: Other Contributor <[email protected]>
* NPU Adaption for Sanna


---------

Co-authored-by: J石页 <[email protected]>
Co-authored-by: Sayak Paul <[email protected]>
Sigmoid scheduler in scheduling_ddpm.py docs
* create a script to train vae

* update main.py

* update train_autoencoderkl.py

* update train_autoencoderkl.py

* add a check of --pretrained_model_name_or_path and --model_config_name_or_path

* remove the comment, remove diffusers in requiremnets.txt, add validation_image ote

* update autoencoderkl.py

* quality

---------

Co-authored-by: Sayak Paul <[email protected]>
)

* add community pipeline for semantic guidance for flux

* fix imports in community pipeline for semantic guidance for flux

* Update examples/community/pipeline_flux_semantic_guidance.py

Co-authored-by: hlky <[email protected]>

* fix community pipeline for semantic guidance for flux

---------

Co-authored-by: Linoy Tsaban <[email protected]>
Co-authored-by: hlky <[email protected]>
* [training] Convert to ImageFolder script

* make
huggingface#10663)

controlnet union XL, make control_image immutible

when this argument is passed a list, __call__
modifies its content, since it is pass by reference
the list passed by the caller gets its content
modified unexpectedly

make a copy at method intro so this does not happen

Co-authored-by: Teriks <[email protected]>
* start pyramid attention broadcast

* add coauthor

Co-Authored-By: Xuanlei Zhao <[email protected]>

* update

* make style

* update

* make style

* add docs

* add tests

* update

* Update docs/source/en/api/pipelines/cogvideox.md

Co-authored-by: Steven Liu <[email protected]>

* Update docs/source/en/api/pipelines/cogvideox.md

Co-authored-by: Steven Liu <[email protected]>

* Pyramid Attention Broadcast rewrite + introduce hooks (huggingface#9826)

* rewrite implementation with hooks

* make style

* update

* merge pyramid-attention-rewrite-2

* make style

* remove changes from latte transformer

* revert docs changes

* better debug message

* add todos for future

* update tests

* make style

* cleanup

* fix

* improve log message; fix latte test

* refactor

* update

* update

* update

* revert changes to tests

* update docs

* update tests

* Apply suggestions from code review

Co-authored-by: Steven Liu <[email protected]>

* update

* fix flux test

* reorder

* refactor

* make fix-copies

* update docs

* fixes

* more fixes

* make style

* update tests

* update code example

* make fix-copies

* refactor based on reviews

* use maybe_free_model_hooks

* CacheMixin

* make style

* update

* add current_timestep property; update docs

* make fix-copies

* update

* improve tests

* try circular import fix

* apply suggestions from review

* address review comments

* Apply suggestions from code review

* refactor hook implementation

* add test suite for hooks

* PAB Refactor (huggingface#10667)

* update

* update

* update

---------

Co-authored-by: DN6 <[email protected]>

* update

* fix remove hook behaviour

---------

Co-authored-by: Xuanlei Zhao <[email protected]>
Co-authored-by: Steven Liu <[email protected]>
Co-authored-by: DN6 <[email protected]>
…de (huggingface#10600)

* fix: refer to use_framewise_encoding on AutoencoderKLHunyuanVideo._encode

* fix: comment about tile_sample_min_num_frames

---------

Co-authored-by: Aryan <[email protected]>
* update

* remove unused fn

* apply suggestions based on review

* update + cleanup 🧹

* more cleanup 🧹

* make fix-copies

* update test
…_max_memory` (huggingface#10669)

* conditionally check if compute capability is met.

* log info.

* fix condition.

* updates

* updates

* updates

* updates
…ity pipelines in float16 mode (huggingface#10670)

Fix pipeline dtype unexpected change when using SDXL reference community pipelines
…10552)

* support StableDiffusionAdapterPipeline.from_single_file

* make style

---------

Co-authored-by: Teriks <[email protected]>
Co-authored-by: hlky <[email protected]>
* fix enable memory efficient attention on ROCm

while calling CK implementation

* Update attention_processor.py

refactor of picking a set element
)

* Update train_instruct_pix2pix.py

Fix inconsistent random transform in instruct_pix2pix

* Update train_instruct_pix2pix_sdxl.py
…ity_for_timestep_sampling (huggingface#10699)

* feat(training-utils): support device and dtype params in compute_density_for_timestep_sampling

* chore: update type hint

* refactor: use union for type hint

---------

Co-authored-by: Sayak Paul <[email protected]>
a-r-r-o-w and others added 29 commits March 24, 2025 23:25
…gingface#11101)

* update

* Update docs/source/en/optimization/memory.md

* Apply suggestions from code review

Co-authored-by: Dhruv Nair <[email protected]>

* apply review suggestions

* update

---------

Co-authored-by: Dhruv Nair <[email protected]>
…ad_lora_adapter` in PeftAdapterMixin class (huggingface#11155)

set self._hf_peft_config_loaded to True on successful lora load

Sets the `_hf_peft_config_loaded` flag if a LoRA is successfully loaded in `load_lora_adapter`. Fixes bug huggingface/issues/11148

Co-authored-by: Sayak Paul <[email protected]>
…face#11167)

* update

* raise warning and round to nearest multiple of scale factor
…already set (huggingface#10918)

* Bug fix in ltx

* Assume packed latents.

---------

Co-authored-by: Dhruv Nair <[email protected]>
Co-authored-by: YiYi Xu <[email protected]>
* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
* rewrite memory count without implicitly using dimensions by @ic-synth

* replace F.pad by built-in padding in Conv3D

* in-place sums to reduce memory allocations

* fixed trailing whitespace

* file reformatted

* in-place sums

* simpler in-place expressions

* removed in-place sum, may affect backward propagation logic

* removed in-place sum, may affect backward propagation logic

* removed in-place sum, may affect backward propagation logic

* reverted change
…e dtype (huggingface#10301)

* allow models to run with a user-provided dtype map instead of a single dtype

* make style

* Add warning, change `_` to `default`

* make style

* add test

* handle shared tensors

* remove warning

---------

Co-authored-by: Sayak Paul <[email protected]>
…huggingface#11197)

* add xpu part

* fix more cases

* remove some cases

* no canny

* format fix
)

* Fix enable_sequential_cpu_offload in CogView4Pipeline

* make fix-copies
added onnxruntime-vitisai for custom build onnxruntime pkg
…uggingface#11188)

* feat: [Community Pipeline] - FaithDiff Stable Diffusion XL Pipeline for Image SR.

* added pipeline
…ngface#7615)

* model card gen code

* push modelcard creation

* remove optional from params

* add import

* add use_dora check

* correct lora var use in tags

* make style && make quality

---------

Co-authored-by: Aryan <[email protected]>
Co-authored-by: Sayak Paul <[email protected]>
Change LoRA Loader to StableDiffusion

Replace the SDXL LoRA Loader Mixin inheritance with the StableDiffusion one
@clementchadebec clementchadebec merged commit e82eefd into clipdrop-main Apr 29, 2025
7 of 24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.