forked from pschroedl/StreamDiffusion
-
Notifications
You must be signed in to change notification settings - Fork 1
UI Changes #57
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
BuffMcBigHuge
wants to merge
234
commits into
main
Choose a base branch
from
marco/fix/frontend-dev
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
UI Changes #57
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# Conflicts: # examples/controlnet/controlnet_webcam_demo.py
this is to refactor to follow the existing codebase architecture more closely. with a tight timeline, SDXL support is not a priority. TODO todo: look at state before this commit and fix SDXL
Ryan/fix/demo prompt fix
* testing * text to image working * img2img working * example update * update examples * successful engine build * ipadapter tensorrt acceleration * remove test scripts * remove test script * safe import * update test script * working * button up * bake with strength | name engine dir * cleanup wrapper * cache embeddings * comment some prints * backtrack multiple ipadapter support this will be done in subsequent phase * remove test scripts * dynamic ipadapter token * plus support * rm erroneous commit * move config * erroneous comment * demo spike * prompts working * composable conditioning wrapper * bugfix wrapper * wrapper fix * remove print statement * fix prompt embeds * add ipadapter support to demo * remove extranneous exports * remove extranneous backwards compat * remove extrannous controlnet exports * comment cleanup * rm ipadapter readme * cleanup prints * remove debug script * cleanup config logic * remove defensive import handling * remove example bloat * remove extranneous demo * rm print statements * remove prints, update todo * fix config upload * fix style image update * remove copywritten image * leverage preprocessor system * remove print statements * prompt update perf fix * remove heuristic ipadapter detection # Conflicts: # src/streamdiffusion/ipadapter/base_ipadapter_pipeline.py * Ryan/feat/02 ipadapter on sdxl (#32) * merge sdxl Merged changes from ryan/feat/ipadapter-on-sdxl branch with marco/feat/sdxl branch, resolving conflicts in: src/streamdiffusion/pipeline.py: Integrated SDXL UNet calling conventions with comprehensive conditioning support, retained SDXL added_cond_kwargs handling and TensorRT vs PyTorch UNet detection demo/realtime-img2img/main.py: Combined IPAdapter info response with resolution calculation, merged pipeline creation logic for both IPAdapter and SDXL support src/streamdiffusion/acceleration/tensorrt/__init__.py: Unified embedding dimension detection for both SDXL (2048) and SD1.5 (768), integrated IPAdapter and ControlNet TensorRT support src/streamdiffusion/controlnet/base_controlnet_pipeline.py: Merged ControlNet conditioning logic with SDXL compatibility src/streamdiffusion/stream_parameter_updater.py: Integrated IPAdapter embedding enhancers with parameter update system src/streamdiffusion/wrapper.py: Resolved TensorRT engine compilation conflicts, unified IPAdapter and SDXL model loading paths * handle sdxl in conditioning wrapper * image encoder download fix * remove extranneous ipadapter pipeline abstraction * remove heuristic ipadapter detection * consolidate model detection * Ryan/feat/03 controlnet on ipadapter on sdxl (#33) * controlnet enabled unet engine * remove prints * cnet engine support * consolidate utilities logging * uncomment fallback * consolidate sdxl unet wrapper * Fixed model detection. * Rebuilt model detection mechanism, cleanup. * Removal of fluff. * More reliance on detect_model function, fix of SDXL detection for onnx export. * Bit of cleanup and additional logging. * Reverted controlnet/ipadapter model detection to original functions. * add controlnet model detection * add controlnet model detection to export --------- Co-authored-by: BuffMcBigHuge <[email protected]> --------- Co-authored-by: BuffMcBigHuge <[email protected]> --------- Co-authored-by: RyanOnTheInside <[email protected]> Co-authored-by: BuffMcBigHuge <[email protected]>
…ckage ryan/refactor/03-ipadapter-as-package
Ryan/refactor/02 preprocessor
…ventions Ryan/refactor/01 trt wrapper conventions, ipadapter as package, preprocessor refactor
remove legacy docs
set use cuda graph true in wrapper
* remove logging, input/output validation * remove logging, inputoutput from infer() * remove logging and input output validation from unet * remove overhead from hotpath remove logging, input/output validation, make vram montioring in debug mode only * remove logging from controlnet engine * remove logger.debug * remove HybridControlnet abstraction and pytorch fallback * remove dead code * add feedback preprocessor * add feedback preprocessor support * add blend to preprocessor * add preprocessor metadata * dynamic preprocessor controls * remove erroneous variable * unify tensorrt engine management * remove unicode chars * import fix * change default acceleration * fullscreen * add route to get default image and makes ipadapter use it * rgb conversion fix * static video input control * minimalist resolution picker * increase max delta value * Update resolution button
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Added better column handling - added floating input.