Skip to content

UI Changes #57

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 234 commits into
base: main
Choose a base branch
from
Open

UI Changes #57

wants to merge 234 commits into from

Conversation

BuffMcBigHuge
Copy link
Collaborator

Added better column handling - added floating input.

ryanontheinside and others added 25 commits July 18, 2025 12:43
* testing

* text to image working

* img2img working

* example update

* update examples

* successful engine build

* ipadapter tensorrt acceleration

* remove test scripts

* remove test script

* safe import

* update test script

* working

* button up

* bake with strength | name engine dir

* cleanup wrapper

* cache embeddings

* comment some prints

* backtrack multiple ipadapter support

this will be done in subsequent phase

* remove test scripts

* dynamic ipadapter token

* plus support

* rm erroneous commit

* move config

* erroneous comment

* demo spike

* prompts working

* composable conditioning wrapper

* bugfix wrapper

* wrapper fix

* remove print statement

* fix prompt embeds

* add ipadapter support to demo

* remove extranneous exports

* remove extranneous backwards compat

* remove extrannous controlnet exports

* comment cleanup

* rm ipadapter readme

* cleanup prints

* remove debug script

* cleanup config logic

* remove defensive import handling

* remove example bloat

* remove extranneous demo

* rm print statements

* remove prints, update todo

* fix config upload

* fix  style image update

* remove copywritten image

* leverage preprocessor system

* remove print statements

* prompt update perf fix

* remove heuristic ipadapter detection

# Conflicts:
#	src/streamdiffusion/ipadapter/base_ipadapter_pipeline.py

* Ryan/feat/02 ipadapter on sdxl (#32)

* merge sdxl

Merged changes from ryan/feat/ipadapter-on-sdxl branch with marco/feat/sdxl branch, resolving conflicts in:
src/streamdiffusion/pipeline.py: Integrated SDXL UNet calling conventions with comprehensive conditioning support, retained SDXL added_cond_kwargs handling and TensorRT vs PyTorch UNet detection
demo/realtime-img2img/main.py: Combined IPAdapter info response with resolution calculation, merged pipeline creation logic for both IPAdapter and SDXL support
src/streamdiffusion/acceleration/tensorrt/__init__.py: Unified embedding dimension detection for both SDXL (2048) and SD1.5 (768), integrated IPAdapter and ControlNet TensorRT support
src/streamdiffusion/controlnet/base_controlnet_pipeline.py: Merged ControlNet conditioning logic with SDXL compatibility
src/streamdiffusion/stream_parameter_updater.py: Integrated IPAdapter embedding enhancers with parameter update system
src/streamdiffusion/wrapper.py: Resolved TensorRT engine compilation conflicts, unified IPAdapter and SDXL model loading paths

* handle sdxl in conditioning wrapper

* image encoder download fix

* remove extranneous ipadapter pipeline abstraction

* remove heuristic ipadapter detection

* consolidate model detection

* Ryan/feat/03 controlnet on ipadapter on sdxl (#33)

* controlnet enabled unet engine

* remove prints

* cnet engine support

* consolidate utilities logging

* uncomment fallback

* consolidate sdxl unet wrapper

* Fixed model detection.

* Rebuilt model detection mechanism, cleanup.

* Removal of fluff.

* More reliance on detect_model function, fix of SDXL detection for onnx export.

* Bit of cleanup and additional logging.

* Reverted controlnet/ipadapter model detection to original functions.

* add controlnet model detection

* add controlnet model detection to export

---------

Co-authored-by: BuffMcBigHuge <[email protected]>

---------

Co-authored-by: BuffMcBigHuge <[email protected]>

---------

Co-authored-by: RyanOnTheInside <[email protected]>
Co-authored-by: BuffMcBigHuge <[email protected]>
…ckage

ryan/refactor/03-ipadapter-as-package
…ventions

Ryan/refactor/01 trt wrapper conventions, ipadapter as package, preprocessor refactor
* remove logging, input/output validation

* remove logging, inputoutput from infer()

* remove logging and input output validation from unet

* remove overhead from hotpath

remove logging, input/output validation, make vram montioring in debug mode only

* remove logging from controlnet engine

* remove logger.debug

* remove HybridControlnet abstraction and pytorch fallback

* remove dead code

* add feedback preprocessor

* add feedback preprocessor support

* add blend to preprocessor

* add preprocessor metadata

* dynamic preprocessor controls

* remove erroneous variable

* unify tensorrt engine management

* remove unicode chars

* import fix

* change default acceleration

* fullscreen

* add route to get default image and makes ipadapter use it

* rgb conversion fix

* static video input control

* minimalist resolution picker

* increase max delta value

* Update resolution button
@ryanontheinside ryanontheinside deleted the branch main August 4, 2025 20:07
@ryanontheinside ryanontheinside changed the base branch from ryan/feat/cnet-spike-trt to main August 4, 2025 20:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants