[Feature] The import messages "Unsloth: Will patch your computer" and "Unsloth Zoo will now patch everything" should be more precise

[vadimkantorov]

and list exactly what patches they are applying and where

Hopefully, these patches can be accepted by upstream PyTorch and HF some day and not be needed :) or at least, be registered with them in a more graceful way than patching

[mmathew23]

There are a lot of patches, and they're model dependent so by default we don't print the logs of this. You can try os.environ["UNSLOTH_ENABLE_LOGGING"] = 1 to get more verbose information.

[vadimkantorov]

"will patch your computer" and "will now patch everything" is really scary :)

are any patches happening at the import time? when the model name is not available yet

[mmathew23]

Yes, many of the patches are happening at import time. I'd recommend running in a virtualenv.

[vadimkantorov]

IMO all these patches should be always verbose-logged by default and explained what exactly is patched and how... spooky action at a distance is scary, especially if it's persistent

[mmathew23]

Thank you for the feedback. I dropped a note to the team as well. In general we want to keep the logging on the cleaner side by default, and going forward will make sure to consider what additional logging to add in future releases.

[woct0rdho]

I just want to say that 'patch your computer' indeed sounds uncomfortable for people who know what're in their computers. Maybe a better wording is 'patch Transformer and other libraries'.

[vadimkantorov]

patch everything is also scary... I wish there was a brief but exhaustive list of what's being patched and how

Maybe what could be done is adding an import unslothconfig; unslothconfig.apply_only_these_patches(["this", "that"]), so that later import unsloth does only what's explicitly specified...

[rolandtannous]

There is no current plan for this, however i'll move this to discussions to warrant it potential future consideration
@mmathew23 @vadimkantorov @woct0rdho