• 1 Post
  • 8 Comments
Joined 1 year ago
cake
Cake day: July 29th, 2023

help-circle

  • You’re the best, thanks so much for trying it and getting it working!

    I don’t think it’s ever not worth chasing improved performance, so I’m definitely going to continue looking for optimizations. While cannibalizing the code for Comfy and A1111, I saw a lot (and I mean a lot) of shortcuts being made over the official Stability code release that improves performance in specific situations. I’m going to try and see how I can leverage some of those shortcuts into options for the user to tune to their hardware.

    This latest release has attracted some more developer attention (and also some inquiries from hosting providers about offering Enfugue in the cloud!) I’m hoping that some of the authors of those improvements find their way to the Enfugue repository and perhaps are inspired to contribute.

    With that being said, TensorRT will definitely knock your socks off in terms of speed if you haven’t used it before, if you’ve got the hardware for it. I’d be happy to troubleshoot whatever went wrong with your Windows install - there should be up to three enfugue-engine.log files in your ~/.cache/ directory that will have more information about what went wrong, if you’d like to share them here (or we can start a GitHub thread if you have that.)

    Thank you again for all your help!




  • I can’t thank you enough for linking that!!!

    It made me realize that there must have been a way to effectively downcast without getting NaN’s. There’s just no way that app could work on the devices it does with SDXL without having figured it out, so I scoured the web for references and dug in to figure it out. I’m happy to say I got it working on my M1 Pro! That also means memory usage is cut down by about a third, and speed is up by about 50% on Mac in general thanks to being able to work in half-precision instead of full.

    I was able to do the same 512x512 20 steps in 17 seconds using a fine-tuned model (Realistic Vision 5.) SDXL took it’s sweet time coming in at almost 3 minutes, so yeah probably not my usual workflow, but SDXL isn’t even in my usual workflow on my 3090 Ti Windows/Ubuntu hybrid machine. I still use TensorRT and fine-tuned SD 1.5 models - 512x512 is roughly 3 seconds on that, but the beautiful part is when doing a 2000-iteration upscale and TensorRT caps out at ~30 it/s on Windows or ~40 it/s on Linux.

    I have a little bit more testing to do for this, but I’m going to be releasing a 0.2.1 build in the next couple days. I would love it if you would give it another shot - I’ll send you a message with a link, if that’s okay with you!

    With respect to AMD - that’s a complicated answer, I’m trying to work with some AMD users to test out the combination of dependencies that will work for them. I’m not sure if anyone has managed to successfully use the GPU for AI on the steam deck, but I do know officially ROCm is unsupported and will be for the foreseeable future on the deck. I’ve seen people successfully use Stable Diffusion with CPU inference on it, which Enfugue will allow - but those same people reported it took half an hour to generate a single image on the deck, so I’m not sure it’s worth trying.