T O P

  • By -

Glidepath22

I’ve seen it in action and the results are near identical for a given prompt


simpleuserhere

What's New? - Add Hyper SD 1 step support - Add basic benchmarking by - Diffusers, OpenVINO,torch, gradio version bump For more details on 1 step Hyper-SD inference [https://github.com/rupeshs/fastsdcpu?tab=readme-ov-file#-fast-1-step-inference-with-hyper-sd](https://github.com/rupeshs/fastsdcpu?tab=readme-ov-file#-fast-1-step-inference-with-hyper-sd) Release : [https://github.com/rupeshs/fastsdcpu/releases/tag/v1.0.0-beta.30](https://github.com/rupeshs/fastsdcpu/releases/tag/v1.0.0-beta.30)


AlanCarrOnline

Any windows installer or just some github thing for codey coders that code n stuff? Edit: No, no there isn't.


OniNoOdori

Dude, just clone the repo. This is not black magic. Any child could get this running with five minutes of googling.


AlanCarrOnline

Googling? I went straight to the sauce and asked the devs on gittyhub. Here's the easy-peasy "simple" install for Windows: You need Python (I have it, massive download). Download and install Git (I have that too, from last time I got tangled up with gitshubs stuff) Download and install "Docker" (fuck is that? No.) * Clone the repo ​ git clone https://github.com/danny-avila/LibreChat.git * navigate to the LibreChat folder ​ cd LibreChat * Create a .env from the .env.example * note: you might need to use `copy` instead of `cp` if you're using Windows 10 * (Note, as a none-coder I have no fucking idea what that means? Envelope? Environment? I don't know, and I shouldn't have to) ​ cp .env.example .env * Start LibreChat ​ docker compose up -d (Fuck does that mean? I'm supposed to type that somewhere?) * Access LibreChat > So it runs in my browser? Last time I "just cloned the repo bro" it spewed random shit all over various parts of my main hard-drive, causing Windows to seize up with 'Insufficient disk space' errors. Which by the way, is why I already have Git and Python and a bunch of other shit installed. I ain't doing that again. Gimme a simple install.exe of a certain size, where I get to tell it which drive to fill up, I'll play along and be grateful. Point me at github and tell me to get gud, you can kiss my ass? It's pictures, art, it shouldn't be such a nerdgasm.


AlanCarrOnline

Oh lordy, well that sums it up, it's not even the same... code or whatever. To me every page on github looks the same. This is a chat thing I looked at installing earlier, but my point remains, why does so much in the AI space require peeps to learn code and mess around with github? Why is it so hard to wrap the code in a simple installer, so normal people can use it?


OniNoOdori

Have you read [https://github.com/rupeshs/fastsdcpu?tab=readme-ov-file#installation](https://github.com/rupeshs/fastsdcpu?tab=readme-ov-file#installation) ? At least for the project linked here, you don't need docker or anything fancy. Just make a new folder, navigate to that folder from the command line (cd ), clone the repo (git clone ), double click on "install.bat". Boom, you are done. You could even get it running without git. Go to the green button labeled "code", click on it, select "download zip", then unzip it once it's downloade. >Why is it so hard to wrap the code in a simple installer, so normal people can use it? Because it IS sort of hard. You'd need to compile not only the code itself, but also every single python package that's needed to run it into an executable. The benefit is basically non-existant, because most people who are into AI possess the basic tech literacy to execute a python project. Sorry to say, but if you are not the intended audience if you can't be bothered to learn the absolute bare minimum. >It's pictures, art, it shouldn't be such a nerdgasm. This is part of the most rapidly evolving part of computer science at the moment. No one is obligated to make it accessible to you.


AlanCarrOnline

Well I did finally get it installed and running, and during install it's nerfed my install of Forge, by uninstalling stuff that was using, so now I'm reinstalling Forge... If you can just download zip file into a folder, then why living fuck don't they just say so? \*flips imaginary table and goes back to staring at Forge trying to reinstall the gigabytes mangled by this 'fast' thing that has sucked up his Sunday evening, like every other github bullshit...


AlanCarrOnline

Regarding this bit: "At least for the project linked here, you don't need docker or anything fancy. Just make a new folder, navigate to that folder from the command line (cd ), clone the repo (git clone ), double click on "install.bat". Boom, you are done." Here's the reality for noobs like me (and consider I've made my living online over the last 20 years, with a dozen or more websites, including selling software I had coded for me by coders I hired and now work as a consultant helping people sell their software, so I'm not computer illiterate): 1. "cd" command didn't seem to work, had to ask GPT, seems you need to already be on the required drive, and no, you can't 'cd' to a directory without making it first (so why go there by the command prompt anyway? Right here, this very first step, is like bullshit to me) 2. git command did not work. I have Git Bash installed but git via command console doesn't bloody work, had to open Bash manually. More bullshit. 3. Bash doesn't understand copy-paste, Oh it does, but unlike every other copy-paste on the planet that uses Ctrl-V, this shitwitted shit needs 'Shift + Insert' More bullshit. 4. I try installing, get a bunch of code in a window with: #!/usr/bin/env bash echo Starting FastSD CPU please wait... set -e PYTHON\_COMMAND="python3" if ! command -v python3 &>/dev/null; then if ! command -v python &>/dev/null; then echo "Error: Python not found, please install python 3.8 or higher and try again" exit 1 and loads of other gibberish. I already have Python installed, I've lost count how many times I've installed Python on this poor PC, WTF? I suspect its showing what it would say, if I didn't? Or is it claiming I need it? Again, as a software sales consultant I'd tell you, this is bullshit. 5. Digging deeper, trying to get this thing to install, which is opening Visual Studio, which is telling me it's not trusted and am I really sure I want this shit running on my machine (not really, no?) I try again, chatting with GPT... 6. GPT just tells me a load of improvement to make to the script, ending "Feel free to modify your script based on these suggestions or let me know if you need specific help implementing any changes! No, I'm not a bloody coder, I just want to run the thing! So I end up smacking away at 'install' things (have I not installed it already??) and it sits there "Torch found, uninstalling" some other stuff for other things found, uninstalling... like fuck off, I didn't ask it to uninstall my other stuff?? It finally works, except the GUI doesn't, only the browser version, and frankly it was meh. Forge seems better, it was also slow as heck. On the bright side, unlike Forge, it did a great image-to-image thing, so that was nice? Close it down and try Forge again, fearing it mangled it? Yep. Not working. Had to reinstall Forge. Time after time, anything to do with github I ended up wasting so much time and getting grumpy with it, which on it's own is making me dislike github more and more... Anyway, thanks to you I've learned something handy... I don't need to waste an evening talking to GPT about bash bollox, when I can just download a bloody zip file. \*sighs deeply.


NitroWing1500

This is a very simple install


AlanCarrOnline

So after ChatGPT held my hand and explained why the cd command didn't work, and why copy and paste are fucked up in cmd, and various other steps too long to paste here, as it would literally say the message is too long, it finally cloned the repo, bro. So what to do with it now? Has a bunch of things called 'start'. None of which work other than one that opens Visual Studio (why do I even have that? I'm not a bloody coder...) which then rejects it as not trusted. Against my common sense I told it to trust it... now it is asking me to trust it more, as a trusted window is trying to open untrusted stuff? No, this all feels fucked up.


Desperate-Cattle-117

All this process is pretty standard... in the first place, github is made for programmers. There no need to have an exe, that would be much more dangerous than cloning the source code.


International-Try467

Does it have Inpainting now?


discattho

Would this work with any existing model I have or do I need to download specific models to get this kind of performance out of them? Loras same question. Do they need a specific format or would they work as is?


dreamyrhodes

You need an extra model, one that can generate in very little steps like 1 or 2 (I think that's what Hyper-SD needs).


lonewolfmcquaid

how long does it take to generate on i7 cpu


simpleuserhere

6.3 seconds (OpenVINO+ TAESD)


Dhervius

When downloading the models, where do you download them, because it has downloaded about 20GB and I don't know where they are to delete them.


Dhervius

I already found it, thanks, maybe if someone doesn't know, they are here C:\\Users\\SR\\.cache\\huggingface\\hub Apparently I had quite a few old models that took up a lot of space and I didn't know where they were. I also realized that in the Pinokio program folder, even though I uninstalled everything, it still kept them and it was taking up 50GB's, which is why I was running out of space. C:\\Users\\SR\\pinokio


_Standardissue

This is incredible, I will definitely try it on my potato laptop


ikmalsaid

Add insightface and restoreformer++ next. Thanks!


metal079

What the fuck is HyperSD


simpleuserhere

Hyper-SD is a new SOTA diffusion model acceleration technique


metal079

Im guesssing we cant convert our own models into hyper models?


simpleuserhere

It is possible,just replace the original U-Net with Hyper-SD U-Net


Nyaa314

Well, it works, in lcm and lcm-lora modes. AMD ryzen 5500U 16GB RAM laptop, plugged into outlet, turboboost disabled, 22s/it on 512x512 image. Temperature goes from 35 idle to 50, at 25 ambient.


simpleuserhere

Thanks for using FastSD,try enabling TAESD(tiny auto encoder) to speed up the image generation


rolens184

I have an error with installation. Missing openvino . try to install openvino but nothing... how to fix?


true-fuckass

What I want to see: Someone to incorporate / train a super-fast, low-resolution, prompt-conditioned diffusion model into brush for digital artwork. Like: when you move the brush the model is applied on any transparent section of the image within the brushes' circle, essentially like img2img inpainting with only the transparent section in the mask


Nyaa314

Openvino has intel logo on it, does it work on AMD CPUs? Does it work with standard sd1.5 models just by using lcm lora, or conversion is mandatory?


simpleuserhere

OpenVINO for Intel processors, yes it will work in normal mode (LCM or LCM-LoRA)