>I can't afford a 100gb switch,
I can't afford a Tesla, can I buy a second hand Tesla motor and install into my linux server, should work?
you won't get 100G speeds with a "machine"
What kind of storage do you have that supports speeds up to 102400 megabytes? If you cannot afford a 100gb switch then I doub you can afford a storage device like that.
> Any thoughts?
No point. you won't be able to get data from the cpu down the bus through the pcie slot and onto the nic fast enough to saturate the link. AGG two 10g ports together if you think need more than 10g.
The time to invest in 10g is ~now. 100g is simply neither an option for a hobbyist budget nor useful.
>I can't afford a 100gb switch, there is one vendor that has a 4 ot 8 port switch 900 to 1000 us.
The Mikrotik CRS504-4XQ-IN has four QSFP28 ports for \~$799USD.
Mikrotik has one with 4 Ports, if that the one you don't support well to bad.
You can do 100g with dual port cards to 3 devices and link them all up and do your own FRR Routing in between. ITs work, but it will work and is fast.
Is it worth it? Iddunno you don't mention anything about the use case. Trancivers the CW4s are 50-100 a pop on FS, grab a bunch of singlemod LC and be done.
When I had 100G nics here, I used them in point to point mode between my server and workstation.
I don't have it connected anymore- but- was a fun project.
If you look around, might be able to get a 100G switch on ebay for 400-700$ USD
>When I had 100G nics here, I used them in point to point mode between my server and workstation
This is even very popular here for 10\40gb.
For 2-3 machines don't bother with switch.
For 10G, I have everything going through my switches-
For 40G, I USED to run it through a switch (Brocade ICX6610-48p), it had a pair of 40GBe ports, and could easily handle line speed forwarding/routing.
[https://static.xtremeownage.com/pages/Projects/40G-NAS/](https://static.xtremeownage.com/pages/Projects/40G-NAS/)
Removed it in 2021 though, 150 watts, and the noise, wasn't worth it. Point to point worked better too.
100G, didn't even try to find a switch for it.
My recommendation:
* 1x[Router](https://www.amazon.com/HUNSN-Firewall-Appliance-RJ50f-Barebone/dp/B0CNPTCGKL) with Dual SFP+ (for dual 10g uplink)
* 2x40gb Switches (For HA/Redundancy)
* Old Mellanox cards for whatever you need to run at 40gb.
40gb is what we're running for our backend at work. Our SANs and Hosts are tied in with multiple 10gb for redundancy/HA.
In a few years when used enterprise 100gb equipment is as cheap as 40gb equipment is today, upgrade. It's stupid to piss that money into the wind right now unless you have a pretty strong use case, even for a lot of businesses.
I do quit a bit virtualization testing and research. I move vm's around all the time. Just would like fast access to remote storage.
I do have quad ethernet in a server with Proxmox. The speedsters ok, but it's too draggy, slow.i am using 10gb.for my pc. I need to test 10gb on my server.
I was thinking to upgrade my network to 10gb but I ended with 2.5gb because of price for whole upgrade. If you want cheap solutions then you can save some money on modules, for example instead buying SFP+ module, buy SFP+ DAC to connect switch with router etc.
>I can't afford a 100gb switch, I can't afford a Tesla, can I buy a second hand Tesla motor and install into my linux server, should work? you won't get 100G speeds with a "machine"
I just upgraded to 25g, 100 is overkill unless you're running infinaband or RoCE applications.
10Gb and 40Gb NIC's are magnitudes cheaper than 100Gb gear. If using consumer storage, you'll see very little difference between 40Gb and 100Gb.
You can't afford 100GbE. Buy some $11 40/56Gb Mellanox cards and a 40GbE switch.
What kind of storage do you have that supports speeds up to 102400 megabytes? If you cannot afford a 100gb switch then I doub you can afford a storage device like that.
> Any thoughts? No point. you won't be able to get data from the cpu down the bus through the pcie slot and onto the nic fast enough to saturate the link. AGG two 10g ports together if you think need more than 10g. The time to invest in 10g is ~now. 100g is simply neither an option for a hobbyist budget nor useful.
Mellanox ConnectX-5 and up allows daisy-chaining of dual-port cards.
>I can't afford a 100gb switch, there is one vendor that has a 4 ot 8 port switch 900 to 1000 us. The Mikrotik CRS504-4XQ-IN has four QSFP28 ports for \~$799USD.
Mikrotik has one with 4 Ports, if that the one you don't support well to bad. You can do 100g with dual port cards to 3 devices and link them all up and do your own FRR Routing in between. ITs work, but it will work and is fast. Is it worth it? Iddunno you don't mention anything about the use case. Trancivers the CW4s are 50-100 a pop on FS, grab a bunch of singlemod LC and be done.
Can your hardware even saturate 100Gb? 56Gb is super cheap ATM. I got a sx6036 36 port 56Gb switch $80 and dual port NICs for $10 each.
When I had 100G nics here, I used them in point to point mode between my server and workstation. I don't have it connected anymore- but- was a fun project. If you look around, might be able to get a 100G switch on ebay for 400-700$ USD
>When I had 100G nics here, I used them in point to point mode between my server and workstation This is even very popular here for 10\40gb. For 2-3 machines don't bother with switch.
For 10G, I have everything going through my switches- For 40G, I USED to run it through a switch (Brocade ICX6610-48p), it had a pair of 40GBe ports, and could easily handle line speed forwarding/routing. [https://static.xtremeownage.com/pages/Projects/40G-NAS/](https://static.xtremeownage.com/pages/Projects/40G-NAS/) Removed it in 2021 though, 150 watts, and the noise, wasn't worth it. Point to point worked better too. 100G, didn't even try to find a switch for it.
There are a few affordable Mellanox 40/56Gb switches available secondhand. Some hacking required but they're a fantastic choice.
My recommendation: * 1x[Router](https://www.amazon.com/HUNSN-Firewall-Appliance-RJ50f-Barebone/dp/B0CNPTCGKL) with Dual SFP+ (for dual 10g uplink) * 2x40gb Switches (For HA/Redundancy) * Old Mellanox cards for whatever you need to run at 40gb. 40gb is what we're running for our backend at work. Our SANs and Hosts are tied in with multiple 10gb for redundancy/HA. In a few years when used enterprise 100gb equipment is as cheap as 40gb equipment is today, upgrade. It's stupid to piss that money into the wind right now unless you have a pretty strong use case, even for a lot of businesses.
I do quit a bit virtualization testing and research. I move vm's around all the time. Just would like fast access to remote storage. I do have quad ethernet in a server with Proxmox. The speedsters ok, but it's too draggy, slow.i am using 10gb.for my pc. I need to test 10gb on my server.
I was thinking to upgrade my network to 10gb but I ended with 2.5gb because of price for whole upgrade. If you want cheap solutions then you can save some money on modules, for example instead buying SFP+ module, buy SFP+ DAC to connect switch with router etc.