|
I need to figure out how to do this 10gig switchless poo poo i got three 2 port NICs, three machines, and a bag of patch cables. i suppose since i use 10.0.3.0/24 for the actual house lan that i'll just use 10.0.4/5/6 with a /24 for em? simple i suppose
|
#
?
Feb 21, 2024 06:37
|
|
|
|
| # ? Apr 27, 2024 09:18 |
|
|
Jabor posted:deez nats
|
|
#
?
Feb 21, 2024 10:27
|
|
|
Jonny 290 posted:I need to figure out how to do this 10gig switchless poo poo what's the physical topology? three machines with two ports each doesn't leave any ports for uplink on anything either each machine has a third 1GbE port to go to a switch at some point to hit the firewall or one of the machines is the firewall what's the end plan here?
|
|
#
?
Feb 21, 2024 10:49
|
|
|
Kazinsal posted:what's the end plan here? token ring for the modern era
|
|
#
?
Feb 21, 2024 11:38
|
|
|
abigserve posted:Most modern enterprisey firewalls will support something like that via session-based ECMP, which should also handle NAT based on outgoing interface. I assume that sorta thing has trickled down into the prosumer market already. they call them load balancers
|
|
#
?
Feb 21, 2024 13:13
|
|
|
Jabor posted:deez nats
|
|
#
?
Feb 21, 2024 14:42
|
|
|
Progressive JPEG posted:hey whats a reasonable way to handle two ISPs in a home situation multi-wan ecmp can be hit or miss depending on the comparative performance of the connections, but not a bad option overall. ubiquiti/unifi have some reasonably good multi-wan capabilities. i have qty 3 isps so i assign a (virtual or physical) router to each and give them their own ips (.1 and .2 and .3), and then i can just change my gateway any time i want to flip between one, or i can hardcode a route to point at one of those next-hops if i know i always want that to take a different path. ultimately, it's pretty difficult to determine empirically if one of your connections is saturated or not (at least locally), and so most solutions are either random ecmp (just split traffic by session 50/50, NOT by bandwidth, so it always ends up uneven) or you tell the device what the maximum bandwidth per provider is (which is tough because 4G/WISP bandwidth tends to be variable).
|
|
#
?
Feb 23, 2024 01:22
|
|
|
get an asn and a /24, then peer with each isp via bgp
|
|
#
?
Feb 23, 2024 01:31
|
|
|
outhole surfer posted:get an asn and a /44, then peer with each isp via bgp
|
|
#
?
Feb 23, 2024 01:35
|
|
|
outhole surfer posted:get an asn and a /24, then peer with each isp via bgp
|
|
#
?
Feb 23, 2024 01:39
|
|
|
I run my dual WAN as a single site SDWAN load balancing a Starlink service and a fixed line service on a low end Fortigate. stretching the definition of ‘home’ though.
|
|
#
?
Feb 23, 2024 02:04
|
|
|
2 wifi routers on different channels and different network names. dont make it harder than it needs to be
|
|
#
?
Feb 23, 2024 02:07
|
|
|
I would just do failover or create firewall rules to split bulk downloads and low latency traffic
|
|
#
?
Feb 23, 2024 04:03
|
|
|
Kazinsal posted:
this! quote:what's the end plan here? copy file fast between the big computers.
|
|
#
?
Feb 23, 2024 04:10
|
|
|
jonny for three machines doing point to point 10G links with distinct host names for the fast network is your starting point. scp ./big-hentai-movie.mp4 jerk@host2:~/watchlist/urgent vs scp ./big-hentai-movie.mp4 jerk@host2-10g:~/watchlist/urgent aint that big a deal if you got automation that already is configured for existing host names then /etc/hosts overrides to point to the 10g ip is the next least bad solution only do that split horizon dns if you like futzing with bind na gently caress all that do ospf jonny you know you wanna be a hero not a zero
|
|
#
?
Feb 23, 2024 04:30
|
|
|
Yeah gotcha. I have no problem hostsfiling 'mojoryzen10g' and 'benchmarx10g' etc etc. Cool, thank you!
|
|
#
?
Feb 23, 2024 04:39
|
|
|
|
|
#
?
Feb 23, 2024 04:47
|
|
|
go rogue and run your home network off djbdns
|
|
#
?
Feb 23, 2024 05:18
|
|
|
i just put all my internal dns entries on public dns since i don't care if the internet is able to resolve weatherstation.<domain> to 172.27.0.2 also means i can set up a real letsencrypt wildcard *.<domain> cert and have it work fine in all clients
|
|
#
?
Feb 23, 2024 05:35
|
|
|
Progressive JPEG posted:
a powerful technique!
|
|
#
?
Feb 23, 2024 05:56
|
|
|
Somebody fucked around with this message at 00:09 on Feb 26, 2024 |
|
#
?
Feb 25, 2024 16:59
|
|
|
me, getting informed that the network teams planned update is now in hour 5 of the 30 minute window.
|
|
#
?
Feb 25, 2024 17:29
|
|
|
( to be fair: the vendors poo poo was all jacked up and the update broke the gently caress out of everything, and they ended up with like 4 open support tickets after gathering all the dumps and logs before rolling back to the previous release )
|
|
#
?
Feb 25, 2024 17:35
|
|
|
alright, got one for yall to solve the infra gigabit LAN on 10.0.3.1/24 for all the machines, all attached to the gig ports on the downstream machines. 'internet lan' lets call it. Everything has a 2 port 10gbe nic, with patches running to the other two. benchmarx: big epyc box with 2 port 10gbe nic and one 1gb onboard, connected to internet lan. debian ---10gbe port 1: 10.0.4.1/24, connected to shintel ---10gbe port 2: 10.0.5.1/24, connected to mojoryzen mojoryzen: 5900x with another 2port 10gbe and one 1gb connected to internet lan. win10 --10gbe port 1: 10.0.5.2/24, connected to benchmarx --10gbe port 2: 10.0.6.1/24, connected to shintel shintel: 12700k with another 2port gbe card and one 1gb connected to internet lan. win10 --10gbe port 1: 10.0.4.2, connected to benchmarx --10gbe port 2: 10.0.6.2, connected to mojoryzen My issue: i have a SMB share set up on benchmarx that i'm using to test. Shintel can copy to and fro with benchmarx at 1 GB/sec to it. I didn't fiddle with the NIC port here beyond buffers and MTU. Mojoryzen only copies to and fro with benchmarx at 100MB/sec. When I pull up task manager, it's using the gigabit. EVEN THOUGH i'm specifically going to \\10.0.5.1\tmp\ or whatever. I did the same buffer and MTU bumps on this machine. Yes, i have set the metrics for the interface on mojo to prioritize the 10gbe port to benchmarx. It still goes over the 1gbe LAN between everything. whyyyyy I have duct taped it by only offering benchmarx's SMB on the 10gbe ports. But i want to know whyyyyyyyy it works differently from each win10 machine.
|
|
#
?
Mar 2, 2024 05:00
|
|
|
what do your routing tables look like
|
|
#
?
Mar 2, 2024 07:01
|
|
|
yeah this feels like a routing metrics issue
|
|
#
?
Mar 2, 2024 07:52
|
|
|
my homie dhall posted:what do your routing tables look like NEEeARLY identical. thats the thing box that works, box that dont  
|
|
#
?
Mar 2, 2024 07:55
|
|
|
hmm, those look fine. what does the routing table on benchmarx look like? also if you have multi-channel support enabled in your samba conf on benchmarx, turn that off
|
|
#
?
Mar 2, 2024 08:07
|
|
|
another option: get one of these and set yourself up some proper 10GbE switching and VLANs my brother: https://www.fs.com/products/72944.html $329 USD for a fanless 24x1GbE + 4x10GbE SFP+ switch that does inter-VLAN and static routing
|
|
#
?
Mar 2, 2024 08:10
|
|
|
go back to mikrotik jony  edit: less than half the price of the above switch Asymmetric POSTer fucked around with this message at 13:14 on Mar 2, 2024 |
|
#
?
Mar 2, 2024 13:11
|
|
|
Kazinsal posted:hmm, those look fine. what does the routing table on benchmarx look like? also if you have multi-channel support enabled in your samba conf on benchmarx, turn that off yea this feels like windows being all helpful cause it knows bettern you
|
|
#
?
Mar 3, 2024 00:24
|
|
|
try iperf and see if it behaves similarly.
|
|
#
?
Mar 3, 2024 01:22
|
|
|
Asymmetric POSTer posted:go back to mikrotik jony mikrotik doesnt cross my threshold any more after my 0-day adventures Kazinsal posted:hmm, those look fine. what does the routing table on benchmarx look like? also if you have multi-channel support enabled in your samba conf on benchmarx, turn that off pre:root@benchmarx:~# route Kernel IP routing table Destination Gateway Genmask Flags Metric Ref Use Iface default router 0.0.0.0 UG 100 0 0 enp101s0f0 10.0.3.0 0.0.0.0 255.255.255.0 U 100 0 0 enp101s0f0 10.0.4.0 0.0.0.0 255.255.255.0 U 0 0 0 enp3s0f1 10.0.5.0 0.0.0.0 255.255.255.0 U 0 0 0 enp3s0f0 172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 192.168.122.0 0.0.0.0 255.255.255.0 U 0 0 0 virbr0 fresh_cheese posted:try iperf and see if it behaves similarly. iperf 3.1.3 showed 3Gbps on a single thread from shintel to benchmarx and 9.8Gbps all together from four threads. i havent yet tried with mojoryzen b/c ive been busy with Nargle stuff and folks said this specific iperf version is a weirdo snowflake maintained by freaks and i havent tried a newer/more official one yet.
|
|
#
?
Mar 3, 2024 02:42
|
|
|
yeah, i’d try to figure out whether all traffic between the two hosts is using the wrong routes or just the smb traffic. also would be interested in the routing table of the receiving host, and also the arp tables
|
|
#
?
Mar 3, 2024 05:37
|
|
|
my homie dhall posted:yeah, i’d try to figure out whether all traffic between the two hosts is using the wrong routes or just the smb traffic. also would be interested in the routing table of the receiving host, and also the arp tables routing table was posted above (the second screenshot) ARP on the fucky client: pre:C:\Users\jonny290>arp -a Interface: 10.0.3.100 --- 0xc Internet Address Physical Address Type 10.0.3.1 44-d9-e7-9e-46-45 dynamic 10.0.3.106 b8-27-eb-f0-c9-27 dynamic 10.0.3.129 9c-3e-53-2f-ad-5a dynamic 10.0.3.200 00-11-32-c5-46-a1 dynamic 10.0.3.206 50-eb-f6-ce-2d-59 dynamic 10.0.3.222 02-42-0a-00-03-de dynamic 10.0.3.224 d0-50-99-db-9c-55 dynamic 10.0.3.225 d0-50-99-f2-81-91 dynamic 10.0.3.255 ff-ff-ff-ff-ff-ff static 224.0.0.22 01-00-5e-00-00-16 static 224.0.0.251 01-00-5e-00-00-fb static 224.0.0.252 01-00-5e-00-00-fc static 239.255.255.250 01-00-5e-7f-ff-fa static 255.255.255.255 ff-ff-ff-ff-ff-ff static Interface: 10.0.5.2 --- 0x29 Internet Address Physical Address Type 10.0.5.1 00-e0-ed-32-9e-4c dynamic 10.0.5.255 ff-ff-ff-ff-ff-ff static 224.0.0.22 01-00-5e-00-00-16 static 224.0.0.251 01-00-5e-00-00-fb static 224.0.0.252 01-00-5e-00-00-fc static 239.255.255.250 01-00-5e-7f-ff-fa static 255.255.255.255 ff-ff-ff-ff-ff-ff static pre:Interface: 10.0.3.206 --- 0x8 Internet Address Physical Address Type 10.0.3.1 44-d9-e7-9e-46-45 dynamic 10.0.3.100 24-4b-fe-e0-e0-c6 dynamic 10.0.3.106 b8-27-eb-f0-c9-27 dynamic 10.0.3.124 4e-e0-5d-db-62-c9 dynamic 10.0.3.129 9c-3e-53-2f-ad-5a dynamic 10.0.3.200 00-11-32-c5-46-a1 dynamic 10.0.3.222 02-42-0a-00-03-de dynamic 10.0.3.223 14-eb-b6-8f-38-94 dynamic 10.0.3.224 d0-50-99-db-9c-55 dynamic 10.0.3.225 d0-50-99-f2-81-91 dynamic 10.0.3.255 ff-ff-ff-ff-ff-ff static 224.0.0.22 01-00-5e-00-00-16 static 224.0.0.251 01-00-5e-00-00-fb static 224.0.0.252 01-00-5e-00-00-fc static 239.255.255.250 01-00-5e-7f-ff-fa static 255.255.255.255 ff-ff-ff-ff-ff-ff static Interface: 10.0.4.2 --- 0x2e Internet Address Physical Address Type 10.0.4.1 00-e0-ed-32-9e-4d dynamic 10.0.4.255 ff-ff-ff-ff-ff-ff static 224.0.0.22 01-00-5e-00-00-16 static 224.0.0.251 01-00-5e-00-00-fb static 224.0.0.252 01-00-5e-00-00-fc static 239.255.255.250 01-00-5e-7f-ff-fa static
|
|
#
?
Mar 3, 2024 05:47
|
|
|
i meant on the benchmarx box, but if other traffic doesn’t have a problem then it doesn’t sound like a routing thing and i’m completely out of my depth. the arp tables look fine too
|
|
#
?
Mar 3, 2024 06:22
|
|
|
Yeah it's so loving weird. At any rate, things are mitigated by locking down the interfaces the server's smbd is listening on, so I'm okay for now. i just want to solve the myyyyysssssteryyyyyy ya know? I've got my streamlabs set up to save videos to benchmarx now, and a cron job to rsync whatever's new in that folder to the NAS for archiving every day at 4am. It's really nice to be able to open a gigabyte class video file on Premiere in just a second or two, and editing is so much less painful. i used to have to pre-copy things to the ryzen to edit, but now i can skip that
|
|
#
?
Mar 3, 2024 06:26
|
|
|
oh neat side project here: i realized that i have a spare gig port on both the linux server and my nas, so i ran a patch cable and moved all the NFS mounts to go over that. now qbittorrent can move completed linux isos to the nas at full gigabit while also downloading more linux isos at full gigabit
|
|
#
?
Mar 3, 2024 11:55
|
|
|
I've got this bizarre realtek 4x1GbE card sitting in one of my drawers and I'm torn between jamming it into the next iteration of my home server vs. trying to write a driver for it from scratch for my hobby kernel
|
|
#
?
Mar 3, 2024 12:26
|
|
|
|
| # ? Apr 27, 2024 09:18 |
|
|
you could wireshark the smb traffic between the client and server and see which ips it's actually going over. they have a decent smb decoder, I think. you could see if the 1g ip is referenced anywhere in the comms
|
|
#
?
Mar 3, 2024 14:52
|
|
