-
demido
so i'm setting up a freebsd box as a wireguard server with 1 wireguard client. i'll want wg client to be able to pass its traffic out through wg server, and it obviously needs to be able to receive return traffic through wg server. also, wg server needs to forward traffic coming in on a certain port range to the wg client. i'm using pf firewall. is
-
demido
the best way to do that `nat` for wg client out, and `rdr` for port forwarding wg client in?
-
dvl
scoobybejesus: what are you looking for? py311-sopel?
-
scoobybejesus
indeed
-
dvl
scoobybejesus: Oh, you got it good, I see now.
-
scoobybejesus
I had to pip install it tonight. would love to pkg install it again
-
casado47_2
Hi, I'm taking a lookt at the Yazi file manager. But it seems that Nerd Fonts doesn't work with XFCE4 Terminal.
-
demido
termbin.com/yeii are all of my pf config. how can i make it better please? more complete, more specific, more accurate, more strict, etc
-
demido
i want to make it /perfect/
-
demido
there any downside to skipping unbound and just putting nameserver ips in /etc/resolv.conf?
-
demido
:q
-
ek
demido: Nope.
-
demido
ok nice that's good for low mem installs
-
demido
ek you fix your bhyve issue?
-
ek
If you have available nameservers accessible, resolv.conf will point to the right places to do the lookups.
-
ek
demido: Nope. Bhyve still broken (for re-use of vm names.) Otherwise, it works really well.
-
demido
you open a bugzilla for it?
-
ek
Well, re-use of vm names and Windows 11 (ugh...) Those are struggling pretty hard. But, I don't use them, so it doesn't bother me much.
-
ek
demido: Not yet. I need to figure out how to make it reproducible. Problem is, I can't just keep doing reboots to figure it out. So, kind of between a rock and hard place.
-
ek
demido: Do keep in mind that you can also use Unbound to relay to your default nameservers and it'll cache. Making replies not only faster, but a little less internet traffic as a whole. It'll save a tiny bit space on the install, but won't really much (any) extra load on the system.
-
ek
... unless it's a really, really low-resource system (like a dog turd with potato power, or something.)
-
demido
1G total mem fwiw
-
ek
Yep. It won't even touch 1% of that as far as I've seen.
-
ek
Small VM's and such where I use Unbound (just by default as a caching NS server generally run around 0.01 CPU usage and 25-100MG RAM.
-
ek
(Active)
-
demido
this box is just a wireguard server so don't know how much dns it'll be doing. not sure it's worth that
-
ek
If it's a endpoint, probably a lot?
-
ek
s/a/an/
-
demido
maybe i'll pflog it and watch
-
ek
Sure. Can't hurt to monitor. Again, if it's an endpoint, it'll be doing lookups and routes for anything external. If you have internal DNS servers and it's not an endpoint, it wouldn't do really do anything.
-
demido
ek feels really nice being back to no swap. i had done that before but ppl convinced me it was a bad idea. but i'm with you, never had swap help me only had it hurt me
-
demido
i don't overcommit boxes so i don't need any cheats
-
ek
The only time it's ever mattered for me was for panics. But, even then, mostly not helpful. Also, I haven't had a FBSD panic is years and years.
-
ek
Not to mention, even when I do set up swap, it's never used anyway.
-
demido
yea
-
ek
I guess it's just one of those things. By, default 2GB isn't much to spare for SWAP for emergency panic info. But, if they system ends up using it (or not,) it's slow and basically worthless these days.
-
Pauli1
:q
-
Pauli1
Oops, the trap of tabbing. ;)
-
ek
Pauli1: It happens to everyone (me more often than I'd like.)
-
mountainman1312
Howdy everyone. I got a new SSD for my computer, installed freebsd on it (had freebsd on the HDD too) and due to lack of experience I didn't realize leaving the default name "zpool" for the ZFS pool would render my other drive un-bootable. Is there any way to recover the other drive's data?
-
|cos|
mountainman1312: i'm the opposite of an expert, but if i were in your shoes i would first physically remove one disk. then rename to pool of the remaining one, and reinsert the previously conflicting disk again.
-
demido
just fyi #zfs also exists
-
» |cos| realizes renaming a zpool isn't as trivial as i assumed...
-
mountainman1312
demido: thanks, I'll hop over there
-
demido
just did a fresh install and config of 14.2 and when i boot i get "fssh_kex_exchange_identification connection reset by peer" to console. what can cause that?
-
demido
ek i'm trying to see how many dns requests are going out from the wg client but all i can see in pf log on wg server is dns requests from the wg server, and nat pings out from the wg client, not showing nat dns requests out from the wg client
-
demido
now that i think about it, wg client dns requests wouldn't be performed by the wg server unless i set that up somewhere right? i actually wonder where they're going
-
demido
i'll bet the wg client is putting them out over ITS dns server, which is my home router ip. that sound right ek?
-
mzar
demido: are you progressing with solving FreeBSD issues ?
-
demido
mzar ya basically i turned off swap and problem solved lol. i'm using wired_memory="yes" for bhyve guests but not sure if i even need it anymore
-
mzar
nice; I cannot help much with wired_memory="yes", I have never been using it
-
mzar
demido: good luck with FreeBSD
-
demido
how much ram is biggest bhyve guest you made?
-
demido
ty
-
mzar
12 or 16GB IIRC
-
demido
ah ok
-
mzar
I prefer jails, especialy those without VNET
-
demido
why no vnet
-
mzar
less overhead
-
demido
i noticed /etc/resolv.conf doesn't have options edns0, should i add that?
-
demido
anyone know why wg client would get abysmal throughput between wg server? i started a curl dl of debian iso on wg client, saw it was slow, started same dl on wg server and it finished in a minute. meanwhile wg client dl is saying 2 hours?
-
ketas
mzar: it's on now
-
demido
anyone know why wg client would get abysmal throughput between wg server? i started a curl dl of debian iso on wg client, saw it was slow, started same dl on wg server and it finished in a minute. meanwhile wg client dl is saying 2 hours? if i sftp from wg client to wg server, i can dl the file in like 30 sec. the only wg server pf rule i have
-
demido
enabled is the wg client nat so it can pass traffic
-
gt
demido: are you using tcp for wireguard connection?
-
demido
no udp
-
demido
gt ^
-
demido
anyone know why wg client would get abysmal bw through wg server? i started a curl dl of freebsd iso on wg client, saw it was slow, started same dl on wg server and it was fast. if i sftp iso from wg server to wg client, it's fast. the only wg server pf rule i have enabled is the wg client nat so it can pass traffic. what could be making my wg
-
demido
connection so slow?
-
demido
(cleaned up text)
-
ghoti
demido: I haven't had that experiene with wg, it has always performed flawlessly for me.
-
gt
demido: idk, it could've been a tcp meltdown if it was tcp
-
demido
do you use wg over tcp or udp?
-
gt
udp everytime
-
demido
im using set reassemble yes in pf, good?
-
gt
I think that's the default anyways
-
demido
you modify any mtu anywhere?
-
gt
no
-
demido
modify mss or anything else?
-
gt
did you track this issue to your pf setup?
-
demido
no
-
gt
if I'd start with that
-
demido
i have no clue what the problem is
-
gt
if possible*
-
demido
well i commented out every rule i had
-
demido
so all i have left in pf.conf is: set block-policy drop, set reassemble yes, set skip on lo, nat on vtnet0 inet from {<wg_addys>} to any -> vtnet0 that's IT
-
demido
see any probs?
-
gt
no
-
gt
thing is, you want to rule out pf
-
gt
anyways
-
demido
how can i do that?
-
demido
i need the nat rule for wg client to get traffic through no?
-
gt
I don't know, do you?
-
gt
it depends on your topology
-
gt
if you can test your wg setup without any nat that will give you a way of ruling out pf
-
demido
fails to resolve domain
-
gt
then remove the name and point to the ip instead
-
gt
or add it to /etc/hosts
-
demido
ya no traffic passes even by ip
-
demido
how do you pass wg client traffic through your wg server without a pf nat rule?
-
demido
gt ^
-
gt
if your setup is simply a box acting as a gateway for a bunch of wireguard peers, then you do need nat at the wan interface
-
demido
ok
-
demido
and as you see i have a few options and 1 nat rule, so it can't be pf man
-
demido
what the f could be making my wireguard connection so slow
-
demido
maybe freebsd isn't a good wg server yet?
-
morpho
is there anywhere detailing wifi development of fbsd? like how is 802.11ac support on intel cards?
-
ketas
it's getting there
-
ketas
not much details tho
-
gt
demido: I doubt that
-
morpho
ketas: i heard there is a push to improve laptop support
-
morpho
good to hear though
-
nimaje
-
gt
demido: I guess you could play with the mtu and mss values a bit. See if you can find a better mtu and then lower max-mss to match it
-
demido
gt already tried playing with mtu, didn't really change anything
-
demido
i tried 1380, 1280, few more
-
gt
try setting max-mss to the mtu of your wg interface
-
demido
max-mss in wg0.conf or?
-
gt
pf
-
demido
gt like match in all scrub (no-df random-id max-mss 1420)?
-
gt
demido: yes, assuming 1420 is your mtu
-
demido
should i remove any of that? or should i remove set reassemble yes? i believe that conflicts with the older no-df
-
gt
I'd try it as is first, idk you need to disable reassemble
-
gt
no-df and reassemble are related to fragmentation but they're are not controlling the same thing
-
demido
-
demido
didn't help
-
demido
what else can i try?
-
gt
also maybe try it on wg0 alone
-
gt
match in on wg0
-
demido
tried, no better
-
demido
match in on wg0 all scrub ...
-
gt
remove all
-
demido
-
cybercrypto
hey there, are you guys enforcing user autentication for wireguard?
-
demido
and each time, i reload pf rules. then on wg client i down the interface, up it, and try the dl again
-
demido
cybercrypto just using pub/priv key
-
cybercrypto
demido: same here. I am looking into some alternative. In case of lost/stolen device (keys will be visible)
-
morpho
nimaje: does this mean the latest BSD release will have 802.11ac speeds now? I used fBSD a few years back and had to run a linux vm and pipe the wifi through
-
demido
termbin.com/sqon is my whole config for the slow wireguard setup
-
morpho
wifibox i think it was called
-
demido
gt any other ideas?
-
gt
demido: not much, maybe remove in, do match on wg0
-
gt
btw did you get to test the link speed with something like iperf or scp'ing a big file?
-
demido
no change
-
demido
well i could sftp the file down from wg server to wg client and it was fast
-
demido
but no iperf yet
-
demido
can't believe i'm the only person that can't get wireguard server running fast in freebsd like wtf
-
ketas
that makes you special one
-
ketas
maybe you found a bug
-
veg
hey there! I've used /boot/loader.conf to pass through a PCI NIC to bhyve
-
veg
it does show as ppt0 when doing `vm passthru`
-
veg
my question is: can I release so the NIC is again available to the host system (not the VM) without rebooting, or is a reboot after commenting out the pptdevs= section of loader.conf mandatory at this stage?
-
veg
thanks in advance!
-
mzar
veg: try kenv -u (compare kenv(1) first), I have not tested it, but that's what comes to mind first
-
nimaje
morpho: it is an active project of the freebsd foundation, no idea if any code from it got merged in any stable branch (or produced at all), I hoped that site has more information about the status of it, but I haven't read it
-
veg
thanks for the tip, mzar
-
veg
unfortunately, after `kenv -u pptdevs`, `kenv -l pptdevs` returns "unable to get pptdevs" (whereas it was reporting the PCI address before), but the NIC does not show up still, and `vm passthru` still reports the PCI address as being passed through; I guess a reboot it will be :)
-
mzar
veg: after removing from kenv variables, you'll probably need to rescan PCI bus, but I doubt it's feasible
-
mzar
veg: try "devctl rescan pci0" after clearing pptdevs
-
scoobybejesus
is a vnet jail (or host) required for running tailscale on freebsd? or is it possible to enable /dev/tun in a loopback jail
-
mzar
scoobybejesus: regardless to access to /dev/tun you'll probably need access to manipulating FIB tables and will not work without VNET
-
scoobybejesus
i see, thank you
-
mzar
scoobybejesus: but yes, you can enable access to /dev/tun* devices from non-vnet jail
-
veg
ouch, too late, I had rebooted already, mzar, but I'm writing that down in case I get another occasion to try it out, thanks a bunch!
-
mzar
veg: let us know if is it possible to get this device back or not
-
mzar
when you will have opportunity to test, of course
-
veg
will do, mzar! It's a production server though, so I'm not too keen on rebooting unless needed :)
-
mzar
veg: cool; perhaps the right path will be kenv -u ... && devctl delete ... && devctl rescan pci0
-
scoobybejesus
a VNET jail, despite having its own fancy network interface could just as easily be a loopback-only jail, right? just choose lo0 and everything should be fine? it's on a VPS with one public IP, so i just want to give it a loopback address like everything other jail
-
mzar
veg: kenv -u ... && devctl delete ... && devctl rescan pci0 is proven to work
-
mzar
thanks for the opportunity to test
-
mzar
scoobybejesus: in non-vnet jail you have access not only lo devices, also aliases on NICs shared by the host can be used
-
scoobybejesus
i never had good luck with shared networking, though in theory you're right
-
scoobybejesus
for now, i need a VNET jail to be confined to loopback
-
mzar
OK
-
mzar
veg: moreover, you can also steal the device this way from the system and then passthrough it to bhyve without rebooting
-
scoobybejesus
this is proving tricky. bastille can't create a vnet jail on the loopback device. i created it on vtnet0, and now i guess i have routing problems
-
jpb
ok, regarding my earlier ipfw tablearg problem, i've traced the issue to ipfw table value corruption. see
bugs.freebsd.org/bugzilla/show_bug.cgi?id=284691
-
scoobybejesus
i need destination, gateway, flags, netif to be: 10.0.0.184, link#3, UH, bastille0. perhaps I can set that in rc.conf?
-
eniac
is freebsd is better than linux to host AI? gpus nvidia drivers ok?
-
jpb
eniac: i have 14.2 running on a lenovo laptop with nvidia0: <NVIDIA GeForce RTX 4070 Laptop GPU> on vgapci0
-
jpb
nvidia-driver-550.127.05.1401000 NVidia graphics card binary drivers for hardware OpenGL rendering
-
jpb
nvidia-drm-61-kmod-550.127.05.1401000_1 NVIDIA DRM Kernel Module
-
scoobybejesus
and i need it to be nat'd.. hmm.
-
jpb
running X. works fine. i don't know anything about hosting AI though, sorry
-
eniac
jpb nice.. never tried to run ollama?
-
eniac
vllm?
-
jpb
eniac: no - sorry.
-
jpb
i've got some other things on my plate atm
-
jpb
btw - love the nick.
-
jpb
old school cool
-
jbo
everything is broken :<
-
eniac
jbo tks
-
jbo
one day I might get upset enough to maintain my own ports tree :/
-
ek
Wait... What? What's broken?
-
elsheepo
I'm gana slap FreeBSD on my server tonight I think
-
elsheepo
unless someone can convince me why I would chose NetBSD instead?
-
mason
elsheepo: Different systems, different strengths. Try them both if you can.
-
elsheepo
I have a feeling NetBSD would probably be more appropriate
-
elsheepo
but maybe freebsd is a little more friendly? idk
-
mason
elsheepo: Don't forget OpenBSD and Dragonfly.
-
elsheepo
gana have to watch more youtube videos
-
rtprio
aybe more appropriate if you're running it on a dreamcast or toaster
-
elsheepo
lol
-
gt
rtprio: ngl I was thinking along the same lines...
-
gt
no doubt a highly capable brother system though
-
gt
elsheepo: ooc, why did you have a feeling that netbsd would be more appropriate?
-
demido
i have a wireguard setup that's 'working' but the wg client gets tiny throughput. any help appreciated
termbin.com/u89g
-
gt
demido: did you do the iperf test?
-
demido
not yet just woke up
-
demido
going to soon tho
-
elsheepo
gt, less thrills, more of a work-horse server
-
elsheepo
doesn't need a gui
-
gt
you don't need a gui on freebsd either
-
elsheepo
I'm curious to hear your opinions on these three BSD variants, FreeBSD v OpenBSD v NetBSD
-
elsheepo
particularly, the strengths of each, if anyone would be so kind
-
elsheepo
I know I can just as easily Google it, but I'd like to hear directly from the community if/when possible
-
demido
ok got it...
-
rtprio
wow
-
demido
termbin.com/et91 is my wireguard setup that works (but has tiny throughput down to wg client) including iperf tests from wg client to wg server over tunnel, wg client to wg server over inet, and wg server to wg client over tunnel
-
rtprio
how tiny? 71MBytes seems plenty fast to me
-
demido
when i try to dl freebsd or linux iso from the mirror sites it CRAWLS. like saying 80 hours to dl