-
duncan
debdrup: are you saying such MOTDs don't work?
-
» rwp likes the BSOD motd idea, lol!
-
armin
I'm still in love with the BSOD XScreensaver
-
luke_jobless_sb
is there any visualization tool for pf?
-
rwp
-
luke_jobless_sb
what a wall
-
drijen
hello, i have a question about jails - i intend to serve up a number of web apps behind a reverse proxy via jails and will require a bridge network. Is the bridge network created automatically, or will i need to create an interface myself. Additionally, firewall NAT rules will be required as well, correct
-
rwp
drijen, "automatically" depends upon if you are actually doing it yourself or using a utility such as iocage or some such. The utilities will generally do lots of stuff to help you automatically.
-
rwp
I don't like those for jails and so for me, no, I create the jails manually and have to create the bridge manually. I will have cloned_interfaces="bridge0" and "ifconfig_bridge0="addm eth1 up" and such in order to "manually" create the bridge that I am using when constructing the jails.
-
rwp
Is doing that manual or automatic? It depends upon your definitions. For me I have to manually put that configuration into /etc/rc.conf so it feels like a manual creation to me. But for others it might be considered automatic since they did not need to run ifconfig bridge create themselves.
-
luke_jobless_sb
on boot? if that's automatic, it is pretty common to use vnet bridge combo
-
luke_jobless_sb
pretty popular
-
drijen
rwp: thank you very much this is exactly the info i was needing to understand
-
drijen
luke_jobless_sb: cheers also
-
rwp
drijen, Also remember there are about 17,432 different ways, approximately, and so whether you need a bridge or not depends upon how you are configuring it.
-
drijen
thats ok; i just haven't used a nix system professionally in a very long time - im super rusty and taking forever to map out what i need to do to accomplish X
-
ivy
drijen: there are two different ways of doing jail networking, the old way, and the new vnet way. if you intend for each jail to have its own network interface that you will bridge on the host, you need to use vnet jails
-
ivy
the old way is that you assign a bunch of IP aliases to the host's network interface then bind each jail to one IP address, then there's no bridging involved at all
-
ivy
drijen: as to whether you need NAT, that depends on your network setup. if you have some internal range of addresses you use in your network (say 10.0.0.0/8) you can just take a /24 from that range, assign it to the bridge, and make sure the host is configured as a router; then your existing NAT router (or whatever you use) will handle the traffic as normal
-
ivy
drijen: otoh if this is something like a single colo/vps host with one public IP address, then yes, you probably need to configure the host to do the NAT for the bridge network itself
-
ivy
an alternative would be to simply not give the jails internet access at all, and run something like squid on the host to proxy http for freebsd-update/pkg/whatever
-
ivy
i also strongly recommend setting this up manually at least once (not using iocage/bastille/whatever) so you understand how it works at the OS level
-
systemdlete2
so I'm trying out freebsd. So far, so good. Just one issue having to do with consoles. I launch xfce4 from a console logged in as regular user. If I switch back to a console, the command line sometimes becomes corrupted so I can't type anything into it, or it does "funny things" with my keystrokes.
-
systemdlete2
I tried "stty sane" but that didn't help.
-
systemdlete2
root is using a plain sh in console.
-
systemdlete2
I am running freebsd under virtualbox 7.0.22. The guest additions are installed, and I'm using VBoxSVGA and no 3D for the VM
-
systemdlete2
usually, I log into another console and kill the one that got wonky on me.
-
systemdlete2
and this is freebsd 13.4
-
systemdlete2
the host is devuan daedalus (basically bookworm)
-
systemdlete2
this is not a huge problem, but a bit annoying. If there is a simple way to fix this, I'd appreciate knowing. Thanks.
-
l00py
anybody know vps hosts that got a 30 day free trial?
-
zip
why the switch to vnet jails, anyway?
-
zip
like i guess it lets you put firewall rules on the jail itself, and i bet it's handy for vpn endpoints
-
zip
otherwise it's a little unclear
-
zip
oh, I suppose it also lets you control how jails talk among themselves
-
Alver
Hm. I tried to bootstrap a 15.0-CURRENT jail on my 14.1-RELEASE host. That did not work out well. Expected?
-
Alver
mount_nullfs: Resource deadlock avoided
-
yuripv_
not this exact issue, but otherwise it's pretty much expected, you can't run newer userland on older kernel
-
ivy
Alver: yes, this is expected. you can't run a jail userland which is newer than the host.
-
Alver
Gotcha. Figured it was worth a try. :)
-
Alver
Anyone here played with podman on freebsd yet?
-
Alver
I'm trying it inside a jail and it's misbehaving (and I'm not that familiar with the codebase to know where to look)
-
ivy
having 10+ minutes of downtime every time you restart a jail due to it being stuck in 'dying' state is getting really annoying
-
rtprio
Alver: just enough to build a very basic container
-
rtprio
l00py: oracle has free tiny vms or one not-bad arm64 one
-
rtprio
that run freebsd
-
rtprio
ivy: any hint on what process is causing the fuss?
-
ivy
rtprio: there are no processes, the jail is dead. it's some timeout in the kernel, maybe related to vnet
-
rtprio
oh
-
ivy
(by 'dead' i means it doesn't show in 'jls' but it does show in 'jls -d', which prevents it from restarting)
-
ivy
i mostly solved this by moving to bhyve but unfortunately arm64 on rpi4 doesn't support vmm(4) as it only has GICv2
-
aquamo4k
fyi : starting in about two hours:
youtube.com/live/jZ3mjJZEqs0
-
ivy
aquamo4k: might be worth mentioning exactly what it is that starts in two hours
-
aquamo4k
ivy: tyvm ; fyi November 2024 FreeBSD Summit starting in about 2 hours, live stream is supposed to be here:
youtube.com/live/jZ3mjJZEqs0
-
aquamo4k
-
Alver
rtprio: on bare metal, I suppose?
-
rtprio
Alver: right, not in a jail
-
rtprio
you might test not-in-a-jail to see if that's what the problem is
-
ibs
aquamo4k: Thanks for the heads up.
-
ivy
i haven't used nushell (and have no idea what it is) but i did use fish as my login shell for a while, which is also not posix compliant, and that worked fine
-
ivy
wc
-
dch
ivy: maybe you can elaboarate on this slow jail shutdown issue on #freebsd-jails channel?
-
ivy
dch: i suppose i could but literally the issue is "jails are stuck in dying state for 10 minutes". and this is a known issue, i've mentioned it to kevans before
-
dch
ivy: thanks. I don't see this locally and I use jails every day. Is there a PR (bugzilla) with more info?
-
dch
I'm interested in getting this fixed, first stage is a reproduction.
-
ivy
no, but if you're seriously interesting in investigating this issue, i could create one
-
dch
ivy: yes please. I assume its either vnet, or filesystem related
-
ivy
dch: what's your bugzilla account so i can cc you (or assign to you if you prefer)?
-
dch
just drop the PR# here and thats sufficient. or dch⊙Fo
-
ivy
ok, will do that when i get some free time
-
dch
^5
-
stdout
hi, is there a freebsd alternative to gcs-fuse to mount google cloud storage buckets?
-
dch
stdout: rclone probably does this for you. I don't use it for GCS but it looks like that works -
rclone.org/googlecloudstorage
-
stdout
thanks dch, i think that'll work.
-
Alver
rtprio: I only have one FreeBSD machine at the moment, and I can't afford to let podman stick its fingers in the various OS orifices :°)
-
dch
stdout: also
freshports.org/devel/py-gcsfs is worth a look. but rclone should be faster and in go.
-
dch
stdout: I have an encrypted password in ~/.config/rclone/rclone.conf
-
dch
and then run this as required
-
dch
`rclone mount -v --cache-dir (mktemp -d -t dropbox) --progress --password-command 'secret password comand' --vfs-cache-mode full --debug-fuse dropbox: ~/Dropbox`
-
dch
most of that will be useful
-
drijen
ivy: you are spot on, its a colo’d server
-
rtprio
well you can uninstall it once you determine it's a jail problem
-
foxxx0
where do I begin debugging if my freebsd 14.1 VM gets stuck at "lo0: link state changed to UP"?
-
foxxx0
it appears to have configured the network interfaces, as it's responding to pings, but neither on the vga console nor on the serial console does it provide any login prompt and sshd is not running yet either
-
rtprio
i suspect there's something else running that hasn't updated the console
-
stdout
Is anyone here running fbsd on GCP? If so, what is the experience like and also are there issues running an unsupported image?
-
foxxx0
rtprio: here is the full boot log from serial console:
paste.foxxx0.de/PHJ
-
foxxx0
I'm unable to spot anything ot of the ordinary, but I've never had to debug such issues on freebsd
-
foxxx0
out of the ordinary*
-
rtprio
does ^C get you past it?
-
foxxx0
oh lol
-
foxxx0
it does
-
rtprio
any dhclient?
-
foxxx0
it's supposed to have static networking, and it was already responding to pings
-
foxxx0
next line after ^C is immediately: "Starting Network: lo0 iavf0 vlan60."
-
foxxx0
so probably that networking start was stuck somewhere?
-
rtprio
that's what i would suspect
-
foxxx0
is there a way to add more debug output around network initialization from /etc/rc.conf?
-
rtprio
there's rc_debug="YES" but i'm not sure that will help you
-
foxxx0
let me try the obvious choice and comment-out the vlan60 cloned interface, I have a sneaking suspicion that might be the culprit
-
rtprio
i would agree
-
foxxx0
yup, that's the cause
-
rtprio
you can share those lines, i can take a look
-
foxxx0
-
foxxx0
even when aborting with ^C it hasn't set the mac address, it's still the same as the parent interface
-
rtprio
that part looks suspect to me
-
foxxx0
so likely I'm doing that wrong
-
rtprio
ifconfig_vlan60="inet 192.168.60.32 netmask 255.255.255.0 vlan 60 vlandev iavf0 link xx:xx:xx:Xx:xx:xx"
-
rtprio
is what i'd try
-
rtprio
you don't need _alias unless you want more ip addresses
-
foxxx0
you can't set family inet and family ether/link in the same ifconfig call
-
foxxx0
-
mzar
foxxx0: why you want to override default iavf0 address for child vlan device ?
-
foxxx0
I'm trying to keep mac-addrs unique, to not have the same mac addr on multiple VLANs
-
foxxx0
I don't have that many devices here and it really helps when debugging stuff, if you can pinpoint a mac address uniquely to a vlan+interface
-
rtprio
bah, that's what lldp is for
-
foxxx0
hm, that would also be an option
-
rtprio
i mean, if you know the mac, you know the machine, i guess i don't see how it needs to be unique
-
foxxx0
oh, now I know where it actually gets stuk
-
foxxx0
-
foxxx0
-
mzar
foxxx0: interesting, but IMHO there are only 2 reasons to change ether address: 1. anonymisation 2. spoofing
-
foxxx0
yeah, I've removed that part now
-
foxxx0
now I still need to figure out what kind of magic is silently dropping vlan stuff for the VFs
-
foxxx0
in theory each VF should be able to fully utilize vlan tagging on its own, unless you restrict the VF to a specific vlan
-
rtprio
vf?
-
foxxx0
virtual function, sr-iov
-
ivy
foxxx0: i am not convinced "restrict the VF to a specific vlan" actually works
-
ivy
i could not get this working on either Intel X520 or Chelsio T540
-
foxxx0
ah well, I derped and forgot to actually trunk the port on the switch ... add vlan60 tagged and it just starts working
-
ivy
inspecting the source, it might work on a specific variant of the chelsio cards
-
rtprio
lol
-
foxxx0
I've been fighting the weirdest issue over the last two days and that has made my brain into mush
-
foxxx0
I shutoff the system one evening, wouldn't boot the next day. right after grub timeout reached 0 and it would try to load the kernel/initrd, it just started endlessly spewing "error: false." at me
-
foxxx0
after multiple rounds of resetting to factory defaults, cmos clears, reflashing bmc firmware and bios ... nothing worked. reproduced with a fresh install and after switching from grub to syslinux it immediately started booting again
-
ivy
so? it had no error, what are you complaining about?!
-
foxxx0
I still have NO idea why it worked for ~2 weeks with grub just fine and just completely bricked suddenly with no way to fix it
-
foxxx0
usually I'm able to figure out such issues or at least make some sort of progress but this just refused to cooperate and went against all logic (that I could come up with)
-
foxxx0
at least one friend told me he also has one mainboard that is just not working with grub but works with syslinux just fine, so I'm not totally alone. just still really confused why it worked it the beginning then
-
foxxx0
I was starting to question my sanity <hidethepainharold.jpg>
-
foxxx0
anyways, thank you rtprio , mzar and ivy !
-
zip
I had a long, boring meeting so I put freebsd on the hp 705 :D
-
ivy
what's an hp 705
-
zip
a little mini computer
-
ivy
is that better than an rpi3?
-
zip
-
zip
it's an improvement over an rpi2b for sure
-
zip
gets kinda warm though
-
ivy
it's winter, put it under your duvet
-
zip
hah, I've often thought that energy savings on computers were rather a moot point in Scotland
-
zip
now I have to decide if I can be arsed to set up wpa_supplicant
-
zip
I suppose it doesn't desperately need to be wired in to the network
-
mzar
wpa_supplicant is in the base, you can use it with wired and wireless interfaces
-
rwp
I have often reasoned that if someone has electric heat in their house that they might as well crank up a server farm turning electricity into heat that way. It's the same thing but at least something useful more than just heat is produced by it.
-
mzar
yes, heating room in winter with waste heat from computer makes your computing green
-
zip
it'd be great if i could host a rack and have a thermostat attached to it
-
zip
setup seems to let me create a zfs volume for an encrypted home directory but then there's nothing actually configured to make it happen and it's not clear that ssh is equipped for it. that's a shame
-
zip
I suppose there's TPM nonsense I could be doing
-
ivy
zip: i'm not sure what bsdinstall does, but never, ever use zfs native encryption, it has been broken since the day it was committed
-
ivy
if you need encryption with zfs, use geli
-
rtprio
i haven't found that to be true
-
ivy
it doesn't affect all users, it depends how you use the filesystems
-
ivy
if you use non-encrypted zfs send from a zfs encrypted filesystem, it will cause random i/o errors on your disks (but it won't actually corrupt data on disk, reboot fixes it)
-
ivy
this is a well known bug which has been open for months, openzfs position is basically "sorry, we do not understand this code well enough to fix it"
-
rtprio
even the folks who wrote it?
-
ivy
those people quit Sun 15 years ago and aren't working on openzfs
-
zip
I don't need encryption on servers really
-
zip
for laptops it's mandatory because they're the most stealable and loseable devices and are most likely to have sensitive documents
-
zip
though it'd be nice to have a machine grab a key from another device on the network
-
zip
also I love the redneck engineering of getting wifi working by running a copy of alpine linux in a VM and handing it the hardware. Absolutely deranged.
-
zip
(I did not do this)
-
rtprio
as deranged as reading the binary bits of a windows driver?
-
rtprio
i would say yes
-
zip
haha, those were the days
-
rtprio
i think that's the time i bought a usb ethernet adapter
-
ivy
that's weird, i rebooted this system, it did not come back up, connected a serial console and it was stuck at loader's 'OK ' prompt. type 'boot', it boots fine, rebooted, it reboots fine
-
ivy
must be a heisenboot
-
kevans
i've only really seen phantom input like that with the serial console already attached
-
ivy
hmm, how do i get nmh's repl to quote the body in the reply? can't work out the right way to do this in replcomps
-
ivy
ah, repl -format
-
zip
the first talk for the Fall 2024 FreeBSD Summit is pretty cool!
youtube.com/watch?v=jZ3mjJZEqs0