08:57:47 ghoti: xmllint with --xpath can extract it 09:20:26 Are there plans to support the openat() flag O_XATTR anytime soon ß 09:20:38 s/ß/\?/ 10:07:58 does freebsd configure mtu automatically? and if so – through what mechanisms (dhcp option 26, …?) 10:09:39 <[tj]> freebsd does path mtu discovery out of the box 10:09:45 <[tj]> which has issues 10:12:47 Any recommendations how to setup xfce DE on jail? i have 14.2 host with KDE DE but i want xfce in jail. i have .xinitrc file which does launch kde at bootup but i dont have .Xauhority file. if i create xauthority file then i am unable to boot even on the host. so i dont create it. All i want is an xfce DE on jail. 10:27:48 i'm starting a debian vm in bhyve on freebsd. weird thing. if i give it 6 cpu cores and 1500GB disk, installer finishes and reboots into new system. if i give it 12 cpu cores and 3600GB disk, installer finishes but then reboots to grub> prompt? 10:28:43 demido: it does not even attempt to load the kernel/initrd? 10:30:21 doesn't seem to. no errors in the vm's log (using vm-bhyve pkg) 10:37:07 oh and another change i make, 16GB ram when it works, 48GB when it doesn't 10:55:51 ok i narrowed it down. i tried switching 1 thing at a time to the working config and it's the disk size 10:56:11 1500GB disk0_size works, but 3600GB reboots into grub prompt 10:59:37 Odd. Does it default to a different type of partition table (BIOS vs GPT) between the two? 11:00:34 * Alver doesn't like using single huge disks anyway - multiple smaller fixed-sizes one for optimal queue utilisation :°) 11:00:54 no clue how can i check? 11:02:59 If you boot from the installer iso, you can check the disk 11:03:16 (or however you get into your installer, really) 11:03:50 If size is the factor, I'd put $5 that the 1.5T disk gets legacy label, and 3.6T GPT, and your system apparently doesn't like GPT in a VM 11:05:18 what you think solution is then? 11:17:16 demido: not using a single huge ass disk. 11:17:36 why's that so bad? 11:18:07 It's not terribly bad per se. Just... I don't like it. I don't like extending disks. LVM makes it unnecessary anyway. 11:18:45 I also have a huge dislike of partitions of any kind. My server didn't have any, laptop doesn't have any on internal devices. 11:19:26 Small disk for OS and swap, and fixed-size extra disks for data. Need more? Add a new disk, pvcreate, vgextend, lvresize, bob's your uncle. 11:20:24 There is a noticeable performance gain to be had on physical machines if you use multiple smaller disks vs one big, but on VMs I suppose it's negligible. 11:57:38 ok it took forever but i have good info now. trying to install debian in a bhyve vm on freebsd. with 2048GB disk install finishes, reboots into new system. with >2048GB disk install finishes, reboots to grub prompt. what's causing that and how can i fix without resorting to multiple disks? 11:59:07 does anybody know a definitive "here's what you need to know about swap" article for freebsd? 12:00:33 I'm trying to figure out why I have 72% swap usage on a system with 128GiB RAM, after building from sources a couple of times 12:00:45 this system shouldn't need any swap at all 12:01:39 $ doas top -Sjw -mcpu -oswap -b 12:01:39 last pid: 42; load averages: 0.33, 0.18, 0.21 up 0+17:57:27 12:01:03 12:01:39 205 processes: 3 running, 200 sleeping, 2 waiting 12:01:39 CPU: 6.4% user, 0.0% nice, 0.6% system, 0.0% interrupt, 93.0% idle 12:01:39 Mem: 20G Active, 32G Inact, 62G Laundry, 7679M Wired, 104K Buf, 2760M Free 12:02:07 apologies! 12:02:41 https://www.irccloud.com/pastebin/76uUotAm/swap 12:14:51 someone found out what happens when you don't use a pastebin ;) 12:16:09 I found https://wiki.freebsd.org/Memory and added a bunch of links (mostly by markj) to the end of it. this is enough for me to dig through. 12:27:19 so, ~ 60% of my swap disappeared when I got rid of /usr/obj as tmpfs 12:29:25 I would have naively expected a tmpfs not to be swapped out, I would have expected a ENOSPACE or similar. 12:29:38 but its clearly documented in tmpfs(4) that swap will be used. 12:29:45 let's try these builds *without* swap 12:32:03 ok, so its all clear now. 12:32:38 its tmpfs, I will redo the builds without swap, and keep an eye on total memory. 12:32:57 I guess we get close to max mem, and then tmpfs is flushed to disk 12:37:47 it took forever but i have good info now. trying to install debian in a bhyve vm on freebsd. with 2048GB disk install finishes, reboots into new system. with >2048GB disk install finishes, reboots to grub prompt. what's causing that and how can i fix without resorting to multiple disks? i tried using uefi loader but that only works with 12:37:47 graphics="yes" which requires vnc, but i wanna stay with a pure console connection 12:47:36 i think https://github.com/churchers/vm-bhyve/wiki/Serial-Console-Output-with-the-UEFI-loader is my issue (found at https://github.com/churchers/vm-bhyve/issues/398) will those work for debian? 13:04:24 demido: any reason why you want to stick with a single disk? 13:04:40 to learn 13:04:41 Unless you know for certain that your data will never grow beyond the initial size, that is 13:05:09 Because LVM exists for a reason, and makes the physical disk underneath irrelevant 13:05:38 I had unix systems with well over a thousand devices connected - and yet only a dozen or so filesystems 13:06:21 to learn 13:06:45 You can learn LVM, then. Instead of eighties tech. :°) 13:07:00 i'll learn what i choose instead of what you choose thx 13:07:17 ¯\_(ツ)_/¯ 14:00:20 phryk: looks like it's initialised by the interface somehow, when the interface is created, and is interface-dependent. it can also be set later on with dhcp 14:17:09 using pkg can you show all packages use libfmt 14:20:27 grep -r 'devel/libfmt' /usr/ports/ <--- or is that better? 14:24:18 quickrr: use `pkg info -r libfmt` 14:25:35 dch: very nice, thanks :) 14:25:38 demido: share your vm-bhyve conf? my old debian9 with usefi works without console, I just used graphical console for the installer. 14:25:38 https://docs.skunkwerks.at/s/UUA69hTzU#debian-9-with-uefi 14:27:02 demido: but yes, the grub doc you posted should work just fine on debian too 14:28:23 dch i want the opposite of you, i want to use console and NO vnc 14:28:59 it's just loader="uefi", graphics="yes", and i can use vnc to install and start it. but i want to use vm console for install and start, no vnc at all 14:29:14 demido: thats not what I said, I only used vnc for the install, and afterwards can skip it. the doc you linked to looks like it will work, .. 14:29:27 demido: but it requires modifying grub config after install. 14:30:07 this (to me) looks like a debian/ubuntu issue rather than a specific bhyve one 14:30:20 https://p5r.uk/blog/2020/instaling-debian-over-serial-console.html covers altering the installer to cater for that case 14:31:01 is 'update-grub' a freebsd pkg? 14:31:26 demido: no. all of this stuff requires hacking debian. either after install, or on the debian .iso you downloaded 14:31:41 it would be nice if all OS could be installed via (serial) console 14:31:47 sheesh. just to be able to use a large vm disk dang 14:32:58 duno if you saw what i learned but 2048GB is the max that grub works seamlessly with. more than that and that's when i ran into problems 14:33:44 demido: is this a GPT format disk, or MBR? the uefi loader + GPT format should be able to deal with very big disks 14:34:22 not sure. i just used debian installer defaults. i'm using uefi loader now instead of grub and it works, but i have to start it with graphics="yes" 14:34:31 haven't figured out uefi sans vnc yet 14:35:00 huh, https://bugs.launchpad.net/ubuntu/+source/grub2/+bug/1666853 14:35:52 lol sitting around for years, 'nice' 14:36:24 demido: when you boot via bhyve without graphical console, do you get (at any stage) a terminal? 14:37:21 if i vm install with grub and >2048GB, vm console works and i can get through installation. but at end of debian install it wants to reboot so i do that and it boots to grub> prompt 14:37:25 instead of the OS 14:37:55 so 2 separate issues, (1) debian can't use large disks for the root fs, that we can't fix here obviously. 14:39:07 and you want to be able to install bhyve via serial consolel, that we probably can help 14:39:39 i got debian vm running with a 4TB disk  for root fs tho 14:40:00 i just had to use loader="uefi", graphics="yes" and vnc 14:40:25 <[tj]> is grub using the serial console? 14:40:32 <[tj]> would that do it? 14:40:42 ya, works great, as long as disk is <=2048GB 14:40:52 but i need my vm to have 4TB disk 14:41:01 <[tj]> how does graphics let you use 4TB? 14:41:07 <[tj]> I'm not connecting these 14:41:11 back 14:41:20 ya, works great, as long as disk is <=2048GB, but i need my vm to have 4TB disk 14:41:42 <[tj]> how does graphics let you use 4TB? 14:41:46 <[tj]> these dots don't connect for me 14:41:48 demido: we seem to be going in circles here. (1) is a debian issue, we can't fix that for you. See the above bug I linked. 14:41:59 <[tj]> dch: I prefer spirals 14:42:18 inbound spirals, converging on a solution 14:43:26 i'm using vm-bhyve. in my vm config, if i use grub loader, i can run vm console for install and using installed vm. i just gotta keep disk <=2048GB. to use a bigger disk, i gotta set vm config to loader="uefi" and graphics="yes" but then i can't use vm console, i gotta connect with vnc and i don't want that. i want console still 14:44:31 <[tj]> you need loader=uefi without graphics? 14:44:47 <[tj]> I've never used vm-bhyve so I'm not sure where to dig 14:44:54 ya but when i try to boot that, it says something like no video detected, using blind mode 14:45:08 <[tj]> what does? 14:45:22 the screen says that after i run vm console 14:45:25 <[tj]> is it vm-bhyve, grub or linux? 14:45:29 <[tj]> what screen? 14:45:46 the text on the screen. using loader="uefi" not grub 14:49:24 well i'm gonna crash it's late af. ty for trying to help me dch i'm prolly too tired to comprehend 14:54:37 demido: if you are booting with uefi than wait for vm-bhyve v1.6.2 14:54:47 version 1.6.0 is broken 14:54:58 the fix is ongoing 14:55:24 if you are booting linux with grub, vm-bhyve should work fine 15:05:03 [tj], jmnbtsls1E: thanks for the info. :) 15:24:37 hm, entering capability mode breaks rusts backtrace printing, afaik it uses libunwind, what do I have to call before cap_enter() so that it works properly? 15:27:41 nimaje: can you provide ktrace output? i can't think off the top of my head what libunwind would be doing that would make capsicum unhappy 15:30:58 it doesn't make capsicum unhappy, it just doesn't show function names and file locations (just instead) 15:31:49 oh, hm. can you reproduce that in C using backtrace + backtrace_symbols by using libexecinfo? 15:32:01 that also uses libunwind 15:33:41 libexecinfo alone definitely doesn't look capsicum friendly 15:34:17 neither is my spincter 15:34:23 *sphincter 15:35:09 backtrace_symbols immediately wants to open() the binary, which wants both sysctl lookup and a subsequent open(2) 15:35:27 that will probably cause the unknown names then 15:36:42 still, i'd expect the actual unwinding to work, it's just the symbol resolution that would be broken then 15:36:42 I think everything else seems fine, though I'm not really sure how this works if you need to cross into a DSO or something 15:37:13 tbf they didn't say that the unwinding didn't work, just that it doesn't resolve names and locations 15:37:18 yeah 15:37:44 yeah, the unwinding works, but just some addresses doesn't help really much to debug stuff 15:40:09 not a whole lot you can do there, unfortunately; you could make it work, but you'd need to re-work libexecinfo a bit at a minimum 15:41:50 it wants to re-open() the binary fd every time you call backtrace_symbols(), I would suspect you could bake in a global fd and add a function to preload the exe binary, and use that if it's not -1 -- otherwise keeping the current open_self() calls 15:43:07 I don't think you'd want to remove the open_self() at runtime call just to avoid changing applications and to allow some flexibility to not burn an fd at the cost of not much complexity 15:49:44 https://0x0.st/8HFT.c is a bit better than what rust produces, it doesn't get the main function name, but figures out that it comes from the binary and it prints libc stuff 15:58:59 https://0x0.st/8HFQ.rs a rust equivalent 16:01:37 this seems to work well: https://termbin.com/2r1u 16:01:56 maybe it'll never grow anything else needed in a sandbox, but as a PoC 16:13:33 whoops, that has a major flaw in that it will close(self_fd) at the end of backtrace_symbols_fmt; easy fix 18:28:56 How can I find all snapshots that have changes to a given path? 18:29:59 I'd rather something faster than grepping zfs-diff 18:44:11 i don't think that there is 19:15:48 Hi, in a Jail, if I run "nc -lv 5000" it hangs, instead of showing "Listening on [0.0.0.0] (family 0, port 5000)" 19:16:16 martinrame what kind of jail networking? inherit? new? or vnet? 19:16:22 inherit 19:17:09 antranigv: allow.raw_sockets; ipv4=inherit; ipv6=inherit; 19:17:18 antranigv: I don't really need ipv6 here. 19:18:08 antranigv: this is not a vnet jail btw. 19:18:27 what makes you think it's hanging and not just listening? you can check.. i don't think base netcat prints anything on listen. you might have a port installed that's giving you that output. 19:18:51 martinrame with inherit, it inherits the host's network stack. as long as no one on the host listens on 5000, it should work fine. can you check the sockets using sockstat ? 19:18:52 isley: because I tried telnetting from the host and it doesn't respond. 19:19:09 antranigv: from inside the jail? 19:20:02 martinrame in case of inherit, it should not matter. 19:21:38 antranigv: https://termbin.com 19:21:45 antranigv: https://termbin.com/0y8m 19:22:22 yeah, base nc doesn't print a message about listening 19:22:28 even with -v it'll just print when a client connects 19:23:22 kevans: you are right. I tested on linux and it prints the message, but not on FreeBSD. 19:23:39 you've got an nc trying to do DNS stuff, is that this one? 19:24:44 It looks like a firewall issue. If I run nc -l 5000 from the host I can telnet to it, but not from the jail. 19:26:04 sorry, from the jail it also works. I used nc to try to debug a Phoenix (port 4000) issue, there it hangs. 19:27:14 so the original report is wrong and it's really just when trying to connect to Phoenix? (which seems to be some kind of web framework?) 19:27:21 nothing listening, just connecting? 19:27:54 oh. maybe "not nc at all, just phoenix and nc was to make sure bind/listen was fine" 19:28:51 kevans: yes, nc binds ok. 19:34:30 i know i am going to be asking a loaded question here: I need to get a GPU for my ollama bhyve and was wondering.. is there a "list" of GPUs that work with bhyve? 19:35:52 all i have been able to find is a AMD list.. which is great but curious if there is another "official" lishttps://wiki.freebsd.org/Graphics/AMD-GPU-Matrix 19:41:39 voy4g3r2: I use a rtx 3090, dell OEM and it works great. Some nvidia gpu's have a problem with resetting so you need to restart the whole machine if your restart the VM 19:41:52 you will also need to apply a small patch to bhyve if you want a nvidia gpu 19:44:21 12 or 6 gig model? 19:44:34 not bad price point either in my 200-300 range budget 19:46:50 24gig, but amd cards might work without any hacks 19:47:24 just make sure you cpu/mobo combo supports passthrough 20:06:22 getz: will the motherboard say passthrough or the like? i have a i3 and this board: https://www.microcenter.com/product/662283/B760M_DS3H_DDR4_Intel_LGA_1700_microATX_Motherboard and so far i have been able to do a lot of things with bhyve and it.. just not GPU passthrough 20:37:56 voy4g3r2: *disclaimer* i don't know a lot about freebsd but if I've understood what you want to do correctly, i think the thing that your motherboard needs to support is "IOMMU". that should at least give you something to google and see whether it looks plausible. 21:18:15 mzar know when vm-bhyve 1.6.2 is coming? 21:19:50 the patch is ready, if driesm@ pushes it fast then by the beginning of next week 1.6.2 will be in official repo 21:20:30 mzar ok ty! there any place i can read about what it's going to address? to see if it's involved with th eprob i'm having 21:20:34 demido: you can buid it from ports, update patch is on the FreeBSD bugzilla 21:21:49 demido: see PRs 273560 and 284254 on Bugzilla 21:28:28 hm maybe. ok i'll collect more info on this prob and share in an hour or two. i wanna get all the details right 21:35:18 crab: thanks for the tip. 21:35:29 looks like my 500w power supply will not work with these beast video cards..