00:54:47 want me to try anything with bsdinstall_chroot or go right to the ls -l kevans? 00:56:14 just go straight there 00:58:51 k, building 00:59:12 destructing 01:02:55 ok for ls and cat got: /tmp/bsdinstall-install*: no such file or dir 01:04:23 which branch are you installing, to be precise? 01:05:27 oh right, in the chroot it doesn't have that prefiz 01:07:28 i'm installing from 13.3 repo pull 01:07:58 releng/13.3 01:08:06 just checked and up to date with that branch 01:08:35 hmm 01:09:22 everything should be mounted at that point... the lack if any bsdinstall-install prefixed files would seem to ndicate that we are infact chrooted 01:20:46 what else can i do to help you debug? i'm at the extent of my knowledge 01:22:53 maybe inspect the fs state a bit in the scripr 01:22:59 ls -l /mnt /usr/local 01:23:18 is that /mnt/usr/local or 2 separate paths like you typed? 01:23:46 two separate 01:23:50 k building 01:29:19 well /mnt has 0 and /usr/local has bin etc share www 01:35:46 is there some kinda wait command that'llmake the setup script pause for 1 second? it's kinda hard to catch the data sometimes 01:37:29 or sleep? 01:37:38 ok, so you are chrooted 01:38:37 but then why is the thing you're expecting not there 01:39:11 oh this doesn't have that. this is way stripped down to just what i pasted 01:39:23 and the extras distro is empty just to simplify testing 01:39:40 know how i can make the setup part sleep? i can add the other stuff back in and test 01:39:52 right, but /mnt is empty 01:40:01 just sleep, yeah 01:40:18 oh lol 01:41:17 building 02:02:51 kevans: https://termbin.com/lemi 02:03:41 putting jail dir at / root for less typing 02:04:18 seems when i create a zfs mountpoint, it doesn't use the chroot because of the altroot property? 02:04:35 it is in the chroot, though 02:04:40 ls -la /mnt 02:04:40 # --> empty 02:05:01 so the altroot property is affecting how it works IN the chroot 02:05:28 this feels like a bug so far 02:05:55 is it INTENDED for zfs altroot to be set to /mnt during the setup phase of a scripted bsdinstall? 02:06:03 almost certainly, yes 02:06:14 so what do you think the bug is? 02:08:47 oh, I see what happened now 02:08:52 ls -la / 02:08:52 # --> 22 items (no "/jail") 02:08:54 er 02:08:59 the next one, /mnt/jail exists 02:09:19 ya, the new /jail mountpoint is being created in the /mnt dir, not at / 02:09:21 because it looked up altroot but didn't consider that it's in a chroot 02:09:26 because of altroot 02:09:29 yep 02:16:43 what do? 02:29:59 are you sure it's not working as intended? if the altroot is /mnt, shouldn't it be creating the mountpoint in /mnt/jail instead of /jail? it's still within the chroot 02:32:37 it is, in a way 02:35:40 why is altroot even set? i remember asking about it in #zfs last week because i expected the mountpoint to be off of /, and they said it was in an altroot because during install it's on a tmproot or smth. but if it's in chroot, why does it need altroot at all? 02:36:34 because you can't let it mount at / 02:36:40 you can't chroot until it's mounted, and you can't let it mount at / 02:36:56 therefore you need an altroot to safely move it out of the way 02:37:28 why can't let it mount at /? 02:39:20 because you don't want it covering the install media while you're trying to build it out 02:40:01 feels like some part of the design here is painting us into a corner 02:40:18 if not then tell me how i can start and jexec against a jail in the installerconfig's setup phase? 02:46:01 try symlinking /mnt/jails into the root 02:46:24 you might need to cleanup the symlink on success, not sure yet 02:47:12 whoa 02:47:14 lemme try 02:49:18 alternative `zfs create -u` and just mount it manually 02:52:43 with symlink method i gotta clean it up before rebooting, with zfs create -u it's a temporary change that i don't have to clean up. i think the latter sounds cleaner 02:52:51 ill try symlink method first just to see if it works 02:55:45 you can also copy ZFSBOOT_DATASETS out of the bsdinstall scripts and set that in your script 02:55:51 adding in your jails dataset or any other you need 02:56:18 how would that fix it? 02:56:29 because ZFSBOOT_DATASETS get created by the installer before your script runs 02:56:37 thus avoiding the chroot issue entirely 02:57:16 so it wouldn't have the /mnt issue? 02:57:21 it would just be right off / 02:59:26 btw man page for bsdinstall ZFSBOOT_DATASETS seems to have an error. it says "about who to write" should be "about how to write" ya? 03:12:28 it's since been changed to "how to populate" 03:13:20 nice! 03:13:49 i gotta sleep sadly but the symlink at least shows up in ls -la like /jail -> /mnt/jail. i'll test if that lets the jail start and work normally tomorrow 03:13:57 tyvm for helping me 04:35:37 I have question related to jails exec.clean command parameter, specifying this parameter in jail.conf means any command parameters that runs in system environment should be run in clean environment? except USER, HOME, SHELL and TERM? 04:41:25 padukajorat, Commands that run through the jail commands, yes. Obviously commands that run normally inside the jail have their normal environment. But clean is like "env -i" with those named variables passed through. 04:41:55 This is documented in the jail(8) man page. 04:48:01 yeah, i went through the jail(8) man page, kind of confused i am, let us assume i am using exec.prepare="" so this exec.prepare will run in clean environment? if i have exec.clean set in jail.conf? 09:18:35 hm one thing what i have not played around is.. how i can control device led lights on freebsd? 09:18:59 does not seem to have much information on net 09:20:02 ivaat: there's led(4), but i don't know what drivers support it (em(4) does at least) 09:20:19 apparently they should show up in /dev/led if available 09:21:25 ls: /dev/led: No such file or directory 09:21:30 ok its duck tape then 09:21:55 the mini pc has so bright blue led :) 09:22:42 it might be one of these things where you have to load a random kmod to get the driver, a lot of system/i2c/whatever stuff is like that 09:24:51 okey 09:24:55 i will dig around 13:54:24 i want to build a dns/knot package but i can't until the build i started last night finished... currently doing electron28 and qt6-webengine. bleh. i hate this 14:53:16 can anyone help us compile freebsd? 14:57:12 Soni: have you read https://docs.freebsd.org/en/books/handbook/cutting-edge/#makeworld ? 14:57:14 Title: Chapter 26. Updating and Upgrading FreeBSD | FreeBSD Documentation Portal 14:58:15 lw: yeah it runs out of ram 14:58:23 (with -j1 ofc) 14:59:01 well, you may need to add more memory, i'm not sure there's any other workaround for that 14:59:22 how much? 15:00:01 i don't know what the minimum is, although kevans said 2GB when you asked yesterday i think? which sounds reasonable to me... the host i normally build on has 6GB and i've not had a problem there 15:01:25 oh only 2GB? okay 15:05:08 here we go building llvm again... this takes a while 15:22:34 well you can add swap too but then it will not be fast :) 15:22:50 just mentioning if someone is testing-doing on vs for example 15:22:59 vps 15:26:51 we are using a VM 17:40:33 what kind of sensitive information might one find in dmesg that should be redacted prior to publicly sharing it? 17:40:44 jbo: hopefully, nothing 17:40:53 maybe MAC addresses if you are super paranoid 17:41:09 lw, I thought so but was wondering since: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=278311#c9 17:41:11 Title: 278311 – amdtemp: Does not recognize AMD Threadripper 7960X 17:41:31 curious, i am not sure what that could be referring to 17:41:52 i know some people consider their IP addresses and stuff to be "sensitive information" though 17:42:00 (hackers can find your IP address!!!) 17:43:31 well I mean... 17:43:34 whatever? 17:43:36 jbo: delphij seems quite friendly IME, maybe just ask :-) 17:46:20 true 17:52:47 lw, hw.model: AMD Ryzen Threadripper 7960X 24-Cores :x 18:17:56 jbo: go away 18:18:19 ( :-) ) 18:24:21 yeah, typically nothing but it's nice to remind people 18:25:49 It's also very surprising to me what other people get upset about and then want to have it removed. After they already emailed it to 2000 people on a mailing list. 18:26:58 And of course sometimes I am on the admin side doing the redaction. And sometimes I am on the gawking side where I run over there quickly to see what it is that they want to hide from other people before it gets redacted! 18:32:10 right, in my experience it's better to act casual after you've accidentally leaked something really important :-) 19:11:02 lw, ok :( 19:13:05 jbo: you are gonna be so jealous when my Chinese router arrives from AliExpress, i bet it has more 10G Ethernet ports than you!! 19:13:24 lw, much jealous 19:14:10 lw, does your chinese router also have this? 19:14:11 kern.smp.cpus: 48 19:14:13 :D 19:15:46 My IP address is 127.0.0.1. Everyone here is allowed to use it to DoS me. 19:19:03 lw, I did decide not go get a new GPU yet tho. so running a 8 years old GPU 19:20:30 my workstations are ancient 19:21:32 whenever I get round to replacing the oldest I'm planning on just using amdgpu 19:22:08 no aircon and it gets hot in the office in summer 19:22:26 yep 19:22:46 the +350W TPD of the new CPU was a major "problem" 19:24:46 jbo: i have an NVidia GT710 if you want to borrow it? 19:25:04 lw, nah I just migrated the GPU I have/had in my previous desktop (Nvidia Quadro P5000) 19:25:55 picture: https://bin.jvnv.net/file/mG6y0 19:26:31 your computer looks like a borg drone 19:26:52 thank you 19:26:55 what's the lower PCIe card? an SSD? 19:27:32 https://bin.jvnv.net/file/ncViH 19:27:56 also did you go with a different motherboard, i thought you were looking at one with like 10 PCIe slots 19:28:01 top to bottom: GPU, 4x PCIe m.2 Gen5 adapter card, 4x USB dedicated controller card (for bhyve pass-thru) 19:28:24 lw, that is when I was still considering to go Intel Xeon w5-3400 or w7-3400 19:28:32 ah right, you did AMD 19:28:34 but eventually I moved to threadripper 19:28:37 yeah, this is my first ever AMD machine 19:29:14 and yes, it only boots FreeBSD. 19:29:33 i heard on questions@ about some issues with TR recently, i hope you don't run into that 19:29:34 lw, there are 4x 4TB SATA drives in the very bottom (not visible) 19:29:49 that was about it not booting at all though so i guess if it boots it's fine :-) 19:29:49 lw, what kind of issue(s)? 19:29:54 ah 19:29:55 single boot would be a bit of a luxury 19:30:22 - L- 853/3265: Chris Torek 14-stable on AMD7950X: Good and bad news 19:30:29 thread on -stable (not -questions) 19:30:54 ah, that was specifically with amdgpu not working 19:31:09 that is a ryzen, not a threadripper 19:31:11 this one has no GPU 19:31:25 wait what 19:31:33 7950X is a Ryzen, 7960X is a TR? 19:31:35 yeah 7960X is threadripper 19:31:42 wtf is your product naming doing, AMD 19:31:43 yep... don't ask. I was also like " wut" 19:32:05 I mean, they do seem to call it "AMD Ryzen Threadripper 7960X" 19:32:09 so, kinda also a ryzen? 19:33:10 ok 7950X has 16 cores, i guess if 7960X has 24 cores that sort of makes sense 19:33:31 i thought in the past TR was a completely different CPU though (other than the Zen core itselF) 19:33:40 anyway, I hope to get some time over the weekend to setup the machine. too busy right now. 19:33:42 like, different socket and stuff 19:33:49 it is a very different socket. 19:33:54 this CPU is HUGE 19:34:38 jbo: do you have ECC memory? (and do AMD actually certify ECC on TR?) 19:35:04 lw, it's ECC memory, yes (real ECC, not the regular DDR5 "on-die ECC". I yet need to figure out whether it actually performs as ECC memory. 19:35:41 i've been wondering that too but i'm not sure how to test it other than hitting one of the chips with a hammer 19:36:11 btw the CPU ships with a torque wrench in the box 19:36:34 that's funny 19:36:55 i assume that's for attaching the heatsink, not for bolting it into the socket 19:37:04 the latter :D 19:37:12 ... 19:37:13 https://www.storagereview.com/wp-content/uploads/2023/11/StorageReview-AMD-ThreadRipper-HEDT-6.jpg 19:37:16 it's not a ZIF socket? 19:37:17 the three screws 19:37:22 it's LGA 19:37:24 ah 19:37:44 that seems weirdly janky for a modern CPU, are Xeons like that too? 19:38:00 not the xeons I have worked with. but I haven't had anything new since 2017 19:38:10 I'm completely fine with it tho. 19:38:14 I like the torque wrench approach. 19:38:26 but I'm an electrical engineer so... 19:38:53 i'm okay with a torque wrench for a bolt but with a screw head like that it seems like an invitation to strip the head if you do it wrong 19:38:58 once I had some time to setup the system and ensure that everything works well I'll try to do some overclocking. That's why I went for 2x 360mm radiators 19:39:18 it's torx. hard to screw that one up. 19:41:29 jbo: so can i have a shell account to build ports? 19:41:57 it's the least you can do when i helped you commit all those ports 19:42:36 lw, no :> 19:42:43 lw, but I should be faster at building ports now. 19:42:50 it did a buildworld in 404 seconds 19:43:06 with clang? i don't believe that actually 19:44:02 it takes me about an hour to build clang and i don't believe your CPU is that much faster :-) 19:44:27 although i do have HT disabled 19:44:51 well, it's what I observed. but I had an extremely busy week and only played around with it for a little while yesterday. will do "proper testing" over the weekend 19:44:55 the first run was 418 seconds 19:45:20 I had a hard time believing it too 19:45:28 it felt like a reverse scam 19:46:06 rm -rf your obj directory and try again and make sure it builds toolchain, not just src... if it can really do that in 400 seconds i will reprioritise things to buy a new build system 19:46:17 lw: we've got a box that builds freebsd in ~5 minutes 19:46:33 CPU: AMD Ryzen 7 5800X3D 8-Core Processor (3400.15-MHz K8-class CPU) 19:46:34 lw, it definitely built clang too. 19:46:43 this is not a TR but it's also not super slow 19:46:49 lw, this is 24 cores, 48 threads at sustaining 4.2 GHz 19:47:06 and PCIe gen5 SSDs in mirror (if that matters (probably not)) 19:47:12 jbo: yeah but proportionally, if it takes me an hour with 8 cores, shouldn't it take longer for you on 24 cores 19:47:18 or am i bad at maths 19:47:34 hmm it is true the SSD in this system is hilariously slow, that probably doesn't help... i've been meaning to replace that 19:47:48 the base system is on two Crucial T700 disks 19:48:45 i think freebsd build caps at -j64 or so, no big gains past that 19:48:56 i don't recall the exact number, but 64 rings a bell 19:49:22 I still 'like' the feel of -j80 19:49:40 kevans: -j256 is also satisfying, but not very useful :D 19:50:04 lw, just did a make clean, rm -rf /usr/obj, make -j48 buildworld, ttyl. 19:50:21 jbo: hopefully not too much later, lmk 19:50:47 i waste so much time waiting for kernel builds i really do need something faster (although i knew that already...) 19:51:00 lw, kernel builds in what feels like < 60 seconds 19:51:11 GENERIC, that is. 19:51:27 lw: do you use META_MODE? 19:51:37 dstolfa: yes, but building all of a kernel still takes a while 19:51:44 let me do a quick test to compare... 19:52:01 my incremental builds take around 2 seconds for kernel 19:52:13 fresh takes around... i wanna say ~2 minutes? 19:52:23 and this is on a 16c/32t xeon 19:52:51 it does have nvme storage and plenty of RAM, though 19:53:00 i ran into this earlier when i merged main into my local branch to test a one-line change and it recompiled the entire thing for whatever reason, even with meta mode 19:54:28 make -j12 KERNCONF=GENERIC buildkernel 756.05s user 135.85s system 738% cpu 2:00.72 total 19:54:47 so 2 minutes, not really that bad, it just feels slow 19:54:59 the youngsters these days are so impatient... 19:55:28 * dstolfa blinks in 3 hour long builds currently 19:55:43 hey, i built electron28 earlier, that took like 10 hours 19:56:03 lw: yes, but do you have to do it every time you make a single line change? :P 19:56:29 dstolfa: it basically feels like it yes... probably because it depends on so many things 19:56:47 >>> World build completed on Fri Apr 12 19:56:38 UTC 2024 19:56:47 >>> World built in 412 seconds, ncpu: 48, make -j48 19:57:03 that is with non-OC and stock RAM timings 19:57:05 ok, i jsut deleted my /src/obj so let me try a buildworld to compare 19:57:06 (no EXPO) 19:57:24 i'm currently dealing with building v8 on morello, having to change a header to test something and it basically kicks off a fresh build because that change is inlined everywhere 19:57:27 pain 20:04:03 fun build error of the day, i guess this is caused by the llvm 18 update https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=278336 20:04:05 Title: 278336 – multimedia/ringrtc: build failure 20:05:23 lw, are we still waiting for your build to finish?! 20:05:31 * jbo hides under the table 20:06:24 jbo: PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 20:06:24 6425 lexi 1 102 0 344M 293M CPU1 1 0:04 32.18% clang 20:06:24 24394 lexi 1 101 0 291M 258M RUN 7 0:04 30.27% clang 20:06:24 33559 lexi 1 98 0 291M 236M CPU5 5 0:03 22.27% clang 20:06:24 52510 lexi 1 98 0 259M 220M RUN 1 0:03 22.17% clang 20:06:24 58132 lexi 1 96 0 259M 212M CPU4 4 0:02 19.29% clang 20:06:24 66594 lexi 1 95 0 231M 181M RUN 2 0:02 15.58% clang 20:06:25 60076 lexi 1 94 0 231M 178M CPU3 3 0:02 15.09% clang 20:06:26 84965 lexi 1 92 0 170M 130M CPU2 2 0:01 10.16% clang 20:06:26 54243 lexi 21 20 0 1115G 211M uwait 7 17:47 0.88% QtWebEngineProcess 20:06:27 73098 lexi 1 68 0 36M 16M wait 1 0:00 0.88% ccache 20:06:27 49693 lexi 1 68 0 33M 14M wait 4 0:00 0.68% ccache 20:06:29 holy mackarel 20:06:37 ok, phew 20:06:43 ... i did not mean to paste that 20:06:51 jbo always makes me paste stuff wrongly 20:06:53 so you still didn't learn how to paste? :D 20:06:57 ahahahaha 20:06:59 let's try this again 20:07:08 jbo: https://www.le-fay.org/tmp/30d/HMW95f.txt 20:08:52 i really need to script my IRC client to intercept multi-line paste and not send them 20:10:03 although on the subject of top output, look at this 20:10:11 54243 lexi 21 20 0 1115G 211M uwait 7 17:47 0.88% QtWebEngineProcess 20:10:17 that's 1.1TB of virtual memory 20:10:22 how is that even possible? 20:10:45 like, what is it even doing to map that much memory 20:11:27 hmpf, I don't seem to be able to log into phabricator anymore 20:11:35 was there something happening? I was mostly "AFK" the past few weeks 20:11:54 my account seems ok, or at least i can load the front page 20:12:11 never mind... it's not using kerberos 20:12:17 PEBKAC 20:12:32 jbo: 24 CPUs and you can't even log into a website? smh my head 20:14:33 lw, :D 20:14:47 lw, still on my old system. only SSH'ing into the new one to buildworld for you 20:14:49 meanwhile, buildworld still on clang 20:15:16 so glad this builds the PowerPC and LoongArch targets for all those PPC and MIPS systems i don't have 20:15:58 we could play factorio in the meantime 20:16:09 i would but i need to build dns/knot 20:16:24 have literally been waiting all day for electron to finish building so i can do that 20:55:26 lw, still building world? 20:55:35 oh no it finished 20:55:39 >>> World built in 2919 seconds, ncpu: 8, make -j12 20:56:20 kevans: ok back at it i'll tell you if the symlink method let jails start 20:57:49 lw, still faster than my current shit system 20:58:01 jbo: remind me what your score was on the TR? 20:58:07 or did you not try buildworld yet 20:58:19 lw, wtf? the 404 seconds was TR 20:58:23 ah right 20:58:36 or 412 in the run I did just for you earlier 20:58:41 2929/404 = 7.25 20:58:45 24/8 = 3 20:59:00 so your base CPU performance is 7.25/3 = 2.417x faster than mine? 20:59:04 alepzi: thanks; if not, `zfs create -u` to prevent it from mounting and just mount it yourself after it's created (or the ZFSBOOT_DATASETS we talked about) 20:59:24 lw, keep in mind that mine is powered entirely by hydroelectric power 20:59:25 yours are like 5GHz turbo right, i guess that's about right 20:59:29 nod 20:59:42 5800X3D has a really low turbo clock even for Ryzen 20:59:43 kevans, how's the ecc stuff going? 20:59:56 jbo: just have to do the pkg(7) side now 21:00:04 kevans, nice :) 21:00:05 I looked at the libstdc++ bits and man, this is a royal pain in the ass 21:00:17 :(((((( 21:00:33 would you happen to enjoy having royal pain in the ass? 21:00:38 figuring out with gcc's build system how to build just libstdc++, I'm not yet convinced that it's possible 21:01:01 kevans, wasn't there an alternative approach we discussed? 21:01:35 what are you two working on? 21:01:42 i hear libstdc++, i am interested 21:01:45 I don't typically enjoy it, no :-) 21:01:50 bare metal libstdc++ built against newlib 21:02:14 we have arm-none-eabi-newlib, but arm-none-eabi-libstdc++ would unlock some stuff jbo is trying to do 21:02:20 lw, I was complaining to kevans@ that arm-none-eabi-gcc is "useless" in it's current form :p 21:02:25 ah 21:02:41 s/gcc/newlib 21:03:07 I think I had it building, but I think it wasn't actually using newlib 21:03:14 so because kevans is a lazy slacker I had to get a $6k PC upgrade to spawn VMs just to compile against Cortex-M targets :p 21:03:33 :/ 21:03:56 $6k i guess you're an ecc enjoyer? 21:04:01 tbf the projects I was derailing on were significantly more fun 21:04:11 kevans, 21:04:49 alepzi, yes, ECC RAM. I'll never get non-ECC ever again. but I went for cheapo RAM because money is a problem at the moment. 21:05:06 ya same 21:05:10 "i bought a new $6k PC" "money is a problem at the moment" 21:05:25 $6k turkish lira 21:05:25 well technically it's the company's PC, not mine 21:05:38 and my current "workstation" is 7 years old 21:06:06 hmpf... I don't think that I can explain this in a way that would make it sound better 21:06:09 let's just change topics 21:06:25 pwned 21:07:43 [#freebsd] lw, keep in mind that mine is powered entirely by hydroelectric power 21:07:47 wait you're Canadian? 21:10:29 no he's from dubai where they burn oil to pump water up a hill then let it run down a hydroelectric dam for Clean Energy 21:15:57 lw, as you know. yes. 21:16:06 (I'm swiss) 21:16:13 the canadians of europe 21:16:47 here in the alps where I'm located, we get 96% hydroelectric and 4% solar power 21:16:59 nice 21:17:07 not if you have to pay for it 21:17:22 you'd think they could combine those two things are boil the water with solar power to generate electricity 21:17:26 also, did you just assume my gender? >:D 21:17:47 jbo: so do you get 25Gbps Internet at home? i heard swiss people have this 21:18:05 lw, yes. although I only have 10Gbps at home. 21:18:21 I don't have the necessary hardware 21:19:02 are you looking for a housemate? i have switches 21:19:20 i'll come 21:19:36 lw, I actually am, yes. 21:19:37 jbo bsd flophouse 21:20:00 jbo: ok, can you move into our house and bring your internet with you? 21:20:01 I am currently in a 4.5 bed room 150m2 penthouse apartment I'm moving out of because it's too huge ass for living there alone (and again, money is a problem) 21:20:19 lw, not sure whether your bf would like that but sure 21:21:51 anyone who seriously wants to move in here with me has exactly 6 days to decide because my current plan is to move to a tiny one bedroom apartment soon 21:35:35 using virtio-9p with bhyve. works great, but i noticed on reboot (of the FreeBSD host) the guest VM sometimes has failed to mount the passed through filesystems. i can connect to the guest "mount -a" and all is well. i'm guessing it's a timing issue on the FreeBSD host at boot. If I just reboot the VM, everything also works fine, i.e., it's only on an actual host reboot I have the problem. 21:39:46 markmcb: what provides the filesystem on the host? 21:39:52 (UFS, ZFS, NFS, ...?) 21:39:55 zfs 21:40:08 what are you using to start bhyve? 21:40:37 vm: vm_enable="YES" 21:41:30 hmm, that's more or less the same config i use (zfs, vm-bhyve) and i haven't noticed this issue 21:41:54 markmcb: out of interest, if you edit /usr/local/etc/rc.d/vm to add 'LOGIN' to 'REQUIRE', does that fix the problem? 21:42:18 (this is my go-to method to fix rc ordering issues since LOGIN runs after everything has started... although tbh i can't imagine that's the issue here) 21:42:24 the other complexity is this guest is Ubuntu 24.04 running Incus (formerly LXD) ... another guest without Incus and also using 9p never has this issue 21:43:16 lw: I'll try the LOGIN tweak 21:43:34 i notice that rc script has a strange 'BEFORE' - 'dnsmasq ipfw pf'? 21:43:47 i'm not sure why you'd want VMs to start before those services 21:44:18 yeah, i was wondering about that too 21:44:47 this may be nothing to do with the issue but i would try removing that as well 21:44:58 although i think zfs filesystems should be mounted well before any of those 21:46:56 unrelated, has anyone noticed this on 15-CURRENT? 21:46:58 Apr 12 21:42:35 amaranth node_exporter[4926]: ts=2024-04-12T21:42:35.787Z caller=collector.go:169 level=error msg="collector failed" name=zfs duration_seconds=8.2479e-05 err="couldn't get sysctl: no such file or directory" 21:47:20 all my node_exporters are logging this, even on systems that are definitely using zfs 21:47:59 node_exporter_args="--no-collector.zfs" fixes it but i don't understand why it doesn't just work 21:50:31 lw: that seems to have done the trick, thanks for the work around! 21:51:10 markmcb: that's odd, i suggest filing a bug against sysutils/vm-bhyve because this shouldn't be required 21:52:36 will do 23:28:42 kevans: CONFIRMING that ln -s /mnt/jail /jail was enough to be able to start a jail in the setup phase of a scripted bsdinstall and run jexec shit on it 23:29:00 now i'll rip that out and switch to the zfs create -u method