00:37:15 I'm gonna have to test it further, but it seems like setting compat.linuxkpi.semaphores=1 in /boot/loader.conf has maybe made an impact on the fault errors 00:39:45 I feel like this requires a pretty firm knocking on wood though, since several things so far have given the impression that the fault errors are fixed 00:46:48 oh good 00:55:01 anybody know the answer to my earlier question of gstat vs camcontrol? 00:56:12 basically i added a sata, ide, and scsi drive to this vm but i'm not sure how to identify that in freebsd 00:56:50 i gave them different sizes so i can cheat though 00:59:28 sata comes up as vtbd0 01:00:04 I prefer camcontrol because it identifies the device by model. If I want the serial number though I query the device with "smartctl -i /dev/...". There is also "geom -t" which is very useful after it has been partitioned. 01:00:31 Let's not forget diskinfo -cit /dev/... either. 01:01:17 do virtual sata disks have a serial ? 01:03:23 i see 01:03:33 rtprio: that' 01:03:43 s part of the problem, vm's aren't exactly making it easy to identify the drive 01:03:49 it just says VIRTUAL DRIVE or QEMU DISK 01:04:00 bit weird how many dropped frames I get on youtube under firefox on FreeBSD, even with hardware accelerated decoding, while on my PC, using firefox on Linux, with a CPU from the same exact generation, I basically get a small fraction of this number despite using software decoding 01:04:05 where are you trying to identify th drive? what's the vm guest? 01:04:09 freebsd? 01:04:20 yes 01:04:40 like here I've got about 120 dropped out of about 6300 total frames 01:04:42 i realized i couldn't tell sata from ide or whatnot unless maybe it gave it a different device type 01:04:43 and what vm host? 01:04:59 i use virtualbox on windows and libvirt on linux. linux in this case 01:05:11 I am looking at my vm and I cannot run smartctl on a virtual drive. diskinfo -v /dev/vtbd0 does not report any id information. 01:05:23 i couldn't either 01:05:56 Maybe it would be good to add the devices one at a time and then get them configured with a UUID so that the confusion is avoided. :-) 01:06:07 johnjaye: do they not iterate in order? 01:06:14 sure. but i wanted to know the way to do it for real in freebsd 01:06:16 But you said they were different sizes. So you can tell them apart that way, right? 01:06:18 they do. in this case 01:06:27 well yes. but that's because i did that on purpose 01:06:47 i was trying to see if i could tell them apart based on the type of device 01:07:00 On bare metal systems which I assume is what is meant by "for real" then the devices do have models and serial numbers. 01:07:13 ah ok 01:07:24 yep, they do. 01:07:34 as in the device id and vendor id too right 01:07:40 $ sudo camcontrol devlist 01:07:40 at scbus0 target 0 lun 0 (pass0,ada0) 01:07:56 seems picom is responsible for a lot of these frame drops. guess I shouldn't be surprised 01:08:00 what is ada vs da again? 01:08:08 johnjaye, Two examples: https://bsd.to/06in/raw 01:08:09 Title: 06in 01:08:22 da is scsi, ada is sata 01:08:25 SATA controllers are adaX and SCSI controllers are daX. 01:08:56 is 'attachment' the type of controller? 01:09:11 Generally random desktop hardware will have SATA controllers and use ada names. Fancy systems with high performance SAS/SATA/SCSI and use da names. 01:09:31 ok. i think libvirt got that right because it made the scsi one da0 01:09:32 But... USB drives also use da names too. So... I wish USB controllers were different. 01:09:39 eh 01:09:47 ok 01:11:14 On my desktop when I plug in a USB SD card then I get /dev/da0 for it and my SATA disks are /dev/ada0 and /dev/ada1 so there is no confusing. But on my NAS with the SAS controller all of the disks have /dev/da0 through da5 names and plugging in a USB there results in a /dev/da6 name. And I am VERY careful about which is which. 01:12:11 rwp: same: ada0 and ada1, ada4-7 ar the onboard controller here, and ada2,ada3 are the expansion card? for some reason? 01:12:54 rtprio, No idea. But they don't have names unless something is attached there, right? What are those? 01:13:26 yes, i have 8 drives. 01:14:08 You have 8 drives so it makes sense you would have /dev/ada0 through ada7 then, right? What am I missing? 01:14:47 that the expansion card is assigned ada2 and 3 rather than ada0,1 or ada 6,7 01:15:45 What does "sysctl kern.disks" say? 01:16:06 kern.disks: ada6 ada5 ada4 ada0 ada7 ada1 ada3 ada2 01:16:51 That looks perfectly regular to me. Out of order, yes, but all of the devices are there. Those are the dynamically assigned kernel names anyway. Which is why UUIDs or gpt labels are recommended. 01:17:50 i labeled the OS drives, but one label was lost 01:18:02 Very likely your motherboard is using two different SATA controllers, at the least. It would be good to check that all are 6Gbs as many motherboards might only have that for two of the ports. 01:18:42 yes, it is, the onboard controller only has 6 ports 01:19:31 One of my motherboards has huge silk screen lettering 6Gbps SATA! but only two of the ports are 6 and the rest on that motherboard are 3. 01:19:46 i don't recall seeing that 01:20:11 i have " block size: 512B configured, 4096B native " also, which i expect is not doing me any favors either 01:20:59 For the SATA port speed the best I know is smartctl for example: https://bsd.to/hVUe/raw 01:21:00 Title: hVUe 01:21:57 i'll be damned https://bsd.to/7Bep 01:21:58 Title: dpaste/7Bep (Plain Text) 01:22:10 And here is a 3Gbs here too: https://bsd.to/JynG/raw 01:22:11 Title: JynG 01:22:16 my motherboard is like that. half the sata ports are 6Gb the other 3Gb 01:22:20 why? no idea. 01:22:51 Honestly that is pretty typical vendor marketing. It's a buyer beware market. 01:23:14 And also honestly it must be fast enough because it wasn't stopping any of us from using it. Sorry to disillusion. 01:23:31 'current' does that mean the drive supports 6 but the controller does not? 01:23:38 Yes. 01:23:49 you can see which drives i've updated over time with that too 01:24:13 Yes. By the different SATA versions. However that is going to be fuzzy because it all depends upon vendor and such. 01:24:37 they're all wd. the oldest drives sadly have 94500 hours 01:24:55 I have a couple of Hitachis that are past 100,000 hours! 01:25:21 i'm impressed 01:25:54 I assume these are in a RAID configuration running zfs? If so then there is no concern even if one turns up failed. Just replace it when it does. Until then use it until it fails. 01:26:30 2 os drives, mirrored. 6 raidz2. yep. 01:26:54 at some point i need to buy a whole set of drives and migrate because i'm out of space and this sector size thing is annoying and can't be repaired 01:27:55 On 2022-10-18 I recorded this for one of the drives: "9 Power_On_Hours 0x0012 085 085 000 Old_age Always - 108935" that's 109k hours! One of the drives in that pair did start to throw an error last year. 01:28:20 12.4 years. oof 01:29:42 A 1TB Deskstar. Those Hitachis were awesomely good. 01:30:22 The other one in the pair on that day was recorded at 102878 hours. 01:31:16 Oh, and it was the 102k hour drive that started to throw errors. The 109k drive is still going. I just don't have it plugged into anything at the moment. 1TB is so small now afterall. :-) 01:32:10 yeah it is 01:36:51 To avoid the "slow" 3Gbps port problem I am using three different LSI SAS 2008 HBA cards running with IT Initiator Target firmware. Mine are Dell surplus. You can get them inexpensively surplus now. Those are SAS/SATA controllers and will provide 6Gbps to 8 ports using multiple aggregated PCI channel bandwidth. If you have a spare PCI-e slot then that's a good option for increasing disk I/O performance. 01:37:41 i actually had a dell hba card in this, which freebsd casually dropped support for between 13 and 14 01:38:14 twa i believe it was. that's what started my whole mess 01:38:21 That's so annoying when things are working and then support is dropped for it. I have been there many times and find it terribly frustrating. 01:39:18 yeah, just a harmless buildworld/installworld and ... where's the pool 01:40:40 Oh that would be annoying. But you can boot to the previous boot environment and get back going again. But not able to upgrade. Drat! 01:40:45 I think I was able to buy each of these Dell LSI HBA adaptor cards for less than US$50 each at different times. It's a way forward. 01:41:13 And there are fancier cards for more dollars too. 01:41:42 my other system has a mfi one and sas drives, using hardware raid since passthrough on that card seemed annoying 01:41:49 Note that these do get hot without airflow. I have ensured a fan for them in order to keep the temperature down. With a fan they are fine. Without they became so hot that I could not keep a finger on the heat sink. 03:34:37 When it comes to CVEs in packages, who is responsible to updating the package. The security team or the package manager? 04:07:00 port maintainer generally 11:02:18 remiliascarlet: tykling: yep, same zfs code used for linux and freebsd. but linux and freebsd are different kernels, so freebsd-only and linux-only zfs bugs are possible if they involve some kernel-specific interaction 11:04:52 someone (can't remember who offhand) was asserting that no one on freebsd had encountered the zfs encryption + snapshotting + zfs send issue, and there was speculation that it was all due to a linux kernel specific interaction of some kind 11:04:57 but i think that's been disproven 11:05:19 i mean, some freebsd users have seen the same problem right? 11:05:37 andjjj23: yes, i'm having that exact problem right now on 14.0 11:18:27 I'm sending unencrypted data snapshots to a remote encrypted dataset (trough zrepl) and I don't have any problem (13.2) 11:18:55 (offsite backup) 11:21:39 5 11:29:10 mage: the problem seems to be if the sending side is encrypted 15:40:44 andjjj23: I wonder what about the ZFS in OpenIndiana? 15:41:31 Or the one in the mother of ZFS, Sun Solaris? 15:52:48 remiliascarlet: Pretty sure that's still Illumos-based and hasn't moved to OpenZFS. 15:52:56 Or rather, the new definition of OpenZFS. 15:53:09 is openindiana reengineered all the code or is it just Sun's code? 15:53:29 Sun's largely as I understand it. 15:53:55 ok. so kinda different to linux and the *bsds which reengineered all the original AT&T stuff over time 15:54:10 That's part of the unix history I didn't understand initially. That the CSRG rewrote the entire system 15:54:37 Might be more accurate to say they zealously wrote so much that there wasn't a lot of AT&T left that mattered. 15:54:50 CSRG didn't rewrite the entire system, they just released a non-functional OS called 4.4BSD-Lite which removed the remaining AT&T code but as a result didn't compile or boot 15:55:18 386BSD and others rewrote the removed code to make it functional again 15:55:28 That's the last chapter. CSRG did a ton before then. 15:55:48 yeah, i mean at that point the vast majority of the code was probably CSRG, just not all of it 15:55:58 Yeah. 15:57:49 i wonder what BSD/OS was based off... did they have a UNIX source license to use the full 4.4BSD code? or did they start from 386BSD 15:59:22 that was mostly ex-CSRG people, right 16:01:16 They had tapes from AT&T. 16:01:31 The legality of the arrangement was all very relaxed in the very early days. 16:01:45 lw: If you haven't read it, you'd love Salus. 16:02:13 There's a digital copy available on ... um. Forgetting the name. TUHS? 16:02:20 mason: hmm, that's an interesting way to look at it. so if i join your open source project and write 10x as much code as you have... now it's my project? 16:02:34 mason: this one? https://wiki.tuhs.org/doku.php?id=publications:quarter_century_of_unix 16:02:35 Title: publications:quarter_century_of_unix [Unix Heritage Wiki] 16:02:37 johnjaye: Licensing isn't done on the project level. 16:02:43 mason: Forked from OpenSolaris's last (and half broken) release, and continued work more or less independently from there on. 16:02:50 lw: That's the one. I'd recommend a paper copy if you can get one, but that works. 16:02:59 mason: i'll have a look, ty 16:03:26 i started using BSD around 1996 so i just missed a lot of this earlier stuff (and wasn't really paying attention at the time) 16:03:40 mason: i'm not saying you're wrong. it's an interesting idea 16:04:07 I started using Linux in the early 1990s, and only recently discovered BSD. 16:04:10 johnjaye: Not even an idea so much as a description of what happened. 16:04:13 lw: Kirk McKusick and Michael Karels have given talks at BSD confs that were recorded about a lot of the history 16:04:42 There's a good textual example at the beginning of D&I. 16:05:02 i lost my copy of D&I :-( probably time to replace it with the new freebsd edition anyway 16:05:43 Well, I know FreeBSD existed much earlier on, but I thought "FreeBSD runs Gnome, and so does Debian, so what's even the difference?" at that time. But I recently found out that in order to appreciate FreeBSD and OpenBSD, you need to use it for at least a while, and now I love both of them more than Linux. 16:06:00 lost my two volumes of UNP and TAOCP at the same time, that was annoying, they're all a bit dated but still useful references 16:06:18 the TLAs are getting a bit heavy. what's UNP? 16:06:42 johnjaye: "UNIX Network Programming", a popular book on writing network applications for Unix 16:14:41 Richard Stevens' books, yes. 16:15:14 What happened to to "TCP/IP Illustrated?" 16:15:25 Stevens passed I think., 16:15:38 https://en.wikipedia.org/wiki/W._Richard_Stevens 16:15:39 Title: W. Richard Stevens - Wikipedia 16:15:47 So he's not writing more. 16:16:04 mason: yes, i believe someone else updated the books for a new edition a few years back though 16:16:16 Ah, I'd missed that. 16:18:16 yes, RIP Richard Stevens. I have I think all his editions. 16:25:05 one of my shelves: https://lowsig.com/shelf1.jpg 16:28:24 all those books helped with my early career. the magic garden books were useful when working on SGI/MIPS/IRIX. 16:30:29 There were 2 new editions of APUE with Seven Rago (?) writing the updates - Pearson has the copyright. 16:30:35 Steven Rago 16:30:51 Another great early Linux book is "Operating Systems - Design and Impl" by Andrew S. Tannenbaum 16:31:23 OK it's Stepehen 16:31:27 I got my copy when I bought Minix for ATART ST. Took all weekend to build Minux from source on an ATARI but was super fun. 16:32:08 Tannenbaum is Minix oops, not Linux but Linus used that book too IIRC 16:36:14 am i missing something incredibly obvious here? /dev/md0s2 exists, but mount says no such file or directory... https://www.le-fay.org/tmp/30d/M026Wo.txt 16:37:11 oh, it's md0s2a, stupid BSD labels 16:37:34 weird error though as md0s2 clearly does exist 16:47:20 filed bug as i think this is wrong https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=277264 16:47:22 Title: 277264 – mount(8)ing incorrect device gives confusing ENOENT 19:35:36 am i missing something or is there no way to tell wireguard what address to listen / bind on? 19:37:20 it can be any address you want, as long as the one you want is * 19:37:45 yeah, might go back to IPsec if this isn't supported... 19:42:47 or, considerig all my traffic should be encrypted anyway, maybe i'll just stop using a vpn and run over ipv6 19:44:45 right, you get just the port at best 19:44:46 why would you not use ipv6 over that vpn? 19:44:57 nimaje: i am using ipv6 over the vpn? 19:45:10 nimaje: what i'm considering is to just not use a vpn at all and use ipv6 directly between the two hosts 19:45:34 because all the traffic is over tls or ssh anyway, so... what's the vpn really giving me in terms of security 19:46:08 ok, that 'maybe i'll just stop using a vpn and run over ipv6' read like it was a choise between vpn and ipv6 19:46:14 oh, no 19:46:28 the choice is vpn-over-ipv6 + ipv6-over-vpn vs just ipv6-over-internet 19:47:08 i think i set up these vpns initially because a) ipv4 brain (everything goes over vpn) and b) it means everything can have an address in my local /48, but neither of those are really valid reasons 20:52:35 Hi, I have a jail inside a zfs dataset. think of it as tank/jails/jail01 and I want my jail to be able to manage its own dataset, for example create dataset under its dataset like tank/jails/jail01/test. the zfs device has been unhided with devfs.rules, and all of the allow.mount, allow.mount.zfs parameters are have been set. However my jail can't create a dataset under its own. I read the jailed property 20:52:42 of the zfs. But when I want to set it, it need to remount the dataset and obviously it is not possible when the jail is alive. even before starting the jail, you can not use the jailed property because the it will be hide from the host point of view and you can not start the jail because the root directory of it is not mounted. 20:55:26 s/it need/it needs/g s/because the it/because it/g 20:55:47 lw, I need a C++ library that does utf-8 which comes with algorithms such as starts_with(), ends_with(), substring(), replace(), count_occurrences() and that sort of thing. Ideally with conversion to/from other encodings but that is optional. Any recommendations? 20:56:02 lw, I was looking at https://github.com/tzlaine/text but... 20:56:03 Title: GitHub - tzlaine/text: What a c++ standard Unicode library might look like. 20:57:58 jbo: i don't know, i was in the middle of writing my own but got distracted. there was a reference implementation of std::text i came across once but i could never find it again 21:05:17 :< 21:09:09 spmzt: pretty sure jailed=on should be set before starting the jail 21:09:24 or before attaching the dataset to it 21:10:09 you will probably need to add `zfs jail ....` to exec.poststart 21:10:45 i've never had any luck delegating zfs to a jail - even if you get the jail to start, it hangs on shutdown because it doesn't unmount the filesystems properly (zfs unmount rc script is disabled for jails) 21:11:14 would be very interested if anyone got that working, even though i've mostly migrated to bhyve now 21:11:19 use exec.*stop 21:11:35 I had no issues running poudriere in a jail with ZFS 21:11:45 and poudriere loves managing dataset 21:11:51 Remilia: what do you put in exec.stop? 21:12:05 you can use zfs.unjail 21:12:11 er 21:12:15 does that unmount the filesystems? 21:12:18 `zfs unjail` obviously 21:13:01 lw: I forgot since poudriere unmounts everything after a run 21:13:13 so maybe I never considered that myself 21:13:18 It'd be pretty annoying if it didn't clean up after itself. 21:13:25 but if you are *attaching* a dataset you do not need to unmount it 21:13:28 ah yeah. i wanted to run an app that just had a filesystem and some children 21:13:39 you need to detach it 21:13:45 'detach'? 21:13:49 zfs unjail 21:13:57 so unjail unmounts the filesystems? 21:14:10 it detaches the dataset from the jail 21:14:25 but does it unmount the filesystems? the problem i had is the jail was stuck in dying state because the zfs filesystems were still mounted 21:14:50 as soon as i manually unmounted them, the jail would stop 21:14:56 if you are mounting them manually, unmount them in jail.stop 21:15:06 i was not mounting them manually, the jail did that from rc.d 21:15:42 I think we had very different scenarios 21:16:18 and right now it is way too late for me to start experimenting with this, maybe I will try tomorrow 21:16:30 loooking at /etc/rc.d/zfs, it seems like this is *meant* to work, there is specific support for unmounting filesystems in jail 21:17:26 well, i don't use jails anymore, but maybe i'll have another poke at it one day 21:18:16 I am guessing in my case it just called rc.d/zfs 21:34:48 Remilia: you can't set it before starting the jail. check this: https://bsd.to/1V2c 21:34:49 Title: dpaste/1V2c (Bash) 22:45:55 Yea, zfs jail and unjail needs to be done exec.poststart and exec.prestop respectively.