ngortheone: sure, there's an argument to be made that there are degrees to reliability of protocols, but my gripe with email stems from the fact that on more than a handful of occations over the years when critical infrastructure has gone down, the notifications that were supposed to go out over email didn't.

debrup: sure. I was only poiting out that zabbix might also use email to alert, which weakens the case you were making for zabbix. What is your preferred alternative for sending alerts?

SMSes for everyone🎉

ngortheone: net-mgmt/alertmanager and www/rubygen-pagerduty generating notifications to my phone

If I still had a local SMS gateway, I might've used that.

ngortheone: pushover.net

Title: Pushover: Simple Notifications for Android, iPhone, iPad, and Desktop

Right, that's the alternative to paperduty.

I was trying to recall the name of it

don't like, 1 in 50 SMS messages just get lost, in the US?

I'm not in the US, though.

Email is more reliable than SMS, just on a general basis (i.e. no critical structure failures)

Also, SMS has delivery and read-notification support.

I hate phones, I want to go phone-free this year

it has read notification?

isn't that RCS rather than SMS?

RCS definitely is an improvement over SMS, for sure

You're right, there's only delivery notifications - but if I'd setup something with my own SMS gateway, I'd retry if delivery confirmation didn't happen within a very short amount of time. :P

I think what landed me on paperduty rather than pushover is that paperduty was in ports when I set it up.

pushover is just a curl call

Sure, and prometheus can do both pagerduty and pushover - but I needed something that could notify me in case prometheus decided to tip over.

a second prometheus

debdrup, pager duty?

debdrup, Nevermind; missed that you had later changed from "paPerduty"

someone knocks on the door with a card, on it written "httpd on thor is critical. [ ] ack [ ] snooze [ ] ignore"

<rtprio> a second prometheus

someone at work did this

two prometheus instances, one monitors everything and also the second prometheus instance; the second prometheus instance only monitors the first prometheus instance :P

so... I have a zpool. there's a disk I want to do some manual dinkery with, like using dd to write over a bad sector, hoping to clear the SMART Current_Pending_Sector...

can I get away with offlining that specific drive before doing this, or will exporting the zpool 'release' the drive so I can dd to it? or what?

I figure I'll need to resilver tit when I'm done.

there's 8 512 byte bad sectors (1 4K sector)

the drive is a 16TB WDC Gold, that came up with this single error

I'm hoping that if I can write 0s over the 'bad sectors', it will zero the Current_Pending_Sector

its a 512 logical 4096 physifcal sector drive, and the error is just the one 4096 physical sector, that shows up as 8 logical sectors.

so,, again, right now, I can't use dd or whatever to write on /dev/adao, but I can read from it. does if I offline the disk from the pool, will that be allowed? or do I have to export the whole pool?

You con put the disk in offline; then try writing over; do not know if ZFS would see that as the disk being online again. Also, so replace the disk while you tinker with th offending one

oh, if it matters, this is 13.1-RELEASE, in the form of TrueNAS

s/so replace/do replace/

# uname -a

FreeBSD hognas.hogranch.com 13.1-RELEASE-p2 FreeBSD 13.1-RELEASE-p2 n245412-484f039b1d0 TRUENAS amd64

parv yeah, thats my intent, to resilver this drive after 'fixing' it.

Better would be put the disk offline, remove it, & tinker on a different 'puter

now, this is an entirely different issue, but I've been resilvering 4 drives from a raidz vdev, swapping 8TB drives with 16tb....

What kind of RAIDZ is that -Z2?

first one took ~ 30 hours. 2nd one took 5+ days. 3rd one took 30ish hours. and this last 4th one is taking 5ish days.

*WTF?!?

its raidz cuz I only have 4 drives, its a HP Microserver N40L I deployed 10 years ago.

( Wow, -Z1 )

at my last $job (I retired almost 5 years ago), my preference was mirrors... lots and lots of mirros.

but with a 4 drive Microserver, thats not really an option, and this use case is basically archval bulk storage.

I do frequent scrubs

but, this last drive swap/resilver is saying its going to take 3 days 4+ hours more. and we're already a day+ into this resilver

Plan a picnic? Cook a turkey dinner?

hah.

i figure once this 4th disk resiover is finished, I'll export te whole pool and see if it lets me use dd to write directly on the 4K block thats erroring, then see if that clears the smart errors

if it doesn't, I'll triy using dd to zero the whole drive

[gawd, zeroing 16TB is going to take over a day at best]

or maybe I really should jsut RMA this disk to WDC

I bought it direct fromt hem

16TB drives for $250 each.. price on the gold drives has gone way up

( was going to mention that; started a "dd if=/dev/zero" on a 4|6 TB disk from a old ZFS pool, but after ~10 minutes, gave up; clearing first 10 MB was enough for the purpose)

yeah, first few is fine for just making the drive 'clean', but that won't clear a SMART Current_Pending_Sector

Frankly I would go with RMA option

sigh, i hate having to deal with that but yeah, youre' probably right

a 'good' drive should NOT have bad sectors on the first use

even if its only 1 4k physical bad sector that mapps to 8 512 logicals.

Please buy 1 or 2 extra disks to have on hand, when next disk would go bad

my CFO (wife) probably would not allow that.

this 21-er-42TB NAS is mostly a media server for her brit TV

but I also use it for backups and stuff, its been running rock solid reliable for 10 years now.

which yes, I know, means I'm on borrowed time

Ok. Seems that downtown of days is tolerable

Damnit s/downtown/downtime/

Why do you prefer WD Gold over Red Pro NAS ones?

um, they were on sale for $250 direct from WDC a couple weeks ago

and the golds are suposedly enterprise RAID grade, as opposed to 'red' home NAS grade

thats $250 for 16TB drives.

seemed like a really good deal

and direct from WD< not some reseller or grey market crap

my long term experience is, the less drives get handled, the more reliable they will be.

I used to get 20 drive cases direct from a major drive maker adn those drives were WAY more reliable than the brand had a reputation for.

All the WD Reds are not of the same color. Sure, avoid plain "Red" for NAS for using SMR tech. "Red Plus" & "Red Pro" use CMR. Do you know what is used for Gold ones?

Title: Western Digital to Settle SMR HDD False Advertising Class Action Lawsuit | Tom's Hardware

i've just configured a wireguard client on my 13.1 installation using the "experimental" kernel module. so far it works great. is there any timeline for merging into FreeBSD? the last commits to donenfeld's repo are from september, all i could find on the web is that an inclusion in 13.1 was planned

yeah, but I really hope these 16TB Golds, which are helium, aren't SMR

I knew aobut that whole red SMR shit, and wow, that was just stupid.

How does ZFS fare on SMR?

After all the COW does probably trigger a lot of rewrites too

very poorly, SMR tends to shit a brick during any sort of vdev rebuild

marketing around SMR has been borderline criminal

But I mean without zraid?

raidz, sorry... I'm thinking of migrating my ext4 nas to zfs (based on freebsd) now

I don't use raidz on it but instead snapraid on a separate machine

IMHO, SMR drive swould e just fine as a mag tape replacement device.

sequentially written, read randomly

That's how I back up now! I tar to a bunch of old drives in multi-drive format

but i like the spooling sounds of my lto3 :D

:-]

I cannot hear tape moving around over the noise of damn noisy fans going on always all the time (at work)

last tape drive I had at home was a DDS, I think it was 4gb DDS. I had LTO3 stuff at $job.

I've got an old sas-based lto3 and a fibre-channel based lto4 in my, eh, "homelab"

I do remember when 4GB was plenty of backup, HAH HAH HAH

[my home NAS is 42TB now]

i actually use them for backups, but just the family fotos and keepass files. not the whole NAS

my photos are backed up in the cloud

Work is using LTO-7 currently, ~6TB uncompressed; plans to move to larger capacity ones in near future

yes, if I lsoe the originals, I will only have the cloud versions, which aren't the full editable sources, but I havent' messed with lightroom in some years

so i don't care

i never figured out why i can't keep the lto drives at full speed when running the backups. according to the specs, the drive lto3 drive should max out at 80mb/s. the disks can definitely deliver that. but the drive spins up and down from time to time, i'm assuming it's a buffer thing

anyways, if I 'offline' a zfs drive, dd should be able to write to it? thats what I came here to ask

i tried plugging mbuffer in there, fine-tuning star parameters and whatnot

yet the drive always pauses and spins back up every 30 seconds or something

i heard it's bad for tape life, so i want to avoid it but never could

peerce, Yeah, remember to export the pool before tinkering

Wait! I thought peerce had changed to do RMA ... oh well

My home nas is > 100TB and tapes are probably just not feasible anymore

I use old drives now (to back up the most important 30% of it)

the latest lto9 has a raw capacity of 18TB per tape, but it's very expensive. tape only makes sense if you buy it used on the cheap or if you're a big enterprise with enough data to fill so many tapes that the lower per-tb price of the indivudal tapes offset the high system price

Yeah exactly, this is why I use my old drives as tapes

The LTO drives are so expensive

And also too noisy for a home environment IMO

The drawback is that my backup pool is always too small as I always replace my drives with bigger ones

wildeboskat, Quite obvious that you ought to stop buying larger capacity disks ;-J

But then I don't need to replace any :)

Well, yeah

Like other I always need to upgrade my backuo sysème. I need to change 3TB disks of my NAS with may be 8TB, to be sure to run my jail and store my backup.

*system

there a safe way to lower the ARC for ZFS? Running into an issue where the machine is running out of RAM a lot and going into swap space

dedup is off, but compression is on.. only get 1.04x from that so might turn compression back off

Grabunhold: I find LTO-6 a good middle ground because you can buy decent LTO-5 tape for cheap and format it to 6 without any issues

2.5 TB uncompressed is pretty good

Remilia: well, my lto4 is okay for the most important of data like the family fotos and stuff. of course i'd like more, but even the used tape drives are still pretty expensive...

true

and you need SAS :\

LTO tapes.. wow I haven't used those in about 17 years

people still use tapes to back up files these days? o_O

considering it is the best option for long term storage, yes

pertho: do you have any better suggestions when it comes to density/price/longevity?

I remember once putting a LTO tape in a demagnetizer.. and the demagnetizer couldn't even get through to scramble the tape.. checked the tape afterwards and all the data was still there. I think you'd need some powerful electromagnet to kill an LTO tape :D

well, i got the tape drive for free at work because they wanted to toss it. came with a bunch of tapes, too. so why not dump the family fotos, keepassxc database and stuff on there every month. makes a decent backup and i can even easily carry the tapes to the office for "off-site" backup

Remilia: sorry, no better suggestions aside from perhaps having both onsite and offsite backups if possible

I want an internal LTO drive but the price is staggering

you can never have too many backups

i've got an internal fibre-channel LTO drive. had to take a dremel to my case because apparently double-height 5.25" drives aren't a thing in consumer computercases. and the cheap fibre channel controller from ebay has no internal connectors, so i'm re-routing the fiber back into the case via a missing PCI bracket :D

pertho, You could adjust vfs.zfs.{arc.max,arc_free_target} MIBs; Allan J metions *.arc_free_target MIB in youtu.be/L_kBM_RHa6g?t=1533

Title: ELI5: ZFS Caching (2019) - YouTube

Set "*arc_free_traget" to keep that amount free. Note that size is specified as number of pages ; "hw.pagesize" tells you current byte/page

thanks!

mason, I came across your post wiki.freebsd.org/MasonLoringBliss/JailsEpair (I'm assuming that is you) - I replaced lines 5 and 6 in the jail.conf example with the dhclient line and it's working nicely

Title: MasonLoringBliss/JailsEpair - FreeBSD Wiki

pertho: not sure if you got answer but her goes... from iwm(4) man page: Currently, iwm only supports 802.11b and 802.11g modes. It will not as sociate to access points that are configured to operate only in 802.11n or 802.11ac modes.

ahh thought as much, thanks

bsd.to has an invalid certificate

is freetype compiled with png support in FreeBSD?

freetype2

pertho: Appears to be.

I think rinfo is a default pkg alias?

pkg rinfo -f -r FreeBSD freetype2

er no it's not.

/usr/ports/print/freetype2/Makefile has "OPTIONS_DEFAULT= BROTLI LCD_RENDERING LONG_PCF_NAMES PNG V40"

On my default pkg: PNG : on

hmm

Shared Libs required: libpng16.so.16

pkg search -S "name" -e -f -r FreeBSD freetype2 I have "rinfo = search -S "name" -e" in pkg.conf

I don;t see rinfo as a pkg option?

pertho: Yeah, I forgot it's a custom alias.

The second command is the same.

If you're dealing with mutliple repos then you can drop the -r FreeBSD part or change it to the repo of youre primary install.

hmm ok I see same thing: Shared Libs required: libpng16.so.16

vkarlsen, re bsd.to, maybe best to email koobs.

trying to resolve an issue with emojis from noto color emojis not showing properly in an app (they also don't show up in "gucharmap" either)

Good day everyone

I have a peculiar problem on FreeBSD 13.1 that is very strange: when i use frr + full route import, not only does zebra use 280% cpu, bgpd 100% cpu, but it seems to also cause other processes such as charon, ntpd and dnsmasq also to consume 100% cpu

I have raised kern.ipc.maxsockbuf to 16777216, but aside from that the rest of the system is rather stock from opnsense

V_PauAmma_V: Ok, done

I was wondering if anyone has a hint on what might be wrong? I checked the usual search terms for perforrmance tuning, but did not spot anything useful so far

skered: Thanks, that's a neat alias. I put it in my own pkg.conf o/

telmich: out of curiocity, what CPU state is it in?

cation: Yeah, there are a couple things I changed to accomodate bugs that seem to have gone away. I want to go through to remove this, marking older mitigations and options. Thank you for the feedback!

s/this/these/

sure, and thanks a lot for writing it :) helped me a lot

cation: One thing I want to explore is actually not having any logical (just physical) network config in the jail config, and having the system itself do that work. I believe it was meena that noted that interface names can be set to something predictable, so that ought to do the trick.

If I test this out and have success I'll note it alongside the existing methods.

oh, that would be neat

debdrup: You mean he cpu state of zebra?

debdrup: `15792 root 9 103 0 1400M 615M CPU11 11 339.2H 277.97% zebra`

And for bgpd: 29426 root 4 103 0 68G 50G CPU9 9 121.5H 100.19% bgpd

anyone in here been using Fly.IO platform? and with that flyctl?

i tried fly.io

telmich: I'm honestly not sure

looks like Fly.io is the backend for supabase deployment. very cool

rtprio: have you used flyctl in freebsd or what tools did you use to deploy to the platform?

xD grub-bhyve segfaults for me when trying to boot a CentOS image. A great start to the day lololol

Are there any plans to make /bin/sh as the default root shell in 13.x?

That'd break POLA.

Alright

That was my understanding too. But could change in some future 13 version, for the better despite POLA AFAIAC

parv: you're gonna have to use more words to explain that sentence, because it doesn't make an y sense.

debdrup, "But could change in some future 13 version, for the better despite POLA AFAIAC", rephrased: If some future 13.x version would make "/bin/sh" as the default root shell in spite of POLA, I would welcome that for I do prefer "/bin/sh". AFAIAC "/bin/t?csh" could disappear for ever

parv: the proposal to change roots shell doesn't include an MFC notice, and it's even explicitly mentioned in UPDATING - so why would you assume it changes in any minor version of 13?

debdrup, I did not assume. I am wishing

Also, your shell preference has absolutely nothing to do with what should be in the base system, and the proposal - if memory serves - explicitly confirms that the change was _not_ supposed to be about removing (t)csh.

It's been a long time since I've seen a user be this arrogant, and I'd appreciate it if you take it _ANYWHERE_ else.

Yeah, I know /bin/t?csh would not be going anywhere. Aagin, wishing

What does it matter to you that tcsh is in base, if you don't use it?

All the documentation is Bourne-compatible, there are (as far as I know) no scripts that depend on the C shell in the base system, and there's a significant number of committers who do use (t)csh.

I like tcsh, though I believe we are not too many liking it lol

I'm fairly sure there's more than people seem to assume.

Am I correct, that FreeBSD kernel moves swapped out memory back to RAM on demand?

mrtnt: I think you're confusing terms a bit; things that can be swapped out of memory include clean pages, clean anonymous pages (dirty anonymous pages are cleaned during the process of writing them), sysv ipc, as well as filesystem data such as files and metadata.

If something is swapped to disk and it's referenced, then yes it will be brought back into memory - that's kinda the point of paging. ;)

It's a fair bit more complicated because all of that doesn't account for the unified buffer cache that FreeBSD has, the active, inactive and laundry queues of the pagedaemon, and it also doesn't take into account ZFS' ARC.

And then there's stuff that, like ZFS ARC, is wired and therefore will never be swapped.

debdrup: ok. So even if something is swapped out to a swap partition or swap file and there is a need to access this swapped out data, then it will always be brought back to RAM.

mrtnt: yes, although since you mention swap file, I think it's important to mention that swap files generally speaking aren't recommended.

debdrup: ok, understood. Thanks!

re: swap, what's recommended for small RAM VPS installs (eg: 1GB RAM)?

ISTR seeing "2x RAM if < 4GB RAM"

That's a good rule of thumb, yes. And > 4GB, swap should equal the amount of memory.

spork_css_: it depends on the ram size. if there's 32GB ram i make 4 swap partitions of 4gb each. Then if stuff starts swapping and stays swapped, one can swapoff that partition then swapon to force whats swapped out back into ram. This approach makes less sense much after 32GB ram

if it's all just one big swap partition then you can't do that unless the amount in swap is less than the amount of free ram

^^ that should read 4 swap partitions of 8gb each

f451: that's a lot of swap