-
rtprio
MelMalik: uh, it might be possible to put a bootloader on a different disk, but just make a backup and reinstall
-
MelMalik
the problem is no longer live; i put the bootloader on the same disk as the pool and all became well
-
rtprio
great
-
dch
veg: just unmount the "top" filesystem in the hierarchy, zfs will do the rest
-
dch
my general suggestion is to do all fs mounting outside the jail, in exec.created and exec.release steps in jail.conf
-
dch
Demosthenex: you could consider a zfs dataset and force `sync: disabled` `atime:off` which will allow zfs to bundle even async writes into transaction groups, *by lying about fsync to the applications*
-
dch
its a signficant change from data loss aspect if you lose power / crash the server
-
dch
Demosthenex an alternative is to use a ZIL which passes the small sync writes directly to a dedicated SSD, which can then be bundled up later into async writes to the main zpool
-
dch
-
dch
Demosthenex: so a dedicated ZIL is the "correct" option, and sync:disabled is the cheap/risky option
-
Demosthenex
dch: sync:disabled sounds similar to what i'm doing today
-
dch
Demosthenex: the only other thing I can think of, is to have a longer txn time, but IIRC that would impact the whole server
-
dch
s/txn/txg/
-
Demosthenex
yeah, i'd prefer it only impact the one filesystem
-
Demosthenex
sounds like sync disabled just ignores the app calling sync, turning sync io into async io. not sure that'd cache more to ram
-
Demosthenex
if zfs is trying to dump to disk frequently. i'm only trying to do it once every 15 min
-
Demosthenex
and i need to coordinate it so i get a good snapshot. i can lose 15 min, but i need a consistent snapshot
-
dch
Demosthenex: you mentioned that your workload trashes SSDs, this is typically related to write amplification (wrong logical sector size as seen by FS, vs physical size on device)
-
dch
and/or many many small allocations, which is what sync (or a ZIL) helps more with
-
dch
but if you need more stuff cached, then either add RAM, or add a nvme read cache device (L2ARC)
-
dch
zfs will write to disk at least every 5s by default, this is the transaction group (txg)
-
dch
but delaying that out to 15 *minutes* seems extremely counterproductive
-
mzar
plaese let me report that I have now fully working laptop without INET (legacy IP) support
-
mzar
the wireless connection is working fine
-
mzar
this laptop is immune to all legacy IP attacks
-
mvanbaak
only INET6? funny
-
Demosthenex
dch: so to be fair, it's just minecraft. ;] but it's a known write spammer. i don't know the specific IO characteristics, but i've lost ssds that way in the past. i tend to host the game in a ramdisk, then i use a cron job to rsync down to disk for a consistent copy
-
Demosthenex
the idea of delaying writes and such is the opposite of my professional experience where every write counts, data cannot be lost, databases write with fsync mandatory, etc :P
-
mzar
mvanbaak: we will disable INET at some point, the same way IPX got disabled in the past
-
dch
mzar: \o/ how do you get to e.g. github?
-
dch
do you have some nat64 or something similar on a gateway?
-
Demosthenex
the current game is now over 20GB ramdisk, and so i'm looking at alternatives. that's why i was thinking a COW buffer. but maybe zfs sync=disabled, and a longer txg delay may work
-
dch
btw I get ~ 200Mb/s on the new if_iwx driver now, which is awesome
-
mzar
nice
-
dch
Demosthenex: there's a zfs histogram thing somewhere, shows you size of writes
-
» dch rummages around in history
-
dch
-
dch
aah bonus, its not even zfs specific, so you can see what sort of i/o pattern is used from minecraft (change the process name from firefox ofc)
-
erk
dch: Is there a way you can limit that to local files? If I understand correctly network read/write will also show up there.
-
nimaje
hm, the vfs layer should have probes for write to, that should only be writes to filesystems then, but no idea how it is named
-
dch
erk: my dtrace skills are pretty limited, but this would be a nice addition. I don't yet know how we'd filter on that, syscall:: is the wrong layer, we'd need vfs or similar
-
nimaje
maybe fbt::VOP_WRITE_AP: ?
-
nimaje
oh, and you can inspect fds[arg0].fi_fs in the syscall probe maybe, not sure how portable that is
brendangregg.com/DTrace/DTrace_Chapter_5_File_Systems.pdf
-
mtll
I really need to sit down and learn dtrace one of these days. not knowing it is holding me back
-
Demosthenex
dch: unfortunately iostat and other tools don't work on tmpfs
-
mzar
dch: I have nat64 to connect to github
-
mzar
will iwm(4) get 802.11ac support ?
-
nimaje
mzar: with clat?
-
mzar
nimaje: yes
-
dch
mzar: I would assume all the new stuff goes into if_iwx(4) and if_iwlwifi(4)
-
dch
but check the manpage for the latter at least, it reports which devices are supported and it goes quite a way back already
-
dch
iwx manpage is still wip I think
-
mzar
dch: thans for the clue, I had to switch from iwm to iwlwifi
-
Demosthenex
dch: that gist, what's a .d? what's making your graph?
-
polarian
hmm is there a IRC channel for pf/networking for freebsd, my messages just get lost to the backlog :/
-
nimaje
Demosthenex: a dtrace script as you can see from the shbang and dtrace has many nice features like quantize()
-
Demosthenex
nimaje: sorry must have missed the shebang. awesome
-
Demosthenex
polarian: you can check the channel list, but that's the nature of irc. people who care scroll back a reasonable amount and read ;]
-
polarian
or you keep bumping your messages and annoy the absolute fuck out of people
-
polarian
I could use the ML but asking stupid firewalling questions on there will be cemented into history
-
polarian
anyone with a search engine can read your fuck ups :p
-
polarian
I guess thats not the worse thing, unless you make a complete show of yourself
-
polarian
issue is claws-mail is broken since the Q2 port snapshot, so I was going to try alpine like I have wanted to for ages, but I cant seem to set the user-id for the email and therefore cant use ML right now :/
-
polarian
-
tykling
polarian: there is #pf on this network
-
polarian
tykling: that is mainly focused at openbsd no?
-
polarian
oo 8 people!
-
tykling
it doesn't say :) I use it on freebsd
-
tykling
how many people do you need to answer a question
-
[tj]
polarian: you could also ask in discord
-
polarian
tykling: 1 other, provided they aren't a zombie account :P
-
polarian
I was surprised there was even 8 people in the channel
-
polarian
[tj]: I rather not fix the problem than install Discord :P
-
[tj]
it is nice that some people have a choice about the tools they get to use
-
tykling
polarian: so... you want free support, you want to dictate the medium where it happens, and 8 people is not enough for you to even try to ask your question. Do you think maybe your expectations need some adjustment here?
-
polarian
tykling: If that medium involves compromising security, freedom and privacy then yes, I rather not solve the problem :)
-
polarian
and I was going to ask my question in #pf it takes a bit to type and I was on a different workspace not using my IRC client, do I need to instantly post to #pf? please do not make assumptions that I do not deem 8 people good enough
-
tykling
alright, well good luck with it
-
MelMalik
I have cursed ideas in my skull
-
farhan
Question! I am ssh'ing to do Dev on a device that is frequently rebooting (kernel crashes)
-
farhan
I'm wondering if there is an alternative to vs code that has similar functionality that I could use/
-
farhan
by "similar functionality", I just mean text editing and a terminal.
-
MelMalik
why are you trying to dev on a crashy machine?
-
farhan
I'm doing kernel work for FreeBSD.
-
dstolfa
farhan: do work locally and rsync it over
-
dstolfa
rsync -zvah local-dir user@remote:/path/to/dir
-
dstolfa
omit the -v if you don't want verbose
-
zi
farhan: ssh+vi? vs code can be quite belligerent
-
farhan
I currently am doing that but vim breaks upon every reboot
-
SponiX
vim problems?
-
SponiX
if your system is crashing while just editing text, it is likely time to start inspecting hardware
-
farhan
so to be clear, its crashing due to my kernel driver that I'm working on.
-
farhan
No vim problems, I just dislike having to re-open my terminal and vim location every time.
-
farhan
Would be nice to just hit "reconnect" and its in the same location.
-
dstolfa
your options are either using something like vscode and installing the vscode remote under a linuxulator since ms doesn't ship one for freebsd, or using an editor on your local machine and then rsyncing/sshfs/whatever
-
dstolfa
otherwise you'll just have to deal with the fact that the box running your editor is in fact crashing
-
thedaemon
I use the anvil editor and it has ssh interface built in so it just connect when you load or save something, works for me.
-
SponiX
farhan: I have a FreeBSD vm setting idle right now that you could make use of. If that would actually help any
-
farhan
Idle setting? I do not follow?
-
thedaemon
sitting idle, not doing anything
-
SponiX
"sitting" yeah -- sorry
-
farhan
Meaning, I do not understand how that would be of assistance.
-
SponiX
It may not
-
SponiX
I just thought it might :P