-
aftergluhwine
dogg0, that has nothing to do with your shell or term, I can reproduce exactly this behaviour by pressing ': <alt>-a' in vi (not sure why I press this, but sometimes happens). You can simply exit this state with ':q'
-
aftergluhwine
this doesn't happing in vim though; must be another key combo there
-
aftergluhwine
<ctrl>-w, s actually splits the screen in vim, vi probably has similar functionality. Anyhow, ':q' solves your 'problem' dogg0
-
Macer
so i'm trying to work out getting my nvidia P400 into a jail and i'm working on seeing if it works at all on the host and got this...
his.macer.life/@macer/115785009424595380
-
Macer
fatal trap
-
ant-x
vkarlsen, Stuck in the middle with you -- got it.
-
nimaje
Macer: you already tried to use it directly and it works like that? I have no idea what a jail should make diffrent there so that it leads to a trap in kernel
-
Macer
nimaje: i didn't even get to the jail part yet. i was just seeing if nvidia-smi worked on the host
-
Macer
i'm not sure how important it is to do nowadays but i vaguely remember having to put it in persistent mode to get it working with plex or jellyfin. but maybe i'm wrong. i just finished getting jellyfin running in a jail so i'll have to test it out
-
nimaje
ok, yeah no idea about nvidia, you writing jail in that message made it seem like it was jail-specific and I wanted to confirm that
-
Liaf
I'm currently testing FreeBSD 15.0 and I tried the auto-installer with ZFS. According to the handbook I should use twice the sice of RAM for swap. So since my vm has 4G RAM I expect swap to be 8G but the installer suggested 2G. Is that just the installer default or did something change here?
-
nimaje
that is the installer default, but well, you don't need as much swap anymore, for kernel crash dumps it would be good to have the same amount of swap as ram, but else you need less and less swap as you increase ram, not sure where the 1:1 ram:swap suggestion lays, I think it was with 1G ram and with 16G I think the suggestion was 2:1, but not sure about those numbers
-
Liaf
Okay, I guess for my 8G machine I will just use 8G of swap then.
-
Remilia
Liaf: if you plan to use poudriere (you probably don't) and you have less than 64 GB RAM with 8+ cores, you might want 32 GB of swap space just in case
-
Liaf
Remilia: I won't use it. I currently just test 15.0 a bit on my local hypervisor to get a feeling for what I want when I migrate my mail and nextcloud server :-D
-
polarian
I was thinking today about freebsd supply chain attacks, if I remember correctly the port mirrors are not signed but anything...
-
Liaf
My two largest struggles at the moment are a) switching from UFS to ZFS which I haven't used since 12.x I think and b) if I want geli encryption on a remote server or if the hassle isn't worth it :-D
-
polarian
would be cool if we could embed signify into pkg and the releases
-
Liaf
polarian: isn't there a checksum on the ports git? I thought that gets verified but I never checked
-
polarian
Liaf: a checksum isn't the same as cryptographic verification, and I dont know anything about this
-
ant-x
GNU Privacy Guard supports cryptographic signatures, but it has the wrong license...
-
Liaf
polarian: what do you mean by cryptographic verification?
-
ant-x
Liaf, IMHO, is the processess whereby the author signs a file with his public key, so that the receiver can verify its authentity.
-
BarnabasDK
ant-x: you sign it with your private key. the reciever can then verify the signature using your public key
-
BarnabasDK
or decrypt if needed
-
BarnabasDK
of cause you then need the recievers public key to encrypt
-
Liaf
ant-x: ah, got it.
-
ant-x
BarnabasDK, yes, but there's also clearsigning, where the paylod is not encrypted, if I am not in error.
-
BarnabasDK
ant-x: yes.
-
» ant-x nods.
-
BarnabasDK
the reciever still needs your public key to verify
-
ant-x
Yes, I never said he did not. Bu this is /exactly/ the same as with checksums: you need the checksum to verify.
-
nimaje
Liaf: I don't know any published checksums of the ports tree, the individual ports contain checksums for most stuff that gets downloaded, to ensure that it is exactly what was expected, but that doesn't mean the sources the ports maintainer write into the port are what was released by the upstream maintainer and that also that doesn't mean anything for the resulting pkg, but the resulting pkg repo
-
nimaje
should be signed by the builder (see signature_type in the repo config, but not sure what guaranties the default of fingerprints gives)
-
BarnabasDK
well a checksum has not got anything to do with authentication, just verification of the file contents imho
-
BarnabasDK
which may be all you need
-
Liaf
nimaje: yea, I was thinking the threat model was that someone takes over a mirror. Then the checksum would be enough to verify that it differs from the original file. If we talk about someone compromising the whole "update" of a port then yes, the checksum is not enough.
-
Macer
hm. i managed to get the nvidia driver installed but it doesn't seem to want to work for a jail
-
Liaf
On my test system I've added a user and set the home directory to be encrypted with ZFS. I set a passphrase and rebooted the system. However, the system decrypts the home directory during boot but I cannot find where it stores the key. Any idea where to look?
-
nimaje
hm, the pam module responsible for unlocking is named pam_zfs_key, but it seems like it is missing documentation, iiuc it uses the password of your user in some way for unlocking
-
nxjoseph
latest firefox-esr-140.6.0_1,2, youtube can play anything but live streams
-
linXea
I have to say that v15.0 is really nice. Also first interaction with packages instead of distribution sets.
-
Liaf
I didn't try the packages yet but I guess I'll reinstall it later anyway :-)
-
Macer
hm
-
Macer
./nv-freebsd.h:17:2: error: This driver does not support FreeBSD-CURRENT!
-
Macer
and i'm running RELEASE
-
Macer
kind of odd
-
Macer
blah. i'm at a loss here. i really don't know where to even look
-
cndghm
Hello everyone, I would like to talk about (kinda ask for advices) setting FreeBSD. I have been running freebsd 15 stable, no problem with the system. Everything works fine, I wonder, how do you guys manage to upgrade systems... Let me explain, I'm thinking to switch to freebsd current, but I would need to save my gpg keys and all config files. Do you guys keep one system with a stable release and another
-
cndghm
one to run test (like current, or openBSD, netBSD, etc...)?
-
nimaje
you know that current and stable are development branches? But you should be able to just upgrade without losing what you have saved on the system as long as there is no bug that deletes random user data. So you should keep backups anyway, as bugs happen
-
cndghm
I didn't know that both are dev branches. I will do some research about how to upgrade. I'm still learning more about FreeBSD
-
cndghm
But yeah, I will do backups before trying to update
-
rtprio
if you're a new user, i don't know why you would want to use current
-
ivy
if you use zfs, you can use bectl(8) to make a copy of the current system before upgrading
-
nimaje
"stable" in the freebsd version means the ABI (and KBI I think) stays stable and is the branch to develop the next minor release, stuff from current can get merged in there as long as it doesn't change ABI
-
Macer
ok. i'm at a loss with this :/
-
Macer
i guess maybe native fbsd nvidia driver doesn't come with cuda?
-
rtprio
I don't know but I wouldn't count on it
-
Macer
and the actual nvidia one thinks i'm running CURRENT heh
-
Macer
sigh
-
Macer
otherwise jellyfin seems to run great
-
rtprio
hrm, my jellyfin does fine with software
-
rtprio
are you doing much transcoding for your media?
-
ivy
if it's for jellyfin, don't you only need NVENC, not CUDA?
-
cndghm
rtprio: I'm trying to learn to contribute to FreeBSD, so using current seemed to me like a good option.
-
cndghm
nimaje: What ABI and KBI stands for ?
-
rtprio
uh
-
cndghm
Never mind, just googled it. Silly question
-
Macer
ivy: not sure heh
-
Macer
either way i can't get ffmpeg to use it on the host either
-
Macer
guess i'll have to do it the ugly way and use a VM and pass the gpu through
-
Macer
that kind of sucks. i sure wish i could sort out how to get this nvidia P400 working in a jail properly
-
Macer
crap. i really should have used beadm for this
-
Macer
i totally forgot to snapshot the boot env so now i'm sure i have proprietary nvidia module stuff everywhere and that didn't work anyways
-
Macer
think i'll just go ahead and start over and start with the gpu
-
afterglow
Sounds like my way of working, Macer, I always think of taking snapshots after tthe harm has been done
-
Macer
yeah
-
Macer
because now i'd have to hunt down wherever it pu tthem
-
Macer
let me look at the install script and hunt it all down manually
-
rtprio
Macer: can the host not keep up without acceleration?
-
Macer
rtprio: probably.. but why do that when i can use the lower powered P400
-
Macer
it's a ryzen 3700x so i'm not sure where that would top out at
-
Macer
i had nvidia-smi working .. .other than it causing a reboot when trying to put it in persistent mode
-
Macer
but i couldn't get it working on the host with ffmpeg or in a jail with either ffmpeg or jellyfin
-
Macer
so i tried the proprietary drivers and those didn't even work with nvidia-smi
-
rtprio
my jellyfin is a vm on a E5620 and it does fine for less than 4k
-
Macer
ok.. i managed to get it back to the state it was in prior to using the stuff FROM nvidia
-
afterglow
pfew
-
Macer
although i think i'm at the point where i'm about to just pass it through to a vm
-
Macer
this seems impossible. i can't really find much information on how to do it either
-
afterglow
you're a pioneer, our Columbus
-
ivy
Macer: at some point this was just broken, not sure if/when it was fixed, you might want to search bugzilla
-
Macer
ivy: what was?
-
ivy
Macer: nvidia passthrough
-
Macer
oh. for bhyve?
-
ivy
yes
-
Macer
well.. it seems broken altogether for me right now :)
-
Macer
like i don't understand how you're supposed to get it working
-
Macer
i almost feel like tossing my arc in it but the arc probably has worse support than the nvidia
-
rtprio
what is arc
-
dkeav
intel discrete gpu
-
rtprio
i've thought about slapping a gpu in my r710 bhyve host
-
Macer
[hevc_nvenc @ 0x32774cc1b500] Cannot load libcuda.so.1
-
rtprio
but without gpu passthru what's the point
-
Macer
blah
-
Macer
yeah heh.. using proxmox all you have to do is ckick and add render128 to a container and it "just works" (tm) ... the arc at least
-
Macer
*click
-
Macer
this is more of a personal project to see if i can find parity between proxmox and freebsd ... i sort of figured i'd have a huge hangup with this part
-
rtprio
i don't need/want the clicky proxmox; just need to wait until some patches land for bhvye
-
rtprio
saw a usb passthru is in the phrabicrator
-
Macer
i sort of expected it to work in a jail fairly easily .. but i can't even get the transcoding working properly on the host .. let alone a jail
-
Macer
i guess the nvidia stuff is only meant for using a desktop maybe and just isn't built for this stuff for fbsd?
-
rtprio
it should still transcode, without the video card
-
Macer
oh. sure. i can do it on the cpu.. but.... :/
-
Macer
that just isn't efficient nowadays
-
Macer
and i mean... my P400 absolutely crushes the cpu transcoding .. and that thing is ancient.. my arc absolutely crushes the P400 :)
-
Macer
those intel arc cards are something special
-
Macer
(for this use case)
-
ivy
i mean, the P400 is almost 10 years old :-) but yes, Intel does provide quite decent encoding hardware, i think those even have AV1 support
-
Macer
they do
-
Macer
my ryzen 3700x that i'm doing this on is rather old too.
-
ivy
i thought about putting one in here, but i already have 2 x8 cards (nic, hba) so i'd have to file off one of the x4 slots to fit the gpu in
-
Macer
i actually replaced it with a 1u supermicro that has an arc in it for proxmox just for this
-
Macer
yeah i had the same problem. i was going to use an arc in an ancient 1u i had but it doesn't have pcie notches
-
Macer
notches should be standard :/
-
ivy
they probably omit them deliberately for market segmentation
-
Macer
yeah but the 1u is a server board lol
-
Macer
it's kind of rare to see the notches though. i guess maybe some boards have them.. like back in the day i'm sure there were plenty of boards with 8 pcie x1 slots with notches
-
Macer
i think then people were actually cabling them into cages or something. blame matt damon.
-
nimaje
why do you want to transcode those videos? isn't the result of that mostly quality loss?
-
ivy
nimaje: imagine you have a library of high quality (4K) HEVC/AV1/whatever movies, and you want to play them on some old streaming stick that only does AVC, or only can decode 1080p, so you have to transcode it
-
ivy
yes, it reduces quality, but it's not really noticable for casual viewing
-
ivy
most people prefer to transcode on the fly rather than keep 2+ encodes of everything around permanently
-
ivy
also tonemapping HDR movies for SDR playback, although i'm not sure if hardware encoding actually helps with that...
-
Liaf
I am still confused about my encrypted test home dir.
-
Liaf
I have checked that zroot/home/test is encrypted with a passphrase and the keylocation is "prompt".
-
Liaf
I found that in /etc/rc.d/zfskeys somehow the keys are loaded but somehow the system manages to decrypt the dataset without me entering a passphrase.
-
nimaje
iiuc the password is the same as for your user and pam_zfs_key suplies it when you login for the first time (but currently misses unmounting the dataset when you log out of all your sessions, so it will remain readable until reboot)
-
Liaf
I mean it's readable after reboot as well. I rebooted the system. Logged in as root via console and accessed the home dir.
-
Liaf
No password or passphrase of user 'test' required
-
Liaf
I mean it's pretty convenient but I would like to understand what happens :-D
-
nimaje
ah, wait, did you add that user with encrypted home in the installer or manually after the fact? What I wrote should apply to the first case, but I only read a bit about it, I didn't play around with it yet; if you do it manually you can many things
-
nimaje
rc.d/zfskeys should only apply if you have zfskeys_datasets in rc.conf (and maybe zfskeys_enable)
-
Liaf
I added the user with the adduser command afterwards
-
Liaf
I also checked and zfskeys is disabled so that wasn't doing the trick anyway
-
Liaf
The key is also unavailable the whole time.
-
mzar
Liaf: maybe it's not encrypted ?
-
Liaf
zroot/home/test encryption aes-256-gcm -
-
Liaf
It should be but I just saw that if I execute mount the dataset does not show up. Only zroot/home shows uop
-
mzar
OK
-
mzar
so you have to decrypt it on login
-
mzar
do you have the password aka key set ?
-
Liaf
A passphrase, yes
-
mzar
does it match user password ?
-
Liaf
No
-
Liaf
But I think adduser created the directory and uses it though there is an unmounted dataset
-
mzar
if it doesn't match user's password, you will not be able to unlock it with pam module
-
mzar
can you load the key ?
-
mzar
zfs load-key -a
-
Liaf
I can
-
Liaf
And I just figured it out
-
Liaf
It's like I said. adduser creates the directory and afterwards it creates the dataset
-
mzar
do you want to unlock it by hand from root's account ?
-
mzar
OK
-
Liaf
So after reboot there's an empty "home" that is accessible but the real "home" is unmounted
-
Liaf
I deleted /home/test loaded the key and zfs mount zroot/home/test
-
Liaf
Now it's not only there but all the .files are also in the directory.
-
mzar
do you want to poke it with each reboot ?
-
Liaf
Well I would like for it to be encrypted and get decrypted at login (gonna test this now with a new testuser and passphrase == passowrd as you mentioned).
-
Liaf
I'm just happy I figured out that I had "two" directories and one wasn't the dataset
-
mzar
Liaf: when dataset name will match username and dataset password will match userpassword, and user needs password for logging in, you can use pam module for automation
-
mzar
but if for example your user logs in via ssh it will not work
-
mzar
but you can still add extra, encrypted dataset for this user and use pam module
-
Liaf
Okay, for now I am very happy I figured out what I did wrong :-D
-
Liaf
Now the next step is to figure out if I want full disc encrpytion with geli and if I want ZFS encrypted home on a remote server. Both I have to decrypt everytime first :-D
-
Macer
-
Macer
boom.. ffmpeg works.. now to sort out how to get jellyfin to use it lol
-
Macer
i wonder if i can just use an alias for it somehow.. is there a way to make global aliases?
-
cyric
Macer: just create a wrapper?
-
Macer
cyric: hm
-
Macer
is that something that can be done in jail.conf?
-
Macer
i just need the jail to use nv-sglrun ffmpeg instead of just ffmpeg
-
Macer
unfortunately jellyfin for fbsd doesn't let you change this
-
Macer
i wonder if the linux ver does
-
Macer
guess not. it only has the path
-
trillerd
experience*
-
Macer
is there some universal way to force ffmpeg to run as 'nv-sglrun ffmpeg' in freebsd?
-
Macer
this seems pretty hard coded in jellyfin
-
Macer
so using gpu passthrough to bhyve doesn't work. using an ubuntu jail isn't too practical because you don't get vnet... and i can't sort out how to force ffmpeg to use nv-sglrun. so looks like i hit a brick wall with hw accel for jellyfin. i'll leave it alone for the rest of the day.
-
nimaje
what about the wrapper script suggestion? and what problem did you have with a vnet jail?
-
Macer
nimaje: i don't think linux jails support vnet.. only alias. at least bastille doesn't do it
-
Macer
nimaje: as for a wrapper script. i wouldn't know where to start there .. mostly because even if i did make the script how would i get jellyfin to use it when it seems to only want to use the ffmpeg bin heh
-
Macer
i tried making a basic script and moving ffmpeg to ffmpeg.bin .. that didn't work. i think jellyfin is actually hard coded to check for a ffmpeg bin.. but their matrix bridge is down now because of the earlier tomfoolery
-
Macer
-
nimaje
I don't see why linux jails wouldn't support vnet, but maybe the linux userland doesn't have the tools to configure interfaces on freebsd, then you would need to configure it from the host, most commands have a -j <jail id> option for that
-
LXGHTNXNG
Is lang/erlang broken with ODBC enabled?
-
nimaje
why do you ask? at least it is not marked as such
-
rtprio
Macer: yeah, afik jellyfin uses it's own bundled ffmpeg
-
rtprio
Macer: could you relocate that ffmpeg.bin to a shell script that calls "nv-sglrun ffmpeg.h0h0 $@"
-
wipt
This may be a bit dense, but I'm using "cp -a" and getting a bunch of chflag errors saying that the operation isn't supported. I'm trying to copy from a local pool to a NFS mount. All files are 755 and chown'ed to my current user. I've also set the same permissions on the mount point on both ends.
-
nprice
wipt: my first guess would be that files on your local system have some sort of ACLs enabled that the NFS mount isn't configured to support and so cp fails to set the mode on them
-
nprice
wipt: I might try rsync instead of cp because I believe you can have it do things like drop ACLs when you copy files
-
wipt
nprice: shouldn't be any ACLs set. Pretty simple set up for a family server.
-
nprice
wipt: what happens if you try cp -R instead of cp -a?
-
nprice
wipt: also maybe the NFS service doesn't have the rights to set the permissions on the target files
-
wipt
nprice: -R is clean, it's the -p flag that's doing it. I don't think I have this issue within the same pool.
-
wipt
maybe the uid is different across the systems -_-
-
nprice
wipt: that'd probably do it
-
nprice
wipt: have you tried to chown/chmod things over the NFS mount
-
wipt
same uid...
-
rtprio
which files?
-
dkeav
same group id and groups exist on both?
-
wipt
gid is different across systems, 1001 vs 0, both should have the user in the wheel group.
-
dkeav
right, but cp -a is the same as cp -RpP and -p is trying to preserve the group id which doesn't match
-
dkeav
its trying to preserve a lot of things, but thats the one that has bit me in the ass before, so maybe a place to look at
-
wipt
dkeav: but the cp man page says that if the uid "and" gid can not be persevered, no error is printed. Is that an inclusive "and"?
-
nprice
see if you can chgrp a file over nfs to 0 (or 1001)
-
dkeav
wipt: i think that may refer to copying within the same filesystem, not to NFS
-
Macer
It looks like Jellyfin for FreeBSD just uses the ffmpeg in pkg / ports
-
Macer
rtprio: I tried that.
-
Macer
It still didn’t work. I tried moving ffmpeg to ffmpeg.bin and making a script called ffmpeg to “trick” jellyfin but it didn’t work.
-
Macer
Does $@ accept everything after as input? Maybe that’s where I went wrong.
-
ant-x
$@ does not accept anything. It expands into the arguments, so that "$@" is reusable in invocations.
-
ant-x
This may be the way subcommands such as "pkg install" may be implemented in shell: analyse the first argument, shift, use "$@" for the handler.
-
Macer
ant-x: ah that's what i meant.
-
Macer
essentially takes all the --settings for ffmpeg
-
Macer
rtprio: thank you so much. that did it
-
ant-x
If you passed them.
-
Macer
let me double check that it's using the card
-
ant-x
Macer, you can always debug your scrits, e.g. with echo commands to STDOUT or a log file.
-
Macer
oh wait. no it didn't heh.. i disabled nvenc in jellyfin. let me try again
-
Macer
| 0 N/A N/A 42485 C ffmpeg.bin 54MiB |
-
Macer
SWEET thanks!
-
Macer
probably going to be problematic when ffmpeg gets updated in pkg heh
-
ant-x
Macer, observe that $PATH is search left-to-right. Put your overrides on the left.
-
nprice
Macer: you can do `chattr schg` to it to prevent pkg from clobbering it lol
-
Macer
lol
-
nprice
pkg will be unhappy but ffmpeg won't
-
Macer
nprice: it's a simple script. i just didn't know there was a $@ option
-
Macer
nprice: yeah :/
-
Macer
it's a terrible way to do it
-
Macer
the only other option would be if there was a different dep with a differnet pkg for jellyfin on fbsd
-
Macer
that does this for you
-
Macer
#!/bin/sh
-
Macer
nv-sglrun ffmpeg.bin "$@"
-
Macer
just a 2liner heh
-
rtprio
yeah
-
rtprio
Macer: so does that work?
-
rtprio
ill be damned
-
rtprio
yo're welcome
-
lockna_
Hello! I just changed my email address on bugzilla and it said I should get a confirmation mail where I can verify the new email address but I haven't received on yet. In the account information tab the new address is displayed as pending. Do I have to wait longer (waiting currently about 10mins) or is this process not automated?
-
Macer
yeah. i tried that but didn't realize i needed a $@ lol
-
Macer
one more thing down i guess. but that's going to be an issue unless i find a better way to do it lol.. i might have to script pkg upgrades
-
Macer
something that moves ffmpeg back and forth
-
dkeav
you're using an external script to call ffmpeg right?
-
Macer
yes
-
Macer
but it has to be called ffmpeg
-
dkeav
why does it need to be in the /usr/local/bin path, just put it in a non conflicting path and adjust your script to its new discrete path
-
dkeav
pkg can update ffmpeg all it wants, your binary is safe over there and the script is still calling it
-
Macer
hm. i can try that out
-
Macer
i'm not sure how jellyfin searches for ffmpeg but hopefully it's from PATH
-
Macer
for now i'm going to work on adding libraries to it now that it's working. i still have to move onto the apache2 jail
-
ant-x
FreeBSD people are moving from jail to jail.