-
gitomat
[illumos-gate] 15220 isatty should return reasonable errnos -- Robert Mustacchi <rm⊙fo>
-
sensille
has anyone tried to raise MAXPATHLEN?
-
Reinhilde
well that was weird. dragon friend's VM just spinlocked for two hours. zero disk, zero network, 100% cpu. I couldn't make it panic because I had no kind of access.
-
Reinhilde
so I couldn't get a core dump.
-
Reinhilde
I wonder what I should look for in logs, starting around 8am UTC or maybe a bit before
-
Reinhilde
7am
-
Reinhilde
three hours, gosh.
-
sjorge
Interesting read rmustacc for IPD 38, although a lot of it goes way over my head.
-
sjorge
So I've been looking around the viona doe a bit, woud a /etc/system tunable just need to force
github.com/illumos/illumos-gate/blo…/uts/intel/io/viona/viona_tx.c#L100 to always return true to be effective?
-
sjorge
s/doe/code/
-
sjorge
-
sjorge
I'll try and figure out how to compile that when I am less sick.
-
jbk
sjorge: i think so (though testing is always better than guessing)...
-
jbk
the one thing that might be a concern from what I recall is it may prevent the VM front getting stuck
-
jbk
but it looked like we're somehow not triggering a notification on the read size (when the destination is a local non-VM zone)
-
jbk
like the one core had like several MB of data ready for the zone, the process was blocked in either poll() or port_get(), but data wasn't moving
-
jbk
if my recollection is correct, that may not address that aspect
-
jbk
(which might be fine for you uses, just pointing that bit out)
-
sjorge
building omnios now, not sure how to get it on my actual hw though
-
sjorge
and yeah it doesn't fix the issue of the local non-VM zone
-
sjorge
but it should prevent the bhyve hangs
-
sjorge
i think
-
sjorge
build gonna take a while though
-
sjorge
thats step 1 😅
-
sjorge
Well failing on that, given kvm doesn't seem to compile :/
-
sjorge
Not that I need kvm, but just following the omnios build instructions at this point
-
sjorge
Oh I'm dumb, I think I know where I went wrong, off for another few hour wait
-
jclulow
FWIW I hit this yesterday
-
jclulow
The reproduction is completely reliable: I was using rsync to try and copy a 2GB file from inside an OmniOS VM (bhyve, SmartOS host) to the host GZ
-
jclulow
As soon as it kicks up to line speed on outbound data transfer, the window expands to the point where it fills the 256 ring entries and then it corks
-
jclulow
I don't think it's a missed poll wakeup at all, I think the rsync on the GZ side stops reading data because it's trying to send acks/hashes back to the guest and it's basically a classic pipe deadlock situation
-
jclulow
If I made the vqsize vastly bigger I am sure it would happen less, or at least happen later, as sjorge has noted
-
jbk
that could be -- all i could see was the reading process stuck in one of those despite the conn_t showing multiple MB of data queued
-
jbk
from the dump at the time
-
jclulow
I'm pretty sure in this case the rsync is waiting to write before it gets around to reading again
-
jclulow
We're only going to send 256 * 1500 bytes in this configuration before we get corked
-
jclulow
which is _tiny_
-
sjorge
Yes, lowering vqsize from the default is a speedrun any% to get it for me
-
sjorge
Glad someone was able to reproduce it reliably aside from me now
-
papertigers
I'm surprised I haven't hit this myself. I have a wireguard bhyve VM and I have used to to talk to local native zones
-
sjorge
So... how much space is needed to build omnios? 50G is apparently not enoug has I wrecked the vm when it went out of disk space :/
-
richlowe
build... all of omnios?
-
richlowe
probably better for #omnios, but I'm also not sure why you'd do that.
-
sjorge
Well i just ran omni build_illumos
-
sjorge
so I would expect that to just be illumos-gate, well illumos-omnios I guess
-
richlowe
yeah, definitely an answer I don't know, but for building illumos "Not that much"
-
richlowe
rpool/builds/richlowe/illumos-git referenced 7.70G -
-
richlowe
(that has a bunch of extra crap in it, so less than that much)
-
sjorge
OK, gonna retry tomorrow and not run it in vmware fusion on my laptop
-
richlowe
you might ask hadfl or andyf just to find out what it's going to do
-
richlowe
maybe it'll build all the dependencies or something, but even that shouldn't be _that_ big
-
jclulow
sjorge: Maybe make sure you have compression enabled on the pool
-
danmcd
tsoome: i_dladm_flow_proplist_extract_one() alone is really bugging me for reasons that have nothing to do with your reasonable initialize-a-local fix.
-
sjorge
Oh compression was probably not on
-
sjorge
Gonna be smarter this time and set a quota on my build dataset so it doesn't cause havoc if it fills up
-
hadfl
`omni build_illumos` just builds illumos-omnios, so should take approximately as much resources as an illumos-gate build. nothing special there
-
richlowe
even without compression that workspace with tonnes of crap in it is 18G
-
richlowe
(sorry, I forgot about logicalreferenced)
-
richlowe
sjorge: not sure how 50 wouldn't be enough
-
sjorge
could have been some onu's around from before, i grabbed my old build vm
-
sjorge
anyway, nee vm not on my laprop is doing build_illumos now, next ul is figuring out how to get the viona sruff in a pkg archive
-
danmcd
15.1G ./build/illumos-gate
-
danmcd
(^ with du -Ash. v with du -sh)
-
danmcd
4.76G ./build/illumos-gate
-
danmcd
Eeesh compression IS helpful. ;)
-
danmcd
And sjorge if you're just changing viona you SHOULD be able to just replace the viona module as long as you've built in the same branch as whatever you're booting.
-
danmcd
(No need to build the world to just alter one module's function.)
-
richlowe
you want to make sure it _really_ matches your genunix, for CTF
-
richlowe
adding mysterious lies to what mdb tells you won't help :)
-
richlowe
or disable uniq when building the module, which I can't remember how to do
-
sjorge
So create a be, replace just the module and boot to it woth -t incase things inevetably explode ... i'll try that tomorrow if the build succeeds
-
danmcd
Do NOT forget to:
-
danmcd
bootadm update-archive -R /path/to/mounted/new-be
-
danmcd
In case you don't use `beadm activate` and instead pick it from loader (as I'm wont to do on experiments)..
-
gitomat
[illumos-gate] 15198 libdladm: variable is used uninitialized -- Toomas Soome <tsoome⊙mc>
-
tsoome_
danmcd I actually did spot it too, but forgot to file the issue for it... thanks!