-
gitomat
[illumos-gate] 16812 fsck_pcfs: need to support 4kn sector size -- Toomas Soome <tsoome⊙mc>
-
nomad
thanks to whoever fixed the problem that was keeping OmniOS from booting in XCP-ng.
-
richlowe
I'm not sure what that would be
-
richlowe
off the top of my head
-
jbk
XCPng was identifying itself as hyper-v
-
jbk
at least that's what I saw
-
jbk
although there is also a change related to it's emulated nvme support
-
nomad
it was the nvme support that was hosing me when I tried before.
-
nomad
I take it ipadm is not the right tool to tell me the negotiated speed on an interface. What command would you recommend for that?
-
nomad
(I'm trying to figure out why iperf3 says the network speed is pathetic.)
-
richlowe
dladm show-link
-
richlowe
oh, no, not that one either
-
richlowe
show-phys?
-
nomad
LINK MEDIA STATE SPEED DUPLEX DEVICE
-
nomad
e1000g0 Ethernet up 1000 full e1000g0
-
jbk
VM? or a physical e1000g interface?
-
nomad
VM
-
jbk
what hypervisor?
-
nomad
and what I'm seeing is a Linux (AlmaLinux 9) VM on the same hypervisor is getting multiple orders of magnitude better results.
-
nomad
XCP-ng
-
jbk
doesn't it support virtif?
-
nomad
jbk, the "NIC type" options are e1000 or RTL8139.
-
nomad
Is virtif something I need to set in OmniOS?
-
richlowe
I believe we have a para-virt 8139 driver
-
nomad
I just did a basic default install.
-
richlowe
tho I have no idea about any kind of recent xen
-
nomad
richlowe, I get the same (bad) speed with either NIC type.
-
richlowe
I just know that when we build i86hvm we build a separate PV 8139
-
richlowe
that's the extent of my xen knowledge, unfortunately.
-
richlowe
rmustacc: see, 8139, another cockroach nic.
-
richlowe
tulip, 8139, 3c509?
-
nomad
jbk, my google fu is failing me. I'm not finding any reference to 'virtif' in regard to XCP-ng or OmniOS. I'll keep digging, though.
-
richlowe
I think jbk meant vioif
-
richlowe
virtio network interfaces
-
nomad
that would explain why I'm not finding it :)
-
jbk
err yeah
-
jbk
it's been a very long past 2 weeks :)
-
nomad
It's still Monday here.
-
nomad
A very Mondayish Monday.
-
nomad
The whole reason I was looking at this was because I was getting divergent numbers between AlmaLinux 9 (at 9.40 Gbits/sec) and FBSD (at 1.40 Gbits/sec) so I thought I'd add another non-Linux into the mix to see if I saw similar results.
-
nomad
I didn't expect it to be 97.8 Mbits/sec though.
-
nomad
(All using exactly the same iperf3 command.)
-
nomad
(all VMs running on the same hypervisor)
-
neuroserve
nomad : all with the same network driver?
-
nomad
all with the e1000 device, yes.
-
richlowe
e1000g is one of the drivers I would have bet on not being slower than necessary
-
richlowe
given the sun systems it shipped in :\
-
nomad
I just installed this VM using a fresh download of OmniOS 151050. Everything was set to defaults.
-
nomad
(and yes, I did patch :)
-
nomad
but that doesn't mean this isn't a tuning problem.
-
nomad
Unlikely thing: there's no XEN management agent for this OS (that I can find, anyway) and that sets rate limits. I presume with no agent there are no rate limits, not all the rate limits.
-
richlowe
can someone confirm for me that the `findroot` test skips on x86 too? I think it's because `user=root` lacks the spaces, maybe?
-
nomad
richlowe, is this a test I can run for you? I'd need some context :)
-
richlowe
it's one of the tests in the util-test suite, but I'd hoped someone had run it recently and could just look :)
-
richlowe
it's going to be a couple hours before they all finish on (emulated) arm.
-
sommerfeld
richlowe: it has a dependency on idmap
-
sommerfeld
if [ $(svcs -H -o state svc:/system/idmap) != "online" ]; then
-
sommerfeld
echo "svc:/system/idmap not enabled and online; can't do SID-to-UID mapping" >&2
-
sommerfeld
exit 4
-
sommerfeld
fi
-
sommerfeld
the test is new with 16546
-
richlowe
sommerfeld: thanks, I'll check if that's what's happening
-
sommerfeld
for me, on x86, it will PASS if idmap is enabled, and SKIP if it's disabled.
-
richlowe
it was that, it now flipped to FAIL, I'll look into that separately and assume it's aarch64 related
-
richlowe
I can show you the log, if you think it might help, but it didn't help me. (...and the nature of running in an emulator like this makes it very very prone to races)
-
sommerfeld
I can take a look
-
sommerfeld
might point towards which thing isn't working.
-
richlowe
-
sommerfeld
ah, it mostly worked, except for -sidacl which is the most complicated variant.
-
sommerfeld
(it maps the sid to both a uid and a gid and looks for both in acl entries)
-
sommerfeld
what's really odd is the "/root" in the actual output of the second one. that points more towards something being off in the shell.
-
sommerfeld
it does everything in a temporary directory that should only have four entries (a b c d)
-
richlowe
that is surprising, I'll run it with -x and look at it assuming it's a bug here.
-
richlowe
what I especially don't understand is that I would imagine `find . ...` to always give output beginning ./
-
richlowe
sommerfeld: the `/root` is the text from `cd -`, the 2nd find invocation found nothing.
-
richlowe
sommerfeld: I updated the gist with ls -lV of the test directory, but it looks like something larger (and no doubt specific to arm) must be wrong, to me.
-
nomad
FTR: a colleague of mine did a similar test using OmniOS 151050 on an ESXi server that also should have 10G available and got: at 0.00-60.00 sec, 5.66 GBytes, 811 Mbits/sec
-
nomad
much better than mine, but still much slower than would be expected.
-
sommerfeld
richlowe: ah, d'oh.
-
sommerfeld
richlowe: something's definitely off with id mapping somewhere. I see "sidb" (4*-5*-6*) appearing on all four files when I'd expect it only on files b and d, with "sida" (1*-2*-3*) on a and c..
-
sommerfeld
idmap dump -v and ls -lnn may also be informative.
-
jbk
nomad: w/ e1000g or vmxnet3s?
-
nomad
jbk, he tested both. I'm working on a writeup now.
-
nomad
the 5.66 was with e1000
-
nomad
he got 28.5 Gbits/sec with vmxnet3s