out of interest, has been anyone able to run Solaris 11.4 (CBE) in bhyve? I get the boot stuck in module loading.

With disabling ohci / ehci / uhci I could get it a bit further but then it gets stuck around iwscn

Only if I could send the debugger a break to see more... (tried on SmartOS latest, what does OmniOS bhyve?)

`zadm nmi <zone>` ?

I run Solaris CBE under bhyve

oh that is ... I WANT THAT TOO :)

Have you tried booting without any network devices, just as a test?

but my hypervisor is smartos only

There was definitely a problem with e1000g, and maybe vioif too

not yet, I can deconfigure net in the smartos zone config.

do you happen to have an example (anonymized) bhyve command line for me? maybe I can see some diff to what smartos does.

for networking I ended up building the illumos vioif driver and I use that in the solaris guest (until I find time to investigate what is going on with the native solaris vioif driver)

thank you very much! I'll dig into it during the day.

I have these bhyve command line on SmartOS. DO you think there is something off on there that might be worth trying to changeß paste.ec/paste/zDOyQoQg#Tnw-plP4ZSIMybC8J8R5m5V3mNiweOwMDg3DacEjIdz

s/off/odd/

You should be able to use a virtio disk with CBE, in case that helps

as far as I remember, the latest version has those drivers

but otherwise I don't see anything in those options

Maybe I should throw an ssd into the box and install OmniOS and see if I can replicate your S11.4 bhyve setup.

on smartos you should be able to inject an NMI with 'bhyvectl' to see where it's stuck

that will give some pointers, anyway

I don't know if that's wired back to the smartos VM tools

oh good idea, I'll do that first.

at least in vmadm console I wasn't able to break into the kernel debugger.

hm. at the moment no luck with breaking into the kernel debugger (VM powers off too fast while in previous runs it just stayed hung)

I don't know much about the smartos framework unfortunately. It's still using command line parameters and I think it has an older bootrom too.

tomww: try vmadm sysrq <uuid> nmi

ah that might only be hooked up for kvm

tomww - I can set up a fresh VM on omnios and see what happens. I'll try it later on this afternoon.

oh that would be wonderful. I can work with S11.4 in KVM for the current ansible projekte, but in th elong term I would

prefer a bhyve VM for s11.4 (SFE project). If your attempt in a clean env works, I might try the different bootrom eventually?

oh the right people entering the channel :)

well well well, one can't have a vnic in a hbyve zone on smartos. why is this.

You should be able to

It won't actually be able to transmit/receive unless you add its MAC address to the secondary-macs property on the bhyve zone's VNIC in the global zone, but nothing should prevent you creating it

hm well

the guest is omnios:

root@omnios:~# dladm create-vnic -l vioif0 huhu0

dladm: vnic creation over vioif0 failed: operation not supported

is my command wrong?

Well then, it looks like they are missing a commit from gate that allowed that

I did another try, on the smartos global zone:

[root@KVM03 /]# dladm create-vnic -l e1000g0 huhu0

dladm: VLAN over 'e1000g0' may not use default_tag ID (see dladm(8))

[root@KVM03 /]# dladm create-vnic -l igb0 huhu0

[root@KVM03 /]#

illumos 13695 (fenix)

BUG 13695: Can't create VNICs over vioif after 13637 (Closed)

↳ illumos.org/issues/13695 | code.illumos.org/c/illumos-gate/+/1402

Perhaps SmartOS does not have this fix?

could be. I'll verify if my bhyve VM uses the hardware e1000 or igb0 ... maybe this changes someting?

okay. I totally forgot I have an aggregation running too. so this works: dladm create-vnic -l aggr1 huhu1 (global smartos zone)

I'll try to find out if BUG 1369 is merged into smartos

13695

for the moment I don't need it. I was playing around with ansible to create a zone in omnios (guest on smartos) and it failed to create a virtual interface for the zone.

it's in smartos

according to git branch --contains

I have joyent_20221117T002317Z

sinc release-20210408

should it be possible to run this bhyve VM with e1000 nic? I have model e1000 but still shows in the guest as virtio nic

probably best to ask stuff like that in #illumos