I did some investigation on Solaris 11.4 guest deadman cyclic panic on Omnios Bhyve. In the moment of panic the deadman_counter on the next CPU is 301sec back. All CPU threads are idle. It seems the root cause is, that the Solaris guest uses: APIC_TIMER_MODE_ONESHOT 0x0 /* One-Shot */. I guess this is not the default, instead is set because the CPU do not report the TSC feature as available (cpi_std[1].cp_ecx = 0xfede7a17) & 0x1000

00. It is possible to change/choose an other CPU type in Bhyve on Omnios? Illumos guest uses apic_timer_preferred_mode = 2 (TSC) anyway.

carba: i'm working on something for modifying cpuid features, but no idea if this will help you in any way with this problem

to help with live migration between nodes?

Btw: Illumos deadman does not compare the deadman_counter of next/other CPU with the own counter.

otis: that's the long term goal

Woodstock: fingers crossed.

Does Bhyve have counters for steal-time or scheduling delays of vcpus?

[illumos-gate] 18278 rpc: pointers need more deadbeef -- Toomas Soome <tsoome⊙mc>

is there a way to turn off the auto-unload of unused kernel modules on debug builds?

(or at least mark specific modules to not unload)

though I suppose I might be able to just have _fini() return 1 for testing

(so I don't have to race w/ te dtrace before the symbols disappear :P)

/* Don't auto unload modules on if moddebug flag is set */

moddebug & MODDEBUG_NOAUL_DRV

tsoome knows everything, maybe he is an AI bot? :)

most certainly do not know everything.

I was once searching same thing.... ;)

the trick is often knowing where to look :)

moddebug is full of goodies

the 1 bit is great too

jbk: something else good in an emergency, with an eminently forgettable name: `mtc_off` (and `mdi_mtc_off`)

multi-threaded config?

mtc - "multi threaded config", it's what fans out module load etc.

ahh

thankfully this is just for working on the ice driver

it doesn't panic, but when something's not working, it's often too quick to unload

so just need to have it be sticky so it's easier to dtrace