I built illumos-gate on OpenIndiana, then used the onu tool to boot into the new BE it creates. Afterwards, I booted back into the host BE. After booting back into it, the build tools appear to be gone -- running gcc, git, etc, returns :command not found. Is this intended?

booting back into the new BE?

have you checked your path?

The path looks like what it should look like, and the active BE is the right one that should be active

Yes, I booted into it, then activated the prior BE, and rebooted back into that prior BE

Which BE were you in when you installed the tools?

Whoops, I missed something when trying to activate the original BE. I ended up booting into the wrong BE

Thanks!

We’ll time ilke that is made not had

When it comes to summer of code we won’t have the choice of existing students except in Berlin where Rolf teaches but we could prep for other times already

morning

[illumos-gate] 17010 tar creates corrupt archives for large files with ACLs -- Joshua M. Clulow <josh⊙so>

Tangential to tsoome's post I found unitedbsd.com/d/1283-configuring-fail2ban-on-illumos helpful to get Fail2ban running on SmartOS. Included anyone hunting for git in the jail and ban them for a month.

.oO

Has anyone built Hadoop on illumos before?

[illumos-gate] 17247 Manual typos in section headings -- Peter Tribble <peter.tribble⊙gc>

twobitsahead I would suspect so, but can not confirm;)

twobitsahead: built in a sense of a platform or as in a software piece?

I and at least one of my teammates (intern at that time) did something of the former, somewhen in 2020

gemelen I'm interested in building it in the sense of running a small cluster on illumos

The nearest things I've found are some Solaris build manuals which seem to be out of date

When trying to build it, the build fails on protobuf not having sunos support. Figured I had best ask around before reinventing the wheel

we have protoc in openindiana which distro are you using?

omnios has one as well, though ISTR an issue with the location of some of the files (and/or maybe the pkg-config data)...

at least when I tried to build influxdb_iox (new rust based influx)

(one of many issues unfortunately)

toasterson I'm using OpenIndiana. I installed pkg:/library/c++/protobuf⊙230, but the build is still failing. Here's what the build is doing pastebin.com/ztNWGTyv

Looks like the Java wrapper for that fail. it gives you the maven command to install that from a file.

Looks like you can play a bit with the pom.xml to get that dependency working stackoverflow.com/questions/6762558…-missing-1-com-google-protobufproto

But thats Javaland. No clue about that unfortunately

Thanks. I'm getting out of my comfort zone on this one, but it's a part of a larger project and hardly an option to forego Hadoop. Is that missing file (com.google.protobuf:protoc:exe:sunos-x86_64:3.25.5) included in pkg:/library/c++/protobuf⊙23?

no, that would be part of the java dependency tree. Isn't haddop purely Java? Of so simply compiling the jar on linux then copying th jar to illumos should work.

toasterson Looks good so far, thanks a bunch

heh, compile once run anywhere :)

ah, like wasm

hadoop itself is a jvm framework, but it needs a bunch of native tools, like protoc for example

twobitsahead: feel free to ping me on that matter. I don't do data eng now, but I ate a lot of this stuff in the past

That missing file rings a bell - oxidecomputer/helios-omnios-extra #25/files#diff-c27f5cc5eeaf31345241b5a039fcf07a62d2a950364a17e696695c9b307709fb

Anyone know if there is a restriction within a zone to only run 1 Virtual machine? Trying to start 2 bhyve processes within a zone at the same time errorrs with vm_created: Invalid Argument

Yes, only one instance is allowed per non-global zone - github.com/illumos/illumos-gate/blo…el/io/vmm/vmm_sol_dev.c#L2078-L2088

A somewhat arbitrary limit, though

At some point, I'd like to see us get resource controls setup for vmm instances

Banged my head on that trying to get parallel image builds going lol

Thought I was giving it a bad arg for a good solid 30 minutes

Is there any reason this couldn't be set in say zonecfg? Would be cool to keep from burning a machine for builds or having many zones. Would you get some odd resource util if 4 ran at once?

Smithx10: It ought to be managed like any other resource control

Just work that has to be done

Like, a "zone.max-vmms" or whatever, a la resource_controls(7)

and possibly a matching global property in zonecfg(8)

I think pmooney is right that you'd also want vm-level controls too

a limit on the number of vCPUs might be useful there

like if you're permitted 8 in a zone, you could do 1x8/2x4 etc

Yeah

We could also: (a) require you to use the reservoir, (b) cap the amount of memory you can take out of it