-
sommerfeld
megaTherion: defrouter is only effective on shared-IP zones, and allowed-address is only effective on exclusive-IP zones. Pick one!
-
sommerfeld
On an exclusive-IP zone, you set the route from inside the zone (route -p add so it persists across zone reboot)
-
megaTherion
sommerfeld: I see, thanks for the clarification
-
megaTherion
I think what I want to have is a kind of bridge-like configuration for an internal net
-
sommerfeld
there are many ways to plumb something like that up - which one makes sense depends on addressing plans & how much control you have over the local network.
-
sommerfeld
Simplest is probably vnics over your physical nic.
-
sommerfeld
vnics over an isolated etherstub or simnet if you want it completely internal.
-
megaTherion
I see, well I've basically one internal net 192.168.171.0/24 and the omnios box would be 192.168.171.7 and I need some net block for a couple of zones which could be anything like 10.0.10.0/24
-
sommerfeld
can sometimes be simpler to put the zones directly on the 192.168.171.0/24 net but that may not be what you want for other reasons.
-
megaTherion
sommerfeld: got it running, confused myself quite a bit on the way... but its basically easy
-
megaTherion
igc0:2: flags=1100843<UP,BROADCAST,RUNNING,MULTICAST,ROUTER,IPv4> mtu 1500 index 2 zone postgres inet 10.10.10.2 netmask ffffff00 broadcast 10.10.10.255
-
megaTherion
igc0:1: flags=1100843<UP,BROADCAST,RUNNING,MULTICAST,ROUTER,IPv4> mtu 1500 index 2 inet 10.10.10.1 netmask ffffff00 broadcast 10.10.10.255
-
megaTherion
and then just a NAT on 10.10.0.0/24 (but I was confused by ipf, Im a pf guy)
-
sjorge
doubling back to eu-mirrors, primary was in swiss I think. Been a while since I checked.
-
sjorge
Yep, AS559 is swiss
-
andyf
sommerfeld / megaTherion - the defrouter property alongside allowed-address should definitely work. I use it on all of my zones
-
andyf
-
megaTherion
andyf: I see, its getting a while to get into how things are handled - there are a couple of howtos on the net, but nothing really comprehensive.
-
megaTherion
as I know understand it ip-type exclusive gives you a seperate network stack for the zone, shared is the opposite and then you cant manipulate routes from within the zone as the routing table is the same as the host
-
megaTherion
someone knows how to correctly configure bridges?
-
megaTherion
whats also a bit strange is that if I add another lipkg branded zone, all packages are downloaded again - there is no caching?
-
tsoome_
see pkg property (flush-content-cache-on-success)
-
megaTherion
oh I see
-
megaTherion
tsoome_: it's true that if I want to keep data in lipkg branded zones seperate from BE changes that I need to manually create a 'data' dataset for each zone?
-
tsoome_
thats the separation usually means, yes:)
-
megaTherion
tsoome_: ok just wanted to clarify, is it basically the rule for all zones or are pkgsrc zones excluded from this?
-
tsoome_
its just like with physical host - you have space for your OS and you have space for your data. If you want to keep data separate from the os (in terms of storage device separation), then you need to add device for data.
-
tsoome_
in that sense, it really does not matter which type of zone or physical system it is.
-
megaTherion
well I try to understand how this works, basically BEs are snapshot for rpool/ROOT, but then why would rpool/zones/zone1/ROOT be affected?
-
megaTherion
ok for LX zones this is not the case, at least according to the documentation on omnios.org
-
megaTherion
"LX Zones, unlike ipkg or lipkg zones, do not have individual boot environments. If you update and create a new BE, any LX zones are not explicitly updated. "
-
megaTherion
seems that it's not a good idea to craete zone names with numbers in it, that breaks some things
-
warden
megaTherion: what things are breached? All my production zones names end with a couple of numbers, and I noticed no drawback so far...
-
megaTherion
warden: I've tried to create an lx branded zone like in the example on omnios.org, if it contains a number like for exmaple 'influxdb2' I get an error tha the route cannot be added
-
megaTherion
I can try again and check
-
warden
megaTherion: well, I'm not very experienced in OmniOS, but I'm pretty sure that zone's network stack is unrelated from its name! :)
-
megaTherion
probably, but I noticed that zadm always proposes zonename0 as physcial device ... maybe it was conflicting or so. But I'll check again if it happens
-
megaTherion
warden: you are right, it works - no clue what I did wrong
-
megaTherion
is there a reason that I cannot add a zoned dataset to an lx-branded zone?
-
megaTherion
I basically did it the same way as with another pkgsrc zone I have... but the dataset won't get mounted upon zone starting
-
m1ari
for a "bridged" interface the easiest is probably a vnic, This is a stuff I fed to zonecfg for a test lipkg zone.
gist.github.com/m1ari/da615a75ce803ab3b1e93567e35a2b8a
-
megaTherion
m1ari: ya figured that out, I couldnt get a bridge to run - Im using now vnics
-
m1ari
rge0 is the physical interface, test00_0 is the interface inside the zone
-
m1ari
I think part of the reason that pkg and lipkg zones have linked BEs is that part of the filesystem is shared between GZ and zone, so you need to keep packages in sync between the two. That doesn't apply in the same way for pkgsrc and lx zones.
-
megaTherion
I see, but I dont see the technical reason why a zoned dataset wouldn't apply to an lx zone too - or why it would be impossible to mount
-
m1ari
for help the man pages are often quite good (as I think they are in freebsd) sometimes the challenge is finding the right one (especially if some of the commands are new to you)
-
megaTherion
yeah thats true, manpages are great
-
megaTherion
Im coming from freebsd actually, trying to get a similar setup done
-
sommerfeld
mlari: the key thing is that Illumos doesn't have a stable system call ABI, so libc.so.1 has to match the kernel.
-
sommerfeld
linked images ensure that the zones have certain core userspace packages that match the global zone and kernel.
-
megaTherion
how does the bloody release cycle works? Is it a different publisher/mirror for ips?
-
jclulow
yes
-
jclulow
-
megaTherion
thanks
-
jclulow
FYI:
omniosorg/omnios-build #3770 seems like a relatively critical defect in r151046 LTS?
-
megaTherion
I seem to have pkg⊙0:20241017T212621Z
-
jclulow
megaTherion: Oh, that FYI was not aimed at you, just to the room in general, sorry
-
megaTherion
sure, I just thought I check what version I have :D
-
megaTherion
but isn't your verison older then?
-
jclulow
Yes, r151046 is an older release but with a long term maintenance plan (LTS)
-
megaTherion
ah I see
-
jclulow
-
megaTherion
what would I have to enable SLAAC (IPv6 autoconfiguration) in OmniOS?
-
jclulow
I believe you can just "ipadm create-addr -T addrconf igb0/v6" or whatever
-
megaTherion
I see, nice
-
neitzel
yes, but additionianlly add -p options.
-
megaTherion
for persistance?
-
megaTherion
ah prop
-
jclulow
neitzel: Which -p option are you thinking about?
-
jclulow
I believe the default mode is stateless
-
megaTherion
well I get a link-local... thats it
-
neitzel
for "policy". -p stateless=yes/no for RTADV on/off, -p statefull=yes/no for DHCPv6 on/off.
-
jclulow
megaTherion: Are you expecting route advertisements or DHCP?
-
megaTherion
the former
-
jclulow
Is your "ndp" service online
-
megaTherion
Im not using DHCPv6
-
megaTherion
jclulow: thanks, ndp was it
-
neitzel
I specify "-p stateless=yes -p statefull=no" in that case, and yes: I like to forget activating ndp, too :-)
-
megaTherion
it works :)
-
sommerfeld
neitzel: specifying more than one -p option to ipadm create-addr doesn't actually work (only one gets used)
-
sommerfeld
(I noticed this recently, don't think I've filed the bug yet..)
-
sommerfeld
in practice once you are aware of this limitation it doesn't prevent you from doing anything reasonable as there are only two options and they both default on and you never want to turn both of them off...
-
m1ari
It might be useful to have something in the docs about IPv6, I was playing with it a couple of days ago and found it took a bit of random googling to find the answers
-
m1ari
and it was a case of `ipadm create-addr` and starting the ndp service (seems like its disabled by default)
-
m1ari
Ultimately I wonder if it's something that should also be in the installer (I only started looking after realising it was off by default - I'd assumed I'd have IPv6 by default as that's been the case in most other OSes for many years)
-
sommerfeld
there are some missing pieces around nameserver autoconfiguration over v6.
-
sommerfeld
if you put a v6 address in resolv.conf, it works but neither DHCPv6 nor SLAAC will put an address there.
-
megaTherion
sommerfeld: is it expected that resolv.conf will be automatically changed?
-
sommerfeld
The DHCPv4 client will in some cases update the nameserver.
-
jclulow
I don't really understand why the ndp service is disabled by default, FWIW
-
megaTherion
ok right, with DHCP it might make more sense
-
jclulow
So that seems like probably an OS bug
-
megaTherion
jclulow: in FreeBSD IPv6 is still optional too.. you have to enable it with ifconfig
-
megaTherion
many people dont like IPv6
-
jclulow
That's fine, but if you do "ipadm create-addr -T addrconf" it really feels like it should at least get turned on as part of that operation
-
jclulow
like, if you've opted in to IPv6 it should work haha
-
megaTherion
true
-
megaTherion
one command should be enough :)