avsm changed the topic of #mirage to: mirage 2 released! party on!
rgrinberg has quit [Remote host closed the connection]
rgrinberg has joined #mirage
rgrinberg has quit [Remote host closed the connection]
rgrinberg has joined #mirage
rgrinberg has quit [Remote host closed the connection]
brson has quit [Ping timeout: 250 seconds]
caw has quit [Read error: Connection reset by peer]
justincormack has quit [Ping timeout: 252 seconds]
caw has joined #mirage
justincormack has joined #mirage
brson has joined #mirage
noddy has quit [Ping timeout: 245 seconds]
brson has quit [Ping timeout: 265 seconds]
brson has joined #mirage
brson has quit [Ping timeout: 244 seconds]
brson has joined #mirage
jermar has joined #mirage
noddy has joined #mirage
noddy has quit [Ping timeout: 245 seconds]
andreas231 has quit [Quit: Leaving.]
brson has quit [Ping timeout: 265 seconds]
copy` has quit [Quit: Connection closed for inactivity]
jermar has quit [Ping timeout: 260 seconds]
andreas23 has joined #mirage
andreas23 has quit [Client Quit]
andreas23 has joined #mirage
noddy has joined #mirage
andreas23 has quit [Ping timeout: 245 seconds]
andreas23 has joined #mirage
andreas23 has quit [Ping timeout: 245 seconds]
milog has joined #mirage
andreas23 has joined #mirage
andreas23 has quit [Ping timeout: 256 seconds]
andreas23 has joined #mirage
mort___ has joined #mirage
andreas23 has quit [Ping timeout: 245 seconds]
andreas23 has joined #mirage
andreas23 has quit [Ping timeout: 245 seconds]
andreas23 has joined #mirage
mort___ has quit [Quit: Leaving.]
andreas23 has quit [Ping timeout: 256 seconds]
andreas23 has joined #mirage
jermar has joined #mirage
andreas23 has quit [Read error: Connection timed out]
andreas23 has joined #mirage
AltGr has joined #mirage
andreas23 has quit [Ping timeout: 245 seconds]
AltGr has left #mirage [#mirage]
AltGr has joined #mirage
andreas23 has joined #mirage
andreas23 has quit [Ping timeout: 256 seconds]
andreas23 has joined #mirage
andreas23 has quit [Ping timeout: 256 seconds]
andreas23 has joined #mirage
mort___ has joined #mirage
andreas23 has quit [Ping timeout: 245 seconds]
mort___ has quit [Quit: Leaving.]
mort___ has joined #mirage
mort___ has quit [Quit: Leaving.]
jermar has quit [Quit: Leaving]
rgrinberg has joined #mirage
mort___ has joined #mirage
jermar has joined #mirage
copy` has joined #mirage
yomimono has joined #mirage
agarwal1975 has joined #mirage
noddy has quit [Ping timeout: 260 seconds]
noddy has joined #mirage
mattg has quit [Ping timeout: 258 seconds]
mattg has joined #mirage
noddy has quit [Ping timeout: 250 seconds]
noddy has joined #mirage
rgrinberg has quit [Ping timeout: 250 seconds]
rgrinberg has joined #mirage
jermar has quit [Ping timeout: 256 seconds]
mort___ has quit [Quit: Leaving.]
brson has joined #mirage
brson has quit [Client Quit]
brson has joined #mirage
noddy has quit [Ping timeout: 250 seconds]
noddy has joined #mirage
AltGr has left #mirage [#mirage]
ebagdasa has quit [*.net *.split]
betheynyx has quit [*.net *.split]
rektide has quit [*.net *.split]
dobson has quit [*.net *.split]
ptrf has quit [*.net *.split]
sigjuice has quit [*.net *.split]
rektide_ has joined #mirage
sigjuice has joined #mirage
ptrf has joined #mirage
ebagdasa has joined #mirage
dobson has joined #mirage
betheynyx has joined #mirage
yomimono has quit [Ping timeout: 260 seconds]
miragebot has joined #mirage
<miragebot>
mirage/master 6cf2267 Hannes Mehnert: make automatically defines $(LD)! For solo5 use ld provided by backend...
miragebot has left #mirage [#mirage]
<miragebot>
mirage/master f35c2af Hannes Mehnert: Merge pull request #623 from hannesm/minor...
<miragebot>
mirage/master 5fdb9e7 Hannes Mehnert: reword missing ocaml-crunch slightly so that it points to the missing ocaml package
<miragebot>
[mirage] hannesm pushed 3 new commits to master: https://git.io/vPD66
<hannes>
mato: thx! :D
noddy has quit [Ping timeout: 245 seconds]
<mato>
hannes: you're welcome. now if we can just figure out the packet loss on virtio/bhyve that would be awesome. ricarkol has been posting more findings on slack, i'm a bit distracted today...
<hannes>
I'm in morroco
<mato>
enjoy! never been there, hope to make it someday
<hannes>
could you summarise the findings?
<mato>
Quick update about the solo5 on bhyve issue: still can't figure it out. These are the few leads I have:
<mato>
- not sleeping at all in solo5_poll "fixes" the problem for ~1/2 of the runs.
<mato>
- when pinging at any interfal smaller than`-i 0.001` we get ~1/10 of the interrupts. But it shouldn't make any difference as every time we go to sleep we check for pending packets. However, it does make a difference as we fail to see packets fast enough because we spend time sleeping.
<mato>
Some stuff I want to test next:
<mato>
- what happens with a Linux VM, does it behave as expected when pinged?
<mato>
- check if interrupts are being coalesced somewhere, although it should not really make any difference to us
<mato>
(...)
<mato>
I'm asking because turning them ["Received ping reply" messages] off here reduces loss from 79% to 2% (still a problem though).
<mato>
hannes: My feeling is we're doing something wrong on the "check for pending packets || go to sleep" path, but I can't quite put my finger on what it might be.
<hannes>
mato: if switching off console output improves the situation... maybe we should not output to console ;)
<mato>
also, there's some interaction between the scheduler and us missing packets... HZ = AFAIK 100 on FreeBSD which corresponds to the smallest internal which is not lossy (10ms)
<hannes>
ah, thx for looking that up. I had the suspicion that 10ms would be the smallest unit of time in FreeBSD
<mato>
oh.. actually that's not the case
<hannes>
ups :(
<mato>
$ sysctl kern.hz
<mato>
kern.hz: 1000
<mato>
though it's still plausible that scheduler interaction is triggering the loss
<mato>
but none of this really explains why we're missing interrupts/packets
<hannes>
mato: off-topic, based on some discussion in some issue on GitHub, I started implementing syslog for MirageOS + authentication. OpenBSDs syslogd does TLS+auth for example! :)
<hannes>
maybe something like disable interrupts during console output?
<mato>
well, console output causes a VMEXIT (in fact 1 per character) into bhyve (and the usermode bhyve process), so it'll effectively yield the cpu. however, the whole point of virtio is that it's a queue, so we should get the notification the moment we're rescheduled.
<mato>
gotta go, (way past) dinner time. cyl.
<hannes>
cy
copy` has quit [Quit: Connection closed for inactivity]
noddy has joined #mirage
jermar has joined #mirage
andreas23 has joined #mirage
andreas231 has joined #mirage
yomimono has joined #mirage
andreas23 has quit [Ping timeout: 256 seconds]
yomimono has quit [Ping timeout: 256 seconds]
mort___ has joined #mirage
mattg has quit [Ping timeout: 250 seconds]
mattg has joined #mirage
noddy has quit [Ping timeout: 252 seconds]
copy` has joined #mirage
<demonimin>
Gyah. There's a perfectly good btree implementation on GitHub, but the author hasn't licensed it and is unresponsive
<demonimin>
Even a no would be better than nothing, at least I could move on
noddy has joined #mirage
rgrinberg has quit [Remote host closed the connection]
<demonimin>
looking into hitchhiker trees, but that's a lot of yak shaving
lobo has quit [Ping timeout: 256 seconds]
lobo has joined #mirage
agarwal1975 has quit [Quit: agarwal1975]
rgrinberg has joined #mirage
seangrove has joined #mirage
seangrove has quit [Remote host closed the connection]
mort___ has quit [Quit: Leaving.]
jermar has quit [Ping timeout: 244 seconds]
<hannes>
demonimin: pretend there is none... :)
<demonimin>
now that I think about it, hitchhiker trees are much better anyway. for append-only data it's great. But it'll be a lot of work.
<hannes>
"a lot" means weeks? months? years?
<demonimin>
a few k lines for basic functionality? a month maybe?
<hannes>
hmm, but is for sure worth it... I've seen several people who wanted to have btrees to marshal irmin to block devices, and nobody yet finished writing sth...
rgrinberg has quit [Remote host closed the connection]
rgrinberg has joined #mirage
rgrinberg has quit [Remote host closed the connection]