<Lofty>
I switched the routing data from BZ2 to LZMA
<Lofty>
BZ2:
<Lofty>
-rw-r--r-- 1 lofty lofty 83M Dec 17 20:06 gt300f-r.txt.bz2
<Lofty>
[lofty@ramen data]$ time bzcat gt300f-r.txt.bz2 > /dev/null
<Lofty>
real 0m21.522s
<Lofty>
LZMA:
<Lofty>
-rw-r--r-- 1 lofty lofty 24M Dec 27 16:36 gt300f-r.txt.xz
<Lofty>
[lofty@ramen data]$ time xzcat gt300f-r.txt.xz > /dev/null
<Lofty>
real 0m4.034s
<Lofty>
4x reduction in size, 5x reduction in decompression time
hansfbaier has joined #prjmistral
hansfbaier has quit [Ping timeout: 260 seconds]
hansfbaier has joined #prjmistral
hansfbaier has quit [Quit: WeeChat 2.8]
<sorear>
bz2 was amazing when it came out but there are better options now
frubbl has quit [Ping timeout: 264 seconds]
hansfbaier has joined #prjmistral
frubbl has joined #prjmistral
frubbl has quit [Ping timeout: 240 seconds]
frubbl has joined #prjmistral
<Sarayan>
Lofty: So you add lzma support to the c++ (it's in cv-rmux.cc, method rmux_load) and merge it?
<Lofty>
Yeah, I was patching that in and updating the gdata files last night
<Lofty>
liblzma has terrible error reporting
hansfbaier has quit [Read error: Connection reset by peer]
frubbl has quit [Ping timeout: 240 seconds]
frubbl has joined #prjmistral
<Sarayan>
the library currently has terrible error reporting too fwiw :-)
<Sarayan>
note that if the resulting files re small enough they're probably embeddable
<Sarayan>
joy, there are exactly 2 or 4 routing nodes per die that have more than one port associated
<Sarayan>
I'll special-case them because fuck it
<Lofty>
Sarayan: gt300f is like 25MiB
<Lofty>
With LZMA
<Sarayan>
from a 640M source that's nice
<Lofty>
But I'm still trying to get LZMA to fucking decompress things...
<Sarayan>
Not cooperating?
<Lofty>
Sarayan: not even slightly. First I had to set up a bloody filter chain because LZMA requires that for some reason, and now it's reporting the data is corrupt
<Lofty>
My suspicion is it might be trying to extract XZ as if it was raw LZMA
<Sarayan>
oh
<Lofty>
It's difficult to tell; all I'm getting is LZMA_DATA_ERROR