cfbolz changed the topic of #pypy to: PyPy, the flexible snake (IRC logs: https://botbot.me/freenode/pypy/ ) | use cffi for calling C | the secret reason for us trying to get PyPy users: to test the JIT well enough that we're somewhat confident about it
lritter_ has joined #pypy
lritter has quit [Ping timeout: 264 seconds]
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
asmeurer_ has quit [Quit: asmeurer_]
asmeurer_ has joined #pypy
jcea has quit [Remote host closed the connection]
marself has quit [Ping timeout: 276 seconds]
exarkun has quit [Read error: Connection reset by peer]
exarkun has joined #pypy
marky1991 has quit [Read error: Connection reset by peer]
asmeurer_ has quit [Quit: asmeurer_]
asmeurer_ has joined #pypy
oberstet2 has joined #pypy
oberstet has quit [Ping timeout: 248 seconds]
Hasimir has quit [Read error: Connection reset by peer]
Hasimir has joined #pypy
carljm has joined #pypy
lritter_ has quit [Ping timeout: 248 seconds]
Garen has quit [Read error: Connection reset by peer]
Garen has joined #pypy
tonyseek has joined #pypy
energizer has quit [Ping timeout: 265 seconds]
R3d_Sky has quit [Quit: Textual IRC Client: www.textualapp.com]
MerlinTheWise has joined #pypy
MerlinTheWizard has quit [Ping timeout: 255 seconds]
asmeurer_ has quit [Quit: asmeurer_]
asmeurer_ has joined #pypy
oberstet2 has quit [Ping timeout: 260 seconds]
energizer has joined #pypy
energizer has quit [Remote host closed the connection]
energizer has joined #pypy
oberstet2 has joined #pypy
antocuni has joined #pypy
oberstet3 has joined #pypy
oberstet2 has quit [Ping timeout: 255 seconds]
energizer has quit [Remote host closed the connection]
lazka has joined #pypy
antocuni has quit [Ping timeout: 260 seconds]
energizer has joined #pypy
tayfun26 has joined #pypy
mcyprian has joined #pypy
mcyprian has quit [Ping timeout: 248 seconds]
mcyprian has joined #pypy
mcyprian has quit [Ping timeout: 264 seconds]
tonyseek has quit [Quit: tonyseek]
tonyseek has joined #pypy
bendlas has quit [Ping timeout: 245 seconds]
lazka has quit [Quit: Leaving]
mcyprian has joined #pypy
bendlas has joined #pypy
lazka has joined #pypy
mcyprian has quit [Quit: Leaving.]
mcyprian has joined #pypy
mcyprian has quit [Client Quit]
antocuni has joined #pypy
tonyseek has quit [Remote host closed the connection]
tonyseek has joined #pypy
asmeurer_ has quit [Quit: asmeurer_]
the_drow has joined #pypy
energizer has quit [Ping timeout: 240 seconds]
<the_drow> cfbolz, In case you're wondering what's the difference between an SIMD version that strips whitespaces and a non-vectorized one see https://github.com/lemire/despacer
<the_drow> This is similar to the way RapidJSON skips whitespaces in a string.
<the_drow> I've also opened an issue about integrating the code into 'str'.strip() etc.
<cfbolz> the_drow: that is not my question though. My question is whether real world json files have enough whitespace for this to pay off
<fijal> most people who go fancy on JSON soon realize that there are much better protocols out there typically
<the_drow> fijal, browsers communicate via json if we like it or not
<the_drow> But I agree that other serialization protocols are much better
<fijal> I'm not debating your work
<fijal> I'm saying "why we haven't seen that much work in the area"
<fijal> sorry if it came out wrong
<the_drow> yeh I get it
<cfbolz> the_drow: you still didn't answer my question
<the_drow> cfbolz, I think that if the fastest parser in the world includes those optimizations they are not there for no reason
<cfbolz> You'd be surprised
<cfbolz> That's argument by authority
<the_drow> A pretty printted JSON contains at least one whitespace (tab) per nesting
<the_drow> Sometimes spaces are used instead of tabs
<the_drow> Clients are of a variety degree of quality and some do not send compact representations
<the_drow> cfbolz, Whitespace skipping using SIMD can be a 1% performance boost or 10%, depending on the input
<the_drow> cfbolz, A much better candidate for optimization is copying strings until the next ". See https://github.com/Tencent/rapidjson/blob/master/include/rapidjson/reader.h#L1064
mcyprian has joined #pypy
<cfbolz> Sounds cool, I suppose. Somebody needs to go and implement it
<the_drow> Right now I'm stuck with a translation error I can't figure out
<the_drow> I'm also wondering if we should do it with rffi + C or use rffi to expose interstices to RPython and code this in RPython somehow
<the_drow> The latter is more complex but will allow us to use SIMD more easily
<the_drow> In any case a SIMD module is required to detect at boot time which instructions are available to us
<cfbolz> You'd like a platform independent simd DSL compiler somehow. I wonder whether one exists anywhere
asmeurer_ has joined #pypy
asmeurer_ has quit [Ping timeout: 240 seconds]
mcyprian has quit [Quit: Leaving.]
antocuni has quit [Ping timeout: 268 seconds]
cjwelborn has quit [Remote host closed the connection]
jcea has joined #pypy
inad922 has joined #pypy
demonimin has quit [Ping timeout: 268 seconds]
iblis17_ is now known as iblis17
tonyseek has quit [Ping timeout: 264 seconds]
tonyseek has joined #pypy
cjwelborn has joined #pypy
cjwelborn has joined #pypy
cjwelborn has joined #pypy
cjwelborn has quit [Changing host]
<the_drow> cfbolz, The weld project (https://github.com/weld-project/weld) can do that
<the_drow> but it requires us to compile code to their IR
antocuni has joined #pypy
<the_drow> cfbolz, I think that a feature detection module should be enough
tonyseek has quit [Quit: tonyseek]
<antocuni> the_drow: as usual rpython is a bit obscure
<the_drow> yeh :)
<antocuni> but I think the error is due to the fact that in the self._raise you use %d and you pass "i"
inad922 has quit [Ping timeout: 265 seconds]
<antocuni> i is returned by pypy__skip_whitespaces_simd, which is declared as "unsigned int"
<antocuni> so it has an rpython type of r_uint
<antocuni> I don't think that oefmt supports any formatting char for passing unsigneds, though
<antocuni> so your best bet is probably to use intmask() to convert the r_uint into a normal int
<the_drow> antocuni, but i wasn't previously unsigned?
<the_drow> without my code changes?
<the_drow> Because it should be size_t...
<antocuni> we can argue that it should be size_t, indeed
<antocuni> but from the rpython point of view, it's a signed int
<antocuni> look at loads()
<antocuni> it calls decode_any(0), where 0 is an "int"
<antocuni> and then the "i" is passed everywhere, so the type propagates as int
R3d_Sky has joined #pypy
<antocuni> indeed, probably the easiest thing to do is to make your C function returning a long, and then fix the signedness later
marky1991 has joined #pypy
simpson has quit [Ping timeout: 255 seconds]
inad922 has joined #pypy
marky1991 has quit [Ping timeout: 240 seconds]
marr has joined #pypy
Rhy0lite has joined #pypy
oberstet3 has quit [Quit: Leaving]
bremner has quit [Quit: Coyote finally caught me]
bremner has joined #pypy
exarkun has quit [Read error: Connection reset by peer]
lazka has quit [Quit: Leaving]
simpson has joined #pypy
exarkun has joined #pypy
inad922 has quit [Ping timeout: 256 seconds]
dddddd has joined #pypy
marky1991 has joined #pypy
marky1991 has quit [Remote host closed the connection]
marky1991 has joined #pypy
inad922 has joined #pypy
realitix has joined #pypy
lazka has joined #pypy
the_drow has quit [Ping timeout: 248 seconds]
tayfun26 has quit [Remote host closed the connection]
tayfun26 has joined #pypy
tayfun27 has joined #pypy
tayfun26 has quit [Ping timeout: 240 seconds]
tayfun27 is now known as tayfun26
raynold has quit [Quit: Connection closed for inactivity]
marky1991 has quit [Ping timeout: 264 seconds]
danieljabailey has quit [Quit: ZNC 1.6.5+deb2build2 - http://znc.in]
danieljabailey has joined #pypy
inad922 has quit [Ping timeout: 256 seconds]
tayfun26 has quit [Quit: tayfun26]
lazka has quit [Quit: Leaving]
tbodt has joined #pypy
ronan has quit [Remote host closed the connection]
realitix has quit [Ping timeout: 248 seconds]
lritter_ has joined #pypy
tonyseek has joined #pypy
ronan has joined #pypy
tonyseek has quit [Quit: tonyseek]
lritter_ is now known as lritter
lritter has quit [Quit: Leaving]
lritter has joined #pypy
R3d_Sky has quit [Quit: Textual IRC Client: www.textualapp.com]
marky1991 has joined #pypy
marky1991 has quit [Remote host closed the connection]
marky1991 has joined #pypy
Garen has quit [Read error: Connection reset by peer]
Garen has joined #pypy
antocuni has quit [Ping timeout: 240 seconds]
tonyseek has joined #pypy
jorge has joined #pypy
jorge is now known as Guest312
<kenaan> rlamy py3.6 d3671e3e862c /pypy/interpreter/pyparser/parsestring.py: fix translation
Guest312 has quit [Client Quit]
tonyseek has quit [Quit: tonyseek]
bjs has quit [Quit: Bye!]
<bbot2> Started: http://buildbot.pypy.org/builders/own-linux-x86-64/builds/6730 [ronan: force build, py3.6]
<bbot2> Started: http://buildbot.pypy.org/builders/pypy-c-jit-win-x86-32/builds/3885 [ronan: force build, py3.6]
<bbot2> Started: http://buildbot.pypy.org/builders/own-linux-x86-32/builds/5843 [ronan: force build, py3.6]
<bbot2> Started: http://buildbot.pypy.org/builders/own-win-x86-32/builds/1770 [ronan: force build, py3.6]
energizer has joined #pypy
asmeurer has joined #pypy
lazka has joined #pypy
marky1991 has quit [Ping timeout: 240 seconds]
marky1991 has joined #pypy
nunatak has joined #pypy
lazka has quit [Quit: Leaving]
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
marky1991 has quit [Ping timeout: 260 seconds]
kipras is now known as kipras`away
kipras`away is now known as kipras
<bbot2> Retry: http://buildbot.pypy.org/builders/own-win-x86-32/builds/1770 [ronan: force build, py3.6]
bjs has joined #pypy
<bbot2> Failure: http://buildbot.pypy.org/builders/own-linux-x86-64/builds/6730 [ronan: force build, py3.6]
Rhy0lite has quit [Quit: Leaving]
tbodt has joined #pypy
tbodt has quit [Ping timeout: 256 seconds]
mattip has quit [Ping timeout: 240 seconds]
mattip has joined #pypy
JStoker has quit [Remote host closed the connection]
tbodt has joined #pypy
JStoker has joined #pypy
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
tbodt has joined #pypy
marky1991 has joined #pypy
nunatak has quit [Remote host closed the connection]
marky1991 has quit [Remote host closed the connection]
marky1991 has joined #pypy
marky1991 has quit [Remote host closed the connection]
marky1991 has joined #pypy
Guest95978 has quit [Remote host closed the connection]
marvin has joined #pypy
<bbot2> Failure: http://buildbot.pypy.org/builders/own-linux-x86-32/builds/5843 [ronan: force build, py3.6]
lritter has quit [Remote host closed the connection]
antocuni has joined #pypy
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
tbodt has joined #pypy
marvin has quit [Remote host closed the connection]
marvin has joined #pypy
marvin has quit [Remote host closed the connection]
marvin has joined #pypy
marvin has quit [Remote host closed the connection]
marky1991 has quit [Remote host closed the connection]
marvin has joined #pypy
marky1991 has joined #pypy
lazka has joined #pypy
lazka has quit [Client Quit]
tbodt has quit [Read error: Connection reset by peer]
lritter has joined #pypy
marvin has quit [Remote host closed the connection]
marvin has joined #pypy
tbodt has joined #pypy
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
tbodt has joined #pypy
<bbot2> Failure: http://buildbot.pypy.org/builders/pypy-c-jit-win-x86-32/builds/3885 [ronan: force build, py3.6]
<bbot2> Started: http://buildbot.pypy.org/builders/own-win-x86-32/builds/1771 [ronan: force build, py3.6]
demonimin has joined #pypy
marr has quit [Ping timeout: 248 seconds]
energizer has quit [Remote host closed the connection]
ssbr has quit [Remote host closed the connection]
ssbr has joined #pypy
antocuni has quit [Ping timeout: 264 seconds]
exarkun has quit [Ping timeout: 248 seconds]
Eyess has joined #pypy
SunDwarf has quit [*.net *.split]
ronny has quit [*.net *.split]
mvantellingen has quit [*.net *.split]
Ganwell has quit [*.net *.split]
infernix has quit [*.net *.split]
kanaka has quit [*.net *.split]
exarkun has joined #pypy
pepesza- has quit [Ping timeout: 260 seconds]
pepesza has joined #pypy
kanaka has joined #pypy
ronny has joined #pypy
Ganwell has joined #pypy
infernix has joined #pypy
marky1991 has quit [Read error: Connection reset by peer]