2017-09-12 15:07
cfbolz changed the topic of #pypy to: PyPy, the flexible snake (IRC logs:
https://botbot.me/freenode/pypy/ ) | use cffi for calling C | "nothing compares to the timeshifter, my personal polar expedition in software" - pedronis
00:30
yuyichao_ has joined #pypy
00:30
yuyichao has quit [Ping timeout: 260 seconds]
00:42
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
00:43
tbodt has joined #pypy
01:08
cloudyplain has joined #pypy
02:01
<
kenaan >
rlamy py3.5 ca8b2b8a0df0 /pypy/module/cpyext/genobject.py: fix translation
02:16
ArneBab_ has joined #pypy
02:16
ArneBab_ has quit [Changing host]
02:16
ArneBab_ has joined #pypy
02:20
ArneBab has quit [Ping timeout: 240 seconds]
02:52
lritter__ has joined #pypy
02:56
lritter_ has quit [Ping timeout: 252 seconds]
03:53
cloudyplain has quit [Remote host closed the connection]
03:59
cloudyplain has joined #pypy
04:04
cloudyplain has quit [Ping timeout: 252 seconds]
04:36
cloudyplain has joined #pypy
04:41
cloudyplain has quit [Ping timeout: 240 seconds]
04:56
_whitelogger has joined #pypy
05:08
glyph has joined #pypy
05:12
cloudyplain has joined #pypy
05:16
kdas_ has joined #pypy
05:16
kdas_ has quit [Client Quit]
05:21
yuyichao_ has quit [Ping timeout: 240 seconds]
05:22
yuyichao_ has joined #pypy
05:26
forgottenone has joined #pypy
05:31
lritter__ has quit [Remote host closed the connection]
05:33
<
kenaan >
mattip default 1fb2a6a3b647 /pypy/: fix tag, fix PYPY_VERSION_NUM is hex not decimal
05:33
<
kenaan >
mattip py3.5 6a7983eb68b8 /pypy/module/_socket/interp_func.py: CMSG_SPACE, CMSG_LEN not available on windows
05:40
* mattip
trying to see why own tests take 5 hours on windows
05:41
<
mattip >
looking at tests that run for over 2000 secs, translator/c/test/test_typed.py takes 275 secs for 71 tests on linux64, 2170 secs on win32
05:42
<
mattip >
likewise translator/c/test/test_backendoptimized.py takes 323 secs for 85 tests on linux64, 2555 secs on win32
05:45
<
mattip >
something to do with forking/subprocess ?
06:09
<
cfbolz >
mattip: or simply C compiler speed?
06:10
<
mattip >
cfbolz: maybe, for smaller snippets? is that a known phenomenon?
06:11
cloudyplain has quit [Remote host closed the connection]
06:11
<
cfbolz >
mattip: I don't know. Just saying that that is what those test files do
06:11
<
njs >
it's true that windows subprocess spawn is ridiculously slow. and if nothing else, C compilers are subprocesses :-)
06:12
<
cfbolz >
mattip: the improved json parsing performance is probably worth mentioning in the release announcement
06:12
<
mattip >
it just seems to be a shame to waste all that CPU over and over again every night
06:12
<
mattip >
cfbolz: cool
06:13
<
mattip >
is there a benchmark or comparison?
06:13
<
cfbolz >
mattip: I can try to write something. I didn't mention super rigorously, but particularly the memory improvements should be quite big
06:14
<
cfbolz >
s/mention/measure
06:14
<
mattip >
even a "should be 10% faster and use %30 less memory for JSON files with xxxx attributes" would be enough
06:15
<
mattip >
where "should" is the important part
06:15
cloudyplain has joined #pypy
06:20
cloudyplain has quit [Ping timeout: 246 seconds]
06:23
realitix has joined #pypy
06:32
tormoz has joined #pypy
06:45
<
kenaan >
mattip default 61e579f98356 /pypy/doc/release-v5.9.0.rst: update release notes
06:48
cloudyplain has joined #pypy
06:54
<
mattip >
hints about slowdowns
06:54
<
mattip >
- maybe use precompiled headers (but TestMakefile::test_precompiled_headers is not showing more than a 25% gain)
06:55
<
mattip >
- maybe reduce amount of prints in compile process, especially if they are going to console (apparently they are not, since not seeing them in stdout log)
06:56
<
mattip >
- use a SSD disk
06:59
cloudyplain has quit [Remote host closed the connection]
06:59
cloudyplain has joined #pypy
07:00
cloudyplain has quit [Remote host closed the connection]
07:00
cloudyplain has joined #pypy
08:13
marr has joined #pypy
08:32
antocuni has joined #pypy
08:37
raynold has quit [Quit: Connection closed for inactivity]
08:53
yuyichao_ has quit [Remote host closed the connection]
08:53
cstratak has joined #pypy
09:25
the_drow has quit [Ping timeout: 248 seconds]
09:42
the_drow has joined #pypy
09:47
cloudyplain has quit [Remote host closed the connection]
09:52
cloudyplain has joined #pypy
09:56
cloudyplain has quit [Ping timeout: 255 seconds]
10:05
cloudyplain has joined #pypy
10:19
antocuni has quit [Ping timeout: 240 seconds]
10:22
forgottenone has quit [Ping timeout: 260 seconds]
10:41
oberstet has joined #pypy
11:07
yuyichao has joined #pypy
11:11
yuyichao has quit [Ping timeout: 240 seconds]
11:11
yuyichao has joined #pypy
11:13
cloudyplain has quit [Remote host closed the connection]
11:20
cloudyplain has joined #pypy
11:25
cloudyplain has quit [Ping timeout: 252 seconds]
11:33
forgottenone has joined #pypy
11:38
cloudyplain has joined #pypy
11:50
cloudyplain has quit [Remote host closed the connection]
12:09
forgottenone has quit [Quit: Konversation terminated!]
12:16
marr123 has joined #pypy
12:16
kipras is now known as kipras`away
12:17
exarkun has quit [Ping timeout: 240 seconds]
12:17
exarkun has joined #pypy
12:17
marr has quit [Ping timeout: 248 seconds]
12:19
antocuni has joined #pypy
12:28
kipras`away is now known as kipras
12:39
marr123 has quit [Remote host closed the connection]
12:39
marr has joined #pypy
12:43
Rhy0lite has joined #pypy
12:52
cstratak has quit [Quit: Leaving]
12:58
cstratak has joined #pypy
13:03
<
kenaan >
cfbolz default dc8707606e3e /pypy/doc/release-v5.9.0.rst: some numbers
13:10
adamholmberg has joined #pypy
13:12
demonimin has joined #pypy
13:12
bauerj_ has joined #pypy
13:19
Guest29991 has quit [Remote host closed the connection]
13:19
marvin has joined #pypy
13:20
marvin is now known as Guest12827
13:54
forgottenone has joined #pypy
13:56
exarkun has quit [Ping timeout: 240 seconds]
13:58
Ulfalizer has joined #pypy
13:59
exarkun has joined #pypy
14:04
cstratak has quit [Quit: Leaving]
14:05
cstratak has joined #pypy
14:09
marky1991 has joined #pypy
14:10
<
Ulfalizer >
ops, premature paste. hang on. :)
14:11
<
Ulfalizer >
does that optimization depend on all attributes being set in __init__()? i have a parser library where some attributes are set on parse nodes after they're created. it's still always a fixed set though.
14:11
<
Ulfalizer >
guessing not, but thought i'd check
14:27
realitix has quit [Quit: Leaving]
14:28
yuyichao has quit [Ping timeout: 255 seconds]
14:28
<
antocuni >
Ulfalizer: no,
__init__ is nothing special
14:28
<
Ulfalizer >
thought so - thanks!
14:28
<
antocuni >
you can attach attributes from wherever you like
14:35
the_drow has quit [Ping timeout: 255 seconds]
14:36
ArneBab has joined #pypy
14:37
yuyichao has joined #pypy
14:50
the_drow has joined #pypy
14:54
raynold has joined #pypy
15:27
oberstet has quit [Ping timeout: 246 seconds]
15:33
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
15:36
exarkun has quit [Ping timeout: 240 seconds]
15:38
exarkun has joined #pypy
15:43
asmeurer__ has quit [Read error: Connection reset by peer]
15:52
tbodt has joined #pypy
15:55
asmeurer has joined #pypy
16:36
cstratak has quit [Quit: Leaving]
16:43
rubdos has quit [Ping timeout: 255 seconds]
16:48
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
16:49
antocuni has quit [Ping timeout: 240 seconds]
16:55
tbodt has joined #pypy
17:07
marky1991 has quit [Ping timeout: 240 seconds]
17:17
exarkun has quit [Ping timeout: 240 seconds]
17:17
exarkun has joined #pypy
17:38
marky1991 has joined #pypy
17:51
<
mattip >
it seems most of the test slowdown is subprocess, running a compiled exe is more than 100X slower
17:52
<
kenaan >
mattip win32-slow-tests d8fd9d7c8d1b /rpython/translator/c/test/test_typed.py: instrument and compare linux to win32 on the same machine (not under a vm)
17:52
<
kenaan >
mattip default 3a589f5a003b /pypy/doc/release-v5.9.0.rst: typos and links (thanks to reviewers on pypy-dev)
17:57
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
17:58
tbodt has joined #pypy
18:12
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
18:14
tbodt has joined #pypy
18:21
tbodt has quit [Ping timeout: 240 seconds]
18:23
tbodt has joined #pypy
18:38
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
18:56
exarkun has quit [Ping timeout: 255 seconds]
18:57
tbodt has joined #pypy
18:57
exarkun has joined #pypy
18:58
jamesaxl has joined #pypy
19:01
marky1991 has quit [Ping timeout: 248 seconds]
19:05
<
njs >
Ulfalizer: note that cpython does a similar optimization and I believe that it's version
*does* benefit from always initializing all attributes inside
__init__
19:11
Rhy0lite has quit [Quit: Leaving]
19:23
jamesaxl has quit [Ping timeout: 252 seconds]
19:24
jamesaxl has joined #pypy
19:27
jamesaxl has quit [Read error: Connection reset by peer]
19:27
jamesaxl has joined #pypy
19:30
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
19:33
jamesaxl has quit [Read error: Connection reset by peer]
19:34
jamesaxl has joined #pypy
19:40
rubdos has joined #pypy
19:55
ronan has quit [Remote host closed the connection]
19:56
forgottenone has quit [Quit: Konversation terminated!]
20:08
adamholmberg has quit [Read error: No route to host]
20:08
adamholmberg has joined #pypy
20:17
tbodt has joined #pypy
20:17
tbodt has quit [Client Quit]
20:24
marky1991 has joined #pypy
20:26
tbodt has joined #pypy
20:30
jamesaxl has quit [Read error: Connection reset by peer]
20:30
jamesaxl has joined #pypy
20:34
marky1991 has quit [Ping timeout: 248 seconds]
20:38
exarkun has quit [Ping timeout: 246 seconds]
20:39
exarkun has joined #pypy
20:46
raynold has quit [Quit: Connection closed for inactivity]
20:48
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
20:54
tbodt has joined #pypy
20:54
tbodt has quit [Client Quit]
21:03
raynold has joined #pypy
21:18
marky1991 has joined #pypy
21:19
marky1991 has quit [Remote host closed the connection]
21:19
marky1991 has joined #pypy
21:19
marky1991 has quit [Changing host]
21:19
marky1991 has joined #pypy
21:20
<
kenaan >
pjenvey default 4bda0b81a960 /pypy/doc/release-v5.9.0.rst: blurb a18e6d5
21:36
kolko has quit [Ping timeout: 248 seconds]
21:39
ronan has joined #pypy
21:55
marky1991 has quit [Ping timeout: 248 seconds]
21:59
john51 has joined #pypy
22:01
john51_ has quit [Ping timeout: 240 seconds]
22:05
marky1991 has joined #pypy
22:06
marky1991 has quit [Remote host closed the connection]
22:06
marky1991 has joined #pypy
22:12
marky1991 has quit [Ping timeout: 240 seconds]
22:19
exarkun has quit [Ping timeout: 240 seconds]
22:19
exarkun has joined #pypy
23:13
cloudyplain has joined #pypy
23:18
marr has quit [Ping timeout: 248 seconds]
23:22
cloudyplain has quit [Remote host closed the connection]
23:23
cloudyplain has joined #pypy
23:25
cloudyplain has quit [Read error: Connection reset by peer]
23:25
cloudyplain has joined #pypy
23:35
adamholmberg has quit [Remote host closed the connection]
23:42
yuyichao has quit [Ping timeout: 240 seconds]
23:47
cloudyplain has quit [Remote host closed the connection]
23:50
cloudyplain has joined #pypy
23:53
cloudyplain has quit [Remote host closed the connection]
23:57
cloudyplain has joined #pypy
23:58
yuyichao has joined #pypy
23:59
cloudyplain has quit [Remote host closed the connection]