2018-02-26 15:52
cfbolz changed the topic of #pypy to: PyPy, the flexible snake (IRC logs:
https://botbot.me/freenode/pypy/ ) | use cffi for calling C | the secret reason for us trying to get PyPy users: to test the JIT well enough that we're somewhat confident about it
00:15
tbodt has joined #pypy
00:18
marr has quit [Ping timeout: 264 seconds]
00:21
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
00:24
tbodt has joined #pypy
00:36
jredondo__ has joined #pypy
00:37
marky1991 has quit [Remote host closed the connection]
00:37
marky1991 has joined #pypy
00:40
pf_moore has quit [Quit: Connection closed for inactivity]
00:43
jredondo__ has quit [Ping timeout: 240 seconds]
00:52
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
01:11
lritter_ has joined #pypy
01:11
tbodt has joined #pypy
01:14
squeaky_pl has quit [Ping timeout: 240 seconds]
01:14
lritter has quit [Ping timeout: 248 seconds]
01:35
lritter_ has quit [Ping timeout: 264 seconds]
01:51
marky1991 has quit [Ping timeout: 264 seconds]
01:53
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
01:59
marky1991 has joined #pypy
02:21
marky1991 has quit [Remote host closed the connection]
02:23
marky1991 has joined #pypy
02:33
dddddd has quit [Read error: Connection reset by peer]
02:41
marky1991 has quit [Read error: Connection reset by peer]
02:50
energizer has quit [Ping timeout: 264 seconds]
02:52
raynold has quit [Quit: Connection closed for inactivity]
02:53
energizer has joined #pypy
03:16
raynold has joined #pypy
03:49
xorAxAx has quit [Ping timeout: 248 seconds]
03:50
planrich has quit [Ping timeout: 248 seconds]
03:50
planrich has joined #pypy
03:52
danieljabailey has quit [Ping timeout: 240 seconds]
03:54
danieljabailey has joined #pypy
04:06
asmeurer__ has quit [Quit: asmeurer__]
04:07
asmeurer__ has joined #pypy
04:50
TheAdversary has quit [Ping timeout: 264 seconds]
04:51
Hasimir has quit [Ping timeout: 248 seconds]
05:11
forgottenone has joined #pypy
05:43
forgottenone has quit [Quit: Konversation terminated!]
06:01
asmeurer__ has quit [Quit: asmeurer__]
06:02
asmeurer_ has joined #pypy
06:04
<
kenaan >
arigo pypy.org[extradoc] b010de333e74 /: Clarify how to build PyPy3 from sources
06:45
illume has joined #pypy
06:58
tayfun26 has joined #pypy
07:15
asmeurer_ has quit [Quit: asmeurer_]
07:17
antocuni has joined #pypy
07:31
solarjoe4 has joined #pypy
08:01
xorAxAx has joined #pypy
08:37
inad924 has joined #pypy
08:40
energizer has quit [Ping timeout: 240 seconds]
08:44
pf_moore has joined #pypy
08:46
mcyprian has joined #pypy
08:47
mcyprian has quit [Client Quit]
08:50
oberstet has joined #pypy
08:57
mcyprian has joined #pypy
08:57
mcyprian has quit [Client Quit]
08:57
mcyprian has joined #pypy
08:59
<
mattip >
any hypothesis experts want to guess why hypothesis 3.52 times out creating readline tests?
09:03
<
mattip >
"Only produced 1 valid examples in 1.05 seconds (0 invalid ones and 0 exceeded maximum size)"
09:12
dddddd has joined #pypy
09:23
marr has joined #pypy
09:27
<
cfbolz >
mattip: I don't understand this at all
09:27
<
cfbolz >
I have tried various things to fix it, but still makes no sense to me
09:28
<
cfbolz >
Also, can't reproduce it locally at all
09:28
<
mattip >
cfbolz: can you reproduce at all?
09:29
<
mattip >
hehe, crosstalk. Maybe some kind of lock when running multiple workers?
09:29
<
cfbolz >
Ah, interesting theory
09:29
<
cfbolz >
mattip: or just CPU contention that pushes it over the limit
09:29
<
mattip >
is it actually using a file handle?
09:30
<
cfbolz >
Probably, yes
09:30
<
cfbolz >
It stores stuff in some kind of db
09:30
<
mattip >
annoying, we are so close to green buildbots
09:31
<
cfbolz >
mattip: I am tempted to disable this test
09:33
<
mattip >
is there a way to tell hypothesis to skip without raising an error
09:34
<
cfbolz >
I doubt it
09:34
<
cfbolz >
mattip: would you be up to merging default up to the fix-sre-problems to py3.5?
09:34
<
cfbolz >
I'd like to merge the latter there, but some of the commits before confuse me
09:34
mcyprian has quit [Ping timeout: 248 seconds]
09:35
<
cfbolz >
mattip: I'll try to take another look at the hypothesis thing in the meantime
09:36
<
cfbolz >
DRMacIver: ping (but I guess you were highlighted by 'hypothesis' already?)
09:36
<
mattip >
or just leave it, not a big deal really
09:36
<
DRMacIver >
cfbolz: Hmm I should have been but apparently wasn't.
09:36
<
cfbolz >
DRMacIver: we have this test failure on a buildbot regularly, but can't reproduce it at all locally:
09:37
<
cfbolz >
any clue how to debug it?
09:37
<
DRMacIver >
cfbolz: Did this really only start with Hypothesis 3.52?
09:38
<
cfbolz >
unclear. it's been failing since a while, didn't track when it started
09:38
<
DRMacIver >
If it's a while probably not then. 3.52 is quite recent
09:38
<
DRMacIver >
(this week)
09:38
<
cfbolz >
no, much longer
09:39
<
cfbolz >
one problem is that nobody ever managed to make it fail locally
09:40
<
cfbolz >
and the buildserver isn't slow, just rather busy (we run many tests in parallel)
09:40
<
DRMacIver >
And using the @seed decorator it tells you doesn't reproduce the problem locally
09:42
<
cfbolz >
the statistics look like this:
09:45
<
cfbolz >
DRMacIver: matti was wondering whether any disk i/o is happening during test generation. that could possibly be quite slow on the test machine
09:45
<
DRMacIver >
cfbolz: Some but not a lot. You will get some disk I/O after some tests (and almost always the first), so yeah that could be it.
09:45
<
DRMacIver >
cfbolz: You could try setting database=None in your tests and see if tha tmakes the problem go away
09:46
<
cfbolz >
DRMacIver: ah, good idea
09:49
<
kenaan >
mattip py3.5 c06e1a903116 /pypy/module/cpyext/test/sre_constants.h: one more missing file
09:49
<
kenaan >
mattip py3.5 c3b4518f2322 /: merge default into branch
09:50
<
kenaan >
cfbolz pyparser-improvements e5c117bc3cbf /pypy/interpreter/pyparser/: move bench target to test/
09:50
<
kenaan >
cfbolz pyparser-improvements fbbadbbb888b /: merge default
09:50
<
kenaan >
cfbolz pyparser-improvements ec7d9790f8f9 /pypy/doc/whatsnew-head.rst: document branch
09:52
<
cfbolz >
DRMacIver: but wouldn't I see that when running it locally?
09:53
<
DRMacIver >
cfbolz: Maybe, but this is definitely something where slow disk performance exacerbates the problem
09:53
<
cfbolz >
ah, interesting
09:53
<
DRMacIver >
Especially given you're on pypy where the actual calculation is likely to be fast
09:53
<
cfbolz >
I think the tests actually run on cpython
09:53
<
cfbolz >
(it's faster)
09:54
<
cfbolz >
DRMacIver: any way to mitigate this bug? or to test whether it's really this problem?
09:54
<
DRMacIver >
cfbolz: I think the current best workaround is add a 'st.text().example()' somewhere in your test startup code (e.g. in a conftest.py)
09:55
<
cfbolz >
DRMacIver: globally in that file is fine?
09:57
<
cfbolz >
DRMacIver: thanks will try that
09:59
mcyprian has joined #pypy
10:00
antocuni has quit [Ping timeout: 252 seconds]
10:00
<
cfbolz >
mattip: looking at the whatsnew, this will be quite a nice release
10:01
<
mattip >
just ... looking ... for ... one ... more ... bug
10:02
<
mattip >
something goes wrong with a mix of cythonized code that calls a python
__new__ that uses lots of class attributes
10:02
<
cfbolz >
sure, still a bit to go
10:03
<
kenaan >
cfbolz py3.5 ffbcc29df485 /: merge default
10:03
<
mattip >
it doesn't appear to be a cython problem, maybe I can copy it to cpyext tests - calling np.empty_like(x[0]) where x is a MaskedArray
10:04
<
kenaan >
cfbolz py3.5 6b57c7b53662 /pypy/module/_io/test/test_interp_textio.py: try to see whether disk I/O is the culprit
10:04
<
kenaan >
cfbolz py3.5 2487a89f1e8c /pypy/module/_io/test/test_interp_textio.py: yet another workaround suggested by david
10:08
forgottenone has joined #pypy
10:09
<
arigato >
mjacob: hi! can you point us to the branch and test name for the weakref issue with async generators? thanks!
10:10
<
arigato >
ah, it's py3.6, lib-python/3/test/test_asyncgen.py, right?
10:10
inad924 has quit [Ping timeout: 240 seconds]
10:13
[Arfrever] has quit [Ping timeout: 248 seconds]
10:14
geov has quit [Remote host closed the connection]
10:14
[Arfrever] has joined #pypy
10:15
<
cfbolz >
mattip: do you have an idea why sometimes fetching the dependencies fails?
10:16
<
mattip >
where does it fail?
10:19
<
cfbolz >
ah, that's a cert error
10:19
<
mattip >
cfbloz: IMO linux32 is running an old ubuntu, the cpython and the certs there are ancient
10:19
<
mattip >
also virtualenv is failing there
10:19
<
cfbolz >
yes, that's tannit (which will go away soon anyway
10:20
<
cfbolz >
ok, fair enough
10:28
inad924 has joined #pypy
10:39
squeaky_pl has joined #pypy
10:53
dddddd has quit [Ping timeout: 264 seconds]
11:20
dddddd has joined #pypy
11:21
mcyprian has quit [Ping timeout: 264 seconds]
11:22
inad924 has quit [Ping timeout: 276 seconds]
11:30
solarjoe4 has quit [Quit: Leaving]
11:35
inad924 has joined #pypy
11:51
Remi_M has quit [Remote host closed the connection]
12:18
solarjoe4 has joined #pypy
12:22
inad924 has quit [Ping timeout: 256 seconds]
12:35
inad924 has joined #pypy
12:42
antocuni has joined #pypy
12:42
Rhy0lite has joined #pypy
12:45
jredondo__ has joined #pypy
12:50
jredondo__ has quit [Ping timeout: 264 seconds]
12:52
inad924 has quit [Ping timeout: 276 seconds]
12:57
marky1991 has joined #pypy
13:04
inad924 has joined #pypy
13:14
marky1991 has quit [Ping timeout: 240 seconds]
13:22
marky1991 has joined #pypy
13:24
illume has quit [Quit: My MacBook Pro has gone to sleep. ZZZzzz…]
13:27
lritter_ has joined #pypy
13:28
illume has joined #pypy
13:53
jredondo__ has joined #pypy
14:02
marky1991 has quit [Ping timeout: 240 seconds]
14:05
inad924 has quit [Ping timeout: 246 seconds]
14:18
antocuni has quit [Ping timeout: 256 seconds]
14:25
solarjoe4 has quit [Quit: Leaving]
14:27
inad924 has joined #pypy
14:36
marky1991 has joined #pypy
14:39
jredondo__ has quit [Quit: jredondo__]
14:40
inad924 has quit [Ping timeout: 264 seconds]
14:40
jredondo__ has joined #pypy
14:41
illume has quit [Quit: My MacBook Pro has gone to sleep. ZZZzzz…]
14:41
jredondo__ has quit [Client Quit]
14:42
jredondo__ has joined #pypy
14:44
jredondo__ has quit [Client Quit]
14:46
jredondo__ has joined #pypy
14:48
marky1991 has quit [Ping timeout: 256 seconds]
14:52
lesshaste has quit [Quit: Leaving]
14:57
Lightsword has quit [Quit: ZNC]
14:59
mcyprian has joined #pypy
15:09
<
mjacob >
arigato: yes, it's in the py3.6 branch. the primary problem is actually not the weakref-despite-resurrect which i told you about.
15:10
oberstet has quit [Ping timeout: 256 seconds]
15:11
<
mjacob >
arigato: i came up with a different approach for a minimal failing example. i can finish and commit this soon-ish if it's pressing
15:12
dw has left #pypy [#pypy]
15:12
<
mjacob >
arigato: (that's why i didn't commit a failing test so far)
15:13
illume has joined #pypy
15:18
marky1991 has joined #pypy
15:22
<
mjacob >
arigato: and you're correct that lib-python/3/test/test_asyncgen.py fails
15:24
mcyprian has quit [Quit: Leaving.]
15:32
tayfun26 has quit [Quit: tayfun26]
15:36
oberstet has joined #pypy
15:38
marky1991 has quit [Ping timeout: 276 seconds]
15:46
jredondo__ has quit [Quit: jredondo__]
15:52
tormoz has joined #pypy
15:55
demonimin has joined #pypy
16:06
marky1991 has joined #pypy
16:20
illume has quit [Quit: My MacBook Pro has gone to sleep. ZZZzzz…]
16:28
energizer has joined #pypy
16:29
mcyprian has joined #pypy
16:30
tbodt has joined #pypy
16:38
asmeurer__ has joined #pypy
16:44
mcyprian has quit [Read error: Connection reset by peer]
16:55
antocuni has joined #pypy
17:20
nunatak has joined #pypy
17:28
inhahe_ has quit []
17:34
antocuni has quit [Ping timeout: 264 seconds]
17:39
marky1991 has quit [Ping timeout: 264 seconds]
17:44
inhahe__ has joined #pypy
17:49
marky1991 has joined #pypy
17:49
marky1991 has quit [Remote host closed the connection]
17:49
marky1991 has joined #pypy
18:04
<
kenaan >
mjacob py3.6 aa53932d50e0 /pypy/module/sys/: IN-PROGRESS: Implement sys.get_asyncgen_hooks() and sys.get_asyncgen_hooks(). This needs to made thread-local event...
18:14
marr has quit [Remote host closed the connection]
18:15
<
cfbolz >
mattip: so, one step forward, one back: merged the branch, but found a segfault :-)
18:18
lritter_ has quit [Quit: Leaving]
18:19
squeaky_pl has quit [Quit: Leaving]
18:23
<
kenaan >
cfbolz pyparser-improvements c6a2bdbe2a72 /pypy/interpreter/pyparser/parser.py: remove redundant assert
18:23
<
kenaan >
cfbolz default ac6363dcdcbb /pypy/module/_io/test/test_interp_textio.py: try to see whether disk I/O is the culprit
18:23
<
kenaan >
cfbolz default 058357bd35eb /pypy/module/_io/test/test_interp_textio.py: yet another workaround suggested by david
18:27
marky1991 has quit [Remote host closed the connection]
18:29
marky1991 has joined #pypy
18:30
Kireji has quit [Remote host closed the connection]
18:33
illume has joined #pypy
18:37
inhahe__ has quit [Read error: Connection reset by peer]
18:37
inhahe__ has joined #pypy
18:37
tbodt has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
18:48
Hasimir has joined #pypy
18:57
TheAdversary has joined #pypy
19:00
<
mattip >
cfbolz: in the JIT or something I changed?
19:01
<
cfbolz >
An old bug in the jit hooks
19:01
<
cfbolz >
Not super high priority, but I'd like to look
19:09
marky1991 has quit [Ping timeout: 240 seconds]
19:09
forgottenone has quit [Ping timeout: 256 seconds]
19:19
Rhy0lite has quit [Quit: Leaving]
19:22
tbodt has joined #pypy
19:23
mcyprian has joined #pypy
19:25
jamesaxl has quit [Read error: Connection reset by peer]
19:26
jamesaxl has joined #pypy
19:32
raynold has quit [Quit: Connection closed for inactivity]
19:43
mcyprian has quit [Quit: Leaving.]
19:50
planrich has quit [Ping timeout: 240 seconds]
19:57
marky1991 has joined #pypy
20:11
sbauman has quit [Quit: Connection closed for inactivity]
20:19
jamesaxl has quit [Quit: WeeChat 2.0.1]
20:29
lritter has joined #pypy
20:34
illume has quit [Quit: My MacBook Pro has gone to sleep. ZZZzzz…]
20:37
planrich has joined #pypy
20:47
marky1991 has quit [Read error: Connection reset by peer]
21:02
drolando_ has quit [Remote host closed the connection]
21:02
drolando has joined #pypy
21:10
nunatak has quit [Quit: Leaving]
21:13
mattip has left #pypy ["bye"]
21:13
drolando has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
21:16
drolando has joined #pypy
21:20
lritter has quit [Remote host closed the connection]
21:23
drolando_ has joined #pypy
21:26
drolando has quit [Ping timeout: 240 seconds]
21:27
raynold has joined #pypy
21:31
marr has joined #pypy
22:37
oberstet has quit [Ping timeout: 268 seconds]
23:56
sbauman has joined #pypy