arigato changed the topic of #pypy to: PyPy, the flexible snake (IRC logs: https://quodlibet.duckdns.org/irc/pypy/latest.log.html#irc-end ) | use cffi for calling C | mac OS and Fedora are not Windows
irclogs_io_bot has joined #pypy
trfl has joined #pypy
antocuni has quit [Ping timeout: 250 seconds]
jcea has quit [Remote host closed the connection]
adamholmberg has joined #pypy
jcea has joined #pypy
jcea has quit [Remote host closed the connection]
jcea has joined #pypy
TwoPilesOfDirt has quit [Remote host closed the connection]
forgottenone has joined #pypy
adamholmberg has quit [Remote host closed the connection]
adamholmberg has joined #pypy
adamholmberg has quit [Ping timeout: 250 seconds]
lritter has joined #pypy
jcea has quit [Quit: jcea]
forgottenone has quit [Ping timeout: 245 seconds]
forgottenone has joined #pypy
forgottenone has quit [Ping timeout: 250 seconds]
forgottenone has joined #pypy
lritter has quit [Ping timeout: 244 seconds]
lritter has joined #pypy
<kenaan> rlamy jit-cleanup 8ffa1a681639 /rpython/: remove more stuff from rpython.jit.metainterp.typesystem
<kenaan> rlamy jit-cleanup 49a109ff63cc /rpython/jit/metainterp/: Inline instanceOf() into its only caller and simplify
<bbot2> Started: http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-64/builds/6125 [ronan: force build, jit-cleanup]
<bbot2> Started: http://buildbot.pypy.org/builders/own-linux-x86-64/builds/7394 [ronan: force build, jit-cleanup]
forgottenone has quit [Ping timeout: 246 seconds]
forgottenone has joined #pypy
_whitelogger has joined #pypy
forgottenone has quit [Remote host closed the connection]
<bbot2> Failure: http://buildbot.pypy.org/builders/own-linux-x86-64/builds/7394 [ronan: force build, jit-cleanup]
<mattip> pypy2.7 builds in a arm32 docker on aarch64, but does not run
<mattip> AssertionError at "rpython_jit_backend_arm.c", line 44542, in Regalloc_prepare_op_cond_call_gc_wb
<mattip> I don't think running in a chroot rather than a docker would matter
<mattip> .. although it would have preserved the pypy-c I spent two hours building which was erased when I exited the docker :(
xcm has quit [Remote host closed the connection]
<tumbleweed> that does make debugging more annoying :P
<petronny> I'm building pypy3 in chroot with qemu.
xcm has joined #pypy
<mattip> petronny: how long does it take to build?
<petronny> 23h if there is no error
<mattip> so 10x slower. I don't think we could run a build slave like that
<mattip> more like 15x
<tumbleweed> you should be able to do this without having to do full virtualization
<mattip> tumbleweed: the debian ARM32 build slaves run on aarch64?
<tumbleweed> no, on ARMv7
<tumbleweed> but I swear I've built it on ARMv8
<tumbleweed> Ubuntu's buildds are ARMv8
<mattip> those have 4GB RAM?
<tumbleweed> some do, yeah
<tumbleweed> actually, seems they all do
<petronny> mattip: I get a new error when building pypy3 in qemu chroot.
<mattip> strange that I can use a x86 32 bit chroot on a x86 64 bit host, but not a ARMv8 docker on a aarch64 host
<tumbleweed> do you have the log from that build?
<mattip> petronny: pastebin?
<tumbleweed> mattip: also, do you have access to that environment right now? I'm ssh-ed into an ARMv8 box with armhf (32bit) chroots on it
<tumbleweed> I can compare
<bbot2> Failure: http://buildbot.pypy.org/builders/pypy-c-jit-linux-x86-64/builds/6125 [ronan: force build, jit-cleanup]
<mattip> no, unfortunately I exited the docker and did not share the directory
<petronny> I added the patch from issue 2984 to the 7.1.0 release.
<mattip> tumbleweed: running anythin that reaches the JIT, like "arm32-pypy pytest.py -A pypy/module/_ast" fails
<mattip> petronny: that is exactly the error I see as well
<mattip> on pypy2.7
<petronny> This is the build script I'm using.
<tumbleweed> mattip: yeah, I have no problem with that. https://launchpadlibrarian.net/416458851/buildlog_ubuntu-disco-armhf.pypy_7.0.0+dfsg-3_BUILDING.txt.gz for example (interestingly, they're setting the arch to armv7l, but it *is* an ARM64 kernel)
oberstet has joined #pypy
<mattip> so it seems that is using armhf, I used a arm32v7 docker image
<mattip> tumbleweed: thanks for that. How do I see the source for the build commands?
<mattip> also splitting the script with pypy rpython/bin/rpython --source
<mattip> then "make" makes sense, it clears out the memory used in translation
<tumbleweed> mattip: this is the build script https://salsa.debian.org/debian/pypy/blob/debian/debian/rules
<mattip> +1
<mattip> thanks. Worthwhile looking at for our buildslaves
<petronny> What does the `--source` option mean?
<tumbleweed> it doesn't compile the C source, just generates it
<mattip> python rpython/bin/rpython --help
<mattip> shows the rpython toolchain options,
<mattip> python rpython/bin/rpython -Ojit pypy/goal/targetpypystandalone.py --help
<mattip> shows the pypy translation options
<petronny> thx, I'm looking at them.
<mattip> if you use that, you might want to look at rpython/tool/udir.py, which sets the directory the artifacts are created in,
<mattip> PYPY_USESSION_DIR sets the top-level directory (by default /tmp)
<tumbleweed> mattip: so what is the ARM64 box you've been playing on? AWS A1?
<mattip> debian rule uses a different trick - setting TMPDIR - which does the same thing
<mattip> tumbleweed: yup
<mattip> someone at amazon gave me some credits to try it out
<mattip> it translated in 6200 seconds.
<petronny> Is parallel translation possible?
<mattip> no
* tumbleweed will try his chroot setup on an A1 and see if it's reproduceable
<LarstiQ> mattip: re docker removing the build attempt, was that because you passed --rm to `docker run`?
<mattip> tumbleweed: I am trying again with a armhf base image instead of arm32v7
<mattip> LarstiQ: I am a docker newbie. I have a Dockerfile but it finishes with hg clone
<mattip> then I "docker run -it <image> bash" and build inside it.
<LarstiQ> mattip: that should stick around then after you quit
<LarstiQ> mattip: with `docker ps -a` you can see also the non-running containers, and with `docker start <name of container>` get back to a suspended one
forgottenone has joined #pypy
<mattip> ahh, so I am not re-entering the container, rather starting a new one each time I call "docker run -it <image>" ?
<LarstiQ> mattip: yeah, `docker run <image>` will instantiate a new container based on the specified image, you can run multiple in parallel
<LarstiQ> if you pass --name to run it will use the name you wish, otherwise it gives something random like `sad_lamarr`
<LarstiQ> mattip: the distinction between containers (docker ps -a) and images (docker images) is a crucial one, and unfortunately a subtle one to beginners
darkman66 has joined #pypy
darkman66 has quit [Remote host closed the connection]
darkman66 has joined #pypy
<kenaan> arigo pypy.org[extradoc] 9dacd393c375 /: remove donation button temporarily
nimaje has quit [Ping timeout: 250 seconds]
<fijal> arigato: thanks
oberstet has quit [Remote host closed the connection]
antocuni has joined #pypy
oberstet has joined #pypy
tsaka__ has quit [Ping timeout: 245 seconds]
tsaka__ has joined #pypy
nimaje has joined #pypy
leshaste has joined #pypy
tsaka__ has quit [Ping timeout: 246 seconds]
antocuni has quit [Ping timeout: 258 seconds]
tsaka__ has joined #pypy
forgottenone has quit [Quit: Konversation terminated!]
xcm has quit [Remote host closed the connection]
xcm has joined #pypy
<mattip> tumbleweed: using armhf still did not help. Here is what I did to use docker
<mattip> how do you set up your chroot?
tsaka__ has quit [Ping timeout: 268 seconds]
jcea has joined #pypy
tsaka__ has joined #pypy
forgottenone has joined #pypy
Rhy0lite has joined #pypy
dddddd has joined #pypy
dante has quit [Quit: bye]
antocuni has joined #pypy
inhahe has joined #pypy
inhahe_ has quit [Read error: Connection reset by peer]
tsaka__ has quit [Quit: Konversation terminated!]
adamholmberg has joined #pypy
adamholmberg has quit [Remote host closed the connection]
adamholmberg has joined #pypy
adamholmberg has quit [Remote host closed the connection]
adamholmberg has joined #pypy
Ai9zO5AP has joined #pypy
marky1991 has joined #pypy
<tumbleweed> mattip: every other line needs a setarch too
<kenaan> rlamy cffi/cffi 326ee02b5d12 /: Fix deprecated uses of pytest.raises()
<kenaan> arigo cffi/cffi b89baed6d697 /testing/cffi1/test_new_ffi_1.py: style
<kenaan> arigo cffi/cffi 1af377542a51 /: merge heads
<kenaan> arigo cffi/cffi[py3.8-interp-dict] a0845a00fa4c /: hg merge default
<kenaan> arigo cffi/cffi[py3.8-interp-dict] 25a0189f4638 /: close branch, ready for merge (python 3.8a3 was released)
<kenaan> arigo cffi/cffi 5aeca29219db /c/call_python.c: merge py3.8-interp-dict: use the official way to do that
marky1991 has quit [Ping timeout: 245 seconds]
leshaste has quit [Ping timeout: 255 seconds]
xcm has quit [Remote host closed the connection]
<tumbleweed> mattip: schroot, setup by mk-sbuild, and (in this case) https://github.com/stefanor/ansible-sbuild (although this doesn't know to set the linux32 personality here)
<tumbleweed> mattip: you want access to an instance like this, before I terminate it?
xcm has joined #pypy
<kenaan> arigo default 67af7a9e5ca2 /: update to cffi/5aeca29219db
leshaste has joined #pypy
<mattip> tumbleweed: no, thanks. It has been most helpful.
<tumbleweed> there's a good chance that lxc/lxd gets all of this stuff right, out of the box, too
<kenaan> arigo cffi/cffi d5c083291044 /c/: Shut down a warning from recent CPython versions: int() should always return an int, not a bool
darkman6_ has joined #pypy
darkman66 has quit [Ping timeout: 255 seconds]
<kenaan> arigo cffi/cffi dbc31afe99d0 /c/test_c.py: improve the test on py2.7
<kenaan> arigo cffi/cffi e43fdc644918 /c/test_c.py: Two more cases
<kenaan> arigo default afdbea198bb5 /pypy/module/_cffi_backend/: update to cffi/e43fdc644918
leshaste has quit [Quit: Leaving]
fling has quit [Ping timeout: 246 seconds]
fling has joined #pypy
xcm has quit [Remote host closed the connection]
xcm has joined #pypy
darkman6_ has quit [Remote host closed the connection]
darkman66 has joined #pypy
xcm has quit [Remote host closed the connection]
marky1991 has joined #pypy
xcm has joined #pypy
darkman66 has quit [Ping timeout: 246 seconds]
marky1991 has quit [Ping timeout: 250 seconds]
tsaka__ has joined #pypy
Garen_ has joined #pypy
marky1991 has joined #pypy
marky1991 has quit [Remote host closed the connection]
marky1991 has joined #pypy
Garen has quit [Ping timeout: 255 seconds]
antocuni has quit [Ping timeout: 244 seconds]
<tos9> So more on the numpy saga...
<mattip> ?
<tos9> mattip: jupyter notebook I think doesn't run on pypy
<tos9> The reasons are a bit silly though I think
<tos9> (Well at least the first reason I see) Basically it looks for a gc.get_stats function from py3: https://docs.python.org/3/library/gc.html#gc.get_stats
<tos9> Which pypy (even pypy2) defines, but which returns a totally different kind of object
<ronan> tos9: jupyter notebook worked last time I tried
<tos9> The gc module though is supposed to be interpreter-specific right? So seemingly the right fix for that is for prometheus to not assume anything there?
<tos9> ronan: Yeah I could have sworn I've done this before too --
<tos9> The prometheus-looking stuff looks new though I think
mjacob has quit [Ping timeout: 252 seconds]
<tos9> (And it's interesting to see jupyter expects to interact with prometheus at all...)
<mattip> https://github.com/jupyter/notebook/pull/3490 is the pr to add metrics from prometheus
<mattip> why isn't it optional?
marky1991 has quit [Read error: Connection reset by peer]
<tos9> mattip: I suspect it is, but that prometheus_client has import side effects, from reading this module
marky1991 has joined #pypy
<tos9> This thing tries to construct an instance on import, and that goes off and yeah looks for gc stats
<mattip> 'pip install "prometheus_client==0.5.0" works on PyPy 7'
<tos9> Oh, and even master has a fix
* tos9 tries
<tos9> mattip: (thanks!)
<mattip> thank google
oberstet has quit [Quit: Leaving]
<tos9> (OK with master it starts at least)
fling has quit [Ping timeout: 255 seconds]
fling has joined #pypy
Rhy0lite has quit [Quit: Leaving]
darkman66 has joined #pypy
darkman66 has quit [Remote host closed the connection]
forgottenone has quit [Quit: Konversation terminated!]
darkman66 has joined #pypy
marky1991 has quit [Read error: Connection reset by peer]
marky1991 has joined #pypy
darkman66 has quit [Remote host closed the connection]
darkman66 has joined #pypy
darkman66 has quit [Remote host closed the connection]
darkman66 has joined #pypy
marky1991 has quit [Remote host closed the connection]
marky1991 has joined #pypy
marky1991 has quit [Client Quit]
darkman66 has quit [Remote host closed the connection]
darkman66 has joined #pypy
Ai9zO5AP has quit [Quit: WeeChat 2.4]
darkman66 has quit [Remote host closed the connection]
darkman66 has joined #pypy
darkman66 has quit [Remote host closed the connection]
antocuni has joined #pypy
xcm has quit [Remote host closed the connection]
xcm has joined #pypy
xcm has quit [Remote host closed the connection]
xcm has joined #pypy
mjacob has joined #pypy
lritter has quit [Quit: Leaving]