<archi42>
hi, how can i set the parallel make level when building an image? i did a 'make image -j16' but am seeing 25+ cc1 processes
<archi42>
(i recently built a llvm with a 'make -j$empty_var', turns out 1200 processes are enough to OOM on 128GB RAM - I'd like to avoid that nasty surprise today ;-)
<buzzmarshall>
theres been a lot of changes to the build scripts since i last built and am still going thru them all to better learn how the toolchain and build system currently works
<buzzmarshall>
but i am wondering if theres something that can be tweaked maybe in the pkgbuild script or maybe the multibuild scripts
<vpeter>
archi42: parallel build is done automatically. Just use make.
<buzzmarshall>
actually thats the way i have been using that and for me it seems to adjust fine but just out of curiosity was looking at things
<buzzmarshall>
i don't normally use the -j switch ever since the introduction of the parallel a long time ago
<archi42>
aah, okay.. any way to force it to some value? it must have auto-picked -j32 (16C/32T machine), but this makes the fans spin up *really* loud
<buzzmarshall>
lol
<buzzmarshall>
i just found that once they got the parallel thing settled down to build things in the proper order i stopped using any of the -j switch as it seemed to adjust to which ever machine i built on
<archi42>
yeah, it was pretty fast I guess (40m realtime) - but my SO texted me the server was making funny noises ;)
<buzzmarshall>
for along time i used to just revert some of the scripts back to older versions that did it the way i wanted but now after my most recent builds wanted to leave things as is and just better learn it
<buzzmarshall>
aw
<archi42>
hm, seems it can not be set... at least not automatically:
<archi42>
pkgbuiler.py takes --max-procs
<archi42>
pkgjson sets that to $(nprocs)
<buzzmarshall>
ya i was just looking at that and wondering bout that
<archi42>
na, i think i'll just do a fake nprocs to my path then :D
<archi42>
-> #!/bin/sh\n echo 16
<buzzmarshall>
i'd like to figure out how to spread the build out across a server farm i have here
<archi42>
oh, that's even nicer :D
<buzzmarshall>
hence my snooping
<buzzmarshall>
i do like the way the build currently works tho
<buzzmarshall>
much faster then before
<archi42>
what we're doing a work would probably be much like "use one host per target/image" and don't bother with a complex scheme (I was told distcc was more trouble than it was worth)
<buzzmarshall>
ya that might be
<buzzmarshall>
i was playing around with the idea last summer as i got a half dozen servers in a rack here sharing about 30tb of network storage and messed around for a bit
<archi42>
with the 2x 2687W (v1) I can build the H6 orange-pi-lite2 image in 40m, so that's about 24 to 30 images that machine could build per day (but with EU power prices that would leave me broke)
<archi42>
nice
<buzzmarshall>
but the stamps were give me grief
<archi42>
what do you mean with "stamps"?
<buzzmarshall>
the stamps in the build to know whether it needs to rebuild the packages and stuff
<archi42>
ah, timestamps^^ k
<buzzmarshall>
everytime i altered something it retriggerd a complete build
<buzzmarshall>
probably something to do with the network and shares
<archi42>
i recall reading some problems with NFS regarding that -- but i didn't get around to testing it
<buzzmarshall>
then i started at looking at trying to setup a jenkins setup in the house but got sidetracked
<archi42>
(not necessary on the 50 node cluster @work and i only have one machine at home)
<archi42>
oh, i have to leave, meeting some friends in 15m ;)
<buzzmarshall>
take care...
archi42 is now known as archi42`away
<archi42`away>
thx, you too
|Jeroen| has joined #libreelec
archi42`away has quit [Quit: leaving]
andy-burns has joined #libreelec
egos has joined #libreelec
andy-burns has quit [Read error: Connection reset by peer]
andy-burns has joined #libreelec
RedSoxFan07 has joined #libreelec
rubdos has quit [Quit: WeeChat 2.4]
RaphGro has joined #libreelec
rubdos has joined #libreelec
prahal has quit [Quit: prahal]
gouchi has joined #libreelec
|Jeroen| has quit [Quit: dada]
|Jeroen| has joined #libreelec
Colty has joined #libreelec
Colti has quit [Ping timeout: 272 seconds]
rubdos has quit [Quit: WeeChat 2.4]
RedSoxFan07 has quit [Ping timeout: 265 seconds]
RedSoxFan07 has joined #libreelec
rubdos has joined #libreelec
ghostcube has quit [Quit: Verlassend]
rduke has quit [*.net *.split]
j0nnymoe has quit [*.net *.split]
bacobart has quit [*.net *.split]
bacobart has joined #libreelec
rduke has joined #libreelec
iNDi has quit [Ping timeout: 268 seconds]
iNDi has joined #libreelec
|Jeroen| has quit [Quit: dada]
Fenster` has joined #libreelec
RaphGro has quit [Quit: Please remember your own message. It'll be read as soon as possible.]
Fenster has quit [Ping timeout: 260 seconds]
gouchi has quit [Remote host closed the connection]