stebalien changed the topic of #ipfs to: Heads Up: To talk, you need to register your nick! Announcements: go-ipfs 0.5.1 and js-ipfs 0.43.1 are out! Get them from dist.ipfs.io and npm respectively! | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS: https://github.com/ipfs/ipfs | Logs: https://view.matrix.org/room/!yhqiEdqNjyPbxtUjzm:matrix.org/ | Forums: https://discuss.ipfs.io | Code of Conduct: https://git.io/vVBS0
spinza has joined #ipfs
LHLaurini2 is now known as LHLaurini
jessehattabaugh_ has joined #ipfs
jessehattabaugh has quit [Ping timeout: 260 seconds]
KeiraT has quit [Remote host closed the connection]
KeiraT has joined #ipfs
Caterpillar2 has joined #ipfs
Caterpillar has quit [Ping timeout: 264 seconds]
<JCaesar>
Hm, I've been working on a little tool to hopefully make it easier to put linux distro mirrors onto IPFS: https://github.com/jcaesar/ftp2mfs/
<JCaesar>
Essentially, what it does is retrieve a file from http/ftp/rsync, and write it to mfs, one by one.
p-core has quit [Remote host closed the connection]
<JCaesar>
Now if I sync a mirror with, say, 20000 files, I'll be creating 20000 versions of the mfs root directory.
<JCaesar>
Is that a problem?
<swedneck>
can't you just add all the files to a parent directory, and then make that directory the MFS root?
<JCaesar>
Maybe. But i'm a bit afraid of pin management and GCs.
<JCaesar>
How exactly would that look?
<JCaesar>
Where would that parent directory live?
<swedneck>
i'm talking about IPFS objects
<swedneck>
so you'd add a file to IPFS, get the CID, then add that cid to an existing IPFS directory object
<JCaesar>
Would that make for a great improvement? Somehow lessen the strain on IPFS?
<swedneck>
it would at least prevent modifying the MFS needlessly
<JCaesar>
Also, the object patch add-link magic will give me back a hash, right? What about the pin-status of that object? Can I somehow prevent IPFS from GCing it? Or, if it does get pinned, how do I prevent my little tool from leaking pins in case it or IPFS go oom the moment the pin is created?
<swedneck>
leaking pins?
<JCaesar>
"leaking pins" = Pin something and then don't remove the pin when the sync is finnished and the change is written to mfs.
<swedneck>
i don't see why you'd want to remove the pin?
<JCaesar>
several reasons. most prominently that distro mirrors are big, and add and remove files all the time. keeping old versions around pinned may not be an option due to disc space cost.
<JCaesar>
but on a smaller scale: I create objects with object patch, right? Syncs, especially the initial syncs, may be long running operations. So I'd need to pin the objects temporarily so the GC doesn't eat them, right?
<swedneck>
i mean GC isn't even enabled by default
<swedneck>
unless that has changed
<JCaesar>
Don't think so.
butcher_ has quit [Ping timeout: 246 seconds]
<JCaesar>
* but on a smaller scale: I would create objects with `object patch`, right? Syncs, especially the initial syncs, may be long running operations. So I'd need to pin the objects temporarily so the GC doesn't eat them, right?
<JCaesar>
Maybe I should occasionally close my eyes and stop worrying…
<JCaesar>
I also wonder whether I could achieve the same effect by passing `--flush=false` on all the mfs operations...
<swedneck>
that's where my knowledge ends :P
mowcat has quit [Ping timeout: 272 seconds]
Nact has quit [Read error: Connection reset by peer]
Nact has joined #ipfs
Lukas[m]1 has joined #ipfs
p8m_ has joined #ipfs
p8m has quit [Ping timeout: 272 seconds]
butcher_ has joined #ipfs
ZaZ has quit [Read error: Connection reset by peer]
bengates has quit [Remote host closed the connection]
bengates has joined #ipfs
bengates has quit [Ping timeout: 256 seconds]
<perguth>
✨
tryte has quit [Remote host closed the connection]
tryte has joined #ipfs
modul8[m] has quit [Quit: Idle for 30+ days]
ylp has quit [Quit: Leaving.]
Colpop4323 has joined #ipfs
mowcat has joined #ipfs
mikkel has quit [Ping timeout: 264 seconds]
Colpop4323 has quit [Ping timeout: 258 seconds]
mikkel has joined #ipfs
abn has quit [Ping timeout: 240 seconds]
mikkel has quit [Remote host closed the connection]
abn has joined #ipfs
mikkel has joined #ipfs
mikkel has quit [Remote host closed the connection]
mikkel has joined #ipfs
jcea has quit [Quit: jcea]
jcea has joined #ipfs
D_ has quit [Remote host closed the connection]
D_ has joined #ipfs
mikkel has quit [Ping timeout: 272 seconds]
VoiceOfReason has quit [Quit: Free ZNC ~ Powered by LunarBNC: https://LunarBNC.net]
VoiceOfReason has joined #ipfs
catonano has joined #ipfs
jessehattabaugh_ has quit [Ping timeout: 265 seconds]
jessehattabaugh_ has joined #ipfs
drathir_tor has quit [Ping timeout: 240 seconds]
supercoven_ has quit [Ping timeout: 272 seconds]
mir100 has quit [Ping timeout: 256 seconds]
<McSinyx[m]>
<JCaesar "several reasons. most prominentl"> why are you on every room (-: FYI e.g. python package index which keeps all versions of 200k+ projects only takes over 6 TB
<McSinyx[m]>
unix-like distro pkgs may be a degree larger in size, but I suppose it's not super expensive
mowcat has quit [Ping timeout: 246 seconds]
butcher_ has quit [Quit: Leaving]
butcher_ has joined #ipfs
KempfCreative1 has joined #ipfs
KempfCreative has quit [Ping timeout: 272 seconds]
KempfCreative1 is now known as KempfCreative
drathir_tor has joined #ipfs
Mateon1 has quit [Read error: Connection reset by peer]
Mateon1 has joined #ipfs
drathir_tor has quit [Quit: leaving]
Caterpillar2 is now known as Caterpillar
drathir_tor has joined #ipfs
dqx_ has joined #ipfs
maxzor has quit [Ping timeout: 264 seconds]
KempfCreative1 has joined #ipfs
KempfCreative has quit [Ping timeout: 272 seconds]