stebalien changed the topic of #ipfs to: Heads Up: To talk, you need to register your nick! Announcements: go-ipfs 0.5.1 and js-ipfs 0.43.1 are out! Get them from dist.ipfs.io and npm respectively! | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS: https://github.com/ipfs/ipfs | Logs: https://view.matrix.org/room/!yhqiEdqNjyPbxtUjzm:matrix.org/ | Forums: https://discuss.ipfs.io | Code of Conduct: https://git.io/vVBS0
catonano_ has joined #ipfs
midgard has quit [Read error: Connection reset by peer]
midgard has joined #ipfs
catonano has quit [Ping timeout: 246 seconds]
catonano_ is now known as catonano
Oatmeal has quit [Ping timeout: 258 seconds]
catonano has quit [Read error: Connection reset by peer]
catonano_ has joined #ipfs
_jrjsmrtn has joined #ipfs
__jrjsmrtn__ has quit [Ping timeout: 256 seconds]
_whitelogger has joined #ipfs
Oatmeal has joined #ipfs
cipres has quit [Ping timeout: 240 seconds]
KempfCreative has joined #ipfs
Belkaar has quit [Ping timeout: 240 seconds]
Belkaar has joined #ipfs
Belkaar has joined #ipfs
lain`2 has joined #ipfs
lain` has quit [Ping timeout: 256 seconds]
lain`2 is now known as lain`
stoopkid has joined #ipfs
user_51 has joined #ipfs
user_51_ has quit [Ping timeout: 260 seconds]
thefinn93 has joined #ipfs
jcea has quit [Quit: jcea]
thefinn93 has quit [Quit: WeeChat 2.9]
thefinn93 has joined #ipfs
jamiew has quit [Ping timeout: 240 seconds]
jamiew has joined #ipfs
psyk has joined #ipfs
jrt is now known as Guest53513
Guest53513 has quit [Killed (tepper.freenode.net (Nickname regained by services))]
jrt has joined #ipfs
Jeanne-Kamikaze has joined #ipfs
ipfs-stackbot has quit [Remote host closed the connection]
ipfs-stackbot has joined #ipfs
Bushwhacker[m] has joined #ipfs
zeden_ has quit [Quit: WeeChat 2.9]
KempfCreative has quit [Ping timeout: 246 seconds]
Mukayu has joined #ipfs
Mukayu has left #ipfs [#ipfs]
Nact has quit [Quit: Konversation terminated!]
GuerrillaMonkey has joined #ipfs
Jeanne-Kamikaze has quit [Ping timeout: 256 seconds]
gimzmoe_ has quit [Ping timeout: 256 seconds]
twistedline has quit [Remote host closed the connection]
twistedline_ has joined #ipfs
john2gb has quit [Quit: john2gb]
Mukayu has joined #ipfs
RzR has quit [Ping timeout: 260 seconds]
john2gb has joined #ipfs
Mukayu has left #ipfs [#ipfs]
Muukayuu has joined #ipfs
Muukayuu has quit [Quit: WeeChat 2.9]
Muukaayuu has joined #ipfs
Muukaayuu has left #ipfs [#ipfs]
GuerrillaMonkey has quit [Quit: Leaving]
RzR has joined #ipfs
frogar has quit [Remote host closed the connection]
frogar has joined #ipfs
john2gb has quit [Quit: john2gb]
MrAureliusR has quit [Quit: ZNC - https://znc.in]
jesse22 has joined #ipfs
MrAureliusR has joined #ipfs
Muukaayuu has joined #ipfs
Muukaayuu has quit [Quit: WeeChat 2.9]
Encrypt has quit [Ping timeout: 260 seconds]
tedious has joined #ipfs
tedious has quit [K-Lined]
stoopkid has quit [Quit: Connection closed for inactivity]
zhoreeq[m] has joined #ipfs
bengates has joined #ipfs
Bushwhacker[m] has left #ipfs ["User left"]
i9zO5AP has quit [Remote host closed the connection]
i9zO5AP has joined #ipfs
Bushwhacker[m] has joined #ipfs
tsrt^ has quit []
pecastro has joined #ipfs
endvra has quit [Read error: Connection reset by peer]
endvra has joined #ipfs
i9zO5AP has quit [Remote host closed the connection]
i9zO5AP has joined #ipfs
FennecCode has quit [Ping timeout: 272 seconds]
Oatmeal has quit [Quit: Suzie says, "TTFNs!"]
dethos has joined #ipfs
r_d[m] has quit [Quit: Idle for 30+ days]
TraderOne has quit [Quit: Idle for 30+ days]
aniketd[m] has quit [Quit: Idle for 30+ days]
QuantumWings[m] has left #ipfs ["Kicked by @appservice-irc:matrix.org : Idle for 30+ days"]
requiredtruth[m] has left #ipfs ["Kicked by @appservice-irc:matrix.org : Idle for 30+ days"]
axod[m] has quit [Quit: Idle for 30+ days]
Vishnu[m] has quit [Quit: Idle for 30+ days]
CringePirate[m] has quit [Quit: Idle for 30+ days]
ab[m] has left #ipfs ["Kicked by @appservice-irc:matrix.org : Idle for 30+ days"]
FennecCode has joined #ipfs
lord| has quit [Ping timeout: 256 seconds]
lord| has joined #ipfs
MrSprinkles has joined #ipfs
MrSparkle has quit [Ping timeout: 258 seconds]
Ecran10 has joined #ipfs
FennecCode has quit [Ping timeout: 244 seconds]
spinza has quit [Ping timeout: 240 seconds]
FennecCode has joined #ipfs
ylp has joined #ipfs
john2gb has joined #ipfs
hellpup has joined #ipfs
catonano_ has quit [Quit: catonano_]
catonano has joined #ipfs
ipfs-stackbot2 has joined #ipfs
midgard has quit [Ping timeout: 272 seconds]
ipfs-stackbot has quit [Ping timeout: 258 seconds]
midgard has joined #ipfs
spinza has joined #ipfs
cipres has joined #ipfs
KempfCreative has joined #ipfs
zeden has joined #ipfs
cepmee_69[m] has joined #ipfs
jcea has joined #ipfs
snackoverflow[m] has joined #ipfs
MrSprinkles has quit [Quit: MrSprinkles]
MrSparkle has joined #ipfs
Acacia has quit [Ping timeout: 260 seconds]
nullheroes has quit [Quit: WeeChat 2.9]
kdlv has joined #ipfs
vivus has joined #ipfs
Ecran10 has quit [Quit: Going offline, see ya! (www.adiirc.com)]
kdlv has quit [Remote host closed the connection]
Acacia has joined #ipfs
<georgyo[m]> I have a map tile server in IPFS, in it there are about 43k images in one directory.
<georgyo[m]> If you do an `ipfs ls /ipns/uap.fu.io/Images` it will download 400MB locally and take over 10 minutes
<georgyo[m]> Even at ~43k files, that seems a bit excessive
<georgyo[m]> It doesn't effect normal usage, so looking at https://uap.fu.io/ works just fine.
<georgyo[m]> * It doesn't affect normal usage, so looking at https://uap.fu.io/ works just fine.
kyoo[m] has joined #ipfs
vivus has quit [Quit: Leaving]
<georgyo[m]> Is this considered a bug?
<swedneck> taking 10 minutes doesn't seem too extraordinary, but 400MB seems.. weird
<swedneck> then again, 43k files..
<georgyo[m]> It would imply a little about 9kB of metadata per file.
<georgyo[m]> * It would imply about 9kB of metadata per file.
<georgyo[m]> Only about 23k of those are unique, many of them are exactly the same black square for places that fall off the rendered map.
<georgyo[m]> But IPFS does dedup that kind of thing.
<swedneck> okay so, `ipfs object links /ipfs/bafybeie2mcjgb73jfwxblvkybzokxlgvxb7wkoywc53ovorm3acw37n76m` works fine
<swedneck> (that's /ipns/uap.fu.io/Images)
<georgyo[m]> Indeed, I pinned it in parallel using
<georgyo[m]> ```(ipfs object links bafybeie2mcjgb73jfwxblvkybzokxlgvxb7wkoywc53ovorm3acw37n76m | while read link size subdir; echo $link; done) | xargs -n 1 -P 8 ipfs pin```
<georgyo[m]> But still, I wouldn't expect an LS to download 400MB of metadata
<swedneck> yeah i can't see why that'd happen
Nact has joined #ipfs
<georgyo[m]> Does every file have it's own metadata object in directory listings? And as such, an LS is fetching ~43k individual chunks of meta data?
<georgyo[m]> * Does every file have it's own metadata object in directory listings? And as such, an LS is fetching ~43k individual chunks of metadata?
<swedneck> hmm, i don't believe there are "metadata objects"
<swedneck> i suppose the 400MB could be because the node has to download all but the final objects?
Acacia has quit [Ping timeout: 272 seconds]
Acacia has joined #ipfs
KempfCreative1 has joined #ipfs
KempfCreative has quit [Ping timeout: 265 seconds]
KempfCreative1 is now known as KempfCreative
Acacia has quit [Client Quit]
gimzmoe has joined #ipfs
john2gb has quit [Remote host closed the connection]
psyk has quit [Remote host closed the connection]
ipfs-stackbot2 has quit [Remote host closed the connection]
ylp has quit [Quit: Leaving.]
ipfs-stackbot has joined #ipfs
Acacia has joined #ipfs
bengates has quit [Remote host closed the connection]
bengates has joined #ipfs
Acacia has quit [Read error: Connection reset by peer]
Newami has joined #ipfs
bengates has quit [Ping timeout: 260 seconds]
Newami has quit [Remote host closed the connection]
Acacia has joined #ipfs
stoopkid has joined #ipfs
XORed has quit [Ping timeout: 240 seconds]
XORed has joined #ipfs
<ipfsbot> Michael Parkhurst @qdpie posted in I can't add large files to IPFS - https://discuss.ipfs.io/t/i-cant-add-large-files-to-ipfs/8972/1
jesse22 has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
jesse22 has joined #ipfs
Polemos_ has joined #ipfs
Polemos__ has joined #ipfs
Polemos_ has quit [Remote host closed the connection]
dqx_ has joined #ipfs
cipres has quit [Ping timeout: 256 seconds]
john2gb has joined #ipfs
ntwaaci^ has joined #ipfs
Acacia has quit [Read error: Connection reset by peer]
Acacia has joined #ipfs
cipres has joined #ipfs
<ipfsbot> Todd Foreman @Bull posted in Question: Repetitive, probably - I cannot start IPFS desktop (Directory Missing Sharding File) - https://discuss.ipfs.io/t/question-repetitive-probably-i-cannot-start-ipfs-desktop-directory-missing-sharding-file/8974/1
stoopkid has quit [Quit: Connection closed for inactivity]
john2gb has quit [Remote host closed the connection]
nullheroes has joined #ipfs
Ecran10 has joined #ipfs
john2gb has joined #ipfs
RzR has quit [Changing host]
RzR has joined #ipfs
swills has joined #ipfs
Polemos__ has quit [Quit: Leaving]
<aschmahmann[m]> georgyo: in order to know whether a given object is a file or directory (as well as the UnixFS reported file size) the root block of that object needs to be fetched too. There are flags you can pass to turn that off. You can pass `--resolve-type = false` and `--size = false`
cipres has quit [Ping timeout: 256 seconds]
rodolf0 has joined #ipfs
rodolf0 has quit [Client Quit]
rodolf0 has joined #ipfs
rodolf0 has quit [Client Quit]
maxzor has joined #ipfs
cipres has joined #ipfs
Encrypt has joined #ipfs
stoopkid has joined #ipfs
trilliaris has joined #ipfs
KempfCreative has quit [Ping timeout: 240 seconds]
cipres has quit [Ping timeout: 240 seconds]
john2gb has quit [Remote host closed the connection]
cipres has joined #ipfs
dethos has quit [Ping timeout: 258 seconds]
Ecran10 has quit [Read error: Connection reset by peer]
Ecran10 has joined #ipfs
lain` has quit [Quit: Ping timeout (120 seconds)]
lain` has joined #ipfs
ipfs-stackbot2 has joined #ipfs
ericnoan has quit [Ping timeout: 258 seconds]
ipfs-stackbot has quit [Ping timeout: 258 seconds]
ericnoan has joined #ipfs
ericnoan has quit [Ping timeout: 258 seconds]
erikj has quit [Ping timeout: 260 seconds]
ericnoan has joined #ipfs
nimaje has quit [Quit: WeeChat 2.9]
nimaje has joined #ipfs
<ipfsbot> @reload posted in Galacteek 0.4.32 released - https://discuss.ipfs.io/t/galacteek-0-4-32-released/8975/1
cipres has quit [Ping timeout: 265 seconds]
pecastro has quit [Ping timeout: 265 seconds]
ntwaaci^ has quit []
tsrt^ has joined #ipfs
Ecran10 has quit [Quit: Going offline, see ya! (www.adiirc.com)]
trilliaris has quit [Quit: Leaving.]
Taoki has joined #ipfs
stoopkid has quit [Quit: Connection closed for inactivity]
jesse22 has quit [Ping timeout: 244 seconds]
system[m]1 has joined #ipfs
erikj has joined #ipfs