whyrusleeping changed the topic of #ipfs to: go-ipfs 0.4.15 is out! Try out all the new features: https://dist.ipfs.io/go-ipfs/v0.4.15 | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS, the InterPlanetary FileSystem: https://github.com/ipfs/ipfs | Logs: https://botbot.me/freenode/ipfs/ | Forums: https://discuss.ipfs.io | Code of Conduct: https://git.io/vVBS0
carsonfarmer has quit [Quit: carsonfarmer]
Guest57382 has joined #ipfs
robbawebba has joined #ipfs
ericxtang has quit [Remote host closed the connection]
toxync01 has quit [Ping timeout: 240 seconds]
pnkl has quit [Ping timeout: 245 seconds]
toxync01 has joined #ipfs
hph^ has joined #ipfs
hph^ has quit [Max SendQ exceeded]
hph^ has joined #ipfs
hph^ has quit [Max SendQ exceeded]
hph^ has joined #ipfs
hph^ has quit [Max SendQ exceeded]
hph^ has joined #ipfs
hph^ has quit [Max SendQ exceeded]
hph^ has joined #ipfs
hph^ has quit [Max SendQ exceeded]
hph^ has joined #ipfs
hph^ has quit [Max SendQ exceeded]
_PiGreco_ has joined #ipfs
pcardune has quit [Remote host closed the connection]
ericxtang has joined #ipfs
_PiGreco1 has quit [Ping timeout: 264 seconds]
ericxtang has quit [Ping timeout: 260 seconds]
lanlink has quit [Quit: lanlink]
pcardune has joined #ipfs
pcardune has quit [Ping timeout: 268 seconds]
shizy has joined #ipfs
pcardune has joined #ipfs
pcardune has quit [Ping timeout: 265 seconds]
sz0 has quit [Quit: Connection closed for inactivity]
user_51 has joined #ipfs
user51 has quit [Ping timeout: 248 seconds]
dimitarvp has quit [Quit: Bye]
pcardune has joined #ipfs
pcardune has quit [Read error: Connection reset by peer]
pcardune has joined #ipfs
ericxtang has joined #ipfs
shizy has quit [Quit: WeeChat 2.1]
shizy has joined #ipfs
shizy has quit [Ping timeout: 256 seconds]
bomb-on has quit [Quit: SO LONG, SUCKERS!]
mtodor has joined #ipfs
mazeto has quit [Ping timeout: 256 seconds]
lassulus_ has joined #ipfs
ericxtang has quit [Remote host closed the connection]
lassulus has quit [Ping timeout: 260 seconds]
lassulus_ is now known as lassulus
mtodor has quit [Ping timeout: 256 seconds]
Guest57382 has quit [Ping timeout: 276 seconds]
rngkll has quit [Quit: Leaving.]
rngkll has joined #ipfs
reit has quit [Ping timeout: 265 seconds]
ericxtang has joined #ipfs
ericxtang has quit [Ping timeout: 276 seconds]
Mateon1 has joined #ipfs
mrBen2k2k2k has quit [Remote host closed the connection]
daMaestro has joined #ipfs
MrSparkle has joined #ipfs
pcardune has quit [Remote host closed the connection]
tsglove has quit [Read error: Connection reset by peer]
tsglove has joined #ipfs
muravey has joined #ipfs
muravey has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
pcardune has joined #ipfs
pcardune has quit [Ping timeout: 264 seconds]
robbawebba has quit [Quit: Leaving]
rngkll has quit [Quit: Leaving.]
ygrek has quit [Ping timeout: 240 seconds]
Alpha64_ has joined #ipfs
Alpha64 has quit [Ping timeout: 240 seconds]
Guanin has quit [Ping timeout: 248 seconds]
Fessus_ has joined #ipfs
p3t3r has quit [Ping timeout: 260 seconds]
Guanin has joined #ipfs
Fessus has quit [Ping timeout: 264 seconds]
p3t3r has joined #ipfs
carsonfarmer has joined #ipfs
Humatiel has joined #ipfs
ulrichard has joined #ipfs
jesse22 has joined #ipfs
jesse22_ has joined #ipfs
Alpha64_ has quit [Read error: Connection reset by peer]
jesse22 has quit [Ping timeout: 268 seconds]
}ls{ has quit [Quit: real life interrupt]
muravey has joined #ipfs
p3t3r has quit [Ping timeout: 264 seconds]
p3t3r has joined #ipfs
muravey has quit [Quit: Textual IRC Client: www.textualapp.com]
espadrine has quit [Ping timeout: 245 seconds]
muravey has joined #ipfs
daMaestro has quit [Quit: Leaving]
fazo96 has joined #ipfs
ylp has joined #ipfs
carsonfarmer has quit [Quit: carsonfarmer]
slashrsm has quit [Quit: ZNC - http://znc.in]
jesse22_ has quit [Ping timeout: 260 seconds]
pnkl has joined #ipfs
inetic has joined #ipfs
Fessus_ is now known as Fessus
slashrsm has joined #ipfs
slashrsm has quit [Client Quit]
slashrsm has joined #ipfs
slashrsm has quit [Client Quit]
rendar has joined #ipfs
slashrsm has joined #ipfs
slashrsm has quit [Client Quit]
mtodor has joined #ipfs
slashrsm has joined #ipfs
rubill has quit [Ping timeout: 260 seconds]
mtodor has quit [Remote host closed the connection]
rubill has joined #ipfs
cmbrnt has quit [Ping timeout: 260 seconds]
muravey has quit [Quit: Textual IRC Client: www.textualapp.com]
mtodor has joined #ipfs
pnkl has quit [Remote host closed the connection]
triston has joined #ipfs
triston has quit [Max SendQ exceeded]
triston has joined #ipfs
triston has quit [Max SendQ exceeded]
triston has joined #ipfs
p3t3r has quit [Ping timeout: 240 seconds]
clemo has joined #ipfs
p3t3r has joined #ipfs
xzha has joined #ipfs
cwahlers_ has joined #ipfs
vmx has joined #ipfs
cwahlers has quit [Ping timeout: 256 seconds]
lanlink has joined #ipfs
vmx_ has joined #ipfs
cxl000 has joined #ipfs
vmx has quit [Ping timeout: 248 seconds]
vmx_ is now known as vmx
inetic has left #ipfs [#ipfs]
Steverman has joined #ipfs
Poefke has left #ipfs [#ipfs]
pkold has joined #ipfs
pkold has quit [Quit: 离开]
bauruine has quit [Ping timeout: 248 seconds]
triston has quit [Quit: Leaving]
lanlink has quit [Ping timeout: 256 seconds]
bomb-on has joined #ipfs
fazo96_ has joined #ipfs
fazo96 has quit [Ping timeout: 260 seconds]
lanlink has joined #ipfs
lanlink has quit [Remote host closed the connection]
dimitarvp has joined #ipfs
plexigras has joined #ipfs
dethos has joined #ipfs
diemyst has joined #ipfs
Steverman has quit [Ping timeout: 264 seconds]
lanlink has joined #ipfs
Steverman has joined #ipfs
malaclyps has quit [Read error: Connection reset by peer]
malaclyps has joined #ipfs
Steverman has quit [Ping timeout: 264 seconds]
ericxtang has joined #ipfs
ericxtang has quit [Ping timeout: 248 seconds]
fazo96_ has quit [Quit: Konversation terminated!]
clemo has quit [Ping timeout: 276 seconds]
pcardune has joined #ipfs
mindCrime has joined #ipfs
clemo has joined #ipfs
}ls{ has joined #ipfs
Arsenick has quit [Read error: Connection reset by peer]
mindCrime has quit [Ping timeout: 264 seconds]
Arsenick has joined #ipfs
raynold has quit [Quit: Connection closed for inactivity]
fazo96 has joined #ipfs
Cavedude has quit [Ping timeout: 276 seconds]
bauruine has joined #ipfs
diemyst has quit [Ping timeout: 260 seconds]
MDude has quit [Ping timeout: 260 seconds]
Cavedude has joined #ipfs
bomb-on has quit [Remote host closed the connection]
mindCrime has joined #ipfs
rngkll has joined #ipfs
kkmk has joined #ipfs
kkmk has quit [Quit: kkmk]
kkmk has joined #ipfs
kkmk has quit [Client Quit]
tsglove has quit [Remote host closed the connection]
DO1MB has joined #ipfs
tsglove has joined #ipfs
user_51 has quit [Ping timeout: 256 seconds]
bomb-on has joined #ipfs
lassulus_ has joined #ipfs
lassulus has quit [Ping timeout: 260 seconds]
lassulus_ is now known as lassulus
ulrichard has quit [Remote host closed the connection]
Guest57382 has joined #ipfs
Guest57382 has quit [Client Quit]
rodolf0 has joined #ipfs
mrBen2k2k2k has joined #ipfs
matt-h has quit [Quit: Leaving]
matt-h has joined #ipfs
Steverman has joined #ipfs
Steverman has quit [Client Quit]
xzha has quit [Ping timeout: 248 seconds]
LFF^ has joined #ipfs
brianhoffman has quit [Read error: Connection reset by peer]
kompowiec2[m] has joined #ipfs
brianhoffman has joined #ipfs
<kompowiec2[m]> hey, does exists some search engine for IPFS?
vmx has quit [Ping timeout: 248 seconds]
<kompowiec2[m]> or link catalog?
ericxtang has joined #ipfs
vmx has joined #ipfs
roygbiv has joined #ipfs
Steverman has joined #ipfs
bertschneider has joined #ipfs
bomb-on has quit [Read error: Connection reset by peer]
mindCrime has quit [Ping timeout: 256 seconds]
bomb-on has joined #ipfs
ygrek has joined #ipfs
Alpha64 has joined #ipfs
parkan has joined #ipfs
xzha has joined #ipfs
jesse22 has joined #ipfs
vmx has quit [Quit: Leaving]
ericxtang has quit [Remote host closed the connection]
ericxtang has joined #ipfs
ONI_Ghost has joined #ipfs
ericxtang has quit [Remote host closed the connection]
ericxtang has joined #ipfs
lanlink_ has joined #ipfs
lanlink has quit [Ping timeout: 248 seconds]
SunflowerSociety has joined #ipfs
pvh has joined #ipfs
parkan has quit [Ping timeout: 260 seconds]
ONI_Ghost has quit [Ping timeout: 256 seconds]
ylp has quit [Quit: Leaving.]
pcardune has quit [Remote host closed the connection]
pcardune has joined #ipfs
carsonfarmer has joined #ipfs
pcardune has quit [Ping timeout: 256 seconds]
ericxtang has quit [Remote host closed the connection]
rendar has quit [Quit: Naïm Favier a.k.a. nai is f!@#in` stupid! ahah]
jesse22 has quit [Read error: Connection reset by peer]
Steverman has quit [Ping timeout: 248 seconds]
upperdeck has quit [Ping timeout: 264 seconds]
ericxtang has joined #ipfs
gabcoh has quit [Ping timeout: 260 seconds]
gabcoh has joined #ipfs
mtodor has quit [Remote host closed the connection]
jesse22 has joined #ipfs
upperdeck has joined #ipfs
gabcoh has quit [Ping timeout: 256 seconds]
gabcoh has joined #ipfs
gabcoh has quit [Ping timeout: 276 seconds]
gabcoh has joined #ipfs
gabcoh has quit [Ping timeout: 276 seconds]
gabcoh has joined #ipfs
drrty2 has joined #ipfs
Encrypt has joined #ipfs
gabcoh has quit [Ping timeout: 248 seconds]
gabcoh has joined #ipfs
gabcoh has quit [Ping timeout: 248 seconds]
gabcoh has joined #ipfs
MDude has joined #ipfs
pcardune has joined #ipfs
gabcoh has quit [Ping timeout: 248 seconds]
gabcoh has joined #ipfs
gabcoh has quit [Ping timeout: 256 seconds]
gabcoh has joined #ipfs
lanlink_ has quit [Quit: lanlink_]
Steverman has joined #ipfs
gabcoh has quit [Ping timeout: 268 seconds]
ericxtang has quit [Remote host closed the connection]
gabcoh has joined #ipfs
gabcoh has quit [Ping timeout: 268 seconds]
<kompowiec2[m]> wow thank you
fazo96 has quit [Quit: Konversation terminated!]
<Swedneck> i just searched "ipfs search" on ddg lol
gabcoh has joined #ipfs
rodolf0 has quit [Remote host closed the connection]
kkmk has joined #ipfs
rodolf0 has joined #ipfs
mindCrime has joined #ipfs
gabcoh has quit [Ping timeout: 240 seconds]
gabcoh has joined #ipfs
shizy has joined #ipfs
gabcoh has quit [Ping timeout: 245 seconds]
jesse22 has quit [Read error: Connection reset by peer]
jesse22_ has joined #ipfs
gabcoh has joined #ipfs
gabcoh has quit [Ping timeout: 248 seconds]
gabcoh has joined #ipfs
elasticdog has quit [Ping timeout: 276 seconds]
bomb-on has quit [Quit: SO LONG, SUCKERS!]
ericxtang has joined #ipfs
itsmetoo[m] has joined #ipfs
elasticdog has joined #ipfs
jesse22 has joined #ipfs
jesse22_ has quit [Ping timeout: 260 seconds]
bomb-on has joined #ipfs
plexigras has quit [Ping timeout: 256 seconds]
rodolf0 has quit [Remote host closed the connection]
rodolf0 has joined #ipfs
plexigras has joined #ipfs
Encrypt has quit [Quit: Quit]
parkan has joined #ipfs
kkmk has quit [Quit: kkmk]
roygbiv has quit [Quit: ™]
espadrine has joined #ipfs
ericxtang has quit [Remote host closed the connection]
ericxtang has joined #ipfs
Steverman has quit [Ping timeout: 268 seconds]
drrty2 has quit [Ping timeout: 265 seconds]
drrty2 has joined #ipfs
kkmk has joined #ipfs
shizy has quit [Ping timeout: 240 seconds]
kkmk has quit [Client Quit]
hovr has quit [Ping timeout: 240 seconds]
hovr has joined #ipfs
hovr has joined #ipfs
hovr has quit [Changing host]
clemo has quit [Ping timeout: 264 seconds]
ericxtang has quit [Remote host closed the connection]
shizy has joined #ipfs
brianhoffman has quit [Ping timeout: 260 seconds]
ericxtang has joined #ipfs
brianhoffman has joined #ipfs
shizy has quit [Quit: WeeChat 2.1]
<mikeal> it notes that "Merkledag/Protobuf (legacy)"
<mikeal> what does "legacy" mean?
<mikeal> and what implementation would supersede it?
<mikeal> it *looks* like it was replaced by cbor, since that is noted as the default
<mikeal> but they don't really do the same thing
<lgierth> mikeal: merkledag aka dag-pb was the very first data structure, pre-ipld -- it's the `ipfs object` datastructure (links+data), and unixfs is built on top of that
<mikeal> right, it's still in use, which is why i'm confused by the term "legacy" in this context
<lgierth> dag-pb is still there and powering unixfs, but there's a desire to replace it with a unixfs-v2
<mikeal> ok, would unixfs-v2 be built on a new dag implementation?
<lgierth> does legacy imply deprecation and having-moved-away-from-it too much? i wrote that table and couldn't come with a better word
<mikeal> and will that dag replace dag-pb?
<lgierth> probably not on a new dag
<lgierth> dag is generally links+data
<lgierth> while most ipld formats have links-in-data
<mikeal> legacy implies there is a new thing you should use instead
<lgierth> right
<lgierth> mh
<lgierth> well i'm open to suggestions :):) not a native speaker
<lemmi> call it stable. thanks to debian it has exactly the taste you are probably after :)
<mikeal> hahaha
<mikeal> or just nothing, it's essentially the same status as the rest of them
<mikeal> this table isn't specific to unixfs, so nothing that it powers the soon-to-be old unixfs isn't all that relevant
<lgierth> right
<lgierth> ok i'll also try to find a good link for unixfs-v1
jesse22 has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
jesse22 has joined #ipfs
ericxtang has quit [Remote host closed the connection]
ericxtang has joined #ipfs
rodolf0 has quit [Remote host closed the connection]
Encrypt has joined #ipfs
jesse22 has quit [Read error: Connection reset by peer]
rodolf0 has joined #ipfs
jesse22 has joined #ipfs
neuthral has joined #ipfs
jesse22 has quit [Ping timeout: 260 seconds]
rudolph has joined #ipfs
rudolph is now known as Guest45240
rodolf0 has quit [Ping timeout: 260 seconds]
jesse22 has joined #ipfs
neuthral has quit [Quit: leaving]
bomb-on has quit [Quit: SO LONG, SUCKERS!]
parkan has quit [Ping timeout: 260 seconds]
Shadow53[m] has left #ipfs ["User left"]
crptck has quit [Quit: Connection closed for inactivity]
bomb-on has joined #ipfs
Taoki has quit [Ping timeout: 240 seconds]
jesse22_ has joined #ipfs
jesse22 has quit [Read error: Connection reset by peer]
shizy has joined #ipfs
jesse22_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
shizy has quit [Ping timeout: 248 seconds]
xelra_ is now known as xelra
rngkll has quit [Quit: Leaving.]
<mikeal> i read somewhere that the IPFS and js-ipfs meeting are recorded
<mikeal> are they actually published somewhere?
atrus6 has joined #ipfs
<mikeal> thanks :)
<mikeal> question about the ipld interface
<mikeal> the links interface, it requires that all links are returned in a single array
<mikeal> i have a dataset where the links for a single level won't fit in memory
<mikeal> i'm currently building this on dag-pb and i'm just implementing my own sharding/fanout
<mikeal> but i was considering writing a new ipld format to handle it
<mikeal> but this is sort of a blocker, even if i implement the sharding internally i have to return all the links as a single array at some point
nast has joined #ipfs
brianhoffman has quit [Ping timeout: 265 seconds]
<lgierth> directory sharding / hamt
<lgierth> we had the same problem for wikipedia and npm
<lgierth> in go-ipfs you'll set Experimental.ShardingEnabled in the config, and for js-ipfs there's probably code in https://github.com/ipfs-shipyard/npm-on-ipfs
<mikeal> ya, i've seen that
<lgierth> (ah, npm-on-ipfs also just uses go-ipfs)
<lgierth> the api can stream responses, and we've been meaning to add that to the cli as well
<mikeal> for now i'll just keep plugging away on this dag-pb approach
<mikeal> i need to instrument a bulk write interface anyway, without it the writes are too slow to actually work
<lgierth> the good thing about the built-in sharding is that the path resolver and `ipfs ls` understand it ;)
<mikeal> i'm putting all the gharchive data into ipfs, with MFS it eventually takes longer than an hour to add an hour of data :)
<lgierth> ooh that stinks
<mikeal> bulk writes solve a big part of the problem, sharding solves another
<mikeal> in particular, i have sharding that detects timestamps and shards them differently than other strings
<lgierth> tried --offline and Datastore.NoSync?
<mikeal> because it's quite efficient
<lgierth> riight. yeah that makes sense i guess
<lgierth> and try the badger datastore
cxl000 has quit [Ping timeout: 255 seconds]
<lgierth> (--offline is to prevent publishing provider records from being a bottleneck)
<mikeal> i've spent a lot of time with npm data too, and this is significantly harder on IPFS :)
<mikeal> top level directory is millions of entries
<lgierth> aye
<lgierth> english wikipedia is the best we've gotten so far
<mikeal> every hour of data is hundreds of thousands of small blocks written deep into the tree
<lgierth> do you want something with NVMe storage?
<lgierth> i got this idle server
<mikeal> eventually
<mikeal> i've gotta finish this storage method first
<lgierth> :)
<mikeal> should be done some time this week
<mikeal> then i'll test it by putting all of 2018 into it
<lgierth> is this basically a webhook block per event?
<mikeal> it's about 1/2 TB of gzipped JSON
<mikeal> for the full archive
<mikeal> but it's increasing in size exponentially
<mikeal> new hours this month are almost 100megs each
<mikeal> i'm storing each JSON object as a gzipped buffer to keep the storage down
<lgierth> so we meet again, ilya grigorik
<lgierth> mikeal: does the gzipping still let you view it through ipfs.io and other gateways?
<mikeal> then stored /:owner/:repo/:timestamp and /:author/:timestamp
<mikeal> it just looks like a binary blob
<lgierth> ack
<mikeal> cbor is like 3.5x bigger
<mikeal> i ran a quick test to verify :)
<mikeal> actually, it's 3x bigger :)
<lgierth> have you encountered stuff >256KiB yet?
<mikeal> i'm not only concerned about storage in IPFS
<mikeal> i need to pull a repo's dataset into the browser at some point, so i prefer it to be smaller
<mikeal> @lgierth nope, not yet
<mikeal> I doubt there are any objects that big, especially after gzipping
mindCrime has quit [Ping timeout: 256 seconds]
<mikeal> the push events are the largest
<mikeal> and i've never seen one that big
<mikeal> @lgierth I'm Mikeal Rogers, we've met before I think :)
<mikeal> you going to be in Berlin?
<lgierth> i know who you are but i'm not sure we've met :):)
<lgierth> i live in berlin in fact!
<lgierth> definitely gonna be here for the meetings
<mikeal> hrm... were you at any of the JSConf's or CSVConf or Data Terra Nemo?
<lgierth> oh we might have met at DTN
<lgierth> that'd 3 years ago right?
<mikeal> ya, 2015
<lgierth> that's when my ipfs journey started
<mikeal> awesome :)
<lgierth> when&where
<lgierth> i fixed the wifi at the venue with jbenet
<mikeal> that was a good event
<mikeal> i'm been trying to convince Paolo to run another one
<lgierth> louisc in #dat has been pretty active in berlin
cxl000 has joined #ipfs
Encrypt has quit [Quit: Quit]
Humatiel has quit [Read error: Connection reset by peer]
xzha has quit [Ping timeout: 240 seconds]
LFF^ has quit [Ping timeout: 245 seconds]
carsonfarmer has quit [Quit: carsonfarmer]
bomb-on has quit [Quit: SO LONG, SUCKERS!]
hacman has joined #ipfs
Taoki has joined #ipfs
nast has quit [Quit: Leaving]
hacman has quit [Remote host closed the connection]
atrus6 has quit [Quit: Leaving]
cxl000 has quit [Ping timeout: 240 seconds]
testname_ has joined #ipfs
plexigras has quit [Ping timeout: 260 seconds]
dethos has quit [Ping timeout: 268 seconds]
cxl000 has joined #ipfs
Taoki has quit [Ping timeout: 240 seconds]
cxl000 has quit [Client Quit]
Taoki has joined #ipfs
DO1MB has quit [Quit: http://quassel-irc.org - Chat comfortably. Anywhere.]
user51 has joined #ipfs
user51 has quit [Client Quit]
user_51 has joined #ipfs
astrofog has joined #ipfs
upperdeck has quit [Quit: ZNC 1.7.0 - https://znc.in]
Steverman has joined #ipfs
astrofog has quit [Quit: Quite]
rngkll has joined #ipfs
bomb-on has joined #ipfs
kaotisk has quit [Ping timeout: 264 seconds]
Steverman has quit [Ping timeout: 240 seconds]
Guest45240 has quit [Ping timeout: 276 seconds]
wolfen has joined #ipfs
wolfen has quit [Read error: Connection reset by peer]
clemo has joined #ipfs
jatayu[m] has joined #ipfs
ericxtang has quit [Remote host closed the connection]
<malaclyps> if anyone here was from IPFS/Protocol Labs and was at Mozilla party last week, say hi from me -- I'm Danny from EFF, and I really wanted to talk to them, but just at the moment they came over, I heard that my laptop bag had disappeared!
<malaclyps> i found it at security, but missed them!
<lgierth> ah hey danny o/ i wasn't there but we met in january - i'm lars, we went from EFF to IA friday lunch together
<malaclyps> hey lars! i'm in Brussels right now, fighting this dumb copyright directive
<lgierth> godspeed friend!
<lgierth> i signed yesterday
dethos has joined #ipfs
rodolf0 has joined #ipfs
rudolph has joined #ipfs
rudolph is now known as Guest91972
ygrek has quit [Ping timeout: 264 seconds]