bwerthmann has quit [Remote host closed the connection]
ivo_ has quit [Ping timeout: 258 seconds]
bwerthmann has joined #ipfs
reit has joined #ipfs
bwerthmann has quit [Remote host closed the connection]
bwerthmann has joined #ipfs
ianopolous has quit [Read error: Connection reset by peer]
ianopolous has joined #ipfs
ianopolous has quit [Read error: Connection reset by peer]
ianopolous has joined #ipfs
bwerthmann has quit [Remote host closed the connection]
infinity0 has quit [Remote host closed the connection]
bwerthmann has joined #ipfs
infinity0 has joined #ipfs
bwerthmann has quit [Remote host closed the connection]
ivo_ has joined #ipfs
herzmeister has quit [Quit: Leaving]
bwerthmann has joined #ipfs
herzmeister has joined #ipfs
espadrine has quit [Ping timeout: 260 seconds]
bwerthmann has quit [Remote host closed the connection]
ebel has quit [Ping timeout: 260 seconds]
bwerthmann has joined #ipfs
bwerthmann has quit [Remote host closed the connection]
bwerthmann has joined #ipfs
bwerthmann has quit [Remote host closed the connection]
reit has quit [Ping timeout: 250 seconds]
bwerthmann has joined #ipfs
bwerthmann has quit [Remote host closed the connection]
ebel has joined #ipfs
pfrazee has joined #ipfs
f4 has joined #ipfs
infinity0 has quit [Remote host closed the connection]
pfrazee has quit [Ping timeout: 248 seconds]
infinity0 has joined #ipfs
everywhen has joined #ipfs
<kumavis[m]>
hey i have an IPLD spec question
<kumavis[m]>
when I create a base-encoded string
everywhen has quit [Ping timeout: 268 seconds]
<kumavis[m]>
the codec number should be varint encoded?
<kumavis[m]>
when I create a base-encoded string of the CID
Alaura has quit [Remote host closed the connection]
Alaura has joined #ipfs
Alaura has quit [Client Quit]
<kumavis[m]>
imassume jas
mguentner2 has quit [Ping timeout: 256 seconds]
<Akaibu>
whyrusleeping: did you see that p2p browser that showed up in the awsome iPfs issues? Haven't downloaded it but it sounds like a good step of decentralizing the net *woot*
mguentner2 has joined #ipfs
lkcl has quit [Ping timeout: 250 seconds]
Akaibu has quit []
kulelu88 has quit [Quit: Leaving]
lkcl has joined #ipfs
tilgovi has quit [Ping timeout: 245 seconds]
kzimmermann[m] has joined #ipfs
Akaibu has joined #ipfs
captain_morgan has quit [Remote host closed the connection]
Kane` has quit [Remote host closed the connection]
mguentner has quit [Ping timeout: 250 seconds]
kode54 has quit [Read error: Connection reset by peer]
Kane` has joined #ipfs
<Akaibu>
Really like the IPFS search website, whyrusleeping any possibility of making something like that built into the native binary, or maybe the webUI?
<daviddias>
kumavis[m]: \o/ rad! :D merged and released! Thank you so much for adding support to the ethereum-blocks
infinity0_ has joined #ipfs
infinity0_ has quit [Changing host]
infinity0 has joined #ipfs
infinity0_ is now known as infinity0
<daviddias>
I really like seeing the test that resolves /parent/parent :D
gully-foyle has quit [Quit: Leaving]
infinity0 has quit [Remote host closed the connection]
chris613 has quit [Quit: Leaving.]
lacour has quit [Ping timeout: 250 seconds]
pfrazee has quit [Remote host closed the connection]
infinity0 has joined #ipfs
kvda has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
ygrek has quit [Ping timeout: 260 seconds]
infinity0 has quit [Remote host closed the connection]
infinity0 has joined #ipfs
kode54 has joined #ipfs
everywhen has joined #ipfs
everywhen has quit [Ping timeout: 246 seconds]
DiCE1904 has quit [Remote host closed the connection]
DiCE1904 has joined #ipfs
reit has quit [Quit: Leaving]
soloojos has quit [Remote host closed the connection]
soloojos has joined #ipfs
webdev007 has quit [Ping timeout: 245 seconds]
sametsisartenep has quit [Quit: zzz]
webdev007 has joined #ipfs
sivachandran has joined #ipfs
konubinix has quit [Remote host closed the connection]
konubinix has joined #ipfs
sivachandran has quit [Remote host closed the connection]
jchevalay has left #ipfs [#ipfs]
jchevalay has joined #ipfs
HastaJun_ has quit [Ping timeout: 260 seconds]
pocketss has joined #ipfs
<pocketss>
hey I have been experimenting and reading up on IPFS, wanted to know the major difference between how ipfs data sharing is done vs Kademlia protocol? Could someone give me some tips?
ylp1 has joined #ipfs
infinity0 has quit [Remote host closed the connection]
infinity0 has joined #ipfs
infinity0 has quit [Remote host closed the connection]
silotis has quit [Ping timeout: 260 seconds]
infinity0 has joined #ipfs
A124 has quit [Quit: '']
silotis has joined #ipfs
<jchevalay>
i'm sorry i don't know kamadelia
A124 has joined #ipfs
<jchevalay>
but i think the goals is a same create an decentralized networks so i think it's a another way to create this
<jchevalay>
for exemple in choose of technology
sivachandran has joined #ipfs
ygrek has joined #ipfs
sivachandran has quit [Remote host closed the connection]
sivachandran has joined #ipfs
<pocketss>
jchevalay: I found a repo on ipfs saying it uses kademlia as well. Was a bit confused by this. Does IPFS use kademlia routing or has built its own from scratch
ecloud_wfh has quit [Ping timeout: 265 seconds]
<jchevalay>
i think can use somes technologies to routing (DHT)
sivachandran has quit [Remote host closed the connection]
sivachandran has joined #ipfs
<Mateon1>
pocketss: As far as I know, IPFS uses the kademlia DHT to store ipns entries and provider records (list of who has this hash)
ecloud has joined #ipfs
<pocketss>
Mateon1: Ohk, so the DHT is used to store the ipfs and ipns hash. But once thats done and we know where the data is stored/ who the provider is, then getting the data is done via?
<Mateon1>
pocketss: IPFS uses the bitswap protocol, roughly inspired by bittorrent
<pocketss>
Mateon1: I saw the ipfs-js code, which has bitswap in the components folder, but the part which actually opens a connection between the peers, transfers data and closes it, is not in the .js file
hashcore has joined #ipfs
s_kunk has quit [Ping timeout: 250 seconds]
sivachandran has quit [Remote host closed the connection]
sivachandran has joined #ipfs
ianopolous has quit [Ping timeout: 245 seconds]
<Mateon1>
pocketss: Sorry, I had to leave for a while. Look into libp2p, it's the transport layer for IPFS that supports many protocols in a modular fashion
hashcore has quit [Quit: Leaving]
<pocketss>
Mateon1: Yes I have studied libp2p and managed to setup a mesh network of 3 nodes that can communicate with each other
warner` has joined #ipfs
<pocketss>
The issue is setting up so many nodes and ensuring they communicate with each other, cause libp2p seems to require one person to *host* the connection, and one to *dial* to it.
warner has quit [Ping timeout: 245 seconds]
ygrek has quit [Ping timeout: 250 seconds]
pcre has quit [Ping timeout: 260 seconds]
pcre has joined #ipfs
sivachandran has quit [Remote host closed the connection]
<Stskeeps>
can find sources for myself knowing the tag :)
<haad>
Stskeeps: if you want to use it in your JS project, I would recommend to use https://github.com/haadcode/ipfs-daemon to get quickly started with all the needed deps
<haad>
Stskeeps: cool. let me know if you have any questions or run into problems
jvalanen has joined #ipfs
sivachandran has joined #ipfs
sivachandran has quit [Remote host closed the connection]
pp7y7 has quit []
jvalanen has quit [Ping timeout: 260 seconds]
lindybrits has joined #ipfs
<lindybrits>
Ahoy IPFS! :) Long time no problems
sivachandran has joined #ipfs
<lindybrits>
daviddias: are you in the house? :)
bullcomber has quit [Remote host closed the connection]
Malus has joined #ipfs
sivachandran has quit [Remote host closed the connection]
sivachandran has joined #ipfs
<pcre>
Sorry. I'm a noob. Lets say i have a large file on ipfs on machine A then someone copies this file on some other machine B. Now someone doanloads the file on machine C. Is this file distributed like bittorrent? Like A and B share upload?
warner` has quit [Ping timeout: 250 seconds]
sivachandran has quit [Remote host closed the connection]
fleeky has joined #ipfs
sivachandran has joined #ipfs
sivachandran has quit [Remote host closed the connection]
leob_ has quit [Ping timeout: 260 seconds]
sivachandran has joined #ipfs
sivachan_ has joined #ipfs
sivachandran has quit [Read error: Connection reset by peer]
<lindybrits>
dignifiedquire: are you in the house?
sivachan_ has quit [Read error: Connection reset by peer]
sivachandran has joined #ipfs
leob has joined #ipfs
<dignifiedquire>
hey lindybrits
<pcre>
q[-O-o]p
<lindybrits>
dignifiedquire: hope you are well! I am having problem with my code. Moved from 0.18.0 to 0.20.1 and a couple of things have changed I see.
<lindybrits>
what I am struggling with is to add a link to a node. I used addRawLink previously
sivachandran has quit [Remote host closed the connection]
sivachandran has joined #ipfs
<dignifiedquire>
doing good thanks, hope you are well to
<dignifiedquire>
what was the code you originally had?
sivachandran has quit [Ping timeout: 260 seconds]
slothbag has quit [Quit: Leaving.]
<lindybrits>
dignifiedquire: I was doing the following: ipfs.object.get(mh, (err, node) => { node.addRawLink(link) }) where link = {"name": ..., "size": ..., "hash": ...}
<lindybrits>
Now it is telling me that "addRawLink is not a function", where previously it worked fine
<Mateon1>
pcre: Yes, however right now bitswap is very inefficient and a lot of data transferred is duplicate.
<Mateon1>
Still, it works relatively well, and does share some transfer speed between nodes
<dignifiedquire>
lindybrits: right, so the dag interface changed quite a bit
<dignifiedquire>
addRawLink was merged with addLink
<dignifiedquire>
it's a helper method on the ipld-dgag-pb module
<lindybrits>
Ahh haha I wondered about that
<lindybrits>
I'll try it and get back to you
<dignifiedquire>
good luck
<Mateon1>
pcre Yeah, bitswap handles all the exchange of data, the dht handles small metadata, and pubsub does realtime communication (quite new in IPFS).
Arwalk has joined #ipfs
<lindybrits>
dignifiedquire: no luck. still telling me the function does not exist. both of the nodes are valid DAGNodes
<lindybrits>
could some of my dependencies be outdated?
<dignifiedquire>
that might be, make sure you are using the latest ipld-dag-pb
<lindybrits>
dignifiedquire: 0.9.3 for ipld-dag-pb?
bastianilso_____ has quit [Ping timeout: 265 seconds]
bastianilso_____ has joined #ipfs
pcre has quit [Ping timeout: 256 seconds]
<lindybrits>
dignifiedquire: still not a function :/
pcre has joined #ipfs
shizy has joined #ipfs
taaem has joined #ipfs
soloojos has quit [Ping timeout: 245 seconds]
<victorbjelkholm>
dignifiedquire daviddias regarding jsdoc, is there any way we can be sure the comments are actually correct? I'm thinking there has to be a way of leveraging the examples or something to create tests for us, or something like that
<victorbjelkholm>
I'm worried that it'll be hard to keep them up to date, since the only way we can verify is by looking at the comments and the code everything changes, and that includes the human factor
HastaJun_ has joined #ipfs
<lindybrits>
dignifiedquire: I resulted in using ipfs.object.patch.addLink(mh, link, (err, node) => {}). No problems and seems to work
maxlath has quit [Ping timeout: 260 seconds]
<dignifiedquire>
victorbjelkholm: there is no good working doctest module, but I might write one later down the line
<dignifiedquire>
I have also enabled linting for jsdoc comments so it validates that the comment is properly formatted and that param names match the code param names
<victorbjelkholm>
dignifiedquire: yeah, would be a nice addition, but maybe we can do something simpler if we just include assert.equals or similar in the examples, extract them and run them. Would help making sure the documentation also shows the returned values
<victorbjelkholm>
great!
<dignifiedquire>
it would actually be pretty easy to add example testing to documentation.js now that I think about it
<victorbjelkholm>
that makes me happy to hear :)
<dignifiedquire>
I might write sth next week for this
<victorbjelkholm>
woho! Let me know if I can help out
<dignifiedquire>
:) will do
<dignifiedquire>
currently the main task is still writing the actual docs, though I am getting pretty fast :)
PseudoNoob has joined #ipfs
m0ns00n_ has quit [Remote host closed the connection]
Zr90 has joined #ipfs
HastaJun__ has joined #ipfs
HastaJun_ has quit [Ping timeout: 260 seconds]
bastianilso_____ has quit [Quit: bastianilso_____]
cwahlers_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
ashark has joined #ipfs
bastianilso_____ has joined #ipfs
<seharder>
david: Good morning David, are you around?
bastianilso_____ has quit [Quit: bastianilso_____]
pfrazee has joined #ipfs
shizy has quit [Quit: WeeChat 1.6]
everywhen has joined #ipfs
ylp1 has quit [Remote host closed the connection]
ylp1 has joined #ipfs
sametsisartenep has joined #ipfs
PrinceOfPeeves has joined #ipfs
shizy has joined #ipfs
Zr90 has quit [Remote host closed the connection]
saintromuald has quit [Ping timeout: 256 seconds]
everywhen has quit [Ping timeout: 268 seconds]
saintromuald has joined #ipfs
maxlath has joined #ipfs
pfrazee has quit [Remote host closed the connection]
Oatmeal has joined #ipfs
PrinceOfPeeves has quit [Quit: Leaving]
physiology has quit [Max SendQ exceeded]
bastianilso_____ has joined #ipfs
everywhen has joined #ipfs
ylp1 has quit [Quit: Leaving.]
palkeo has joined #ipfs
iczero has joined #ipfs
<victorbjelkholm>
wking: great to see your work on depviz, amazing how fast it moves forward :)
<daviddias>
Good morning! :)
<daviddias>
Just arrived at my keyboard
<daviddias>
how are things? seharder ?
iczero is now known as wlp1s1
<victorbjelkholm>
daviddias: good morning!
<daviddias>
victorbjelkholm: I feel that has to be part of CR
pfrazee has joined #ipfs
<daviddias>
and we can start having the habit of having test files for 'interface' specifically
<victorbjelkholm>
yeah, but it's very easy to miss that compared to having something automatic to really make sure
<daviddias>
which hammer the functions with all the things that the description has, so that the possibility to create a breaking change without making those tests fail is harder
leob has quit [Ping timeout: 260 seconds]
<victorbjelkholm>
I've been part of projects where docs/code is supposed to be in sync, since docs are in the same file as the code, but it does slip through...
<victorbjelkholm>
yeah, something like that
<daviddias>
victorbjelkholm: understood and agreed
<daviddias>
did you had something special for that process?
<victorbjelkholm>
daviddias: no, just "Let's get better at reviewing that!"
<victorbjelkholm>
but I like that dignifiedquire has some ideas about it, written above
Hory_ has joined #ipfs
<daviddias>
lindybrits: I am now :) I'll be in the Pacific Time timezone until the 15th, so I might only appear later during your day
<lindybrits>
daviddias: good to know! :) FYI, for some reason I couldn't get DAGNode.addLink() to work
<daviddias>
lindybrits: do you have a gist with how you are calling it?
<lindybrits>
daviddias: I don't think so... as I don't know what a gist is haha
<seharder>
daviddias: I am able to get to the keys in the leveldb go-ipfs repo now but the values for the keys seem to be encrypted.
pcre has quit [Ping timeout: 248 seconds]
pcre has joined #ipfs
<seharder>
daviddias: as an example I see this key: /F5UXA3TTF4JCB5OTOYTDCBGWYFARRBGGIPJR4KKXVXBGOHK4C5MB47SOZHQM3LH6 with this data:Y��9_)a���˹2�R�m�Ŗke�9����
shizy has quit [Ping timeout: 250 seconds]
<seharder>
daviddias: are you familiar with how the values are encoded?
<daviddias>
lindybrits: something that I can see how you are calling the function, an example made by you or straight up a copy paste
<daviddias>
seharder: the value might actually be a serialied protobuf
<daviddias>
although a serialized protobuf shouldn't mangle it that much
pcre has quit [Read error: Connection reset by peer]
<daviddias>
whyrusleeping: thoughts?
<seharder>
I'm running this on an Ubuntu server. I will try it on my mac and see what I get.
<lindybrits>
daviddias: I will make one soon
<daviddias>
seharder: should be the same
<seharder>
daviddias: So If I created the repo with js-ipfs, the datastore folder would not be created?
<daviddias>
seharder: right now, it isn't, yes
<seharder>
And the goal of this issue is to create the datastore folder with the same leveldb database.
<daviddias>
seharder: exactly, so that we can store things like 'head of the pinset'
<seharder>
Got it!
shizy has joined #ipfs
everywhen has quit [Read error: Connection reset by peer]
everywhen has joined #ipfs
ckwaldon has quit [Ping timeout: 244 seconds]
Hory_ has quit [Read error: Connection reset by peer]
ashark has quit [Ping timeout: 260 seconds]
shizy has quit [Ping timeout: 265 seconds]
ashark has joined #ipfs
<wking>
victorbjelkholm: depviz only looks like it's moving fast because jbenet did the hard work of figuring out what we wanted ;)
<wking>
now that we're reaching the end of the mocks and need to make fresh design decisions, I expect progress to slow down :p
cwahlers has joined #ipfs
<wking>
and if you want to review/merge depviz#52 and/or depviz#57, that would help too ;)
<seharder>
daviddias: I got same results with my mac. Should we wait for Jeremy?
everywhen has quit [Ping timeout: 265 seconds]
* whyrusleeping
wonders who Jeremy is
<ansuz>
hi whyrusleeping
<whyrusleeping>
hi ansuz
<whyrusleeping>
how france today?
<whyrusleeping>
eating baguettes and cheese and drinking bad coffee?
lindybrits has quit [Quit: Page closed]
valentinjesse[m] has joined #ipfs
<seharder>
whyrusleeping: I am working on getting js-ipfs to create the leveldb store as the go-ipfs implementation does.
<seharder>
whyrusleeping: I can see the keys that are created in the store but the values are not readable
<seharder>
whyrusleeping: As an example, I see this key: /F5UXA3TTF4JCB5OTOYTDCBGWYFARRBGGIPJR4KKXVXBGOHK4C5MB47SOZHQM3LH6 with this data:Y��9_)a���˹2�R�m�Ŗke�9����
<whyrusleeping>
ok
<whyrusleeping>
whats the issue?
<seharder>
Do you know how the data is encoded?
<whyrusleeping>
probably binary
<seharder>
OK, I'll see what I can figure out. Thanks.
everywhen has quit [Read error: Connection reset by peer]
rendar has quit [Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!]
everywhen has joined #ipfs
<Kubuxu>
0.4.4 is too old, it was added today
<Kubuxu>
you need to build master to get it, or wait for 0.4.5-pre2 or rc
<Kubuxu>
IDK what is whyrusleeping's plan
<whyrusleeping>
Yeah... i wanted to release 0.4.5-pre2 today
<whyrusleeping>
and i still can, but lgierth wants to shove more stuff in 0.4.5
<whyrusleeping>
eh, i'll release another pre today
<whyrusleeping>
its not an rc or anything
ulrichard has quit [Remote host closed the connection]
mafintosh has quit [Ping timeout: 260 seconds]
saintromuald has quit [Ping timeout: 250 seconds]
saintromuald has joined #ipfs
<kevina>
whyrusleeping: so you want the repo. change to go in 0.4,5 or 0.4.6? If you are already release pre-releases it seams like a fairly major change to shove in...
<whyrusleeping>
kevina: that will be 0.4.5
<whyrusleeping>
0.4.5 adds raw-leaves and ipld stuff in general
<whyrusleeping>
so that bug will be quite annoying to have
<kevina>
what exactly did you have in mind for the test
<kevina>
add a bunch of keys with the same prefix and make sure there is more than one dir?
<whyrusleeping>
basically, yeah
<whyrusleeping>
make sure that adding a bunch of keys with a shared prefix results in moderately well distributed files on disk
<kevina>
i can easilly test the more than one dir case, not sure about how to write a test for "moderately well distributed"
<whyrusleeping>
if you add 10000 files, and your sharding with is 1000, i'd expect no directory to contain more than 2 * ( 10000 / 1000) entries or so
<jbenet>
hey pfraze -- need help on how to do this daemon thing? daviddias may be able to help, though haad may be best (he's in berlin time though)
<kevina>
whyrusleeping: my idea was something simple with just a few keys
<kevina>
whyrusleeping: all with the same prefix
<kevina>
whyrusleeping: and then test that they land in separate dirs
<Kubuxu>
fuse tests leave zombile process on my system
<Kubuxu>
* zombie
<whyrusleeping>
Kubuxu: yeap
<kevina>
whyrusleeping: what I think you want would qualify as an "expensive" test
<Kubuxu>
I wonder if updated fuselib fixes it
<whyrusleeping>
Kubuxu: they also cause my computer to hang about 15min after running
<whyrusleeping>
kevina: 10,000 entries arent super expensive
<whyrusleeping>
especially if you use a tempdir
<kevina>
but not cheap
sametsisartenep has quit [Quit: zZz]
<Kubuxu>
If i run them I can shut down cleanly
<kevina>
whyrusleeping: are you not okay with my simple idea?
<whyrusleeping>
no, because we already basically test that
<whyrusleeping>
the idea is that we're testing the intention of the change
<whyrusleeping>
the reason for us making this change is so that we can make sure that lots of entries with shared prefixes don't end up clustered in the same directory