whyrusleeping changed the topic of #ipfs to: Release Candidate 2 of go-ipfs v0.4.3 has been released, available at https://dist.ipfs.io -- IPFS - InterPlanetary File System -- https://github.com/ipfs/ipfs -- FAQ: https://git.io/voEh8 -- Channel logs: https://botbot.me/freenode/ipfs/ -- Code of Conduct: https://git.io/vVBS0 -- Sprints: https://git.io/voEAh
matoro has joined #ipfs
anonymuse has joined #ipfs
cemerick has joined #ipfs
ghtdak has quit [Quit: WeeChat 1.3]
rgrinberg has joined #ipfs
computerfreak has quit [Remote host closed the connection]
kerozene has joined #ipfs
rgrinberg has quit [Ping timeout: 244 seconds]
f[x] has quit [Ping timeout: 258 seconds]
jgantunes has quit [Quit: Connection closed for inactivity]
anonymuse has quit [Remote host closed the connection]
anonymuse has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
taaem has quit [Read error: Connection reset by peer]
wallacoloo has quit [Quit: wallacoloo]
taaem has joined #ipfs
mgue has quit [Ping timeout: 276 seconds]
cwahlers has quit [Read error: Connection reset by peer]
taaem has quit [Remote host closed the connection]
taaem has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
mgue has joined #ipfs
kants has joined #ipfs
apiarian has quit [Ping timeout: 240 seconds]
apiarian has joined #ipfs
JesseW has joined #ipfs
cwahlers has joined #ipfs
apiarian has quit [Ping timeout: 244 seconds]
apiarian has joined #ipfs
anonymuse has quit [Remote host closed the connection]
mgue has quit [Quit: WeeChat 1.5]
krs93 has joined #ipfs
mgue has joined #ipfs
krs93 has quit [Quit: Leaving]
[1]bussiere has joined #ipfs
galois_d_ has joined #ipfs
dd[m] has quit [Ping timeout: 250 seconds]
M-edrex has quit [Ping timeout: 250 seconds]
M-jimt has quit [Ping timeout: 250 seconds]
cemerick has quit [Ping timeout: 276 seconds]
M-edrex has joined #ipfs
dd[m] has joined #ipfs
M-jimt has joined #ipfs
M-Guillaume1 has joined #ipfs
vikneshwaren[m]1 has joined #ipfs
Guest26812[m]1 has joined #ipfs
hermann-tab[m]1 has joined #ipfs
Guest346811 has joined #ipfs
M-37981 has joined #ipfs
PalTale has quit [Ping timeout: 250 seconds]
M22536[m] has quit [Ping timeout: 250 seconds]
dudezer0_bot[m] has quit [Ping timeout: 250 seconds]
trytrytry[m]1 has joined #ipfs
zamabe1 has joined #ipfs
arkadiy[m] has quit [Ping timeout: 250 seconds]
M-pieohpah has quit [Ping timeout: 250 seconds]
alistair77[m] has quit [Ping timeout: 250 seconds]
M6e7961[m] has quit [Ping timeout: 250 seconds]
ntninja[m] has quit [Ping timeout: 250 seconds]
erikj` has quit [Ping timeout: 250 seconds]
martinBrown has quit [Ping timeout: 250 seconds]
mikolalysenko_ has joined #ipfs
warner` has joined #ipfs
M-boli has quit [Ping timeout: 250 seconds]
warner has quit [Ping timeout: 250 seconds]
M-erwin has quit [Ping timeout: 250 seconds]
robogoat_ has joined #ipfs
locusf_ has joined #ipfs
onic[m] has quit [Ping timeout: 250 seconds]
Confiks_ has joined #ipfs
martinBrown has joined #ipfs
ajp_ has joined #ipfs
vasachi[m]1 has joined #ipfs
M-GereG1 has joined #ipfs
H3g3m0n[m]1 has joined #ipfs
Jellybeanmommy[4 has joined #ipfs
M22536[m] has joined #ipfs
Akaibu_ has joined #ipfs
M-jh1 has joined #ipfs
cehteh has quit [Ping timeout: 276 seconds]
damongant has quit [Ping timeout: 276 seconds]
PalTale has joined #ipfs
Guest34681 has quit [Ping timeout: 258 seconds]
M-Guillaume has quit [Ping timeout: 258 seconds]
mikolalysenko has quit [Ping timeout: 258 seconds]
hermann-tab[m] has quit [Ping timeout: 258 seconds]
trytrytry[m] has quit [Ping timeout: 258 seconds]
vikneshwaren[m] has quit [Ping timeout: 258 seconds]
M-3798 has quit [Ping timeout: 258 seconds]
Guest26812[m] has quit [Ping timeout: 258 seconds]
eternaleye has quit [Ping timeout: 258 seconds]
voldyman has quit [Ping timeout: 258 seconds]
H3g3m0n[m] has quit [Ping timeout: 258 seconds]
M-jh has quit [Ping timeout: 258 seconds]
Jellybeanmommy[m has quit [Ping timeout: 258 seconds]
vasachi[m] has quit [Ping timeout: 258 seconds]
M-GereG has quit [Ping timeout: 258 seconds]
jamespedwards42[ has quit [Ping timeout: 258 seconds]
jhiesey has quit [Ping timeout: 258 seconds]
Leer10[m] has quit [Ping timeout: 258 seconds]
Guest22220[m] has quit [Ping timeout: 258 seconds]
qwertyuioppo[m] has quit [Ping timeout: 258 seconds]
M-4485 has quit [Ping timeout: 258 seconds]
M-2617 has quit [Ping timeout: 258 seconds]
Guest22926[m] has quit [Ping timeout: 258 seconds]
mafintosh has quit [Ping timeout: 258 seconds]
ec has quit [Ping timeout: 258 seconds]
henriquev has quit [Ping timeout: 258 seconds]
mgue has quit [Ping timeout: 258 seconds]
Akaibu has quit [Ping timeout: 258 seconds]
koshii has quit [Ping timeout: 258 seconds]
M-cyan has quit [Ping timeout: 258 seconds]
M-16865 has quit [Ping timeout: 258 seconds]
pik[m] has quit [Ping timeout: 258 seconds]
naggie[m] has quit [Ping timeout: 258 seconds]
seg_violation has quit [Ping timeout: 258 seconds]
tibor has quit [Ping timeout: 258 seconds]
robogoat has quit [Ping timeout: 258 seconds]
nullstyle has quit [Ping timeout: 258 seconds]
locusf has quit [Ping timeout: 258 seconds]
M-HirmeS has quit [Ping timeout: 258 seconds]
M-bp51 has quit [Ping timeout: 258 seconds]
galois_dmz has quit [Ping timeout: 258 seconds]
Soft has quit [Ping timeout: 258 seconds]
Guest28905[m] has quit [Ping timeout: 258 seconds]
M18695[m] has quit [Ping timeout: 258 seconds]
timthelion[m] has quit [Ping timeout: 258 seconds]
Patrik[m] has quit [Ping timeout: 258 seconds]
M-toor has quit [Ping timeout: 258 seconds]
bussiere has quit [Ping timeout: 258 seconds]
zamabe has quit [Ping timeout: 258 seconds]
sega01 has quit [Ping timeout: 258 seconds]
vladimir-sn has quit [Ping timeout: 258 seconds]
unforgiven512_ has quit [Ping timeout: 258 seconds]
zrl has quit [Ping timeout: 258 seconds]
jryans has quit [Ping timeout: 258 seconds]
geoah has quit [Ping timeout: 258 seconds]
M-HirmeS1 has joined #ipfs
ajp has quit [Ping timeout: 258 seconds]
xicombd has quit [Ping timeout: 258 seconds]
Guest28775[m] has quit [Ping timeout: 258 seconds]
jackyquack[m] has quit [Ping timeout: 258 seconds]
steven[m] has quit [Ping timeout: 258 seconds]
M-7416 has quit [Ping timeout: 258 seconds]
palesz[m] has quit [Ping timeout: 258 seconds]
M-3714 has quit [Ping timeout: 258 seconds]
M-mubot has quit [Ping timeout: 258 seconds]
Remram[m] has quit [Ping timeout: 258 seconds]
M-trashrabbit has quit [Ping timeout: 258 seconds]
bauruine has quit [Ping timeout: 258 seconds]
Confiks has quit [Ping timeout: 258 seconds]
dyce_ has quit [Ping timeout: 258 seconds]
opal has quit [Ping timeout: 258 seconds]
todder has quit [Ping timeout: 258 seconds]
[1]bussiere is now known as bussiere
M18695[m]1 has joined #ipfs
Patrik[m] has joined #ipfs
M-bp51 has joined #ipfs
timthelion[m] has joined #ipfs
naggie[m] has joined #ipfs
M-cyan has joined #ipfs
M-toor has joined #ipfs
pik[m] has joined #ipfs
M-16865 has joined #ipfs
Guest28905[m] has joined #ipfs
M6e7961[m] has joined #ipfs
M-4485 has joined #ipfs
Guest22220[m] has joined #ipfs
Leer10[m] has joined #ipfs
qwertyuioppo[m] has joined #ipfs
jamespedwards42[ has joined #ipfs
Remram[m] has joined #ipfs
M-3714 has joined #ipfs
Guest22926[m] has joined #ipfs
dyce has joined #ipfs
M-2617 has joined #ipfs
jackyquack[m] has joined #ipfs
palesz[m] has joined #ipfs
M-7416 has joined #ipfs
steven[m] has joined #ipfs
vladimir-sn has joined #ipfs
Guest28775[m] has joined #ipfs
M-trashrabbit has joined #ipfs
M-mubot has joined #ipfs
eternaleye has joined #ipfs
M-boli has joined #ipfs
Akaibu_ is now known as Akaibu
Soft has joined #ipfs
mgue has joined #ipfs
bauruine has joined #ipfs
voldyman has joined #ipfs
opal has joined #ipfs
todder has joined #ipfs
dudezer0_bot[m] has joined #ipfs
koshii has joined #ipfs
seg_violation has joined #ipfs
arkadiy[m] has joined #ipfs
zamabe1 is now known as zamabe
unforgiven512 has joined #ipfs
M-pieohpah has joined #ipfs
alistair77[m] has joined #ipfs
ntninja[m] has joined #ipfs
erikj` has joined #ipfs
damongant has joined #ipfs
mikolalysenko_ is now known as mikolalysenko
M-erwin has joined #ipfs
nullstyle has joined #ipfs
onic[m] has joined #ipfs
tibor has joined #ipfs
ec has joined #ipfs
geoah has joined #ipfs
mafintosh has joined #ipfs
sega01 has joined #ipfs
jhiesey has joined #ipfs
xicombd has joined #ipfs
jryans has joined #ipfs
zrl has joined #ipfs
henriquev has joined #ipfs
<baffo32> ok, so I have no peers
<baffo32> I type `ipfs swarm connect /ip4/54.236.205.6/tcp/4001`, but it spews out "Error: invalid peer address: invalid ipfs address"
<baffo32> what's the valid form for an ipfs address?
<baffo32> ah found --help ;p sorry
ec is now known as Pyrrh^
infinity0 has quit [Remote host closed the connection]
infinity0 has joined #ipfs
reit has quit [Quit: Leaving]
cehteh has joined #ipfs
seagreen has quit [Ping timeout: 250 seconds]
Pyrrh^ is now known as ELLIOTTCABLE
doesntgolf has quit [Ping timeout: 276 seconds]
seagreen has joined #ipfs
<baffo32> hrm ipfs isn't working for me
<baffo32> I add my file, and then ipfs.io won't give it back to me
<JesseW> baffo32: that can take a little while
<JesseW> for your node to get sufficiently hooked up for the gateway (ipfs.io) to see it
<baffo32> it seems the problem was with running Tor on the same box ... after quitting Tor, things worked
<JesseW> interesting
<JesseW> Can someone give me an example peerID that actually returns data when used with, say, `ipfs dht query`?
<JesseW> none of the ones I've tried so far seem to do so
<deltab> including the bootstrap nodes listed in the config?
<JesseW> hm, good idea
<JesseW> yep
<JesseW> One of the bootstrap nodes is: /ip4/178.62.61.185/tcp/4001/ipfs/QmSoLMeWqB7YGVLJN3pNLQpmmEk35v6wYtsMGLzSr5QBU3
<JesseW> Running `ipfs dht query QmSoLMeWqB7YGVLJN3pNLQpmmEk35v6wYtsMGLzSr5QBU3` gives me no output.
okek has quit [Remote host closed the connection]
keko has joined #ipfs
keko is now known as Guest61064
Guest61064 is now known as keko_
JesseW has quit [Ping timeout: 264 seconds]
chris613 has quit [Quit: Leaving.]
warner` is now known as warner
chadoh has joined #ipfs
chadoh has quit [Ping timeout: 252 seconds]
mgue has quit [Ping timeout: 252 seconds]
mgue has joined #ipfs
wallacoloo has joined #ipfs
reit has joined #ipfs
crackhead has joined #ipfs
<crackhead> My imaginary friend thinks you have serious mental problems.
<crackhead> My imaginary friend thinks you have serious mental problems.
<crackhead> My imaginary friend thinks you have serious mental problems.
<crackhead> My imaginary friend thinks you have serious mental problems.
<crackhead> My imaginary friend thinks you have serious mental problems.
<crackhead> My imaginary friend thinks you have serious mental problems.
wallacoloo has quit [Ping timeout: 260 seconds]
crackhead has quit [Killed (Sigyn (Spam is off topic on freenode.))]
wallacoloo has joined #ipfs
Foxcool has joined #ipfs
devbug has joined #ipfs
wallacoloo has quit [Ping timeout: 276 seconds]
rendar has joined #ipfs
chadoh has joined #ipfs
chadoh has quit [Ping timeout: 240 seconds]
<geoah> heh, querying the DHT as per JesseW's example does something weird, 1st call returns 16 results, 2nd returns 7, 3rd returns 3, 4th returns 2 and from then all calls return 0 results until you restart the daemon :P
<Kubuxu> cr[m]:
<Kubuxu> sorry
cyberwolf has joined #ipfs
cyberwolf has quit [Client Quit]
cyberwolf has joined #ipfs
guest22 has joined #ipfs
<geoah> Good morning Kubuxu :)
cyberwolf has quit [Client Quit]
guest22 has quit [Client Quit]
<Kubuxu> Good morning
corvinux has joined #ipfs
Encrypt has joined #ipfs
kerozene has quit [Ping timeout: 244 seconds]
santamanno has joined #ipfs
infinity0 has quit [Remote host closed the connection]
kerozene has joined #ipfs
infinity0 has joined #ipfs
mvorg has joined #ipfs
devbug has quit [Quit: ZZZzzz…]
f[x] has joined #ipfs
espadrine has joined #ipfs
chadoh has joined #ipfs
corvinux has quit [Quit: Leaving]
tmg has joined #ipfs
corvinux has joined #ipfs
chadoh has quit [Ping timeout: 260 seconds]
f[x] has quit [Ping timeout: 276 seconds]
ianopolous has quit [Ping timeout: 276 seconds]
ianopolous has joined #ipfs
compleatang has joined #ipfs
compleatang has quit [Client Quit]
zz_r04r is now known as r04r
hobofan has joined #ipfs
cketti has joined #ipfs
cketti has quit [Changing host]
cketti has joined #ipfs
chadoh has joined #ipfs
chadoh has quit [Ping timeout: 244 seconds]
taaem has quit [Remote host closed the connection]
computerfreak has joined #ipfs
Encrypt has quit [Quit: Lunch time!]
kants has quit [Quit: sleep.]
locusf_ is now known as locusf
apiarian has quit [Ping timeout: 240 seconds]
apiarian has joined #ipfs
zorglub27 has joined #ipfs
Tsutsu has joined #ipfs
doesntgolf has joined #ipfs
computerfreak has quit [Remote host closed the connection]
apiarian has quit [Ping timeout: 250 seconds]
apiarian has joined #ipfs
<victorbjelkholm> daviddias, dignifiedquire, just pulled down latest master of js-ipfs and tried running the tests, get "SyntaxError: Unexpected token 'const'" from the browser tests
<daviddias> victorbjelkholm: are you using npm3?
<victorbjelkholm> daviddias, yup
<daviddias> weird
<daviddias> chrome tests?
<victorbjelkholm> seems like the webkit version phantomjs is using (for me at least) does not support const
<daviddias> or PhantomJS? It should have transpiled for ES5 code
<victorbjelkholm> browser tests, inside phantomjs: "at webpack:///~/interface-ipfs-core/src/block.js:6:0 <- test/browser.js:172409"
<daviddias> do you have phantomJS installed globally?
<victorbjelkholm> hm, might have
<daviddias> which aegir version are you using?
<victorbjelkholm> yeah, phantomjs is global
<daviddias> yeah, better make it local
<victorbjelkholm> aegir is 6.0.1, just did a fresh install of everything including dependencies
<victorbjelkholm> alright, I'll try that
harleyk has quit [Ping timeout: 276 seconds]
hobofan has quit [Quit: Lost terminal]
Tsutsu has left #ipfs [#ipfs]
Encrypt has joined #ipfs
<victorbjelkholm> daviddias, tried again, uninstalling my global phantomjs and reinstalling dependencies, still same error...
<daviddias> ok, doing a full clean clone and fresh install myself
<victorbjelkholm> daviddias, took a look at the CIs as well (travis and circleci), both are failing with the same error, seems to be an issue in master
<daviddias> got it!
<victorbjelkholm> daviddias, seems to be regarding feat/generic-spec-compliant because master was passing before merging that
<daviddias> yeah
<daviddias> when I did the last PR to interface-ipfs-core
<daviddias> I missed changing this
<daviddias> back to lib
<daviddias> so it was trying to use code that was not transpiled
<daviddias> just released the fix
<daviddias> a clean npm install should do the trick
harleyk has joined #ipfs
<victorbjelkholm> daviddias, sweet, thanks
chadoh has joined #ipfs
tmg has quit [Quit: leaving]
fleeky__ is now known as fleeky
<dignifiedquire> daviddias: while you are at it, could you fix spdy please? :P
<daviddias> it is my priority right now
<daviddias> I would appreciate the extra pair of eyes trying to figure it out
<daviddias> it is a massive blocker and a very tricky thing
<dignifiedquire> just been looking at it
seppellll has joined #ipfs
<dignifiedquire> and it's starting to annoy the heck out of me
martinkl_ has joined #ipfs
<dignifiedquire> daviddias: so I found out the following:
<dignifiedquire> - there is no infinite loop or sth like that, taking a javascript profile after it starts hanging shows the js being fully idle
<dignifiedquire> - starting at 10 they hang after a while, the amount of messages processed before decreases until limit 100 (the test spawns up to a 100 streams)
<dignifiedquire> - limiting the spawning to 1-9 makes the tests pass
<dignifiedquire> - using stream-pair wrapped in toPull shows the exact same issue, that means pull-pair is not the source of the issue
doesntgolf has quit [Ping timeout: 240 seconds]
<daviddias> so, we know that over Node.js Streams it works
<daviddias> what if we have Node.js Streams (stream-pair), wrapped by toPull and then wrapped by toStream, creating a layer of pull in the middle, but keeping the Node.js Streams
<dignifiedquire> that's what I meant with using stream-pair wrapped
<dignifiedquire> it has the same issue
<daviddias> "fully idle", that almost feels that packets are just dropped
<daviddias> you have pull(node.js streams), what I was proposing is node.jsStreams(pull(node.jsStreams))
pfrazee has joined #ipfs
<dignifiedquire> that's whats happening, as spdy only understand node.js streams, so in libp2p-spdy/index.js I have toStream(pullStream) and in the spawner I have toPull(stream-pair)
<dignifiedquire> which makes it node -> pull -> node -> spdy
<daviddias> got it, right
<daviddias> this feels a lot like the High watermark is being reached and pull-streams are just going "meh, drop it"
<daviddias> instead of backpressuring
<dignifiedquire> hmm looking at the pull-pair directly it doesn't look like things are dropped, they are not even sent in the first place
<victorbjelkholm> daviddias, after downloading the dependencies again it works, thanks :)
<dignifiedquire> the messages stop reaching the transport
<daviddias> victorbjelkholm: nice! :D thank you for catching that!
chadoh has quit [Ping timeout: 244 seconds]
chadoh has joined #ipfs
mikeym has joined #ipfs
hobofan has joined #ipfs
seppellll has quit [Ping timeout: 244 seconds]
cow_2001 has quit [Quit: cow_2001]
neurrowcat has joined #ipfs
<dignifiedquire> daviddias: I'm sure it's some backpressure somewhere, changing the message size changes the point where it stops
mikeym has quit [Quit: Textual IRC Client: www.textualapp.com]
<daviddias> I'm trying to figure out if I understood the way pull-streams activate backpressure wrong, or if we are just missing something
<daviddias> (or if the pull-streams has a bug/racing condition somewhere)
<dignifiedquire> I'm pretty sure it's not sth directly related to pull-streams, but rather in the conversion part pull-stream to stream and/or stream to pull-stream
<daviddias> yeah, me too
<daviddias> or at least, I hope so
<dignifiedquire> as long as I use only pull-streams life was good :D, sooo
ianopolous has quit [Ping timeout: 244 seconds]
rgrinberg has joined #ipfs
<daviddias> well, we can't do that
<daviddias> unfortunately, it is not an option
<daviddias> I'm really glad I made this stress tests before
<daviddias> pinpoint this in js-ipfs flows would be a nightmare
neurrowcat has quit [Quit: Deebidappidoodah!]
chadoh has quit [Ping timeout: 264 seconds]
chadoh has joined #ipfs
Mateon1 has quit [Ping timeout: 240 seconds]
<dignifiedquire> yep
mikeym has joined #ipfs
mikeym has quit [Max SendQ exceeded]
chadoh has quit [Ping timeout: 250 seconds]
martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
espadrine has quit [Ping timeout: 260 seconds]
anonymuse has joined #ipfs
espadrine has joined #ipfs
<dignifiedquire> daviddias: isn't the default highwatermark 16?
<dignifiedquire> yes default highwatermark for object streams i 16
<dignifiedquire> daviddias: the above is what I get when adding some state analyisis to what happens,
<dignifiedquire> (the 101 are a bug in my counter, it's sending 101 messages) , but the first streams are pausing at 16 messages
espadrine has quit [Ping timeout: 260 seconds]
anonymuse has quit [Read error: Connection reset by peer]
herzmeister has quit [Ping timeout: 252 seconds]
anonymuse has joined #ipfs
ianopolous has joined #ipfs
_whitelogger has joined #ipfs
<daviddias> it should be 16KB for byte streams
<daviddias> or 16 for object mode
<daviddias> does pull-streams change the streams to objectMode?
<dignifiedquire> haven't found any indication of objectMode
seppellll has joined #ipfs
cow_2001 has joined #ipfs
intransit_away has joined #ipfs
anonymuse has quit [Ping timeout: 250 seconds]
computerfreak has joined #ipfs
chadoh has joined #ipfs
<dignifiedquire> okay sooo I found a way to make the tests pass
chadoh has quit [Ping timeout: 240 seconds]
<daviddias> I'm listening
<dignifiedquire> if I slow down the generator using "setTimeout(_, 1)" in the spawner it starts working
<daviddias> the message generator?
<daviddias> it is the backpressure, has to be
<daviddias> that is the same of throtteling the number of open streams
<daviddias> because they all go through the same pipe
herzmeister has joined #ipfs
seppellll has quit [Ping timeout: 265 seconds]
<dignifiedquire> yeah
<dignifiedquire> but I still haven't found a single indicator on any of the streams that they are paused/throttled or have anything in the buffer when it stops
<dignifiedquire> which I don't understand
kants has joined #ipfs
nixyne[m] has joined #ipfs
ianopolous has quit [Ping timeout: 244 seconds]
Mateon1 has joined #ipfs
Mateon1 is now known as Guest53101
zorglub27 has quit [Quit: zorglub27]
doesntgolf has joined #ipfs
<dignifiedquire> I don't get it :(
anonymuse has joined #ipfs
intransit_away has quit [Read error: Connection reset by peer]
anonymuse has quit [Ping timeout: 265 seconds]
anewuser has joined #ipfs
seppellll has joined #ipfs
martinkl_ has joined #ipfs
JesseW has joined #ipfs
anonymuse has joined #ipfs
cow_2001 has quit [Quit: cow_2001]
seppellll has quit [Ping timeout: 240 seconds]
anonymuse has quit [Ping timeout: 240 seconds]
circ-user-7S8ts has joined #ipfs
PrinceOfPeeves has joined #ipfs
ianopolous has joined #ipfs
circ-user-7S8ts has quit [Remote host closed the connection]
chris613 has joined #ipfs
ylp has joined #ipfs
<kpcyrd> can somebody give me a pointer to the chunking code for `ipfs add -n` ?
apiarian has quit [Quit: zoom]
<kpcyrd> I'm trying to reimplement it in a different language
cryptix has joined #ipfs
TheWhisper_ has joined #ipfs
TheWhisper has quit [Ping timeout: 265 seconds]
<daviddias> kpcyrd: that is all on the https://github.com/ipfs/go-ipfs/tree/master/importer
<daviddias> or parallel, in JS, https://github.com/ipfs/js-ipfs-unixfs-engine
anonymuse has joined #ipfs
apiarian has joined #ipfs
<daviddias> dignifiedquire: gonna open 3 PRs to help the debuging/testing and I'll write a comment on the migration to pull issue, just to guide other folks that might wanna take a look at the issue. My point is, let me finishing writing all of that before your review or comments, might save your time :)
computerfreak has quit [Remote host closed the connection]
anonymuse has quit [Ping timeout: 250 seconds]
<dignifiedquire> daviddias: thanks will take a look when they are up
<dignifiedquire> going for a run now :)
Guest53101 has quit [Changing host]
Guest53101 has joined #ipfs
Guest53101 is now known as Mateon1
<daviddias> have fun! :)
mvorg has quit [Ping timeout: 250 seconds]
Encrypt has quit [Ping timeout: 260 seconds]
anonymuse has joined #ipfs
anewuser has quit [Read error: Connection reset by peer]
<kpcyrd> daviddias: hm, the code is a bit complex, is there a document describing it in text form? like, how to binary format works, the chunk size, what are the limits for large files (enable or disable chunking), etc
anewuser has joined #ipfs
<daviddias> kpcyrd: unfortunately, not really
<daviddias> kpcyrd: https://github.com/ipfs/js-ipfs-unixfs explains how files are represented
chadoh has joined #ipfs
<JesseW> kpcyrd: once you understand it, please write one!
seppellll has joined #ipfs
<kpcyrd> daviddias: I'm trying to write a small program in rust that is able to calculate the multihash of a file, similar to sha256sum, without actually running ipfs. So far I'm reading the file from stdin and I'm able to calculate multihashes for strings (using dignifiedquire's library)
<daviddias> each file is chunked in 256KiB chunks
<daviddias> and each chunk is put into a unixfs protobuf
<daviddias> you serialize that protobuf and put it on the data field of a merkledag node
<daviddias> once you have all the files in merkledag nodes
anewuser has quit [Ping timeout: 260 seconds]
<daviddias> then you create a new merkledag node that points to all of them
Encrypt has joined #ipfs
<daviddias> you need to build first the chunker, the unixfs type (https://github.com/ipfs/js-ipfs-unixfs ) and the DAGNode type(https://github.com/ipfs/js-ipfs-merkle-dag/blob/master/src/dag-node.js)
chadoh has quit [Ping timeout: 240 seconds]
Arakela007 has joined #ipfs
Arakela007 has quit [Client Quit]
zorglub27 has joined #ipfs
espadrine has joined #ipfs
f[x] has joined #ipfs
cryptix has quit [Ping timeout: 244 seconds]
hobofan has quit [Quit: Lost terminal]
cryptix has joined #ipfs
zorglub27 has quit [Read error: Connection reset by peer]
<Mateon1> daviddias: Actually, hold on a second. Are the chunks themselves (incl. overhead) 256kiB, or is the data within them 256kiB?
<Mateon1> I am unable to check this right now, as my PC is updating...
<daviddias> the chunks are 256KiB
<daviddias> a merkledag node is not a chunk
<daviddias> the data field has a unixfs protobuf which contains the chunk
<daviddias> so total, the block size is a bit more than 256KiB
<daviddias> Mateon1: makes sense? ^^
<Mateon1> Hm, I guess so
<Mateon1> Thanks
<kpcyrd> Mateon1: the block size is 14 + 256KiB
cryptix has quit [Remote host closed the connection]
anonymuse has quit [Remote host closed the connection]
doesntgolf has quit [Ping timeout: 265 seconds]
ianopolous has quit [Ping timeout: 250 seconds]
arpu has joined #ipfs
ianopolous has joined #ipfs
cryptix has joined #ipfs
seppellll has quit [Ping timeout: 265 seconds]
martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
<kpcyrd> hrm, there aren't a lot of examples for protobuf in rust
__red__ has quit [Remote host closed the connection]
corvinux has quit [Remote host closed the connection]
corvinux has joined #ipfs
russelsteapot has joined #ipfs
anewuser has joined #ipfs
martinkl_ has joined #ipfs
chris613 has quit [Quit: Leaving.]
<russelsteapot> does ipfs have an offtopic channel?
chris613 has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
chris613 has quit [Quit: Leaving.]
jedahan has joined #ipfs
chadoh has joined #ipfs
zorglub27 has joined #ipfs
neurrowcat has joined #ipfs
<Kubuxu> russelsteapot: not really
<Kubuxu> \o kpcyrd
JesseW has quit [Ping timeout: 265 seconds]
cow_2001 has joined #ipfs
<kevina> Kubuxu: Just noticed the Topic is out of date, release Candidate 3 is not available, :)
<Kubuxu> kevina: thanks
<geoah> +1 for an ipfs offtopic :P
<Kubuxu> also thanks for work you are putting into ipfs
<Kubuxu> same with you geoah
<kevina> Your Welcome.
Kubuxu changed the topic of #ipfs to: Release Candidate 3 of go-ipfs v0.4.3 has been released, available at https://dist.ipfs.io/go-ipfs/v0.4.3-rc3 -- IPFS - InterPlanetary File System -- https://github.com/ipfs/ipfs -- FAQ: https://git.io/voEh8 -- Channel logs: https://botbot.me/freenode/ipfs/ -- Code of Conduct: https://git.io/vVBS0 -- Sprints: https://git.io/voEAh
<russelsteapot> is there a recommended golang development environment/setup for working on ipfs? does everyone just use vim/emacs and some intellisense plugins?
<geoah> my pleasure Kubuxu :) not a lot of spare time but really interested to get involved with ipfs, and for now trying to understand how things fit together is really interesting
<Kubuxu> russelsteapot: I don't think there is recommended setup
<geoah> I've been kinda spamming whyrusleeping1 a bit though hehe.
<Kubuxu> geoah: it is awesome, isn't it.
<Kubuxu> I don't think he minds.
<geoah> Kubuxu: it is indeed :D
<Kubuxu> russelsteapot: me and whyru are both using vim + vim-go + in my case neocomplete + neosnippets
<Kubuxu> + tagbar + some other plugins
wallacoloo has joined #ipfs
<geoah> visual studio code + golang + goreturns = <3 :D
<russelsteapot> Kubuxu, ok, ill try installing those. do you have any resources discussing proper configuration for all that by chance?
computerfreak has joined #ipfs
<Kubuxu> no I don't, it isn't that hard. Just a note, if you aren't using vim already, you will be better of with sublime or some normal IDE. If you know vim or want to learn it go ahead.
<Kubuxu> As someone that was working in Java and Scala for some time, I discovered that InteliJ has Go support plugin.
<Kubuxu> but as I knew vim from coding in C, I went with vim.
<kevina> I have been using emacs. It has fairly good go support.
<russelsteapot> Kubuxu, i was trying to get goclipse up and running, but after a couple hours of configuration work, its still not working, and SO doesnt have much relevant info either, so now im hunting for a better golang dev environment solution
zorglub27 has quit [Ping timeout: 276 seconds]
<geoah> debugging golang in eclipse (same with vim/emacs at least imo) was a nightmare
<geoah> not sure if any of them have gotten any better
<Kubuxu> I personally have never run Golang in a debugger.
<geoah> Kubuxu: you should try it at some point, it's a very nice experience :) just walking through the code and being able to jump around and see the actual state of everything is really useful
<geoah> especially when going through some else's code
<geoah> awh, also break points in tests are wonderful :P
jedahan has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
<Kubuxu> It is, haven't had that need in a Go, there aren't crazy undefined behaviors like in C or complex class hierarchy like in Java.
<russelsteapot> I'm a .net programmer for my day job, and i have been absolutely flabbergasted by the lack of debugging options in golang, especially considering how popular is has become in some production systems in businesses
hobofan has joined #ipfs
computerfreak has quit [Remote host closed the connection]
<hobofan> Kubuxu: hey there, is there any other info you need regarding 2823?
<Kubuxu> is there any message when add dies?
<hobofan> `Error: Context aborted`, maybe `abort` since `aborted`
<hobofan> It will probably die again in a few hours, I can post the exact message in the issue then
<Kubuxu> it might not help much, it is quite interesting.
rendar has quit [Ping timeout: 265 seconds]
<hobofan> But it basically ends with a single message of that
<Kubuxu> the bug
<hobofan> I've also put a newrelic monitoring agent on the server, so I'll be able to report a bit more about memory consumption
<Kubuxu> I can create a patch for you where the cli client also runs the http debug api/
<Kubuxu> we would get more info this way.
<Kubuxu> but the context aborted is weird
martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
<hobofan> I'd be happy to do that, the Wikidata add will take more than a week so there will be quite some oportunities to test :D
chadoh has quit [Ping timeout: 250 seconds]
martinkl_ has joined #ipfs
pfrazee has quit [Remote host closed the connection]
anewuser has quit [Quit: anewuser]
cow_2001 has quit [Quit: cow_2001]
chadoh has joined #ipfs
martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
rendar has joined #ipfs
cow_2001 has joined #ipfs
<dignifiedquire> daviddias: still around?
<hobofan> Kubuxu: I'll be offline in a few minutes. Should I write a comment on the issue to remind you of the patch? Like I said there isn't too much time pressure for me.
<Kubuxu> I haven't done it yet, why might have idea at first glance what is going on so I will wait for him.
Oatmeal has joined #ipfs
<Kubuxu> I remember about the possibility of the patch.
<hobofan> Okay :)
chadoh has quit [Ping timeout: 252 seconds]
hobofan has quit [Quit: leaving]
zorglub27 has joined #ipfs
<dignifiedquire> daviddias: brain exploded but I found our problem
arpu has quit [Quit: Ex-Chat]
zorglub27 has quit [Ping timeout: 240 seconds]
<Kubuxu> :D
mvorg has joined #ipfs
zorglub27 has joined #ipfs
infinity0 has quit [Remote host closed the connection]
cow_2001 has quit [Quit: cow_2001]
infinity0 has joined #ipfs
cryptix has quit [Ping timeout: 244 seconds]
cryptix has joined #ipfs
espadrine has quit [Ping timeout: 260 seconds]
cketti has quit [Ping timeout: 265 seconds]
chadoh has joined #ipfs
chadoh has quit [Ping timeout: 244 seconds]
cketti has joined #ipfs
taaem has joined #ipfs
pfrazee has joined #ipfs
f[x] has quit [Ping timeout: 264 seconds]
duekill has joined #ipfs
duekill has quit [Client Quit]
martinkl_ has joined #ipfs
zorglub27 has quit [Quit: zorglub27]
wallacoloo has quit [Ping timeout: 258 seconds]
wallacoloo has joined #ipfs
martinkl_ has quit [Quit: Textual IRC Client: www.textualapp.com]
<alu> link still works lol :D
corvinux has quit [Ping timeout: 260 seconds]
taaem has quit [Remote host closed the connection]
taaem has joined #ipfs
neurrowcat has quit [Quit: Deebidappidoodah!]
jedahan has joined #ipfs
taaem has quit [Remote host closed the connection]
taaem has joined #ipfs
DiCE1904 has joined #ipfs
<alu> around spring 2015, would ipfs be considered alpha or pre alpha?
<elimisteve> Congratulations to the IPFS team for creating something that works!
<elimisteve> Seriously -- most things just don't
<elimisteve> I'm trying to try ZeroNet as well but it does not work as advertised; running into little glitches every step of the way
chadoh has joined #ipfs
Oatmeal has quit [Ping timeout: 240 seconds]
Bheru27 has joined #ipfs
chadoh has quit [Ping timeout: 244 seconds]
herzmeister has quit [Quit: Leaving]
chadoh has joined #ipfs
herzmeister has joined #ipfs
Boomerang has quit [Quit: leaving]
santamanno has quit [Read error: Connection reset by peer]
sugarpuff_ has joined #ipfs
kyledrake_ has joined #ipfs
henriquev has quit [Ping timeout: 264 seconds]
trytrytry[m]1 has quit [Ping timeout: 264 seconds]
gozala has quit [Ping timeout: 264 seconds]
ebarch has quit [Ping timeout: 264 seconds]
gabishu[m] has quit [Ping timeout: 264 seconds]
M-jbenet has quit [Ping timeout: 264 seconds]
peapeaxiong[m] has quit [Ping timeout: 264 seconds]
arby[m] has quit [Ping timeout: 264 seconds]
gozala has joined #ipfs
kitcambridge_ has joined #ipfs
M6e7961[m] has quit [Ping timeout: 264 seconds]
kitcambridge has quit [Ping timeout: 264 seconds]
M-Sonata has quit [Ping timeout: 264 seconds]
michaelmure[m]1 has quit [Ping timeout: 264 seconds]
hosh has quit [Ping timeout: 264 seconds]
mrrrgn____ has joined #ipfs
Caquilala[m] has quit [Ping timeout: 264 seconds]
M-Guest2152 has quit [Ping timeout: 264 seconds]
M-martinklepsch has quit [Ping timeout: 264 seconds]
red5d[m] has quit [Ping timeout: 264 seconds]
soradet[m] has quit [Ping timeout: 264 seconds]
M-infpetal has quit [Ping timeout: 264 seconds]
M-player33 has quit [Ping timeout: 264 seconds]
M-leer10 has quit [Ping timeout: 264 seconds]
cdata has quit [Ping timeout: 264 seconds]
bergie has quit [Ping timeout: 264 seconds]
sickill has quit [Ping timeout: 264 seconds]
kitcambridge_ is now known as kitcambridge
hosh has joined #ipfs
mrrrgn___ has quit [Ping timeout: 264 seconds]
bitspill has quit [Ping timeout: 264 seconds]
M-bungle has quit [Ping timeout: 264 seconds]
bcavileer has quit [Ping timeout: 264 seconds]
mbrock has quit [Ping timeout: 264 seconds]
torarne1 has quit [Ping timeout: 264 seconds]
M-11367 has quit [Ping timeout: 264 seconds]
Muis has quit [Ping timeout: 264 seconds]
edu[m] has quit [Ping timeout: 264 seconds]
M-3725 has quit [Ping timeout: 264 seconds]
Guest31078[m] has quit [Ping timeout: 264 seconds]
M-amstocker has quit [Ping timeout: 264 seconds]
M-g has quit [Ping timeout: 264 seconds]
M-cyzoonic has quit [Ping timeout: 264 seconds]
M-sraja has quit [Ping timeout: 264 seconds]
M-4447 has quit [Ping timeout: 264 seconds]
M-erikgarrison has quit [Ping timeout: 264 seconds]
M-mistake has quit [Ping timeout: 264 seconds]
kyledrake has quit [Ping timeout: 264 seconds]
anderspree_ has quit [Ping timeout: 264 seconds]
yoshuawuyts has quit [Ping timeout: 264 seconds]
clever has quit [Ping timeout: 264 seconds]
sugarpuff has quit [Ping timeout: 264 seconds]
chromakode has quit [Ping timeout: 264 seconds]
elimisteve has quit [Ping timeout: 264 seconds]
bjp3 has quit [Ping timeout: 264 seconds]
kyledrake_ is now known as kyledrake
sugarpuff_ is now known as sugarpuff
keko_ has quit [Ping timeout: 264 seconds]
jhiesey has quit [Ping timeout: 264 seconds]
H3g3m0n[m]1 has quit [Ping timeout: 264 seconds]
hermann-tab[m]1 has quit [Ping timeout: 264 seconds]
dd[m] has quit [Ping timeout: 264 seconds]
kode54 has quit [Ping timeout: 264 seconds]
ehd has quit [Ping timeout: 264 seconds]
yuryk[m] has quit [Ping timeout: 264 seconds]
M-3511 has quit [Ping timeout: 264 seconds]
M-austinhc has quit [Ping timeout: 264 seconds]
M-3444 has quit [Ping timeout: 264 seconds]
Guest26265[m] has quit [Ping timeout: 264 seconds]
M-p0pa has quit [Ping timeout: 264 seconds]
M-2223 has quit [Ping timeout: 264 seconds]
M-giodamelio has quit [Ping timeout: 264 seconds]
qzo[m] has quit [Ping timeout: 264 seconds]
M-liberdiko has quit [Ping timeout: 264 seconds]
Qwertie has quit [Ping timeout: 264 seconds]
sindresorhus has quit [Ping timeout: 264 seconds]
caseorganic has quit [Ping timeout: 264 seconds]
NeoTeo has quit [Ping timeout: 264 seconds]
splintax has quit [Ping timeout: 264 seconds]
Igel has quit [Ping timeout: 264 seconds]
yangwao has quit [Ping timeout: 264 seconds]
M-3870 has quit [Ping timeout: 264 seconds]
jakobvarmose_ has quit [Ping timeout: 264 seconds]
Guest31481[m] has quit [Ping timeout: 264 seconds]
Guest20690[m] has quit [Ping timeout: 264 seconds]
M-Tribex10 has quit [Ping timeout: 264 seconds]
davidar has quit [Ping timeout: 264 seconds]
nivekuil has quit [Ping timeout: 264 seconds]
cypher has quit [Ping timeout: 264 seconds]
ehd has joined #ipfs
elimisteve has joined #ipfs
Oatmeal has joined #ipfs
cdata has joined #ipfs
yangwao has joined #ipfs
mbrock has joined #ipfs
ebarch has joined #ipfs
sickill has joined #ipfs
bitspill has joined #ipfs
caseorganic has joined #ipfs
bcavileer has joined #ipfs
chromakode has joined #ipfs
NeoTeo has joined #ipfs
jhiesey has joined #ipfs
sindresorhus has joined #ipfs
M-Guest2152 has joined #ipfs
M6e7961[m] has joined #ipfs
michaelmure[m]1 has joined #ipfs
M-Sonata has joined #ipfs
M-leer10 has joined #ipfs
M-martinklepsch has joined #ipfs
M-infpetal has joined #ipfs
red5d[m] has joined #ipfs
Caquilala[m] has joined #ipfs
soradet[m] has joined #ipfs
M-player33 has joined #ipfs
Qwertie has joined #ipfs
anderspree_ has joined #ipfs
Guest31078[m] has joined #ipfs
edu[m] has joined #ipfs
torarne1 has joined #ipfs
M-3725 has joined #ipfs
M-4447 has joined #ipfs
M-amstocker has joined #ipfs
M-sraja has joined #ipfs
M-g has joined #ipfs
M-11367 has joined #ipfs
M-bungle has joined #ipfs
M-cyzoonic has joined #ipfs
bergie has joined #ipfs
Igel has joined #ipfs
kode54 has joined #ipfs
nivekuil has joined #ipfs
M-erikgarrison has joined #ipfs
M-giodamelio has joined #ipfs
hermann-tab[m]1 has joined #ipfs
Guest26265[m] has joined #ipfs
M-3511 has joined #ipfs
yuryk[m] has joined #ipfs
M-p0pa has joined #ipfs
qzo[m] has joined #ipfs
M-2223 has joined #ipfs
H3g3m0n[m]1 has joined #ipfs
M-3444 has joined #ipfs
dd[m] has joined #ipfs
M-austinhc has joined #ipfs
jakobvarmose_ has joined #ipfs
M-liberdiko has joined #ipfs
M-mistake has joined #ipfs
trytrytry[m]1 has joined #ipfs
gabishu[m] has joined #ipfs
M-3870 has joined #ipfs
peapeaxiong[m] has joined #ipfs
Guest31481[m] has joined #ipfs
arby[m] has joined #ipfs
M-Tribex10 has joined #ipfs
clever has joined #ipfs
Guest20690[m] has joined #ipfs
M-jbenet has joined #ipfs
Muis has joined #ipfs
davidar has joined #ipfs
TheWhisper_ is now known as TheWhisper
henriquev has joined #ipfs
JesseW has joined #ipfs
daviddias has quit [Ping timeout: 250 seconds]
keko_ has joined #ipfs
splintax has joined #ipfs
daviddias has joined #ipfs
bjp3 has joined #ipfs
yoshuawuyts has joined #ipfs
cypher has joined #ipfs
mvorg has quit [Ping timeout: 255 seconds]
rendar has quit [Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!]
taaem has quit [Remote host closed the connection]
taaem has joined #ipfs
Encrypt has quit [Quit: Sleeping time!]
jbenet has quit [Ping timeout: 244 seconds]
voxelot has quit [Ping timeout: 260 seconds]
bengl has quit [Read error: Connection reset by peer]
bitspill has quit [Read error: Connection reset by peer]
mappum has quit [Read error: Connection reset by peer]
karissa has quit [Ping timeout: 244 seconds]
risk has quit [Ping timeout: 240 seconds]
prettymuchbryce has quit [Ping timeout: 265 seconds]
mbrock has quit [Ping timeout: 255 seconds]
ebarch has quit [Ping timeout: 255 seconds]
taaem has quit [Remote host closed the connection]
manveru has quit [Ping timeout: 255 seconds]
lohkey has quit [Ping timeout: 255 seconds]
taaem has joined #ipfs
bcavileer has quit [Read error: Connection reset by peer]
geoah has quit [Ping timeout: 260 seconds]
taaem has quit [Remote host closed the connection]
taaem has joined #ipfs
zielmicha has quit [Read error: Connection reset by peer]
jclay has quit [Ping timeout: 252 seconds]
Nukien has quit [Ping timeout: 265 seconds]
Luzifer has quit [Ping timeout: 255 seconds]
lgierth has quit [Quit: WeeChat 1.4]
lgierth has joined #ipfs
cryptix has quit [Ping timeout: 244 seconds]
bengl has joined #ipfs
Nukien has joined #ipfs
bitspill has joined #ipfs
karissa has joined #ipfs
voxelot has joined #ipfs
bcavileer has joined #ipfs
ebarch has joined #ipfs
risk has joined #ipfs
ianopolous has quit [Ping timeout: 255 seconds]
mappum has joined #ipfs
PrinceOfPeeves has quit [Ping timeout: 255 seconds]
PrinceOfPeeves has joined #ipfs
chadoh has quit [Ping timeout: 258 seconds]
lohkey has joined #ipfs
zielmicha has joined #ipfs
prettymuchbryce has joined #ipfs
jedahan has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
fraxed has quit [Quit: ""]
matoro has quit [Ping timeout: 252 seconds]
jclay has joined #ipfs
Luzifer has joined #ipfs
manveru has joined #ipfs
fractex has joined #ipfs
geir_ has quit [Ping timeout: 265 seconds]
geir_ has joined #ipfs
mbrock has joined #ipfs
frabrunelle has quit [Ping timeout: 265 seconds]
frabrunelle has joined #ipfs
russelsteapot has quit [Ping timeout: 265 seconds]
chadoh has joined #ipfs
fleeky_ has joined #ipfs
jedahan has joined #ipfs
geoah has joined #ipfs
jedahan has quit [Client Quit]
jbenet has joined #ipfs
fleeky has quit [Ping timeout: 244 seconds]
chadoh has quit [Ping timeout: 276 seconds]
reit has quit [Quit: Leaving]
chadoh has joined #ipfs
jedahan has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
cryptix has joined #ipfs
chadoh has quit [Ping timeout: 240 seconds]
jedahan has quit [Quit: My Mac has gone to sleep. ZZZzzz…]