lgierth changed the topic of #ipfs to: Current release: go-ipfs v0.4.4 on dist.ipfs.io | Dev chatter: #ipfs-dev | IPFS, the InterPlanetary FileSystem: https://github.com/ipfs/ipfs | FAQ: https://git.io/voEh8 | Logs: https://botbot.me/freenode/ipfs/ | Code of Conduct: https://git.io/vVBS0 | Sprints: https://git.io/voEAh
trvon has joined #ipfs
domanic has quit [Ping timeout: 260 seconds]
anewuser has quit [Ping timeout: 245 seconds]
raedok has joined #ipfs
raedok has quit [Client Quit]
sdgathman has quit [Quit: ZNC - http://znc.in]
sdgathman has joined #ipfs
palkeo has quit [Quit: Konversation terminated!]
Hory_ has quit [Quit: Leaving]
<kevina> whyrusleeping: okay, the code is in
<kevina> whyrusleeping: does https://github.com/ipfs/go-datastore/issues/59 make sense to you?
<whyrusleeping> kevina: hrm... it makes sense. And its something i've wanted to do for a little while, but i'm not sure it makes sense for us to do that right now
* whyrusleeping thinks
<whyrusleeping> kevina: yeah, lets punt on doing the zero-copy values for now
<whyrusleeping> I definitely want that at some point, but lets not rock the boat *too* much here
<whyrusleeping> the reason i'm more hesitant on this one is that misuse of that feature can lead to some pretty subtle bugs
<kevina> no problem, it was only a small speed up anyway in https://github.com/libp2p/go-libp2p-kad-dht/issues/39.
Kane` has joined #ipfs
<whyrusleeping> yeap, thats what i was looking at
<whyrusleeping> cool, great speedup there :)
soloojos has quit [Ping timeout: 245 seconds]
<kevina> thanks!
<kevina> https://github.com/ipfs/go-datastore/pull/54 needs to go in first
Ronsor has quit [Ping timeout: 258 seconds]
chromakode has quit [Ping timeout: 248 seconds]
fleeky__ has joined #ipfs
Ronsor has joined #ipfs
fleeky_ has quit [Ping timeout: 260 seconds]
soloojos has joined #ipfs
eternalfrost has quit [Quit: Leaving]
<Kubuxu> whyrusleeping: what do you think about this idea: instead of gxifying while fuse dep and it's deps, I would vendor it's deps into it and gxify it as a whole.
kulelu88 has quit [Quit: Leaving]
* whyrusleeping shrugs
<whyrusleeping> i'm not gonna be violently against that
Qwertie has quit [Ping timeout: 260 seconds]
anonymuse has quit [Ping timeout: 268 seconds]
Qwertie has joined #ipfs
galois_d_ has quit [Remote host closed the connection]
galois_dmz has joined #ipfs
ianopolous__ has quit [Remote host closed the connection]
c5e3 has joined #ipfs
lentan has quit [Remote host closed the connection]
cubemonkey has quit [Ping timeout: 246 seconds]
mildred2 has joined #ipfs
mildred1 has quit [Ping timeout: 268 seconds]
<whyrusleeping> kevina: I think we should probably automatically call close if we return 'false' from a NextSync call
<whyrusleeping> does that seem right to you?
<whyrusleeping> or should we make it the convention that the user always calls 'Close' on the query when they are done?
lentan has joined #ipfs
lentan has quit [Remote host closed the connection]
lentan has joined #ipfs
<jbenet> whyrusleeping: the most important thing to do on stream muxing is metrics. measurement is what's going to give us a way to compare, adopt, default to one or the other
lentan has quit [Read error: Connection reset by peer]
<whyrusleeping> jbenet: yeap
lentan has joined #ipfs
<jbenet> whyrusleeping: we should be able to generate perf graphs of all this stuff, and how they fail-- doing this blind will cause another screw up like go-utp.
<jbenet> whyrusleeping: a muxer behaving poorly has the potential to be equally bad, possibly worse.
<jbenet> whyrusleeping: point is really driven home when you look at perf graphs from hard core datacenter systems. not baby WAN distributed systems.
<jbenet> also, grass always seems greener on the other muxer.
<jbenet> muxer/transport/etc
ianopolous__ has joined #ipfs
nonluminous has quit [Read error: Connection reset by peer]
<whyrusleeping> jbenet: we're pretty sure actually that go-utp wasnt the problem and that it was actually yamux
<whyrusleeping> havent gone back to verify yet, but its pretty sketchy on yamux's part
<jbenet> whyrusleeping: im not clear on how that would work, given yamux works with tcp but failed fantastically with go-utp.
<jbenet> whyrusleeping: my bet is that it's actually both are fucking up.
<whyrusleeping> jbenet: it had to do with timings
<jbenet> whyrusleeping: both libraries ARE NOT robustly tested. it's honestly bad for yamux to be where it's at and not have standard perf / failure graphs (of the likes you can find for TCP, SSH, SCTP, QUIC,
<jbenet> "where it's at" = in production in hundreds of thousands of machines.
<jbenet> ^ that's something, btw, that i dont think {muxado, multiplex, spdystream, etc} can claim. and it's a big deal though. it's at least _that_ battle tested.
<jbenet> don't be so eager to switch it for something that's "so far so good" in thousands of machines.
<jbenet> need a _rigorous_ perf review to support a claim like "let's use X (battle testing O(1K)) instead of Y (battle testing O(100K))". otherwise you're just fooling yourself.
<jbenet> be careful-- one thing that sets apart "engineering" from "hacking" is correctness, rigorous proof, a scientific approach to proving what's right.
<jbenet> (it's why i remotely feel safe trusting something like TLS 1.3, or Zcash, or Signal, or Tor, ... rigorous _engineers_.
chungy has quit [Quit: ZNC - http://znc.in]
Qwertie has quit [Ping timeout: 260 seconds]
<whyrusleeping> yeap, exactly why i said i'd add it as an experimental option.
<whyrusleeping> because currently i have no way of even testing performance. I need the ability to do so before i can start getting any miniscule perf data
anonymuse has joined #ipfs
<whyrusleeping> but currently, yamux is the biggest pain point of the networking stack, and by far the biggest consumer of memory
Qwertie has joined #ipfs
<whyrusleeping> to reduce memory much lower than the current usage levels I either need to 'fix' yamux, rewrite yamux, or write a new stream muxer
unfrustratable has joined #ipfs
<vtomole> I'm thinking about using ipfs as a replacement to Dropbox, anything i should consider before making the switch?
chungy has joined #ipfs
trvon has quit [Ping timeout: 258 seconds]
anonymuse has quit [Remote host closed the connection]
<kevina> whyrusleeping: sorry I was away for a bit, you are giving me conflicting messages
<pjz> vtomole: I think anything you post is publicly readable unless you encrypt it manually
<whyrusleeping> kevina: most recent == closest to what i'm actually thinking
chungy has quit [Ping timeout: 260 seconds]
<whyrusleeping> also, random aside, but eggs, pickles and sriracha make a pretty tasty meal
<whyrusleeping> either that or my taste buds are broken
lentan has quit [Remote host closed the connection]
<kevina> okay, no comment on your taste buds :) I don't even know what a sriracha is, sounds weird :)
<pjz> whyrusleeping: add peanut butter to get a taste of thai :)
<pjz> kevina: sriracha is "kickin' chicken" sauce :) mildly spicy
<whyrusleeping> pjz: peanut butter? ooooo! peanut butter is my favorite topping
<whyrusleeping> and thai is my favorite type of food
<whyrusleeping> pjz: youre a genius
chungy has joined #ipfs
herzmeister has quit [Quit: Leaving]
lentan has joined #ipfs
<pjz> whyrusleeping: if you want even more protein, add some tuna
<whyrusleeping> unfortunately there is no tuna in my house
<whyrusleeping> the only protein i have are eggs, soylent, and cliff bars
<whyrusleeping> and i'm running low on at least two of those things
M[m]4 has joined #ipfs
mguentner has quit [Ping timeout: 252 seconds]
<pjz> soylent is too scary for me
<pjz> I just get Clif builder bars or other protein bars and jerky or sausage sticks to snack on
<pjz> also roasted nuts and wasabi peas
<whyrusleeping> cliff builder bars are awesome
<pjz> some are. Peanut butter hides lots of crimes.
tmg has quit [Ping timeout: 250 seconds]
<pjz> tried out some 'chili lime' beef jerky - it's okay, but a bit sweet.
Qwertie has quit [Ping timeout: 258 seconds]
<whyrusleeping> ooooh, is it that krave brand?
evil_filip has joined #ipfs
<whyrusleeping> ugh, youre making me hungry for real food
<kevina> whyrusleeping: so NextSync() should _not_ call close if it will return false?
herzmeister has joined #ipfs
<whyrusleeping> kevina: I'm thinking so, yeah
<whyrusleeping> that way we don't provide an excuse for users to forget to call close
<kevina> okay, that will simplify things a bit
ygrek has quit [Ping timeout: 244 seconds]
Qwertie has joined #ipfs
<pjz> whyrusleeping: yeah, it's Krave. (Thanks Amazon Pantry!)
<whyrusleeping> kevina: sweet
<whyrusleeping> pjz: I love that stuff, i could eat multiple bags of it in one sitting
mguentner has joined #ipfs
<kevina> whyrusleeping: actually according to the docs, close should only be required on early exit:
<kevina> "Close() error // client may call Close to signal early exit"
slothbag has quit [Quit: Leaving.]
<whyrusleeping> hrm...
<kevina> the entire interface is confusing to me :)
<kevina> :) = :(
* kevina can't type
<vtomole> I wonder how hard it would be to create a dropbox clone with an ipfs backend. The app encrypts your data for you before you post it.
<whyrusleeping> vtomole: it shouldnt be too difficult
<whyrusleeping> depending on how nice of a UX you want
<whyrusleeping> kevina: which interface is that?
<kevina> the Results interface as documented in go-datastore/query.go
<whyrusleeping> oh
<whyrusleeping> yeah
<whyrusleeping> i have negative opinions of that interface
<kevina> whyrusleeping: in order to match the interface it seams NextSync() should the close function if it is defined
<whyrusleeping> okay, so if NextSync returns 'false' we assume things have been closed?
<kevina> I think, that is what we have to do to match the interface.
<kevina> In go-ds-leveldb i.Release() will be called when it has no more results to send in runQuery(), see https://github.com/ipfs/go-ds-leveldb/blob/a37289361537b8109b1a4ec3c7f194c5d2b39414/datastore.go#L141
jonnycrunch has quit [Ping timeout: 258 seconds]
<kevina> when not using a channel the close function passes in will serve to call i.Release() see https://github.com/ipfs/go-ds-leveldb/blob/a37289361537b8109b1a4ec3c7f194c5d2b39414/datastore.go#L108
<kevina> whyrusleeping: ^
<kevina> basically I think I figured this out :)
<whyrusleeping> Okay, that makes sense
<vtomole> I found this post:https://www.quora.com/What-are-the-major-issues-with-current-operating-system-design-in-terms-of-scalabilty-and-inter-operability-of-OS-between-different-devices. I just thought it was interesting that the problems the answer-er talks about are what ipfs is solving. I've been thinking about why a new operating system would be needed for this.....
jonnycrunch has joined #ipfs
mguentner has quit [Quit: WeeChat 1.6]
jonnycrunch has quit [Ping timeout: 260 seconds]
<pjz> whyrusleeping: I just ahd v0.4.4 crash on me
<whyrusleeping> pjz: oh? got a log of it?
mguentner has joined #ipfs
<pjz> whyrusleeping: yah, lemme get you a hash
<pjz> QmTY3A43uG8Kv9cRSrn65WJaLZrwJteBrKTBq6nNoWecJ3
<whyrusleeping> oh, oomdeath
<whyrusleeping> yay
<pjz> whyrusleeping: it's on a linux box with 1G total RAM, over 600M free usually
Kane` has quit [Remote host closed the connection]
<pjz> whyrusleeping: can you tell what's so large?
<pjz> whyrusleeping: it's doing mostly nothing, sitting and listening to the network is all
<pjz> whyrusleeping: I need to do some testing so am going to stop pinning that hash; I can add it again later if you need another look
<whyrusleeping> pjz: i have it, no worries
<whyrusleeping> it looks like its just network connections accumulating
<pjz> whyrusleeping: is there a knob I need to set to limit that?
<whyrusleeping> unfortunately no
<whyrusleeping> its going to be better in 0.4.5
<pjz> whyrusleeping: I'm trying to run a pinning service :) So these will be long-running
<whyrusleeping> lowering memory usage is high on my priority list
wallacoloo_ has quit [Quit: wallacoloo_]
lentan has quit [Remote host closed the connection]
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
wallacoloo_ has joined #ipfs
Boomerang has quit [Remote host closed the connection]
lentan has joined #ipfs
Qwertie has quit [Ping timeout: 250 seconds]
Qwertie has joined #ipfs
dignifiedquire has quit [Quit: Connection closed for inactivity]
AndrewLeCody[m] has joined #ipfs
evil_filip has quit [Quit: Mutter: http://www.mutterirc.com]
pfrazee has quit [Remote host closed the connection]
DiCE1904 has quit [Ping timeout: 250 seconds]
evil_filip has joined #ipfs
M[m]4 has left #ipfs ["User left"]
AndrewLeCody[m] has left #ipfs ["User left"]
Kane` has joined #ipfs
evil_filip has quit [Remote host closed the connection]
Scio[m] has joined #ipfs
lentan has quit []
Kane` has quit [Remote host closed the connection]
evil_filip has joined #ipfs
evil_filip has quit [Client Quit]
vtomole has quit [Ping timeout: 260 seconds]
Qwertie has quit [Ping timeout: 250 seconds]
Qwertie has joined #ipfs
herzmeister has quit [Ping timeout: 240 seconds]
Kane` has joined #ipfs
chriscool has joined #ipfs
herzmeister has joined #ipfs
rendar has joined #ipfs
saintromuald__ has quit [Remote host closed the connection]
jholden has joined #ipfs
ulrichard has joined #ipfs
jholden has quit [Ping timeout: 260 seconds]
Qwertie has quit [Ping timeout: 250 seconds]
Qwertie has joined #ipfs
rugu has joined #ipfs
mythmonster is now known as mythmon-
Guest2_ has joined #ipfs
pickle_ has joined #ipfs
kaotisk has quit [Ping timeout: 256 seconds]
pickle_ has quit [Read error: Connection reset by peer]
unfrustratable has quit [Ping timeout: 244 seconds]
robattila256 has joined #ipfs
<graffen> Morning all (or good-whatever-time-of-day-it-is-where-you-are)
bastianilso___ has joined #ipfs
Spartan has joined #ipfs
kvda has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
vtomole has joined #ipfs
jonnycrunch has joined #ipfs
dignifiedquire has joined #ipfs
jonnycrunch has quit [Ping timeout: 248 seconds]
ylp1 has joined #ipfs
konubinix has quit [Quit: ZNC - http://znc.in]
konubinix has joined #ipfs
Guest2_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
bastianilso__ has joined #ipfs
rendar has quit [Ping timeout: 268 seconds]
bastianilso___ has quit [Ping timeout: 268 seconds]
<victorbjelkholm[> graffen: Good morning! And good morning to the rest of you too
rendar has joined #ipfs
ylp has quit [Ping timeout: 260 seconds]
ZaZ has joined #ipfs
ylp has joined #ipfs
<haad> o/
lkcl has quit [Read error: Connection reset by peer]
lkcl has joined #ipfs
<dignifiedquire> good morning
ianopolous__ has quit [Ping timeout: 240 seconds]
s_kunk has quit [Ping timeout: 268 seconds]
rugu has quit [Quit: Page closed]
<dignifiedquire> daviddias: finished my dag review
rugu has joined #ipfs
maxlath has joined #ipfs
lkcl has quit [Read error: Connection reset by peer]
lkcl has joined #ipfs
s_kunk has joined #ipfs
jonnycrunch has joined #ipfs
slothbag has joined #ipfs
jonnycrunch has quit [Ping timeout: 268 seconds]
jonnycrunch has joined #ipfs
jonnycrunch has quit [Ping timeout: 268 seconds]
maxlath has quit [Ping timeout: 265 seconds]
domanic has joined #ipfs
evil_filip has joined #ipfs
domanic has quit [Ping timeout: 250 seconds]
domanic has joined #ipfs
infinity0 has joined #ipfs
Oatmeal has quit [Quit: Suzie says, "TTFNs!"]
evil_filip has quit [Ping timeout: 260 seconds]
maxlath has joined #ipfs
ylp has quit [Ping timeout: 260 seconds]
ylp has joined #ipfs
espadrine has joined #ipfs
Spartan has quit [Ping timeout: 258 seconds]
<daviddias> dignifiedquire: thank you :)
<daviddias> morning!
kaotisk has joined #ipfs
<Kubuxu> !pin QmTq8ag5pgTCqtGDtmpm1F5TPE2i1H8bcU6295WFKTc5ie golang.org/x/sys
<pinbot> now pinning /ipfs/QmTq8ag5pgTCqtGDtmpm1F5TPE2i1H8bcU6295WFKTc5ie
<Kubuxu> !pin QmVekR75tD8aw6kE2WFF1i3ePociCEZ6YecQefcukJ5w8m go fuse lib
<pinbot> now pinning /ipfs/QmVekR75tD8aw6kE2WFF1i3ePociCEZ6YecQefcukJ5w8m
sevcsik has quit [Ping timeout: 260 seconds]
domanic has quit [Read error: No route to host]
<Kubuxu> !unpin QmVekR75tD8aw6kE2WFF1i3ePociCEZ6YecQefcukJ5w8m
<pinbot> now unpinning /ipfs/QmVekR75tD8aw6kE2WFF1i3ePociCEZ6YecQefcukJ5w8m
domanic has joined #ipfs
sevcsik has joined #ipfs
wallacoloo_ has quit [Quit: wallacoloo_]
kenshyx has joined #ipfs
Foxcool has joined #ipfs
Foxcool has quit [Client Quit]
Foxcool has joined #ipfs
dan0_0 has quit [Ping timeout: 252 seconds]
lkcl has quit [Read error: Connection reset by peer]
dan0_0 has joined #ipfs
Oatmeal has joined #ipfs
ofdm has joined #ipfs
jonnycrunch has joined #ipfs
sdelic has joined #ipfs
<Kubuxu> !pin QmaFNtBAXX4nVMQWbUqNysXyhevUj1k4B1y5uS45LC7Vw9 fuzz
<pinbot> now pinning /ipfs/QmaFNtBAXX4nVMQWbUqNysXyhevUj1k4B1y5uS45LC7Vw9
lkcl has joined #ipfs
Soft has joined #ipfs
jonnycrunch has quit [Ping timeout: 256 seconds]
slothbag has quit [Quit: Leaving.]
<richardlitt> Morning all.
tmg has joined #ipfs
maxlath has quit [Remote host closed the connection]
anonymuse has joined #ipfs
sdelic has quit [Ping timeout: 258 seconds]
jokoon has joined #ipfs
<haad> morning richardlitt o/
<richardlitt> morning haad
<pinbot> [host 6] failed to grab refs for /ipfs/QmaFNtBAXX4nVMQWbUqNysXyhevUj1k4B1y5uS45LC7Vw9: unknown ipfs-shell error encoding: text/html - "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body bgcolor=\"white\">\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>nginx/1.10.1</center>\r\n</body>\r\n</html>\r\n"
<pinbot> [host 5] failed to grab refs for /ipfs/QmaFNtBAXX4nVMQWbUqNysXyhevUj1k4B1y5uS45LC7Vw9: unknown ipfs-shell error encoding: text/html - "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body bgcolor=\"white\">\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>nginx/1.10.1</center>\r\n</body>\r\n</html>\r\n"
<pinbot> [host 4] failed to grab refs for /ipfs/QmaFNtBAXX4nVMQWbUqNysXyhevUj1k4B1y5uS45LC7Vw9: unknown ipfs-shell error encoding: text/html - "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body bgcolor=\"white\">\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>nginx/1.10.1</center>\r\n</body>\r\n</html>\r\n"
<pinbot> [host 0] failed to grab refs for /ipfs/QmaFNtBAXX4nVMQWbUqNysXyhevUj1k4B1y5uS45LC7Vw9: unknown ipfs-shell error encoding: text/html - "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body bgcolor=\"white\">\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>nginx/1.10.1</center>\r\n</body>\r\n</html>\r\n"
<pinbot> [host 7] failed to grab refs for /ipfs/QmaFNtBAXX4nVMQWbUqNysXyhevUj1k4B1y5uS45LC7Vw9: unknown ipfs-shell error encoding: text/html - "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body bgcolor=\"white\">\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>nginx/1.10.1</center>\r\n</body>\r\n</html>\r\n"
<richardlitt> I never got your milestone thing working :/
<pinbot> [host 3] failed to grab refs for /ipfs/QmaFNtBAXX4nVMQWbUqNysXyhevUj1k4B1y5uS45LC7Vw9: unknown ipfs-shell error encoding: text/html - "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body bgcolor=\"white\">\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>nginx/1.10.1</center>\r\n</body>\r\n</html>\r\n"
bauruine_ has quit [Quit: ZNC - http://znc.in]
<pinbot> [host 2] failed to grab refs for /ipfs/QmaFNtBAXX4nVMQWbUqNysXyhevUj1k4B1y5uS45LC7Vw9: unknown ipfs-shell error encoding: text/html - "<html>\r\n<head><title>504 Gateway Time-out</title></head>\r\n<body bgcolor=\"white\">\r\n<center><h1>504 Gateway Time-out</h1></center>\r\n<hr><center>nginx/1.10.1</center>\r\n</body>\r\n</html>\r\n"
bauruine has joined #ipfs
rugu has quit [Ping timeout: 260 seconds]
<daviddias> dignifiedquire: I know I asked this before but I'm not sure if I got the answer: When this happens -- https://travis-ci.org/ipfs/js-ipfs-api/builds/176709791 -- it means that you enabled CI to fail if Sauce fails again, right? (because I know there was a version that wouldn't mind if Browser tests failed for the sake of Sauce Labs)
<dignifiedquire> daviddias: I made is so that if sauce labs fails some browsers it will not fail ci
<victorbjelkholm[> daviddias: not sure if related, but I noticed that the sauce labs badges stopped working, maybe you changed some project settings?
<daviddias> "some browsers"
<dignifiedquire> that log looks like it completely failed to connect to saucelabs
<daviddias> victorbjelkholm[: I didn't touch anything with regards to SauceLabs' config options
<dignifiedquire> not even starting the test
<dignifiedquire> that's why it's failing
<daviddias> ok, so, when you say "some browsers" is it "if it passes in Chrome and Firefox we are good, if it fails in any of the two then it fails"?
lamarpavel has quit [Ping timeout: 260 seconds]
azdle has quit [Remote host closed the connection]
<haad> daviddias: your https://github.com/ipfs/js-ipfs-api/commit/23a3d493d80fca402aac359c7d51e73365573911 fixes js-ipfs-api master (currently broken, tests are not running), can you merge it to master asap? LGTM to merge all the way through :)
<daviddias> I'm putting it on a boat
<daviddias> :D
<haad> oooo, actually, take that back. it fixes nodejs tests but browser tests still fail :/
<haad> well, at least it fixes something :)
phaenanthery has joined #ipfs
lamarpavel has joined #ipfs
<haad> ty
<daviddias> haad there is a issue with js-ipfs-api and go-ipfs when js-ipfs-api runs from the browser, which only happens for adding nested dirs
ylp has quit [Ping timeout: 260 seconds]
<daviddias> I've disabled that test, so everything else should be just fine
<daviddias> verifying
arpu has joined #ipfs
ylp has joined #ipfs
<daviddias> got it
<daviddias> disabled the add test
<daviddias> forgot to disable the get test for the dir
<haad> daviddias: new commit incoming?
<daviddias> yep
jonnycrunch has joined #ipfs
<daviddias> just to make sure, note that this is just a issue with js-ipfs-api and go-ipfs, js-ipfs-api + js-ipfs adding directories is super fine
jonnycrunch has quit [Ping timeout: 244 seconds]
<haad> ok
jonnycrunch has joined #ipfs
<yoshuawuyts> daviddias: when are you arriving in Berlz?
<daviddias> yoshuawuyts: late night tomorrow, like landing 11pm
<daviddias> will you be there for DAppHack? :D
<yoshuawuyts> daviddias: ya they just emailed me to present on dat tech ✨ - figured since you're there I might as well haha
<yoshuawuyts> ^________^
<lgierth> daviddias: oh on thursday already
<lgierth> that's cool
<lgierth> yoshuawuyts: o/
<daviddias> yoshuawuyts: sweet! :D
jonnycrunch has quit [Ping timeout: 244 seconds]
<yoshuawuyts> wooooh! - excited to see y'all again :D
<daviddias> lgierth: yeah, tomorrow already, I guess I should have shared my flight details with you :) :)
<haad> daviddias: something went wrong with the latest merge commit to js-ipfs-api. it has a change to swarm.js and updating aegir to latest in package.json is missing
<daviddias> whyrusleeping: I've been seeing an increase of time to execute the IPNS tests in js-ipfs-api, it just took 52 seconds to complete
<haad> daviddias: nvm re. aegir, it was already updated in master
<victorbjelkholm[> daviddias yeah, guessing the increase is because the network in general is growing. More nodes = slower ipns
<daviddias> victorbjelkholm[: js-ipfs-api tests are made in an isolated network
<daviddias> disconnected from the global one
<daviddias> victorbjelkholm[: so although you are right, we might see a increase in delay overall, it should not affect js-ipfs-api tests
<victorbjelkholm[> Ooh, and it almost takes a minute? Wow
maxlath has joined #ipfs
jonnycrunch has joined #ipfs
Qwertie has quit [Ping timeout: 250 seconds]
<daviddias> dignifiedquire: "WARNING in DedupePlugin: This plugin was removed from webpack. remove it from configuration."
<daviddias> you probably know what is happening in Webpack land
<daviddias> I believe we were getting massive bundle rreduction with the DedupePlugin
<dignifiedquire> well the message is pretty clear, we can drop the dedupe plugin because it is enabled by default now
brimstone has joined #ipfs
jonnycrunch has quit [Ping timeout: 260 seconds]
Qwertie has joined #ipfs
<daviddias> "was removed" === "enabled by default"?
* Kubuxu is wondering why ipfs is not reporting local IP address
<Kubuxu> connecting the ethernet cable fixes the issue :p
<daviddias> Kubuxu: are you in a vpn?
<daviddias> Kubuxu: ahaha
herzmeister has quit [Quit: Leaving]
jonnycrunch has joined #ipfs
herzmeister has joined #ipfs
mildred3 has joined #ipfs
kaotisk has quit [Remote host closed the connection]
mildred2 has quit [Ping timeout: 260 seconds]
infinity0 has quit [Remote host closed the connection]
kenshyx has quit [Remote host closed the connection]
ipfs-sprint-help has joined #ipfs
<richardlitt> Please ignore the following test.
<richardlitt> ipfs-sprint-help: "This is a test" 99 http://hackmd.io https://zoom.us/call https://youtube.com/video
<richardlitt> ipfs-sprint-helper: "This is a test" 99 http://hackmd.io https://zoom.us/call https://youtube.com/video
phaenanthery has quit [Ping timeout: 245 seconds]
<richardlitt> Well, that's annoying.
<victorbjelkholm[> ah, if that's what I think it is, super useful! richardlitt
infinity0 has joined #ipfs
<richardlitt> It is.
ipfs-sprint-help has quit [Remote host closed the connection]
ipfs-sprint has joined #ipfs
<richardlitt> ipfs-sprint: "This is a test" 99 http://hackmd.io https://zoom.us/call https://youtube.com/video
<richardlitt> Huh. Ok, need to fix something.
ipfs-sprint has quit [Remote host closed the connection]
ipfs-sprint has joined #ipfs
jholden has joined #ipfs
<richardlitt> ipfs-sprint: "This is a test" 99 http://hackmd.io https://zoom.us/call https://youtube.com/video
* richardlitt goes back into a private channel, where this was previously working.
* richardlitt join #richardsbot
ipfs-sprint has quit [Remote host closed the connection]
pfrazee has joined #ipfs
<dignifiedquire> daviddias: haad docs theme work is happening here: https://github.com/dignifiedquire/clean-documentation-theme
sprint-helper has joined #ipfs
<dignifiedquire> victorbjelkholm[: ^^
<richardlitt> sprint-helper: "This is a test" 99 http://hackmd.io https://zoom.us/call https://youtube.com/video
<sprint-helper> ========================= IPFS Hangouts: This is a test =========================
<sprint-helper> Topic: This is a test
<sprint-helper> Sprint Issue: https://github.com/ipfs/pm/issues/99
<sprint-helper> Notes: http://hackmd.io
<sprint-helper> Join Call: https://zoom.us/call
<sprint-helper> Watch Stream: https://youtube.com/video
<sprint-helper> =============================================================================
<richardlitt> Sweet.
<dignifiedquire> nice richardlitt :)
<richardlitt> sprint-helper: "This is a bad test" 3jljl google.com
<sprint-helper> Correct usage: sprint-helper: <topic name> <github sprint issue number> <notes url> <zoom url> <stream url>
<richardlitt> Well, that's pretty cool.
<richardlitt> Now I just need to find a place where I can run it 24/7
<richardlitt> I guess Heroku would work for that? Do we have another server I could run it on?
<haad> dignifiedquire: got it re. docs
sprint-helper has quit [Remote host closed the connection]
<victorbjelkholm[> richardlitt: probably Heroku is the easiest atm
<victorbjelkholm[> richardlitt: btw, regarding https://github.com/ipld/website/issues/19#issuecomment-262330024, is the meaning that "Help Shape IPLD" would be the title of the section instead of "Community"?
<mg> Is there any mechanism in ipfs in which one can (not, like, mathematically) prove an upload, similar to bittorrent?
<victorbjelkholm[> mg: you can always download a file via the hash, then add it to IPFS again, and if the hash is the same, you should be good-to-go
<victorbjelkholm[> Sneak-peek of the new ipld website: http://beta.ipld.io
<mg> victorbjelkholm[: hmm
<Kubuxu> !pin QmdJrEas3iBogrrzriSuoP3NiANr2JvUc2b2kX1p4tGoE2 go-random
<pinbot> now pinning /ipfs/QmdJrEas3iBogrrzriSuoP3NiANr2JvUc2b2kX1p4tGoE2
<Kubuxu> !pin QmaFNtBAXX4nVMQWbUqNysXyhevUj1k4B1y5uS45LC7Vw9 go-fuse
<pinbot> now pinning /ipfs/QmaFNtBAXX4nVMQWbUqNysXyhevUj1k4B1y5uS45LC7Vw9
<mg> victorbjelkholm[: how about any mechanism to estimate the availability of some hash in the network? e.g. how many are hosting some file at the moment
<Kubuxu> mg: you can estimate it a bit with `ipfs dht findprovs` it will give you some estimate
<mg> Kubuxu: thanks
<victorbjelkholm[> mg: you can use "ipfs dht findprovs QmVZYWLJoQDxbMEEhLWGKgzz3eJZKKSSQKPdGZQofjiwE6" to find a list of the peers that can provide a value in the dht
<victorbjelkholm[> ah, ninjad...
<Kubuxu> !pin QmdcULN1WCzgoQmcCaUAmEhwcxHYsDrbZ2LvRJKCL8dMrK go-homedir
<pinbot> now pinning /ipfs/QmdcULN1WCzgoQmcCaUAmEhwcxHYsDrbZ2LvRJKCL8dMrK
<mg> Kubuxu, victorbjelkholm[: I get "Error: routing service is not a DHT", am I misconfigured in some way?
jokoon has quit [Quit: Leaving]
<victorbjelkholm[> mg: are you running the daemon?
<victorbjelkholm[> should ideally give you a "This command must be run in online mode", but you never know
<mg> victorbjelkholm[: not running daemon, so that was it
<victorbjelkholm[> mg: could you open an issue/find an existing one in ipfs/go-ipfs regarding the wrong error message?
<victorbjelkholm[> would be very helpful
<mg> victorbjelkholm[: sure :)
<victorbjelkholm[> thanks!
<Kubuxu> !pin QmSsEjZVtM49rDWFa1sNumNmw3rhihcqCRRtyaqyN92mTf go-detect-race
<pinbot> now pinning /ipfs/QmSsEjZVtM49rDWFa1sNumNmw3rhihcqCRRtyaqyN92mTf
<mg> victorbjelkholm[: it's the same error message for all dht commands according to the code, all using errors.New("routing service is not a DHT")
<mg> What is preferable?
<victorbjelkholm[> I'll let Kubuxu answer that as I'm not normally working on go-ipfs
<mg> I can submit a patch if it's just a matter of changing the text, if not I'll open an issue and go back to work :p
<victorbjelkholm[> guessing that all commands require you to be running the daemon
anewuser has joined #ipfs
<Kubuxu> mg: if you want to fix it look at core/commands/diag.go:102
<mg> Kubuxu: yeah, but should all dht commands use errNotOnline over ErrNotDHT?
Qwertie has quit [Ping timeout: 248 seconds]
Qwertie has joined #ipfs
<Kubuxu> errNotOnline
<Kubuxu> mg: both
<Kubuxu> first not online, and if online then check if routing is DHT
<mg> right. and checking n.Routing == nil is basically checking if online
<lgierth> Kubuxu: i got a bunch of package updates coming. anything you'd like me to include?
<lgierth> i got go-cid and its fanout
<Kubuxu> kevina was working on datastore it would be worth an update
<Kubuxu> but I don't know if it is ready
<richardlitt> victorbjelkholm[: Responded on GitHub.
<Kubuxu> also I have go-libp2p-pnet-interface update pending
<victorbjelkholm[> richardlitt: thanks!
<lgierth> Kubuxu: is pnet-interface already in there and just needs an update?
<Kubuxu> yes
<Kubuxu> just published 1.0.0 of pnet
<lgierth> minor nitpick: privnet is easier to recognize, but i figure it's too late for that :)
<Kubuxu> I am hoping to kill Godeps today
<Kubuxu> in go-ipfs
<lgierth> yay
<lgierth> <3
sprint-helper has joined #ipfs
sprint-helper has quit [Remote host closed the connection]
maxlath has quit [Ping timeout: 240 seconds]
ashark has joined #ipfs
<Kubuxu> js-ipfs-api test is green
<Kubuxu> WOWOW
<victorbjelkholm[> probably the swarm.peers fix that was merged today
<richardlitt> :D
trvon has joined #ipfs
lkcl has quit [Read error: Connection reset by peer]
<mg> Kubuxu: opened an issue for now, will have a look later
<lgierth> Kubuxu: unknown package in this round: go-libp2p-pnet-interface
<Kubuxu> interface-pnet
<Kubuxu> sorry :/
<lgierth> aah ok
<lgierth> wow that's a proper update
<richardlitt> lgierth: Did you see my messages? :)
sprint-helper has joined #ipfs
<richardlitt> hooray, sprint-helper workson Heroku.
<lgierth> richardlitt: yes yes!
sprint-helper has quit [Remote host closed the connection]
<richardlitt> I spoke too soon.
sprint-helper has joined #ipfs
sprint-helper has quit [Remote host closed the connection]
<lgierth> and yeah it published go-ipfs 5 times... it's pretty naive at the moment and doesn't do any real graphing of dependencies
pfrazee has quit [Remote host closed the connection]
sprint-helper has joined #ipfs
sprint-helper has quit [Remote host closed the connection]
Foxcool has quit [Read error: Connection reset by peer]
<daviddias> Kubuxu: ahaha nice :D
<daviddias> I'm sure whyrusleeping will also be super happy on that
Akaibu has quit [Ping timeout: 260 seconds]
<lgierth> if we make it to ccc we can make a code burning there
<lgierth> burn all the deleted code
Foxcool has joined #ipfs
Akaibu has joined #ipfs
<Kubuxu> Yeah, I have 10k today
<Kubuxu> not really deleted-deleted
<Kubuxu> but from-repo-deleted
<lgierth> that's what counts
<lgierth> #shitwedonthavetoworryabout
pfrazee has joined #ipfs
Axman6 has quit [Ping timeout: 268 seconds]
<Kubuxu> !pin QmTVvctiHWZzSDZdyU5wdnXh7VF3kprHSyQFwVChos5qKu
<pinbot> usage: !pin <hash> <label>
<Kubuxu> !pin QmTVvctiHWZzSDZdyU5wdnXh7VF3kprHSyQFwVChos5qKu go-golang-levenshtein
<pinbot> now pinning /ipfs/QmTVvctiHWZzSDZdyU5wdnXh7VF3kprHSyQFwVChos5qKu
<lgierth> Kubuxu: are they all going to gxed?
<Kubuxu> no, I am no pushing them
<Kubuxu> not pushing them
<Kubuxu> as those are not forks, just adding package.json
<lgierth> dunno, package.json seems pretty useful
IlanGodik has joined #ipfs
<Kubuxu> it is under hash already
<lgierth> a fork also gives us a way to see how far we're behind
<lgierth> behind upstream
ben___ has left #ipfs ["Textual IRC Client: www.textualapp.com"]
<lgierth> ah i fixed that thing about publishing go-ipfs multiple times
<lgierth> i failed to return an error
<lgierth> do you wanna go first with your gx things?
<Kubuxu> nah, it shouldn't conflict much
<lgierth> i'm ready ~now
maxlath has joined #ipfs
Qwertie has quit [Ping timeout: 245 seconds]
brianhoffman has joined #ipfs
<brianhoffman> hey guys quick question
<haad> ies, all test passing! heads up daviddias and dignifiedquire, there's a fairly fundamental refactoring PR coming in for how we handle streams (and chunked objects) in js-ipfs-api (mainly in request-api.js), along with pubsub
<brianhoffman> over at OpenBazaar we have a concern raised about people sending in malicious file paths to IPFS that would serve up files on the system outside of the directory structure intended to share
<brianhoffman> do you all have any protections in placel for that? is that a valid concern?
Qwertie has joined #ipfs
<brianhoffman> i.e. someone asks to retrieve /../../../familyPics/pic.png and serves up files above the ipfs share?
<brianhoffman> thoughts jbenet?
<lgierth> brianhoffman: unless you're using the /ipfs FUSE mount that's not a concern
<lgierth> since .. is not a valid multihash
<lgierth> and .. is also not a valid path namespace
<Kubuxu> lgierth: he means object with link {'../hax': 'QmXXX}
<Kubuxu> that you would latter `ipfs get`
<lgierth> well slashes in link names are not addressable
<lgierth> ah
<lgierth> slashes in link names are kinda undefined behaviour
<Kubuxu> just tired it: ipfs object patch add-link QmbFMke1KXqnYyBBWxB74N4c5SBnJMVAiMNRcGu6x1AwQH '../hax' QmeomffUNfmQy76CQGy9NdmqEnnHU9soCexBnGU3ezPHVH
<Kubuxu> Error: no link by that name
<Kubuxu> but I don't know about precrafter object
disgusting_wall has joined #ipfs
<lgierth> everything expects that it can safely split a path at a forward-slash
<brianhoffman> so you’re saying it is possible or is not?
Axman6 has joined #ipfs
<brianhoffman> we’re trying to decide how much wokr we put into doing validation of paths on our side
<Kubuxu> just hand crafted block like that and it doesn't sanitise in go-ipfs: ipfs object patch add-link QmbFMke1KXqnYyBBWxB74N4c5SBnJMVAiMNRcGu6x1AwQH '../hax' QmeomffUNfmQy76CQGy9NdmqEnnHU9soCexBnGU3ezPHVH
<Kubuxu> Error: no link by that name
<lgierth> i don't know, what specific case are you thinking about
<Kubuxu> it shouldn't be possible on our side
<Kubuxu> if it is, it is serious bug
<lgierth> yeah i don't trust that what object/patch does is the same everywhere
<lgierth> we have too much duplication to be sure
disgusting_wall has quit [Client Quit]
<brianhoffman> the gist is that we allow users to define a slug for their files and they could put those malicious paths in as the slug name
<Kubuxu> it would be more of, would block with path like this be read
<lgierth> most interesting spots for this are `ipfs get` and the fuse code, everything else i'm not worried at all
<brianhoffman> so just wondering if XSS vulnerability could expose file system
<Kubuxu> lgierth: they are reading links on their own
Aranjedeath has joined #ipfs
<lgierth> brianhoffman: just prevent them from putting forward-slashes in link names
<lgierth> note that link names should not be used as free-form labels
<brianhoffman> is that really enough to keep people from violating this issue though?
<lgierth> i don't know, i have a hard time understanding how you get from an object link name to "iterating the filesystem" :)
<Kubuxu> brianhoffman: where does the slug comes from
<brianhoffman> neither do i i’m trying to convey someone else’s concern right now lol
<brianhoffman> I asked Justin to come in here and explain
<brianhoffman> so hopefully he will join
<brianhoffman> so a user defines the slug on their own system
<brianhoffman> so I can create an OpenBazaar contract and name it my-contract-for-a-car as the slug name
<brianhoffman> when someone visits my OB store they request that link
<lgierth> something like /ipns/Qmsomething/the-slug?
<brianhoffman> but if someone requests /../../../../important-file instead will they get my OS files?
<lgierth> no they definitely won't
<lgierth> unless you do something very stupid with the http reverse proxy config
<Kubuxu> ^^ +1
ulrichard has quit [Ping timeout: 250 seconds]
<brianhoffman> exploit code is like
<brianhoffman> toDelete := path.Join(n.RepoPath, "root", "listings", slug+".json")
<brianhoffman> err := os.Remove(toDelete)
<brianhoffman> if we just let someone tell us what they wanted “slug” to be
<Kubuxu> then yes, but it isn't connected with IPFS in any way
konubinix has quit [Quit: ZNC - http://znc.in]
<Kubuxu> if slug is fully user defined, then they can do whatever they want
<lgierth> yeah don't do stupid things and say it's ipfs's fault :D:D
<lgierth> haha
<lgierth> you don't need the local fs at all if you have everything stored in ipfs
konubinix has joined #ipfs
<brianhoffman> got you
<brianhoffman> yes it’s two separate issues i conflated on my side
<brianhoffman> but the ipfs concern seems unfounded
<brianhoffman> that’s good. thank you.
<lgierth> you can put something like varnish in front of the gateway though if that'd speed things up in your case
<brianhoffman> this is p2p software so people won’t be setting up varnishes in most cases
<brianhoffman> anyone setting up a full gateway might though
JustinDrake has joined #ipfs
<victorbjelkholm[> daviddias: can't get js-ipfs to work between node and browser. It's supposed to work right?
<lgierth> brianhoffman: yeah the full gateway was what i was thinking. if you have lots of ram but only slow spinning disks it's useful to disk accesses
<brianhoffman> yeah we probably will set one up for our gateway that we have
<brianhoffman> not that far along yuet
<brianhoffman> we will be releasing a Milestone 1 version of the IPFS OpenBazaar soon though
<brianhoffman> probably will mess around with that then
<JustinDrake> Hi, Justin here from Duo Search (www.duosear.ch), working on OpenBazaar.
<brianhoffman> ^ fellow I was chatting about before
<brianhoffman> you can read up and see if I expressed your concern properly and clarify if necessary
<JustinDrake> I've been poking around with IPFS, love it! Very happy with the decision by the OB team to use IPFS.
<lgierth> brianhoffman: cool, looking forward to M1! :)
<lgierth> hey justin o/
<lgierth> i'll be back in a few
ylp1 has quit [Quit: Leaving.]
domanic has quit [Ping timeout: 268 seconds]
kulelu88 has joined #ipfs
PseudoNoob has joined #ipfs
PseudoNoob has quit [Ping timeout: 250 seconds]
Foxcool_ has joined #ipfs
ygrek has joined #ipfs
<haad> dignifiedquire: daviddias: here's the stream refactoring I mentioned earlier, would love to get CR https://github.com/haadcode/js-ipfs-api/commit/1087960d2506cf44b428c974d8e70f9fd5c45742
<haad> and victorbjelkholm[ ^
<haad> and the refactored and completed pubsub API is here: https://github.com/haadcode/js-ipfs-api/commit/48528f7c075d3993d061a91541208985afa600e2
<haad> also up for CR
Foxcool has quit [Ping timeout: 268 seconds]
PseudoNoob has joined #ipfs
<JustinDrake> IPFS, IPLD, IPRS, IPNS => Did I miss any IP* acronyms?
jholden has quit [Ping timeout: 265 seconds]
<lgierth> ipget, which is a simple wget-like tool
dbri4 has joined #ipfs
dbri has quit [Write error: Broken pipe]
<lgierth> and IPDB, but that really isn't an ipfs thing
Qwertie has quit [Ping timeout: 256 seconds]
eibriel has quit [Quit: Leaving.]
Soft has quit [Read error: Connection reset by peer]
Qwertie has joined #ipfs
lkcl has joined #ipfs
A124 has quit [Ping timeout: 250 seconds]
A124 has joined #ipfs
Foxcool_ has quit [Read error: Connection reset by peer]
ulrichard has joined #ipfs
eibriel has joined #ipfs
sprint-helper has joined #ipfs
sprint-helper has quit [Remote host closed the connection]
<seharder> Help! I am still trying to npm install js-ipfs on ubuntu server with no success.
<seharder> I just created a clean install of Ubuntu Server on virtual box. Getting error with sha3@1.2.0 error.
<seharder> This may be my problem but I'm beginning wonder if it's something else.
<kevina> Kubuxu, lgierth: This PR is pending and should be merged soon https://github.com/ipfs/go-datastore/pull/54
ulrichard has quit [Remote host closed the connection]
ylp has quit [Ping timeout: 260 seconds]
ylp has joined #ipfs
webi has joined #ipfs
webi has quit [Client Quit]
rgrinberg has joined #ipfs
webi has joined #ipfs
Foxcool_ has joined #ipfs
<dignifiedquire> seharder: there might some dependencies missing
<seharder> I noticed it choked on Python so I am install it now.
<dignifiedquire> right you will need a working node-gyp toolchain
<dignifiedquire> seharder: https://github.com/nodejs/node-gyp/blob/master/README.md for details
<seharder> Thanks!
Foxcool_ has quit [Ping timeout: 245 seconds]
JustinDrake has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
jholden has joined #ipfs
<lgierth> seharder: is the node-gyp info missing from the readme?
<lgierth> if yes it would be good to add it
espadrine has quit [Ping timeout: 268 seconds]
<seharder> lgierth: I did a search on the readme for node-gyp and it found no results.
<seharder> lgierth: I would be happy to create an issue and add it.
<seharder> However,
jholden has quit [Ping timeout: 260 seconds]
<lgierth> just saying, anyone else might stumble upon it as well and not everyone is as persistent as you :)
<seharder> However, after installing node-gyp I have the same error: sha31.2.0 install: 'node-gyp rebuild'
<seharder> More specifically: Failed at the sha3@1.2.0 install script 'node-gyp rebuild'.
<richardlitt> daviddias: where is js-iprs?
sametsisartenep has joined #ipfs
tmg has quit [Ping timeout: 260 seconds]
kenshyx has joined #ipfs
ygrek has quit [Ping timeout: 260 seconds]
bastianilso__ has quit [Ping timeout: 260 seconds]
<daviddias> in the future?
<richardlitt> No, in the now
<richardlitt> I'm guessing it doesn't exist, and this is another example of having links to repos which aren't there?
s_kunk has quit [Ping timeout: 260 seconds]
<daviddias> it doesn't seem that who wrote that file was really pointing to the repos, just creating placeholders, I guess
rgrinberg has quit [Ping timeout: 258 seconds]
Qwertie has quit [Ping timeout: 246 seconds]
sametsisartenep has quit [Quit: leaving]
rgrinberg has joined #ipfs
Encrypt has joined #ipfs
Qwertie has joined #ipfs
<seharder> OK, I finally got npm install working. :)
ygrek has joined #ipfs
Encrypt has quit [Quit: Quit]
trvon has quit [Remote host closed the connection]
trvon has joined #ipfs
bastianilso__ has joined #ipfs
pfrazee has quit [Remote host closed the connection]
pfrazee has joined #ipfs
strauberry has joined #ipfs
<kenshyx> seharder: how? :D
pfrazee has quit [Ping timeout: 245 seconds]
<seharder> kenshyx: that's a good question.
<seharder> kenshyx: I'll have to go through it again to see what steps are important.
<seharder> I have a new error now when trying to init a repo: TypeError: base64 is not a function
<seharder> On this line: /home/sid/git/js-ipfs/node_modules/libp2p-crypto/src/crypto/util.js:18
<seharder> return new BN(Buffer.from(str, 'base64'))
<seharder> Is this still an install issue?
bastianilso___ has joined #ipfs
<lgierth> pls write the node-gyp solution down in that issue +1
bastianilso__ has quit [Ping timeout: 248 seconds]
<richardlitt> :/
<richardlitt> Ok. I am giving up on Heroku and running my bot.
<richardlitt> Which means it will not be a good bot, because it won't be here much. Heroku keeps setting dynamic bots, but I need the range to be restricted for it to work with IRC; I basically can't have ipfs-sprint-helper connect on 6667, so I can't use Heroku to host it.
<richardlitt> lgierth: Is there another server I can use to run a small node IRC bot?
<whyrusleeping> richardlitt: sprint time?
<richardlitt> Yeah; working on getting the video up now
<whyrusleeping> woo! thanks
pfrazee has joined #ipfs
<richardlitt> Connectivity in this café is worse than I expected, taking a bit for me to load.
z0mfg has left #ipfs ["memory allocation failure"]
<lgierth> ok zoom link?
<richardlitt> Still trying.
sprint-helper has joined #ipfs
<richardlitt> First time coming to this cafe, not coming again it seems
<lgierth> can someone else host the zoom call and record?
<richardlitt> I can't connect to the call
<kevina> zoom link?
<richardlitt> I am on, it is just taking ages
<richardlitt> Someone else will have to initially host it
<richardlitt> wait, got it
<sprint-helper> ========================= IPFS Sprint: go-ipfs =========================
<sprint-helper> Topic: go-ipfs
<sprint-helper> Join Call: https://zoom.us/j/3339991818
<sprint-helper> Watch Stream: http://github.com/ipfs/pm/issues/258
<sprint-helper> Sprint Issue: https://github.com/ipfs/pm/issues/258
<sprint-helper> ====================================================================
<richardlitt> Stream is not going to be up today, as dignifiedquire is not around. Kubuxu, if you could stream, that would be good.
<lgierth> please mute everybody
<richardlitt> daviddias: made you the host
<richardlitt> please record this
<richardlitt> I am going to have to drop out, my connexion won't take this
<daviddias> recording
<richardlitt> Thank you
<daviddias> I got this! :D
<richardlitt> The good news is that sprint-helper totally worked!
<victorbjelkholm[> Woho! Great job
<richardlitt> But sadly, only while I ran it on my own terminal
<victorbjelkholm[> fun with the links twice :)
<richardlitt> If anyone wants to help me host it on a server that doesn't dynamically assign ports (looking at you, Heroku), would be awesome to do that.
sprint-helper has quit [Remote host closed the connection]
lkcl has quit [Ping timeout: 248 seconds]
JustinDrake has joined #ipfs
<victorbjelkholm[> whyrusleeping: daviddias what about CircleCI's OSX support?
ianopolous has joined #ipfs
<Mateon1> I missed the start of the call, can I still join in and listen? (didn't expect one as it's wednesday)
s_kunk has joined #ipfs
<lgierth> Mateon1: sur
<richardlitt> Mateon1: Yes!
ulrichard has joined #ipfs
lkcl has joined #ipfs
elico has joined #ipfs
ylp has quit [Ping timeout: 260 seconds]
ylp has joined #ipfs
<richardlitt> Let me know when ya'll need another libp2p notification
sprint-helper has joined #ipfs
<daviddias> victorbjelkholm[: for what Kubuxu wants to test, fuse, CI might not be the best, I'm up for anything that is automation though :)
<Kubuxu> I also discovered why our travis is so slow
<Kubuxu> they have constant 300+ backlog in OSX builds
<victorbjelkholm[> richardlitt: right about now
<richardlitt> sprint-helper: "libp2p" 258 https://hackmd.io/EYJgDAZgjCAmEFoBsBmYSEBYQEMCmCwAxngcLJlAOzB5JUCsOUQA https://zoom.us/j/3339991818 "Currently disabled: Join the call and turn your video and sound off."
<sprint-helper> ========================= IPFS Sprint: libp2p =========================
<sprint-helper> Topic: libp2p
<sprint-helper> Join Call: https://zoom.us/j/3339991818
<sprint-helper> Watch Stream: Currently disabled: Join the call and turn your video and sound off.
<sprint-helper> Sprint Issue: https://github.com/ipfs/pm/issues/258
<sprint-helper> ===================================================================
<richardlitt> Man, I like this.
<victorbjelkholm[> daviddias: ah, I can help you again Kubuxu if you want to test out the FUSe stuff you're working on
<victorbjelkholm[> daviddias: regarding website, nothing to preview yet, rushing to get ipld.io finished first :/
<victorbjelkholm[> Kubuxu: sure, I'll try it later
<Kubuxu> thank you
anewuser has quit [Read error: Connection reset by peer]
sprint-helper has quit [Remote host closed the connection]
JustinDrake has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
cubemonkey has joined #ipfs
Qwertie has quit [Ping timeout: 265 seconds]
lacour has joined #ipfs
JustinDrake has joined #ipfs
Encrypt has joined #ipfs
<lgierth> richardlitt: let's put the notes above the agenda in the sprint templates
<lgierth> this is so annoying
mib_kd743naq has joined #ipfs
<mib_kd743naq> hi
<mib_kd743naq> is there a reason go-ipfs tries to keep all link blocks within roughly 8k? https://github.com/ipfs/go-ipfs/blob/master/importer/helpers/helpers.go#L21
Qwertie has joined #ipfs
<mib_kd743naq> is there a downside of creating a block full of links that is much closer to the 1mb soft-limit for blocks in general?
<Kubuxu> mib_kd743naq: there is balance in blocksize
<Kubuxu> in case of links you want to fan up quite quickly
<Kubuxu> so you can fetch data blocks
<Kubuxu> and first data byte
<Kubuxu> but you don't want to spend ages downloading link block
pfrazee has quit [Quit: pfraze has joined]
<Kubuxu> when you want to just traverse one branch
<Kubuxu> imagine tree of depth 4 but with link block size of 1MiB
lacour has quit [Client Quit]
<victorbjelkholm[> daviddias, in case you missed: regarding website, nothing to preview yet, rushing to get ipld.io finished first :/
<Kubuxu> or tree of depth 8 but with blocks of 8K
<Kubuxu> in case of first you will download 4MiB just to traverse to one byte
<Kubuxu> in the second it will be just 64k.
<Kubuxu> math might be wrong but this is the concept
<Kubuxu> mib_kd743naq: ^^
<mib_kd743naq> Kubuxu: right, but if you want the whole file, you will end up downloading more in case of excessive tree depth, as each link is nontrivial overhead
<mib_kd743naq> correct?
<Kubuxu> yes
<mib_kd743naq> ok thanks
pfrazee has joined #ipfs
trvon has quit [Ping timeout: 256 seconds]
<mib_kd743naq> Kubuxu: is the "time to first byte" part important? I feel like I am missing something obvious
JustinDrake has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
JustinDrake has joined #ipfs
JustinDrake has quit [Client Quit]
webi has quit [Quit: leaving]
feross has left #ipfs [#ipfs]
<lgierth> hackmd.io kept confusing my caret
JustinDrake has joined #ipfs
reit has quit [Ping timeout: 260 seconds]
<Kubuxu> mib_kd743naq: yes, when you are streaming media for exampel
<mib_kd743naq> nod, makes sense
JustinDrake has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
<dansup> Kubuxu, oh cool, thanks for sharing
reit has joined #ipfs
ulrichard_ has joined #ipfs
arpu has quit [Ping timeout: 260 seconds]
kenshyx has quit [Quit: Leaving]
apiarian has quit [Ping timeout: 240 seconds]
apiarian has joined #ipfs
<pfrazee> daviddias: hey you have any thoughts about what's happening with https://github.com/ipfs/js-ipfs-api/issues/443 ?
<daviddias> oh, we never added a test to check the behaviour when there is no go-ipfs daemon
<daviddias> checking
<pfrazee> cool thanks
arpu has joined #ipfs
<daviddias> pfrazee: this should solve it for you https://github.com/ipfs/js-ipfs-api/pull/445
<daviddias> tried with the examples
<daviddias> and it doesn't throw uncaught exceptions anymore and the error is propagated to the callback/promise as expected
<daviddias> want to try it out?
<pfrazee> daviddias: much obliged, 1 moment while I clone and set it up
tidux[m] has joined #ipfs
<victorbjelkholm[> daviddias: maybe you missed my earlier question so I'll ask again. I seem to remember that js-ipfs on node and in the browser should be able to communicate with each other, is that true? If so, I need to do something special? Can't get it to work with my js-ipfs-passing-data example
<victorbjelkholm[> I'm using the webrtc signaling server for both of them
<daviddias> victorbjelkholm[: libp2p-webrtc-star works on nodejs now, but libp2p-ipfs hasn't been updated to enable that transport by default
<daviddias> it is a small change
<victorbjelkholm[> ah, but if I force-set the address in js-ipfs config, should work?
<victorbjelkholm[> hm, with that link, not sure what I have to do
<daviddias> victorbjelkholm[: not only the address, but also needs to have a libp2p build that has the transport
<daviddias> libp2p-ipfs and libp2p-ipfs-browser as just bundles of network modules
<victorbjelkholm[> oh, I see. So the node version of libp2p-ipfs doesn't have the webrtcstar transport yet, if I understand correctly?
<victorbjelkholm[> I'm a bit worried about doing a video player example, if we cannot seed content via node then...
<daviddias> it doesn't, because it hasn't been updated
<daviddias> as simple as that ^^ :)
<victorbjelkholm[> ah, I'll give it a try then
<daviddias> awesome :)
ulrichard_ has quit [Ping timeout: 268 seconds]
Qwertie has quit [Ping timeout: 265 seconds]
ianopolous has quit [Ping timeout: 256 seconds]
Qwertie has joined #ipfs
Qwertie has quit [Changing host]
Qwertie has joined #ipfs
<pfrazee> daviddias: it's taking me a sec because I have to use a custom build of peer-id. You might find this interesting: https://github.com/beakerbrowser/js-peer-id
<victorbjelkholm[> daviddias: sorry, got stuck on something now, can you verify that "swarm peers" is working and printing peers for you?
<daviddias> pfrazee: interesting :)
<daviddias> so, no crypto operations ?
<daviddias> how are you doing the hashing?
<pfrazee> daviddias: fully story - the webcrypto deps of libp2p-crypto want to build against open ssl. I have to build from source in electron due to funkiness with the ABI. MacOS doesnt use openssl anymore and tries to keep you from doing it. Thus, my problem
<daviddias> victorbjelkholm[: in js-ipfs latest?
<victorbjelkholm[> daviddias: yup, in node
<victorbjelkholm[> cli
<pfrazee> daviddias: afaict, the ipfs-api only needs libp2p-crypto to generate keypairs, but it *appears* that I dont need to do that. So my stripped build works
<victorbjelkholm[> doing some debugging and doesn't even seem to call core/components/swarm#peers for me
<daviddias> pfrazee: I was just mentioning that on the libp2p call, the benefits of using WebCrypto (reduced bundle size, tons of perf improv in crypto operations), has left us with that ugly dependency install
<daviddias> victorbjelkholm[: ah, you mean, you do jsipfs daemon and then jsipfs swarm peers doesn't show anything?
<pfrazee> daviddias: yeah. Tough tradeoff. Since I'm just calling out to the go daemon, I think/hope I can avoid it
haad has quit [Quit: reboot]
<daviddias> victorbjelkholm[: that might just because you are not connected to anyone?
<victorbjelkholm[> daviddias: yeah, exactly, even with two jsipfs instances locally
<victorbjelkholm[> no, outputted the array coming from the call, is empty as well
Guest2 has joined #ipfs
Guest2 has quit [Client Quit]
<daviddias> victorbjelkholm[: you have to connect them
<victorbjelkholm[> trying to force-connect them with "/ip4/127.0.0.1/tcp/4002" and get "Error: multiaddr not valid"
<daviddias> jsipfs id, pick one of the addrs of your local network
<victorbjelkholm[> ay
<daviddias> you need to include the /ipfs/QmHash
<victorbjelkholm[> ofc, thanks... :/
<daviddias> I guess we need better error logs with suggestions
<daviddias> works now?
<victorbjelkholm[> silly me, yeah, everything is working
<victorbjelkholm[> thanks for catching my silly mistakes
<daviddias> hey, no problem! Happy that is working 😃)
<victorbjelkholm[> me too! :D
Guest2 has joined #ipfs
<daviddias> once that go-ipfs 0.4.5 is released (which means interop with js-ipfs) I'll add update and add mdns again
<kevina> whyrusleeping: any other place where the datastore Query method is used (other then the Blockstore and providers)?
<daviddias> so that it is all seemless for the discovery of LAN nodes
ylp has quit [Ping timeout: 260 seconds]
ylp has joined #ipfs
JustinDrake has joined #ipfs
rendar has quit [Quit: Leaving]
brianhoffman has quit [Read error: No route to host]
ulrichard_ has joined #ipfs
mib_kd743naq has quit [Ping timeout: 260 seconds]
ianopolous has joined #ipfs
JustinDrake has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
ulrichard_ has quit [Remote host closed the connection]
ylp has quit [Ping timeout: 260 seconds]
ylp has joined #ipfs
<pfrazee> daviddias: https://github.com/ipfs/js-ipfs-api/pull/445 looks like a winner
wallacoloo_ has joined #ipfs
palkeo has joined #ipfs
quim has joined #ipfs
JustinDrake has joined #ipfs
domanic has joined #ipfs
cubemonkey has quit [Ping timeout: 244 seconds]
espadrine has joined #ipfs
cubemonk1y has joined #ipfs
Qwertie has quit [Ping timeout: 258 seconds]
kpcyrd has quit [Quit: WeeChat 1.0.1]
kpcyrd has joined #ipfs
Guest2 has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
Qwertie has joined #ipfs
ashark has quit [Ping timeout: 244 seconds]
slothbag has joined #ipfs
JustinDrake has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
<whyrusleeping> kevina: I think thats it
PseudoNoob has quit [Remote host closed the connection]
<kevina> whyrusleeping: okay, everything should be good to go pending review...
<kevina> there are 5 related pull requests, two of them of in go-ipfs
quim has quit [Ping timeout: 265 seconds]
rgrinberg has quit [Remote host closed the connection]
Encrypt has quit [Quit: Sleeping time!]
Powersource has joined #ipfs
elico has quit [Quit: Leaving.]
JustinDrake has joined #ipfs
vtomole has quit [Ping timeout: 260 seconds]
A124 has quit [Remote host closed the connection]
ulrichard has quit [Remote host closed the connection]
A124 has joined #ipfs
wallacoloo_ has quit [Quit: wallacoloo_]
<Powersource> does js-ipfs work by going through ipfs.io/ipfs?
galois_d_ has joined #ipfs
ZaZ has quit [Read error: Connection reset by peer]
cubemonk1y has quit [Read error: Connection reset by peer]
galois_dmz has quit [Ping timeout: 260 seconds]
Kane` has quit [Remote host closed the connection]
<Mateon1> Powersource: No, it runs an actual node.
<Mateon1> If you want something more lightweight, you can run a service worker and capture network requests. If it's an IPFS request you can try redirecting it to (in order): a browser builtin with fs:/ipfs/... ipfs:// ; a localhost gateway; and ipfs.io.
<Powersource> Mateon1: but how does it work if it's limited to http?
<Mateon1> Powersource: It's not limited to HTTP, it uses web sockets (to go-ipfs nodes) and WebRTC to other js nodes
<Powersource> oh damn I need to read up
Qwertie has quit [Ping timeout: 240 seconds]
<Mateon1> daviddias: Care to upload the sprint call recording to IPFS?
Qwertie has joined #ipfs
JustinDrake has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
<seharder> daviddias: I just finished testing js-ipfs on ubuntu with ipv4 and ipv6 on port 5001, daemon is not choking. :)
<seharder> daviddias: Looks like https://github.com/ipfs/js-ipfs/issues/228 is fixed!
IlanGodik has quit [Quit: Connection closed for inactivity]
kvda has joined #ipfs
vtomole_ has joined #ipfs
cehteh has quit [Ping timeout: 260 seconds]
bastianilso____ has joined #ipfs
bastianilso___ has quit [Ping timeout: 250 seconds]
maxlath has quit [Quit: maxlath]
herzmeister has quit [Quit: Leaving]
lidel has quit [Ping timeout: 246 seconds]
herzmeister has joined #ipfs
seharder_ has joined #ipfs
palkeo has quit [Quit: Konversation terminated!]
seharder_ has left #ipfs [#ipfs]