whyrusleeping changed the topic of #ipfs to: IPFS - InterPlanetary File System - https://github.com/ipfs/ipfs -- channel logged at https://botbot.me/freenode/ipfs/ -- code of conduct at https://github.com/ipfs/community/blob/master/code-of-conduct.md -- sprints + work org at https://github.com/ipfs/pm/ -- community info at https://github.com/ipfs/community/
reit has joined #ipfs
<whyrusleeping> jbenet: thoughts on making the default yamux transport in go-peerstream use 512k window size?
<whyrusleeping> its the one that gets used by multistream, which means its whats used by go-ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<whyrusleeping> jbenet: https://github.com/ipfs/go-ipfs/pull/1473 <- RFM
<alu> guys
<alu> this is so cool
<alu> let me make a photo album
<whyrusleeping> alu: more VR goodness?
<alu> Yeah
<alu> One sec, ill upload so you can see
* whyrusleeping is excited
<alu> you best be, this is historical
<alu> heres a preview
<alu> check that out in a web browser
<whyrusleeping> pretty
<alu> okay
<alu> so that is a 2D web page
<alu> Now when I open that link up in janusVR
<alu> I get a 3D virtual reality room as well !! https://u.teknik.io/68Gf2C.png
<whyrusleeping> haha, nice!
<alu> also!!
<alu> It's multiserver! https://u.teknik.io/Wse2bB.jpg
<whyrusleeping> oooOoo
<alu> thats someone from australia [opposite corner of the world] in my room!!
<alu> on my 2d/3d web page!
<jbenet> alu that's pretty cool
<alu> Now I have a question, is that person also seeding the room?
<alu> he doesn't have ipfs
<alu> so how can he become a peer ?
<jbenet> alu: are they accessing via gateway.ipfs.io, or what?
<alu> yes
<jbenet> alu: then no, for now they're just viewing (once we have node-ipfs they will be able to seed too just from the gateway). we should talk about how to make this work with ipfs now, like people installing ipfs locally.
<jbenet> alu: i presume they're already installing something?
www1 has quit [Ping timeout: 252 seconds]
<jbenet> whyrusleeping: 512k window size? does it always allocate those buffers? cause * N conns?
<alu> they hhave a cache of the content yeah
<jbenet> cyberwizardry.
<daviddias> needs more sparkles to be a proper party
<jbenet> substack o/
<substack> A+
<jbenet> alu: what program do they install?
<alu> if I make a change to the files
<alu> how do people update ?
<jbenet> alu: they can update with an `/ipns/...` name
<alu> I'll have to try that sometime
<alu> They download JanusVR
<alu> janusvr.com
<alu> brb i have to get recycling
<jbenet> YOU WILL BE MERKELIZED
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<lgierth> jbenet: i need to take one pic of you for my ipfs poster
<lgierth> with a very subtle merkel pun
queue has joined #ipfs
qqueue has quit [Ping timeout: 256 seconds]
<alu> Hmm
<alu> is there a discussion going on for node-ipfs
<alu> because if we can get others to seed that'd be great, but I also see potential risk
<alu> for the spread of malware
www has joined #ipfs
alu has quit [Quit: WeeChat 0.3.8]
<whyrusleeping> jbenet: no, its not for allocation, its for breaking outgoing packets
<whyrusleeping> with window size == 256k, any packet larger than 256k will be broken up into two separate transmissions
<whyrusleeping> which incurs an extra RTT on sending the block
<jbenet> @lgierth haha sounds good
<jbenet> whyrusleeping whats curr window size
<jbenet> ?
<whyrusleeping> 512k
<jbenet> whyrusleeping: ah sure
<whyrusleeping> we define our own yamux transport in the stream.go file
<whyrusleeping> but using multistream, we use the 'default transports'
<whyrusleeping> i guess i could make the 'multistream transport' take a windowsize and then have it create the child transports
reit has quit [Ping timeout: 250 seconds]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<whyrusleeping> but thats more godep hell
<whyrusleeping> i would rather do something really hacky than have to mess with godep again
<jbenet> whyrusleeping you could pass a transport to multistream to set it up.
<whyrusleeping> i would rather put if rand() % 1000 == 0 {panic('aaaaaaah')} in our code somewhere than mess with godeps again
<jbenet> whyrusleeping like, i setup my multistream with a map of ids to the transports i want.
<jbenet> whyrusleeping: fix gx and let's ditch godeps then :)
<whyrusleeping> yeah, thats probably the right way to do it
<whyrusleeping> i need ipnsssssss
<whyrusleeping> s/need/really want/
<rschulman> whyrusleeping: me toooooooooo
<rschulman> :)
Wallacoloo has joined #ipfs
rht___ has joined #ipfs
tperson has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<jbenet> so sometimes i need to reboot my node, and things will resovle.
<jbenet> but i am connected to others, inc gateways. not sure if i'm really connected or the conns are stale.
<jbenet> (things i publish will resolve) *
<rht___> how big is the bottleneck to replace godeps?
<jbenet> whyrusleeping so you want me to merge https://github.com/ipfs/go-ipfs/pull/1473#issuecomment-121403395 or wait?
<jbenet> rht___ there's some improvements to make to https://github.com/whyrusleeping/gx
<jbenet> hey rht___ are the latest goprocess changes in go-ipfs/master now?
border has joined #ipfs
<rht___> actually not yet because godeps
<jbenet> rht___ ah fun. godeps is painful.
<jbenet> whyrusleeping: what needs to happen to gx?
<jbenet> can we ditch godeps for good? (i'm borderline to using a shell script :) )
<jbenet> also, rht___ mind if i reassign some other issues? #143 is lower prio, #1418 has kbala and lgierth on it atm (may still need help later, but atm may be more trouble coordinating changes)
<jbenet> #1353 would be good to have, but needs a bit of work discussing before doing. (we could do something like git's ref logs (which are just text files) or make them proper ipfs objects.
<rht___> sure, I pick #143 just to settle if /dev/urandom is fine (and why gpg is not using it)
Leer10 has quit [Ping timeout: 255 seconds]
<rht___> (but golang's openpgp uses /dev/urandom ... stuff like this)
Leer10 has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<rht___> gx: every update to deps will have to change the hashes of the import statement in the sources?
<jbenet> rht___ i think we came up with a way to prevent the hashes from changing everywhere (though i personally dont mind that too much)
<rht___> but shouldn't the versioning (especially that it is not human readable. code is meant to be readable) be localised to the package manager json file?
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<jbenet> alu: i emailed the janusvr folks. i'll keep you posted if anything good comes up.
<jbenet> rht___ yeah, maybe. and maybe not. the "package.json" may be too far out.
<rht___> unless there is auto import tool (e.g. goimports), then I'd have to copy the hash manually
<jbenet> it may be that a single file is all you need per module (think npm but even more modular)
<jbenet> rht___ yeah granted, that'd be annoying :)
joshbuddy has quit [Quit: joshbuddy]
<rht___> > it may be that a single file is all you need per module ...
<rht___> this is only possible if the package manager has a knowledge that the file doesn't depend on other parts of the module
queue has quit [Ping timeout: 244 seconds]
<Tv`> jbenet: status update! i burned a bunch of time for Gophercon, needed these two days to just catch up, but have time for ipfs again during the rest of this week; lmk if you have something lined up.
<Tv`> whyrusleeping: https://github.com/ipfs/go-ipfs/pull/1225 looks like it can be closed, right?
Wallacoloo has left #ipfs [#ipfs]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<Tv`> akshully, not sure if you want to close pulls once they're in dev or master
<tperson> I love git, it would appear every command you run is track, not only your source tree (git reflog)
<tperson> jbenet: Decided as part of this readonly gateway I'm going to start writing the api test spec. As I feel there needs to be better test coverage for the API.
<Tv`> fuse/readonly/ipfs_test.go:39: too many arguments in call to importer.BuildTrickleDagFromReader
<tperson> When playing around with the ipfs-blob-store I was getting some errors when running against the read-only branch.
<ipfsbot> [go-ipfs] tv42 force-pushed s3 from f857e0d to ba6686b: http://git.io/vmnzd
<ipfsbot> go-ipfs/s3 4cf9ead Tommi Virtanen: Remove dead code
<ipfsbot> go-ipfs/s3 95299bf Tommi Virtanen: core tests: Stop assuming internals of Config
<ipfsbot> go-ipfs/s3 611ddd9 Tommi Virtanen: Fix BuildTrickleDagFromReader call args
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
www has quit [Ping timeout: 246 seconds]
<ipfsbot> [go-ipfs] tv42 force-pushed s3 from ba6686b to dda3c6a: http://git.io/vmnzd
<ipfsbot> go-ipfs/s3 b0dd235 Tommi Virtanen: Remove dead code...
<ipfsbot> go-ipfs/s3 77f6941 Tommi Virtanen: core tests: Stop assuming internals of Config...
<ipfsbot> go-ipfs/s3 e233d4f Tommi Virtanen: sharness: Stop assuming leveldb Datastore...
<ipfsbot> [go-ipfs] rht opened pull request #1480: Bump goprocess (master...godep) http://git.io/vmnVM
simonv3 has quit [Quit: Connection closed for inactivity]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
patcon has joined #ipfs
<ipfsbot> [go-ipfs] jbenet pushed 2 new commits to master: http://git.io/vmnKp
<ipfsbot> go-ipfs/master 3089eba rht: Bump goprocess...
<ipfsbot> go-ipfs/master 7ba49f1 Juan Batiz-Benet: Merge pull request #1480 from rht/godep...
<rht___> tperson: though git reflog is not git object
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<tperson> Whatever it is, it's really cool
<jbenet> Tv` hey! sweet, how was it? hope it was fun.
tilgovi has joined #ipfs
<jbenet> Tv` yep, will look at stuff. we've pinning merged into 0.4.0. maybe finishing the S3 stuff?
<Tv`> jbenet: mostly missing just Query
pfraze has quit [Remote host closed the connection]
<Tv`> Getting what's in the pull request merged would be good, don't want to branch out too much
<Tv`> Time for a movie over here, I'll catch up with you guys tomorrow
<jbenet> Tv` sounds good! o/
pfraze has joined #ipfs
<deltab> on json sequences: https://tools.ietf.org/html/rfc7464 (proposed standard; uses ASCII control chars RS and LF to delimit)
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
hellertime has quit [Quit: Leaving.]
tomdanner has joined #ipfs
<tomdanner> evening
<jbenet> evening
domanic has quit [Ping timeout: 252 seconds]
alu has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
cow_2001 has joined #ipfs
tilgovi has quit [Ping timeout: 244 seconds]
tilgovi has joined #ipfs
<whyrusleeping> jbenet: responded
<whyrusleeping> jbenet: <3
<ipfsbot> [go-ipfs] jbenet deleted godep-peerstream at a9c971f: http://git.io/vmn7w
<whyrusleeping> yesssssss
<whyrusleeping> maybe make the logo look incomplete?
tilgovi has quit [Ping timeout: 240 seconds]
pinbot has quit [Ping timeout: 246 seconds]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<whyrusleeping> jbenet: the tests run much faster now :)
<whyrusleeping> sharness tests*
<whyrusleeping> those shutdown changes i made helped it seems
<tperson> jbenet: whyrusleeping Do you think a API Spec tester should be implemented as a go test, or as a standalone program that can be compiled and downloaded?
<tperson> I'm cleaning towards a standalone
<tperson> leaning*
<whyrusleeping> standalone would be nice if we were planning on implementing the API exactly the same in other languages
<whyrusleeping> i guess it would also be nice to have something outside the codebase to assert that it doesnt change too
simonv3 has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
tomdanner has quit [Remote host closed the connection]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
pfraze has quit [Remote host closed the connection]
<kyledrake> alu Right now I'm just describing how to use it with the Docker image. What I want to do eventually is have a guide to use IPFS to share data between machines in a docker cluster using etcd as a shared IPFS hash reference
<alu> heh
<alu> funny, you catch me right when im making a neocities page
<alu> trying to get a pretty / basic front end up
<alu> ima just use darkengine fuck it
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<kyledrake> darkengine?
<alu> ill show yo, its about to be online
<alu> some super basic shit here
<alu> lol
<alu> i gotta fix stuff
<alu> name etc
<alu> kyledrake: http://darkengine.io/
<alu> his site is sexy n yu know it ;P
arhuaco has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<alu> works >:)
mdem has joined #ipfs
<alu> kyledrake what do you think http://avalon.neocities.org/index.html
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<alu> fixed
<alu> this is how it looks when you open the link https://u.teknik.io/fj5PZb.png
<alu> then you can walk through
<kyledrake> alu: COOL!
<kyledrake> I couldn't get VanusVR to run when I tried it a few weeks ago (it crashed), but I'm going to try it again :)
<alu> It's a simple test right now
<alu> I can setup a server and play god
<alu> but multiplayer should work so you can likely see in realtime the people visiting your web page
<alu> via avatars and talking to them in 3D lol
<alu> but yeah with a server, you = god
<alu> all those packets to do what thou wilt
<alu> such as tracking rotation / gaze, what someone looks at, how long, player position, chat
<alu> etc
<alu> over SSL too yo
<kyledrake> alu does anyone run a hosted janusvr site?
<alu> what do you mean hosted
<alu> i just hosted my site on neocities
<alu> a lot of people host theirs on uh
<alu> its like neocities for Janus, a giant apartment complex to go with it
<alu> you get a room and can customize it w/ the editor, design how you want your portal to look, etc
<alu> pretty neat
<alu> but yeah, rooms are webpages and links are portals. my room is hosted on neocities by appending the code into index.html.
<jbenet> hey guys, im trying to fix the docker image. i'll try using alpine linux-- one thing to do would be remove the requirement of go compilation and just use one of our binaries from go builder.
<jbenet> i guess we'd have to install both 32 and 64 archs?
<jbenet> lgierth Luzifer: you two are probably asleep, but thoughts here would be useful o/
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
simonv3 has quit [Quit: Connection closed for inactivity]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<Luzifer> jbenet: nah. why both archs? shouldn't be required. I'd suggest to build `FROM scratch`
<Luzifer> hmh will not work because docker hub cannot download things before building
<Luzifer> okay alpine sounds good
<Luzifer> if you want to I can build a docker file for alpine
karlwestin has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<Luzifer> down to 28.89MB \o/
<ipfsbot> [go-ipfs] Luzifer opened pull request #1481: WIP: Migrated Dockerfile to use alpine linux (master...alpine) http://git.io/vmczu
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
joshbuddy has joined #ipfs
tperson has quit [Quit: Connection closed for inactivity]
karlwestin has quit [Quit: karlwestin]
reit has joined #ipfs
karlwestin has joined #ipfs
karlwestin has quit [Client Quit]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<jbenet> mafintosh: does playback work with chromecasts anymore?
<mafintosh> jbenet: yea
<mafintosh> jbenet: i just used it to broadcast stuff
<jbenet> mafintosh it's not working so hot atm. new chromecast.
<mafintosh> jbenet: oh maybe they changed something then
<jbenet> mafintosh: any idea how to debug the cast?
<mafintosh> jbenet: yea 2 sec
<mafintosh> jbenet: try making a simple js test file that uses https://github.com/mafintosh/chromecasts and see if it finds your chromecast
<mafintosh> jbenet: if not then its probably something with discoveribility that has changed
<jbenet> and of course the moment you get involved it just works
<mafintosh> lol
<jbenet> (well maybe, it's attempting to work)
<alu> man if i dont find a place to live after DEFCON
<alu> i might just move to thailand
<alu> also im testing the docker image myself
<alu> would like to know if theres been any updates
keroberos has quit [Max SendQ exceeded]
keroberos has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
joshbuddy has quit [Quit: joshbuddy]
<jbenet> Luzifer: that's great, thank you!
atomotic has joined #ipfs
<jbenet> Luzifer: "Check checksum for downloaded asset" would be sweet. I wonder how best to do this-- have a pre-commit hook that builds IPFS and updates the hash? or check it from elsewhere? (i guess from gobuilder?)
<jbenet> Luzifer: know if go is reproducible?
Tv` has quit [Quit: Connection closed for inactivity]
zorun_ has quit [Ping timeout: 256 seconds]
<mafintosh> jbenet, daviddias how is the node spdy transport module working out for you guys? is it stable enough to use for "production" things?
notduncansmith has joined #ipfs
<jbenet> daviddias went to sleep a bit ago. i think there's a bug daviddias found ran into earlier today, but take a look. you can probably fix them.
<mafintosh> jbenet: cool thanks
notduncansmith has quit [Ping timeout: 265 seconds]
zorun has joined #ipfs
www has joined #ipfs
kbala has quit [Quit: Connection closed for inactivity]
karlwestin has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
reit has quit [Ping timeout: 240 seconds]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
patcon has quit [Ping timeout: 246 seconds]
karlwestin has quit [Ping timeout: 256 seconds]
konubinix has quit [Quit: ZNC - http://znc.in]
rht___ has quit [Quit: Connection closed for inactivity]
konubinix has joined #ipfs
<cryptix> gmorning
<Luzifer> jbenet: it isn't I'd check against hash table of gobuilder.
karlwestin has joined #ipfs
<Luzifer> jbenet: but what we could do: Sign all tags… (So don't use lightweight tags but signed ones) in that way gobuilder would verify the code before building a tag…
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
reit has joined #ipfs
martinBrown has quit [Quit: -]
martinBrown has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<Luzifer> jbenet: Git-Cop is trolling me. I've used its forced message and it continues to flame me about it. >:(
atomotic has quit [Quit: Textual IRC Client: www.textualapp.com]
mdem has quit [Quit: Connection closed for inactivity]
AtnNn_ has joined #ipfs
dbolser has joined #ipfs
ralphthe1inja has joined #ipfs
taaz_ has joined #ipfs
amiller- has joined #ipfs
arhuaco_ has joined #ipfs
flugsio has quit [Ping timeout: 250 seconds]
dbolser__ has quit [Ping timeout: 250 seconds]
ralphtheninja has quit [Ping timeout: 250 seconds]
amiller has quit [Ping timeout: 250 seconds]
AtnNn has quit [Ping timeout: 250 seconds]
arhuaco has quit [Ping timeout: 250 seconds]
taaz has quit [Ping timeout: 250 seconds]
flugsio has joined #ipfs
hellertime has joined #ipfs
can0e has joined #ipfs
karlwestin has quit [Quit: karlwestin]
karlwestin has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
tomdanner has joined #ipfs
atomotic has joined #ipfs
Taek42 has quit [Quit: No Ping reply in 180 seconds.]
Taek has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
tilgovi has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
notduncansmith has joined #ipfs
tomdanner has quit [Remote host closed the connection]
notduncansmith has quit [Read error: Connection reset by peer]
karlwestin has quit [Quit: karlwestin]
karlwestin has joined #ipfs
karlwestin has quit [Client Quit]
taaz_ is now known as taaz
karlwestin has joined #ipfs
<lgierth> jbenet: why not build ipfs locally for the container?
<lgierth> we lose useful features *and* introduce a dependency on a service
<lgierth> Luzifer: ^
www has quit [Ping timeout: 240 seconds]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
therealplato has quit [Ping timeout: 248 seconds]
<Luzifer> lgierth: because dockerhub has no build step outside the single dockerfile
<Luzifer> everything not doable with `docker build --no-cache .` is just not possible for the automated build process on dockerhub
<Luzifer> either `FROM golang` and building inside the container or binaries from different locations
<lgierth> Luzifer: oh. got it. it can't ADD . /src ?
<Luzifer> sure it can
<Luzifer> but then you have `from golang` and building inside the container…
<Luzifer> jbenet talked about not having to build inside the container
<lgierth> i just thought prometheus does it nicely https://github.com/prometheus/prometheus/blob/master/Dockerfile
<Luzifer> thats the base I made the rebuild
<lgierth> nevermind the make step, they just download golang
therealplato has joined #ipfs
<Luzifer> jep. I really really really don't like their approach by downloading some random golang
<lgierth> i just really like to be able to build images from local changes or other branches
notduncansmith has joined #ipfs
<lgierth> what about a Dockerfile.dev or something like that?
notduncansmith has quit [Read error: Connection reset by peer]
<lgierth> yeah but you download a random ipfs ;)
<Luzifer> for other projects I use a jenkins job fetching the code, executing the `centurylink/golang-builder:latest` providing me a binary and then bunding them into a `FROM scratch` container… but thats not possible on dockerhub
<Luzifer> lgierth: random? *throws code* they are not random!!!!!!!!111eleven! they are build by my build system!!!! :P
<lgierth> :>
<lgierth> all your entropy are belong to us
tomdanner has joined #ipfs
* Luzifer throws entropy at lgierth
<lgierth> i might just be missing something -- i don't understand why it's bad to build within `docker build`
<lgierth> me having next to no experience with golang
<Luzifer> the container is several hundred MB bigger
<lgierth> rm -rf
<Luzifer> but tbh I don't have an opinion on this… jbenet wanted to have a container without building inside, I built the container… ;)
<Luzifer> my servers are having all that layers for golang:latest nevertheless
<lgierth> ok let's wait and see what his reason was
<lgierth> i gotta go to ikea again
<Luzifer> wow. at this time?
<Luzifer> just must be crazy ;)
<Luzifer> (at least the IKEA at schnelsen is hell that late)
<lgierth> we have 4 ikeas in this city
<lgierth> :)
<Luzifer> hm we only have 2 ;)
<lgierth> it's fine here if you know exactly what you want
tomdanner has left #ipfs [#ipfs]
<Luzifer> yeah but all those people are wandering around like really slow zombies… If they were not there I'd need 5-10min to get all the things I want…
pfraze has joined #ipfs
can0e has quit [Ping timeout: 244 seconds]
ondownthefalllin has joined #ipfs
<Luzifer> excatly :D
ondownthefalllin has quit []
Tv` has joined #ipfs
atomotic has quit [Quit: Textual IRC Client: www.textualapp.com]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
domanic has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
patcon has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
www has joined #ipfs
freedaemon has joined #ipfs
<bret> is there a way to prevent ipfs from logging such a massive stack trace when it crashes?
<bret> its clogging up my logs!
<bret> ;_
<bret> ;)
www has quit [Ping timeout: 256 seconds]
<ipfsbot> [go-ipfs] whyrusleeping force-pushed dev0.4.0 from 0b76942 to 0636f3c: http://git.io/vLnex
<ipfsbot> go-ipfs/dev0.4.0 feaeb78 Tommi Virtanen: pin: Guard against callers causing refcount underflow...
<ipfsbot> go-ipfs/dev0.4.0 b5531f6 Tommi Virtanen: sharness: Use sed in a cross-platform safe way...
<ipfsbot> go-ipfs/dev0.4.0 b168645 Tommi Virtanen: sharness: `fusermount -u` is the documented way to unmount FUSE on Linux...
<Tv`> that's a might by force push..
<Tv`> s/by/big/
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
tilgovi has quit [Ping timeout: 256 seconds]
ryan___ has joined #ipfs
<ipfsbot> [go-ipfs] tv42 force-pushed s3 from dda3c6a to 651a0cd: http://git.io/vmnzd
<ipfsbot> go-ipfs/s3 fb998ba Tommi Virtanen: Remove dead code...
<ipfsbot> go-ipfs/s3 a661fa9 Tommi Virtanen: core tests: Stop assuming internals of Config...
<ipfsbot> go-ipfs/s3 2f3db1a Tommi Virtanen: sharness: Stop assuming leveldb Datastore...
<Tv`> assets/bindata.go is not gofmt'ed
<Tv`> i dont' want to really commit to it if whyrusleeping is doing force pushes
<whyrusleeping> Tv`: oh crap
<whyrusleeping> did i push over something you wrote?
<Tv`> it wasn't meant to happen?-)
<Tv`> no
<Tv`> perhaps someone else, but not me
<whyrusleeping> oh, good, freaked out for a second
<whyrusleeping> lol
<whyrusleeping> was just rebasing all that on latest master
<Tv`> whyrusleeping: the question is, are you done?
<whyrusleeping> yes
<Tv`> ok
<Tv`> oh it's go-bindata itself that doesn't gofmt results? eww
<whyrusleeping> yeck
<whyrusleeping> does your tool gofmt?
<Tv`> the code it generates does not change on a gofmt run
<Tv`> it's technically not calling gofmt, it's just that the output template doesn't suck
<whyrusleeping> good enough for me
<Tv`> pushed a kludge
<ipfsbot> [go-ipfs] tv42 pushed 1 new commit to dev0.4.0: http://git.io/vmlis
<ipfsbot> go-ipfs/dev0.4.0 3c5be9b Tommi Virtanen: gofmt generated assets...
<whyrusleeping> Tv`: where does the key prefixing happen for blocks?
<ipfsbot> [go-ipfs] tv42 force-pushed s3 from 651a0cd to fc949cb: http://git.io/vmnzd
<ipfsbot> go-ipfs/s3 5a3de50 Tommi Virtanen: sharness: Stop assuming leveldb Datastore...
<ipfsbot> go-ipfs/s3 f606a23 Tommi Virtanen: Remove dead code...
<ipfsbot> go-ipfs/s3 3286ee5 Tommi Virtanen: core tests: Stop assuming internals of Config...
<whyrusleeping> if i remember correctly, blocks are stored at /b/<hash> right?
notduncansmith has joined #ipfs
<Tv`> repo/fsrepo/defaultds.go:72:Prefix: ds.NewKey("/blocks"),
notduncansmith has quit [Read error: Connection reset by peer]
<whyrusleeping> got it
<whyrusleeping> thanks
<Tv`> that's not really the prefixing part
<Tv`> that's the part that splits out the namespace into different backends
<whyrusleeping> it puts them on in blockstore.go
<Tv`> blocks/blockstore/blockstore.go:22:var BlockPrefix = ds.NewKey("blocks")
<Tv`> yeah
<whyrusleeping> sweet
<whyrusleeping> i need to add two separate 'blockstores' now
<Tv`> huh
<whyrusleeping> one to store blocks we're intending to share, and one for things that are private, such as private keys and pin lists
<Tv`> you might want to look at the s3 branch first
<whyrusleeping> since jbenet wants to store everything in the blockstore
* whyrusleeping does a git fetch
<Tv`> i'd hate to have tons of merge conflicts
<whyrusleeping> lol
<whyrusleeping> what doesnt kill you only makes you more pissed off at someone else
<Tv`> ideally, let's bring that in first, clean up, then you get to have two sections in config instead of just Datastore
<Tv`> or something
<whyrusleeping> :+1:
<Tv`> because i fear you wouldn't want those "private" things on s3, necessarily, etc
border has quit [Ping timeout: 246 seconds]
<Tv`> or you might, but with a separate bucket or acl
<whyrusleeping> yeah
<whyrusleeping> i'd want them on disk still
<whyrusleeping> but thats just me
<Tv`> then you really want two sections in config
domanic has quit [Ping timeout: 246 seconds]
* whyrusleeping is excited for Tv`s s3 changeset
domanic has joined #ipfs
karlwestin has quit [Quit: karlwestin]
<Luzifer> whyrusleeping: nice quote! I think I'll keep that one :D "17:42:51 <@whyrusleeping> what doesnt kill you only makes you more pissed off at someone else"
karlwestin has joined #ipfs
<whyrusleeping> Luzifer: :D
karlwestin has quit [Quit: karlwestin]
<Tv`> whyrusleeping: i was actually amazed to see how little i needed to do to get it working
<Tv`> i mostly did the config stuff as a cleanup, even that wasn't strictly necessary
atomotic has joined #ipfs
<whyrusleeping> Tv`: thats good news
Taek has quit [*.net *.split]
hellertime has quit [*.net *.split]
ralphthe1inja has quit [*.net *.split]
mappum has quit [*.net *.split]
uhhyeahbret has quit [*.net *.split]
jonl has quit [*.net *.split]
krl has quit [*.net *.split]
Luzifer has quit [*.net *.split]
ralphtheninja has joined #ipfs
krl has joined #ipfs
hellertime has joined #ipfs
uhhyeahbret has joined #ipfs
Taek has joined #ipfs
jonl has joined #ipfs
mappum has joined #ipfs
Luzifer has joined #ipfs
atomotic has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
<jbenet> lgierth Luzifer: the thing about building is the go compiler is big. We could remove it afterwards, but then every user has to do that. I almost think there should be two dockerfiles, one for building, one for downloading latest _release_.
nessence has joined #ipfs
tilgovi has joined #ipfs
ryan___ has quit [Remote host closed the connection]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<lgierth> jbenet: i don't understand the issue with removing the go compiler. it's an rm -rf away isn't it?
joshbuddy has joined #ipfs
<lgierth> and we don't neccessarily build FROM golang
<lgierth> *need to build
<lgierth> alpine + wget http://golang.org/dl/...
<lgierth> anyhow i'm fine dockerfile.dev and dockerfile.release
<lgierth> i'm thinking which one i'd use for the gateways though, and that'd be one which lets me build from an arbitrary commit
<lgierth> nevermind the last line, tagged release images are fine for the moment
<jbenet> Yeah we can rm rf. But many people will not want to wait through compiling (or may not be able to-- golang compile is a mem hog) so I think having both is probably the right way
<jbenet> whyrusleeping: we don't _need_ two blockstores. That's just one way of inplementing that. If color works, that should be enough for an implementation. (Can do either way as blockstore may be faster)
<jbenet> (But it is more complicated because now we have to worry about two blockstores at a higher level)
mildred has joined #ipfs
<Tv`> jbenet: do you want to configure where what kinds of blocks are stored?
<Tv`> if you do, you either need two Datastore config sections, or more complex config that can talk about mounts
<Tv`> (and for both, the cleanups in the s3 branch would be a good thing)
mildred has quit [Read error: Connection reset by peer]
mildred has joined #ipfs
<lgierth> jbenet: Luzifer: anyhow this whole discussion is not a blocker regarding the blog posting :)
ryan___ has joined #ipfs
<jbenet> Tv`: it's just for deciding which blocks are served and which aren't. The more complicated question is: to whom.
patcon has quit [Ping timeout: 244 seconds]
<jbenet> lgierth: maybe we can make the dockerfile in repo build from src (using ADD) and move the release dockerfile to its own repo?
<Tv`> jbenet: I understood there were privacy implications in leaking existence of keys for one of those colors
<Tv`> I figured one way to use s3 would be to just let it be public
<Tv`> Hence, wrong color objects there would be bad
tilgovi has quit [Ping timeout: 250 seconds]
notduncansmith has joined #ipfs
simonv3 has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
Encrypt_ has joined #ipfs
<whyrusleeping> jbenet: what do you mean 'if color works' ?
<whyrusleeping> jbenet: i really think that two blockstores is the only reasonable way to do it.
mildred has quit [Ping timeout: 248 seconds]
mildred has joined #ipfs
Encrypt_ has quit [Quit: Quitte]
<whyrusleeping> go-peerstream as a gx package: QmUgvTbsHH1h6BJ9t7obEpomqQ2f1iizDNHFLNJhYzJqD1 (assuming my internet holds out well enough for an ipfs transfer)
<jbenet> I mean if we trust it then why not trust it to handle the coloring of what to serve
<whyrusleeping> because its inneficient as all hell to enumerate that entire set constantly
<whyrusleeping> or keep it in memory
<whyrusleeping> wont scale at all
<jbenet> Tv`: I would want to store my private data on S3 (possibly encrypted)
<jbenet> whyrusleeping: that's orthogonal, you asked me why I said "if it works". Also see above where I say that it's likely faster to do this.
<jbenet> (This being two blockstores)
nsh has quit [Ping timeout: 246 seconds]
<jbenet> "Keep it in memory"? Why is that a concern?
<whyrusleeping> ah, i thought you were being skeptical of the fact that it worked
nsh has joined #ipfs
<Tv`> jbenet: sure, private data on s3 might still be a separate bucket, a different acl setting, etc
<Tv`> (the current s3 branch just shoves everything under one "config" = bucket,acl,etc, but one could write a datastore config widget for saying "handle /blocks like this")
nessence has quit [Remote host closed the connection]
domanic has quit [Ping timeout: 256 seconds]
domanic has joined #ipfs
<daviddias> whyrusleeping here goes the paper about virtual coordinate system based on latency distances - http://pdos.csail.mit.edu/papers/vivaldi:sigcomm/paper.pdf I talked about
tperson has joined #ipfs
mdem has joined #ipfs
<jbenet> daviddias: yep vivaldi +1. also note that paper, dabek, russ, frans, rtm
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
ryan___ has quit []
therealplato has quit [Ping timeout: 256 seconds]
<ipfsbot> [go-ipfs] jbenet closed pull request #1481: Migrated Dockerfile to use alpine linux (master...alpine) http://git.io/vmczu
mildred has quit [Ping timeout: 248 seconds]
ralphtheninja has quit [Ping timeout: 264 seconds]
<daviddias> thanks jbenet !
<sprintbot> Sprint Checkin! [whyrusleeping jbenet cryptix wking lgierth krl kbala_ rht__ daviddias dPow chriscool gatesvp]
kbala has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<daviddias> sprintchicken: working on integrating the new spdy-transport on swarm, trying to understand why it is sending a RST_STREAM frame, writing more tests and refactoring during that process
tilgovi has joined #ipfs
<daviddias> whyrusleeping: did you went to lunch?
<jbenet> daviddias: i dont think so
<daviddias> cool, just not here then :)
Encrypt_ has joined #ipfs
<lgierth> sprintbot: battlemesh preparations, cjdns discovery
tilgovi has quit [Quit: No Ping reply in 180 seconds.]
tilgovi has joined #ipfs
<lgierth> anybody able to ping 128.199.219.111?
<lgierth> that's the gateway in singapore
Encrypt_ is now known as Encrypt
<lgierth> and i just lost it a few minutes ago. digitalocean ui says it's alive
<jbenet> lgierth: nope cant ping
<jbenet> lgierth: may be hosed-- i've seen this happen and have to reboot via DO
<lgierth> i'll give that a try
<lgierth> ah hey digitalocean's "live" stats stop 15 minutes ago too
<jbenet> lol
<lgierth> yeah that power cycle seems to hang
* lgierth files support ticket
<lgierth> The hypervisor in this case is under a very high load. Our platform engineers are working to reduce the load as a first step before doing a reboot of the machine itself, as a reboot is usually the last step.
<lgierth> -- John Doe, Customer Success Engineer
domanic has quit [Ping timeout: 256 seconds]
<whyrusleeping> sprint checkin: sketched out ideas more concretely for live streaming/pubsub, finished dev0.4.0 rebase, working on gx a bit now
therealplato has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<whyrusleeping> jbenet: go-peerstream as a gx package: QmPfGxidTpHSe4Pq6PHwrPAbqHkRZfJbUsFquA9mym6eVw
<whyrusleeping> (all dependencies included as well)
<lgierth> saturn still unresponsive, another update said it looked like a slightly bigger issue in SGP1
<whyrusleeping> lgierth: lame...
<lgierth> let me take it out of dns
tilgovi has quit [Ping timeout: 240 seconds]
joshbuddy has quit [Quit: joshbuddy]
tilgovi has joined #ipfs
hellertime has quit [Ping timeout: 246 seconds]
domanic has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<lgierth> back it is
<lgierth> since 20:12
<lgierth> gonna reinstate dns
simonv3 has quit [Quit: Connection closed for inactivity]
<lgierth> i disabled it by setting the [h.]gateway.ipfs.io record from "@" to an arbitrary "disabled"
tilgovi has quit [Ping timeout: 244 seconds]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<cSmith> lgierth: is it in nyc3?
<cSmith> I've had that issue too, box was really sluggish and eventually just died. moved it over to a different DC and had no issues
<lgierth> cSmith: nope sgp1
<lgierth> had a support engineer confirm issues with the hypervisor
<cSmith> oh, interesting
* cSmith is moving to lunanode soon anyways
<lgierth> no idea how often similar issues happened in the past, our monitoring has been up for a week only
<lgierth> not my ikea, sadly
<Luzifer> lgierth: :D
joshbuddy has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
Leer10 has quit [Ping timeout: 256 seconds]
mildred has joined #ipfs
mildred has quit [Ping timeout: 244 seconds]
<lgierth> jbenet: about to send the battlemesh thing, see slack
www has joined #ipfs
<jbenet> oh man, i want to go to that ikea
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
joshbuddy has quit [Quit: joshbuddy]
joshbuddy has joined #ipfs
Encrypt has quit [Quit: Sleeping time!]
<Bat`O> lgierth: what do you use to monitor ipfs node ?
joshbuddy has quit [Quit: joshbuddy]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<lgierth> Bat`O: prometheus for scraping the api's /debug/metrics/prometheus endpoint, and grafana to render dashboards
<Bat`O> fancy
<Bat`O> ok, it's not in :5001/api/v0/
<lgierth> Bat`O: :5001/debug/metrics/prometheus
<Bat`O> is there something else in /debug ?
<lgierth> yeah check /debug
<lgierth> oh m
<lgierth> Bat`O: there's /debug/vars and /debug/pprof
<Bat`O> is there another way than reading the code to know that ?
<Bat`O> thx :)
<jbenet> Bat`O we could write a blog post
<jbenet> or an example
<lgierth> yeah good point
<Bat`O> i really should improve my go dev tools
<Bat`O> what do you guys use ?
simonv3 has joined #ipfs
<jbenet> kbala: yeah panic: send on closed channel -- /home/travis/gopath/src/github.com/ipfs/go-ipfs/p2p/net/mock/mock_stream.go:30
<jbenet> kbala: ok i found it-- the synchronization is off, i'll comment
<lgierth> Bat`O: i'm a go newb too
<lgierth> sublime and a terminal
<lgierth> with gosublime
<kbala> jbenet thanks
<Bat`O> lgierth: i'll try that thx
<jbenet> kbala: was this from whyrusleeping's code
<jbenet> ?
<kbala> jbenet: no this is mine, only the transport function is from whyrusleeping
<jbenet> kbala: did you add the `done` channel? we can go through the sync together
notduncansmith has joined #ipfs
<jbenet> (or the `toDeliver` channel)
notduncansmith has quit [Read error: Connection reset by peer]
<kbala> jbenet yeah i did
www has quit [Ping timeout: 264 seconds]
Leer10 has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
www has joined #ipfs
pfraze has quit [Remote host closed the connection]
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<cryptix> Bat`O: /debug/vars and /debug/pprof are stdlib go. you can scrape and analyse them with 'go tool pprof' see https://blog.golang.org/profiling-go-programs for the gory details
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
therealplato has quit [Ping timeout: 244 seconds]
therealplato has joined #ipfs
notduncansmith has joined #ipfs
notduncansmith has quit [Read error: Connection reset by peer]
<daviddias> now with multistream-select (and therefore, `ls`)
<daviddias> ?
mdem has quit [Quit: Connection closed for inactivity]
<jbenet> kbala: hey sorry had to deal with something
<ipfsbot> [go-ipfs] jbenet created heems-master (+3 new commits): http://git.io/vmBp3
<ipfsbot> go-ipfs/heems-master d080d14 Karthik Bala: add transport logic to mocknet...
<ipfsbot> go-ipfs/heems-master 816d31a Karthik Bala: address comments and fix bug in ratelimiter.go...
<ipfsbot> go-ipfs/heems-master a28caff Juan Batiz-Benet: use goprocess in mocknet...
<jbenet> kbala i just pushed to go-ipfs@heems-master, which uses goprocess to fix the bug i think.
<jbenet> we'll see if it works here: https://travis-ci.org/ipfs/go-ipfs/builds/71174114
<jbenet> i clarified the transport function with helpers
<jbenet> daviddias: you're right. we don't need that. we do need to keep it around (commented out + say deprecated) so we dont reuse that tag.