jbenet changed the topic of #ipfs to: IPFS - InterPlanetary File System - https://github.com/ipfs/ipfs -- channel logged at https://botbot.me/freenode/ipfs/ -- Code of Conduct: https://github.com/ipfs/community/blob/master/code-of-conduct.md -- Sprints: https://github.com/ipfs/pm/ -- Community Info: https://github.com/ipfs/community/ -- FAQ: https://github.com/ipfs/faq -- Support: https://github.com/ipfs/support
Matoro has quit [Ping timeout: 255 seconds]
<lgierth> whyrusleeping: worked! thanks :)
<whyrusleeping> wooo!
<whyrusleeping> waiting for CI to push through
<whyrusleeping> eventually
<whyrusleeping> some day
<lgierth> works now too: http://v03x.ipfs.io/ipns/ipfs.io/
rendar has quit [Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!]
Not_ has joined #ipfs
voxelot has quit [Ping timeout: 248 seconds]
palkeo_ has quit [Ping timeout: 250 seconds]
jaboja has quit [Ping timeout: 276 seconds]
reit has joined #ipfs
reit has quit [Client Quit]
Matoro has joined #ipfs
jaboja has joined #ipfs
devbug has joined #ipfs
HostFat has joined #ipfs
vandemar has joined #ipfs
devbug has quit [Ping timeout: 244 seconds]
e-lima has joined #ipfs
hellertime has joined #ipfs
analogv0id has joined #ipfs
zootella has joined #ipfs
elima_ has quit [Ping timeout: 265 seconds]
jaboja has quit [Ping timeout: 240 seconds]
analogv0id has quit [Ping timeout: 250 seconds]
felixn has joined #ipfs
dignifiedquire has quit [Quit: Connection closed for inactivity]
jaboja has joined #ipfs
e-lima has quit [Ping timeout: 244 seconds]
zootella has quit [Quit: zootella]
zootella has joined #ipfs
joshbuddy has joined #ipfs
zootella has quit [Quit: zootella]
jaboja has quit [Ping timeout: 265 seconds]
ppham has quit []
computerfreak has quit [Quit: Leaving.]
Oatmeal has quit [Ping timeout: 265 seconds]
kaiza has joined #ipfs
<jbenet> lgierth all done for the day --ended earlier sorry couldn't get back here -- so feel free to mess with things thanks
<lovelaced> how did it go jbenet?
<lgierth> jbenet: cool thanks! hope you had lots of great conversations
<jbenet> Thanks!! I did-- went very well. Lots of good, hard questions re scalability
<lovelaced> Excellent
<lovelaced> I did some talking today over beers w/one of our user facilitators and got some good feedback on how users want to use distributed filesystems
Oatmeal has joined #ipfs
<lovelaced> does ipfs perform the same on huge filesizes?
<lovelaced> > 1TB
<jbenet> It will scale library but not yet. Right now it will likely degrade
<jbenet> Linearly*
<lovelaced> hm, gotcha
<lovelaced> how badly? if you know
voxelot has joined #ipfs
<lovelaced> or have an idea
<ipfsbot> [go-ipfs] lgierth created prometheus2 (+1 new commit): https://git.io/vgxPM
<ipfsbot> go-ipfs/prometheus2 b4f7210 Lars Gierth: metrics: rework prometheus integration...
tmg has quit [Quit: leaving]
mrrrgn is now known as mrrrgn|afk
<ipfsbot> [go-ipfs] lgierth force-pushed prometheus2 from b4f7210 to 91878d4: https://git.io/vgxXv
<ipfsbot> go-ipfs/prometheus2 91878d4 Lars Gierth: metrics: rework prometheus integration...
HostFat has quit [Quit: Leaving]
<ipfsbot> [go-ipfs] lgierth opened pull request #2356: metrics: rework prometheus integration (master...prometheus2) https://git.io/vgxXC
reit has joined #ipfs
jaboja has joined #ipfs
devbug has joined #ipfs
<lgierth> whyrusleeping: is there any automation gxification yet?
<lgierth> *automated
devbug has quit [Ping timeout: 240 seconds]
zootella has joined #ipfs
Arakela has joined #ipfs
plucky has quit [Ping timeout: 240 seconds]
yellowsir has quit [Quit: Leaving.]
mrrrgn|afk is now known as mrrrgn
ygrek has quit [Ping timeout: 276 seconds]
zootella has left #ipfs [#ipfs]
Cary has joined #ipfs
devbug has joined #ipfs
analogv0id has joined #ipfs
analogv0id has quit [Remote host closed the connection]
analogv0id has joined #ipfs
Myagui has quit [Max SendQ exceeded]
Myagui has joined #ipfs
jaboja has quit [Ping timeout: 248 seconds]
hellertime has quit [Quit: Leaving.]
dvn has joined #ipfs
captain_morgan has quit [Remote host closed the connection]
<ipfsbot> [go-ipfs] whyrusleeping closed pull request #2354: fix panic in cli arg parsing (master...fix/stdin-arg-parse) https://git.io/vgAVA
Arakela has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]
<ipfsbot> [go-ipfs] whyrusleeping force-pushed feat/add-utp-default from 9673e61 to 7f6c833: https://git.io/vg9tG
<ipfsbot> go-ipfs/feat/add-utp-default 7f6c833 Jeromy: add utp and change to 4737 default port...
Skaag has quit [Ping timeout: 250 seconds]
dignifiedquire has joined #ipfs
sivachandran has joined #ipfs
<whyrusleeping> lgierth: yeah, you can use gx-go import
<whyrusleeping> it has a few options that are pretty useful
<whyrusleeping> although if there are canonical import paths you might have to do some surgery
voxelot has quit [Ping timeout: 240 seconds]
<sivachandran> Is it possible to store key-value pair in IPFS and retrieve the value by key?
Not_ has quit [Remote host closed the connection]
<sivachandran> I found a discussion related to this(cdb) but not sure whether it is doable in IPFS.
captain_morgan has joined #ipfs
voxelot has joined #ipfs
mrrrgn is now known as mrrrgn|afk
sivachandran has quit [Remote host closed the connection]
devbug has quit [Ping timeout: 240 seconds]
danielrf1 has joined #ipfs
sivachandran has joined #ipfs
danielrf has quit [Ping timeout: 240 seconds]
pfraze has quit [Remote host closed the connection]
sivachandran has quit [Remote host closed the connection]
Pharyngeal has quit [Ping timeout: 240 seconds]
ljhms has quit [Quit: Bye]
ljhms has joined #ipfs
flapjack0811 has joined #ipfs
Pharyngeal has joined #ipfs
sivachandran has joined #ipfs
azm has quit [Quit: ZNC - 1.6.0 - http://znc.in]
reit has quit [Ping timeout: 248 seconds]
disgusting_wall has quit [Quit: Connection closed for inactivity]
Skaag has joined #ipfs
leer10 has joined #ipfs
mildred has joined #ipfs
voxelot has quit [Ping timeout: 265 seconds]
ulrichard has joined #ipfs
zootella has joined #ipfs
zootella has left #ipfs [#ipfs]
sivachandran has quit [Remote host closed the connection]
ygrek has joined #ipfs
e-lima has joined #ipfs
<daviddias> mornin' people of planet earth :)
<alu> good morning daviddias
<daviddias> alu o/ how are things! :)
<daviddias> whyrusleeping: are you still there? Has that mem leak patch landed yet?
<alu> Pretty fuckin cool man
<alu> I'm using IPFS to start a permanent metaverse party
mvollrath has quit [Ping timeout: 240 seconds]
mvollrath has joined #ipfs
<dignifiedquire> good morning everyone :)
ylp1 has joined #ipfs
devbug has joined #ipfs
devbug has quit [Ping timeout: 240 seconds]
flapjack0811 has quit [Quit: Leaving]
sivachandran has joined #ipfs
ygrek has quit [Ping timeout: 244 seconds]
felixn has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
palkeo has joined #ipfs
s_kunk has quit [Ping timeout: 250 seconds]
zz_r04r is now known as r04r
<daviddias> alu: ahaha that sounds really great, how can we get invites? :D
<daviddias> dignifiedquire: mornin'!
sivachandran has quit [Remote host closed the connection]
sivachandran has joined #ipfs
Tv` has quit [Quit: Connection closed for inactivity]
sivachandran has quit [Remote host closed the connection]
hpk has quit [Ping timeout: 240 seconds]
devbug has joined #ipfs
yellowsir has joined #ipfs
sivachandran has joined #ipfs
hpk has joined #ipfs
rendar has joined #ipfs
palkeo has quit [Quit: Konversation terminated!]
s_kunk has joined #ipfs
sivachandran has quit [Remote host closed the connection]
sivachandran has joined #ipfs
cemerick has joined #ipfs
Qwertie- has quit [Read error: Connection reset by peer]
Qwertie has joined #ipfs
martinkl_ has joined #ipfs
computerfreak has joined #ipfs
m0ns00n2 has joined #ipfs
Wolf480pl has quit [Ping timeout: 268 seconds]
sivachandran has quit [Remote host closed the connection]
m0ns00n2 has quit [Quit: undefined]
ulrichard has quit [Ping timeout: 265 seconds]
sivachandran has joined #ipfs
computerfreak has quit [Remote host closed the connection]
Cary has quit [Ping timeout: 255 seconds]
sivachandran has quit [Remote host closed the connection]
zorglub27 has joined #ipfs
amercement has joined #ipfs
devbug has quit [Ping timeout: 248 seconds]
Arakela has joined #ipfs
devbug has joined #ipfs
sivachandran has joined #ipfs
sivachandran has quit [Remote host closed the connection]
sivachandran has joined #ipfs
sivachandran has quit [Client Quit]
voxelot has joined #ipfs
m0ns00n2 has joined #ipfs
devbug has quit [Ping timeout: 240 seconds]
Arakela has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]
Arakela has joined #ipfs
reit has joined #ipfs
analogv0_ has joined #ipfs
analogv0id has quit [Read error: Connection reset by peer]
Senji has quit [Disconnected by services]
Senj has joined #ipfs
Senj is now known as Senji
zorglub27 has quit [Ping timeout: 250 seconds]
martinkl_ has quit [Ping timeout: 248 seconds]
<ipfsbot> [go-ipfs] mildred opened pull request #2359: Simplify merkledag package interface to ease IPLD inclusion (master...ipld) https://git.io/vgpAR
<ipfsbot> [go-ipfs] mildred closed pull request #1916: Remove usage of merkledag.Link.Node pointer outside of merkledag (dev0.4.0...ipld) https://git.io/vlmP0
martinkl_ has joined #ipfs
ylp1 has quit [Read error: No route to host]
ylp2 has joined #ipfs
martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
zorglub27 has joined #ipfs
ipfsrocks has joined #ipfs
martinkl_ has joined #ipfs
flapjack0811 has joined #ipfs
tawar has joined #ipfs
flapjack0811 has quit [Client Quit]
tawar has quit [Read error: Connection reset by peer]
ipfsrocks has quit [Ping timeout: 250 seconds]
HostFat has joined #ipfs
yellowsir has quit [Quit: Leaving.]
takinbo has quit [Quit: ZNC - http://znc.in]
joshbuddy has quit [Quit: joshbuddy]
zorglub27 has quit [Ping timeout: 250 seconds]
Akaibu has joined #ipfs
stoogenmeyer has joined #ipfs
cemerick has quit [Ping timeout: 276 seconds]
Arakela has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]
<dignifiedquire> daviddias: when I add an object using object.put is it pinned? does pin -r on such an object with links work?
Arakela has joined #ipfs
<daviddias> dignifiedquire: 1) I'm not sure, 2) yes
<dignifiedquire> ta
mildred has quit [Ping timeout: 244 seconds]
voxelot has quit [Ping timeout: 240 seconds]
Akaibu has quit [Ping timeout: 240 seconds]
Akaibu has joined #ipfs
ashark has joined #ipfs
yellowsir has joined #ipfs
leer10 has quit [Ping timeout: 248 seconds]
pfraze has joined #ipfs
<ipfsbot> [go-ipfs] mildred opened pull request #2360: merkledag: remove Batch (master...merkledag-remove-batch) https://git.io/vghBa
mildred has joined #ipfs
zorglub27 has joined #ipfs
felixn has joined #ipfs
Matoro has quit [Ping timeout: 276 seconds]
joshbuddy has joined #ipfs
wlan2_ has joined #ipfs
<wlan2_> Is there timeout for ipfs pin add?
warner has quit [Quit: ERC (IRC client for Emacs 24.5.1)]
warner has joined #ipfs
<wlan2_> oh... erc...
<dignifiedquire> whyrusleeping daviddias no rest for the wicked https://usercontent.irccloud-cdn.com/file/5eUooyA5/IMG_1857.JPG
<daviddias> ehehe nice
<daviddias> I want one to
ashark_ has joined #ipfs
<dignifiedquire> daviddias: aaand I f*** fixed f*** geoip generation :dance:
<lgierth> :):)
<dignifiedquire> it even has tests now
ashark has quit [Ping timeout: 240 seconds]
lmatteis has quit [Ping timeout: 268 seconds]
lmatteis has joined #ipfs
<dignifiedquire> lgierth: can you please pin QmRn43NNNBEibc6m7zVNcS6UusB1u3qTTfyoLmkugbeeGJ everyhwere on 0.4
ashark_ has quit [Read error: Connection reset by peer]
<lgierth> dignifiedquire: ok
<dignifiedquire> thanks
<lgierth> maybe also add that hash to the geoip code's readme or so
<dignifiedquire> that's the new root hash for geoip
<dignifiedquire> it's in the code
<dignifiedquire> will update things around it more
<dignifiedquire> but want to make sure this thing gets circulated
Matoro has joined #ipfs
<lgierth> wooooah
<lgierth> pinning that geoip merkledag
<lgierth> the gateways completely going mad on goroutines
<lgierth> earth went to 315k within a minute
<lgierth> whyrusleeping: ^
ashark has joined #ipfs
<Kubuxu> It weight 170MB
<lgierth> still, they weren't crunchring that much data
<lgierth> earth is at about 1MB/s
ylp2 has quit [Quit: Leaving.]
ylp1 has joined #ipfs
<lgierth> pluto peaked at 651k
mrrrgn|afk is now known as mrrrgn
e-lima has quit [Ping timeout: 240 seconds]
ylp1 has quit [Client Quit]
<yangwao> it's way how to know content-length before pinning?
ipfsrocks has joined #ipfs
<lgierth> yeah just request the top-level object
<lgierth> ipfs object stat <hash>
<lgierth> CumulativeSize: 178393190
<yangwao> see :)
<lgierth> that's no excuse for hundred thousands of goroutines ;)
<yangwao> and pinned object is storaed into ram before its commited to disk?
<lgierth> the object itself is small
<lgierth> it's just links to other objects
<yangwao> (i've just ran ipfs pin QmRn43NNNBEibc6m7zVNcS6UusB1u3qTTfyoLmkugbeeGJ)
<lgierth> CumulativeSize is the size of the whole merkledag underneath
<yangwao> but I dont see it anywhere in datastore
<yangwao> ahm, so that pin is stored in /blocks?
<lgierth> the pin itself is stored somewhere, and the objects and blocks are stored somewhere
<lgierth> the pin is just a link
<wlan2_> It's eating the memory of the VPS where I'm trying to pin it.
<yangwao> ^
<yangwao> it's really too big :)
<wlan2_> but it's seriously eating RAM and SWAP
<wlan2_> Like, only four megs left.
<Kubuxu> yangwao: fs:/ipns/utils.ipfs.ovh
voxelot has joined #ipfs
<yangwao> well, i've just lost ipfs daemon, killed by system :D
<yangwao> root@odroid-server:~# ipfs pin add QmRn43NNNBEibc6m7zVNcS6UusB1u3qTTfyoLmkugbeeGJ
e-lima has joined #ipfs
<lgierth> yeeep. longrunning http requests == bad
<lgierth> oh it killed it, ok
<lgierth> oomkiller?
<yangwao> probably
<yangwao> I have no swap at that arm
<yangwao> (sd card, swap probably could destroy it fast)
<lgierth> haha yeah
<yangwao> this one was faster
<yangwao> :)
ashark_ has joined #ipfs
<lgierth> pluto completely lost it, hrm
ashark has quit [Ping timeout: 255 seconds]
<wlan2_> Looks like mine is still trying to get it.
Tv` has joined #ipfs
<wlan2_> still 4 meg free
<ipfsbot> [js-ipfs] nginnever opened pull request #68: ID command now generates a public key for output (master...master) https://git.io/vghFF
ashark has joined #ipfs
<wlan2_> free swap keeps going down though
drrz has joined #ipfs
<wlan2_> Isn't there a 'lighter' way to pin it?
ashark_ has quit [Ping timeout: 276 seconds]
<dignifiedquire> !pin QmRn43NNNBEibc6m7zVNcS6UusB1u3qTTfyoLmkugbeeGJ
<pinbot> now pinning /ipfs/QmRn43NNNBEibc6m7zVNcS6UusB1u3qTTfyoLmkugbeeGJ
<pinbot> [host 1] failed to grab refs for /ipfs/QmRn43NNNBEibc6m7zVNcS6UusB1u3qTTfyoLmkugbeeGJ: unknown ipfs-shell error encoding: text/html - "<html>\r\n<head><title>502 Bad Gateway</title></head>\r\n<body bgcolor=\"white\">\r\n<center><h1>502 Bad Gateway</h1></center>\r\n<hr><center>nginx/1.9.3</center>\r\n</body>\r\n</html>\r\n"
<whyrusleeping> >.>
<dignifiedquire> :(
<whyrusleeping> thats just host 1
<dignifiedquire> let's see what happnes
<lgierth> it might work actually
<lgierth> it's pointed against 0.4.0 nodes again
<lgierth> that ^ was probably uranus (went out of memory)
<wlan2_> wow free swap just went a bit up. Might actually even work.
pinbot has quit [Ping timeout: 240 seconds]
<wlan2_> Is there any docs on how the name came to be?
Matoro has quit [Ping timeout: 255 seconds]
<dignifiedquire> daviddias: please review https://github.com/ipfs/ipfs-geoip/pull/7
Matoro has joined #ipfs
ashark_ has joined #ipfs
ipfsrocks has quit [Ping timeout: 250 seconds]
ashark has quit [Ping timeout: 276 seconds]
<wlan2_> That machine has pretty fast net, why does it take so much?
computerfreak has joined #ipfs
<dignifiedquire> lgierth: looks like pinbot didn't pin anything :(
<wlan2_> Is this normal? /ipfs/QmXVzBqL3xywdWgP2Bdk8H9THqoj9pNfnkEdiFPokY7Ck1
<dignifiedquire> !pin QmRn43NNNBEibc6m7zVNcS6UusB1u3qTTfyoLmkugbeeGJ
<dignifiedquire> lgierth: pinbot dead :(
<wlan2_> Poor bot.
<yangwao> :D
<yangwao> ..was this ipfs network profiling? :P
ipfsrocks has joined #ipfs
<dignifiedquire> nah just trying to pin sth with lots of links :D
shea256 has joined #ipfs
<Codebird> Well, that was impressive...
<Codebird> ipfs errors on mkdir. Too many links.
zorglub27 has quit [Quit: zorglub27]
<Codebird> .ipfs/blocks contains 31999 folders.
<Codebird> 32000 if you include ..
stoogenmeyer has quit [Remote host closed the connection]
<Codebird> I do believe I have found a bug.
ugjka has joined #ipfs
<Codebird> And one that's going to be nasty to fix too.
IlanGodik has joined #ipfs
ashark_ has quit [Ping timeout: 240 seconds]
<yangwao> how I can verifiy it was sucessfully pinned?
ashark has joined #ipfs
pinbot has joined #ipfs
<dignifiedquire> ipfs pin ls | grep <hash>
<yangwao> when I abort it in the middle of pinning, it will start over again or just starts where it was aborted?
<yangwao> uh, ipfs is eating now 1.9G of my ram :)
<lgierth> yangwao: it'll keep pinning
<Codebird> I've added the bug to my existing open issue on github, as it may (or may not) be related.
<Codebird> It's going to need fixing though. Which means changing the manner in which objects are stored, probably. Again.
pinbot has quit [Remote host closed the connection]
pinbot has joined #ipfs
shea256 has quit [Remote host closed the connection]
joshbuddy has quit [Quit: joshbuddy]
<lgierth> i'll be back later
<lgierth> restarted docker and containers on all gateways
ashark has quit [Ping timeout: 255 seconds]
<whyrusleeping> Codebird: what filesystem?
<Codebird> vzfs.
<Codebird> It's a VM thing.
<whyrusleeping> hrm... i have folders with well over 32k objects in zfs
<Codebird> Not zfs.
<Codebird> vzfs.
<whyrusleeping> oh weird
<Codebird> Virtuozzo.
<whyrusleeping> hrm...
<Codebird> It's a virtual filesystem - lets many VMs all draw storage from common pool as they require it. Very efficient.
<whyrusleeping> pretty easy patch though, can change some code to allow the sharding depth to be configurable
<whyrusleeping> and then write a small tool to move between sharding formats
<Codebird> Yep. Right now I'm horrifying my host by just making an 8GB file, putting ext4 on it and mounting it loopback.
<whyrusleeping> heh
<whyrusleeping> noffle: you around?
<yangwao> interesting, I can't pin antyhing or add when I'm pinning some file :/
<whyrusleeping> yangwao: >.>
<yangwao> even add pbpaste, f*
<whyrusleeping> with a daemon running?
<whyrusleeping> or no?
<yangwao> yes, daemon running
<whyrusleeping> double check? because i know for certain you cant do two things at once without the daemon running
<whyrusleeping> (leveldb exclusive locking per process)
<yangwao> whyrusleeping: got these things running http://hastebin.com/nojonakoto.coffee
<whyrusleeping> hrm, strange
<noffle> whyrusleeping: hey
<whyrusleeping> hows your schedule looking today?
<whyrusleeping> i'd love some help looking at the different test failures
<noffle> pretty open -- I'm around till 1700h PT
<yangwao> whyrusleeping: any idea what could be problem?
<yangwao> whyrusleeping: what I noted, that my ipfs dropped number of peers
<whyrusleeping> yangwao: i'm gonna try a repro
<whyrusleeping> youre on 0.4.0?
<yangwao> wao@astrid~> curl -s http://localhost:8080/version|grep Commit
<yangwao> Commit: a871f37
<yangwao> it should be something 0.4.0 from last days :)
<noffle> whyrusleeping: send me some links; I can take a look today
joshbuddy has joined #ipfs
<whyrusleeping> the most recent five are most likely to still be a problem
<whyrusleeping> before the 'make master green again' issue most of them are likely resolved already
<noffle> are you currently looking at any? don't want to duplicate effort
<noffle> I'm doing 'go get' stuff currently, but can look at some later today!
<bret> hows go 1.6?
cemerick has joined #ipfs
<yangwao> whyrusleeping: could be problem that my internet is overpeaked?:D
<whyrusleeping> noffle: not currently looking at any of them
<yangwao> but ipfs should work local, right? :)
<whyrusleeping> yangwao: it could be that
<whyrusleeping> but i'm not seeing any reason why that should happen...
<whyrusleeping> yangwao: did that 'ipfs add' command finish?
<yangwao> nope
<yangwao> but that one local shouldnt had problem, right?
<whyrusleeping> yangwao: is it still up?
<whyrusleeping> processes are all still alive?
<yangwao> 12 peers
<whyrusleeping> could run press ctrl+\ on the daemon for me?
<whyrusleeping> and send me the output?
<whyrusleeping> (note: this will kill the daemon)
<whyrusleeping> alternatively
<whyrusleeping> run: 'curl localhost:5001/debug/pprof/goroutine?debug=2'
<yangwao> oo, long stack trace
<whyrusleeping> yeeeeep
<whyrusleeping> if i could get *all* of that, that would be super cool
<whyrusleeping> otherwise, as much as you can copy and hopefully i see what i'm looking for
<yangwao> pray for unlimited scrollback buffer :P
<whyrusleeping> lol
zorglub27 has joined #ipfs
<yangwao> just 84262
<yangwao> I expected more
ipfsrocks has quit [Ping timeout: 255 seconds]
<yangwao> ipfs add ipfsdaemondump201602181902.txt
<yangwao> added QmUX9DmHhPMD9P6YUCGCXXTZVGnE6dywi6zVKGkt9VMKPa ipfsdaemondump201602181902.txt
reit has quit [Quit: Leaving]
<yangwao> can you get it?
<whyrusleeping> is your daemon back up again?
<yangwao> yop :)
<whyrusleeping> re-add it?
<whyrusleeping> if you add something while your daemons down and then bring your daemon up, it takes a little while for it to decide to resend all that to the network
martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
martinkl_ has joined #ipfs
<yangwao> should be added second time :x
<wlan2_> LOL mine is still struggling to pin it.
<yangwao> :D
<yangwao> I never pinned anything before
<yangwao> wao@astrid~> du -sh .ipfs/
<yangwao> 176M.ipfs/
<yangwao> I think I was almost there :P
jaboja has joined #ipfs
shea256 has joined #ipfs
martinkl_ has quit [Ping timeout: 240 seconds]
<Codebird> Bah. No loop device support.
ygrek has joined #ipfs
<wlan2_> This is weird
shea256 has quit [Ping timeout: 240 seconds]
<wlan2_> Why's it not getting into the disk?
<yangwao> check objects/
<yangwao> er, blocks/
<dignifiedquire> !pin QmRn43NNNBEibc6m7zVNcS6UusB1u3qTTfyoLmkugbeeGJ
<pinbot> now pinning /ipfs/QmRn43NNNBEibc6m7zVNcS6UusB1u3qTTfyoLmkugbeeGJ
<dignifiedquire> here we go again, lets see if pinbot survives
<yangwao> :D
<whyrusleeping> lgierth: when you get a chance: https://github.com/whyrusleeping/pinbot/pull/16
pinbot has quit [Ping timeout: 240 seconds]
<yangwao> whyrusleeping: do you have time to debug that traversal problem?
<whyrusleeping> yangwao: not right at the moment
<whyrusleeping> but i think i have a fix (youre referring to the one we talked about the other day?)
<yangwao> whyrusleeping: two days ago, right :)
<yangwao> should I fetch latest commit then?
<whyrusleeping> theres nothing in master of go-ipfs
<whyrusleeping> but i put something in libp2p
<whyrusleeping> it will make it into go-ipfs soonish
<yangwao> just ping me then when I can upgrade :)
<yangwao> I just found that I have old tplink tl-mr3020 travel router.. so I thinking about run there ipfs :P
<whyrusleeping> if you want to test, i can tell you how pretty easily
<whyrusleeping> if youre already building from source its pretty easy to do
<yangwao> well, I'd like have working builds at least :D
<yangwao> well, yes, I can :)
<yangwao> not like go get -u github.com/ipfs/go-ipfs/cmd/ipfs, but different?
<whyrusleeping> yeah, since youre testing an updated dependency
<whyrusleeping> do a 'go get -u github.com/ipfs/go-libp2p/p2p'
<whyrusleeping> it will probably fail with some weird error since that exact path isnt a buildable path
<whyrusleeping> but it should trick go into doing a git pull
<yangwao> package github.com/ipfs/go-libp2p/p2p: no buildable Go source files in /Users/wao/Lab/go/src/github.com/ipfs/go-libp2p/p2p
<whyrusleeping> yeap, lol
<whyrusleeping> now cd $GOPATH/src/github.com/ipfs/go-ipfs
<whyrusleeping> gx-go rewrite --undo go-libp2p
<whyrusleeping> go install ./cmd/ipfs
<whyrusleeping> that will 'unvendor' go-libp2p and use the one thats installed on your system
<yangwao> looks done
<yangwao> what's next, restart daemon?
s_kunk has quit [Ping timeout: 255 seconds]
shea256 has joined #ipfs
zorglub27 has quit [Ping timeout: 250 seconds]
ashark has joined #ipfs
<yangwao> whyrusleeping: and I should restart daemon or copy that new one ipfs? :)
shea256 has quit [Ping timeout: 240 seconds]
<whyrusleeping> yeah, restart daemon
<whyrusleeping> (after the go install ./cmd/ipfs part)
<Codebird> I found an ugly hack to make it work.
<yangwao> ok, got it, I should see external ip or what?
<whyrusleeping> hopefully
<Codebird> 32000 subfolder limit... no 32000 object limit.
<Codebird> mv * ../overflow1;ln -s ../overflow1/* .
<whyrusleeping> shit, you guys arent wrong about pinning taking forever
<whyrusleeping> its eating all my ram
<whyrusleeping> wow
<yangwao> :D
<yangwao> ~o~
<yangwao> what's RSS of process? :)
<yangwao> my got somewhere over 2G
<whyrusleeping> lol, mine hit 6GB
<wlan2_> no go on this vps, shall tryon laptop.
<whyrusleeping> mmkay, gonna fix that
<whyrusleeping> also
<whyrusleeping> heading out, so i'll be back later with more info
<yangwao> :D
Arakela has quit [Quit: http://www.kiwiirc.com/ - A hand crafted IRC client]
<dignifiedquire> botsnack
<M-mubot> Oh thx, have a cookie yourself!
<dignifiedquire> pinbot?
<dignifiedquire> !pin test
<dignifiedquire> whyrusleeping: I think there is a resource issue when pinning large linked objects
<dignifiedquire> pinbot keeps dying and lgierth said on 0.4 it ate resources like crazy
shea256 has joined #ipfs
HostFat has quit [Read error: Connection reset by peer]
Matoro has quit [Ping timeout: 255 seconds]
shea256 has quit [Remote host closed the connection]
<dignifiedquire> !botsnack
<M-mubot> Om nom nom!
<dignifiedquire> !friends
Matoro has joined #ipfs
palkeo has joined #ipfs
shea256 has joined #ipfs
rhalff has joined #ipfs
palkeo_ has joined #ipfs
palkeo has quit [Ping timeout: 240 seconds]
Encrypt has joined #ipfs
zorglub27 has joined #ipfs
stoogenmeyer has joined #ipfs
<noffle> lgierth: woo, 'go get' working using multireq+local daemon
<noffle> lgierth: is prod running the latest multireq?
<noffle> lgierth: I notice that http://ipfs.io/ipfs/Qme93Y2mMcbm18CmAjtdfisYWWz7RdEyim4SuJmpuhKGCU only resolves about 50% of the time (hangs otherwise)
pinbot has joined #ipfs
jaboja has quit [Ping timeout: 255 seconds]
Matoro has quit [Ping timeout: 255 seconds]
Matoro has joined #ipfs
<ansuz>
shea256 has quit [Remote host closed the connection]
devbug has joined #ipfs
tilgovi has joined #ipfs
chriscool has quit [Remote host closed the connection]
<noffle> cool
<noffle> stephen // ~ $ go get -v ipfs.io/ipfs/Qme93Y2mMcbm18CmAjtdfisYWWz7RdEyim4SuJmpuhKGCU/go-multihash.git
<noffle> ipfs.io/ipfs/Qme93Y2mMcbm18CmAjtdfisYWWz7RdEyim4SuJmpuhKGCU/go-multihash.git (download)
<noffle> ipfs.io/ipfs/Qme93Y2mMcbm18CmAjtdfisYWWz7RdEyim4SuJmpuhKGCU/go-multihash.git
<noffle> the gateway is either just really slow or is hanging on some % of my requests
<noffle> +1 if anyone else feels like seeing if 'go get -v ipfs.io/ipfs/Qme93Y2mMcbm18CmAjtdfisYWWz7RdEyim4SuJmpuhKGCU/go-multihash.git' works out
joshbuddy has quit [Quit: joshbuddy]
jaboja has joined #ipfs
shea256 has joined #ipfs
chriscool has joined #ipfs
<Codebird> Path Resolve error: no link named "go-multihash.git" under Qme93Y2mMcbm18CmAjtdfisYWWz7RdEyim4SuJmpuhKGCU
<Codebird> There's a go-multihash without .git though.
<Codebird> Ok. I can retrieve that on my node.
<Codebird> Feel free to utilise it if the gateway is having issues. Birds-are-nice.me
<noffle> Codebird: did you use 'go get'?
Matoro_ has joined #ipfs
<Codebird> No.
<Codebird> I was just checking if the key was retrievable for you.
Encrypt has quit [Quit: Quitte]
wiretapp1d-cb has joined #ipfs
vijayee__ has joined #ipfs
chriscool2 has joined #ipfs
wHATEver has joined #ipfs
dvn has quit [Ping timeout: 255 seconds]
cojy has quit [Ping timeout: 255 seconds]
akkad has quit [Ping timeout: 255 seconds]
myp has quit [Ping timeout: 255 seconds]
Kubuxu has quit [Ping timeout: 255 seconds]
chriscool has quit [Ping timeout: 255 seconds]
wiretapped-cb has quit [Ping timeout: 255 seconds]
elasticdog has quit [Ping timeout: 255 seconds]
vijayee_ has quit [Ping timeout: 255 seconds]
guruvan has quit [Ping timeout: 255 seconds]
Matoro has quit [Ping timeout: 255 seconds]
voxelot has quit [Ping timeout: 255 seconds]
SWingedSeraph has quit [Ping timeout: 255 seconds]
Stskeeps has joined #ipfs
Stskeeps has joined #ipfs
Stskeeps has quit [Ping timeout: 255 seconds]
cojy_ has joined #ipfs
revolve has quit [Ping timeout: 255 seconds]
lidel has quit [Ping timeout: 255 seconds]
voxelot has joined #ipfs
SWingedSeraph_ has joined #ipfs
Kubuxu has joined #ipfs
wHATEver is now known as Guest88072
Guest88072 has quit [Ping timeout: 255 seconds]
elasticdog has joined #ipfs
myp has joined #ipfs
revolve has joined #ipfs
lidel has joined #ipfs
sindresorhus has quit [Ping timeout: 250 seconds]
guruvan has joined #ipfs
misalias has quit [Ping timeout: 265 seconds]
Senji has quit [Read error: Connection reset by peer]
Senji has joined #ipfs
sindresorhus has joined #ipfs
chriscool2 has quit [Quit: Leaving.]
chriscool has joined #ipfs
stoogenmeyer has quit [Remote host closed the connection]
stoogenmeyer has joined #ipfs
akkad has joined #ipfs
misalias has joined #ipfs
<ipfsbot> [go-ipfs] RichardLitt created feature/add-level-arg-desc (+1 new commit): https://git.io/vgjSY
<ipfsbot> go-ipfs/feature/add-level-arg-desc b14403a Richard Littauer: Added a description to level argument...
<ipfsbot> [go-ipfs] RichardLitt opened pull request #2362: Added a description to level argument (master...feature/add-level-arg-desc) https://git.io/vgjSG
disgusting_wall has joined #ipfs
ugjka has quit [Ping timeout: 240 seconds]
stoogenmeyer has quit [Remote host closed the connection]
stoogenmeyer has joined #ipfs
<Akaibu> https://github.com/blog/2105-upload-files-to-your-repositories hot damn, this is gonna be useful, about time they added this feature
<yangwao> git.js ?
<yangwao> but nice yea
cojy_ is now known as cojy
mildred has quit [Ping timeout: 240 seconds]
<ipfsbot> [go-ipfs] RichardLitt created docs/resolve (+1 new commit): https://git.io/vgj5Q
<ipfsbot> go-ipfs/docs/resolve 6ea9f60 Richard Littauer: Removed double spaces, added `an`, siwitched carrot to dollar...
<ipfsbot> [go-ipfs] RichardLitt opened pull request #2363: Removed double spaces, added `an`, siwitched carrot to dollar (master...docs/resolve) https://git.io/vgj5b
<ipfsbot> [go-ipfs] RichardLitt created docs/poll-default-false (+1 new commit): https://git.io/vgjF2
<ipfsbot> go-ipfs/docs/poll-default-false 9c53ad7 Richard Littauer: Added default false to stats bw poll...
<ipfsbot> [go-ipfs] RichardLitt opened pull request #2364: Added default false to stats bw poll (master...docs/poll-default-false) https://git.io/vgjF6
<Kubuxu> Akaibu: It won't be useful that often, you really rarely want to add one file in one commit.
<Akaibu> Kubuxu: maybe, but i don't "use" github for the conventanal use that most do
joshbuddy has joined #ipfs
<Protocol_under> is is possible ot make a specific file/ressource aviable withing an IP range only ?
mildred has joined #ipfs
gordonb has joined #ipfs
shea256 has quit [Remote host closed the connection]
shea256 has joined #ipfs
martinkl_ has joined #ipfs
martinkl_ has quit [Max SendQ exceeded]
JasonWoof has quit [Ping timeout: 276 seconds]
gordonb has quit [Quit: gordonb]
patcon_ has joined #ipfs
tilgovi has quit [Ping timeout: 276 seconds]
chriscool has quit [Quit: Leaving.]
chriscool has joined #ipfs
JasonWoof has joined #ipfs
martinkl_ has joined #ipfs
martinkl_ has quit [Max SendQ exceeded]
martinkl_ has joined #ipfs
martinkl_ has joined #ipfs
martinkl_ has quit [Max SendQ exceeded]
chriscool has quit [Quit: Leaving.]
chriscool has joined #ipfs
kaliy has quit [Ping timeout: 240 seconds]
ashark has quit [Ping timeout: 250 seconds]
kaliy has joined #ipfs
rendar has quit [Ping timeout: 240 seconds]
palkeo_ has quit [Ping timeout: 248 seconds]
shea256 has quit [Remote host closed the connection]
palkeo_ has joined #ipfs
rendar has joined #ipfs
palkeo_ has quit [Ping timeout: 240 seconds]
<ipfsbot> [go-ipfs] noffle opened pull request #2365: Fixes range error by using > 0 length buffer. (master...length_zero) https://git.io/v2evu
devbug has quit [Ping timeout: 250 seconds]
palkeo_ has joined #ipfs
Guest33530 has joined #ipfs
Guest33530 is now known as amiller
montagsoup has joined #ipfs
devbug has joined #ipfs
devbug has quit [Remote host closed the connection]
devbug has joined #ipfs
stoogenmeyer has quit [Remote host closed the connection]
prettymuchbryce has quit [Ping timeout: 240 seconds]
prettymuchbryce has joined #ipfs
pfraze has quit [Remote host closed the connection]
stoogenmeyer has joined #ipfs
<voxelot> daviddias: ping
<voxelot> cc dignifiedquire: question about streams in data-importer if you feel like a streams convo
shea256 has joined #ipfs
Encrypt has joined #ipfs
<dignifiedquire> voxelot: what's up?
tilgovi has joined #ipfs
stoogenmeyer has quit [Remote host closed the connection]
ashark has joined #ipfs
cemerick has quit [Ping timeout: 240 seconds]
joshbuddy has quit [Quit: joshbuddy]
<lgierth> dignifiedquire: i'll give the pin another try in a bit
<dignifiedquire> lgierth: my node is down now so not sure it'll work
wwwbukolaycom has joined #ipfs
<dignifiedquire> we can do it tomorrow again or you pull the data from an 0.4 node via migratin
<voxelot> dignifiedquire: hey, trying to work with the fixedSizeChunker https://github.com/ipfs/js-ipfs-data-importing/blob/master/src/chunker-fixed-size.js
<voxelot> ever looked at it?
<ipfsbot> [go-ipfs] RichardLitt created docs/edit-ls-desc (+1 new commit): https://git.io/v2etC
<ipfsbot> go-ipfs/docs/edit-ls-desc 600d4a6 Richard Littauer: Edit the ls.go description...
<dignifiedquire> voxelot: no, but 40 loc I can read ;)
<ipfsbot> [go-ipfs] RichardLitt opened pull request #2366: Edit the ls.go description (master...docs/edit-ls-desc) https://git.io/v2etB
<voxelot> haha yeah it's just a through2 slicing at fixed size
<dignifiedquire> okay so what's your issue?
<lgierth> dignifiedquire: i was trying it with v04x earlier today -- where you meaning it should actually be pinned for v03x?
<lgierth> and is it maybe already available somewhere in v04x which is not your laptop?
<dignifiedquire> lgierth: it needs to be pinned for both
<richardlitt> dignifiedquire: D:
<lgierth> ok -- i'm seeing myself actually building that object migration script, after all :) i was doing the same for the website yesterday
<dignifiedquire> lgierth: maybe, otherwise you can generate the data directly on the machine pretty easily now: https://github.com/ipfs/ipfs-geoip/pull/7
<lgierth> awesome
<lgierth> reproducable hashes?
<dignifiedquire> lgierth: just need to clone, checkout that branch, npm install, and "npm run generate"
<dignifiedquire> should be yes
<lgierth> awesome++
<M-mubot> awesome has 1 point
<lgierth> !botsnack
<pinbot> om nom nom
<M-mubot> Thanks for the treat!
<dignifiedquire> at least they were for me when switching from 0.4 to 0.3
<voxelot> dignifiedquire: when i try to push a buffer into an instance of it, i'm getting a weird offset in the chunks compared to when the stream is feed from a file
<dignifiedquire> lgierth: it will add the objects to what ever daemon is running, but you need to run pin on the root hash afterwards
<lgierth> 0.3/0.4 shouldn't matter -- reproducability is purely about what the npm thing adds
s_kunk has joined #ipfs
<voxelot> and here is log of the buffers after being chunked http://pastebin.com/j2Tgbfix
<voxelot> it's like everything gets shifted to the right one in the buffer arrays, then the last chunk is all 00
<dignifiedquire> voxelot: how do you add the file? fs.createReadStream().pipe ?
<voxelot> dignifiedquire: no I use readSync to get a buffer in memory, then pass the buffer into bufferImporter(buffer, callback)
<dignifiedquire> voxelot: now I'm confused, what are the exactly two different ways that you add the content to the buffer?
<voxelot> i do "var buf = fs.readFileSync(__dirname + '/test-data/1.2MiB.txt')" and then pass buf to that function
<voxelot> so now i need to chunk the 1.2Mb buffer
pfraze has joined #ipfs
<voxelot> dignifiedquire: if I use this chunker I re-purposed from somewhere though it does work https://gist.github.com/nginnever/18dfc4800589e9372238#file-bufferstream-js-L42-L51
<dignifiedquire> voxelot: so the last reference you posted is the one doing the right thing?
<voxelot> yeah so if i call the last gist there like "bufferStream(buffer).pipe(through2((chunk, enc, cb) => ...." it gives the same output as fileImporter
<ipfsbot> [go-ipfs] RichardLitt created docs/capitalize-dht (+1 new commit): https://git.io/v2eOt
<ipfsbot> go-ipfs/docs/capitalize-dht ac42bb7 Richard Littauer: Capitalized DHT...
<ipfsbot> [go-ipfs] RichardLitt opened pull request #2367: Capitalized DHT (master...docs/capitalize-dht) https://git.io/v2eOs
<dignifiedquire> voxelot: I'm not sure, but I have the feeling that sth around this line https://github.com/ipfs/js-ipfs-data-importing/blob/master/src/chunker-fixed-size.js#L26 is not right, but maybe I'm just imagining things
<dignifiedquire> sorry brain is too tired for more helpful advice, let me know if you fix it otherwise if you could pull code somewhere so I can reproduce it I'll check it in the morning
<ipfsbot> [go-ipfs] noffle opened pull request #2368: Checks TEST_OS in a more POSIX-y manner. (master...posixy_test_os) https://git.io/v2eOy
patcon__ has joined #ipfs
patcon_ has quit [Ping timeout: 240 seconds]
<voxelot> dignifiedquire: thank you for looking! I'm going to investigate that line, could be right
<voxelot> get some rest
joshbuddy has joined #ipfs
M-zick has joined #ipfs
<M-zick> who know what the problem - path = api.name_resolve(peer_id)['Path']
<M-zick> File "/d/evox/env/dd7df51d477e0e97340f42c8609b49da45775ca8.160217.224709/local/lib/python2.7/site-packages/ipfsApi/client.py", line 306, in name_resolve
<M-zick> return self._name_resolve.request(self._client, *args, **kwargs)
<M-zick> File "/d/evox/env/dd7df51d477e0e97340f42c8609b49da45775ca8.160217.224709/local/lib/python2.7/site-packages/ipfsApi/commands.py", line 31, in request
<M-zick> return client.request(self.path, args=args, **kwargs)
<M-zick> File "/d/evox/env/dd7df51d477e0e97340f42c8609b49da45775ca8.160217.224709/local/lib/python2.7/site-packages/ipfsApi/http.py", line 24, in wrapper
<M-zick> return f(self, *args, **merged)
<M-zick> File "/d/evox/env/dd7df51d477e0e97340f42c8609b49da45775ca8.160217.224709/local/lib/python2.7/site-packages/ipfsApi/http.py", line 91, in request
<M-zick> raise ipfsApiError(ret['Message'])
<M-zick> ipfsApi.exceptions.ipfsApiError: Could not resolve name.
<richardlitt> Why might I get this error? ipfs get QmT78zSuBmuS4z925WZfrqQ1qHaJ56DQaTfyMUF7F8ff5o
<richardlitt> Error: api version mismatch (0.4.0-dev != 0.3.11-dev)
montagsoup has quit [Quit: Leaving]
reit has joined #ipfs
<lgierth> richardlitt: running daemon is the other version
<lgierth> probably changed the ipfs binary after starting the daemo
<richardlitt> hmm
<richardlitt> it is now at 0.3.11
<richardlitt> how do I go back to 0.4.0?
<richardlitt> Probably happened when I was playing around with ipfs upgrade :/
<lgierth> git clone && make install? :)
<richardlitt> Seriously?
<lgierth> or do you mean the repo?
<lgierth> i haven't ever tried ipfs-update yet tbh
<lgierth> but that should do too
<richardlitt> I am going to make install after pulling
<richardlitt> there. back.
pfraze has quit [Remote host closed the connection]
<ipfsbot> [go-ipfs] RichardLitt created docs/get-command (+1 new commit): https://git.io/v2ec6
<ipfsbot> go-ipfs/docs/get-command 50a44f9 Richard Littauer: Added ticks, `the`, and defaults to `get`...
<richardlitt> thanks lgierth
<ipfsbot> [go-ipfs] RichardLitt opened pull request #2369: Added ticks, `the`, and defaults to `get` (master...docs/get-command) https://git.io/v2ecM
zootella has joined #ipfs
palkeo_ has quit [Quit: Konversation terminated!]
patcon_ has joined #ipfs
pfraze has joined #ipfs
mildred has quit [Ping timeout: 248 seconds]
patcon__ has quit [Ping timeout: 255 seconds]
rawtaz has quit [Ping timeout: 265 seconds]
martinkl_ has joined #ipfs
rawtaz has joined #ipfs
martinkl_ has quit [Client Quit]
<richardlitt> dignifiedquire: thanks for being so assiduous.
<ipfsbot> [go-ipfs] noffle opened pull request #2370: Adds arbitrary port support to t0060-daemon.sh (master...daemon_plus_plus) https://git.io/v2e8k
patcon_ has quit [Ping timeout: 240 seconds]
Matoro_ has quit [Ping timeout: 240 seconds]
Matoro_ has joined #ipfs
shea256 has quit [Remote host closed the connection]
shea256 has joined #ipfs
zootella has quit [Quit: zootella]
Encrypt has quit [Quit: Quitte]