jbenet changed the topic of #ipfs to: IPFS - InterPlanetary File System - https://github.com/ipfs/ipfs -- channel logged at https://botbot.me/freenode/ipfs/ -- Code of Conduct: https://github.com/ipfs/community/blob/master/code-of-conduct.md -- Sprints: https://github.com/ipfs/pm/ -- Community Info: https://github.com/ipfs/community/ -- FAQ: https://github.com/ipfs/faq -- Support: https://github.com/ipfs/support
voxelot has quit [Ping timeout: 255 seconds]
amylopsin has joined #ipfs
Matoro has joined #ipfs
ianopolous2 is now known as ianopolous
<cryptix> !pin QmT9CBvmRBvvJCvWSz7JeeWC7eMQ7nghQtNJfYt4sooCxt
<pinbot> now pinning /ipfs/QmT9CBvmRBvvJCvWSz7JeeWC7eMQ7nghQtNJfYt4sooCxt
<ion> cryptix: Your pets?
<cryptix> breakfirst
pfraze has quit [Remote host closed the connection]
domanic has quit [Ping timeout: 252 seconds]
<codehero> cryptix: oO
afdudley has quit [Ping timeout: 250 seconds]
afdudley has joined #ipfs
<cryptix> codehero, ion: /ipfs/QmWf4jsYKSFK53oJup1Prmz5mceqkq6Ef6AnhbNA578uxL/2-beez/ ;)
<cryptix> ion: i think you brought up nixos one day here? thanks for that ^^
<codehero> you're using nixos now?
<cryptix> codehero: tried it one a few VMs, not exclusivly
<codehero> ah. you use freebsd on your desktop?
<ion> cryptix: It must have been someone else. But yeah, NixOS is neat.
<cryptix> huh sorry
fingertoe has joined #ipfs
vanila has quit [Quit: Leaving]
<tilgovi> I'm still looking for my next laptop os
<tilgovi> if anyone has recommendations
<tilgovi> Very happy KDE user but not sure about the future of Kubuntu.
<davidar> tilgovi (IRC): how so?
<tilgovi> There's some turmoil
<ansuz> lol copyright
<davidar> *sigh* canonical
SDr has quit [Ping timeout: 250 seconds]
<davidar> tilgovi (IRC): fedora is quite stable, but it's almost a bit boring :p
<davidar> whyrusleeping would probably suggest arch
<tilgovi> I've never run fedora, but I've worked in a centos shop and didn't enjoy rpm, but maybe that's just fear
<davidar> Not sure how well pain Debian works as a desktop OS these days
<tilgovi> gentoo was my first, and arch is appealing
<davidar> * plain, lol
<tilgovi> just not sure how much crap I'm going to deal with running arch on my laptop
<codehero> i can recommend arch
<tilgovi> I am a bit of a weirdo, though, and comfortable in territory that's unstable
<codehero> or nixos if you're feeling brave and don't mind delayed security updates
<tilgovi> I'm running zfs on my root partition, for instance
<davidar> I'm trying to work up the courage to try nixos :)
<davidar> nix itself is quite nice
<codehero> it's pretty easy to set up, actually
<davidar> But, it breaks all the traditional assumptions :p
<davidar> @freenode_codehero:matrix.org: sure, more concerned about compatibility though
voxelot has joined #ipfs
voxelot has quit [Changing host]
voxelot has joined #ipfs
SDr has joined #ipfs
<codehero> compatibility isn't a problem
<codehero> they even got steam to work
Guest73396 has joined #ipfs
<tilgovi> I'm thinking maybe tanglu
<codehero> the central config system is one of the best things about nixos
<codehero> when pierron fixes security updates, i can just install the nixos base system and git pull my config
<codehero> finished
<davidar> Last I heard there were a lot of caveats re things like steam
<codehero> yeah. well, steam works now
<codehero> flawlessly
<davidar> Huh
<davidar> tilgovi (IRC): can't say I've heard of it
<davidar> @freenode_codehero:matrix.org: I might have to try it. I've got lvm set up now, so hopefully partitioning will be less painful
<codehero> lvm is pretty easy with nixos. easier than with archlinux
<tilgovi> also https://chakraos.org/
<codehero> davidar: you can also look at my config
<tilgovi> I don't know how well running arch-derivitives works though
<codehero> i think it's better to just install arch
<codehero> it's not that hard
<tilgovi> I don't know enough about arch packages to know what the state of that world is with respect to overlays and such
<tilgovi> is it easy to manage package sources, and does the community make 3rd-party and experimental packages available anywhere easy?
<davidar> tilgovi (IRC): I guess mint would also be an option of you didn't want too big of a change
<davidar> *if
<codehero> tilgovi: well. there's the aur
<davidar> tilgovi (IRC): I think AUR is probably the biggest strong point of arch
<tilgovi> oh right
<tilgovi> i remember that now
<tilgovi> (i have looked into these things in the past)
<tilgovi> you're right
<tilgovi> that is really awesome
<tilgovi> god, how in the hell did I ever install kubuntu on a zfs root?
<tilgovi> I must have done the installation by hand
<tilgovi> I bet it wasn't that bad. Boot livecd. Drop to terminal. Install zfs packages. Format. Then run the installer and ask it not to format. I could probably manage the same with arch.
<codehero> yeah. pretty easy, if not easier
<codehero> you don't have to switch between cli and gui
<tilgovi> maybe i'll give it a shot soon
<tilgovi> I really miss the rolling releases from my gentoo days.
<tilgovi> Every one of the last 3 or 4 upgrades I've done has resulted in failure in the middle of upgrading and some amount of scary rescue effort
<davidar> @freenode_codehero:matrix.org: how easy is it to install third party stuff on nixos?
<davidar> ie. configure make install type stuff
<tilgovi> looks like hella good zfs docs actually
<tilgovi> Actually, heh, I remember using this when I installed kubuntu
<tilgovi> Because the arch wiki had the best info on zfs on an encrypted partition
<davidar> Yeah, I often use the arch docs even though I don't use arch :p
<tilgovi> :)
<codehero> davidar: VERY easy
<tilgovi> thanks for your opinions, everyone
<codehero> ridiculously easy even
<codehero> never saw a simpler package creating mechanism
<davidar> @freenode_codehero:matrix.org: is there an ipfs package yet?
<codehero> good question. let's see
<codehero> yes. in go-packages
<davidar> OK, I'm sold
<codehero> nixos is also used to install packages that would usually be installed via cabal, pip, go, ...
<codehero> it's pretty sweet
<codehero> i think also npm
<codehero> and the ruby thingy
<codehero> oh, also emacs packages
<davidar> I read that, didn't realise it was that comprehensive though
<codehero> yupp
<codehero> but you should wait until security updates are fixed before you use it as your main system
voxelot has quit [Ping timeout: 256 seconds]
pfraze has joined #ipfs
voxelot has joined #ipfs
<davidar> Ah, what's the story with that?
<whyrusleeping> someone say something to me?
<davidar> whyrusleeping (IRC): we were talking about how much arch sucks
<codehero> davidar: mass rebuilds sometimes cause every package update to be delayed by 1 month or more
<codehero> including security updates
<codehero> so, yeah
<codehero> but pierron is working on fixing htat
<codehero> *that
<davidar> @freenode_codehero:matrix.org: ah, how long til that gets fixed?
<whyrusleeping> davidar: take it back!
<davidar> whyrusleeping (IRC): lol
<whyrusleeping> arch is the only distro i've ever used that manages to install graphics drivers without fucking everything up
<davidar> @freenode_codehero:matrix.org: speaking of, what's the state of graphics drivers on nixos?
<codehero> they work
<codehero> i mean. you get the same ones you get on other distributions
<codehero> installing them is also pretty easy
HoboPrimate has quit [Remote host closed the connection]
domanic has joined #ipfs
<davidar> cuda?
r04r is now known as zz_r04r
<codehero> i only have a laptop with intel integrated graphics, but i think cuda also works
<codehero> now the documentation on nixos isn't always the best....
<codehero> but the people on #nixos and the nixos mailing list are very helpful
samiswellcool has quit [Quit: Connection closed for inactivity]
<whyrusleeping> davidar: cuda was the hard part that arch got right for me
<codehero> heh
simonv3 has quit [Quit: Connection closed for inactivity]
<codehero> well, the only thing you can do to find out if it really works is trying
<davidar> @freenode_codehero:matrix.org: ooh, AUR on nixos? :p
<davidar> whyrusleeping (IRC): cuda is pretty easy on Ubuntu too...
<codehero> davidar: umm. no. no aur
<codehero> the package managing works pretty much like AUR though
<codehero> users just create/update a package and make a pull request
<whyrusleeping> davidar: it was a bitch and a half to get up to date cuda on ubuntu
<whyrusleeping> plus, screw actually using ubuntu, unity is an abomination
<davidar> whyrusleeping (IRC): well, kubuntu
<davidar> Cuda is actually easier to install than the standalone drivers
<whyrusleeping> yeah, i just like being able to pick exactly what package i install
<whyrusleeping> 'sudo pacman -S cuda'
<whyrusleeping> kablam
<davidar> Yeah, there's a Debian repo for cuda too :p
<davidar> Anyway, I'll probably try nixos at some point, thanks for answering my questions codehero :)
<ion> Unity is pretty great.
<davidar> I don't mind unity aesthetically, but it's stability is a bit crap
<ion> I like how well you can use it with just the keyboard. It even has a single-keypress cheatsheet for keyboard shortcuts.
<davidar> I ended up abandoning it because the password field in the lock screen kept disappearing :/
<ion> And i like the launcher and the window switcher being the same in any system.
<codehero> davidar: no problem
<davidar> ion (IRC): it's not too hard to set up kde to act like unity for the most part
<davidar> But, actually with good performance :p
tilgovi has quit [Remote host closed the connection]
dignifiedquire has quit [Quit: dignifiedquire]
<davidar> I would have been happy if they just made unity a custom config for kde actually
<davidar> They're already moving to qt anyway...
<whyrusleeping> >.> the webui crashed on me
<zignig> /me passes whyrusleeping the controls for the orbital disintergrator.
<whyrusleeping> dude
<whyrusleeping> i dont know whats going on right now
<whyrusleeping> i also am not webscale, so i dont know how to debug these things
<codehero> whyrusleeping: :D
<codehero> same thing happened to me before
<whyrusleeping> hrm...
<whyrusleeping> this is troublesome
<codehero> but i have no idea how to reproduce it
<codehero> seems to be random
<whyrusleeping> i want to ship 0.3.9 right meow
<codehero> :D
<achin> mrow
<whyrusleeping> hrm. thats very troublesome
<whyrusleeping> a bug i thought was fixed is not fixed
Guest73396 has quit [Ping timeout: 260 seconds]
simonv3 has joined #ipfs
patcon has quit [Ping timeout: 240 seconds]
* whyrusleeping grabs a beer
<whyrusleeping> bugfixin time
<zignig> unce unce unce
<achin> whyrusleeping is invoking the balmer curve
<achin> ballmer peak
<codehero> :D
<codehero> hm. i can't get it to crash, but it doesn't show any node information anymore
<achin> (protip: doens't work with spelling or typing)
<codehero> :D
<codehero> oh well
<codehero> you can't '>' the core dump.....
<codehero> or... i'm just an idiot
<codehero> who knows
<zignig> codehero: why not ?
<codehero> should've used 2& i think...
<codehero> well
<zignig> yes.... ;)
<lgierth> hey everyone, just a heads up: i'm about to run `ipfs repo gc` on all ipfs.io hosts, one after another
ygrek_ has quit [Ping timeout: 260 seconds]
<achin> i'd be curious to know how much data you end up purging (across all nodes)
<whyrusleeping> whats happening is that the 'log' tab is opening up the ipfs log tail endpoint
<whyrusleeping> and then not closing it
<whyrusleeping> so all logs hang trying to write through
<whyrusleeping> and the daemon halts
<whyrusleeping> because every goroutine gets stuck in a log
* whyrusleeping grabs beer #2
<ion> lgierth: While automatic LRU GC isn’t implemented, perhaps you could schedule a round-robin set of invocations on a different node every day. If some content is popular on the gateways, 7/8 hosts will retain it over any single invocation and it’ll probably get it back from the others before the others are GC’d.
<spikebike> but all my priceless data!!!!
<spikebike> ;-)
<spikebike> GC'ing 1/N hosts a day seems pretty reasonable
xelra has quit [Ping timeout: 268 seconds]
<lgierth> ion: this one's RFM: https://github.com/ipfs/go-ipfs/pull/1495
<lgierth> i gc'd 4 of 8 so far
xelra has joined #ipfs
<lgierth> leaving another 3 for tomorrow
<zignig> lgierth: how big is .ipfs/ at the moment on the hosts ?
<zignig> eleventy bajillion zigga bytes ?
* zignig wonders if the S3 backend is working yet ?
<lgierth> i think s3 is part of 0.4.0
Matoro has quit [Ping timeout: 246 seconds]
Oatmeal has quit [Ping timeout: 265 seconds]
<zignig> using glacier / encrypted storage and setting up a replicated node would be cool.
<lgierth> oh i got something better
<zignig> that's a serious amount of cat photos.
<zignig> lgierth / whyrusleeping : is pinbot data on the gateways ?
<lgierth> yeah pinbot pins on all 8
<zignig> ;)
<zignig> http://gateway.ipfs.io/ should point to a common ipns record of cool ipfs stuff, rather than 404.
<lgierth> gateway. is just a gateway
<lgierth> we'll have cool stuff at ipfs.io/refs
<lgierth> well mostly cool stuff
Oatmeal has joined #ipfs
<zignig> ipfs.io/refs is broken
<zignig> Path Resolve error: no link named "refs" under QmTgNJEgQaCqRht9KSXNyZsCp2xpHZmBRms28NRMmtcERp
<ion> https://gateway.ipfs.io/<path> isn’t redirecting to https://ipfs.io/<path>
RJ2 has quit [Ping timeout: 264 seconds]
ogd has quit [Ping timeout: 264 seconds]
sindresorhus has quit [Read error: Connection reset by peer]
leeola has quit [Read error: Connection reset by peer]
sugarpuff has quit [Read error: Connection reset by peer]
daviddias has quit [Read error: Connection reset by peer]
mvr_ has quit [Read error: Connection reset by peer]
zmanian has quit [Read error: Connection reset by peer]
edwardk has quit [Read error: Connection reset by peer]
karissa has quit [Read error: Connection reset by peer]
bergie has quit [Read error: Connection reset by peer]
hosh has quit [Read error: Connection reset by peer]
ekroon has quit [Read error: Connection reset by peer]
bigbluehat has quit [Ping timeout: 268 seconds]
kevin`` has quit [Read error: Connection reset by peer]
Luzifer has quit [Read error: Connection reset by peer]
zmanian has joined #ipfs
tibor has quit [Read error: Connection reset by peer]
cleichner has quit [Read error: Connection reset by peer]
<lgierth> zignig: yeah /refs doesn't exist yet, just a couple more days
jonl has quit [Read error: Connection reset by peer]
prosodyvVC has quit [Read error: Connection reset by peer]
robmyers has quit [Read error: Connection reset by peer]
SoreGums has quit [Read error: Connection reset by peer]
<lgierth> bai irccloud
<zignig> lgierth: :) all good.
<lgierth> ion: the redirect is todo :)
Matoro has joined #ipfs
* zignig has been thinging about convergent/concordant/unanimous naming systems for ipfs.
<zignig> *thinking
<zignig> more complicated than it looks.
karissa has joined #ipfs
kevin`` has joined #ipfs
Guest73396 has joined #ipfs
sindresorhus has joined #ipfs
sugarpuff has joined #ipfs
daviddias has joined #ipfs
edwardk has joined #ipfs
ekroon has joined #ipfs
Luzifer has joined #ipfs
bigbluehat has joined #ipfs
leeola has joined #ipfs
tibor has joined #ipfs
mvr_ has joined #ipfs
robmyers has joined #ipfs
RJ2 has joined #ipfs
<whyrusleeping> YEAH!
<whyrusleeping> BUG DOWN
<lgierth> :):)
jonl has joined #ipfs
* whyrusleeping beer grabs beer #4 to celebrate
<lgierth> and storage host up
<zignig> hooray !
<ion> whyrusleeping: gj
<lgierth> ^5
<whyrusleeping> o/
<zignig> lgierth: exponent 5 ?
<zignig> ;)
<ion> ₅
bergie has joined #ipfs
<lgierth> whyrusleeping: which bug?
SoreGums has joined #ipfs
<whyrusleeping> webui and 'ipfs log tail' do not play well
<whyrusleeping> and there was a bug where the webui would call 'ipfs log tail' for the log streaming view
<whyrusleeping> and then not read the response
<whyrusleeping> which would cause all calls to log to hang
hosh has joined #ipfs
cleichner has joined #ipfs
<whyrusleeping> leading to the entire daemmon hanging
<whyrusleeping> because every goroutine gets stuck in a log call
<lgierth> wow sounds bad
<whyrusleeping> the webui still isnt super good about closing out that request though
<whyrusleeping> yeah, pretty nasty
prosodyvVC has joined #ipfs
<whyrusleeping> but it only ever really happened if you played with 'ipfs log tail' and didnt close things up after yourself
<zignig> have the log on a ring buffer so it just drops stuff if it's not drained.
<ion> put a ring on it
<zignig> did that , gets exe..
ogd has joined #ipfs
<whyrusleeping> well, i'm just going to time out log writers if the write doesnt happen in a timely manner
<zignig> mmm logging.
<zignig> whyrusleeping: is it possible to set up a access hook on a block ?
<whyrusleeping> access hook on a block..?
<whyrusleeping> huh?
<zignig> so if someone asks for a block it emits a log event.
<zignig> ( with the node id )
<whyrusleeping> oh, yeah
<whyrusleeping> thats already there
<zignig> exposed to the api or internal ?
<ReactorScram> I'm trying to make wget download a site for archiving, but wget -mk doesn't seem to be doing it. It just downloads the index page
<lgierth> ReactorScram: try --mirror
<ReactorScram> lgierth: Same result
<whyrusleeping> zignig: should be available through 'ipfs log tail'
<whyrusleeping> although your mileage may vary until i get this fix through
<deltab> just had an idea on how nodes can agree on which of them should host something to ensure that at least a certain number of them have it
<deltab> hash the block id with each of the participating node ids, sort the results., and the first n should obtain or retain the block
<deltab> maybe that's non-obvious and useful to someone
Guest73396 has quit []
<ReactorScram> lgierth: I guess robots.txt is blocking it, oh well
voxelot has quit [Ping timeout: 240 seconds]
<spikebike> deltab: ummm, nodes don't download/replicate anything unless it's requested.
<spikebike> when you setup a ipfs node it will have no files on it until you add them
<spikebike> there's no automatic donation of storage to other ipfs nodes
Guest73396 has joined #ipfs
xelra has quit [Ping timeout: 240 seconds]
xelra has joined #ipfs
sonatagreen has quit [Ping timeout: 246 seconds]
<whyrusleeping> spikebike: i think hes talking about federation of nodes
sseagull has quit [Quit: Lost terminal]
<domanic> wrong channel
<spikebike> ah, yeah, been planning something like that, basically was planning to take N files, query who has them, then add/subtract replication to meet the replication goals
amstocker has joined #ipfs
<whyrusleeping> anyone know how to make netcat *not* read anything?
<whyrusleeping> i just want to connect, write something, and then hang without reading
<whyrusleeping> to test something
<spikebike> echo foo | nc ip port
<nikogonzo> whyrusleeping: like this? https://gist.github.com/anonymous/f2315294158171d21e7d
chriscool has joined #ipfs
gendale_ has quit [Quit: Changing server]
Guest73396 has quit [Ping timeout: 252 seconds]
tilgovi has joined #ipfs
blueskymonster has joined #ipfs
<whyrusleeping> nikogonzo: i think thats the other way around
<whyrusleeping> -z says not to write anything
<whyrusleeping> i want to not read anything
blueskymonster has quit [Ping timeout: 246 seconds]
<whyrusleeping> spikebike: nc reads and spits to stdout
<whyrusleeping> that wont work
<lgierth> whyrusleeping: cat - | nc ?
<lgierth> should hang until you send ctrl-d
gendale_ has joined #ipfs
<nikogonzo> whyrusleeping: so you want to start a nc listener, then send data to the listener, but have the listener silently drop whatever came over the pipe? that sounds like nc -d -k to me. with -d you don't even have to redirect stderr/stdout it appears
Eudaimonstro has quit [Remote host closed the connection]
chriscool has quit [Ping timeout: 268 seconds]
Eudaimonstro has joined #ipfs
chriscool has joined #ipfs
<whyrusleeping> no, i want to send data to an ipfs daemon, and not read anything back
<whyrusleeping> not silently drop
<whyrusleeping> just not read
<whyrusleeping> block
<whyrusleeping> like this bit of go code: http://play.golang.org/p/aQeusHE9sT
<whyrusleeping> just want to do it without an extra binary if i can
<mappum> whyrusleeping: if you have ncat you can do --send-only
<mappum> not sure how common ncat is though
<whyrusleeping> probably not common enough to be on all the test CI machines :/
<whyrusleeping> oh well
<nikogonzo> whyrusleeping: oh, have you tried doing it with bash?
<nikogonzo> most modern bashes can do that
<whyrusleeping> nikogonzo: :( cant use bash either, our tests are strictly run in /bin/sh
<whyrusleeping> (bash isnt cross platform, and doesnt behave the same way all the time)
vx has joined #ipfs
<nikogonzo> whyrusleeping: i think lgierth 's suggestion might do it: https://gist.github.com/anonymous/de8d776c69f9505a8c9b
dysbulic has joined #ipfs
<nikogonzo> nvm, still reads on the client side :(
amstocker has quit [Ping timeout: 244 seconds]
chriscool has quit [Quit: Leaving.]
chriscool has joined #ipfs
e-lima has joined #ipfs
<mappum> can't you just `> /dev/null`? that works for me
Guest73396 has joined #ipfs
sharky has quit [Ping timeout: 260 seconds]
lilkari has joined #ipfs
* lilkari slaps lilkari around a bit with a large fishbot
lilkari has quit [Client Quit]
sharky has joined #ipfs
<ansuz> rude
simonv3 has quit [Quit: Connection closed for inactivity]
nessence has joined #ipfs
Pent has joined #ipfs
tilgovi has quit [Remote host closed the connection]
amstocker has joined #ipfs
bedeho has joined #ipfs
JimmyTheWhale has quit [Remote host closed the connection]
pfraze has quit [Remote host closed the connection]
<whyrusleeping> mappum: no, all the output from the daemon gets read
<whyrusleeping> and written out to /dev/null
<whyrusleeping> my goal is for the daemons write to me to hang
konubinix has quit [Quit: ZNC - http://znc.in]
konubinix has joined #ipfs
konubinix has quit [Client Quit]
mildred has joined #ipfs
konubinix has joined #ipfs
konubinix has quit [Client Quit]
Tv` has quit [Quit: Connection closed for inactivity]
konubinix has joined #ipfs
konubinix has quit [Client Quit]
fingertoe has quit [Ping timeout: 246 seconds]
konubinix has joined #ipfs
<ipfsbot> [go-ipfs] whyrusleeping created fix/log-hang (+2 new commits): http://git.io/vlfdE
<ipfsbot> go-ipfs/fix/log-hang e5cd927 Jeromy: vendor logging lib update...
<ipfsbot> go-ipfs/fix/log-hang 54dce63 Jeromy: fix log hanging issue, and implement close-notify for commands...
zeroish has quit [Ping timeout: 260 seconds]
bedeho has quit [Ping timeout: 240 seconds]
ebarch has quit [Ping timeout: 260 seconds]
<ipfsbot> [go-ipfs] whyrusleeping opened pull request #1914: fix webui log hanging bug (master...fix/log-hang) http://git.io/vlfNy
ebarch has joined #ipfs
<whyrusleeping> my signature sorting algorithm: https://github.com/whyrusleeping/sleepsort
vx has quit [Quit: Connection closed for inactivity]
Guest73396 has quit [Ping timeout: 240 seconds]
<davidar> whyrusleeping (IRC): kind of like spaghetti sort, minus the spaghetti
amstocker has quit [Ping timeout: 255 seconds]
<davidar> Or, spaghetti that's been rotated into the fourth dimension :p
<whyrusleeping> lol
<davidar> Hehe, I love this sentence: "This is possible because the hand, the spaghetti rods and the table work as a fully parallel computing device. "
<davidar> Favorite sorting algorithm: http://www.dangermouse.net/esoteric/bogobogosort.html
domanic has quit [Ping timeout: 240 seconds]
<ipfsbot> [go-ipfs] whyrusleeping force-pushed fix/log-hang from 54dce63 to f21fe5c: http://git.io/vlJ3U
<ipfsbot> go-ipfs/fix/log-hang 8ea9225 Jeromy: vendor logging lib update...
<ipfsbot> go-ipfs/fix/log-hang f21fe5c Jeromy: fix log hanging issue, and implement close-notify for commands...
ipfs_intern has joined #ipfs
s_kunk has quit [Ping timeout: 268 seconds]
harlan_ has joined #ipfs
ilyaigpetrov has joined #ipfs
NeoTeo has joined #ipfs
Zuardi has quit [Remote host closed the connection]
Zuardi has joined #ipfs
dignifiedquire has joined #ipfs
s_kunk has joined #ipfs
dignifiedquire_ has joined #ipfs
dignifiedquire has quit [Ping timeout: 256 seconds]
dignifiedquire__ has joined #ipfs
dignifiedquire has joined #ipfs
dignifiedquire_ has quit [Ping timeout: 240 seconds]
<victorbjelkholm> spikebike, ipfsbin is not working for you? Would be useful if you sent me the console output if something weird happens
<ianopolous> davidar: nice bogobogosort :-)
<dignifiedquire> good morning everyone
<victorbjelkholm> Good morning!
voxelot has joined #ipfs
voxelot has quit [Ping timeout: 252 seconds]
master8787 has joined #ipfs
rendar has joined #ipfs
stoopkid has joined #ipfs
dignifiedquire__ has quit [Quit: dignifiedquire__]
<NeoTeo> morning :)
<spikebike> victorbjelkholm: I added an ipfsbin, then tried to get to it with ipfs cat, took several minutes to get it. A friend couldn't get the website to work which was strange.
ipfs_intern has quit [Quit: Page closed]
<spikebike> victorbjelkholm: you getting any file handle issues on your node handling ipfsbin?
Guest73396 has joined #ipfs
<victorbjelkholm> Hm, working fine here. Let me check
<victorbjelkholm> fifteen minutes ago I got "time="05:45:28:000" level=error msg="err: multipart: NextPart: http: invalid Read on closed Body" module="commands/http""
<victorbjelkholm> might be related maybe
<spikebike> just tried it again
<spikebike> ipfs cat works right away
<spikebike> what version of ipfs are you using?
<victorbjelkholm> hm, tricky. Oh well, right now is just one node that is pinning the content, in the future, there will be more nodes pinning content, then it's gonna get faster
<victorbjelkholm> 0.3.9
<spikebike> gotta run, seems to be workign now
<cryptix> hellow
edcryptickiller has joined #ipfs
edcryptickiller has left #ipfs [#ipfs]
Guest73396 has quit [Ping timeout: 256 seconds]
captain_morgan has quit [Ping timeout: 240 seconds]
harlan_ has quit [Quit: Connection closed for inactivity]
OutBackDingo has quit [Quit: Leaving]
OutBackDingo has joined #ipfs
nessence has quit [Remote host closed the connection]
nessence has joined #ipfs
<victorbjelkholm> dignifiedquire, how are you finding greekeeper so far? Is a bit noisy, no?
ilyaigpetrov has quit [Quit: Connection closed for inactivity]
<dignifiedquire> victorbjelkholm: I love it
<dignifiedquire> it makes it so much easier to keep track of dependency updates and if they are breaking something
<dignifiedquire> and as it’s a PR I can just review it when I have time
<victorbjelkholm> yeah, that's true. I just wished it could batch the things and give me max one PR every X days instead of every time it happens
Guest73396 has joined #ipfs
master8787 has quit [Quit: Leaving]
dysbulic has quit [Quit: ChatZilla 0.9.92 [Firefox 41.0.2/20151016093648]]
Qwertie has quit [Quit: ZNC - http://znc.in]
OutBackDingo has quit [Quit: Leaving]
edcryptickiller has joined #ipfs
OutBackDingo has joined #ipfs
<dignifiedquire> victorbjelkholm: jbenet whyrusleeping any ideas what this error message means: “context deadline exceeded” when trying to do a request via the http api?
<victorbjelkholm> dignifiedquire, my understanding is that it took too long time to find/download the file. Hit it a few times as well
* victorbjelkholm is not 100% sure
<dignifiedquire> I see
edcryptickiller has left #ipfs [#ipfs]
<daviddias> dignifiedquire: learning about this https://github.com/atom/electron/issues/2765 (because of node-webrtc https://code.google.com/p/chromium/issues/detail?id=517914)
<dignifiedquire> daviddias: sounds like you are having the real fun here
<daviddias> it could be related to the fact that we are getting different, almost chaotic, results when each of us tries the latest station app
<cryptix> dignifiedquire: it's def. a timeout error
<dignifiedquire> cryptix: thanks
<cryptix> but wich part of the system... *shrugs*
<cryptix> id love to go berserk on all the context error handling and add some actual context info..
Encrypt has joined #ipfs
null_rad- has quit [Excess Flood]
null_radix has joined #ipfs
Encrypt has quit [Quit: Eating time!]
<zignig> cryptix: ;P
* zignig has put the midget human units to bed and now has some time to talk.
<Teeed> hm...
<zignig> Teeed: ?
martinkl_ has joined #ipfs
arpu has joined #ipfs
OutBackDingo has quit [Quit: Leaving]
OutBackDingo has joined #ipfs
OutBackDingo has quit [Client Quit]
nessence has quit [Ping timeout: 260 seconds]
OutBackDingo has joined #ipfs
Joltidly has joined #ipfs
vanila has joined #ipfs
<victorbjelkholm> just to make sure, if I have two computers connected to the same network, running ipfs, but the network has no internet connection, I can still cat/get content from one to the other, right now, no?
<victorbjelkholm> Second question, if the network has a internet connection, it still prefers to use the network without routing through the external network, right?
<achin> on the first question: yes you can. you might have to manually connect them, though
<cryptix> victorbjelkholm: i wouldnt bet on 2) beeing true but just by latency the local node should be able to provide much faster
<zignig> !pin QmUorpZb2yTLoyHWvo9amm5V1wUN34b2zqWAJYRMx3oJxt
<pinbot> now pinning /ipfs/QmUorpZb2yTLoyHWvo9amm5V1wUN34b2zqWAJYRMx3oJxt
<victorbjelkholm> hm, I see. Thanks achin and cryptix for the answers
* zignig thanks nasa
<zignig> !botsnack
<pinbot> om nom nom
<cryptix> lol
<cryptix> zignig: what is that, elevation/sealevel?
<zignig> elevation
<zignig> I'm working on a openstreetmap <-> ipfs proxy.
<zignig> sort of working.
<cryptix> yey
arpu has quit [Quit: Ex-Chat]
fingertoe has joined #ipfs
ipfsfan has joined #ipfs
<ipfsfan> Hi, I was playing with the python API client, and couldn't seem to be able to publish to /ipns/hash-of-pubkey/arbritary-string, which I have seen mentioned. Is this implemented yet?
<ipfsfan> Publishing to /ipns/hash-of-pubkey worked fine
<demize> You publish a directory with a file called 'arbitrary-string'
<ipfsfan> Thank you, so whenever I publish, I need to republish the whole directory?
<ipfsfan> And does the arbritary-string file just contain the IFPS hash I want to point to?
<stoopkid> the arbitrary-string file is an arbitrary file called arbitrary-string
edcryptickiller has joined #ipfs
edcryptickiller has left #ipfs [#ipfs]
<ipfsfan> Thanks, it's clicked now
fingertoe has quit [Ping timeout: 246 seconds]
<stoopkid> and afaik yea you have to republish the whole directory, and if this is not the case then i'd like to know, heh
<victorbjelkholm> if the file changes, the hash of that file changes. And if a hash of a file changes, you'll need to change the links of the directory, which leads to the directory having a new hash. So yeah...
<victorbjelkholm> but still, the other files doesn't change so it's not that big of a deal
<ipfsfan> If you had a lot of files, wouldn't it take a long time to republish the directory?
<ipfsfan> Or would the idea be to use multiple keypairs, each for a certain purpose?
sonatagreen has joined #ipfs
<ipfsfan> Does the API allow the client to supply some hashes, then make a "virtual" directory, skipping the need to read all of the data (and the need for a real on disk directory)?
martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
<cryptix> ipfsfan: yup - look into 'ipfs object get' put and patch
<cryptix> im not sure how feature complete python-ipfs-api is, though
<mungojelly> oh i didn't know there was a python api at all, that's nice
<mungojelly> any python programs yet that do anything interesting?
ipfsfan has quit [Ping timeout: 246 seconds]
<victorbjelkholm> ipfsfan, publishing is just updating the ipns to point to the new hash. Adding the hash happens locally
<victorbjelkholm> it's not until someone requests it, that it's actually being sent over network
<stoopkid> you have to recompute the whole directory structure and re-add to ipfs though, right?
ipfsfan has joined #ipfs
<cryptix> stoopkid: you can add individual files and create the structures programatically
<ipfsfan> I was under the impression that IPNS records are published around the network?
Encrypt has joined #ipfs
goregrind has quit [Ping timeout: 256 seconds]
OutBackDingo has quit [Quit: Leaving]
fingertoe has joined #ipfs
<cryptix> 13:38 < victorbjelkholm> ipfsfan, publishing is just updating the ipns to point to the new hash. Adding the hash happens locally
<cryptix> 13:38 < victorbjelkholm> it's not until someone requests it, that it's actually being sent over network
<cryptix> ipfsfan: i think you missed that due to reconnect
<victorbjelkholm> oh, damn, me hiding connects/reconnects might not have been that great of an idea after all...
<victorbjelkholm> thanks cryptix
<ipfsfan> I saw it, throught botbot.me :)
<cryptix> victorbjelkholm: irssi maybe? there are smartfilters
<ipfsfan> But I was asking for confirmation, I seem to remember reading in the paper that IPNS records are published to other nodes automatically
<cryptix> also for other clients presumably
<victorbjelkholm> cryptix, nah, textual... since #ipfs is so low traffic anyways, doesn't hurt to see connects and such
<victorbjelkholm> ipfsfan, yeah, but ipns is just a pointer to your content
goregrind has joined #ipfs
<victorbjelkholm> you can relate it to how git handles commits and branches. A branch is just a pointer to a commit
<victorbjelkholm> a bit simplified but yeah
<ipfsfan> ok, so ipns is spread around, but ipfs objects are not, until they are explicitly requested?
<cryptix> +1 the picture fits
<cryptix> yup
<cryptix> also note that the ipfs peer has to be online and reachable to verify the record
<ipfsfan> Forever, or just for a while after publishing?
<dignifiedquire> whyrusleeping: okay so from the looks of it the change you said you made does not work as advertised
<dignifiedquire> whyrusleeping: I’m getting “File argument 'path' is required” as an error when I send it non nested
OutBackDingo has joined #ipfs
<dignifiedquire> whyrusleeping: this is the wireshark dump of the request I’m sending: https://gist.github.com/Dignifiedquire/bc72721f5b96c7017188
<dignifiedquire> as far as I understand that should work, but it does not
Encrypt has quit [Remote host closed the connection]
Encrypt has joined #ipfs
[0__0] has quit [Remote host closed the connection]
ipfsfan has quit [Quit: Page closed]
[0__0] has joined #ipfs
<dignifiedquire> .tell whyrusleeping https://github.com/ipfs/go-ipfs/issues/1915
anticore has joined #ipfs
voxelot has joined #ipfs
sseagull has joined #ipfs
martinkl_ has joined #ipfs
mildred has quit [Ping timeout: 256 seconds]
mildred has joined #ipfs
martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
zz_r04r is now known as r04r
martinkl_ has joined #ipfs
mquandalle has joined #ipfs
martinkl_ has quit [Client Quit]
Guest73396 has quit [Ping timeout: 250 seconds]
bedeho has joined #ipfs
nessence has joined #ipfs
domanic has joined #ipfs
itradarcz8787 has joined #ipfs
martinkl_ has joined #ipfs
mildred has quit [Ping timeout: 272 seconds]
Tv` has joined #ipfs
ed__ has quit [Quit: ZNC - http://znc.in]
HoboPrimate has joined #ipfs
<whyrusleeping> dignifiedquire: hrmmm
cow_2001 has joined #ipfs
bedeho has quit [Ping timeout: 240 seconds]
captain_morgan has joined #ipfs
water_resistant has joined #ipfs
chriscool has quit [Ping timeout: 250 seconds]
nessence_ has joined #ipfs
<HoboPrimate> enhancement request: make ipfs commands work with Tab completion
<HoboPrimate> so 'ips da' + TAB = 'ipfs daemon', etc.
goregrind has quit [Ping timeout: 265 seconds]
NeoTeo has quit [Quit: ZZZzzz…]
nessence has quit [Remote host closed the connection]
nessence_ has quit [Remote host closed the connection]
<whyrusleeping> HoboPrimate: check in the misc directory
<whyrusleeping> there are some bash completion scripts
ygrek_ has joined #ipfs
NeoTeo has joined #ipfs
<HoboPrimate> where is that?
ianopolous has quit [Read error: Connection reset by peer]
ianopolous has joined #ipfs
<HoboPrimate> cool thanks
martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
martinkl_ has joined #ipfs
<whyrusleeping> ^ probably wont be worse than watching freshmen install ubuntu
<cow_2001> hey, what kind of websites only appear on ipfs right now?
martinkl_ has quit [Client Quit]
<victorbjelkholm> cow_2001, a lot of ipfs.io is hosted on ipfs
<victorbjelkholm> neocities has a tight ipfs integration running
<victorbjelkholm> there is a blog running as well: https://ipfs.io/ipns/blog.giodamelio.com
<cow_2001> woo
<victorbjelkholm> But these using ipfs for storage, not only appearing on ipfs but on the web in general, using ipfs
<victorbjelkholm> then my own projects are using ipfs as well, ipfsbin.xyz
gamemanj has joined #ipfs
s_kunk has quit [Ping timeout: 268 seconds]
cryptotec has joined #ipfs
simonv3 has joined #ipfs
<cow_2001> victorbjelkholm: is it possible to get http://gateway.ipfs.io/ipns/ipfsbin.xyz ?
<cow_2001> i've just tried
<cow_2001> before that i've tried on my daemon
amade has joined #ipfs
<cow_2001> oh
<cow_2001> it needs a server
domanic has quit [Ping timeout: 246 seconds]
mercora has quit [Remote host closed the connection]
dignifiedquire- has joined #ipfs
<dignifiedquire-> whyrusleeping, any ideas?
* whyrusleeping spacing out
<whyrusleeping> dignifiedquire-: gonna have to wait until jbenet is around
<whyrusleeping> either that, or i can dig in to it more later today
dignifiedquire- has quit [Remote host closed the connection]
wscott has quit [Quit: ZNC - http://znc.in]
wscott has joined #ipfs
chriscool has joined #ipfs
water_resistant has quit [Quit: Leaving]
<ipfsbot> [go-ipfs] tilgovi closed pull request #1910: Leave overflow logic to go-msgio (master...cleanup-secio-reader-overflow) http://git.io/vWbHa
shyamsk has quit [Ping timeout: 272 seconds]
martinkl_ has joined #ipfs
amstocker has joined #ipfs
water_resistant has joined #ipfs
<jbenet> dignifiedquire whyrusleeping: is this multipart stuff? what's up?
domanic has joined #ipfs
<whyrusleeping> jbenet: yeah, didnt you change the multipart stuff so that order and nesting stuff didnt matter?
<jbenet> whyrusleeping yes, we did. that's what the dag editor does on adding
Pharyngeal has quit [Quit: ZNC - http://znc.in]
<jbenet> dignifiedquire: btw i dont recall multipart having the sizes of the files--- is that what the number before the text is?
Pharyngeal has joined #ipfs
fingertoe has quit [Quit: Page closed]
bedeho has joined #ipfs
martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
<whyrusleeping> no, thats the chunked stuff
<ipfsbot> [go-ipfs] tilgovi reopened pull request #1910: Leave overflow logic to go-msgio (master...cleanup-secio-reader-overflow) http://git.io/vWbHa
<jbenet> dont recall chunking. maybe that's what's not working.
anticore has quit [Ping timeout: 244 seconds]
gamemanj has quit [Remote host closed the connection]
tilgovi has joined #ipfs
atrapado has joined #ipfs
<whyrusleeping> no, thats been there. you just dont ever notice it because the http lib does it seamlessly
<jbenet> whyrusleeping: i dont see chunking anywhere in http://www.w3.org/Protocols/rfc1341/7_2_Multipart.html
<jbenet> why wouldn't it be a header, too?
<whyrusleeping> its not part of multipart
<whyrusleeping> any more than syn and synack are part of http
pjz has joined #ipfs
<pjz> is there an ipfs pinning service?
Nukien has joined #ipfs
<jbenet> whyrusleeping: what are you talking about then? where are these chunking numbers coming from?
<jbenet> whyrusleeping: multipart _is_ part of http.
nessence has joined #ipfs
<jbenet> whyrusleeping: are you saying HTTP is chunking the entire request?
<jbenet> whyrusleeping: ok looks like this is it: https://en.wikipedia.org/wiki/Chunked_transfer_encoding
<whyrusleeping> yeah
<whyrusleeping> that happens for everything on our api so that the trailers can work correctly
<whyrusleeping> ;w
Matoro has quit [Ping timeout: 260 seconds]
<whyrusleeping> hmm... vim this is not
<dignifiedquire> same error happens if I disable chunking
<dignifiedquire> so I do not think that’s related
sonatagreen has quit [Remote host closed the connection]
<ipfsbot> [go-ipfs] whyrusleeping force-pushed fix/log-hang from f21fe5c to 3727f48: http://git.io/vlJ3U
<ipfsbot> go-ipfs/fix/log-hang 3727f48 Jeromy: fix log hanging issue, and implement close-notify for commands...
<dignifiedquire> jbenet: if we can get that request to work, it would be very awesome, as that would mean we can drop all the vinyl stuff from the js-api :)
<whyrusleeping> dignifiedquire: i can take a hack at it in like, an hour
<whyrusleeping> maybe soon
<whyrusleeping> er
<Nukien> noob question - is the gateway (gateway.ipfs.io) simply another node in the mesh or is it special somehow ?
<dignifiedquire> that’d be awesome :)
itradarcz8787 has quit [Read error: Connection reset by peer]
<Nukien> Considering ipfs not connected to ipfs.io
<dignifiedquire> I’m gonna push my code to github so if you want you can reproduce it
itradarcz8787 has joined #ipfs
<dignifiedquire> whyrusleeping: code is in this PR if you want to test it yourself, just need to run “npm test”
<whyrusleeping> Nukien: its kinda special in that the 'ipfs.io' domain gets round robined to a set of machines
<whyrusleeping> but its really just like, ten different ipfs nodes
<Nukien> OK so a private mesh would just be a bunch of nodes with perhaps a similar RR for some dns name. Those nodes would go in the bootstrap list ?
<jbenet> dignifiedquire: the vinyl stuff is just a representation of a file-- we'll still need something like it (a js object to represent a file before reading it all in). the choice of vinyl is because vinyl-fs has a large ecosystem of tooling around them, but happy to switch it if there's something better.
<jbenet> dignifiedquire: (i dont understand what we gain from dropping it-- the overly complicated vinyl thing -- https://github.com/jbenet/node-vinyl-multipart-stream/blob/master/mp2v_tree.js -- is not used at all. we use https://github.com/jbenet/node-vinyl-multipart-stream/blob/master/mp2v_flat.js i believe.
<jbenet> also, this makes sure to (a) read all the local filesystem first to make a list of all the files upfront, instead of later, as things may change. (b) has proper streaming, with backpressure.
<whyrusleeping> jbenet: can you take a look at: https://github.com/ipfs/go-ipfs/pull/1914
<whyrusleeping> Nukien: yeah, for the most part. I think theres an issue somewhere about private ipfs swarms...
<whyrusleeping> let me see if i can find it
<Nukien> reading now thanks
Matoro has joined #ipfs
<ipfsbot> [go-ipfs] mildred opened pull request #1916: Remove usage of merkledag.Link.Node pointer outside of merkledag (dev0.4.0...ipld) http://git.io/vlmP0
<ipfsbot> [go-ipfs] mildred closed pull request #1902: Remove usage of merkledag.Link.Node pointer outside of merkledag (master...ipld) http://git.io/vWKrM
tilgovi has quit [Ping timeout: 240 seconds]
<victorbjelkholm> ok, as a golang beginner, I want to use ipfs from go. Should i use the unoffical bindings from go-ipfs-api or just integrate with go-ipfs directly?
fingertoe has joined #ipfs
<whyrusleeping> victorbjelkholm: what do you want to build?
<victorbjelkholm> whyrusleeping, gonna experiment with rewritting openipfs to golang instead of using node
<whyrusleeping> oh, you can probably just use the api
<whyrusleeping> using go-ipfs directly is generally for when you want to network protocol things, or manipulate internals a little more closely
<victorbjelkholm> yeah, wanna do whatever is cleanest. Is there anything similar to js-ipfs-api for go? So I don't have write my own wrapper
<whyrusleeping> like, if you wanted to write a p2p chat app, you would probably use go-ipfs directly
<whyrusleeping> go-ipfs-api
anticore has joined #ipfs
<whyrusleeping> github.com/ipfs/go-ipfs-api
<cow_2001> ipfs daemon won't shut down for a loooong while after ctrl-c
wscott has left #ipfs ["Leaving"]
<cow_2001> should i send a second signal?
<whyrusleeping> cow_2001: yeah, if it doesnt close in a second or two, give it the second ctrl-c
<whyrusleeping> all the important stuff is done almost immediately
<victorbjelkholm> whyrusleeping, cool, that's the unofficial bindings I were talking about. Thanks :)
<whyrusleeping> it hangs on weird network stuff that makes it really hard to diagnose or reproduce
<whyrusleeping> victorbjelkholm: wooo!
<cow_2001> ding :\
<jbenet> the go-ipfs-api is really bad compared to js-ipfs-api
<victorbjelkholm> jbenet, hah, tell me about it :p Missing like a lot! Probably better off going with js-ipfs-api after all
<victorbjelkholm> my only gripe is that it would be easier to distribute a binary than the whole project + node runtime to be able to run the client
<jbenet> victorbjelkholm: yeah sorry, very incomplete, almost no docs, few tests. we'll get on it as there's time. if others want to contribute to go land, this would be a good place.
<jbenet> victorbjelkholm: indeed. deploying go is really nice
<victorbjelkholm> jbenet, no need to be sorry! rather see an awesome go-ipfs project than awesome go-ipfs-api project, if you know what I mean
<jbenet> :) indeed.
amstocker has quit [Ping timeout: 265 seconds]
<dignifiedquire> jbenet: I will write something up tomorrow why I think that it would be very benefical for js-api to pull out the vinyl deps, too tired to explain anything in a useful way today
<whyrusleeping> victorbjelkholm: yeah, the go-ipfs-api has mostly been 'i need this call, lets throw it in there'
<dignifiedquire> jbenet: (the main points are code simplification, and better compat between node and browser version)
voxelot has quit [Ping timeout: 260 seconds]
dignifiedquire has quit [Quit: dignifiedquire]
sonatagreen has joined #ipfs
cryptotec has quit [Remote host closed the connection]
SDr_ has joined #ipfs
<chriscool> Hi everyone!
<victorbjelkholm> hello chriscool !
SDr has quit [Ping timeout: 250 seconds]
f[x] has joined #ipfs
<whyrusleeping> chriscool: hey!
ygrek_ has quit [Ping timeout: 246 seconds]
<chriscool> Tomorrow I will fly to the San Francisco bay area
<chriscool> I will be there until November 15
sonatagreen has quit [Ping timeout: 250 seconds]
fingertoe has quit [Ping timeout: 246 seconds]
simonv3 has quit [Quit: Connection closed for inactivity]
NeoTeo has quit [Quit: ZZZzzz…]
voxelot has joined #ipfs
voxelot has quit [Changing host]
voxelot has joined #ipfs
captain_morgan has quit [Remote host closed the connection]
fingertoe has joined #ipfs
chriscool has quit [Ping timeout: 265 seconds]
Encrypt has quit [Quit: Eating time!]
captain_morgan has joined #ipfs
cryptotec has joined #ipfs
fingertoe has quit [Ping timeout: 246 seconds]
<jbenet> chriscool yep will do
<whyrusleeping> ion: thats painfully accurate
atrapado has quit [Quit: Leaving]
nessence has quit [Remote host closed the connection]
f[x] has quit [Ping timeout: 264 seconds]
cryptotec has quit [Ping timeout: 272 seconds]
cemerick has joined #ipfs
itradarcz8787 has quit [Quit: AndroIRC - Android IRC Client ( http://www.androirc.com )]
bedeho has quit [Ping timeout: 264 seconds]
<ipfsbot> [go-ipfs] mildred created wip/NodeTree (+3 new commits): http://git.io/vlYF1
<ipfsbot> go-ipfs/wip/NodeTree 3747d7a Mildred Ki'Lya: path/resolver.go: Handle timeout here...
<ipfsbot> go-ipfs/wip/NodeTree 8dbd2c9 Mildred Ki'Lya: NodeTree
<ipfsbot> go-ipfs/wip/NodeTree 77735b5 Mildred Ki'Lya: Remove usage of merkledag.Link.Node pointer outside of merkledag...
<ipfsbot> [go-ipfs] jbenet pushed 15 new commits to master: http://git.io/vlYFp
<ipfsbot> go-ipfs/master 97a80e9 Christian Couder: Add first version of sharness_test_coverage_helper.sh...
<ipfsbot> go-ipfs/master 741c0e5 Christian Couder: coverage_helper: remove more cruft...
<ipfsbot> go-ipfs/master 5abf294 Christian Couder: coverage_helper: remove .ipfs...
<ipfsbot> [go-ipfs] jbenet pushed 1 new commit to master: http://git.io/vlYbw
<ipfsbot> go-ipfs/master 933b973 Juan Benet: Merge pull request #1912 from ipfs/t0220-bitswap-stat...
<jbenet> i love tests. thanks chriscool
<ipfsbot> [go-ipfs] jbenet pushed 1 new commit to master: http://git.io/vlYbK
<ipfsbot> go-ipfs/master a93dbf6 Juan Benet: Merge pull request #1913 from ipfs/test-ipfs-config...
cryptotec has joined #ipfs
<jbenet> whyrusleeping: shipped 0.3.9 yet? is it waiting on the logging stuff? (reminder that right now people cannot use the webui nor much of the api).
NeoTeo has joined #ipfs
<vanila> windows binaries for IPFS?
simonv3 has joined #ipfs
bedeho has joined #ipfs
<whyrusleeping> jbenet: that logging stuff makes the webui usable
<whyrusleeping> sooo, yeah
<whyrusleeping> waiting on that
<whyrusleeping> and people can use the api just fine, not sure what youre talking about there
<jbenet> whyrusleeping: what is that waiting on next?
<jbenet> whyrusleeping: no, they cannot, diasdavid has been pushing for 0.3.9 for this reason alone. remember that merging 0.3.8 broke it without ensuring it was upgraded before releasing https://github.com/ipfs/js-ipfs-api/issues/87
<jbenet> i believe the logging bug in the webui has been happening for a while. obviously we want it to be fixed, but remember that on monday we promised to ship out 0.3.9 on tuesday and it's now friday. we should really ship out 0.3.9 asap. let's not delay another day for it. if it makes it in, great, else it can go later. every day that passes is a day with a
<jbenet> broken interface and users who try things from our docs that do not work.
rendar has quit [Ping timeout: 250 seconds]
<jbenet> cc diasdavid o/ -- is the js-ipfs-api update ready to ship once 0.3.9 lands? (or is there one that needs to be there? dont recall)
<whyrusleeping> jbenet: the daemon will actually hang and nothing will work AT ALL if someone uses the webui
<jbenet> whyrusleeping: _ANY_ of the webui?
<whyrusleeping> like, yeah. we wanted to get this out on tuesday, nothing got reviewed until wednesday.
f[x] has joined #ipfs
<whyrusleeping> and yeah, the webui opens up the 'logs' endpoint when you open it, as far as i can tell
<whyrusleeping> and it doing that screws up the loggers locks
nessence has joined #ipfs
<whyrusleeping> which deadlocks any goroutine trying to call 'eventlog'
Encrypt has joined #ipfs
rendar has joined #ipfs
Matoro has quit [Ping timeout: 260 seconds]
<jbenet> whyrusleeping i reviewed + merged the only PR that we said during the call was mandatory the same day -- https://github.com/ipfs/go-ipfs/pull/1885
<jbenet> whyrusleeping we then added other PRs because we deemed important, which is of course fine, but not good to do for a whole week. right now i'm not certain 0.3.9 will ship today.
<jbenet> whyrusleeping "the webui opens up the 'logs' endpoint when you open it" sounds like a) bug in the webui that shouldn't happen, and b) not something new, becuase the webui and logs have been this way for a long time and it worked just fine.
<jbenet> whyrusleeping: it may be that the deadlock was introduced recently, because it really was not a problem 3+ weeks ago.
<jbenet> (probably wasted resources but did not deadlock)
dinamic has quit [Quit: Leaving]
<revolve> jbenet how's it going?
<jbenet> revolve: hello
<revolve> what do you think of this? https://github.com/LukeB42/Uroko/tree/dht
<revolve> it's an idea i've had since about 2011 that's just starting to work
Matoro has joined #ipfs
<whyrusleeping> jbenet: we can disable the webui, or disable the logs endpoint and ship 0.3.9 if you want
<jbenet> revolve: i can't run a py program atm. have screenshots?
elima_ has joined #ipfs
<jbenet> whyrusleeping: it's up to you-- whatever you think will get done today. if you cant make the log changes today, then let's disable the log endpoint in the webui until it's fixed. it would be useful to figure out _why_ it started to become a problem now so we don't run into this sort of problems in the future (i.e. this is was introduced and means a lack of
<jbenet> testing. if we need to run phantomjs tests against go-ipfs release candidates maybe we should)
amade has quit [Quit: leaving]
<revolve> jbenet: yeah http://i.imgur.com/uNbNR71.png
<revolve> haven't got any of the current frontend at the moment though
<jbenet> what do you mean by collaboration then?
<revolve> in that screenshot a copy is being told an instance bound to :8080 has news.ycombinator.com/ and then retrieves it from that instance and serves it
<jbenet> how do you ensure integrity of the original content?
e-lima has quit [Ping timeout: 250 seconds]
<revolve> everything's rendered in an iframe that can be toggled as contenteditable. on edits it sends whatever part of the dom is changing over the wire where other connected users reintegrate the changes
<whyrusleeping> jbenet: i think phantomjs tests would be good. I beleive the issue was a result of the timeout on the http handlers context being removed
<whyrusleeping> before, things would deadlock, but eventually resume when that context for the api request timed out
<whyrusleeping> but that was removed at some point (i think?)
<revolve> for the p2p side it's just checking the hash of the content is what it was intially reported to be
<jbenet> revolve: if i can edit a site, then it's no longer the original site. which is fine for collab documents, if you can track version history with authentication, but not so good for websites per se
<revolve> on the client side there's just a proof of concept; there's no UX to speak of there at the moment.
<jbenet> revolve: looks cool :) -- consider doing this over ipfs-- we have all the p2p stuff worked out and you get the primitives you need for integrity (everything is merkle tree based, signed auth of mutable content, etc)
<revolve> yeah and there's the awesome issue if spinning a bazillion AWS instances to report your edit of google.com/ as a good copy
<revolve> excellent
<revolve> well I'm glad you dig it. I think I'm going to continue having a go at solving these problems in terms of this project for the time being though
<jbenet> whyrusleeping: "the timeout on the http handlers context being removed" have a link to a diff?
<whyrusleeping> around here is when we had a global timeout based on a passed in value: https://github.com/ipfs/go-ipfs/commit/f9f3c6a5277811ed9d0117535461156c54980419
<whyrusleeping> that commit is where the timeout creation is moving out of the handler, but it should have still been setting a timeout at that point
<whyrusleeping> but it makes sense not to have a timeout
<whyrusleeping> because some commands will take a while
<jbenet> yeah agreed -- why isn't tcp closing the conn and the conn closing bubbling up? because we don't write anymore?
<whyrusleeping> i'm not really sure
<jbenet> that's actually pretty bad, btw, that golang conns cant signal you when they're done
<jbenet> you have to write or read to them to figure it out.
<whyrusleeping> its something to do with the browser i think
<whyrusleeping> because i couldnt really repro with curl or the CLI
<jbenet> net + ctx really should be a thing.
<whyrusleeping> agreed
<whyrusleeping> i would kill for a netctx package
<jbenet> whyrusleeping: prob disable the logs page in the webui would be fine.
<jbenet> i'll do that.
[0__0] has quit [Remote host closed the connection]
[0__0] has joined #ipfs
<whyrusleeping> jbenet: okay, are we also going to ship a new webui then?
<jbenet> whyrusleeping: well pick-- it's that or fixing the logs today
<whyrusleeping> well, if you want to do a preliminary CR on the log code, that could help that go more quickly
<whyrusleeping> otherwise, yeah. lets ship a new webui
<jbenet> whyrusleeping: what do you mean? i already CRed it
cryptotec has quit [Remote host closed the connection]
<whyrusleeping> no, i've been working on the new changes for the past hour or two
<whyrusleeping> havent pushed because its not done yet
Matoro has quit [Ping timeout: 260 seconds]
<victorbjelkholm> got ipfsbin to run offline now, anyone willing to give it a go? use http://ipfsbin.xyz?local to go directly into local mode
<jbenet> whyrusleeping: ah i see. sure as you want. I'll get the webui change ready just in case anyway.
ZioFork has quit [Ping timeout: 246 seconds]
<whyrusleeping> sounds good
<jbenet> whyrusleeping btw the logs dont trigger unless you actually visit the page (or they dont in my chrome and they shouldnt based on the code)
<victorbjelkholm> if someone could pin QmTvGbPiS1PaE7AAn4gEszNiYMgdrbMXwLkGnLKYSADs8K as it's 1.0.0 of ipfsbin, that would be thankful :)
<whyrusleeping> jbenet: https://github.com/ipfs/go-log/pull/1/files <- now with 100% less 'import time'
<whyrusleeping> jbenet: yeah, i noticed a few minutes ago i couldnt repro without going to the logs tab
<jbenet> !pin /ipfs/QmTvGbPiS1PaE7AAn4gEszNiYMgdrbMXwLkGnLKYSADs8K
<pinbot> now pinning /ipfs/QmTvGbPiS1PaE7AAn4gEszNiYMgdrbMXwLkGnLKYSADs8K
ZioFork has joined #ipfs
<ion> I’m happy to see Go doesn’t suffer from the Billion Dollar Mistake and have nil inhabit every type. Now to figure out how to tell it I do want this one struct field to be nullable.
<whyrusleeping> ion 'a *Type'
<ion> whyrusleeping: Thanks. I tried that but then i wasn’t able to get a pointer to a constant with &namesys.ImmutableTTL.
* whyrusleeping thinks ion is doing something really weird
<ion> whyrusleeping: I’d like to check the HTTP response for a Cache-Control/max-age header in https://github.com/ipfs/go-ipfs/blob/master/core/corehttp/gateway_test.go#L120 and I don’t expect the error responses to have one. So I was thinking of having an optional ttl field in the struct.
<victorbjelkholm> jbenet, thanks!
pfraze has joined #ipfs
Guest73396 has joined #ipfs
<jbenet> whyrusleeping: this impl looks very complicated to me. what are the actual constraints here?
Guest73396 has quit [Client Quit]
<whyrusleeping> this is what you asked for in the CR earlier
<whyrusleeping> you wanted each writer to be buffered, and to not block the daemon
<whyrusleeping> and to not rely on a timeout
<codehero> victorbjelkholm: nice. a "use local daemon" button
<victorbjelkholm> codehero, yeah! With that feature + the application now working offline, it will work without internet access, as long as you're connected to the same network :)
<victorbjelkholm> Now if we just had a chat to send the actual link the same way
<codehero> however it has a few... problems
<codehero> like when i press save, nothing happens
Guest73396 has joined #ipfs
<codehero> and i can't deselect the "use local daemon" button
<victorbjelkholm> codehero, I could be more clear in the UI but you can only save once the text is change. And the url does change! You'll need to have the daemon running and CORS activated
<victorbjelkholm> you should be able to deselect the "use local daemon" though. Which browser+os ?
<victorbjelkholm> you get any errors in the console?
<codehero> archlinux + firefox nightly
<codehero> well
<codehero> "n is null"
<codehero> doesn't sound good
<codehero> there are so many errors
<victorbjelkholm> huh, bleeding edge huh. You're loading it from ipfsbin.xyz ?
<victorbjelkholm> Ah, that is not working because the daemon API doesn't work via HTTPS and ipfs.io doesn't work via http
<codehero> oh
<victorbjelkholm> browser doesn't allow request from https -> http, so if you want to use local daemon, you would have to run it locally or via ipfsbin.xyz
akkad has quit [Excess Flood]
<codehero> okay. it works with ipfsbin.xyz
akkad has joined #ipfs
<codehero> but it doesn't work locally
<whyrusleeping> jbenet: pushed updates
<victorbjelkholm> codehero, errors?
<victorbjelkholm> probably you didn't set API_ORIGIN="*", no?
Guest73396 has quit [Ping timeout: 250 seconds]
ipfs_intern has joined #ipfs
<codehero> victorbjelkholm: same errors "n is null"
<codehero> and Network error
<codehero> oh
<codehero> there we go
<codehero> Cross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at http://localhost:5001/api/v0/add?stream-channels=true. (Reason: CORS header 'Access-Control-Allow-Origin' missing).
<victorbjelkholm> so when you run daemon, you are not running it like this: "API_ORIGIN="*" ipfs daemon"
<victorbjelkholm> which is needed to allow CORS
<codehero> what's CORS?
<victorbjelkholm> security for domains not being able to make requests to other domains. But since you want to use localhost:5001 from ipfsbin.xyz, you have to allow it
jamie_k has joined #ipfs
voxelot has quit []
<codehero> ah
nessence has quit [Remote host closed the connection]
ipfs_intern has quit [Quit: Page closed]
nessence has joined #ipfs
sonatagreen has joined #ipfs
tilgovi has joined #ipfs
<cryptix> codehero victorbjelkholm: API_ORIGIN is deprecated, see ipfs daemon --help
simonv3 has quit [Quit: Connection closed for inactivity]
<victorbjelkholm> cryptix, oh, good to know. Way easier than writing those three commands though. Also, editing the config manually would also be easier than that
<cryptix> well.. just fyi :)
cryptotec has joined #ipfs
Matoro has joined #ipfs
<codehero> cryptix: ah. thx
<jbenet> whyrusleeping: seems roughly correct to me, but im not sure. lost in channels. seems overly complex. i suspect something cleaner exists with moving the concurrency to the children, and using locks in the parent. maybe ask cryptix for his opinion
<jbenet> prob will want to test the hell out of it before landing it