<qbg>
Has the public 0.3.x gateway been slow for the past several hours? I'm trying to figure out if my issue is with the gateway, or the gateway fetching content from me
<lgierth>
qbg: you mean v03x.ipfs.io?
<qbg>
yes
<lgierth>
are you behind NAT?
tmg has quit [Quit: leaving]
pfraze has quit [Remote host closed the connection]
tmg has joined #ipfs
<lgierth>
sometimes it helps to restart your local node in that case
<qbg>
shouldn't be. A few weeks ago it worked fine when I was running IPFS on windows; I'm running it on linux currently
<lgierth>
because then it readvertises itself to your router
<qbg>
I'll try bouncing the daemon
<lgierth>
you can check if you see your public ip address in `ipfs id`
<qbg>
I see my public ip under addresses
<slothbag>
what are my options for throttling ipfs? how hard would it be to get a hardcoded kludge to force ipfs to limit upload at a certain rate?
metaf5 has joined #ipfs
<lgierth>
qbg: is it ipv6 or ipv4?
<lgierth>
ipv6 connectivity of the public gateway isn't great yet
<qbg>
v4
<lgierth>
mh ok
<lgierth>
slothbag: the usual throttling mechanisms -- iptables and nm, and i think there was another one
<lgierth>
we want ipfs to be able to throttle itself in the future
<slothbag>
I need it to work on windows too
<slothbag>
I'm thinking something like a Thread.Sleep(1000) in the upload processing.. super kludge :)
<slothbag>
I need it desperately :)
<lgierth>
do it on your router maybe
<slothbag>
is adding a user configurable upload limit a hard thing to implement?
kseistrup has quit [Quit: Lost terminal]
<lgierth>
not sure -- i'm sure the only real blocker is priorities
<qbg>
lgierth: The gateway finally fetched my content a few minutes after I restarted the daemon; that's much slower than what it took when I was running IPFS on windows
<lgierth>
hrm :/
Hoboprimate has joined #ipfs
Hoboprimate is now known as HoboPrimate_
<qbg>
so it looks like it is getting severely throttled
<slothbag>
qbg: not via a user configurable option its not :P
<qbg>
(my content was only a few kb)
<lgierth>
it's very likely not the transfer but the discovery
<lgierth>
eeh content-routing, not discovery
hugooconnor has quit [Ping timeout: 268 seconds]
<qbg>
I last used it on windows a few weeks ago; I guess it's possible the network sufficiently changed since then?
cryptix_ has quit [Ping timeout: 244 seconds]
jaboja has quit [Ping timeout: 240 seconds]
pfraze has joined #ipfs
jaboja has joined #ipfs
inconshreveable has quit [Read error: Connection reset by peer]
inconshreveable has joined #ipfs
kseistrup has quit [Quit: Lost terminal]
_rht has joined #ipfs
kseistrup has joined #ipfs
Senji has joined #ipfs
palkeo has quit [Quit: Konversation terminated!]
tilgovi has quit [Ping timeout: 244 seconds]
computerfreak has quit [Remote host closed the connection]
tilgovi has joined #ipfs
Senji has quit [Ping timeout: 260 seconds]
moimikey has joined #ipfs
HoboPrimate_ has quit [Quit: HoboPrimate_]
dignifiedquire has quit [Quit: Connection closed for inactivity]
r04r is now known as zz_r04r
pfraze has quit [Remote host closed the connection]
pfraze has joined #ipfs
apiarian has quit [Ping timeout: 276 seconds]
sahib has quit [Ping timeout: 240 seconds]
ppham has quit [Remote host closed the connection]
pfraze has quit [Remote host closed the connection]
moimikey has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
pfraze has joined #ipfs
herzmeisterderw has quit [Quit: Leaving]
herzmeister has joined #ipfs
herzmeister has quit [Remote host closed the connection]
herzmeister has joined #ipfs
TheWhisper has quit [Read error: Connection reset by peer]
moimikey has joined #ipfs
TheWhisper has joined #ipfs
ppham has joined #ipfs
moimikey has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
ppham has quit [Remote host closed the connection]
ppham has joined #ipfs
moimikey has joined #ipfs
Not_ has joined #ipfs
Senji has joined #ipfs
pfraze has quit [Remote host closed the connection]
pfraze has joined #ipfs
pfraze has quit [Remote host closed the connection]
kvda has joined #ipfs
Senji has quit [Ping timeout: 244 seconds]
lex_ has joined #ipfs
lex_ has left #ipfs [#ipfs]
tilgovi has quit [Ping timeout: 240 seconds]
tmg has quit [Ping timeout: 252 seconds]
inconshreveable has quit [Read error: No route to host]
tilgovi has joined #ipfs
CounterPillow has quit [Quit: No Ping reply in 180 seconds.]
codehero has quit [Ping timeout: 260 seconds]
bauruine has quit [Ping timeout: 260 seconds]
tilgovi has quit [Ping timeout: 244 seconds]
bauruine has joined #ipfs
codehero has joined #ipfs
jaboja has quit [Ping timeout: 250 seconds]
codehero has quit [Ping timeout: 260 seconds]
bauruine has quit [Ping timeout: 260 seconds]
CounterPillow has joined #ipfs
IlanGodik has joined #ipfs
bauruine has joined #ipfs
_rht has quit [Quit: Connection closed for inactivity]
bauruine has quit [Ping timeout: 260 seconds]
ppham has quit [Remote host closed the connection]
codehero has joined #ipfs
ppham has joined #ipfs
pfraze has joined #ipfs
_rht has joined #ipfs
codehero has quit [Ping timeout: 260 seconds]
bauruine has joined #ipfs
bauruine has quit [Ping timeout: 260 seconds]
codehero has joined #ipfs
chriscool has joined #ipfs
bauruine has joined #ipfs
Tv` has quit [Quit: Connection closed for inactivity]
Not_ has quit [Quit: Leaving]
Animazing has quit [Ping timeout: 250 seconds]
Animazing has joined #ipfs
Not_ has joined #ipfs
edrex has quit [Read error: Connection reset by peer]
fredthomsen has quit [Ping timeout: 248 seconds]
Animazing has quit [Ping timeout: 244 seconds]
moimikey has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
tmg has joined #ipfs
Animazing has joined #ipfs
edrex has joined #ipfs
fredthomsen has joined #ipfs
Magik6k has quit [Ping timeout: 276 seconds]
inconshreveable has joined #ipfs
pfraze has quit [Remote host closed the connection]
Kubuxu has quit [Ping timeout: 244 seconds]
Animazing has quit [Ping timeout: 276 seconds]
qbg has quit [Ping timeout: 240 seconds]
Tristitia has joined #ipfs
Senji has joined #ipfs
Animazing has joined #ipfs
fredthomsen has quit [Ping timeout: 268 seconds]
ppham has quit [Remote host closed the connection]
pfraze has joined #ipfs
Animazing has quit [Ping timeout: 246 seconds]
Kubuxu has joined #ipfs
Magik6k has joined #ipfs
Animazing has joined #ipfs
<lgierth>
whyrusleeping: gc on saturn worked now
<whyrusleeping>
lgierth: yeah... its disk contention
<whyrusleeping>
we're being really stupid about something
<whyrusleeping>
not sure what yet
<whyrusleeping>
going to debug tomorrow/tuesday
* whyrusleeping
needs sleep now
inconshreveable has quit [Ping timeout: 240 seconds]
Animazing has quit [Ping timeout: 244 seconds]
fredthomsen has joined #ipfs
tilgovi has joined #ipfs
tilgovi has quit [Ping timeout: 240 seconds]
Guanin_ has left #ipfs [#ipfs]
Guanin_ has joined #ipfs
inconshreveable has joined #ipfs
Arakela007 has joined #ipfs
afternuun is now known as nuun
ppham has joined #ipfs
reit has quit [Ping timeout: 244 seconds]
IlanGodik has quit [Quit: Connection closed for inactivity]
ppham has quit [Remote host closed the connection]
cryptix has joined #ipfs
reit has joined #ipfs
ppham has joined #ipfs
herzmeister has quit [Ping timeout: 268 seconds]
gunn_ has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
herzmeister has joined #ipfs
Animazing has joined #ipfs
dignifiedquire has joined #ipfs
Not_ has quit [Quit: Leaving]
Animazing has quit [Ping timeout: 276 seconds]
Animazing has joined #ipfs
TomasBond_ has quit [Ping timeout: 244 seconds]
pfraze has quit [Remote host closed the connection]
disgusting_wall has quit [Quit: Connection closed for inactivity]
cryptix has quit [Ping timeout: 244 seconds]
hashcore has joined #ipfs
inconshreveable has quit [Remote host closed the connection]
hashcore has quit [Ping timeout: 240 seconds]
cryptix has joined #ipfs
mildred has joined #ipfs
nicolagreco_ has joined #ipfs
pfraze has joined #ipfs
ylp1 has joined #ipfs
Arakela0_ has joined #ipfs
<nicolagreco_>
I think I worked out how to do loops in ipld
<nicolagreco_>
(instead of hashes one could have relative links)
Arakela007 has quit [Ping timeout: 268 seconds]
Qwertie has joined #ipfs
<haad>
good morning everyone
<haad>
nicolagreco_: did my CRDT stuff help you in any way?
<nicolagreco_>
haad: not but I am sure it will
<nicolagreco_>
it must have lost your links
ulrichard has joined #ipfs
<haad>
nicolagreco_: ok. let me know if there's anything I can do to help. and I'd be curious to hear your feedback and use cases (ie. what would you need to have). I also put the append-log (which is the "transport" of the CRDT data in orbit-db) to its own module: https://github.com/haadcode/ipfs-log, maybe that helps you too.
<nicolagreco_>
perfect thanks haad
zz_r04r is now known as r04r
Arakela0_ has quit [Remote host closed the connection]
ulrichard has quit [Max SendQ exceeded]
nicolagreco_ has quit [Quit: nicolagreco_]
_rht has quit [Quit: Connection closed for inactivity]
pfraze has quit [Remote host closed the connection]
pfraze has joined #ipfs
tactiic has joined #ipfs
nicolagreco_ has joined #ipfs
nicolagreco_ has quit [Client Quit]
Arakela007 has joined #ipfs
Arakela007 has quit [Remote host closed the connection]
Arakela007 has joined #ipfs
nicolagreco_ has joined #ipfs
nicolagreco_ has quit [Client Quit]
MahaDev has quit [Quit: Leaving]
nicolagreco_ has joined #ipfs
nicolagreco_ has quit [Read error: Connection reset by peer]
nicolagreco_ has joined #ipfs
<dignifiedquire>
good morning everyone
nicolagreco_ has quit [Client Quit]
nicolagreco_ has joined #ipfs
Senji has quit [Ping timeout: 248 seconds]
nicolagreco_ has quit [Client Quit]
jinxz has joined #ipfs
Senji has joined #ipfs
Arakela007 has quit [Remote host closed the connection]
nicolagreco_ has joined #ipfs
Arakela007 has joined #ipfs
kseistrup has quit [Quit: Lost terminal]
MahaDev has joined #ipfs
<M-3630>
Morning
ygrek has quit [Ping timeout: 264 seconds]
ecloud_wfh has quit [Ping timeout: 244 seconds]
nicolagreco_ has quit [Quit: nicolagreco_]
ecloud has joined #ipfs
nicolagreco_ has joined #ipfs
nicolagreco_ has quit [Client Quit]
nicolagreco_ has joined #ipfs
tactiic has quit [Ping timeout: 260 seconds]
rendar has joined #ipfs
kseistrup has joined #ipfs
ulrichard has joined #ipfs
ppham has quit [Remote host closed the connection]
ulrichard has quit [Ping timeout: 244 seconds]
pfraze has quit [Remote host closed the connection]
zorglub27 has joined #ipfs
kenmazsyma has joined #ipfs
kenmazsyma has left #ipfs [#ipfs]
kenmazsyma has joined #ipfs
pfraze has joined #ipfs
kenmazsyma_ has joined #ipfs
<kenmazsyma_>
test
nicolagreco_ has quit [Quit: nicolagreco_]
kenmazsyma__ has joined #ipfs
kenmazsyma has quit [Ping timeout: 252 seconds]
kenmazsyma__ is now known as kenmazsyma
kenmazsyma is now known as kenmazsyma__
ulrichard has joined #ipfs
kenmazsyma has joined #ipfs
kenmazsyma has quit [Client Quit]
kenmazsyma_ has quit [Ping timeout: 252 seconds]
kenmazsyma has joined #ipfs
ulrichard has quit [Ping timeout: 260 seconds]
sahib has joined #ipfs
ppham has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
compleatang has quit [Quit: Leaving.]
pfraze has quit [Remote host closed the connection]
ulrichard has joined #ipfs
ulrichard has quit [Ping timeout: 276 seconds]
esotericnonsens_ has joined #ipfs
esotericnonsense has quit [Ping timeout: 268 seconds]
cryptix has quit [Remote host closed the connection]
shyamsk has joined #ipfs
Arakela007 has quit [Remote host closed the connection]
nicolagreco_ has joined #ipfs
ulrichard has joined #ipfs
nicolagreco_ has quit [Client Quit]
shyamsk has left #ipfs [#ipfs]
pfraze has joined #ipfs
ulrichard has quit [Ping timeout: 244 seconds]
Encrypt has joined #ipfs
nicolagreco_ has joined #ipfs
reit has quit [Ping timeout: 240 seconds]
zorglub27 has quit [Quit: zorglub27]
mec-is has joined #ipfs
mec-is has quit [Client Quit]
pfraze has quit [Remote host closed the connection]
kerozene has quit [Ping timeout: 248 seconds]
ralphtheninja has joined #ipfs
moimikey has joined #ipfs
zorglub27 has joined #ipfs
ppham has quit [Remote host closed the connection]
micxjo has joined #ipfs
ppham has joined #ipfs
kerozene has joined #ipfs
hellertime has joined #ipfs
pfraze has joined #ipfs
nicolagreco_ has quit [Quit: nicolagreco_]
nicolagreco_ has joined #ipfs
kenmazsy_ has joined #ipfs
kenmazsyma has quit [Ping timeout: 252 seconds]
moimikey has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
<ipfsbot>
[js-ipfs-api] dignifiedquire pushed 1 new commit to dignified: https://git.io/vaDmj
<ipfsbot>
js-ipfs-api/dignified 33d641e dignifiedquire: refactor: Move testing and linting into digified.js
ugjka has joined #ipfs
<ipfsbot>
[js-ipfs-api] dignifiedquire pushed 2 new commits to dignified: https://git.io/vaD3L
<ipfsbot>
js-ipfs-api/dignified 8c9f806 dignifiedquire: Run lint on travis
moimikey has joined #ipfs
sahib has quit [Ping timeout: 246 seconds]
jinxz has quit [Ping timeout: 276 seconds]
Teeed has quit [Ping timeout: 244 seconds]
kenmazsy_ has quit []
Oatmeal has quit [Ping timeout: 260 seconds]
<ipfsbot>
[js-ipfs] diasdavid force-pushed feature/files-add from d3f90aa to a04dc44: https://git.io/vaD8l
<ipfsbot>
js-ipfs/feature/files-add a04dc44 David Dias: jsipfs files add feature
computerfreak has joined #ipfs
cemerick has joined #ipfs
nicolagreco_ has quit [Quit: nicolagreco_]
<ipfsbot>
[js-ipfs] diasdavid force-pushed feature/files-add from a04dc44 to 4faa8a9: https://git.io/vaD8l
<ipfsbot>
js-ipfs/feature/files-add 4faa8a9 David Dias: jsipfs files add feature
<ipfsbot>
[js-ipfs] diasdavid force-pushed feature/files-add from 4faa8a9 to 8583416: https://git.io/vaD8l
<ipfsbot>
js-ipfs/feature/files-add 8583416 David Dias: jsipfs files add feature
esotericnonsens_ is now known as esotericnonsense
Oatmeal has joined #ipfs
<ipfsbot>
[js-ipfs] diasdavid force-pushed feature/files-add from 8583416 to 3dad1d1: https://git.io/vaD8l
<ipfsbot>
js-ipfs/feature/files-add 3dad1d1 David Dias: jsipfs files add feature
mathemancer has quit [Ping timeout: 264 seconds]
mathemancer has joined #ipfs
Encrypt has quit [Quit: Quitte]
<ipfsbot>
[js-ipfs] diasdavid deleted feature/files-add at 3dad1d1: https://git.io/vaDuZ
ppham has quit [Remote host closed the connection]
<ipfsbot>
[js-ipfs] diasdavid pushed 1 new commit to master: https://git.io/vaDzQ
<ipfsbot>
js-ipfs/master 93a02c2 David Dias: update roadmap on readme
<ipfsbot>
[js-ipfs] diasdavid pushed 1 new commit to master: https://git.io/vaDgv
<ipfsbot>
js-ipfs/master 3da7796 David Dias: Release v0.4.2.
moimikey has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
null_radix has quit [Excess Flood]
null_radix has joined #ipfs
slothbag has quit [Quit: Leaving.]
Proto_type has joined #ipfs
mildred has quit [Ping timeout: 250 seconds]
Protocol_under has quit [Ping timeout: 276 seconds]
pfraze has quit [Remote host closed the connection]
<ipfsbot>
[js-ipfs] diasdavid force-pushed feature/swarm from 293020d to 0317bda: https://git.io/v24B2
<ipfsbot>
js-ipfs/feature/swarm 0317bda David Dias: not fail on browser tests. separate browser and node.js swarm tests
kenmazsyma has joined #ipfs
<ipfsbot>
[js-ipfs] diasdavid force-pushed feature/swarm from 0317bda to 9eb8b3b: https://git.io/v24B2
<ipfsbot>
js-ipfs/feature/swarm 9eb8b3b David Dias: jsipfs swarm...
kenmazsyma has quit [Client Quit]
<ipfsbot>
[js-ipfs] diasdavid pushed 1 new commit to feature/swarm: https://git.io/vaDof
<ipfsbot>
js-ipfs/feature/swarm 639670a David Dias: travis, move!
mildred has joined #ipfs
kvda has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
<ipfsbot>
[js-ipfs] diasdavid force-pushed feature/swarm from 639670a to 2c5b277: https://git.io/v24B2
<ipfsbot>
js-ipfs/feature/swarm 2c5b277 David Dias: jsipfs swarm; libp2p start and stop; not fail on browser tests. separate browser and node.js swarm tests
hellertime has quit [Ping timeout: 268 seconds]
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
voxelot has quit [Ping timeout: 246 seconds]
<ipfsbot>
[js-ipfs] diasdavid force-pushed feature/swarm from 2c5b277 to c18e21f: https://git.io/v24B2
<ipfsbot>
js-ipfs/feature/swarm c18e21f David Dias: jsipfs swarm; libp2p start and stop; not fail on browser tests. separate browser and node.js swarm tests
<daviddias>
merkle links of a file need to be sorted by their chuck offsets
<daviddias>
the fact that it doesn't require sorting anymore, might just mean that we don't have a test to really check that
<voxelot>
okay, let me put some thought into that
M-Guest4198 has joined #ipfs
M-Guest4198 has left #ipfs ["User left"]
<daviddias>
"Live streaming uses Apple’s HTTP Live Streaming (HLS) technolog"
<voxelot>
daviddias: it looks like our link sort exhibits the default behavior of stable
<voxelot>
but i put it back just incase
<daviddias>
I see
<daviddias>
sounds good
<daviddias>
squash and meeerge :D
jaboja has quit [Ping timeout: 248 seconds]
ylp1 has quit [Quit: Leaving.]
<voxelot>
testing to see if that arrow function is okay on dag-node, think it is and i just went on an arrow killing spree during the testing madness
zorglub27 has quit [Quit: zorglub27]
<voxelot>
nope, needs to be non es6 function
ppham has quit [Remote host closed the connection]
<ipfsbot>
[ipfs] RichardLitt opened pull request #168: Feature/add status board (master...feature/add-status-board) https://git.io/vay3U
ppham has joined #ipfs
tilgovi has joined #ipfs
<noffle>
morning
<whyrusleeping>
noffle: mornin!
jaboja has joined #ipfs
<whyrusleeping>
anyone who has been curious about trying soylent should definitely try their 'soylent 2.0' stuff
<whyrusleeping>
its really good
<lgierth>
do they ship to .eu by now? :)
ppham has quit [Remote host closed the connection]
<voxelot>
daviddias: one commit is keeping me from squashing, whats the best way to remove one specific commit in a rebase?
<lgierth>
voxelot: just remove the line from the commit list
<ipfsbot>
[go-ipfs] lgierth created docker-gc (+1 new commit): https://git.io/vayZB
<ipfsbot>
go-ipfs/docker-gc 50127b2 Lars Gierth: docker: start daemon with --enable-gc...
<lgierth>
the "pick <hash>" line
<voxelot>
yeah tried that, still error
<lgierth>
error?
<lgierth>
or conflict?
<voxelot>
Could not apply 5a15a6fc97832b92037462c9543a81e2d6b8a900... update
<voxelot>
is all after trying to just remove the offending commits line from rebase
<voxelot>
and squash everything else at the same time
<ipfsbot>
[go-ipfs] lgierth opened pull request #2490: docker: start daemon with --enable-gc (master...docker-gc) https://git.io/vayZ5
<voxelot>
should i force it? i know the commit has nothing valuable in it
<lgierth>
that probably means the following commits depend on the one that you removed
<lgierth>
no there's a conflict
<lgierth>
check git status to see where it is
jinxz1 has joined #ipfs
jinxz has quit [Ping timeout: 252 seconds]
TomasBond has joined #ipfs
calavera has joined #ipfs
computerfreak has quit [Remote host closed the connection]
Iiterature has joined #ipfs
tilgovi has quit [Ping timeout: 260 seconds]
<Iiterature>
hello
<richardlitt>
Hello
<brimstone>
hello
<Iiterature>
denis from mine/mediachain here :)
<richardlitt>
Whoa, hey Denis
<richardlitt>
I just added your links to our press page (well, PRed it)
<richardlitt>
We're about to have our weekly sprint checkup, so if the channel floods, sorry
parkan has joined #ipfs
parkan has quit [Client Quit]
<Iiterature>
richardlitt: hi. thanks for adding the link! we wanted to listen in to the sprint today :)
parkan has joined #ipfs
calavera has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
<richardlitt>
whyrusleeping daviddias lgierth dignifiedquire noffle voxelot jbenet good morning.
bigs has joined #ipfs
* daviddias
ahoy!
<lgierth>
o/
<bigs>
allo allo
<richardlitt>
literature: awesome! This is a long sprint day (as opposed to every other monday)
rougeth has joined #ipfs
<richardlitt>
so... checkins now, then videos later
<richardlitt>
haad: sup
<dignifiedquire>
yo yo yo
<haad>
richardlitt: yo
<richardlitt>
You all ready?
<haad>
almost
calavera has joined #ipfs
<dignifiedquire>
as ready as I'm ever going to be
<voxelot>
morning
<haad>
ready
<Iiterature>
richardlitt: awesome, mostly wanted to get acquainted w/ the sprint format and maybe give a status update of where we're at during the Apps hangout, if appropriate
* bigs
ready
<richardlitt>
literature: yeah! That sounds great. Apps hangout should be in an hour and a half
reit has quit [Ping timeout: 260 seconds]
<lgierth>
i'm gonna go to the bathroom real quick
<dignifiedquire>
lgierth: as long as you don't take a bath ;)
<richardlitt>
Newcomers: this is the IPFS sprint sync. We post some stuff here. For more, see github.com/ipfs/pm
<richardlitt>
It'll last around an hour (hopefully less), and will involve us copying text from https://github.com/ipfs/pm/issues/97 and then talking about it
sahib has joined #ipfs
<richardlitt>
Videos come afterwards. This is all on IRC, and we apologise for flodding.
<daviddias>
This last sprint I had the chance to give a lot of time to js-ipfs and libp2p, with the goal of getting js-ipfs working on the browser and exchanging blocks with other js-ipfs nodes and go-ipfs nodes. I've made a lot of contributions and updates to: js-libp2p-ipfs, js-ipfs-data-importing, js-multiaddr, js-mafmt, js-peer-id, js-ipfs-repo, js-libp2p-swarm,
<daviddias>
js-libp2p-tcp, js-libp2p-utp, js-libp2p-websockets, js-libp2p-multiplex. These changes bubbled up to js-ipfs.
<daviddias>
I've found some (really nasty) rabbit wholes when using spdy over websockets which I will explain more at the libp2p hangout, which made a good hit at my time planning.
<daviddias>
Also had a good time hacking with @xicombd, good discussions and remote hacking/debugging with @nginnever, good conversations with @dignifiedquire and @nginnever which resulted in the understanding of the new IPFS JavaScript Project guidelines, and last but not the least, the IPLD hangout with a bunch of IPLD enthusiasts.
<daviddias>
I've also got the chance to write and submit the paper for ICWE and organize and host the first Research & Development meetup in Lisbon.
<richardlitt>
EOF
<richardlitt>
What's ICWE?
<daviddias>
EOF
<dignifiedquire>
where is that paper? :)
<richardlitt>
Do you have a link for the R&D meetup?
calavera has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
<daviddias>
any questions? :)
<dignifiedquire>
all good from my side
<richardlitt>
daviddias: I don't think it was.
<dignifiedquire>
<richardlitt>
Any tangible benefits for all that work?
<richardlitt>
Like, what is most significant, do you think?
<whyrusleeping>
is github down?
<daviddias>
oh noes, github is down :(
<richardlitt>
whyrusleeping: yes
<noffle>
yeah
<whyrusleeping>
god dammit
<noffle>
if only we had a mirror on ipfs :(
calavera has joined #ipfs
<noffle>
post your full sprint notes on ipfs for us!
<dignifiedquire>
that's apples doing, so we go watch their event :D
<daviddias>
well, I would, but actually my notes are on that issue
<dignifiedquire>
I have it still open
<whyrusleeping>
lol
<dignifiedquire>
let me download it and put it on ipfs :D
<richardlitt>
Me too
<richardlitt>
Debating best way
<richardlitt>
Downloading hits the server again
<richardlitt>
I don't know if you can download cached versions?
<lgierth>
i have it open
<lgierth>
should i just paste the whole thing?
<daviddias>
richardlitt there is 'hot stuff in the oven', but other than the updates I've already give you for last week, I just have a ton of debugging hours, CR + M things
ygrek has quit [Ping timeout: 276 seconds]
<daviddias>
I would recommend everyone to check out jsipfs though
<lgierth>
oh yeah that works too thanks richardlitt
<richardlitt>
Ok
<richardlitt>
I got up to Noffles
<lgierth>
QmPtvPvqvcvh28gAdohvfP4PRriiCMb1YbgRBt9xAuwn8b is the whole sprint issue html
<richardlitt>
Hope that no one posted after him?
codehero has quit [Ping timeout: 260 seconds]
<whyrusleeping>
eh, i hadnt posted yet
<lgierth>
yep mine is up to noffle too
<richardlitt>
Oh, nice, lgierth
<richardlitt>
How did you do that?
<lgierth>
ctrl+s
<lgierth>
:)
<lgierth>
save as webpage, html only
<richardlitt>
tht didn't work for me. Weird
bigs has quit [Ping timeout: 260 seconds]
<richardlitt>
Uhm
<richardlitt>
Ok
<richardlitt>
Well
<richardlitt>
Let's just move on.
<richardlitt>
My turn.
calavera has quit [Ping timeout: 244 seconds]
<lgierth>
ah heh it's fetching all the assets from assets-cdn.github.com which seems to be up
<lgierth>
cloudflare or akamai or so
<lgierth>
yep go
<richardlitt>
daviddias: thanks
<jbenet>
good stuff re js-ipfs and all the underlying modules daviddias
<daviddias>
thank you :)
<lgierth>
(github backup)
<lgierth>
*back up
<richardlitt>
I feel my work has been a bit slow the past two weeks. I worked on the http-api-spec, some more, redoing ipfs object and opening a lot of PRs on go-ipfs. I also went through go-ipfs and added defaults to all of the options, which I think will help out in the future, and am getting a bit more comfortable with reading go. I've sent out two weeklies, and spent
<richardlitt>
a lot of time helping organize the IPFS trip to New York for next week, and I spent a good amount of time going through ipfs/faq and ipfs/support checking up on all of the old issues which weren't updated. I did not get to help review the 0.4.0 ship, nor did I do significant work on js-ipfs block, which I am unhappy about. Hoping to get more work done this
<richardlitt>
coming sprint, especially with the in-person coding time ahead.
calavera has joined #ipfs
bigs has joined #ipfs
<richardlitt>
Phew.
<richardlitt>
EOF
<richardlitt>
(We should do something about not hosting on GitHub, I guess? Or Mirror it?)
<voxelot>
i feel so lost :(
<richardlitt>
voxelot: what's up?
<voxelot>
nvm git is back :p
<dignifiedquire>
richardlitt: nice work on the weeklies!
<noffle>
the weeklies are wonderful <3
<lgierth>
yay weeklies
<whyrusleeping>
^ +1
<richardlitt>
:P
<lgierth>
sorry i was a bit slow with the latest one, i know i'm a bottleneck and will fix it this week, finally
<richardlitt>
whyrusleeping: I assigned you a lot of small go-ipfs issues yesterday
<richardlitt>
Because they are blocking me on ipfs/http-api-spec#67 and #68
<whyrusleeping>
richardlitt: yeap, i'll get to them after shipping 0.4.0
gristle has joined #ipfs
<richardlitt>
whyrusleeping: cool. thanks.
<richardlitt>
Any other questions for the right honorable richardlitt
<whyrusleeping>
richardlitt: what
<whyrusleeping>
is your favorite color?
<richardlitt>
Blue
<richardlitt>
No, yellow!
<dignifiedquire>
mothers maiden name?
<richardlitt>
AAaaaaaaarrghhhh
* whyrusleeping
kicks richardlitt
<dignifiedquire>
first pet?
<lgierth>
:)
<richardlitt>
Kitchen.
<richardlitt>
No, I'm not joking.
<richardlitt>
Alison Kitchen. It's awkward.
<dignifiedquire>
alright lets move on :)
<richardlitt>
dignifiedquire: you're up next
codehero has joined #ipfs
<richardlitt>
========= dignifiedquire=========
<dignifiedquire>
## @dignifiedquire Update
<dignifiedquire>
My main focus this time was the webui. I have made some good progress on the files explorer interface, refactoring some code and writing more tests. I'm now working on cleaning up the UI, preparing mockups and plans for the final phase of the implementation.
<dignifiedquire>
After a some discussions and issues with our JavaScript setups I've started to create [dignified.js](https://github.com/dignifiedquire/dignified.js) which is going to be the module to help us have a unified testing, linting and building solution in all our JavaScript projects. This is an ongoing effort that I'm working on together with @diasdavid and
<dignifiedquire>
@nginnever.
<dignifiedquire>
Also in addition after the great IPLD hangout last week I've started implementing parts of it in [rust](https://github.com/dignifiedquire/rust-ipld) with the goal of finding a typesafe and general interface on how to define mappings between raw IPLD and higher level abstractions like unix-fs.
<dignifiedquire>
EOF
<daviddias>
lots of good stff with dignified, dignifiedquire :D
<lgierth>
moooore klickibunti!!
<daviddias>
<lgierth>
<3 :)
<dignifiedquire>
:)
<voxelot>
dignfiedquire: ty so much for getting me out of testing hell :)
<voxelot>
and i learned a lot
<dignifiedquire>
voxelot: well I sent you in there, so I'd better get you out ;)
<voxelot>
well, there is still the webui haha
<dignifiedquire>
yeah still waiting on your tests :P
<voxelot>
going to need a bit more time on react for that, a lot of things i've never used in the project
<Blame>
hi, I'm trying to figure out if any kademlia implementation in the wild actually does the: all n-nearest replicas periodically re-publish themselves.
<dignifiedquire>
oh I forgot to mention
<Blame>
the kademlia paper talks about it, but I cannot find any implementation that actually does it.
<dignifiedquire>
I drove to the customs office, and paid them to finally get my IPFS hoodie!
<dignifiedquire>
tune in later to see it live
<whyrusleeping>
Blame: we don't do that, i'm pretty sure
<richardlitt>
hahahah WHAT
<jbenet>
Blame: im not sure if mainline does it. i would imagine the original kademlia implementation does.
<richardlitt>
How did you get your hoodie first
* noffle
also waiting on hoodie
* haad
also needs a hoodie
* whyrusleeping
needs a new one that doesnt have a hole in the elbow
<lgierth>
i think i lost my hoodie
* daviddias
's hoodie also has a hole now :(
<richardlitt>
ok
<lgierth>
it's one of my favorite ones -- so nice fabric and cut
<richardlitt>
Thanks dignifiedquire
<daviddias>
lgierth: shame on you :P
<Blame>
I've actually done the analysis of how robust that makes the record storage. It is in insanely effective. I'm actually writing a paper right now that is a "we should actually bother doing this" statement.
<noffle>
dignifiedquire: cool stuff with rust-ipld :)
<dignifiedquire>
richardlitt: not yet I'm afraid, this is all still very much wip
<richardlitt>
dignifiedquire: Cool. Thanks!
<richardlitt>
lgierth: Ready?
<whyrusleeping>
Blame: i'd love to see your research
<noffle>
Blame: ditto
<Blame>
essentially, you have to knock out all K replicas in a single maintenance period to lose the record
<lgierth>
ok incoming
<lgierth>
Blame: let's discuss kademlia after sprint sync when there's less noise
<Blame>
np
<lgierth>
The past few weeks Berlin has been a huge drag on me, tons of org stuff to take care of, and was generally very easily distracted. My task list is testament to that :) I made a bit of progress on everything, but wasn't able to focus on any particular task very well. I feel quite energized though now that I'm in NYC, so I am to finish all of last sprint's stuff, and maybe a thing or two more.
<lgierth>
My focus is still: v03x/v04x multireq stability, metrics, pages deployment, and cleaning up the mess which is the infrastructure repo.
<lgierth>
We still seem to have subtle issues with v03x/v04x and multireq, which I haven't quite tracked down yet. One of them is timeouts, for which we have UptimeBuddy and Pingdom alerts in place now, as well as nginx-level metrics which are about to be ready. The other is performance/latency. I've taken the saturn host out of ipfs.io DNS for now, it's in DigitalOcean's Singapore datacenter which doesn't have the best
<jbenet>
Blame: can you address it with a threat model at least like s/kademlia's or wanau's? (where a large % (>80%, >90%) of the network is controlled by the adversary)
<richardlitt>
lgierth: sounds good to me. :)
<jbenet>
s/kad has nice graphs showing what happens to resolution as the "adversary controlled" percentage goes to 1.
<haad>
lgierth: why in Singapore?
<jbenet>
would be great to see that with this particular bit you're highlighting
<lgierth>
haad: the 8 gateways hosts are spread pretty much across all of digitalocean's locations
<haad>
lgierth: got it
<haad>
that's cool
<lgierth>
it's not the best of ideas as long as we don't have geo-aware DNS
<voxelot>
This past week I continued to work on web testing the data-importing and merkle-dag modules. This kicked off conversation about new ways to handle our tests so that in the future things will be more consistent. Having this taken care of is allowing me to make much more progress now on jsipfs core. Thanks to @dignifiedquire and @diasdavid
<voxelot>
I also began working on an export function for data-importing on a branch that will unMarshal our hashes and begin to pipe together streams of dag linked data for our files get and files cat commands.
<voxelot>
Worked a bit with the webui but still need to study that type of react structure more to feel useful.
<noffle>
Lots of reading and a few PRs this week some libp2p modules -- mostly usability improvements. Big accomplishment of the week is that the majority of the ipfs initialization logic for js-ipfs is now written.
<noffle>
Several of us (haad, jbenet, whyrusleeping, nginnever) discussed approaches to pubsub in more detail, and I did some further background reading on previous discussions across ipfs/* repos.
<noffle>
Last weekend I wrote a prototype wiki powered by IPFS. A few pieces are written so far, but the overall goal is to gain a better understanding of the functionality still missing in IPFS to make apps like these relatively simple.
<richardlitt>
Do we have a "PubSub: ELI5" document anywhere?
<richardlitt>
Shouldn't we have a PubSub planning repo at some point?
<noffle>
richardlitt: not yet (either)
<noffle>
we're discussing in ipfs/notes currently
<richardlitt>
Yeah, but there are like six pubsub issues in there
<voxelot>
Yeah the pubsub issues are a bit spread around, and seems to be a lot of interest there
<noffle>
richardlitt: once we settle on an impl people like we can draw up better docs on how it works
<noffle>
but right now there are so many ideas for approaches
<noffle>
I'm going to work a bit on consolidation
<voxelot>
noffle +1
<haad>
noffle: sounds good
<richardlitt>
noffle: can we put your wiki in the weekly?
<noffle>
richardlitt: it's not really ready for consumption -- I need a bit more time to make it usable. I'd like to include a demo when it goes into the weekly
<richardlitt>
kk
<richardlitt>
Any other questions for le noffle?
<whyrusleeping>
nein
<lgierth>
what's a noffle
<richardlitt>
========= haad ==========?
<noffle>
sacrebleu!
<haad>
richardlitt: ready
<lgierth>
bah uoi
<haad>
incoming
<jbenet>
noffle:
<haad>
### @haadcode Sprint End Summary
<haad>
I integrated orbit-db into Orbit and it's working nicely. Sending messages feels instantenous and responsive. With that, the "backend" code of Orbit is now a lot smaller and manageable. I was able to refactor the UI code of Orbit a little along the way but it still needs quite a bit of work. Orbit now has a nice new app icon for the desktop app and as a favicon in the browser. I refactored orbit-db a little by taking out the append-only log functionality into it
<haad>
highlights: ipfs-log and the ap/favicon for Orbit :)
<haad>
*app
<haad>
HAL 9000 as daviddias realized
<noffle>
nice work separating out ipfs-log :)
<lgierth>
:)
<daviddias>
eheh :)
<dignifiedquire>
haad: when can we replace irc with it?
<richardlitt>
Sounds pretty great, haad
<haad>
dignifiedquire: next week
<dignifiedquire>
great!
<richardlitt>
dignifiedquire: irc has some really awesome side benefits
<richardlitt>
aka developer standard. easy entry.
<dignifiedquire>
richardlitt: we can alway build a bridge
<haad>
dignifiedquire: seriously though, not in a while. but, if you have motivation to help, the sonner we can do that ;)
<dignifiedquire>
haad: it's not the motivation I'm missing...
<dignifiedquire>
it's more a thing with only 24h in a day
<whyrusleeping>
wait, theres only 24?
<haad>
noffle: yes but I wanted to use *ipfs* (ie. js-ipfs-api) whereas hyperlog comes with its own ecosystem
<whyrusleeping>
^ +1
<haad>
dignifiedquire: I figured :)
<noffle>
haad: hyperlog just provides streams, so you can hook it up to any system
<richardlitt>
whyrusleeping: for you it just feels longer. Side effect of coffee.
<noffle>
you could easily put a replicate-to-ipfs piece on top
<whyrusleeping>
richardlitt: maaaaybbeeee
disgusting_wall has joined #ipfs
inconshreveable has joined #ipfs
<noffle>
haad: hyperlog isn't married to any particular "way" of doing things -- it's just a merkle dag that you can get streams from to replicate them elsewhere
<haad>
noffle: sorry, but I really don't understand the hyperlog code :( you need to explain it to me like to a kid next week in person
<noffle>
haad: hehe. sure :)
<noffle>
haad: it took me some time to wrap my head around too. though the api is pretty understandable
<haad>
noffle: I want to implement streams api to ipfs-log, it's on my todo list
<haad>
ok, I'm taking too much time here, let's move on richardlitt
<richardlitt>
sounds good. whyrusleeping ?
<jbenet>
haad:
zootella has joined #ipfs
<jbenet>
haad: also -- "Sending messages feels instantenous and responsive" nice!
<haad>
jbenet: not written up. I can point to the relative parts in the code if you're interested to understand it.
<whyrusleeping>
Spent most of my effort on getting 0.4.0 ready to ship. This involved lots of testing work, and also a lot of organizational stuff.
<whyrusleeping>
I also did a large amount of performance analysis and have good ideas for improving perf overall moving forward.
<whyrusleeping>
My list of weekly accomplishments feels short, many of these are rather large items.
<whyrusleeping>
- fixed double transfer encoding header
<whyrusleeping>
- worked on 0.4.0 blog post
<whyrusleeping>
- please review!!! ipfs/blog#37
<whyrusleeping>
- debugged gx on windows issues
<whyrusleeping>
- wrote a large stress test for migrations
<whyrusleeping>
- ~200k files, 2000 pins
<whyrusleeping>
- worked on benchmarks for various ipfs operations (expect perf changes in the near future)
<whyrusleeping>
- minor bugfix in go-datastore (prevents a panic)
<whyrusleeping>
=== EOF ===
go1111111 has joined #ipfs
zootella has quit [Client Quit]
<jbenet>
whyrusleeping: <3 stress test.
<richardlitt>
Sounds good to me, whyrusleeping
<whyrusleeping>
jbenet: its pretty hefty
<haad>
whyrusleeping: awesome re. perf. any details where the biggest bottlenecks are atm?
<jbenet>
yeah the backup locations is a very neat trick-- do you know where this originated? i've seen it a few times, but cannot place it. (makes eclipse harder)
ygrek has joined #ipfs
<jbenet>
btw, curious about your thoughts on "reputation / social net" approaches to dhts (like wanau).
<jbenet>
they achieve very strong guarantees.
mildred has joined #ipfs
<Blame>
social networks/networks of trust degenerate into centralized systems (that a human effect not a technical one). It is simply less effort to centralize trust.
jaboja64 has joined #ipfs
<jbenet>
yeah but rep systems with bonds and material punishment for defection exhibit "benevolent centralization", where the centralization pressure is only there when the actors behave correctly, and quickly dissipate if they defect. ((( this is related to stake in economic consensus )))
<Blame>
so, as long as you only need the network of trust to be decentralized for a few years before scrapping it and starting over in a non-game-able way it works great!
calavera has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
jaboja has quit [Ping timeout: 264 seconds]
calavera has joined #ipfs
<jbenet>
no, economic consensus is meant as a long term solution. it maps directly to how things happen in the real world and is quite promising. expect interesting papers on this in the next couple of years.
ppham has quit [Remote host closed the connection]
ppham has joined #ipfs
bielewelt has quit [Quit: Leaving.]
M-bastinik has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
tilgovi has joined #ipfs
ppham has quit [Remote host closed the connection]
Magik6k has quit [Ping timeout: 276 seconds]
Kubuxu has quit [Ping timeout: 264 seconds]
<Iiterature>
is the apps on ipfs hangout public? if so, how does one join :)
Kubuxu has joined #ipfs
<noffle>
Iiterature: richardlitt will announce when it's up
<Iiterature>
noffle: thanks
<richardlitt>
======================= IPFS Hangouts: Apps on IPFS =======================
<lgierth>
surrounding a node in keyspace so that it doesn't haven any honest peers?
ppham has quit [Remote host closed the connection]
zootella has quit [Ping timeout: 248 seconds]
<Iiterature>
hey guys which hangout do you think its best for us to participate in to give a brief update on Mediachain?
<noffle>
Iiterature: apps on ipfs sounds right
<haad>
Iiterature: the apps hangout would be good. we're interested to hear what's happening on your side.
<lgierth>
Iiterature: hehe yeah the one right now :)
<lgierth>
jump on
<Iiterature>
ok rounding up the troops
<richardlitt>
literature: yuo o this?
<richardlitt>
*you on this?
<noffle>
Iiterature: make sure you join the hangout, not the stream
ashark has quit [Ping timeout: 268 seconds]
<jbenet>
literature: the apps hangout is close to done -- we discussed adding a hangout at the end
* yuvipanda
is just stalking the yt stream :)
warner has quit [Quit: ERC (IRC client for Emacs 24.5.1)]
<Iiterature>
jbenet: waiting for parkan/bigs to come back from lunch, shouldbe a few mins
<richardlitt>
lgierth: do you have a lot to talk about in infra, today?
<richardlitt>
Currently having a Mediachain hangout
<lgierth>
richardlitt: not really
zootella has joined #ipfs
<richardlitt>
lgierth: Cool. Apps on IPFS is going to run over
<lgierth>
yeah go for it
zootella has quit [Client Quit]
<richardlitt>
Let's just cancel // see if we still wanto have it in 20 mins
zootella has joined #ipfs
<lgierth>
++
<M-mubot>
in many respects ipfs is just like an hd has 0 points, none of which are for efficiency, gotta minimize the lookups (analogously to reads), so same solutions should be applicable.
calavera has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
<richardlitt>
Currently talking about IPFS wiki by noffle on the hangout
<haad>
lgierth: it's a "distributed" big data processing framework
<haad>
lgierth: puts the computation where the data (vs. hadoop which downloads the data to where the computation is)
<jbenet>
whyrusleeping is the progress bar fixed?
<jbenet>
"+Inf" is insanely annoying
<whyrusleeping>
jbenet: i could 'fix' that, but then adds would take +/- forever
<jbenet>
it's frustrating, and just makes ipfs look very bad.
<jbenet>
"hey look, negative time!"
<haad>
daviddias: Spark uses Akka for communication between the nodes, which is a great library and very perfomant, but I was thinking maybe, in the future, libp2p and ipfs could do the same
<haad>
or something even better :)
<jbenet>
i'm sure that having a sane progress bar is not mutually exclusive with having high perf.
inconshreveable has quit [Ping timeout: 240 seconds]
<whyrusleeping>
although i think i could at least remove the '-inf' thing and put some sort of 'we don't know how big this is yet'
<whyrusleeping>
the issue is that its computing the total size of the directory in the background, while doing the add
<whyrusleeping>
and the larger that is, the longer that takes
<whyrusleeping>
previously, we computed the whole size before the add, which made things really slow
<lgierth>
so we're stating everything while reading and chunking and hashing?
<whyrusleeping>
now, doing it concurrently, the issue is that the disk contention from the add reading all those files chokes the separate routine thats computing the total size recursively
zootella has quit [Quit: zootella]
<whyrusleeping>
lgierth: exactly
<bigs>
jbenet: what was that graph db you'd mentioned?
<lgierth>
another option would be to just do the stat first