galois_dmz has quit [Read error: Connection reset by peer]
jedahan_ has joined #ipfs
fleeky_ has joined #ipfs
jedahan has quit [Ping timeout: 244 seconds]
fleeky__ has quit [Ping timeout: 250 seconds]
Boomerang has quit [Remote host closed the connection]
<whyrusleeping>
mh00: hello!
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
Vyl has quit [Read error: Connection reset by peer]
Vyl has joined #ipfs
rmorey has joined #ipfs
mh00 has quit [Ping timeout: 260 seconds]
dmr has joined #ipfs
pfrazee has quit [Remote host closed the connection]
<achin>
mooooooo
nothingm1ch has quit [Ping timeout: 252 seconds]
nothingmuch has joined #ipfs
rgrinberg has quit [Ping timeout: 260 seconds]
rmorey has quit [Quit: leaving]
captain_morgan has quit [Ping timeout: 260 seconds]
sdiver has quit [Ping timeout: 244 seconds]
shizy has joined #ipfs
Mooney has joined #ipfs
wak-work has quit [Remote host closed the connection]
<Mooney>
For anyone familiar with orbitdb. Is there a way to authenticate users client side since essentially the data access is happening client side? Typicall a key exchange and password, etc are used on server apps. In this case who's the authority?
vtomole has joined #ipfs
shizy has quit [Ping timeout: 268 seconds]
sdiver has joined #ipfs
geemili has joined #ipfs
ygrek has quit [Ping timeout: 244 seconds]
captain_morgan has joined #ipfs
dignifiedquire has quit [Quit: Connection closed for inactivity]
uzyn has joined #ipfs
jedahan_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
captain_morgan has quit [Quit: Ex-Chat]
Pent has joined #ipfs
<Mooney>
Question's probably directed at haad. But not sure.
Mooney1 has joined #ipfs
Mooney has quit [Ping timeout: 265 seconds]
vtomole has quit [Ping timeout: 260 seconds]
captain_morgan has joined #ipfs
<arcalinea>
omg and that fake perianne account. what.
<whyrusleeping>
arcalinea: yeah, i don't think i've ever seen such a bold impersonation attempt on irc before
<reit>
what does ipfs.send() in js-ipfs-api do?
<whyrusleeping>
reit: mmm, ask daviddias or dignifiedquire
<whyrusleeping>
i'm not sure how it works
<whyrusleeping>
(and/or post an issue asking for better docs :P )
<reit>
it'd be super cool not to have to rely on xhrs
<whyrusleeping>
reit: not yet... we're working on it
<whyrusleeping>
its a difficult problem
<whyrusleeping>
in the meantime you can check out pubsub
<reit>
pubsub is nice, but it doesn't help with the initial connection, since there's no way for a client to say to a server "i'm here, please listen to me!"
<whyrusleeping>
hrm?
<reit>
i've a service where i sunk pretty much every bit of communication into ipfs except that, there's no way to avoid the xhrs in that case
<reit>
...that i know of, anyway
<whyrusleeping>
elaborate? i'm not actually sure what xhrs is
<reit>
oh sorry, an XMLHttpRequest
<reit>
that is, an ordinary path used by browsers to send requests to servers
<whyrusleeping>
ah, right
<whyrusleeping>
hrm... yeah
<whyrusleeping>
that example is what you want then
<whyrusleeping>
we really want it to
<whyrusleeping>
its just not super trivial to expose through the api
<reit>
it'll be really useful when it's done for a good few reasons: using xhrs like this first mandates that you get the server's direct ip (i have a json object published to the servers key with a ip section), and also browsers don't want to do https for direct ips any more so the security's gone
<reit>
i also can't really expect users to install a custom ipfs build just to use my site, so that option's out
sdiver has quit [Quit: WeeChat 1.6]
<reit>
i've thought about hacking it into js-ipfs when that's ready though, with that i can be as custom as i want
<reit>
it'd be cool to be able to something like an xhr but addressed to an ipfs peer id instead of a direct ip address
<whyrusleeping>
definitely agreed
<whyrusleeping>
and have ipfs do all the dialing, transport, nat traversal, encryption, multiplexing and other such fun for you
<reit>
^exactly, there's lots of cool stuff ipfs does in those regards
vtomole has joined #ipfs
sdiver has joined #ipfs
Mooney has joined #ipfs
Mooney1 has quit [Ping timeout: 256 seconds]
sametsisartenep has quit [Quit: zzzZZZ]
captain_morgan has quit [Ping timeout: 252 seconds]
DiCE1904 has quit [Remote host closed the connection]
DiCE1904 has joined #ipfs
Mooney has quit [Ping timeout: 260 seconds]
chris613 has quit [Quit: Leaving.]
geemili has quit [Ping timeout: 244 seconds]
captain_morgan has joined #ipfs
uzyn has quit [Quit: uzyn]
* zignig
hands whyrusleeping a large ice cold beer.
<whyrusleeping>
ah thanks :)
<zignig>
how going ipfs-erizing ?
* zignig
has been crazy busy with life and work.
<whyrusleeping>
zignig: its goin pretty good
<whyrusleeping>
just pushed a PR that lets you see open streams you have to each peer
<whyrusleeping>
and noticed something weird
<whyrusleeping>
which generally means theres a bug
<whyrusleeping>
also fixing an issue where diagnostics requests could hang
<whyrusleeping>
and build up goroutines
<whyrusleeping>
zignig: hows the downunder?
<zignig>
heading to summer, tomorrow should be 39C tomorrow ( that's 103F for you silly number system people )
* zignig
erks
<whyrusleeping>
39? i'll get my coat
<whyrusleeping>
its about that here too
<zignig>
if F perhaps
<chriscool>
Hi everyone!
<chriscool>
whyrusleeping: I started taking a look at improving test coverage for gx
<chriscool>
but it looks like existing sharness tests have been failing for some time
kobigurk has joined #ipfs
<whyrusleeping>
chriscool: awesome thank you!
<whyrusleeping>
i can take a look at making sure the current ones pass
<whyrusleeping>
i keep accidentally breaking them
lacour has quit [Quit: Leaving]
<chriscool>
whyrusleeping: yeah that would be nice!
<whyrusleeping>
i will do that right now :)
<chriscool>
great!
kulelu88 has joined #ipfs
<chriscool>
It looks like all the test pass now! Thanks!
pfrazee has joined #ipfs
<whyrusleeping>
chriscool: no problem :)
<whyrusleeping>
thanks for taking a look at them!
pfrazee has quit [Remote host closed the connection]
<chriscool>
No problem! While at it could you take a look at PRs #111 and #112?
captain_morgan has quit [Ping timeout: 256 seconds]
warner has quit [Quit: ERC (IRC client for Emacs 25.1.2)]
ygrek has joined #ipfs
ulrichard has joined #ipfs
<whyrusleeping>
chriscool: i can real quick, but i'm heading off to bed so if they take me very long i'll do it tomorrow
<chriscool>
whyrusleeping: they are short, but do as you wish
<whyrusleeping>
well, those were the easiest PRs i've merged in a while
<whyrusleeping>
:D
<whyrusleeping>
thanks!
<chriscool>
you're welcome :-D !
lkcl has quit [Ping timeout: 260 seconds]
DokterBob has joined #ipfs
DokterBob has quit [Quit: DokterBob]
matoro has quit [Ping timeout: 250 seconds]
ofdm has quit [Ping timeout: 245 seconds]
mildred has joined #ipfs
ofdm has joined #ipfs
polezaivsani has joined #ipfs
ylp has joined #ipfs
DokterBob has joined #ipfs
corvinux has joined #ipfs
dignifiedquire has joined #ipfs
ygrek has quit [Ping timeout: 260 seconds]
jholden_ has joined #ipfs
jholden_ has quit [Client Quit]
maxlath has joined #ipfs
rendar has joined #ipfs
<lugarius>
How far is the filecoin development?
r0kk3rz has quit [Quit: WeeChat 1.4]
polezaivsani has quit [Ping timeout: 268 seconds]
<Mateon1>
lugarius: As far as I know, it's only a paper at the moment. I'm not aware of any public spec or implementation.
r0kk3rz has joined #ipfs
Guest70121[m] has joined #ipfs
herzmeister has quit [Quit: Leaving]
cwahlers has quit [Ping timeout: 268 seconds]
cwahlers has joined #ipfs
bastianilso__ has joined #ipfs
kulelu88 has quit [Quit: Leaving]
espadrine has joined #ipfs
PseudoNoob has joined #ipfs
DokterBob has quit [Ping timeout: 250 seconds]
ivo_ has joined #ipfs
ianopolous_ has quit [Ping timeout: 256 seconds]
DokterBob has joined #ipfs
maxlath has quit [Ping timeout: 260 seconds]
<hsanjuan>
whyrusleeping are you up this time?
frmendes has joined #ipfs
ivo_ has quit [Quit: Leaving]
ivo_ has joined #ipfs
stephan[m] has joined #ipfs
ligi has quit [Quit: Lost terminal]
robattila256 has quit [Ping timeout: 260 seconds]
herzmeister has joined #ipfs
<Kubuxu>
hsanjuan: it is about 3am right now over there, so probably not
<Kubuxu>
if you have some question maybe I will be able to help
<hsanjuan>
kubuxu: :) yeah it was weird to see him at 7:30. I don't have questions, just dealing with dependency hell in libp2p, and projects with non-pinned gx'ed deps, and broken builds on dependent projects because PRs were accepted with broken tests etc.
<Kubuxu>
:(
<Kubuxu>
If you have specific error I might have solution for it as I work on un-rewritten go-ipfs right now.
<dignifiedquire>
Kubuxu: how much do you know about cors in the current ipfs version?
cemerick has joined #ipfs
<Kubuxu>
I know that I fought a lot to make it work.
<Kubuxu>
I think the API still doesn't allow CORS
<dignifiedquire>
well it worked some versions ago, I think 0.4.1 or so but trying to get it to work on 0.4.4 it throws errors for POST requests at me :(
<Kubuxu>
right, we are not testing for POST in any tests ...
<dignifiedquire>
ohh
espadrine has quit [Ping timeout: 260 seconds]
aedigix- has joined #ipfs
NeoTeo has quit [Ping timeout: 260 seconds]
voxelot has quit [Ping timeout: 260 seconds]
wa7son has quit [Ping timeout: 260 seconds]
bigbluehat has quit [Ping timeout: 260 seconds]
NeoTeo has joined #ipfs
c0dehero has quit [Ping timeout: 260 seconds]
<Kubuxu>
nice, I broke ipfs config: Error: failed to set config value: Failure to decode config: json: cannot unmarshal number 1.048576e+06 into Go value of type int (maybe use --json?)
bitspill has quit [Ping timeout: 260 seconds]
kyledrake has quit [Ping timeout: 260 seconds]
child has quit [Ping timeout: 260 seconds]
manveru has quit [Ping timeout: 260 seconds]
edubai__ has quit [Ping timeout: 260 seconds]
bergie has quit [Ping timeout: 260 seconds]
nullstyle has quit [Ping timeout: 260 seconds]
grncdr has quit [Ping timeout: 260 seconds]
Muis has quit [Ping timeout: 260 seconds]
<Kubuxu>
I have 1MiB buffer
<Kubuxu>
and when we encode it it is turned into exponent
<Kubuxu>
....
dignifiedquire has quit [Ping timeout: 260 seconds]
neurochemical[m] has quit [Ping timeout: 260 seconds]
onetom[m] has quit [Ping timeout: 260 seconds]
M-JayCarpenter has quit [Ping timeout: 260 seconds]
NikolayKolev[m] has quit [Ping timeout: 260 seconds]
M-HirmeS has quit [Ping timeout: 260 seconds]
mirek1337[m] has quit [Ping timeout: 260 seconds]
rschulman has quit [Ping timeout: 260 seconds]
M-krsiehl has quit [Ping timeout: 260 seconds]
davidar has quit [Ping timeout: 260 seconds]
mikolalysenko has quit [Ping timeout: 260 seconds]
prosody has quit [Ping timeout: 260 seconds]
omnigoat has quit [Ping timeout: 260 seconds]
ebarch has quit [Ping timeout: 260 seconds]
prettymuchbryce has quit [Ping timeout: 260 seconds]
ELLIOTTCABLE has quit [Ping timeout: 260 seconds]
zmanian____ has quit [Ping timeout: 260 seconds]
voldyman has quit [Ping timeout: 260 seconds]
mbrock has quit [Ping timeout: 260 seconds]
retrohacker has quit [Ping timeout: 260 seconds]
yangwao has quit [Ping timeout: 260 seconds]
aedigix has quit [Ping timeout: 260 seconds]
sknebel_ has joined #ipfs
dannyzen[m] has quit [Ping timeout: 260 seconds]
basilgohar[m] has quit [Ping timeout: 260 seconds]
M-Guillaume has quit [Ping timeout: 260 seconds]
edsilv[m]1 has quit [Ping timeout: 260 seconds]
M-podviaznikov has quit [Ping timeout: 260 seconds]
Natanael[m] has quit [Ping timeout: 260 seconds]
M-thomasbeta has quit [Ping timeout: 260 seconds]
david[m] has quit [Ping timeout: 260 seconds]
poga has quit [Ping timeout: 260 seconds]
mikeal has quit [Ping timeout: 260 seconds]
BostonEnginerd has quit [Ping timeout: 260 seconds]
oleavr has quit [Ping timeout: 260 seconds]
karissa has quit [Ping timeout: 260 seconds]
xnaveira has quit [Ping timeout: 260 seconds]
alanz has quit [Ping timeout: 260 seconds]
sknebel has quit [Ping timeout: 260 seconds]
chungy has quit [Ping timeout: 260 seconds]
jon[m]1 has quit [Ping timeout: 260 seconds]
kpcyrd has quit [Ping timeout: 260 seconds]
erikj has quit [Ping timeout: 260 seconds]
stephan[m] has left #ipfs ["User left"]
child has joined #ipfs
yangwao has joined #ipfs
grncdr has joined #ipfs
manveru has joined #ipfs
<Kubuxu>
which is broken right now
kyledrake has joined #ipfs
edubai__ has joined #ipfs
<Kubuxu>
and we don't have tests for CORS on API
nullstyle has joined #ipfs
bitspill has joined #ipfs
bergie has joined #ipfs
ebarch has joined #ipfs
voldyman has joined #ipfs
Muis has joined #ipfs
mbrock has joined #ipfs
poga has joined #ipfs
prettymuchbryce has joined #ipfs
oleavr has joined #ipfs
ELLIOTTCABLE has joined #ipfs
mikeal has joined #ipfs
prosody has joined #ipfs
karissa has joined #ipfs
zmanian____ has joined #ipfs
retrohacker has joined #ipfs
omnigoat has joined #ipfs
mikolalysenko has joined #ipfs
chungy has joined #ipfs
erikj has joined #ipfs
erikj has joined #ipfs
erikj has quit [Changing host]
cwahlers has quit [Ping timeout: 260 seconds]
j0hnsmith has joined #ipfs
chriscool has quit [Ping timeout: 268 seconds]
voxelot has joined #ipfs
bigbluehat has joined #ipfs
M-krsiehl has joined #ipfs
NikolayKolev[m] has joined #ipfs
rschulman has joined #ipfs
neurochemical[m] has joined #ipfs
M-HirmeS has joined #ipfs
mirek1337[m] has joined #ipfs
M-Guillaume has joined #ipfs
Natanael[m] has joined #ipfs
david[m] has joined #ipfs
kpcyrd has joined #ipfs
M-JayCarpenter has joined #ipfs
M-podviaznikov has joined #ipfs
edsilv[m]1 has joined #ipfs
onetom[m] has joined #ipfs
M-thomasbeta has joined #ipfs
davidar has joined #ipfs
jon[m]1 has joined #ipfs
basilgohar[m] has joined #ipfs
xnaveira has joined #ipfs
geemili has joined #ipfs
dannyzen[m] has joined #ipfs
BostonEnginerd has joined #ipfs
lkcl has joined #ipfs
wa7son has joined #ipfs
dignifiedquire has joined #ipfs
alanz has joined #ipfs
espadrine has joined #ipfs
<hsanjuan>
kubuxu: It seems I got through my errors via rewriting. I hope you don't have to suffer a lot to get an un-rewriten version. It would be great :)
<Kubuxu>
not a lot, but there are about 3 or 4 steps to many
edubai__ has quit [Read error: Connection reset by peer]
lindybrits has joined #ipfs
edubai__ has joined #ipfs
ylp has quit [Read error: No route to host]
ylp has joined #ipfs
vtomole has quit [Ping timeout: 260 seconds]
<lindybrits>
Hi all! :)
geemili has quit [Ping timeout: 260 seconds]
chriscool has joined #ipfs
ilyaigpetrov has joined #ipfs
lindybrits has quit [Quit: Page closed]
<Kubuxu>
whyrusleeping: I might have solution for rewrite hell
<Kubuxu>
Oh yeah
<Kubuxu>
ping me when you are online
<Kubuxu>
or no, as go will happily build it when symlinks don't resolve
<Kubuxu>
and it won't work on windows
<Kubuxu>
Why everything is so broken
c0dehero has joined #ipfs
sknebel_ has quit [Quit: sknebel_]
sknebel has joined #ipfs
<dignifiedquire>
Kubuxu: I am back
<dignifiedquire>
no idea what happend
<dignifiedquire>
I realised I wasn't setting the config properly
<dignifiedquire>
now about to test with correct config
<dignifiedquire>
finally success
<dignifiedquire>
Kubuxu: it does work when setting the config correct
<dignifiedquire>
Kubuxu: but I found a kind of bug which is super annoying
<dignifiedquire>
ipfs config set Value "{nested: {json: true}}" --json does only set Value = {nested: null}
maxlath has joined #ipfs
dmr has quit [Quit: Leaving]
<Kubuxu>
dignifiedquire: what is the correct config?
<dignifiedquire>
not sure yet I pasted the config that should work in the issue
<dignifiedquire>
Kubuxu: looks working with that config for me
maxlath has quit [Ping timeout: 256 seconds]
maxlath has joined #ipfs
corvinux has joined #ipfs
<keks>
whyrusleeping: I'm having trouble configuring my local webserver to reproduce that "add kill ipfs daemon" bug
<keks>
*kills
<keks>
I posted some thoughts at the github issue
cwahlers has joined #ipfs
hashcore has joined #ipfs
hashcore has quit [Client Quit]
rendar has quit [Ping timeout: 252 seconds]
herzmeister has quit [Quit: Leaving]
corvinux has quit [Ping timeout: 252 seconds]
corvinux has joined #ipfs
chriscool has quit [Ping timeout: 256 seconds]
bertschneider has joined #ipfs
O47m341 has quit [Quit: Suzie says, "TTFNs!"]
rendar has joined #ipfs
Oatmeal has joined #ipfs
ivo_ has quit [Remote host closed the connection]
bastianilso__ has quit [Quit: bastianilso__]
corvinux has quit [Ping timeout: 250 seconds]
maxlath has quit [Remote host closed the connection]
maxlath has joined #ipfs
maxlath has quit [Client Quit]
maxlath has joined #ipfs
lkcl has quit [Ping timeout: 250 seconds]
_whitelogger has quit [Ping timeout: 260 seconds]
_whitelogger has joined #ipfs
j0hnsmith has quit [Quit: j0hnsmith]
rgrinberg has joined #ipfs
maxlath has quit [Ping timeout: 265 seconds]
lkcl has joined #ipfs
taaem has joined #ipfs
shizy has joined #ipfs
<keks>
daviddias: i think you were also part of the discussion on irc
soloojos has quit [Ping timeout: 245 seconds]
Encrypt has joined #ipfs
maxlath has joined #ipfs
bastianilso__ has joined #ipfs
herzmeister has joined #ipfs
soloojos has joined #ipfs
<lgierth>
whyrusleeping: very funny crash: ipfs.io/ipfs/QmX3TD2xQXn4evM7B3k88zTAzCJXZkgDxwQ5mnCanx7R1W -- it went from 3k goroutines up to 200k in a matter of 3 minutes
<lgierth>
then got docker into some weird condition where it wouldn't restart the container
<lgierth>
watch out it's 54M
<lgierth>
the log starts when the goroutines already started rising
<lgierth>
(the crash is just a boring OOM)
<Mateon1>
lgierth: A few days ago my main Windows daemon crashed, having consumed a shitton (>10GB) of memory, I was unable to request the pprof dump, because my machine ran out of memory and killed IPFS before I figured the debug/pprof endpoint for stacks
<lgierth>
requested something huge?
polezaivsani has joined #ipfs
<Mateon1>
Not as far as I know, it might have served something huge
chriscool has joined #ipfs
lkcl has quit [Ping timeout: 260 seconds]
matoro has joined #ipfs
lkcl has joined #ipfs
ylp has quit [Quit: Leaving.]
ylp has joined #ipfs
SebastianCB has joined #ipfs
<SebastianCB>
Hi all, is there currently any way to determine on how many nodes host a certain file or portion thereof? e.g. I want to reliably store my data and setup 10 nodes that pin all my stuff. How would I find out if 9 of those have a faulty hard drive that actually deleted all my data?
captain_morgan has joined #ipfs
<dignifiedquire>
woot, down to 500k for minified js-ipfs-api from 1.2M
Arw has quit [Disconnected by services]
<dignifiedquire>
and only 10 tests failing :D
Arw has joined #ipfs
Arw has quit [Disconnected by services]
Arw_ has joined #ipfs
bertschneider has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
DokterBob has quit [Quit: DokterBob]
robattila256 has joined #ipfs
PseudoNoob has joined #ipfs
lkcl has quit [Ping timeout: 268 seconds]
rgrinberg has quit [Remote host closed the connection]
rgrinberg has joined #ipfs
ulrichard has quit [Ping timeout: 250 seconds]
ylp has quit [Quit: Leaving.]
ygrek has joined #ipfs
<dignifiedquire>
whyrusleeping: working on the review, you woke up too early ;)
gmcquillan has quit [Quit: gmcquillan]
arpu has joined #ipfs
gmcquillan__ has joined #ipfs
gmcquillan__ is now known as gmcquillan
mildred has quit [Ping timeout: 244 seconds]
<dignifiedquire>
whyrusleeping: the popcount implementation you are using is the one not taking advantage of the cpu native instruction correct?
<dignifiedquire>
could you use it if available or is it not easily accessible from go?
<dignifiedquire>
hmm alright read the thread on golang I guess this version should be fast enough for us
<whyrusleeping>
yeah, if that becomes an issue, then i'll do some assembly stuff
<whyrusleeping>
but its not really that big of a deal yet
<whyrusleeping>
keks: thanks for investigating. i'm beginning to think that it might be a js-ipfs-api bug
<whyrusleeping>
Kubuxu: I'm pretty sure i know what youre thinking. I used to use symlinks for gx stuff, but its really hard to make any guarantees about that
<whyrusleeping>
keks: read more into your issue, thats rather odd... let me know if you want a second pair of eyes on anything
<dignifiedquire>
whyrusleeping: there are no bugs in js-ipfs-api, why would you think that :P
gmcquillan has quit [Quit: gmcquillan]
cemerick has quit [Ping timeout: 252 seconds]
herzmeister has quit [Quit: Leaving]
maxlath has quit [Ping timeout: 260 seconds]
ygrek has quit [Ping timeout: 260 seconds]
cemerick has joined #ipfs
palkeo has joined #ipfs
palkeo has joined #ipfs
palkeo has quit [Changing host]
matoro has quit [Ping timeout: 252 seconds]
<keks>
whyrusleeping: currently mocking a network to investigate how go http servers behave when using multipart and early flushes
<A124>
Can we set that to NumCPU() if NumCPU() < 3 ?
<keks>
if you change lines 43 and 44 (the flushes) it prints something
<whyrusleeping>
A124: oh, yeah
<whyrusleeping>
thats realllly old code
<whyrusleeping>
that entire thing can be removed
<whyrusleeping>
keks: flush isnt a method on those objects?
ygrek has joined #ipfs
<keks>
oh wat why didn't those errors show before
<A124>
whyrusleeping Can you do that please? We are writing stuff and wanted to see how you solve it, and found this. On single core machines that eats a lot. Does it banefit from virtual cores performance wise?
<A124>
I know you want PRs signed, else I would not hesitate ;)
<whyrusleeping>
A124: yeah, sure
<whyrusleeping>
one sec
captain_morgan has quit [Ping timeout: 260 seconds]
captain_morgan has joined #ipfs
SebastianCB has quit [Ping timeout: 260 seconds]
<whyrusleeping>
dignifiedquire: daviddias is there any way you can just download all the npm stuff to disk first, and then ingest it from there into ipfs?
<dignifiedquire>
I would have to change some code around
<whyrusleeping>
just to make this whole npm-registry thing less "oh shit i have to start completely from scratch"-y ?
<dignifiedquire>
but I can try
<lgierth>
isn't it a couchdb database that it's replicating?
<dignifiedquire>
lgierth: roughly
<dignifiedquire>
but I don't want the db, I want a big folder full of packages with metadata as .json
<lgierth>
but you also want checkpoint-like things so that you can resume
<lgierth>
for keeping it up-to-date
<lgierth>
if there's an rsync-like interface to the npm registry, we can join forces, i need rsync->mfs too (for media.ccc.de)
galois_d_ has joined #ipfs
<lgierth>
a.k.a. ipsync
<dignifiedquire>
no rsync, couch db change feed
<dignifiedquire>
that code is all written
<lgierth>
yup thought so
<dignifiedquire>
but currently it dumps it straight into ipfs
<dignifiedquire>
so just need to change it so it dumps it into the regular filesystem instead
<lgierth>
oh do you want the big folder so you can test out sharding?
gmcquillan__ has joined #ipfs
gmcquillan__ is now known as gmcquillan
<dignifiedquire>
yes and because that's how npm on ipfs is going to work
<dignifiedquire>
which is why I want sharding
<lgierth>
until now i thought i had a pretty good idea how npm-on-ipfs is works
<lgierth>
why the dump-to-fs step?
galois_dmz has quit [Ping timeout: 252 seconds]
<whyrusleeping>
lgierth: so we can stop having to redownload the entire thing when the system hiccups slightly
<lgierth>
then you have to ensure the integrity of the fs dump
<dignifiedquire>
integrity is checked via sha1 hashsums on download + install
captain_morgan has quit [Ping timeout: 260 seconds]
<dignifiedquire>
and we could easily write an integrity checker that just goes through everything and checks the sums
<lgierth>
i don't understand how the current changefeed-to-mfs approach isn't resumable
<dignifiedquire>
because I'm dumping into ipfs with flush false
<dignifiedquire>
and it crashed
<dignifiedquire>
so ipfs has lost all my things :(
<lgierth>
why not flush in intervals?
<lgierth>
this doesn't have to be all or nothing
<dignifiedquire>
that is what should have happened
<dignifiedquire>
but the code wasn't there :D
<lgierth>
(just saying, dumping to a folder will blow up the space requirements. you have to keep that dump around)
<dignifiedquire>
damn I used my laptop for the last couple of months and now I'm using my big machine for dev again, it's soooo much faster
<dignifiedquire>
those macbooks are small and shiny, but not really fast in hindsight
<lgierth>
hah same for me, no more >30s go-ipfs build times
<keks>
i'm not sure, maybe it's illegal to create a multipartreader after flushing
<keks>
maybe flushing actually empties existing buffers? dont know
<keks>
i didn't expect it to break stuff anyway
<mh00>
Hello everybody. I have some question. With which version golang https://github.com/libp2p/go-libp2p is works ? Sorry for my bad english
<whyrusleeping>
keks: hrm... it spits out a bunch of binary for me
<whyrusleeping>
mh00: go1.7
<lgierth>
nice, so you got it to reproduce?
<lgierth>
wouldn't be the first go bug we find
<keks>
yeah that is hte image. i'll make another one that doesn't use the image
<mh00>
Hm. I have some stragnge errors in peerstream package . ( ./example.go:16: cannot use peerstream_spdystream.Transport (type peerstream_spdystream.transport) as type "gx/ipfs/Qmb1US8uyZeEpMyc56wVZy2cDFdQjNFojAUYVCoo9ieTqp/go-stream-muxer".Transport in argument to peerstream.NewSwarm: )
<mh00>
[pydevel@pydevel example]$ go version go version go1.7.3 linux/amd64 .
<lgierth>
mh00: you need to run `gx rewrite`
<lgierth>
and gx install --global
<mh00>
Ooohh. Ok. one second ...
<whyrusleeping>
or 'make deps'
<lgierth>
eh yeah go with make deps
<mh00>
[pydevel@pydevel go-peerstream]$ gx rewrite No help topic for 'rewrite'
<whyrusleeping>
interesting. so it just halts early?
<whyrusleeping>
unexpectedly?
raitucarp has joined #ipfs
<raitucarp>
hi everyone
<keks>
whyrusleeping: uhm, are you talking to me?
<whyrusleeping>
keks: yeah
<whyrusleeping>
the output gets truncated, right?
bastianilso__ has quit [Remote host closed the connection]
bastianilso___ has joined #ipfs
<raitucarp>
Can someone help me, how to call rest api add? Because when I use postnman, I get 403
<raitucarp>
I mean *postman
<keks>
whyrusleeping: the output get truncated because we only look at one part. also flushing is currently commented out. if you remove the // in ln 75 and 76 it won't find any parts and return ann error
<whyrusleeping>
keks: okay, so then what am i looking at here?
<mh00>
make deps will do the same - Thanks !!! It's helped
<keks>
it seems weird to me that flushing the *result* removes data from the *request*
<keks>
well, it's just looking at a multipart request and see what happens when you flush the result before reading the request body
<keks>
it's weird local data that local data gets lost, especially since this isn't mentioned in the docs
<dignifiedquire>
and from the time it took pretty sure it was flushing
wallacoloo_ has joined #ipfs
ianopolous has joined #ipfs
jeffl35 is now known as iczero
<Kubuxu>
whyrusleeping: yeah, once can use symlinks in ./vendor
<A124>
@why Thanks for the PR!
<whyrusleeping>
A124: no probs
nothingmuch has quit [Quit: *poof*]
Oatmeal has quit [Quit: Suzie says, "TTFNs!"]
<seharder>
Hey guys was reading "The Merkeldag" in the specs repository. There is a reference to the following links which are broken: github.com/ipfs/go-merkledag and github.com/ipfs/node-merkledag.
<seharder>
If someone will tell me where they should point to I will fix them.
ilyaigpetrov has quit [Quit: Connection closed for inactivity]
ugjka has quit [Ping timeout: 268 seconds]
ugjka has joined #ipfs
<lgierth>
yoshuawuyts: remember that deployment tool you showed me in lisbon?
rgrinberg has quit [Ping timeout: 252 seconds]
Mizzu has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
mh00 has quit [Quit: Page closed]
Sebastian_CB has joined #ipfs
Mizzu has quit [Quit: WeeChat 1.6]
SebastianCB has quit [Ping timeout: 244 seconds]
Encrypt has quit [Quit: Quit]
ulrichard has quit [Quit: Ex-Chat]
ivo_ has joined #ipfs
ianopolous has joined #ipfs
ianopolous__ has quit [Ping timeout: 250 seconds]
nik has joined #ipfs
nik has left #ipfs [#ipfs]
ianopolous has quit [Remote host closed the connection]
ivo_ has quit [Quit: Leaving]
Aranjedeath has joined #ipfs
ianopolous has joined #ipfs
wak-work has joined #ipfs
Sebastian_CB has quit [Ping timeout: 260 seconds]
shizy has quit [Ping timeout: 260 seconds]
geemili has joined #ipfs
<Polychrome[m]>
Silly question - is there some way to get the IPFS daemon running with a systray icon on Windows or do I have to keep a cmd window open?