zbyte64_ has quit [Remote host closed the connection]
zbyte64 has joined #ipfs
<whyrusleeping>
lgierth: hmmmm
bronzo has joined #ipfs
<whyrusleeping>
yeah
<whyrusleeping>
that works too
<whyrusleeping>
i just experienced my least favorite feeling again
<whyrusleeping>
"Who would write such shitty code?"... `git blame`
<whyrusleeping>
"oh, it was me"
<lgierth>
:))
<bronzo>
greets!
<bronzo>
im curently setting up ipfs on ubuntu-server
<bronzo>
..or trying ;)
zbyte64_ has joined #ipfs
<bronzo>
should i make a new user and initialize ipfs/ & ipns/ under new user or put directries in /srv
zbyte64 has quit [Ping timeout: 248 seconds]
ivo_ has quit [Ping timeout: 245 seconds]
<jbenet>
whyrusleeping: yeah well, i remember some very nasty bugs like that... :[
<wak-work>
bronzo: it depends
<wak-work>
bronzo: for what i do i have an ipfs service running under and ipfs user with acls for access
<wak-work>
bronzo: but if you want to apply resource limits and make sure other users don't tamper with your ipfs pins and things you want individual instances
zbyte64_ has quit [Ping timeout: 260 seconds]
<wak-work>
bronzo: i use /var/lib/ipfs for all of my ipfs state data
<bronzo>
wak-work: ah, interesting, i plan on having other services running like docker or coreos in a vagrant instance
<whyrusleeping>
kevina: NextSync because its the same as Next, but without any 'concurrency' stuff
<kevina>
whyrusleeping: very non-obvious name, but I can live with it for now
<whyrusleeping>
whats non-obvious about it?
<whyrusleeping>
i think its pretty clear
<kevina>
Next() is badly names also, as it returns a channel, not the next element
<kevina>
okay, I will just go with the name, not worth an argument :)
<whyrusleeping>
heh
<whyrusleeping>
thaaaaanks
<lgierth>
nice iterator return func pattern there
<lgierth>
(i like)
dmr has joined #ipfs
zbyte64 has joined #ipfs
zbyte64 has quit [Ping timeout: 258 seconds]
<whyrusleeping>
:D
<whyrusleeping>
lgierth: i'm working on moving to that sort of thing more
<whyrusleeping>
as opposed to channel iterators
<whyrusleeping>
or the even worse "get all the things in one big array"
<lgierth>
or maybe there's a nice way of doing batching
<lgierth>
batching/paging
vtomole has joined #ipfs
<lgierth>
maybe this is a good time to ask this: i'm wondering how to efficiently pass around the packets in libp2p
<lgierth>
thing is they're small
<lgierth>
like, make([]byte, 1400)
<lgierth>
i don't wanna excessively copy stuff around. ideally do en/decryption in place and stuff like that.
<lgierth>
it'll probably work out okay -- the interface so far is SetMsgHandler(func(proto.ID, peer.ID, []byte)) and WriteMsg(proto.ID, peer.ID, []byte)
ralphtheninja has joined #ipfs
DiCE1904 has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
<whyrusleeping>
lgierth: that seems alright to me
<lgierth>
and then protocols on top can decide to buffer or drop or whatever
se3000 has joined #ipfs
<kumavis>
i keep wanting to do type-casting in long lookups
<kumavis>
in adavanced path lookups*
<whyrusleeping>
kumavis: what do you mea?
<whyrusleeping>
n
captain_morgan has quit [Ping timeout: 256 seconds]
mguentner has quit [Ping timeout: 246 seconds]
<kumavis>
yep sorry
<kumavis>
so looking up some value stored in an ethereum contract looks like `/<blockHash>/state/<address>/storage/<storageKey>`
<whyrusleeping>
okay
<kumavis>
that storage is typed as binary data, we dont really have any context at this level
<whyrusleeping>
ahhhh
<whyrusleeping>
hrm...
<kumavis>
but what if that storage is a git commit
<kumavis>
like we've got a DAO managing a git repo
<whyrusleeping>
storageKey should result in giving you a cid, right?
ckwaldon has joined #ipfs
<kumavis>
and they've voted to merge a PR and they've update their HEAD ref
<whyrusleeping>
like, when you resolve storageKey, you should get a cid that points to that 'binary data'
<whyrusleeping>
and the cid should have a type on it
<kumavis>
thats true, you could do that
<whyrusleeping>
thats how i'm looking at doing similar things for zcash encrypted memo fields
<kumavis>
the thing is idk if we'd always want to do that
<kumavis>
sometimes the correct result is just the binary data
<whyrusleeping>
then you'll never have any idea what the data is
<whyrusleeping>
you have to tag the data *somehow*
<kumavis>
and thats where 'casting' comes along
<whyrusleeping>
it should always be self describing
<kumavis>
anyways i cant think of a way to do casting that is clean
<kumavis>
but i do keep wanting it
<kumavis>
we could make the eth storage resolver somewhat clever and check if it looks like a cid and if it does return it as a cid link, otherwise fallback to binary
<kumavis>
maybe you could even push resolvers into the eth-storage-resolver
mguentner has joined #ipfs
<whyrusleeping>
Yeah, that would probably work
<kumavis>
i think i like that better than casting
YossIrving[m] has joined #ipfs
<kumavis>
@daviddias let me know what you think ^
vtomole has quit [Ping timeout: 260 seconds]
trn has quit [Ping timeout: 250 seconds]
cemerick has quit [Ping timeout: 260 seconds]
mguentner has quit [Quit: WeeChat 1.6]
ckwaldon has quit [Quit: ckwaldon]
cemerick has joined #ipfs
mguentner has joined #ipfs
ygrek has quit [Ping timeout: 252 seconds]
lidel has quit [Ping timeout: 268 seconds]
lidel has joined #ipfs
captain_morgan has joined #ipfs
se3000 has quit [Quit: My iMac has gone to sleep. ZZZzzz…]
jholden has joined #ipfs
jholden has quit [Ping timeout: 260 seconds]
reit has quit [Quit: Leaving]
chris613 has quit [Quit: Leaving.]
zbyte64 has joined #ipfs
ygrek has joined #ipfs
pfrazee has quit [Remote host closed the connection]
zbyte64 has quit [Remote host closed the connection]
aggelos_ has joined #ipfs
zbyte64 has joined #ipfs
zbyte64 has quit [Remote host closed the connection]
zbyte64 has joined #ipfs
rgrinberg has quit [Ping timeout: 260 seconds]
mildred has joined #ipfs
cemerick has quit [Ping timeout: 260 seconds]
zbyte64 has quit [Remote host closed the connection]
zbyte64 has joined #ipfs
rendar has joined #ipfs
zbyte64 has quit [Ping timeout: 250 seconds]
ulrichard has joined #ipfs
zbyte64 has joined #ipfs
zbyte64 has quit [Ping timeout: 250 seconds]
yoosi has quit [Remote host closed the connection]
yoosi has joined #ipfs
zbyte64 has joined #ipfs
soloojos has quit [Ping timeout: 245 seconds]
stigo has quit [Quit: Leaving]
mildred has quit [Quit: WeeChat 1.5]
mildred has joined #ipfs
mildred has quit [Ping timeout: 260 seconds]
zbyte64 has quit [Remote host closed the connection]
zbyte64 has joined #ipfs
mildred has joined #ipfs
mildred has quit [Client Quit]
mildred has joined #ipfs
mildred has quit [Client Quit]
zbyte64 has quit [Ping timeout: 268 seconds]
mildred has joined #ipfs
mildred1 has joined #ipfs
ian1 has joined #ipfs
zbyte64 has joined #ipfs
zbyte64 has quit [Ping timeout: 246 seconds]
zbyte64 has joined #ipfs
zbyte64 has quit [Ping timeout: 250 seconds]
mildred1 has quit [Quit: WeeChat 1.5]
ianopolous__ has quit [Remote host closed the connection]
mildred1 has joined #ipfs
ian1 has quit [Ping timeout: 246 seconds]
zbyte64 has joined #ipfs
ianopolous__ has joined #ipfs
zbyte64 has quit [Ping timeout: 260 seconds]
ianopolous_ has joined #ipfs
ianopolous__ has quit [Ping timeout: 260 seconds]
zbyte64 has joined #ipfs
Kane` has quit [Remote host closed the connection]
zbyte64 has quit [Ping timeout: 256 seconds]
<haad>
kumavis: you were having problems yesterday with js-ipfs complaining about some loaders, right?
captain_morgan has quit [Ping timeout: 240 seconds]
<haad>
kumavis: was trying it today and seems using webpack2@2.1.0-beta.25 (instead of -beta.26 which gets picked up by npm install). this can be fixed in aegir I believe. cc dignifiedquire
polezaivsani has joined #ipfs
yoosi has quit [Remote host closed the connection]
<haad>
daviddias: can you release a patch version of js-libp2p-floodsub to include the package.json paths fix gavin did? would need that to get libp2p-floosub module working normally via npm
zbyte64 has joined #ipfs
corvinux has joined #ipfs
ianopolous_ has quit [Ping timeout: 260 seconds]
zbyte64 has quit [Ping timeout: 248 seconds]
kanzure has quit [Remote host closed the connection]
padz has quit [Remote host closed the connection]
corvinux has quit [Ping timeout: 260 seconds]
bastianilso__ has joined #ipfs
s_kunk has joined #ipfs
s_kunk has quit [Read error: Connection reset by peer]
s_kunk_ has joined #ipfs
s_kunk_ has quit [Remote host closed the connection]
s_kunk__ has joined #ipfs
s_kunk__ is now known as s_kunk
yoosi has joined #ipfs
s_kunk has quit [Changing host]
s_kunk has joined #ipfs
corvinux has joined #ipfs
dignifiedquire has joined #ipfs
<haad>
daviddias: actually hold that off, will do a PR soon
<haad>
dignifiedquire: it seems beta26 doesn't seem to pick up json files
<haad>
dignifiedquire: any idea what this means "UpgradeError Dexie specification of currently installed DB version is missing"? getting it with a js-ipfs version built from master when initializing IPFS (and that doesn't happen with 0.17.0)
<haad>
dignifiedquire: btw. the build process is MUCH smoother now with aegir. no more crazy webpack configs or export! requires :) :+1:
<haad>
dignifiedquire: gonna adopt aegir in one of my modules and try it out
<lindybrits>
dignifiedquire: if you use ipfs.files.add(obj, ...) and the object has a blank path, what happens in the background?
<haad>
dignifiedquire: one feedback would be to pickup the index.js file for webpack build from package.json instead of hard-coding it to src/index.js
Kane` has joined #ipfs
<dignifiedquire>
haad: PRs welcome :)
<dignifiedquire>
yeah it seems the json loader is not properly being picked up by webpack 26
<dignifiedquire>
will check out later
<dignifiedquire>
and great to hear you have a better time using !
<dignifiedquire>
*it
<dignifiedquire>
lindybrits: that means the file will be stored with an empty path on ipfs
<dignifiedquire>
the path is just some associated data stored together with the content
<victorbjelkholm>
good morning world!
gmoro has quit [Remote host closed the connection]
<slothbag>
is there some Go code to utilize the IPLD format? Or is it basically just create a conforming structure yourself?
gmoro has joined #ipfs
<lindybrits>
dignifiedquire: okay cool. I am getting and empty response when using ipfs.files.add(obj, ...) but no error. Thoughts?
ian1 has quit [Ping timeout: 245 seconds]
ian1 has joined #ipfs
<lindybrits>
dignifiedquire: meh oops. content has to be buffer instance. all good
espadrine has joined #ipfs
<dignifiedquire>
cool
zbyte64 has joined #ipfs
<slothbag>
nvm, I found it
zbyte64 has quit [Ping timeout: 252 seconds]
<polezaivsani>
Hi Kubuxu! regarding go-metrics-interface - is it a valid way to use its New function to get a Creator in setting where you don't have a context?
<polezaivsani>
the context is used in creating proper metric names anyway and doesn't have a say in resource management of any kind
ian1 has quit [Ping timeout: 256 seconds]
ian1 has joined #ipfs
cemerick has joined #ipfs
<Kubuxu>
yeah, as you don't have proper name just use the new with no context
<Kubuxu>
you can pass explicit name there
<Kubuxu>
(or wire up t he context to creation)
<polezaivsani>
Kubuxu: good, will do without contexts then
jholden has joined #ipfs
ian1 has quit [Ping timeout: 246 seconds]
zbyte64 has joined #ipfs
ian1 has joined #ipfs
zbyte64 has quit [Ping timeout: 258 seconds]
Boomerang has joined #ipfs
anonymuse has joined #ipfs
zbyte64 has joined #ipfs
zbyte64 has quit [Ping timeout: 260 seconds]
ian1 has quit [Ping timeout: 245 seconds]
apiarian_work has joined #ipfs
domanic has joined #ipfs
ian1 has joined #ipfs
zbyte64 has joined #ipfs
<polezaivsani>
Kubuxu, if you don't mind - the go-metrics-interface has no means of unregistering metrics. is this by design? i don't know whether any metric would get registered twice at runtime, but metric gathering datastore wrappers had thier metrics unregistred with Closer
zbyte64 has quit [Ping timeout: 252 seconds]
ian1 is now known as Smilex
domanic has quit [Ping timeout: 240 seconds]
korayal[m] has joined #ipfs
domanic has joined #ipfs
zbyte64 has joined #ipfs
tg has quit [Excess Flood]
jholden has quit [Ping timeout: 258 seconds]
zbyte64 has quit [Ping timeout: 252 seconds]
tg has joined #ipfs
<haad>
!pin QmSbpyYUSJJEpdmHwL1ZfyPL5FHmqxExqSuDZUY5QBZXVZ js-ipfs example
<pinbot>
now pinning /ipfs/QmSbpyYUSJJEpdmHwL1ZfyPL5FHmqxExqSuDZUY5QBZXVZ
anonymuse has quit [Remote host closed the connection]
<Kubuxu>
polezaivsani: can you link me an example?
slothbag has quit [Quit: Leaving.]
mildred has quit [Quit: WeeChat 1.6]
zbyte64 has joined #ipfs
zbyte64 has quit [Ping timeout: 246 seconds]
anonymuse has joined #ipfs
<dignifiedquire>
haad: found the issue
<dignifiedquire>
pushing a release of aegir now which should fix the problem
apiarian_work has quit [Ping timeout: 258 seconds]
<pinbot>
now pinning /ipfs/http://localhost:8080/ipfs/QmRKuSuaH5fK9mFeRxiU74SwYVR6U2uaGhmhbm3P44kDgF/
<pinbot>
[host 6] failed to grab refs for /ipfs/http://localhost:8080/ipfs/QmRKuSuaH5fK9mFeRxiU74SwYVR6U2uaGhmhbm3P44kDgF/: selected encoding not supported
<pinbot>
[host 5] failed to grab refs for /ipfs/http://localhost:8080/ipfs/QmRKuSuaH5fK9mFeRxiU74SwYVR6U2uaGhmhbm3P44kDgF/: selected encoding not supported
<pinbot>
[host 7] failed to grab refs for /ipfs/http://localhost:8080/ipfs/QmRKuSuaH5fK9mFeRxiU74SwYVR6U2uaGhmhbm3P44kDgF/: selected encoding not supported
<pinbot>
[host 0] failed to grab refs for /ipfs/http://localhost:8080/ipfs/QmRKuSuaH5fK9mFeRxiU74SwYVR6U2uaGhmhbm3P44kDgF/: selected encoding not supported
<pinbot>
[host 4] failed to grab refs for /ipfs/http://localhost:8080/ipfs/QmRKuSuaH5fK9mFeRxiU74SwYVR6U2uaGhmhbm3P44kDgF/: selected encoding not supported
<pinbot>
[host 2] failed to grab refs for /ipfs/http://localhost:8080/ipfs/QmRKuSuaH5fK9mFeRxiU74SwYVR6U2uaGhmhbm3P44kDgF/: selected encoding not supported
<pinbot>
[host 1] failed to grab refs for /ipfs/http://localhost:8080/ipfs/QmRKuSuaH5fK9mFeRxiU74SwYVR6U2uaGhmhbm3P44kDgF/: selected encoding not supported
<pinbot>
[host 3] failed to grab refs for /ipfs/http://localhost:8080/ipfs/QmRKuSuaH5fK9mFeRxiU74SwYVR6U2uaGhmhbm3P44kDgF/: selected encoding not supported
galois_d_ has quit [Remote host closed the connection]
galois_dmz has joined #ipfs
arpu has joined #ipfs
elsehow has left #ipfs [#ipfs]
domanic has quit [Quit: Konversation terminated!]
domanic has joined #ipfs
domanic has quit [Read error: Connection reset by peer]
dominic__ has joined #ipfs
bastianilso__ has joined #ipfs
dominic__ has quit [Ping timeout: 246 seconds]
dominic__ has joined #ipfs
mildred has quit [Ping timeout: 268 seconds]
zbyte64 has joined #ipfs
dominic__ has quit [Ping timeout: 268 seconds]
dominic__ has joined #ipfs
zbyte64 has quit [Remote host closed the connection]
zbyte64 has joined #ipfs
dominic__ has quit [Ping timeout: 268 seconds]
captain_morgan has quit [Ping timeout: 256 seconds]
dominic__ has joined #ipfs
mildred has joined #ipfs
zbyte64 has quit [Remote host closed the connection]
zbyte64 has joined #ipfs
se3000 has quit [Quit: My iMac has gone to sleep. ZZZzzz…]
<kumavis>
hey can someone sell me on the multicodecs thing?
<kumavis>
it was explained that it was so you wouldnt need to know what table to look it up from
<kumavis>
but it seems like this information is only meaningful if you know categorically what to use it for
mildred has quit [Ping timeout: 252 seconds]
<kumavis>
e.g. this is a hash algorithm, this is an ipld format, this is a baseX binary encoding
zbyte64 has quit [Ping timeout: 252 seconds]
dominic__ has quit [Quit: Konversation terminated!]
dominic__ has joined #ipfs
apiarian has quit [Ping timeout: 260 seconds]
apiarian has joined #ipfs
zbyte64 has joined #ipfs
Encrypt_ has quit [Quit: Quit]
wallacoloo_ has joined #ipfs
dominic__ has quit [Ping timeout: 252 seconds]
dominic__ has joined #ipfs
<lgierth>
they're required for being able to process the actual data
<lgierth>
encoding, format, hash
ylp has joined #ipfs
se3000 has joined #ipfs
cemerick has quit [Ping timeout: 258 seconds]
oed has quit [Ping timeout: 256 seconds]
gellenburg[m] has joined #ipfs
Mizzu has joined #ipfs
clownpriest has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
taaem has quit [Ping timeout: 246 seconds]
jholden has quit [Ping timeout: 258 seconds]
<kumavis>
of course
anonymuse has quit [Remote host closed the connection]
<kumavis>
but they can be on separate tables not competing for namespace
oed has joined #ipfs
<kumavis>
we're already spilling into the 2byte range
Mizzu has quit [Quit: WeeChat 1.6]
slothbag has joined #ipfs
PseudoNoob has quit [Remote host closed the connection]
tmg has joined #ipfs
<kumavis>
"hey can someone sell me on the multicodecs thing?" i should have said the *unified* multicodecs thing
oed has quit [Ping timeout: 260 seconds]
zbyte64 has quit [Read error: Connection reset by peer]
zbyte64 has joined #ipfs
<kumavis>
dignifiedquire haad: aegir is working for me now - thanks
<kumavis>
resolves to beta27
<kumavis>
now getting test failures (instead of outright failure) for js-libp2p-ipfs-browser
<kumavis>
will file an issue and take a look
ulrichard has quit [Remote host closed the connection]
zbyte64 has quit [Ping timeout: 250 seconds]
zbyte64 has joined #ipfs
robattila256 has quit [Ping timeout: 265 seconds]
saintromuald__ has quit [Ping timeout: 256 seconds]
saintromuald__ has joined #ipfs
mildred has joined #ipfs
wallacoloo_ has quit [Quit: wallacoloo_]
ianopolous has joined #ipfs
zbyte64 has quit [Read error: Connection reset by peer]
zbyte64 has joined #ipfs
zbyte64 has quit [Read error: Connection reset by peer]
zbyte64 has joined #ipfs
zbyte64 has quit [Read error: Connection reset by peer]
zbyte64_ has joined #ipfs
oed has joined #ipfs
zbyte64_ has quit [Read error: Connection reset by peer]
zbyte64 has joined #ipfs
zbyte64 has quit [Read error: Connection reset by peer]
zbyte64 has joined #ipfs
zbyte64 has quit [Read error: Connection reset by peer]
zbyte64 has joined #ipfs
captain_morgan has joined #ipfs
clownpriest has joined #ipfs
oed has quit [Ping timeout: 260 seconds]
zbyte64_ has joined #ipfs
domanic has joined #ipfs
dominic__ has quit [Read error: Connection reset by peer]
zbyte64 has quit [Ping timeout: 260 seconds]
espadrine has quit [Ping timeout: 260 seconds]
zbyte64_ has quit [Ping timeout: 256 seconds]
zbyte64 has joined #ipfs
oed has joined #ipfs
zbyte64 has quit [Read error: Connection reset by peer]
zbyte64 has joined #ipfs
ashark has quit [Ping timeout: 252 seconds]
chris613 has joined #ipfs
kaotisk has joined #ipfs
herzmeister has quit [Quit: Leaving]
palkeo has quit [Ping timeout: 244 seconds]
herzmeister has joined #ipfs
<kevina>
whyrusleeping: you around?
<whyrusleeping>
kevina: I am! was just looking through your go-datastore stuff
<whyrusleeping>
looking pretty encouraging so far
<kevina>
whyrusleeping: thanks
<kevina>
so you like how I handled it?
<whyrusleeping>
Yeah, the feeling i got initially was that youre aiming at entirely deprecating the channel stuff, but providing it as a legacy supported thing, yeah?
<kevina>
there is a lot of code to convert to avoid unnecessary channels
<whyrusleeping>
yeahhh
<kevina>
yep, that's right.
<whyrusleeping>
you don't have to get all of it right away either
<whyrusleeping>
we can always go back later and continue cleaning up
<kevina>
not all of it, but to get the performance gain, any wrapper datastores in the chain need to be converted
<kevina>
so I will focus on thos
<kevina>
those
<kevina>
I also found the last bottleneck in AllKeysChannel()
<kevina>
it is that converting a key from "/ABG56D" to "/blocks/ABG56D" only to convert it right back again to "/ABG56D".
<kevina>
Due to the use of the mount datastore.
oed has quit [Ping timeout: 260 seconds]
<whyrusleeping>
ooooh
<whyrusleeping>
yeah
<whyrusleeping>
i was thinking we should sidestep the mountdatastore thing
<whyrusleeping>
and just pass the children directly to the consumers
<kevina>
I agree, but I am worried about the impact on the the measure datastore
<kevina>
I am not sure what that code is doing, and how much of what it is measuring you need
<kevina>
you seam to have it wrapped twice, one around the blockstore and once around the entire datastore
<whyrusleeping>
hrmmmm
<whyrusleeping>
Kubuxu: and lgierth have better insight into that
<kevina>
by optimizing the how the conversion I was able to improve the performance somewhat
<kevina>
whyrusleeping: there is lot on unnecessary strings being created
<whyrusleeping>
kevina: i know, its pretty bad
<kevina>
I will create a pull request for that first
<kevina>
making use of RawKey when it is safe
<kevina>
and also optimizing the datastore Key methods
<kevina>
reduces the overhead of the mount datastore significantly
oed has joined #ipfs
rgrinberg has joined #ipfs
rgrinberg has left #ipfs [#ipfs]
rgrinberg has joined #ipfs
<kevina>
whyrusleeping: one more thing, the overhead of a channel with a significantly large buffer is not that large
<kevina>
whyrusleeping: and removing channels in some cases can lead to an decrease in performance
<kumavis>
@dignifiedquire have a q if you are around
<kevina>
due to the decreased parallelism ...
<kumavis>
about pull-length-prefixed
zbyte64_ has joined #ipfs
<whyrusleeping>
kevina: record places where we lose out on performance by moving away from channels
<whyrusleeping>
we can make sure to go back and address that later
zbyte64__ has joined #ipfs
zbyte64 has quit [Ping timeout: 260 seconds]
zbyte64_ has quit [Ping timeout: 260 seconds]
zbyte64__ has quit [Remote host closed the connection]
zbyte64 has joined #ipfs
<kevina>
okay, I am first going to separate out some improvements that can be done before the elimination of channels
<kevina>
than comes the p.r. to remove channels
<kevina>
whyrusleeping: this way we can have a handle on what is going on