lgierth changed the topic of #ipfs to: go-ipfs 0.4.4 has been released with an important pinning hotfix, get it at https://dist.ipfs.io | IPFS, the InterPlanetary FileSystem: https://github.com/ipfs/ipfs | FAQ: https://git.io/voEh8 | Logs: https://botbot.me/freenode/ipfs/ | Code of Conduct: https://git.io/vVBS0 | Sprints: https://git.io/voEAh
<kevina> whyrusleeping: anything else, trying to figure out the barriers to getting this merged.
chax has joined #ipfs
<kevina> it's the last major required change. Once that merged we can start to focus on the actual filestore code
<whyrusleeping> yeah, i'm going through and reviewing
<kevina> thanks.
chax has quit [Remote host closed the connection]
chax has joined #ipfs
chax has quit [Ping timeout: 260 seconds]
<Mateon1> I'm wondering, should I create an issue in ipfs/notes (or a libp2p repo) about creating a Wireshark protocol dissector? I believe we should have one (or multiple) when IPFS is production ready.
<lgierth> Mateon1: definitely!
<lgierth> there's --disable-transport-encryption so we can actually do a lot there
<lgierth> you'd need dissectors for multiple layers of multistream, for the different stream muxers, for the actual swarm protocols (bitswap, identify, ping)
<Mateon1> I'm currently looking through the specs and tring to wrap my head around how everything actually works
<lgierth> i think multistream would be the one to start with, that's the outermost layer
<lgierth> the secio or tls, then multistream again, then the stream muxer, then multistream again, then the swarm protocols
ianopolous has quit [Remote host closed the connection]
<whyrusleeping> kevina: finished my review
<whyrusleeping> not really convinced on things yet, still thinking
<kevina> so lets talk about "This really complicates things..." with --allow-dup option.
<kevina> Please see my original proposal: https://github.com/ipfs/go-ipfs/issues/3119
<kevina> I don't see how having blocks in more than one place complicates things
<kevina> whyrusleeping: ^
<kevina> whyrusleeping: and in come cases it is difficult to avoid
<kevina> what should happen if a user adds a block in the filestore that is already in the "cache"?
<kevina> remove it from the cache (i.e the normal blockstore)
<kevina> don't add it to the filestore, but in this case what if the block then gets GCed...
<whyrusleeping> Yeah, thats complicated
<whyrusleeping> and i'm nervous about merging complicated things into the primary codepath
<kevina> whyrusleeping: when there is only one blockstore nothing changes
<kevina> whyrusleeping: these extra options have no effect
<whyrusleeping> hrm....
<kevina> whyrusleeping: did you read https://github.com/ipfs/go-ipfs/issues/3119?
<whyrusleeping> so, i think i would feel better, at least for now, if we only skipped putting to the main blockstore if the main blockstore already has the block
lacour has quit [Ping timeout: 244 seconds]
<whyrusleeping> that way we avoid the concern in my comment on the Put method
<kevina> i'm confused ????
<whyrusleeping> so, if the filestore has block QmABC
<whyrusleeping> and i add a file (normally) that contains QmABC
<whyrusleeping> it will put a block into the normal blockstore
<whyrusleeping> and not skip adding that block because the filestore has a reference
<kevina> I _think_ I can do that.
<kevina> The problem is that the exchange will try to add the block _again_ before it publishes.
<kevina> Thus when adding files to the filestore they will _also_ end up the the main blockstore.
<whyrusleeping> hrm...
<whyrusleeping> kevina: can we have a PR first that does the extraction of the locking logic from the blockstore?
<kevina> whyrusleeping: sure
<apiarian> shower thought: can findprovs be used as a proxy for the relative popularity of an object?
<kevina> whyrusleeping: sorry for nagging, but did you read https://github.com/ipfs/go-ipfs/issues/3119? Reading that will help understand my intentions in #3257.
<whyrusleeping> Yes
<whyrusleeping> apiarian: yeah, it could be
fleeky__ has joined #ipfs
Kane` has joined #ipfs
fleeky_ has quit [Ping timeout: 250 seconds]
ianopolous has joined #ipfs
haileris has joined #ipfs
subtraktion has quit [Remote host closed the connection]
<haileris> can someone help with port binding restriction?
gmcquillan__ has quit [Ping timeout: 244 seconds]
<kevina> whyrusleeping: BTW how do you deal with working P.R. at once
<kevina> completely separate trees or do you just switch branches back and forth?
<whyrusleeping> I switch branches
<whyrusleeping> and either stash things, or do "WIP" commits
<kevina> that mostly works for me, except when I want test to run while I work in something else
<whyrusleeping> oh, then i use a different computer :P
<kevina> how many do you have exactly?
<whyrusleeping> i normally switch between laptop and desktop while at home
<achin> you can never have too many computers
<whyrusleeping> depending on where i feel like sitting
<whyrusleeping> but i have a server, and two other machines on the network
<whyrusleeping> and a few rpis
<haileris> @whyrusleeping can you help a little please?
<achin> what do you use your rpis for? mine are just collecteing dust
<whyrusleeping> haileris: whats the issue?
<whyrusleeping> achin: testing ipfs, mostly
<haileris> I'm still playing with OnionCat
<achin> whyrusleeping: so just cheapo computers
<haileris> I have an OpnionCat only node that binds only to the IPv6
<whyrusleeping> achin: yeah, its testing ipfs on constrained environments
<whyrusleeping> and low memory
<whyrusleeping> haileris: alright
<haileris> but its id shows the public IPv4
<achin> cool
<haileris> how can I prevent that?
<whyrusleeping> haileris: uhm... explicitly set the swarm listener address in your config maybe?
<haileris> yes, did that
<whyrusleeping> and where are you seeing your public ip4?
<haileris> in a connected peer
<haileris> ipfs id QmVPds4PeZRDF7VdcDR335scnHhtzFzfqAxw6hNQvLgTpg
<whyrusleeping> ah, htm
<haileris> shows the IPv4
<whyrusleeping> try deleting your .ipfs dir and re-initing
<whyrusleeping> then change the swarm addr before starting the daemon
<whyrusleeping> it might be the case that the dht remembers your ipv4
<haileris> but local ipfs id just shows "/ip4/127.0.0.1/tcp/4001/ipfs/QmVPds4PeZRDF7VdcDR335scnHhtzFzfqAxw6hNQvLgTpg",
<haileris> "/ip6/fd87:d87e:eb43:cafe:a090:c13d:adb2:bf86/tcp/4001/ipfs/QmVPds4PeZRDF7VdcDR335scnHhtzFzfq
<haileris> OK, I'll try that
<haileris> and yes, I was binding 0.0.0.0 and :: when I first used the node
<haileris> also, BTW, Tor seems to be treating me as DDos :(
<whyrusleeping> Yeah, the dht is very good at remembering people
<haileris> somewhere the default OnionCat port is blocked for my first node :(
<haileris> but a random port works
<haileris> I didn't know that the Tor network could block ports on onion services
<whyrusleeping> weird...
<whyrusleeping> Tor has all sorts of weird stuff in it
chriscool has joined #ipfs
<whyrusleeping> make sure to run the daemon with --routing=dhtclient
<haileris> yes, it does, and some they don't talk in public about ;)
<whyrusleeping> otherwise youre going to be destroying the networks bandwidth
kulelu88 has quit [Quit: Leaving]
<haileris> my first node has ~250 peers, ~0.7 Mbps rx and ~0.6 Mbps tx
<haileris> is that OK?
dignifiedquire has quit [Quit: Connection closed for inactivity]
<whyrusleeping> seems okay
captain_morgan has joined #ipfs
<haileris> OK for ipfs, that's good ... but a fuckload of onion-onion traffic ;)
<haileris> good chaff, right?
<whyrusleeping> Yeah
<whyrusleeping> we're working on improving the bandwidth scenario
<haileris> :)
<haileris> my goal: nodes with only OnionCat IPv6, which can reach the main swarm through a node with both OnionCat IPv6 and public IPv4
<haileris> I've verified that works
<haileris> I even found another OnionCat IPv6 node :)
<haileris> but for that to work, does the hybrid OnionCat IPv6 /public IPv4 node need to be fully routed?
<whyrusleeping> kevina: heres what i'm thinking for blockstore swappability: https://github.com/ipfs/go-ipfs/compare/feat/blockstore-option?expand=1
<haileris> or could they both use dhtclient?
<whyrusleeping> haileris: i really don't know. These are things i havent experimented with at all
<kevina> whyrusleeping: that the easy part :) But it helps.
<kevina> whyrusleeping: the hard part is I didn't really design it to be swappable.
<kevina> whyrusleeping: I just need to think it through
<kevina> whyrusleeping: I say a few days when I am not 100% sure of the work involved :)
<kevina> whyrusleeping: but I will work on it
<haileris> @whyrusleeping OK I'll test and get back to you
<whyrusleeping> kevina: it should be pretty easy to drop your multiblockstore into that
<kevina> whyrusleeping: yes, see my comments above
<haileris> @whyrusleeping and BTW, your solution to the binding issue worked :)
<whyrusleeping> haileris: ah, sweet :)
<haileris> yes :) ipfs id QmcnSFQwSmGfUvWujiZ7UjPTw9fDqz5UFz9Td1abNTQUmr now shows just /ip4/127.0.0.1/... and /ip6/fd87:d87e:eb43:cafe:a090:c13d:adb2:bf86/...
<haileris> so an ipfs branch in onionland seems doable
<kevina> GCLocker code factored out: https://github.com/ipfs/go-ipfs/pull/3348
<kevina> whyrusleeping: ^
matoro has joined #ipfs
sdiver has quit [Ping timeout: 250 seconds]
The_8472 has quit [Ping timeout: 256 seconds]
The_8472 has joined #ipfs
arpu has quit [Ping timeout: 260 seconds]
gmcquillan__ has joined #ipfs
grinbergr has quit [Remote host closed the connection]
rgrinberg has joined #ipfs
rgrinberg has quit [Remote host closed the connection]
sdiver has joined #ipfs
<haileris> @whyrusleeping - My "hybrid" node in --routing=dhtclient mode still bridges my OnionCat-only node to the swarm :)
<whyrusleeping> haileris: noice
<haileris> So how much less throughput should I expect?
<whyrusleeping> with what?
<whyrusleeping> in the future?
arpu has joined #ipfs
<haileris> @whyrusleeping with dhtclient vs full routing
<whyrusleeping> oh, quite a bit less
<haileris> :) ... I'll let you know
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
<whyrusleeping> kevina: alright, merged that
<kevina> okay, give me a day and I will 1) rebase the multifilestore code and 2) make it swappable for you
<whyrusleeping> kevina: mmmkay, i'm gonna do this one: https://github.com/ipfs/go-ipfs/pull/3349
<kevina> whyrusleeping: I am not 100% sure how I will use that, so hold off on merging it into master. I will try to use it and if I do base my comits on that P.R.
<Mateon1> Okay, this time I did switch the branches, but the fix for Windows drive paths didn't work.
<whyrusleeping> kevina: you will want to implement a SetupFilestoreOption
<whyrusleeping> that will override the SetupBlockstore default
<whyrusleeping> and use the multiblockstore
<kevina> okay thanks for the tips, I am not really 100% now, so I will look at this tomorrow
<kevina> whyrusleeping: okay with holding off?
<whyrusleeping> yeah, i'll wait
<kevina> thanks
ygrek has quit [Ping timeout: 260 seconds]
gmcquillan__ has quit [Quit: gmcquillan__]
xrogaan has quit [Ping timeout: 260 seconds]
pinbot has quit [Ping timeout: 260 seconds]
alanz has quit [Ping timeout: 260 seconds]
pinbot has joined #ipfs
herzmeister has quit [Quit: Leaving]
<haileris> @whyrusleeping - belatedly, thanks very much for your help :)
xming_ has quit [Quit: No Ping reply in 180 seconds.]
herzmeister has joined #ipfs
xming has joined #ipfs
captain_morgan has quit [Ping timeout: 260 seconds]
alanz has joined #ipfs
gmcquillan__ has joined #ipfs
xrogaan has joined #ipfs
gmcquillan__ has quit [Quit: gmcquillan__]
captain_morgan has joined #ipfs
chris613 has quit [Quit: Leaving.]
sdiver has quit [Quit: WeeChat 1.6]
haileris has quit [Quit: WeeChat 1.0.1]
captain_morgan has quit [Ping timeout: 265 seconds]
sdiver has joined #ipfs
geemili has quit [Ping timeout: 268 seconds]
chriscool has quit [Ping timeout: 265 seconds]
<kevina> whyrusleeping: you still around?
<whyrusleeping> kevina: not for much heavy thinking
<whyrusleeping> but i can say hi
* whyrusleeping has a bit of a headache
<kevina> whyrusleeping: well maybe this can wait, but as I thought https://github.com/ipfs/go-ipfs/pull/3349 was the easy part
<whyrusleeping> yeah?
<kevina> whyrusleeping: basically the hard part is all the places in the code they rely on the MultiBlockstore interface
<kevina> The GC in particular requires knowledge of the MultiBlockstore
<whyrusleeping> why?
<kevina> It needs to only remove from FirstMount()
<whyrusleeping> why?
<kevina> GC on the filestore doesn't make sense
<whyrusleeping> doesnt it?
<kevina> Objects in the filestore are not pinned
<whyrusleeping> wait, what?
<A124> On other stores it does though
<whyrusleeping> ^ also that
<whyrusleeping> objects in the filestore should definitely be pinned
<kevina> no
<whyrusleeping> uhhhh
<whyrusleeping> yes.
<kevina> then we have a problem
<kevina> whyrusleeping: I outlined this in https://github.com/ipfs/go-ipfs/issues/3119
<kevina> whyrusleeping: since you have a headache and its late for me we will have to come back to this
<kevina> I originally pinned them, but then realized that I didn't make sense
<whyrusleeping> kevina: you don't talk about not pinning filestore objects in that issue
<whyrusleeping> we cant treat filestore objects specially in all these different ways
<alu> whyrusleeping how long u staying in germany for
<whyrusleeping> the only thing the filestore should change is how its stored on disk
<whyrusleeping> alu: post CCC? not sure... anywhere from two weeks to a month or more
<alu> damn!
<alu> thats pretty baller
<kevina> we have a serious problem them
<whyrusleeping> i need to be back by february, i think i have to move out
<whyrusleeping> kevina: i don't think so, this should simplify a lot of things
<kevina> not really
<alu> really looking forward to an interesting c3 this year especially after all of the work wikileaks is doing :)
<whyrusleeping> kevina: it sure simplifies the multiblockstore stuff
<whyrusleeping> makes it a much less leaky abstraction
dmr has joined #ipfs
pfrazee has quit [Remote host closed the connection]
pfrazee has joined #ipfs
txthinking has joined #ipfs
wallacoloo_ has joined #ipfs
txthinking has quit [Ping timeout: 260 seconds]
pfrazee has quit [Remote host closed the connection]
pfrazee has joined #ipfs
lkcl has quit [Ping timeout: 250 seconds]
Oatmeal has quit [Ping timeout: 260 seconds]
O47m341 has joined #ipfs
pfrazee has quit [Remote host closed the connection]
robattila256 has quit [Ping timeout: 250 seconds]
Aranjedeath has quit [Quit: Three sheets to the wind]
ygrek has joined #ipfs
<whyrusleeping> !botsnack
<pinbot> om nom nom
captain_morgan has joined #ipfs
polezaivsani has joined #ipfs
<polezaivsani> early fresh good morning!
<whyrusleeping> polezaivsani: mornin!
<whyrusleeping> or rather, "good rainy midnight"
<polezaivsani> oh man you still up?!
* whyrusleeping checks his username
<polezaivsani> wanted to ask if takcling peeradds into a db of their own is a worthy shot - does sound like that to me after some profiling
<whyrusleeping> yes
<whyrusleeping> we've been wanting to back the 'peerstore' with a db for a while
<polezaivsani> good, will get myself busy then
<whyrusleeping> assuming that by 'peeradds' you mean the peer addresses and stuff, right?
ulrichard has joined #ipfs
<polezaivsani> yep, prob have the names mixed this early
<polezaivsani> also noticed - the hdrhistograms eat up a hefty 30mb of heap; probably could do their task with less
dignifiedquire has joined #ipfs
<polezaivsani> or not worth the trouble?
<whyrusleeping> polezaivsani: yeah.....
<whyrusleeping> kumavis: was going to be taking a look at that
<whyrusleeping> er
<whyrusleeping> Kubuxu: not kumavis
<Kubuxu> yeah, I have to finally replace the metrics lib in datastore
wallacoloo_ has quit [Quit: wallacoloo_]
DokterBob has joined #ipfs
ygrek has quit [Ping timeout: 250 seconds]
corvinux has joined #ipfs
mildred has joined #ipfs
kobigurk has joined #ipfs
corvinux has quit [Ping timeout: 250 seconds]
<dignifiedquire> daviddias: woot
<dignifiedquire> it has begun
<daviddias> :D
<daviddias> good morning!
<dignifiedquire> also you are up pretty early
<dignifiedquire> I was like waking up to the merge storm :D
<daviddias> I like to rise up early, somedays is just impossible though
<daviddias> let's make the morning worth it
<dignifiedquire> :)
<daviddias> and put a big checkmark in all of the PRs
<dignifiedquire> just DO IT
<daviddias> btw, I get a lot of ugly gyp logs when npm installing
<daviddias> all the tests pass
<daviddias> nothing breaks
<daviddias> but these logs saying that something is weird are scary
<dignifiedquire> yeah that's the webcrypro for node stuff :(
<dignifiedquire> node-gyp has a very verbose logging
<daviddias> did you had time to check if people are actively making that go away?
<dignifiedquire> probably not there is a bug open on npm to fix this for yeard
<daviddias> I mean, if there are logs from node-gyp
<daviddias> is because something is not 100%
<dignifiedquire> oh you mean the individual warnings, no haven't checked, code compiles and runs so I am happy :D
mildred1 has joined #ipfs
<dignifiedquire> can you open an issue on libp2p-crypto for me?
<dignifiedquire> will investigate when the storm is over
DokterBob has quit [Quit: DokterBob]
<daviddias> sure
<daviddias> greenkeeper should have a feature for "just be quiet for the day"
ylp has joined #ipfs
<daviddias> for our merge and release days
<dignifiedquire> was thinking the exact same thing
<dignifiedquire> when I looked at my gh feed
mildred has quit [Ping timeout: 260 seconds]
corvinux has joined #ipfs
<dignifiedquire> oh boy, sooo many usages of .key in bitswap
DokterBob has joined #ipfs
<dignifiedquire> alright going for my morning run :) and then full steam ahead
<daviddias> dignifiedquire: nice! enjoy :)
maxlath has joined #ipfs
<dignifiedquire> no rest for the wicked;)
Kane` has quit [Remote host closed the connection]
maxlath has quit [Ping timeout: 244 seconds]
lkcl has joined #ipfs
cemerick has joined #ipfs
maxlath has joined #ipfs
maxlath has quit [Quit: maxlath]
ianopolous_ has joined #ipfs
<dignifiedquire> I am back
<dignifiedquire> daviddias: all good so far in the merge storm?
<daviddias> 👌
<daviddias> all good :)
<daviddias> btw, wanna review this one now? https://github.com/multiformats/js-multistream-select/pull/26
<daviddias> this way I can make it part of this cycle
<dignifiedquire> sure
<dignifiedquire> that's a pretty big pr for a seemlingly simple feature
ianopolous has quit [Ping timeout: 250 seconds]
<daviddias> you would think :P
<daviddias> the last 3 commits are the feature
<daviddias> the first 3 is docs plus making the handling of the logger nicer
<daviddias> instead of requiring debug everywhere and passing a threadId
<daviddias> I just passed the logger with that Id set up all the way down
<daviddias> it helps making sure the logs are consistent
ylp has quit [Read error: No route to host]
ylp has joined #ipfs
<dignifiedquire> I like the logging
<dignifiedquire> left you some comments :)
bastianilso__ has joined #ipfs
bastianilso__ has quit [Remote host closed the connection]
<daviddias> thank you :) applied your CR
<polezaivsani> hey daviddias! can you tell what 'record abstraction' is being mentioned in https://github.com/libp2p/go-libp2p/issues/90 ?
<daviddias> hmm
<daviddias> So, the Record abstraction comes from IPRS
<daviddias> a record is a value, identifieable by the public key used for its signature
frmendes has joined #ipfs
<daviddias> that can be stored in any record store
<daviddias> do we need the peer info objects to be signed though?
<polezaivsani> don't think so, but i'm new around here
<daviddias> polezaivsani: it might make sense to pay always the cost of signing
<daviddias> so that we have the validity working
<daviddias> I would imagine that peer info objects that get flushed should have some kind of validity (like a timestamp or even a subnetwork)
<daviddias> which you can reuse from IPRS
<daviddias> otherwise you will be implementing it again
<dignifiedquire> daviddias: made some good progress on bitswap only one failing test left
<daviddias> woot! :)
<daviddias> good to hear!
lindybrits has joined #ipfs
maxlath has joined #ipfs
<Kubuxu> daviddias: I think we want to move to signing most record store objects once we move to ed25519
<Kubuxu> both signing and verifying is quite expensive in case of RSA, and you have to fetch not a small key
<daviddias> word
espadrine has joined #ipfs
PseudoNoob has joined #ipfs
DiCE1904 has quit [Ping timeout: 260 seconds]
<dignifiedquire> daviddias: I'm adding cacching to ipfs-block right now, so delay the merge on that until I pushed it please
<daviddias> thank you for warning
arpu has quit [Remote host closed the connection]
DiCE1904 has joined #ipfs
maxlath has quit [Remote host closed the connection]
maxlath has joined #ipfs
lkcl has quit [Ping timeout: 252 seconds]
lkcl has joined #ipfs
frmendes has quit [Quit: cya...]
<lemmi> i'm a little lost: how do i access the functionality of ipfs files directly from go?
sametsisartenep has joined #ipfs
chriscool has joined #ipfs
frmendes has joined #ipfs
lkcl has quit [Ping timeout: 252 seconds]
maxlath has quit [Ping timeout: 260 seconds]
geemili has joined #ipfs
lkcl has joined #ipfs
<dignifiedquire> daviddias: only one test failing in "npm run test:node:core"
<daviddias> drumroll
<daviddias> which is?
<dignifiedquire> it's a 'PeerInfo'
<dignifiedquire> was that renamed?
<daviddias> apparently
<dignifiedquire> yep :D
<dignifiedquire> did it myself
<daviddias> xD
<dignifiedquire> thank you git blame
cemerick has quit [Ping timeout: 268 seconds]
lkcl has quit [Ping timeout: 265 seconds]
<daviddias> Is there anything that might have changed on aegir that changes the behaviour how it picks the custom gulpfile?
<daviddias> https://github.com/ipfs/js-libp2p-ipfs-browser/pull/99 is failing on tests that pass in node, but no in the browser
<daviddias> and it is all about dialing the node that gets fired on the gulpfile
rgrinberg has joined #ipfs
<dignifiedquire> hmm
<dignifiedquire> no there shouldn't be any changes to that
<dignifiedquire> are you spawning different things for the browser vs node?
cemerick has joined #ipfs
<daviddias> nope
<daviddias> same code
<dignifiedquire> hmm
frmendes has quit [Quit: Zzzz...]
<dignifiedquire> test:node:http is passing :)
<daviddias> that means that interface-ipfs-core is complete as well, right?
<dignifiedquire> for node yes, still need to make sure it works in the browser
<dignifiedquire> but getting pretty close overall
<dignifiedquire> did you figure out the issue with ipfs-browser?
<daviddias> interface-ipfs-core should not distinguish between node and browser, not sure of what you are refering to
<daviddias> re: libp2p-ipfs-browser - not yet
<dignifiedquire> that's the thing with loading assets in the browser I mentioned, remember?
<daviddias> right!
<A124> Hey. Can I jump in with two questions?
<A124> All merkle constructs (apart from the leaves), unless put raw, are sort.Stable(), is that correct?
<A124> And if I write any code, for which platform I should optimize? Can one presume 64bit architectures nowadays?
<dignifiedquire> not sure about the first one, the second one I would say it depends on the software and your target audience
<A124> Well, related or part of ipfs.
<dignifiedquire> then unless you expect the software to run on microcontrollers it's pretty safe to optimize for 64bit
<dignifiedquire> (I think)
<A124> Alright, thank you. Wanted to confirm if we are on the same note.
<dignifiedquire> daviddias: so many checkmarks <3
<daviddias> ahah :D
<daviddias> I would like really appreciate if github would let me use [ ] to spawn a mouse clickable checkmark
<daviddias> dignifiedquire: is this aegir/fixtures supposed to be a thing? https://travis-ci.org/ipfs/js-ipfs-unixfs/jobs/172599183
<dignifiedquire> :D
<dignifiedquire> daviddias: yes but not yet released
<dignifiedquire> just skip those that need it for now
polezaivsani has quit [Ping timeout: 268 seconds]
<daviddias> ah
<dignifiedquire> that's the thing I have to make sure works for js-ipfs and js-ipfs-api first before I can release it
<daviddias> the file
<daviddias> so
<daviddias> but like, all of unixfs needs it
Kane` has joined #ipfs
<dignifiedquire> yes
<daviddias> this sounds like a priority
<dignifiedquire> it is
<dignifiedquire> and I'm working on it
<daviddias> because otherwise we can't release js-ipfs-api
polezaivsani has joined #ipfs
<daviddias> and right now, if we don't change the ^ to ~, it will break on install
<dignifiedquire> aaaaahhhhh semver
<dignifiedquire> we really should have > 1.0 for all these modules
<dignifiedquire> I expect to have it working today
<daviddias> I was actually thinking that probably the best practice should be ~ before 1.0.0 and then ^ after 1.0.0
<daviddias> awesome, thank you :)
<dignifiedquire> yeah
<dignifiedquire> looks like all of test:node:cli is passing as well now :)
<daviddias> sweet! :D
<dignifiedquire> so onto the browser tests
<dignifiedquire> so close :)
<dignifiedquire> daviddias: what about the shareness tests, how do I run them, should they be passing?
<daviddias> make test
<daviddias> at the root of js-ipfs
<dignifiedquire> k
<dignifiedquire> and they are supposed to be passing?
<daviddias> dignifiedquire: the ones that are on master, yes
<dignifiedquire> okay 👍+
maxlath has joined #ipfs
frmendes has joined #ipfs
frmendes has quit [Quit: cya...]
frmendes has joined #ipfs
bernini has joined #ipfs
grosscol has joined #ipfs
kobigurk has quit [Ping timeout: 245 seconds]
ivanminutillo has joined #ipfs
cemerick has quit [Ping timeout: 260 seconds]
bernini has quit []
shizy has joined #ipfs
G-Ray has joined #ipfs
lkcl has joined #ipfs
lindybrits has quit [Quit: Page closed]
jholden has joined #ipfs
<dignifiedquire> daviddias: made good progress most of js-ipfs browser tests are passing
<daviddias> rad!
shizy has quit [Quit: WeeChat 1.6]
shizy has joined #ipfs
shizy has quit [Quit: WeeChat 1.6]
shizy has joined #ipfs
Boomerang has joined #ipfs
jedahan has joined #ipfs
jedahan_ has quit [Ping timeout: 260 seconds]
<dignifiedquire> daviddias: how is the relase circus coming along?
<daviddias> now just waiting on those fixtures
<daviddias> to continue :)
<daviddias> looking forward to be able to release js-ipfs-api
gmcquillan__ has joined #ipfs
<dignifiedquire> aren't we all
<dignifiedquire> woot, js-ipfs browser tests just passed
<dignifiedquire> daviddias: this is confusing:
<dignifiedquire> when running make test
<dignifiedquire> so that's okay
<dignifiedquire> ?
<daviddias> looks like it
<daviddias> need to review all of that sharness again + the PRs
<dignifiedquire> ok
gozala has quit [Ping timeout: 245 seconds]
<dignifiedquire> daviddias: js-ipfs is ready, you can start reviewing it
kitcambridge has quit [Ping timeout: 250 seconds]
<daviddias> dignifiedquire: is https://github.com/dignifiedquire/aegir/pull/66 ready?
gozala has joined #ipfs
<dignifiedquire> just testing it in js-ipfs-api
<dignifiedquire> but I think so, just need to squash and release
<dignifiedquire> yep works
<dignifiedquire> making the aegir release for you
<dignifiedquire> daviddias: 9.1 released
corvinux has quit [Remote host closed the connection]
kitcambridge has joined #ipfs
robattila256 has joined #ipfs
<daviddias> all right :)
ylp has quit [Ping timeout: 265 seconds]
shizy has quit [Quit: WeeChat 1.6]
ljhms has quit [Quit: Bye]
shizy has joined #ipfs
ljhms has joined #ipfs
ylp has joined #ipfs
lkcl has quit [Ping timeout: 268 seconds]
reit has quit [Ping timeout: 256 seconds]
rendar has joined #ipfs
<daviddias> dignifiedquire: there might be something missing in interface-ipfs-core that you didn't get to push
<dignifiedquire> daviddias: well does the file exist?
<dignifiedquire> and from where do you get this error?
<daviddias> oh, I know .npmigore
<lgierth> the js-* issues noise is strong today
<lgierth> :P
<dignifiedquire> lgierth: we are finally shipping all them things
<dignifiedquire> though shall be happy for us
<lgierth> i am!
maxlath has quit [Quit: maxlath]
dmr has quit [Quit: Leaving]
ulrichard has quit [Remote host closed the connection]
ylp has quit [Quit: Leaving.]
jedahan has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
reit has joined #ipfs
Aeon has quit [Ping timeout: 260 seconds]
lkcl has joined #ipfs
jholden has quit [Ping timeout: 260 seconds]
frmendes has quit [Ping timeout: 260 seconds]
taaem has quit [Read error: Connection reset by peer]
taaem has joined #ipfs
maxlath has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
<lgierth> Kubuxu: mute pls
gmcquillan__ has quit [Ping timeout: 268 seconds]
<daviddias> dignifiedquire: with the fixtures feature
<daviddias> now webpack is trying to load our test files in js-ipfs-api
<daviddias> which are .js files
<daviddias> and throwing out errors because there are some relative deps it cant resolve
<daviddias> lol
<dignifiedquire> lol
<dignifiedquire> well just don't use js files as fixtures ::P
<dignifiedquire> interesting though, I'm not seeing that error
<daviddias> ok, fixed that
<daviddias> now noticing that "wait until the build gets finished" gets printed a ton of times
<daviddias> before running karma tests
gmcquillan__ has joined #ipfs
espadrine has quit [Ping timeout: 250 seconds]
ulrichard has joined #ipfs
jedahan has joined #ipfs
jedahan has joined #ipfs
<daviddias> dignifiedquire: oh, I think that if we exhaust the number of open concorruent sessions
<daviddias> saucelabs just says 'non authorized'
matoro has quit [Ping timeout: 244 seconds]
Boomerang has quit [Ping timeout: 250 seconds]
Boomerang has joined #ipfs
ygrek has joined #ipfs
<dignifiedquire> daviddias: argh, ignore the "wait until the build finishes" logs
<dignifiedquire> they are debug messages and I forgot to disable them in aegir
aggelos_ has quit [Ping timeout: 256 seconds]
<dignifiedquire> so now they get printed everyhwere :'(
<daviddias> well, its ok, a patch version and they are gone
<dignifiedquire> yep
<dignifiedquire> sorry, didn't want to scare you ;)
<dignifiedquire> daviddias: I forgot to push sth https://github.com/ipfs/interface-ipfs-core/pull/84
espadrine has joined #ipfs
<dignifiedquire> also pushed my latest version for js-ipfs-api, which is close to working with that pr above
<daviddias> interface-ipfs-core 0.18.1 is out :)
jholden has joined #ipfs
<dignifiedquire> daviddias: going to head out now, can you please review the last three remaining prs js-ipfs, js-ipfs-api and bitswap so far? there are only minor bug fixes left so would be good to know if the code looks good to you
<dignifiedquire> if credentials are failing I probbably made a mistake when copy pasting, so either check yourself or create an issue for me on those repos
<dignifiedquire> daviddias: also THANK YOU for being an awesome release master
<daviddias> sounds good. Thank you for making this awesome PR mountain :D a lot of our users and contributors will be thrilled to use the stuff without webpack magic
<daviddias> :D
cemerick has joined #ipfs
maxlath has quit [Quit: maxlath]
ivanminutillo has quit [Ping timeout: 245 seconds]
<dignifiedquire> daviddias: look at them badges: https://github.com/libp2p/js-peer-id
pfrazee has joined #ipfs
<daviddias> the badgesss :D
<daviddias> dignifiedquire: yeah, I think that Saucelabs just says unauthorized when it is out of concorrent sessions to spend
<daviddias> and since greenkeeper fires 300 at the same time..
<dignifiedquire> no I had to redo the token
<dignifiedquire> probably pasted it wrong
<dignifiedquire> well that also
moimikey has joined #ipfs
moimikey has quit [Client Quit]
shizy has quit [Quit: WeeChat 1.6]
shizy has joined #ipfs
aggelos_ has joined #ipfs
gmcquillan__ is now known as gmcquilla
gmcquilla is now known as gmcquillan
Encrypt has joined #ipfs
chax has joined #ipfs
espadrine has quit [Ping timeout: 260 seconds]
shizy has quit [Quit: WeeChat 1.6]
shizy has joined #ipfs
Boomerang has quit [Ping timeout: 260 seconds]
chax has quit [Remote host closed the connection]
Boomerang has joined #ipfs
ivanminutillo has joined #ipfs
chax has joined #ipfs
chax has quit [Remote host closed the connection]
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
Boomerang has quit [Ping timeout: 250 seconds]
shizy has quit [Quit: WeeChat 1.6]
Encrypt has quit [Quit: Quit]
shizy has joined #ipfs
Boomerang has joined #ipfs
G-Ray has quit [Quit: Konversation terminated!]
maxlath has joined #ipfs
maxlath has quit [Client Quit]
jholden_ has joined #ipfs
wallacoloo_ has joined #ipfs
jholden has quit [Ping timeout: 265 seconds]
DiCE1904 has quit [Read error: Connection reset by peer]
ivanminutillo has quit [Ping timeout: 245 seconds]
DokterBob has quit [Quit: DokterBob]
rendar has quit [Ping timeout: 268 seconds]
j0hnsmith has joined #ipfs
Boomerang has quit [Ping timeout: 252 seconds]
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
sevcsik has quit [Ping timeout: 250 seconds]
rendar has joined #ipfs
rendar has quit [Excess Flood]
sevcsik has joined #ipfs
bastianilso__ has joined #ipfs
matoro has joined #ipfs
wak-work has quit [Ping timeout: 256 seconds]
ligi has joined #ipfs
ligi has joined #ipfs
ligi has quit [Changing host]
j0hnsmith has quit [Quit: j0hnsmith]
aggelos_ has quit [Ping timeout: 268 seconds]
captain_morgan has quit [Ping timeout: 252 seconds]
aggelos_ has joined #ipfs
rendar has joined #ipfs
Boomerang has joined #ipfs
galois_d_ has joined #ipfs
herzmeisterderw has joined #ipfs
galois_dmz has quit [Ping timeout: 260 seconds]
herzmeister has quit [Quit: Leaving]
galois_dmz has joined #ipfs
jholden_ has quit [Ping timeout: 250 seconds]
galois_d_ has quit [Ping timeout: 260 seconds]
chris613 has joined #ipfs
grosscol has quit [Quit: Leaving]
Boomerang has quit [Ping timeout: 260 seconds]
galois_dmz has quit [Remote host closed the connection]
galois_dmz has joined #ipfs
galois_dmz has quit [Read error: Connection reset by peer]
galois_d_ has joined #ipfs
polezaivsani has quit [Remote host closed the connection]
mildred1 has quit [Ping timeout: 244 seconds]
hoboprimate has joined #ipfs
hoboprimate has quit [Client Quit]
galois_d_ has quit [Read error: Connection reset by peer]
galois_dmz has joined #ipfs
hoboprimate has joined #ipfs
hoboprimate has quit [Client Quit]
wak-work has joined #ipfs
hoboprimate has joined #ipfs
Encrypt has joined #ipfs
maxlath has joined #ipfs
hoboprimate has quit [Quit: hoboprimate]
captain_morgan has joined #ipfs
hoboprimate has joined #ipfs
cemerick has quit [Ping timeout: 265 seconds]
captain_morgan has quit [Ping timeout: 260 seconds]
captain_morgan has joined #ipfs
hoboprimate has quit [Quit: hoboprimate]
ulrichard_ has joined #ipfs
Encrypt has quit [Quit: Quit]
lacour has joined #ipfs
DokterBob has joined #ipfs
jedahan has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
captain_morgan has quit [Ping timeout: 260 seconds]
hoboprimate has joined #ipfs
matoro has quit [Ping timeout: 250 seconds]
taaem has quit [Ping timeout: 244 seconds]
herzmeisterderw has quit [Quit: Leaving]
mh00 has joined #ipfs
palkeo has joined #ipfs
palkeo has joined #ipfs
palkeo has quit [Changing host]
kegsay_ has joined #ipfs
<whyrusleeping> daviddias: dignifiedquire: i would love to merge sharding...
<dignifiedquire> not only you
<dignifiedquire> cloning is running well so far
<dignifiedquire> 715G
kegsay has quit [Ping timeout: 256 seconds]
<dignifiedquire> 300k of 400kchanges processed
<whyrusleeping> and the repository its building looks correct?
<dignifiedquire> yes but haven't done any deeper analysis on it
<dignifiedquire> I can stop processing and run some tests tomorrow
<whyrusleeping> eh, thats fine
<whyrusleeping> think you could review the sharding code?
<dignifiedquire> I can read through it yes
<dignifiedquire> want to understand it anyway
<whyrusleeping> cool
<dignifiedquire> will go throught it tomorrow when async crypto is behind me
<whyrusleeping> the sooner we merge that, the sooner i can start the process of prepping an 0.4.5 release
<dignifiedquire> will try to have feedback for you before you wake up :)
Boomerang has joined #ipfs
<whyrusleeping> good :)
herzmeister has joined #ipfs
jedahan has joined #ipfs
jedahan has quit [Remote host closed the connection]
jedahan has joined #ipfs
wallacoloo_ has quit [Quit: wallacoloo_]
rendar has quit [Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!]
jedahan has quit [Remote host closed the connection]
jedahan has joined #ipfs
captain_morgan has joined #ipfs
<daviddias> whyrusleeping me too.. :)
galois_dmz has quit [Remote host closed the connection]
<daviddias> algorithm wise, I'm happy with it, was excellent that we found something researched along the lines of our intuition
galois_dmz has joined #ipfs
<daviddias> in terms of verifying the correctness of the implementation, nothing beats extensive tests and weird scenarios, will need a bit more time for that
<daviddias> what about users that are putting a lot of data to IPFS?
captain_morgan has quit [Ping timeout: 260 seconds]
<daviddias> seeding that branch to them and getting feedback might be a good way to validate it'
pfrazee has quit [Remote host closed the connection]
<whyrusleeping> i'm fairly confident that the code works, but i just want someone to verify that my code and the algorithm i intended to implement line up
bastianilso__ has quit [Quit: bastianilso__]
ulrichard has quit [Remote host closed the connection]
ulrichard_ has quit [Remote host closed the connection]
<daviddias> dignifiedquire: what is missing in js-ipfs-api right now?
<dignifiedquire> daviddias: make it work in the browser
<dignifiedquire> or more specific wreck is not correctly shimed atm when running in the browser
<lgierth> whyrusleeping: let me start that media.ccc.de mirror right now, if i'm lucky it'll be 100 MBps and i can start adding tomorrow
<lgierth> oh wait, that's not really applicable
<lgierth> it's huge files, but not tons of files
<daviddias> I see
<daviddias> you deactivated the browser tests, that is why they are green on travis :)
<dignifiedquire> no they were deactivated on master, I just haven't turn them on yet
<dignifiedquire> whyrusleeping: 291239 < current number of files in /npm-registry :D
<dignifiedquire> (folders
PseudoNoob has quit [Quit: Leaving]
<dignifiedquire> lgierth: that's what you should aim for ;)
<daviddias> dignifiedquire: what is the size of the IPFS Repo?
<dignifiedquire> 723G
<lgierth> and that's before gc eh?
<dignifiedquire> that's before flushing
<dignifiedquire> it's not pinned yet so please no gc :P
shizy has quit [Ping timeout: 260 seconds]
Pent has quit [Read error: Connection reset by peer]
palkeo has quit [Ping timeout: 252 seconds]
ljhms has quit [Ping timeout: 265 seconds]
maxlath has quit [Remote host closed the connection]
maxlath has joined #ipfs
ljhms has joined #ipfs
Aeon has joined #ipfs
DokterBob has quit [Quit: DokterBob]
captain_morgan has joined #ipfs
Anduck has quit [Ping timeout: 252 seconds]
Anduck has joined #ipfs
Qwazerty has quit [Ping timeout: 250 seconds]
Qwazerty has joined #ipfs
ralphtheninja has quit [Ping timeout: 260 seconds]
maxlath has quit [Quit: maxlath]
ralphtheninja has joined #ipfs