lgierth changed the topic of #ipfs to: Latest release: go-ipfs 0.4.4 at https://dist.ipfs.io, have fun! | IPFS, the InterPlanetary FileSystem: https://github.com/ipfs/ipfs | FAQ: https://git.io/voEh8 | Logs: https://botbot.me/freenode/ipfs/ | Code of Conduct: https://git.io/vVBS0 | Sprints: https://git.io/voEAh
<zignig_> substack: sounds cool, so you are squidging the whole world into ipfs ... ;)
Caterpillar has quit [Quit: You were not made to live as brutes, but to follow virtue and knowledge.]
<zignig_> lgierth: I wanted to chat with you about an ipfs aci server.
galois_d_ has joined #ipfs
zignig_ is now known as zignig
espadrine has quit [Ping timeout: 256 seconds]
slothbag has joined #ipfs
userydfkumydfjyt has quit [Ping timeout: 255 seconds]
<lgierth> i'm about to hop into bed
<lgierth> what's aci though?
<zignig> the rkt container, like a docker , but smaller and more awesome.
<lgierth> ah!
galois_dmz has quit [Ping timeout: 245 seconds]
<zignig> my test ipfs containers are only 5.0 Mb
<lgierth> i'd love to run content-addressed containers
<lgierth> ah you mean an aci container for go-ipfs
<zignig> correct.
anonymuse has quit [Remote host closed the connection]
<zignig> i'll get a pull request together, for the ipfs website (https://github.com/appc/spec/blob/master/spec/discovery.md)
<substack> zignig: QmXJ8KkgKyjRxTrEDvmZWZMNGq1dk3t97AVhF1Xeov3kB4
<substack> planet.osm divided into <=1M o5m.gz files
<substack> and I'm rerunning my scripts with --complete-ways to dupe the ways that span the borders
<zignig> ah , I have done a bit of osm stuff, sooo much data....
soloojos has quit [Ping timeout: 255 seconds]
<whyrusleeping> substack: the box i have pinning the stuff from before went down yesterday... power failure and i'm out of the country
ianopolous has joined #ipfs
<zignig> lgierth: any way, if you are heading to bed, go for it.
bojanlazic has quit []
<zignig> whyrusleeping: out of the country or offworld ?
<whyrusleeping> roughly the same i think
<zignig> hehe , indeed.
<zignig> whyrusleeping: how goes ipfs , still buzzing along ?
<whyrusleeping> pretty well yeah
<zignig> too much coding and not enough hours in the day ?
<whyrusleeping> working on a final few things to get 0.4.5 out the door
<whyrusleeping> then gonna work on not having so much time between releases
tmg has joined #ipfs
<substack> whyrusleeping: it's ok, I might have a new hash soon anyhow
<zignig> cool, what are the shiny new features , huh , huh ?
<lgierth> zignig: definitely ping me again with questions or so
<whyrusleeping> zignig: ipld, pubsub, basic keystore, new experimental stream muxer
<whyrusleeping> all sorts of fun things
<lgierth> whyrusleeping: go-ipfs operations guide table of contents: https://ipfs.io/ipfs/QmSEZtr2vz53P75JnZaVkUNLgSqw1P8DobG4j9y1Vb2xgA
<lgierth> should i make that the start of the PR for the document?
<whyrusleeping> mmm, sure
wallacoloo_____ has quit [Quit: wallacoloo_____]
<zignig> lgierth: will do, it will need website , make file changes and new signed files on dist.ipfs.io , so there is a lot of twiddling.
cyanobacteria has quit [Ping timeout: 240 seconds]
userydfkumydfjyt has joined #ipfs
<zignig> whyrusleeping: cool , looking forward to ipld. emtpy hash will change, but should add an order of magnitude of awesome.
<whyrusleeping> zignig: the empty hash won't even need to change :)
<whyrusleeping> anyways, i'm off to sleep
<lgierth> the empty hash of echo -n | ipfs add will be the same
* zignig needs to re-read the ipld spec again.
fleeky_ has joined #ipfs
<zignig> attaching meta data to stuff is FTW.
<lgierth> because the emptiness passed into ipfs add is wrapped in a unixfs data structure
userydfkumydfjyt has quit [Client Quit]
<lgierth> and unixfs doesn't change
<lgierth> the way to interact with ipld right now is ipld dag
fleeky has quit [Ping timeout: 240 seconds]
elh9 has quit [Ping timeout: 255 seconds]
wallacoloo_____ has joined #ipfs
Sophrosyne__ has joined #ipfs
Sophrosyne_ has quit [Remote host closed the connection]
mildred_ has quit [Remote host closed the connection]
bastianilso____ has quit [Quit: bastianilso____]
slothbag has quit [Quit: Leaving.]
guilherme has joined #ipfs
galois_d_ has quit [Remote host closed the connection]
galois_dmz has joined #ipfs
pcre has quit [Remote host closed the connection]
gully-foyle has quit [Quit: Leaving]
steefmin has quit [Ping timeout: 240 seconds]
steefmin has joined #ipfs
<wking> zignig: also relevant to containers over IPFS: https://github.com/ipfs/container-demos/pull/22
chris613 has joined #ipfs
<wking> that PR is pretty stale by now (nsinit got turned into an official project: https://github.com/opencontainers/runc), but using IPFS to distribute the image filesystem (instead of a packaged up version of that filesystem) is nice for sharing
<__uguu__> will ipfs ever get into debian?
anewuser has joined #ipfs
arkimedes has joined #ipfs
chris613 has quit [Quit: Leaving.]
tmg has quit [Ping timeout: 256 seconds]
vtomole has joined #ipfs
spilotro has joined #ipfs
wallacoloo_____ has quit [Quit: wallacoloo_____]
wallacoloo_____ has joined #ipfs
cyanobacteria has joined #ipfs
wallacoloo_____ has quit [Client Quit]
dignifiedquire has quit [Quit: Connection closed for inactivity]
ianopolous has quit [Remote host closed the connection]
tilgovi has joined #ipfs
cemerick has joined #ipfs
ea12 has joined #ipfs
guilherme has quit [Ping timeout: 245 seconds]
<zignig> wking: thanks.
ianopolous has joined #ipfs
arkimedes has quit [Ping timeout: 260 seconds]
ianopolous has quit [Ping timeout: 256 seconds]
anonymuse has joined #ipfs
guilherme has joined #ipfs
ygrek has quit [Ping timeout: 240 seconds]
arkimedes has joined #ipfs
anewuser_ has joined #ipfs
anewuser has quit [Read error: Connection reset by peer]
Nycatelos has quit [Ping timeout: 240 seconds]
Nyx has joined #ipfs
Nyx is now known as Guest44302
mguentner has quit [Quit: WeeChat 1.6]
smuggler has joined #ipfs
mguentner has joined #ipfs
wallacoloo_____ has joined #ipfs
tmg has joined #ipfs
anonymuse has quit [Remote host closed the connection]
anonymuse has joined #ipfs
anonymuse has quit [Ping timeout: 248 seconds]
mguentner2 has joined #ipfs
tmg has quit [Ping timeout: 245 seconds]
anewuser_ has quit [Ping timeout: 240 seconds]
mguentner has quit [Ping timeout: 245 seconds]
guilherme has quit [Ping timeout: 245 seconds]
infinity0 has quit [Remote host closed the connection]
ygrek has joined #ipfs
vtomole has quit [Ping timeout: 260 seconds]
JayCarpenter has joined #ipfs
infinity0 has joined #ipfs
JayCarpenter has quit [Client Quit]
ygrek has quit [Ping timeout: 240 seconds]
infinity0 has quit [Remote host closed the connection]
infinity0 has joined #ipfs
ygrek has joined #ipfs
ygrek has quit [Ping timeout: 248 seconds]
brand0 has quit [Remote host closed the connection]
brand0 has joined #ipfs
robattila256 has quit [Quit: WeeChat 1.6]
john1 has joined #ipfs
pfrazee has quit [Remote host closed the connection]
kode54 has quit [Ping timeout: 240 seconds]
kode54 has joined #ipfs
taaem has quit [Ping timeout: 248 seconds]
muvlon has quit [Ping timeout: 240 seconds]
tilgovi has quit [Quit: No Ping reply in 180 seconds.]
tilgovi has joined #ipfs
muvlon has joined #ipfs
taaem has joined #ipfs
Caterpillar has joined #ipfs
ulrichard has joined #ipfs
tilgovi has quit [Ping timeout: 256 seconds]
tilgovi has joined #ipfs
demyan[m] has left #ipfs ["User left"]
tilgovi has quit [Ping timeout: 245 seconds]
cemerick has quit [Ping timeout: 252 seconds]
Aranjedeath has quit [Quit: Three sheets to the wind]
structuralist has joined #ipfs
tilgovi has joined #ipfs
structur_ has joined #ipfs
ylp has joined #ipfs
structuralist has quit [Ping timeout: 252 seconds]
wallacoloo_____ has quit [Quit: wallacoloo_____]
dignifiedquire has joined #ipfs
mildred1 has joined #ipfs
taaem has quit [Ping timeout: 240 seconds]
tilgovi has quit [Ping timeout: 245 seconds]
arkimedes has quit [Ping timeout: 252 seconds]
tabrath has joined #ipfs
G-Ray_ has joined #ipfs
structur_ has quit [Remote host closed the connection]
rendar has joined #ipfs
<sneak> hi. anyone know of people keeping pypi/ubuntu mirrors current/active in ipfs?
mildred2 has joined #ipfs
ianopolous has joined #ipfs
infinity0 has quit [Remote host closed the connection]
elico has joined #ipfs
mildred1 has quit [Ping timeout: 256 seconds]
mildred has quit [Ping timeout: 252 seconds]
infinity0 has joined #ipfs
Oatmeal has quit [Quit: Suzie says, "TTFNs!"]
mildred1 has joined #ipfs
s_kunk has quit [Ping timeout: 245 seconds]
ianopolous has quit [Ping timeout: 240 seconds]
Oatmeal has joined #ipfs
maxlath has joined #ipfs
mildred has joined #ipfs
palkeo has quit [Quit: Konversation terminated!]
mildred1 has quit [Ping timeout: 256 seconds]
mildred has quit [Client Quit]
mildred has joined #ipfs
Kamilion has quit [*.net *.split]
tmg has joined #ipfs
kragniz has quit [*.net *.split]
ansuz has quit [*.net *.split]
fjl_ has quit [*.net *.split]
tcrypt has quit [*.net *.split]
slbb has quit [*.net *.split]
r0kk3rz has quit [*.net *.split]
vandemar has quit [*.net *.split]
captain_morgan has quit [*.net *.split]
eater has quit [*.net *.split]
Yatekii has quit [*.net *.split]
Tristitia has quit [*.net *.split]
corby has quit [*.net *.split]
jmelis has quit [*.net *.split]
caveat has quit [*.net *.split]
metaf5 has quit [*.net *.split]
javax has quit [*.net *.split]
drathir has quit [*.net *.split]
gozala has quit [*.net *.split]
frood has quit [*.net *.split]
Stskeeps has quit [*.net *.split]
ansuz has joined #ipfs
jmelis_ has joined #ipfs
javax has joined #ipfs
vandemar has joined #ipfs
vandemar has quit [Changing host]
vandemar has joined #ipfs
Stskeeps has joined #ipfs
Stskeeps has joined #ipfs
frood has joined #ipfs
drathir has joined #ipfs
fjl_ has joined #ipfs
gozala has joined #ipfs
corby has joined #ipfs
r0kk3rz has joined #ipfs
jmelis_ is now known as jmelis
caveat has joined #ipfs
captain_morgan has joined #ipfs
eater has joined #ipfs
Tristitia has joined #ipfs
slbb has joined #ipfs
kragniz has joined #ipfs
Yatekii has joined #ipfs
nausea has quit [*.net *.split]
rektide has quit [*.net *.split]
Igel has quit [*.net *.split]
zozs has quit [*.net *.split]
gmoro has quit [*.net *.split]
Edur has quit [*.net *.split]
amiller has quit [*.net *.split]
ofdm has quit [*.net *.split]
WindPower has quit [*.net *.split]
guybrush has quit [*.net *.split]
rektide has joined #ipfs
tcrypt has joined #ipfs
ofdm has joined #ipfs
zozs has joined #ipfs
silotis has quit [*.net *.split]
sprint-helper3 has quit [*.net *.split]
Ragnis has quit [*.net *.split]
AtnNn has quit [*.net *.split]
esph has quit [*.net *.split]
draynium has quit [*.net *.split]
neuthral has quit [*.net *.split]
Monokles has quit [*.net *.split]
brodo has quit [*.net *.split]
basilgohar has quit [*.net *.split]
rabbitface3 has quit [*.net *.split]
zignig has quit [*.net *.split]
barnacs_ has quit [*.net *.split]
victorbjelkholm has quit [*.net *.split]
alu has quit [*.net *.split]
haad has quit [*.net *.split]
_mak has quit [*.net *.split]
peterix has quit [*.net *.split]
joeyh has quit [*.net *.split]
ion has quit [*.net *.split]
Qwazerty has quit [*.net *.split]
pguth has quit [*.net *.split]
AtnNn has joined #ipfs
brodo has joined #ipfs
haad_ has joined #ipfs
sprint-helper has joined #ipfs
victorbjelkholm_ has joined #ipfs
basilgohar has joined #ipfs
neuthral has joined #ipfs
Igel has joined #ipfs
barnacs has joined #ipfs
joeyh has joined #ipfs
Monokles has joined #ipfs
alu has joined #ipfs
Ragnis has joined #ipfs
esph has joined #ipfs
gmoro has joined #ipfs
Guest5911 has joined #ipfs
rabbitface3 has joined #ipfs
Qwazerty has joined #ipfs
ion has joined #ipfs
_mak has joined #ipfs
peterix has joined #ipfs
draynium has joined #ipfs
drathir has quit [Client Quit]
drathir has joined #ipfs
guybrush has joined #ipfs
guybrush has joined #ipfs
prettymuchbryce has quit [Ping timeout: 259 seconds]
silotis has joined #ipfs
john2 has joined #ipfs
zignig has joined #ipfs
john1 has quit [Ping timeout: 260 seconds]
elh9 has joined #ipfs
prettymuchbryce has joined #ipfs
cyanobacteria has quit [Ping timeout: 260 seconds]
drathir has joined #ipfs
drathir has quit [Changing host]
elh9 has quit [Remote host closed the connection]
elh9 has joined #ipfs
WindPower has joined #ipfs
s_kunk has joined #ipfs
s_kunk has joined #ipfs
s_kunk has quit [Changing host]
seagreen- has joined #ipfs
Kamilion has joined #ipfs
Guest18 has joined #ipfs
kulelu88 has joined #ipfs
pcre has joined #ipfs
xskyripper has joined #ipfs
Sophrosyne__ has quit [Read error: Connection reset by peer]
kvda has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
drathir has quit [Quit: Reconnecting]
drathir has joined #ipfs
pcre has quit [Ping timeout: 245 seconds]
mildred_ has joined #ipfs
bastianilso____ has joined #ipfs
toXel has quit [Remote host closed the connection]
toXel has joined #ipfs
tabrath has quit [Ping timeout: 256 seconds]
espadrine has joined #ipfs
infinity0 has quit [Ping timeout: 248 seconds]
infinity0 has joined #ipfs
infinity0 has quit [Remote host closed the connection]
infinity0 has joined #ipfs
Jackneill[m] has joined #ipfs
zanadar has joined #ipfs
espadrine has quit [Ping timeout: 240 seconds]
gearchef has quit [Write error: Connection reset by peer]
espadrine has joined #ipfs
mildred has quit [Ping timeout: 240 seconds]
mildred_ has quit [Ping timeout: 260 seconds]
dulal7808[m] has joined #ipfs
mguentner2 is now known as mguentner
_rht has joined #ipfs
mrpoopyb1 has quit [Ping timeout: 240 seconds]
structuralist has joined #ipfs
guilherme has joined #ipfs
gearchef has joined #ipfs
elh9 has quit [Remote host closed the connection]
mrpoopyb1 has joined #ipfs
<Kubuxu> I've just added cndjs (60GiB) in 36mins
<Kubuxu> victorbjelkholm_, lgierth, whyrusleeping ^
<Kubuxu> Which gives 28MiB/s
<Kubuxu> not bad
<Kubuxu> s/cndjs/cdnjs
<Kubuxu> also this dedup ratio:
<Kubuxu> 71.9 GiB [##########] /cdnjs
<Kubuxu> 32.9 GiB [#### ] /ipfs
tabrath has joined #ipfs
cemerick has joined #ipfs
elico has quit [Ping timeout: 256 seconds]
cemerick has quit [Ping timeout: 252 seconds]
cemerick has joined #ipfs
anonymuse has joined #ipfs
cemerick has quit [Ping timeout: 252 seconds]
cemerick has joined #ipfs
<lgierth> Kubuxu: sounds pretty slow to me
<lgierth> Kubuxu: how big is your repo? the ccc mirror started with about 120 MiB/s when the repo was still empty
<Kubuxu> it was fresh repo
<lgierth> oh but cdnjs is plenty of tiny files
<Kubuxu> yup
<lgierth> yeah that makes sense then
<Kubuxu> also my bcache was shifting use factors at the same time
<Kubuxu> from 1GiB dirty cache to 45GiB dirty cache
<Kubuxu> which isn't really that cheap
<lgierth> about the slowdown the bigger the repo gets... do you think that's the write, or the lookup before the write?
guilherme has quit [Remote host closed the connection]
<Kubuxu> I think it is fs doing as binary tree walk before, after and during write
cwahlers_ has quit [Quit: Textual IRC Client: www.textualapp.com]
cwahlers has joined #ipfs
<kpcyrd> hrm, can't build go-ipfs on 512MB
<Kubuxu> me and why are looking into boltdb
<Kubuxu> but it might be to DBish for us
<Kubuxu> I've run some statistics yesterday on pollux
zanadar has quit [Ping timeout: 245 seconds]
<lgierth> no idea what the graphs tell me :)
<lgierth> kpcyrd: what runs out?
<Kubuxu> for some reason we have really a lot of small blocks on pollux
<Kubuxu> especially ones with size of 62bytes
cemerick has quit [Ping timeout: 252 seconds]
<lgierth> check out what's inside
ckwaldon has quit [Remote host closed the connection]
ckwaldon has joined #ipfs
<Kubuxu> First I wanted check if it happens in normal add too
<Kubuxu> that is why I added cdnjs
rcat has joined #ipfs
OstlerDev has quit [Quit: FARCALLER!!!!!]
<Kubuxu> also there is a lot of blocks above 256KiB
<Kubuxu> up to 2MiB
<Kubuxu> which are porobably patch attemps
<Kubuxu> for npm-ipfs
<Mateon1> Kubuxu: Large directories?
<Kubuxu> yeah
<Kubuxu> and then we had no sharding
<Mateon1> So, what's the status of HAMT sharding?
mildred_ has joined #ipfs
<Kubuxu> close to merge
<Mateon1> Let me merge it locally and test
<Kubuxu> but I don't think 0.4.5
<Mateon1> I'll make a release
<Kubuxu> it is being tested
<Kubuxu> but other eyes on it will be great
<kpcyrd> lgierth: out of memory
<kpcyrd> I'm using a 512MB droplet
<lgierth> ok but which part runs out of memory, deps or build?
<lgierth> hearing this for the first time i think
<kpcyrd> /usr/lib/go/pkg/tool/linux_amd64/link: running gcc failed: fork/exec /usr/bin/gcc: cannot allocate memory
m0ns00n_ has joined #ipfs
<kpcyrd> reproduce is basically `docker build -t go-ipfs .` on a 512MB digital ocean droplet
<lgierth> hrm :/
<whyrusleeping> that ones hard to do anything about...
mildred1 has joined #ipfs
<Kubuxu> how much the system takes?
m0ns00n_ has quit [Quit: quit]
Guest18 has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
tabrath has quit [Ping timeout: 240 seconds]
<Mateon1> gx install is hanging for me (with no output)
<whyrusleeping> Mateon1: is your ipfs daemon running?
<Mateon3> I disabled the daemon, same result
<whyrusleeping> thats... odd
<Mateon3> Note that I am compiling the HAMT branch
* whyrusleeping checks
<Mateon1> Uh... Your checking fixed it
<Mateon1> A hash must have not been available somehow
<whyrusleeping> lol
<whyrusleeping> one problem could be that my home node is offline...
anonymuse has quit [Read error: Connection reset by peer]
<whyrusleeping> makes some things a little less widely seeded
Mizzu has joined #ipfs
<Mateon1> I really need to make it compile the windows amd64 release first... It's annoying waiting for linux and osx to compile first
fe has joined #ipfs
fe is now known as Guest50678
<whyrusleeping> mmm... it seems i uninstalled zfs at some point and never noticed because i never rebooted my server...
kenshyx has joined #ipfs
Guest50678 has quit [Client Quit]
<Kubuxu> whyrusleeping: distribution after add of cdnjs
<Kubuxu> fs:/ipfs/QmUv78WNZgBYdX2ZNnkn2AkDASc9fuhXBHY54JUZmHUBQj
<whyrusleeping> interesting...
dignifiedquire has quit [Quit: Connection closed for inactivity]
<Kubuxu> 80% is belove 35Kib
_rht has quit [Quit: Connection closed for inactivity]
<Kubuxu> KiB
<Kubuxu> and 60% is below 2.6KiB
<whyrusleeping> kinda feels to me like we should have a small objects datastore and a large (fixed size) objects datastore
<Mateon1> Here's a release with HAMT merged with master: QmdDXPcQnVWFW1CQ7UepXsKc8g9eXS4gC3G8ByAtjjk4YP
<Kubuxu> whyrusleeping: how do you feel about bolt now that we know it is one writer locked?
<whyrusleeping> Kubuxu: mmm... i'm not really sure
<Kubuxu> yeah, I have similar feeling
<whyrusleeping> it definitely puts a little damper on things...
Boomerang has joined #ipfs
<Kubuxu> yeah
<Kubuxu> it will be different for dataset built of big files
<Kubuxu> but still
<whyrusleeping> can leveldb be written to concurrently?
<Kubuxu> no idea, will check
<Mateon1> Just a question, do you need a flag to enable HAMT on that branch?
<whyrusleeping> nope, you shouldnt
<Kubuxu> whyrusleeping: yes: Write might be used concurrently, when used concurrently and
<Kubuxu> / batch is small enough, write will try to merge the batches.
<Mateon1> Just making sure, since ipfs add on 100000 dirs on windows takes a long time
<Kubuxu> whyrusleeping: levelDB if there is write in process opens a window for write batch merge
<Kubuxu> otherwise it chan-locks around write
<Kubuxu> but opens the window
<Kubuxu> whyrusleeping: also here is plot with log scale: https://ipfs.io/ipfs/QmXrbV5Jx4MbRTv2cWhsvNfa7Tk2HP3WSoBAaNicrf1cVX/ecdf.log.ipfs.cdnjs.png IDK if it helps you to see it, it helps me (EE uses mainly log scale)
<Mateon1> Yeah... The add process is currently stuck, with no CPU activity and no IO
<whyrusleeping> >.>
<whyrusleeping> wanna get me a stack trace
<whyrusleeping> ?
<Mateon1> Uh, it crashed while I was looking op the pprof commands
<Mateon1> Odmowa dostępu = access denied
<whyrusleeping> oh, that one again
<Kubuxu> so the prolem is: for how small files you think about making special DS?
<Kubuxu> also I am readding with --raw-leaves
<whyrusleeping> i remember what odmowa dostepu is
<whyrusleeping> Kubuxu: hrm... maybe 4k?
<Mateon1> whyrusleeping: I get the same error in the daemon as well, let me try addind offline, but.. I don't think that will change anything
<Kubuxu> it covers 63% of data
<Mateon1> Oh, you can't add offline..
<whyrusleeping> yes you can?
<lgierth> you should definitely be able to add with --offline
<whyrusleeping> or with the daemon off
* whyrusleeping smells windows problems
<Mateon1> ipfs --offline add -r . -- Error: Unrecognized option 'offline'
<lgierth> ipfs daemon --offline
fe has joined #ipfs
<Mateon1> Ahh, okay
fe is now known as Guest23684
<lgierth> the funny thing with that goroutine leak is... there must be some specific event that triggers it. right now 3 gateways took off at the same time
<Mateon1> Like.. somebody adding 100k random files?
<Mateon1> Uh.. Did `ipfs diag sys` use to fail on Windows before?
<Mateon1> https://ipfs.io/ipfs/QmSi1Fb95gskDuQG9yYQE86oCd91CeGfAf2SANNao7XS3D Here's my current debug info, I let the add command stay on for a while
<whyrusleeping> uhm
Remramm has quit [Changing host]
Remramm has joined #ipfs
Remramm has joined #ipfs
<whyrusleeping> running the daemon with --offline means you wont connect to the gateways
<whyrusleeping> we wont be able to load that hash :P
<Mateon1> Right...
<Mateon1> Sorry
<whyrusleeping> haha, no worries
<Mateon1> Try now
<whyrusleeping> got it, thanks
<whyrusleeping> looks to me like "flatfs really sucks on windows"
<whyrusleeping> could you try setting datastore.NoSync to true?
<Mateon1> Probably, let me try
* whyrusleeping wonders if that even changes anything on windows
<Mateon1> What's the `ipfs config` syntax? Just `ipfs config Datastore.NoSync true` fails, same if I add an equal sign instead of a space
<Mateon1> It complains that it's not JSON
<Mateon1> Gah, I can't read
<Mateon1> Sorry
pfrazee has joined #ipfs
<whyrusleeping> pass --json on that one, yeah
<whyrusleeping> we need to just sanitize input better there...
<Mateon1> Uh, apparently it just randomly finished while I was messing with the config
<Mateon1> One issue I noticed, ipfs ls on a HAMT directory doesn't display the actual contents, but 256 bins from 00 to FF
<Kubuxu> this is the original data for comparison:
<whyrusleeping> Mateon1: ah, yeah
<whyrusleeping> will need to fix that
<whyrusleeping> very nice slightly curved lines
<whyrusleeping> i see a butterfly
<Mateon1> And you can't index a hamt directory like a normal directory, so `QmBlahBlah/CA/FE/00path/to/thing` works, but not `QmBlahBlah/path/to/thing`
<whyrusleeping> Mateon1: yeah, i have a fix for that. its just not plugged into the resolver code yet
<Mateon1> Okay, cool
* whyrusleeping notes that UX for sharding needs work
<Kubuxu> I also love bcache, it makes my HDDs so silent
<Kubuxu> as it optimizes for sequential continuous writes
kode54 has quit [Quit: ZNC 1.6.3+deb1 - http://znc.in]
kode54 has joined #ipfs
ashark has joined #ipfs
rsync has joined #ipfs
rsync has quit [Remote host closed the connection]
dignifiedquire has joined #ipfs
mildred1 has quit [Quit: WeeChat 1.6]
<Kubuxu> Raw leaves add of cdnjs took 28Mi
<Kubuxu> Min
<Kubuxu> vs 36 of normal add
<dignifiedquire> daviddias: pull-multiplex is stable at 200M memory usage on the stress test currently:)
<dignifiedquire> stable over the whole test run
<Kubuxu> but I don't know if it is significant
<Kubuxu> dignifiedquire: was was usage with spdy?
<daviddias> dignifiedquire: rad! :D
<whyrusleeping> Kubuxu: I've definitely seen perf improvements with raw-leaves
<daviddias> even the mega stress ones?
<dignifiedquire> Yeah
<Kubuxu> number of locks is the same
<dignifiedquire> though it's not finished running yet
<Kubuxu> s/locks/blocks
<Kubuxu> as expeceted
<daviddias> let's save the fireworks then :) but awesome work
<dignifiedquire> Kubuxu: I haven't checked yet
<dignifiedquire> thanks, it's also not yet fully spec compliant, but the basics of multiplexing work :)
malware_ has joined #ipfs
<Kubuxu> whyrusleeping: the plot is almost the same with raw leaves, probably expected
<whyrusleeping> yeap, should just be 256k on the high end instead of 256k+12
<Kubuxu> the diff is 14, but yes
<whyrusleeping> :+!:
espadrine has quit [Remote host closed the connection]
espadrine has joined #ipfs
taaem has joined #ipfs
mildred__ has joined #ipfs
mildred_ has quit [Ping timeout: 245 seconds]
aeternity has joined #ipfs
<whyrusleeping> nicolagreco: are you around?
<whyrusleeping> also daviddias
<daviddias> whyrusleeping: I am around
<daviddias> nicolagreco: left for TXL a bit over 30 mins ago
<Jackneill[m]> hey
<whyrusleeping> daviddias: should a cbor byte array be a valid ipld object?
<daviddias> probably already on the plane
Jackneill has joined #ipfs
<Jackneill[m]> hey
<daviddias> whyrusleeping: I'm sure we can construct a thing that makes it so
<whyrusleeping> daviddias: should it be?
<whyrusleeping> Jackneill[m]: hey
<daviddias> but for what is worth, dag-cbor, no
<daviddias> or
<daviddias> wait
<daviddias> the "IPLD object" wording is what is making it tricky
<daviddias> we do resolve through dag-cbor nodes that serialized cbor objects
<whyrusleeping> better phrasing, should dag-cbor accept non-map cbor objects?
<daviddias> just as links
<whyrusleeping> as top level objects?
<daviddias> not as properties
aeternity has quit [Ping timeout: 240 seconds]
ulrichard has quit [Read error: Connection reset by peer]
pcre has joined #ipfs
ulrichard has joined #ipfs
malware_ has quit [Quit: Konversation terminated!]
anonymuse has joined #ipfs
kulelu88 has quit [Ping timeout: 256 seconds]
mildred has joined #ipfs
mildred has quit [Client Quit]
Guest5911 has quit [Changing host]
amiller has joined #ipfs
Akaibu has quit [Quit: Connection closed for inactivity]
chris613 has joined #ipfs
ylp has quit [Quit: Leaving.]
ulrichard has quit [Remote host closed the connection]
xskyripper has quit [Quit: Leaving]
kulelu88 has joined #ipfs
Guest44302 is now known as Nycatelos
bastianilso____ has quit [Remote host closed the connection]
bastianilso____ has joined #ipfs
bastianilso____ has quit [Quit: bastianilso____]
bastianilso____ has joined #ipfs
structur_ has joined #ipfs
galois_d_ has joined #ipfs
structuralist has quit [Ping timeout: 240 seconds]
galois_dmz has quit [Ping timeout: 245 seconds]
Mitar has quit [Ping timeout: 248 seconds]
ckwaldon has quit [Remote host closed the connection]
Mitar has joined #ipfs
ckwaldon has joined #ipfs
tmg has quit [Ping timeout: 240 seconds]
kulelu88 has quit [Ping timeout: 252 seconds]
Guest23684 has quit [Remote host closed the connection]
fe has joined #ipfs
fe is now known as Guest34432
Guest34432 has quit [Ping timeout: 240 seconds]
simcop2387 has left #ipfs [#ipfs]
anonymuse has quit [Remote host closed the connection]
kulelu88 has joined #ipfs
kulelu88 has quit [Ping timeout: 240 seconds]
lindybrits has joined #ipfs
lindybrits has quit [Quit: Page closed]
fiatjaf has quit [Ping timeout: 245 seconds]
kulelu88 has joined #ipfs
fiatjaf has joined #ipfs
<kumavis[m]1> Kubuxu_ what is the identity multibase encoding?
kenshyx has quit [Quit: Leaving]
<Mateon1> kumavis[m]1: The NUL byte, 0x00
<whyrusleeping> lgierth: you around?
<Mateon1> kumavis[m]1: Not sure if that's merged, though
<kumavis[m]1> Kubuxu_: no i mean, what does it do
<Mateon1> Uh, it keeps the data identical
<Mateon1> It just prepends the 0x00 byte and leaves the rest as is
unlmtd[m] has joined #ipfs
ygrek has joined #ipfs
galois_d_ has quit [Remote host closed the connection]
galois_dmz has joined #ipfs
espadrine has quit [Ping timeout: 240 seconds]
JayCarpenter has joined #ipfs
espadrine has joined #ipfs
Encrypt has joined #ipfs
cemerick has joined #ipfs
dignifiedquire has quit [Quit: Connection closed for inactivity]
cemerick has quit [Ping timeout: 252 seconds]
s_kunk has quit [Ping timeout: 240 seconds]
<lgierth> whyrusleeping: yo!
cemerick has joined #ipfs
ygrek has quit [Ping timeout: 240 seconds]
mildred__ has quit [Ping timeout: 245 seconds]
wallacoloo_____ has joined #ipfs
lassulus has quit [Ping timeout: 258 seconds]
chungy has quit [Quit: ZNC - http://znc.in]
corby has quit [Quit: WeeChat 1.1.1]
lassulus has joined #ipfs
corby has joined #ipfs
espadrine has quit [Ping timeout: 258 seconds]
lassulus has quit [Quit: WeeChat 1.5]
lassulus has joined #ipfs
galois_d_ has joined #ipfs
chungy has joined #ipfs
galois_dmz has quit [Ping timeout: 245 seconds]
s_kunk has joined #ipfs
s_kunk has quit [Max SendQ exceeded]
tabrath has joined #ipfs
s_kunk has joined #ipfs
ianopolous has joined #ipfs
Encrypt has quit [Quit: Quit]
bastianilso____ has quit [Quit: bastianilso____]
G-Ray_ has quit [Quit: G-Ray_]
bastianilso____ has joined #ipfs
maxlath has quit [Ping timeout: 240 seconds]
ygrek has joined #ipfs
dignifiedquire has joined #ipfs
seagreen- has left #ipfs [#ipfs]
luizirber has quit [Remote host closed the connection]
structur_ has quit [Remote host closed the connection]
luizirber has joined #ipfs
erde74 has joined #ipfs
structuralist has joined #ipfs
smuggler has quit [K-Lined]
dulal7808[m] has left #ipfs ["User left"]
anonymuse has joined #ipfs
Boomerang has quit [Ping timeout: 258 seconds]
<alterego> Hrm, 15 seconds for a findprovs .. :/
maxlath has joined #ipfs
galois_d_ has quit [Remote host closed the connection]
galois_dmz has joined #ipfs
palkeo has joined #ipfs
palkeo has joined #ipfs
palkeo has quit [Changing host]
john2 has quit [*.net *.split]
silotis has quit [*.net *.split]
des_consolado has quit [*.net *.split]
nivekuil has quit [*.net *.split]
nivekuil has joined #ipfs
des_consolado has joined #ipfs
A124 has quit [Read error: Connection reset by peer]
A124 has joined #ipfs
erde74 has quit [Ping timeout: 258 seconds]
<lgierth> Kubuxu: could the firefox addon hijack requests to ipfs.io? or does it maybe already do it?
erde74 has joined #ipfs
<Kubuxu> it already does
mildred2 has quit [Quit: WeeChat 1.6]
<lgierth> awesome. then my idea of local-ish networks being allowed to hijack the ipfs.io zone is unneccessary. it can be done in the addon
<Kubuxu> the zone is still useful
<lgierth> mh yeah probably
<Kubuxu> ie. PXE
<lgierth> oh true
<lgierth> btw what do you think about handing out SSL certs for ipfs.io in that context?
mildred has joined #ipfs
<lgierth> i'm thinking it might be okay, but it feels fishy
<Kubuxu> nope
shizy has joined #ipfs
<Kubuxu> then anyone who has that cert could hijack
<lgierth> yeah
<Kubuxu> ipfs.io right now works only because we are trusted party
<lgierth> maybe hand certs out to indiviual entities who ask and whom we have a contact channel to
<lgierth> mh yeah
<Kubuxu> I would say, create hijackable domain (with some stupid tld) and by default HTTP 302/303 to ipfs.io
<lgierth> still trying to get ipfs.link
<Kubuxu> it would be 'less safe' but hijackable in local trusted network
<lgierth> which would be the standard domain in fs: links
<lgierth> and ipfs.io would still work as a gateway to be backward-compat, but would only be meant to be the project website
<Kubuxu> ipfs.ing
<Kubuxu> lgierth: what is the problem with ipfs.link?
<lgierth> juan's time :)
<Kubuxu> ahh
<lgierth> ipfs.link is neat because there's similar gateways like onion.link
<lgierth> fs.link would be even nicer of course
<lgierth> oh wow. fs.link was on sale as a premium :X Creation Date: 2016-11-23T04:10:51.316Z
<lgierth> that is fucked up :-
erde74 has quit [Quit: Verlassend]
cyanobacteria has joined #ipfs
<ansuz> way to make work for derp, Kubuxu
<ansuz> <3
ansuz has left #ipfs [#ipfs]
phorse has quit [Ping timeout: 240 seconds]
wallacoloo_____ has quit [Quit: wallacoloo_____]
Boomerang has joined #ipfs
wallacoloo_____ has joined #ipfs
phorse has joined #ipfs
cyanobacteria has quit [Ping timeout: 240 seconds]
rendar has quit [Ping timeout: 260 seconds]
espadrine has joined #ipfs
wallacoloo_____ has quit [Quit: wallacoloo_____]
galois_d_ has joined #ipfs
mildred has quit [Ping timeout: 240 seconds]
galois_dmz has quit [Ping timeout: 245 seconds]
ianopolous has quit [Ping timeout: 256 seconds]
ogd_ has joined #ipfs
shakalaka has quit [Ping timeout: 248 seconds]
clavi has quit [Ping timeout: 248 seconds]
oleavr has quit [Ping timeout: 248 seconds]
lachenmayer has quit [Ping timeout: 248 seconds]
ogd has quit [Read error: Connection reset by peer]
ogd_ is now known as ogd
shakalaka_ has joined #ipfs
lachenmayer has joined #ipfs
clavi has joined #ipfs
oleavr has joined #ipfs
mildred has joined #ipfs
slothbag has joined #ipfs
fe has joined #ipfs
fe is now known as Guest78206
cyanobacteria has joined #ipfs
bastianilso____ has quit [Remote host closed the connection]
<lgierth> go 1.8 rc1
<Kubuxu> cool
alu has quit [Changing host]
alu has joined #ipfs
wallacoloo_____ has joined #ipfs
<lgierth> Kubuxu whyrusleeping: want me to put half the gateways or so on 1.8 to see if it fixes the goroutine growth thing?
<lgierth> it's probably something else but who knows
<Kubuxu> I don't think it is that
<Kubuxu> can you send me a routine dump with this goroutine thing
dignifiedquire has quit [Quit: Connection closed for inactivity]
<lgierth> i have one from saturn at home
<lgierth> where it was at like 220k
wallacoloo_____ has quit [Quit: wallacoloo_____]
wallacoloo_____ has joined #ipfs
wkennington has joined #ipfs
vtomole has joined #ipfs
Guest18 has joined #ipfs
dignifiedquire has joined #ipfs
galois_d_ has quit []
Encrypt has joined #ipfs
Encrypt has quit [Client Quit]
Guest78206 has quit [Remote host closed the connection]
wallacoloo____ has joined #ipfs
wallacoloo_____ has quit [Ping timeout: 248 seconds]
cemerick has quit [Ping timeout: 248 seconds]
cemerick has joined #ipfs
bastianilso____ has joined #ipfs
galois_dmz has joined #ipfs
ianopolous has joined #ipfs
structuralist has quit [Ping timeout: 240 seconds]
slothbag has quit [Quit: Leaving.]
gearchef has quit [Read error: Connection reset by peer]
arpu has quit [Ping timeout: 248 seconds]
cemerick has quit [Ping timeout: 240 seconds]
taaem has quit [Ping timeout: 240 seconds]
tilgovi has joined #ipfs
arpu has joined #ipfs
ashark has quit [Ping timeout: 256 seconds]
tmg has joined #ipfs
Akaibu has joined #ipfs
maxlath has quit [Quit: maxlath]
Guest18 has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
Boomerang has quit [Quit: Lost terminal]
Mizzu has quit [Ping timeout: 252 seconds]
anderspree_ has quit [Ping timeout: 245 seconds]
nskelsey_ has quit [Ping timeout: 245 seconds]
mikeal has quit [Ping timeout: 240 seconds]
jbenet has quit [Ping timeout: 258 seconds]
wa7son has quit [Ping timeout: 255 seconds]
kumavis has quit [Ping timeout: 240 seconds]
bbielsa has quit [Ping timeout: 258 seconds]
anderspree_ has joined #ipfs
emschwartz has quit [Ping timeout: 240 seconds]
caseorganic has quit [Ping timeout: 255 seconds]
grncdr has quit [Ping timeout: 255 seconds]
lohkey has quit [Ping timeout: 240 seconds]
ELLIOTTCABLE has quit [Ping timeout: 240 seconds]
yoshuawuyts has quit [Ping timeout: 258 seconds]
nskelsey_ has joined #ipfs
sneak has quit [Ping timeout: 245 seconds]
risk has quit [Ping timeout: 240 seconds]
ea12 has quit [Ping timeout: 255 seconds]
mappum has quit [Ping timeout: 255 seconds]
zmanian_ has quit [Ping timeout: 255 seconds]
bigs_ has quit [Ping timeout: 256 seconds]
jhiesey has quit [Ping timeout: 258 seconds]
oleavr has quit [Ping timeout: 240 seconds]
antonizoon has quit [Ping timeout: 255 seconds]
jbenet has joined #ipfs
bbielsa has joined #ipfs
emschwartz has joined #ipfs
ea12 has joined #ipfs
jhiesey has joined #ipfs
mappum has joined #ipfs
oleavr has joined #ipfs
zmanian_ has joined #ipfs
lohkey has joined #ipfs
risk has joined #ipfs
ELLIOTTCABLE has joined #ipfs
wa7son has joined #ipfs
grncdr has joined #ipfs
mikeal has joined #ipfs
yoshuawuyts has joined #ipfs
sneak has joined #ipfs
caseorganic has joined #ipfs
palkeo has quit [Quit: Konversation terminated!]
fresn3ll has joined #ipfs
anonymuse has quit [Remote host closed the connection]
fresn3ll has quit []
anonymuse has joined #ipfs
Caterpillar has quit [Quit: You were not made to live as brutes, but to follow virtue and knowledge.]
kvda has joined #ipfs
tilgovi has quit [Ping timeout: 252 seconds]
anonymuse has quit [Ping timeout: 248 seconds]
cemerick has joined #ipfs
dignifiedquire has quit [Quit: Connection closed for inactivity]