<whyrusleeping>
dignifiedquire: cat doesnt have offsets yet
<whyrusleeping>
should be pretty simple to add in though
<whyrusleeping>
just have to seek on our dagreader
<dignifiedquire>
right, but I was just wondering what you do when you support seeking on the gateway
mgue has joined #ipfs
mildred has joined #ipfs
<whyrusleeping>
dagreader.Seek()
<whyrusleeping>
http.ServeContent accepts a reader, but it does type upgrade checks to see if that reader supports seeking. If the given reader supports seeking, it will use it
pfista has joined #ipfs
<whyrusleeping>
Kubuxu: I'm thinking of dropping the peerstore data to disk from this milestone
<whyrusleeping>
its roughly 9MB of data on a longer running node
<whyrusleeping>
which makes it only the 6th largest consumer of memory on the nodes i've been observing
<Kubuxu>
and adds much more complexity
<whyrusleeping>
yeap
xelra has quit [Ping timeout: 264 seconds]
<Kubuxu>
What are them in order?
<whyrusleeping>
yamux, a different part of yamux, leveldb, protobuf (i think this is bitswap?), the dht, and then the peerstore
<whyrusleeping>
depending on how you view yamux, its either one two or three of them
<whyrusleeping>
there are three separate areas each consuming a decent chunk of memory
ashark has quit [Ping timeout: 264 seconds]
martinkl_ has joined #ipfs
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
socon has quit [Ping timeout: 246 seconds]
harlantwood has quit [Ping timeout: 250 seconds]
<Kubuxu>
whyrusleeping: that degradation of DirAddOpsPerSec is 0.14 ms added. It might well be the cache.
<whyrusleeping>
Kubuxu: are we hitting the bloom filter first? or the ARC cache?
<Kubuxu>
the bloom first
<Kubuxu>
It makes the ARC get less noise.
<Kubuxu>
on Put (if block is already in blockstore) and bloom does PutMany cleanup.
<Kubuxu>
I am testing it on my loaded server again.
<Kubuxu>
Increased rounds number and so on.
<whyrusleeping>
SGTM
<whyrusleeping>
i'm heading off for the night
<whyrusleeping>
good luck!
<Kubuxu>
g'night
ygrek has joined #ipfs
Tv` has quit [Quit: Connection closed for inactivity]
rodarima[m] has joined #ipfs
j12t has quit [Remote host closed the connection]
ygrek has quit [Ping timeout: 244 seconds]
s_kunk has quit [Ping timeout: 250 seconds]
stoogenmeyer has joined #ipfs
martinkl_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
martinkl_ has joined #ipfs
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
stoogenmeyer has quit [Ping timeout: 276 seconds]
palkeo has quit [Quit: Konversation terminated!]
s_kunk has joined #ipfs
stoogenmeyer has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
stoogenmeyer has quit [Ping timeout: 250 seconds]
<kpcyrd>
Kubuxu: nice
zorglub27 has joined #ipfs
<reit>
Kubuxu, i noticed you fixed up the dependencies for ipns-pub, but i'm still having difficulties compiling it
<reit>
does it compile for you? i'm wondering whether a specific build environment is required
schmidta has quit [Quit: leaving]
schmidta has joined #ipfs
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
redfish has quit [Ping timeout: 264 seconds]
stoogenmeyer has joined #ipfs
redfish has joined #ipfs
Boomerang has joined #ipfs
stoogenmeyer has quit [Ping timeout: 276 seconds]
cketti has quit [Quit: Leaving]
jager has quit [Ping timeout: 244 seconds]
Encrypt has joined #ipfs
j12t has joined #ipfs
Ametabola has quit [Excess Flood]
j12t has quit [Ping timeout: 252 seconds]
nondiabetic has joined #ipfs
yela[m] has joined #ipfs
martinkl_ has quit [Ping timeout: 272 seconds]
balkian[m] has joined #ipfs
martinkl_ has joined #ipfs
cemerick has joined #ipfs
balkian[m] is now known as balkian
zz_r04r is now known as r04r
computerfreak has joined #ipfs
espadrine has joined #ipfs
stoogenmeyer has joined #ipfs
stoogenmeyer has quit [Ping timeout: 240 seconds]
balkian has left #ipfs ["User left"]
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
zorglub27 has quit [Ping timeout: 240 seconds]
guybrush has joined #ipfs
cemerick has quit [Ping timeout: 250 seconds]
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
cemerick has joined #ipfs
cryptix has joined #ipfs
cketti has joined #ipfs
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
zorglub27 has joined #ipfs
kenshyx has joined #ipfs
pfista has quit [Ping timeout: 240 seconds]
pfista has joined #ipfs
pguth has quit [Remote host closed the connection]
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
rgrinberg has joined #ipfs
j12t has quit [Ping timeout: 252 seconds]
zorglub27 has quit [Remote host closed the connection]
zorglub27 has joined #ipfs
<Kubuxu>
reit: it does compile for me
<Kubuxu>
you need to use gc
<Kubuxu>
s/gc/gx
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
<reit>
hm, i followed the instructions as listed in the readme.md, i got the gx components working and only when getting to the `go install` step do things fall apart and i begin to get errors like
<reit>
../../ipfs/go-ipfs/routing/dht/pb/message.go:81: cannot use peers[i].ID (type "gx/ipfs/QmRBqJF7hb8ZSpRcMwUt8hNhydWcxGEhtk81HKq6oUwKvs/go-libp2p-peer".ID) as type "github.com/ipfs/go-libp2p-peer".ID in argument to n.Connectedness
<reit>
also tried it from scratch in a blank vm just in case, but no dice
Encrypt has quit [Ping timeout: 264 seconds]
rgrinberg has quit [Ping timeout: 240 seconds]
cemerick has quit [Ping timeout: 250 seconds]
stoogenmeyer has joined #ipfs
stoogenmeyer has quit [Remote host closed the connection]
stoogenmeyer has joined #ipfs
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
PrinceOfPeeves has joined #ipfs
zorglub27 has quit [Ping timeout: 264 seconds]
cemerick has joined #ipfs
taw00 has joined #ipfs
redfish has quit [Ping timeout: 264 seconds]
rgrinberg has joined #ipfs
ruby32 has joined #ipfs
ashark has joined #ipfs
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
ashark has quit [Ping timeout: 264 seconds]
stoogenmeyer has quit [Remote host closed the connection]
<kpcyrd>
is there a standalone implementation to calculate ipfs hashes for files without running full ipfs? I'm aware of the multihash implementations, but I think that doesn't do chunking
<lgierth>
oh man whyrusleeping is going to hate me for my feedback on the fs-repo automigration PR
<lgierth>
kpcyrd: i don't think so -- but you could earn yourself lasting honor!
pguth has quit [Remote host closed the connection]
<Kubuxu>
it will keep breaking each time we update dep in go-ipfs
j12t has quit [Ping timeout: 264 seconds]
<Kubuxu>
we need to think of something smarter
brimstone has left #ipfs ["WeeChat 1.4"]
Encrypt has joined #ipfs
ruby32 has quit [Remote host closed the connection]
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
<reit>
yep that one worked, thanks
ruby32 has joined #ipfs
<ipfsbot>
[go-ipfs] Kubuxu pushed 1 new commit to feature/blocks-cache-arc: https://git.io/vKLlp
<ipfsbot>
go-ipfs/feature/blocks-cache-arc 7b42e64 Jakub Sztandera: blocks/blockstore: add blockCache test...
<ipfsbot>
[go-ipfs] Kubuxu force-pushed feature/blocks-cache-arc from 7b42e64 to 8205ff8: https://git.io/vKTuV
<ipfsbot>
go-ipfs/feature/blocks-cache-arc 8205ff8 Jakub Sztandera: blocks/blockstore: add blockCache test...
stoogenmeyer has quit [Remote host closed the connection]
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
firebird__ has joined #ipfs
cryptix has quit [Ping timeout: 244 seconds]
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
kenshyx has quit [Remote host closed the connection]
stoogenmeyer has joined #ipfs
disgusting_wall has joined #ipfs
cketti has quit [Quit: Leaving]
ghtdak has joined #ipfs
cemerick has quit [Ping timeout: 240 seconds]
pfista has quit [Ping timeout: 244 seconds]
ruby32 has quit [Ping timeout: 264 seconds]
pfista has joined #ipfs
ruby32 has joined #ipfs
zorglub27 has joined #ipfs
OutBackDingo has joined #ipfs
Tv` has joined #ipfs
mildred has quit [Ping timeout: 252 seconds]
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
ylp has joined #ipfs
pfista has quit [Ping timeout: 276 seconds]
Guest22926[m] has joined #ipfs
dmr has joined #ipfs
galois_d_ has joined #ipfs
galois___ has joined #ipfs
galois_dmz has quit [Ping timeout: 240 seconds]
galois_d_ has quit [Ping timeout: 272 seconds]
j12t has joined #ipfs
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
j12t has quit [Ping timeout: 252 seconds]
j12t has joined #ipfs
toxip has quit [Ping timeout: 240 seconds]
toxip has joined #ipfs
ygrek has joined #ipfs
Encrypt has quit [Quit: Quitte]
Encrypt has joined #ipfs
<whyrusleeping>
lgierth: what did you do
hermanjunge has joined #ipfs
<lgierth>
huh?
<lgierth>
i have no recollection
<whyrusleeping>
oh, the auto migrations PR
arpu has quit [Ping timeout: 276 seconds]
Encrypt has quit [Quit: Quitte]
<lgierth>
wait, the dns hijacking i mention there is actually not so much of an issue becaue it's not local
<lgierth>
anyhow, we still trust .io and the dns root to do their jobs
<lgierth>
but then that's what we do with dist.ipfs.io anyhow
<kpcyrd>
what did I miss?
<lgierth>
intentional remote code execution :P
<lgierth>
just kidding, automatic fs-repo migrations
taw00 has quit [Ping timeout: 276 seconds]
<kpcyrd>
I don't think dns should be trusted
<whyrusleeping>
lgierth: should we hard code a hash then?
arpu has joined #ipfs
<whyrusleeping>
lgierth: also, is cryptoauth a reliable ordered stream?
<whyrusleeping>
cc Kubuxu ansuz
galois___ has quit [Remote host closed the connection]
<lgierth>
whyrusleeping: i mean, you make a good point with broken migrations and being able to swap these out transparently. if we'd hardcode a hash, the new migrations release would have to be up on dist.ipfs.io before bumping the hash in go-ipfs. and if there's a go-ipfs release with a broken migration, effectively there'd have to be new releases of both migrations and go-ipfs
galois_dmz has joined #ipfs
ygrek has quit [Ping timeout: 240 seconds]
<lgierth>
whyrusleeping: cryptoauth is unreliable and unordered
<whyrusleeping>
lgierth: yay, re: cryptoauth
<whyrusleeping>
ughhhh, re: migrations
<whyrusleeping>
oh, and redeploy pinbot when you get a chance
taw00 has joined #ipfs
galois_d_ has joined #ipfs
<whyrusleeping>
acutally, one sec...
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
<whyrusleeping>
okay now
cemerick has joined #ipfs
<lgierth>
coolio
<lgierth>
hier kommt die maus
galois_dmz has quit [Ping timeout: 272 seconds]
pinbot has quit [Remote host closed the connection]
pinbot-v03x has quit [Remote host closed the connection]
pinbot has joined #ipfs
pinbot-v03x has joined #ipfs
<lgierth>
!botsnack
<pinbot>
om nom nom
gmcquillan has joined #ipfs
gmcquillan is now known as gmcquillan_
<M-mubot>
Thanks for the treat!
stoogenmeyer has quit [Remote host closed the connection]
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
<nicolagreco>
jbenet: actually if you want to talk over here - would be perfect
matoro has quit [Ping timeout: 252 seconds]
<whyrusleeping>
lgierth: what version of go are the gateway ipfs nodes built with?
pguth has quit [Remote host closed the connection]
<whyrusleeping>
we're gonna want that up to 1.7 as soon as it drops
pguth has joined #ipfs
<lgierth>
btw, about these -dev tags, if we're going to use these now, can we at least agree to tag the commit which bumps the version, and not some arbitrary following commit? :)
<whyrusleeping>
ipfs performs a looooot better on 1.7
<whyrusleeping>
>.>
<lgierth>
i'm trying to figure out which commit is the last to have fs-repo@3 and it's tricky :)
<lgierth>
i think it's the parent of Merge pull request #2903 from ipfs/feat/dskey-encoding
<lgierth>
about 1.7, i hope alpine-edge will have 1.7 quickly
toxip has joined #ipfs
<whyrusleeping>
feat/dskey-encoding is the branch that happened in
<whyrusleeping>
why are you looking for that though?
<alu>
will anyone be at HOPE/DEFCON
<lgierth>
whyrusleeping: i'm too lazy to do the repo-migration by hand, and the auto-migration requires a "y" on stdin
<whyrusleeping>
ipfs daemon --migrate=true <- automatically runs with no prompt?
<lgierth>
yes
<whyrusleeping>
ipfs daemon --migrate=false <- standard behaviour with the prompt?
<lgierth>
and --migrate=false <- don't run migration, just fail as it used to
<whyrusleeping>
okay
<lgierth>
--migrate omitted <- prompt
<whyrusleeping>
on it
<lgierth>
that way i can flip between --migrate, "here's our new version hash, and it's okay to run a migration"
<whyrusleeping>
lgierth: do you have any other feedback on the migrations themselves?
<whyrusleeping>
for the auto migrations to work i need to ship a build to dist
stoogenmeyer has joined #ipfs
<lgierth>
what do you think about the addressing of the download? i don
<lgierth>
't have a definite opinion
toxip has quit [Ping timeout: 260 seconds]
<whyrusleeping>
i think i'm gonna leave it using dns
<whyrusleeping>
the option is there for people to say no and run things themselves
<lgierth>
cool SGTM then
toxip has joined #ipfs
<whyrusleeping>
lgierth: youve tried out the migrations a couple times, right?
<lgierth>
aah i wanted to run it on pollux last night
<whyrusleeping>
do itttttt
<whyrusleeping>
also, if anyone can test it on windows for me, that would be super great
<lgierth>
doing it
disgusting_wall has quit [Quit: Connection closed for inactivity]
ygrek has joined #ipfs
vijayee has quit [Ping timeout: 272 seconds]
matoro has quit [Remote host closed the connection]
palkeo has joined #ipfs
palkeo has quit [Changing host]
palkeo has joined #ipfs
M-manveru has quit [Read error: Connection reset by peer]
M-jimt has quit [Remote host closed the connection]
fortyfoxes[m] has quit [Remote host closed the connection]
M-Amandine has quit [Remote host closed the connection]
M-fiatjaf has quit [Remote host closed the connection]
Guest22220[m] has quit [Remote host closed the connection]
M-ptman has quit [Remote host closed the connection]
M-cryptix has quit [Remote host closed the connection]
sull[m] has quit [Remote host closed the connection]
xenxAndreyTvoroz has quit [Remote host closed the connection]
M-jackvt93 has quit [Remote host closed the connection]
M-3526 has quit [Remote host closed the connection]
M-g has quit [Remote host closed the connection]
vikneshwaren[m] has quit [Remote host closed the connection]
M-Guest2152 has quit [Remote host closed the connection]
Karalix[m] has quit [Remote host closed the connection]
Ralith_ has quit [Read error: Connection reset by peer]
Guest20001[m] has quit [Read error: Connection reset by peer]
M-victorm has quit [Read error: Connection reset by peer]
M-pims has quit [Read error: Connection reset by peer]
M-leer10 has quit [Read error: Connection reset by peer]
Red15[m] has quit [Remote host closed the connection]
M-jon has quit [Read error: Connection reset by peer]
M-krsiehl has quit [Read error: Connection reset by peer]
M-oddvar has quit [Remote host closed the connection]
M-rryan has quit [Remote host closed the connection]
M-gdr has quit [Read error: Connection reset by peer]
Sandhose[m] has quit [Read error: Connection reset by peer]
M-Val has quit [Remote host closed the connection]
M-smk has quit [Remote host closed the connection]
M-Lawrence_Pritc has quit [Remote host closed the connection]
M-bungle has quit [Remote host closed the connection]
Guest18692[m] has quit [Remote host closed the connection]
matrixtest[m] has quit [Remote host closed the connection]
M-17739 has quit [Remote host closed the connection]
msmart[m] has quit [Remote host closed the connection]
M-scio_ has quit [Read error: Connection reset by peer]
M-14321 has quit [Read error: Connection reset by peer]
M-javissimo has quit [Read error: Connection reset by peer]
masoodahm[m] has quit [Read error: Connection reset by peer]
M-flyingzumwalt has quit [Remote host closed the connection]
M-sliker has quit [Read error: Connection reset by peer]
M-frabrunelle has quit [Remote host closed the connection]
M-bp5 has quit [Remote host closed the connection]
M-AndrewGaspar has quit [Remote host closed the connection]
M-10660 has quit [Remote host closed the connection]
M-2194 has quit [Remote host closed the connection]
M-Peer2Peer has quit [Remote host closed the connection]
M-p0pa has quit [Remote host closed the connection]
M-3444 has quit [Remote host closed the connection]
l64376[m] has quit [Remote host closed the connection]
M-foxxy has quit [Remote host closed the connection]
M-3798 has quit [Remote host closed the connection]
M-JayCarpenter has quit [Remote host closed the connection]
M-rschulman1 has quit [Read error: Connection reset by peer]
M-wldhx has quit [Read error: Connection reset by peer]
muhriddin[m] has quit [Read error: Connection reset by peer]
M-cocci has quit [Read error: Connection reset by peer]
M-Dan has quit [Read error: Connection reset by peer]
M-3509 has quit [Read error: Connection reset by peer]
M-toor has quit [Remote host closed the connection]
M-jackal has quit [Remote host closed the connection]
M-mistake has quit [Read error: Connection reset by peer]
M-trashrabbit has quit [Remote host closed the connection]
M-cyan has quit [Remote host closed the connection]
M-3511 has quit [Remote host closed the connection]
M-JayJay has quit [Remote host closed the connection]
Guest18705[m] has quit [Remote host closed the connection]
M-3676 has quit [Remote host closed the connection]
M-thomasbeta has quit [Remote host closed the connection]
M-lucnsy has quit [Remote host closed the connection]
M-jacktang has quit [Remote host closed the connection]
M-ryanwilliams has quit [Remote host closed the connection]
M-4267 has quit [Remote host closed the connection]
M-hierophantos has quit [Read error: Connection reset by peer]
M-keverets has quit [Read error: Connection reset by peer]
M-hash has quit [Read error: Connection reset by peer]
M-zick has quit [Read error: Connection reset by peer]
blabla2[m] has quit [Remote host closed the connection]
M-geir has quit [Remote host closed the connection]
monzoon[m] has quit [Remote host closed the connection]
hendry[m] has quit [Remote host closed the connection]
M-internetjanito has quit [Remote host closed the connection]
wehlutyk[m] has quit [Remote host closed the connection]
mads[m] has quit [Remote host closed the connection]
M-6561 has quit [Remote host closed the connection]
M-3725 has quit [Remote host closed the connection]
M-gary123 has quit [Remote host closed the connection]
M-Xorkle has quit [Remote host closed the connection]
M-jaxondu has quit [Read error: Connection reset by peer]
Guest22926[m] has quit [Remote host closed the connection]
M-Ingo has quit [Read error: Connection reset by peer]
M-3974 has quit [Read error: Connection reset by peer]
M-kalmi has quit [Read error: Connection reset by peer]
igork[m] has quit [Remote host closed the connection]
M-jfred has quit [Read error: Connection reset by peer]
M-edrex has quit [Remote host closed the connection]
M-HirmeS has quit [Remote host closed the connection]
Askaban[m] has quit [Remote host closed the connection]
M-blide has quit [Remote host closed the connection]
M-4447 has quit [Remote host closed the connection]
M-davidar-test has quit [Remote host closed the connection]
M-4485 has quit [Read error: Connection reset by peer]
Guest19040[m] has quit [Read error: Connection reset by peer]
M-ming8 has quit [Read error: Connection reset by peer]
M-6781 has quit [Read error: Connection reset by peer]
Guest19048[m] has quit [Read error: Connection reset by peer]
M-16194 has quit [Read error: Connection reset by peer]
M-8319 has quit [Read error: Connection reset by peer]
M-TidyKoala has quit [Read error: Connection reset by peer]
M-Magnap has quit [Read error: Connection reset by peer]
kegan[m] has quit [Remote host closed the connection]
M-10670 has quit [Read error: Connection reset by peer]
trytrytry[m] has quit [Read error: Connection reset by peer]
M-16549 has quit [Read error: Connection reset by peer]
M-15922 has quit [Read error: Connection reset by peer]
M-wkennington has quit [Read error: Connection reset by peer]
M-Dave has quit [Read error: Connection reset by peer]
eternaleye has quit [Read error: Connection reset by peer]
M-liberdiko has quit [Read error: Connection reset by peer]
M-rschulman has quit [Remote host closed the connection]
rfb[m] has quit [Remote host closed the connection]
M-alwi has quit [Remote host closed the connection]
M-mckaydavis has quit [Remote host closed the connection]
yuryk[m] has quit [Remote host closed the connection]
M-aatchison has quit [Remote host closed the connection]
M-2617 has quit [Remote host closed the connection]
Guest20690[m] has quit [Remote host closed the connection]
M-12490 has quit [Remote host closed the connection]
M-whyrusleeping has quit [Remote host closed the connection]
M-volobuev has quit [Remote host closed the connection]
M-alri has quit [Remote host closed the connection]
M-2128 has quit [Remote host closed the connection]
M-jbenet has quit [Remote host closed the connection]
M-6581 has quit [Remote host closed the connection]
M-16544 has quit [Read error: Connection reset by peer]
Askaban[m]1 has quit [Read error: Connection reset by peer]
M-leeola has quit [Read error: Connection reset by peer]
M-jmesserli has quit [Read error: Connection reset by peer]
M-mseri has quit [Read error: Connection reset by peer]
M-selpreload has quit [Read error: Connection reset by peer]
M-16355 has quit [Read error: Connection reset by peer]
M-13288 has quit [Read error: Connection reset by peer]
M-osener has quit [Read error: Connection reset by peer]
M-austinhc has quit [Read error: Connection reset by peer]
M-nated has quit [Read error: Connection reset by peer]
M-Mxaw has quit [Read error: Connection reset by peer]
M-harlan has quit [Read error: Connection reset by peer]
M-9364 has quit [Read error: Connection reset by peer]
M-2255 has quit [Read error: Connection reset by peer]
M-erwin has quit [Read error: Connection reset by peer]
M-jh has quit [Read error: Connection reset by peer]
M-9743 has quit [Read error: Connection reset by peer]
M-lilien1010 has quit [Read error: Connection reset by peer]
M-neoteo has quit [Read error: Connection reset by peer]
M-11367 has quit [Read error: Connection reset by peer]
davidar has quit [Read error: Connection reset by peer]
erikj` has quit [Remote host closed the connection]
sibi[m] has quit [Read error: Connection reset by peer]
M-amstocker has quit [Read error: Connection reset by peer]
M-vro has quit [Read error: Connection reset by peer]
M-ms has quit [Read error: Connection reset by peer]
M-slang has quit [Read error: Connection reset by peer]
M-male has quit [Read error: Connection reset by peer]
M-jabl has quit [Read error: Connection reset by peer]
M-kupskups9 has quit [Read error: Connection reset by peer]
TiagoDanin[m] has quit [Read error: Connection reset by peer]
M-phorse has quit [Read error: Connection reset by peer]
M- has quit [Read error: Connection reset by peer]
M-phaverkamp has quit [Read error: Connection reset by peer]
M-infpetal has quit [Read error: Connection reset by peer]
Guest18694[m] has quit [Read error: Connection reset by peer]
M-mxuribe has quit [Read error: Connection reset by peer]
Guest22356[m] has quit [Read error: Connection reset by peer]
M-16865 has quit [Read error: Connection reset by peer]
steven[m] has quit [Read error: Connection reset by peer]
M-AbhishekDutt has quit [Read error: Connection reset by peer]
M-12044 has quit [Read error: Connection reset by peer]
M-3870 has quit [Read error: Connection reset by peer]
M-3630 has quit [Read error: Connection reset by peer]
M-rjan has quit [Read error: Connection reset by peer]
ntninja[m] has quit [Remote host closed the connection]
M-leoc has quit [Read error: Connection reset by peer]
M-7141 has quit [Remote host closed the connection]
M-ngu has quit [Remote host closed the connection]
M-roblabla has quit [Remote host closed the connection]
Jacob[m] has quit [Remote host closed the connection]
M-dtg has quit [Remote host closed the connection]
Claus[m] has quit [Remote host closed the connection]
Guest21158[m] has quit [Remote host closed the connection]
M-mousereeve has quit [Remote host closed the connection]
M-1982 has quit [Read error: Connection reset by peer]
M-erikgarrison has quit [Read error: Connection reset by peer]
M-8842 has quit [Read error: Connection reset by peer]
M-jgrowl has quit [Read error: Connection reset by peer]
M-cyzoonic has quit [Read error: Connection reset by peer]
M-3891 has quit [Read error: Connection reset by peer]
M-12989 has quit [Write error: Connection reset by peer]
M-5459 has quit [Write error: Connection reset by peer]
M-giodamelio has quit [Write error: Connection reset by peer]
rodarima[m] has quit [Write error: Connection reset by peer]
michaelmure[m] has quit [Write error: Connection reset by peer]
Avinash[m] has quit [Write error: Connection reset by peer]
M-nd has quit [Write error: Connection reset by peer]
M-Sonata1 has quit [Write error: Connection reset by peer]
M-uhiiued7278 has quit [Write error: Connection reset by peer]
M-3045 has quit [Write error: Connection reset by peer]
M-ikreymer has quit [Write error: Connection reset by peer]
M-david has quit [Write error: Connection reset by peer]
M-Shrike has quit [Write error: Connection reset by peer]
chevdor[m] has quit [Write error: Connection reset by peer]
M-brasilikum has quit [Write error: Connection reset by peer]
gwillen[m] has quit [Write error: Connection reset by peer]
djfdfjoijijeoif[ has quit [Write error: Connection reset by peer]
Guest21903[m] has quit [Write error: Connection reset by peer]
M-player33 has quit [Write error: Connection reset by peer]
M-ed has quit [Write error: Connection reset by peer]
M-alien has quit [Write error: Connection reset by peer]
M-5703 has quit [Write error: Connection reset by peer]
naggie[m] has quit [Write error: Connection reset by peer]
M-7416 has quit [Write error: Connection reset by peer]
M-sivachandran has quit [Write error: Connection reset by peer]
M-madsurgeon has quit [Write error: Connection reset by peer]
M-joshumax has quit [Write error: Connection reset by peer]
Guest22481[m] has quit [Write error: Connection reset by peer]
M-matthew has quit [Write error: Connection reset by peer]
TestName[m] has quit [Write error: Connection reset by peer]
M-abdessamadhoud has quit [Write error: Connection reset by peer]
M-bastinik has quit [Write error: Connection reset by peer]
M-liathit has quit [Write error: Connection reset by peer]
ntninja has quit [Write error: Connection reset by peer]
Guest21923[m] has quit [Write error: Connection reset by peer]
M-pfista has quit [Write error: Connection reset by peer]
M-drwasho has quit [Write error: Connection reset by peer]
M-14382 has quit [Write error: Connection reset by peer]
M-2129 has quit [Write error: Connection reset by peer]
M-2223 has quit [Write error: Connection reset by peer]
M-fermuch has quit [Write error: Connection reset by peer]
M-Guillaume has quit [Write error: Connection reset by peer]
M-codebam has quit [Write error: Connection reset by peer]
M-s6 has quit [Write error: Connection reset by peer]
dd[m] has quit [Write error: Connection reset by peer]
M-podviaznikov has quit [Write error: Connection reset by peer]
M-thia has quit [Write error: Connection reset by peer]
M-GereG has quit [Write error: Connection reset by peer]
M-hellomoto has quit [Write error: Connection reset by peer]
M-WolfNightly has quit [Write error: Connection reset by peer]
M-alphakamp has quit [Write error: Connection reset by peer]
M-metamattj has quit [Write error: Connection reset by peer]
yela[m] has quit [Write error: Connection reset by peer]
M-darknumbers has quit [Write error: Connection reset by peer]
M-king_size1953 has quit [Write error: Connection reset by peer]
M-3714 has quit [Write error: Connection reset by peer]
M-martinklepsch has quit [Write error: Connection reset by peer]
M-cpt has quit [Write error: Connection reset by peer]
draget[m] has quit [Write error: Connection reset by peer]
M-sraja has quit [Write error: Connection reset by peer]
M-pieohpah has quit [Write error: Connection reset by peer]
M-2234 has quit [Write error: Connection reset by peer]
M-sokoow has quit [Write error: Connection reset by peer]
M-Samim has quit [Write error: Connection reset by peer]
M-epsilon has quit [Write error: Connection reset by peer]
M-Tribex10 has quit [Write error: Connection reset by peer]
M-jeffreybpeters has quit [Write error: Connection reset by peer]
M-CCLXI has quit [Write error: Connection reset by peer]
M-rongladney has quit [Write error: Connection reset by peer]
robin[m] has quit [Write error: Connection reset by peer]
Guest19042[m] has quit [Write error: Connection reset by peer]
M-mubot has quit [Write error: Connection reset by peer]
M-apolo11 has quit [Write error: Connection reset by peer]
M-1976 has quit [Write error: Connection reset by peer]
M-greymr has quit [Write error: Connection reset by peer]
M-Nickfost has quit [Write error: Connection reset by peer]
Guest18687[m] has quit [Write error: Connection reset by peer]
M-staplemac has quit [Write error: Connection reset by peer]
M-kode54 has quit [Write error: Connection reset by peer]
vijayee has joined #ipfs
matoro has joined #ipfs
cow_2001 has joined #ipfs
zorglub27 has quit [Ping timeout: 272 seconds]
Chris___ has joined #ipfs
<Chris___>
I'm impressed with the capabilities of the GX package manager, but I have a question about it: Is there currently a way to discover new packages without consulting a centralized service like github?
firebird__ has quit [Ping timeout: 244 seconds]
M-TidyKoala has joined #ipfs
stoogenmeyer has quit [Remote host closed the connection]
<lgierth>
Chris___: there's not registries or the like at the moment
<Chris___>
@lgierth I'm interesting in prototyping a package registry. Do you think such a thing would be useful?
<whyrusleeping>
Chris___: yeah, i think a package registry for gx would be really cool
<Chris___>
Well then, I'll look into it. Thanks.
<lgierth>
with IPNS you can build a distributed registry
<lgierth>
the "registry" being just a list of links to people's IPNS/Gx repositories
stoogenmeyer has joined #ipfs
<Chris___>
@lgierth: With my understanding of the IPNS, you can create a registry of links, but how easy would it be to share that registry or update it to include the contents of other people's registries?
<lgierth>
relatively easy -- you'll have to build a bit of tooling though :)
<Chris___>
@lgierth: Also, could you search it if you built it on IPNS? I would expect only exact matches to IPNS keys to be useful.
<lgierth>
you'd need something that maintains a search index
niekie has joined #ipfs
<Chris___>
I was toying with the idea of using a blockchain to associate vendor/package:version with IPFS hashes
<ipfsbot>
[go-ipfs] whyrusleeping pushed 1 new commit to feat/auto-migrate: https://git.io/vKtTh
<ipfsbot>
go-ipfs/feat/auto-migrate 3f17bba Jeromy: add migrate flag to daemon subcommand...
<Chris___>
@whyrusleeping: I hadn't seen that. Am I misunderstanding it, or is that just a seeder for adding packages to IPFS?
<whyrusleeping>
yeah, its just a seeder
<whyrusleeping>
but its the farthest i've gone down the registry route so far
alexvoda[m] has joined #ipfs
<Chris___>
@whyrusleeping: Blockchain seems like a good fit for keeping a registry distributed and consistent. What do you think of that as a solution?
<whyrusleeping>
What would you actually store in the blockchain?
s_kunk has quit [Ping timeout: 250 seconds]
<Chris___>
A ledger of human-readable package references and their corresponding IPFS hashes as transactions
rendar has quit [Ping timeout: 240 seconds]
vijayee has quit [Ping timeout: 258 seconds]
espadrine has quit [Ping timeout: 240 seconds]
vijayee has joined #ipfs
<lgierth>
whyrusleeping: migration on pollux ~6h remaining
<whyrusleeping>
lgierth: yay
<lgierth>
it skipped one key which had "no .data"
<whyrusleeping>
Chris___: i don't think that would work too well
<whyrusleeping>
i think storing a ref pointing to the latest head of a dataset representing the index might be reasonable to put in a blockchain
<Chris___>
@whyrusleeping: I'm sure you know better than I do. Would you mind explaining?
<whyrusleeping>
well, an index is very large
<whyrusleeping>
and blockchains dont really enjoy lots of data being dumped in them
<whyrusleeping>
so you have to find a way to make your data smaller
<whyrusleeping>
which is where ipfs comes in,, you can simply store the ipfs hash of your data in the blockchain
<whyrusleeping>
and people can read the index through ipfs
<whyrusleeping>
lgierth: yeah, the no data thing is fine. Just means at some point the node was killed during a write
<Chris___>
@whyrusleeping: So, to keep up to date you follow the ref to get the current index of packages... makes sense. A transaction is then to update the index and add the new hash to the chain?
<whyrusleeping>
yeap
<Chris___>
Clever. If this idea doesn't sound fundamentally stupid to you, I think I might give it a go.
<whyrusleeping>
yeah, you could give it a shot
<whyrusleeping>
but before you even think of all the blockchain stuff, i'd write the index stuff first
<lgierth>
migration time remaining: ~4h
palkeo__ has joined #ipfs
wmhilton has joined #ipfs
<Kubuxu>
Chris___: which blockchain are you planning to use?
<Chris___>
@whyrusleeping: Sure. Do you already have concrete ideas on how to do that?
<whyrusleeping>
nope, not really
<Chris___>
@Kubuxu: Full disclosure: (please try not to groan) I'm still learning my way around the blockchain space, so I don't know.
<lgierth>
me too! i've been ignorant about it for a long time
<ipfsbot>
[go-ipfs] whyrusleeping pushed 1 new commit to master: https://git.io/vKtto
<Kubuxu>
Chris___: On your place I would look at Ethereum, then you could have contract that would be just storing hash to an index but you need to figure out how to handle decentralized upgrade to the index.
<Kubuxu>
You could also store ref on a per package basis but then you have problem of name squatting.
<Kubuxu>
if name isn't cryptographic, or pre/post fixed with random string you always have problem of name squating in distributed package (and really name) managers.
zorglub27 has joined #ipfs
matoro has quit [Ping timeout: 258 seconds]
<Chris___>
@Kubuxu: I see your point... I'll have to think on that. Gonna be AFK for about 15min. I'll try to come back with intelligent questions.
s_kunk has joined #ipfs
rendar has joined #ipfs
matoro has joined #ipfs
cketti has joined #ipfs
<lgierth>
the log file of the migration is great, it replays the whole progress estimation :P
<lgierth>
~3h now
<voxelot>
Chris___ Kubuxu: I am actually working on a contract to track the head of ipfs logs after having a talk with whyrusleeping earlier this week
<voxelot>
something along the lines of ipfs-hyperlog that can work for several types of applications (distributed github/reddit/... low frequency state change apps)
<voxelot>
more info on this next week
pguth has quit [Remote host closed the connection]
taw00 has quit [Read error: Connection reset by peer]
taw00 has joined #ipfs
<Chris___>
@voxelot: Can you tell me any more about that?
<voxelot>
Chris___: still
<voxelot>
Formulating ideas
M-7141 has joined #ipfs
<voxelot>
But it should be fairly simple to log events in a contract. I've done that before
A124 has quit [Quit: '']
<voxelot>
I want to expand and have a contract act as a controller that can create maybe different types of logs
<Chris___>
@lgierth @Kubuxu @whyrusleeping: Name squatting is definitely a problem. It's not super hard to verify identity via a key, but verifying who has a right to a name is impossible. How about assigning a pronounceable name based on a user's public key? This, in addition to the vendor and package name that they provide should uniquely specify a given package. The canonical owner of a package only needs to publish this additional name for
<Chris___>
@lgierth @Kubuxu @whyrusleeping: The naming convention could follow a similar method to how urbit handles network addresses? Take the public key and deterministically map the numbers to pseudo-english pronounceable syllables.
<r0kk3rz>
voxelot: sounds good :)
<Chris___>
@voxelot: sounds pretty cool. I think I need to read up on Ethereum contracts
monzoon[m] has joined #ipfs
<voxelot>
Chris___: Yeah look into blockchain identity as well. The folks at consensys like Chris Lundkvist have put a lot of cool thought into how to map public keys to all sorts of identity features mapped to ipfs objects
<Chris___>
@voxelot: Do you have any links to that?
reit has quit [Ping timeout: 240 seconds]
taw00 has quit [Ping timeout: 246 seconds]
<voxelot>
Chris___: Oof tons of places to start, check out the evolution of web of trust ideas with PKI and the blockchain id spec by block stack https://blockstack.org/docs
<voxelot>
they were early inspirations to how ethereum is being used
<voxelot>
unfortunately they just closed sourced the code for how uport actually operates
<voxelot>
but at its core it is essentially just registering ethereum public key to ipfs hash containing more information
h has joined #ipfs
<voxelot>
Chris has put in a ton of work on proxy contract to control different type of identity and way to reg that one public key to many types of id systems
h is now known as Guest87967
Guest87967 has quit [Client Quit]
blabla2[m] has joined #ipfs
l64376[m] has joined #ipfs
<voxelot>
ipfs can fit in nice to the type of low frequency consensus you get from blockchains that can store much information but can easily agree to the curent state of a link to easily accessible data over ipfs
zootella has joined #ipfs
zootella has quit [Client Quit]
<Chris___>
Certainly looks that way. Trying to figure out blockstack now
M-matthew has joined #ipfs
sibi[m] has joined #ipfs
yela[m] has joined #ipfs
M-pieohpah has joined #ipfs
M-smk has joined #ipfs
M-ngu has joined #ipfs
hendry[m] has joined #ipfs
TestName[m] has joined #ipfs
M-cyan has joined #ipfs
M-david has joined #ipfs
M-erwin has joined #ipfs
M-whyrusleeping has joined #ipfs
M-6581 has joined #ipfs
M-osener has joined #ipfs
<voxelot>
Two big problems that need work in these systems is 1) what happens if you lose your private key. and 2) Easy user interface to using a private key as your login to everything and proof of ownership to many things... mobile 0.o
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
M-abdessamadhoud has joined #ipfs
M-16865 has joined #ipfs
<ansuz>
if you lose your private key the dementors come and eat your soul
<kevina>
Wait on this one to until after ipfs-0.4.3?
<Kubuxu>
kevina: let me finish the second run
<Kubuxu>
we already bumed the block cache off 0.4.3
<kevina>
I know.
<Kubuxu>
I plan to get good metrics into go-ipfs in following week so we better know hotspots
<whyrusleeping>
i'm fine bumming both PRs off of 0.4.3
socon has joined #ipfs
<kevina>
okay, I think we need a better understanding of where the cache can be helpful, and also how much CPU time is used to retrieve the block and decode the protobuf
<kevina>
otherwise there may not be much benefit over the OS level disk cache
<Kubuxu>
kevina: I've posted my results.
neurrowcat has joined #ipfs
<kevina>
Kubuxu: let's take this to the issue so there is a written record...
<Kubuxu>
kk
stoogenmeyer has quit [Remote host closed the connection]
espadrine has joined #ipfs
rgrinberg has quit [Ping timeout: 246 seconds]
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
<whyrusleeping>
Kubuxu: you think you could work on making `ipfs get` have a working progress bar?
<whyrusleeping>
its on our Q2 goals
<whyrusleeping>
if youre busy i can get to it too
<Kubuxu>
I've started working on metrics, if you want me to do it I can do it, but I will be off to sleep quite quickly.
<Kubuxu>
whyrusleeping: who takes it? you or me? 3, 2, 1. decistion
<whyrusleeping>
i'll take it
<Kubuxu>
kk
Ptolemy has quit [Quit: Page closed]
cemerick has quit [Ping timeout: 260 seconds]
* Kubuxu
just cloned Go repo to ~/.vim/bundle and vim plugin to go/src ...
mildred has quit [Read error: No route to host]
mildred has joined #ipfs
<lgierth>
better than the other way around
bsm1175322 has joined #ipfs
bsm1175321 has quit [Read error: Connection reset by peer]
thefinn93 has quit [Remote host closed the connection]
thefinn93 has joined #ipfs
Aeonwaves has quit [Read error: Connection reset by peer]
Aeon has joined #ipfs
Aeon is now known as Aeonwaves
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
ashark has quit [Ping timeout: 272 seconds]
rendar has quit [Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!]
gmcquillan has joined #ipfs
gmcquillan_ has quit [Quit: gmcquillan_]
gmcquillan is now known as gmcquillan_
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
rgrinberg has joined #ipfs
chewieQC has joined #ipfs
<chewieQC>
Is it possible to use rsync to merge 2 ipfs repo together and keep all the pins?
Nukien has quit [Ping timeout: 252 seconds]
<ipfsbot>
[go-ipfs] whyrusleeping pushed 1 new commit to feat/auto-migrate: https://git.io/vKtH2
<ipfsbot>
go-ipfs/feat/auto-migrate f24214a Jeromy: add a test for auto migrations cli interface...
palkeo__ has quit [Ping timeout: 272 seconds]
neurrowcat has quit [Quit: Deebidappidoodah!]
<lgierth>
whyrusleeping: the migration has gone through all blocks, i'm not sure what it's doing now
<ipfsbot>
[go-ipfs] whyrusleeping created feat/get-progress (+1 new commit): https://git.io/vKt5f
<ipfsbot>
go-ipfs/feat/get-progress 43cd49d Jeromy: fix progress bar in ipfs get...
<ipfsbot>
[go-ipfs] whyrusleeping opened pull request #2948: fix progress bar in ipfs get (master...feat/get-progress) https://git.io/vKt5J
stoogenmeyer has joined #ipfs
<whyrusleeping>
wooo!
pfista has joined #ipfs
pguth has quit [Remote host closed the connection]
pguth has joined #ipfs
<Kubuxu>
chewieQC: you can merge blockstores, but for pins you will have to use commands
pfista has quit [Ping timeout: 252 seconds]
ruby32 has quit [Remote host closed the connection]
<whyrusleeping>
chewieQC: i think it would be pretty easy to write a little tool to merge ipfs repos
ruby32 has joined #ipfs
gmcquillan_ has quit [Quit: gmcquillan_]
gmcquillan has joined #ipfs
gmcquillan is now known as gmcquillan_
gmcquillan_ has quit [Ping timeout: 240 seconds]
palkeo__ has joined #ipfs
palkeo__ has quit [Ping timeout: 240 seconds]
<ipfsbot>
[go-ipfs] lgierth created feature/api-gateway-webui (+1 new commit): https://git.io/vKtpM
<ipfsbot>
go-ipfs/feature/api-gateway-webui 39bef0d Lars Gierth: gateway: on api, restrict to webui...
<ipfsbot>
[go-ipfs] lgierth opened pull request #2949: gateway: on api, restrict to webui (master...feature/api-gateway-webui) https://git.io/vKtpb
<chewieQC>
Thank you kubuxu and whyrusleeping, I will rsync and then use the separate DB I have of my content to repin everything and everything should work
<ipfsbot>
[go-ipfs] whyrusleeping deleted feat/get-progress at 43cd49d: https://git.io/vKthR
Encrypt has quit [Quit: Quitte]
ruby32 has quit [Read error: No route to host]
<lgierth>
whyrusleeping: i think biham might be offline for a day or two for the repo migration
<whyrusleeping>
a day or two? damn
<whyrusleeping>
okay
<lgierth>
ok maybe not that long
<lgierth>
half a day
<lgierth>
pollux was ~1.5T, biham is something between 5T and 10T
<lgierth>
i don't wanna scan the whole repo right now for the exact size