<muvlon>
the paper mentions a method called "ProvideValue" that announces your node can serve some large value
<muvlon>
implying it's only needed for large objects? i'm not sure
<Remramm>
The usual DHT trick is to store the value itself directly in the DHT if it's small, or PeerIDs if it's too large
<Remramm>
Thanks!
<muvlon>
still, i think you were right
<muvlon>
there's definitely some "pushing" going on too
<muvlon>
and jbenet mentions this being unoptimized
infinity0 has quit [Remote host closed the connection]
infinity0 has joined #ipfs
<kevina>
that was a failed test, sorry for the noise
espadrine has quit [Ping timeout: 260 seconds]
cubemonkey has quit [Ping timeout: 250 seconds]
tilgovi has quit [Ping timeout: 240 seconds]
Akaibu has quit [Quit: Connection closed for inactivity]
Akaibu has joined #ipfs
ylp has joined #ipfs
ppham has joined #ipfs
so has joined #ipfs
ylp has quit [Ping timeout: 260 seconds]
ylp has joined #ipfs
anonymuse has joined #ipfs
ylp has quit [Ping timeout: 260 seconds]
Kingsquee has joined #ipfs
cemerick has joined #ipfs
ppham has quit [Remote host closed the connection]
ppham has joined #ipfs
ppham has quit [Remote host closed the connection]
ppham has joined #ipfs
ppham has quit [Ping timeout: 248 seconds]
webdev007 has quit [Ping timeout: 250 seconds]
seafood has quit [Quit: seafood]
seafood has joined #ipfs
seafood has quit [Client Quit]
lkcl has joined #ipfs
webdev007 has joined #ipfs
ylp has joined #ipfs
retrohacker has quit [Quit: Connection closed for inactivity]
anonymuse has quit [Remote host closed the connection]
kevina has quit [Quit: Leaving]
ckwaldon has joined #ipfs
ylp has quit [Ping timeout: 260 seconds]
infinity0 has quit [Ping timeout: 248 seconds]
mguentner has quit [Quit: WeeChat 1.6]
revfan[m] has joined #ipfs
<Remramm>
There's *a lot* of pushing
infinity0 has joined #ipfs
mguentner has joined #ipfs
ylp has joined #ipfs
seafood has joined #ipfs
ylp has quit [Ping timeout: 260 seconds]
ckwaldon has quit [Ping timeout: 252 seconds]
ckwaldon has joined #ipfs
ckwaldon1 has joined #ipfs
ckwaldon has quit [Ping timeout: 258 seconds]
ckwaldon1 is now known as ckwaldon
robattila256 has joined #ipfs
mguentner2 has joined #ipfs
mguentner has quit [Ping timeout: 258 seconds]
ckwaldon1 has joined #ipfs
ckwaldon1 is now known as ckwaldon
ckwaldon has quit [Ping timeout: 265 seconds]
ygrek_ has joined #ipfs
f[x] has quit [Ping timeout: 250 seconds]
webdev007 has quit [Ping timeout: 258 seconds]
ygrek_ has quit [Ping timeout: 258 seconds]
palkeo has joined #ipfs
ylp has joined #ipfs
palkeo has quit [Quit: Konversation terminated!]
slothbag has joined #ipfs
ylp has quit [Ping timeout: 260 seconds]
seafood has quit [Quit: seafood]
ulrichard has quit [Remote host closed the connection]
pfrazee has quit [Remote host closed the connection]
pfrazee has joined #ipfs
slothbag has left #ipfs [#ipfs]
lacour has quit [Quit: Leaving]
pfrazee has quit [Ping timeout: 245 seconds]
ckwaldon has joined #ipfs
fleeky_ has quit [Ping timeout: 258 seconds]
ckwaldon has quit [Read error: Connection reset by peer]
ckwaldon has joined #ipfs
ulrichard has joined #ipfs
ulrichard has quit [Remote host closed the connection]
ckwaldon1 has joined #ipfs
ckwaldon has quit [Ping timeout: 250 seconds]
ckwaldon1 is now known as ckwaldon
cemerick has quit [Ping timeout: 250 seconds]
ygrek_ has joined #ipfs
ckwaldon has quit [Ping timeout: 260 seconds]
chris613 has quit [Quit: Leaving.]
ckwaldon has joined #ipfs
ckwaldon has quit [Ping timeout: 246 seconds]
ckwaldon has joined #ipfs
ylp has joined #ipfs
ckwaldon has quit [Read error: Connection reset by peer]
ckwaldon has joined #ipfs
ylp has quit [Ping timeout: 260 seconds]
muvlon has quit [Ping timeout: 258 seconds]
diffalot has joined #ipfs
ckwaldon has quit [Ping timeout: 245 seconds]
diffalot_ has quit [Ping timeout: 258 seconds]
wallacoloo____ has joined #ipfs
muvlon has joined #ipfs
ckwaldon has joined #ipfs
seafood has joined #ipfs
<Kubuxu>
Remramm: yes, currently we are storing provider record for every block we have, and periodically republish them.
<Kubuxu>
provider record: BLOCK_HASH => PEER_ID
<Kubuxu>
I have the bot ignored.
ckwaldon1 has joined #ipfs
ckwaldon has quit [Ping timeout: 268 seconds]
ckwaldon1 is now known as ckwaldon
seafood has quit [Client Quit]
ckwaldon has quit [Read error: Connection reset by peer]
ckwaldon1 has joined #ipfs
ckwaldon has joined #ipfs
ckwaldon1 has quit [Ping timeout: 248 seconds]
ulrichard has joined #ipfs
kulelu88 has quit [Quit: Leaving]
ckwaldon1 has joined #ipfs
ckwaldon has quit [Ping timeout: 258 seconds]
ckwaldon1 is now known as ckwaldon
rendar has joined #ipfs
mildred has joined #ipfs
john1 has quit [Ping timeout: 260 seconds]
koshii has quit [Ping timeout: 258 seconds]
ylp has joined #ipfs
elico has joined #ipfs
ckwaldon1 has joined #ipfs
ckwaldon has quit [Ping timeout: 258 seconds]
ckwaldon1 is now known as ckwaldon
wallacoloo____ has quit [Quit: wallacoloo____]
s_kunk has quit [Quit: Read error: Connection reset by beer]
koshii has joined #ipfs
ylp1 has joined #ipfs
ckwaldon has quit [Read error: Connection reset by peer]
ckwaldon has joined #ipfs
ianopolous has joined #ipfs
flyingzumwalt has quit [Quit: Connection closed for inactivity]
dze[m] has joined #ipfs
ianopolous has quit [Ping timeout: 256 seconds]
herzmeister has quit [Quit: Leaving]
vasild has joined #ipfs
<Hijiri>
did the guy who wanted to make some kind of mmo in ipfs produce something?
espadrine has joined #ipfs
dze[m] has left #ipfs ["User left"]
JustinDrake has joined #ipfs
JustinDrake has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
ckwaldon has quit [Ping timeout: 265 seconds]
Kingsquee has quit [Quit: Konversation terminated!]
ckwaldon has joined #ipfs
pcre has joined #ipfs
pcre has quit [Client Quit]
_whitelogger has joined #ipfs
chriscool has joined #ipfs
JustinDrake has joined #ipfs
Akaibu has quit [Quit: Connection closed for inactivity]
ygrek_ has quit [Ping timeout: 268 seconds]
JustinDrake has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
ckwaldon1 has joined #ipfs
ckwaldon has quit [Ping timeout: 256 seconds]
ckwaldon1 is now known as ckwaldon
JustinDrake has joined #ipfs
ckwaldon1 has joined #ipfs
ckwaldon has quit [Ping timeout: 246 seconds]
ckwaldon1 is now known as ckwaldon
ckwaldon has quit [Read error: Connection reset by peer]
ckwaldon has joined #ipfs
JustinDrake has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
espadrine has quit [Ping timeout: 265 seconds]
ckwaldon has quit [Ping timeout: 250 seconds]
ckwaldon1 has joined #ipfs
ckwaldon1 is now known as ckwaldon
espadrine has joined #ipfs
john1 has joined #ipfs
slothbag has joined #ipfs
slothbag has left #ipfs [#ipfs]
<vasild>
I want to create some examples of "ipfs dht get". What commands should I execute in order to get "ipfs dht get" to produce some output? I tried "ipfs add somefile", but then "ipfs dht get the_id_returned_by_ipfs_add" returns nothing.
<Kubuxu>
vasild: you would have to decode the key from base58 I think
<vasild>
hmm, you mean that "ipfs dht get" does not take a multihash as an argument?
<Kubuxu>
no, it takes literal request to the network
<Kubuxu>
the DHT network
<vasild>
USAGE
<vasild>
<key>... - The key to find a value for.
<Kubuxu>
it takes multihash in binary form, not base58 encoded
<vasild>
"ipfs dht get -" does not read from stdin
<Kubuxu>
hmm
<alterego>
lol
<Kubuxu>
this is oversight, looks like you are out of luck with this example
<vasild>
I want to implement dht get in https://github.com/vasild/cpp-ipfs-api but want to have some example that when executed actually does something and produces some output
<vasild>
that is - to demonstrate that it works
JustinDrake has joined #ipfs
<alterego>
I wouldn't bother, the command is kinda useless atm.
<vasild>
also tried passing 'QmZSb7SYajaEEbJU2FB4XJWWfxX9AjwmdreK5MDu9zuQvn' as a string (without decoding it to binary) as key, same result - "not found"
<Kubuxu>
vasild: no idea about the error, I am traveling right now so I won't be able to help you more
<vasild>
no worries :)
<vasild>
alright, now this is strange: https://pastebin.mozilla.org/8955780, from JS, dht.put() succeeds, but then trying to dht.get() the same key fails
<Kubuxu>
vasild: yeah, get will fail for arbitrary keys
<Kubuxu>
as selector for it is not defined
<vasild>
but I just managed to dht.put() that key?
<JustinDrake>
Given a block hash, how does one find where that block is stored in the `.ipfs/blocks/` folder?
<Kubuxu>
JustinDrake: currently it is `base32encode-nopad(base58-decode(HASH))
<Kubuxu>
kevina is working on specking out new sharding so it is more clear.
<JustinDrake>
Kubuxu: Thanks! In the `.ipfs/blocks` folder, I see the 512 way sharding with 512 5-digit folders starting `CIQ`. There's also this one folder `AFKRE`. Do you what that is?
ckwaldon1 has joined #ipfs
ckwaldon has quit [Ping timeout: 248 seconds]
ckwaldon1 is now known as ckwaldon
<Kubuxu>
were you using CIDv1 with this repo
<Kubuxu>
?
<JustinDrake>
I am on Master.
<JustinDrake>
I see there's a reference to this folder in issue 3463.
<Kubuxu>
yeah, so this directory would contain blocks that are CIDv1 instead of v0
<Kubuxu>
and it is the reason we are changing sharing of the flatfs repo
<JustinDrake>
It's strange though, because the folder referenced is AFZBE, but I have AFKRE
<Kubuxu>
it will depend on type of block in CIDv1 format that was stored in the repo
<Kubuxu>
raw-leaf vs protobuf vs cbor
JustinDrake has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
john1 has quit [Ping timeout: 260 seconds]
JustinDrake has joined #ipfs
Encrypt has joined #ipfs
ppham has joined #ipfs
ppham has quit [Remote host closed the connection]
ppham has joined #ipfs
<JustinDrake>
Is there a max block size? Could a malicious actor share a block hash which initiates the download of a single 1TB download which is only hashed when the download finishes?
<dignifiedquire>
mappings for the "ipfs files" command
<dignifiedquire>
various other bits and pieces ipfs needs to operate and is not stored as a block
fleeky has joined #ipfs
ppham has quit [Remote host closed the connection]
<dignifiedquire>
victorbjelkholm: aroundß
ppham has joined #ipfs
seafood has joined #ipfs
ppham has quit [Remote host closed the connection]
ppham has joined #ipfs
<victorbjelkholm[>
dignifiedquire: kindish, not around a computer atm
<dignifiedquire>
okay, well if you find some time in the next days, I have updated js-ipfs-api docs pr with an intro section and published a preview. I could use some help filling out all them methods :)
<victorbjelkholm[>
Ah, cool, add a reminder and will check it out :)
ppham has quit [Ping timeout: 258 seconds]
<dignifiedquire>
thank you =)
jokoon has quit [Read error: Connection reset by peer]
pfrazee has joined #ipfs
anonymuse has joined #ipfs
ckwaldon1 has joined #ipfs
ckwaldon has quit [Ping timeout: 252 seconds]
ckwaldon1 is now known as ckwaldon
<JustinDrake>
Is the config option StorageMax actually enforced? I can't see any code for it.
john1 has joined #ipfs
ckwaldon has quit [Ping timeout: 245 seconds]
ckwaldon has joined #ipfs
chris613 has joined #ipfs
seafood has quit [Quit: seafood]
edhr[m] has joined #ipfs
edhr[m] has left #ipfs ["User left"]
<Kubuxu>
JustinDrake: I don't think hard limit is enforced, GC tries to keep storage below it
<JustinDrake>
Kubuxu: I also cannot see where the code to trigger the GC with StorageGCWatermark is.
<Kubuxu>
core/corerepo/gc.go :164
<Kubuxu>
same file :58 storage max is used to define level at which GC will run
<lgierth>
i updated it about storagemax just the other day :)
<JustinDrake>
cool :)
<dignifiedquire>
Kubuxu: lgierth as you both have much go knowledge, do you know about anything happening to files that are 64512 bytes or larger? when transferring data from js to go all is fine, until the file hits this size, (the other way go -> js works fine even for much larger items)
<Kubuxu>
are you sure your network layer is not at fault here?
<lgierth>
that's bitswap business eh?
<Kubuxu>
nah, not really
<Kubuxu>
it is still just one block
<Kubuxu>
so bw should send it as one "packet"
<dignifiedquire>
I don't know what's failing, it's just odd, that all is good, until this exact size and then it just hangs
ashark has joined #ipfs
shizy has joined #ipfs
<Kubuxu>
do js to js work with that?
<Kubuxu>
using smux (I think that is used for js-go comms).
pfrazee has quit [Remote host closed the connection]
ckwaldon1 has joined #ipfs
ckwaldon has quit [Ping timeout: 264 seconds]
ckwaldon1 is now known as ckwaldon
<lgierth>
Kubuxu: this is weird -- my changelog script spits out a few PRs that were supposed to be in v0.4.3
<lgierth>
dignifiedquire: there's also `ipfs log` for filtered logs (by subsystem, by level)
<dignifiedquire>
yeah already looking at all of that :) but it's noooot enough
<lgierth>
what does it lack?
ashark has joined #ipfs
flyingzumwalt has quit [Quit: Connection closed for inactivity]
<Guest94956[m]>
Hello world!
Guest106741[m] has joined #ipfs
<Guest106741[m]>
is there an ipfs server that is "open to the world", i.e., anyone with a javascript client can send files / information to that server from the web and communicate with IPFS?
<lgierth>
Guest106741[m]: we want to have the ipfs.io gateway writable to the public, but there's a few small things left to do for that
<Guest106741[m]>
aw, man
<lgierth>
for now you'll have to run your own node, with --writable (or Gateway.Writable in the config)
<Guest106741[m]>
for my use-case, i won't need ipfs anyway if people trust my node
<Guest106741[m]>
specifically, i'm looking for an anonymity layer
<Guest106741[m]>
i guess i could make a chrome add-on
<dignifiedquire>
lgierth: details about the incoming bitswap msgs and connections
<Guest106741[m]>
or a desktop app
<Guest106741[m]>
but then no-one would use it D:
<lgierth>
Guest106741[m]: ipfs browser addons are actually very high on the general want-list :)
<lgierth>
js-ipfs is pretty good now so someone might be able to pull it off
<Guest106741[m]>
for my use-case, messages and data are ephemeral. receivers of messages should only collect, read, then discard messages later. senders log in once and send, then never visit the site again (until they are / if they are requested to send another message).. so the setup time for installing an app isn't justified
<Guest106741[m]>
it's pretty weird that there are hundreds of free trials for stuff like push notifications, when i need the opposite, and there's nothing available
<Guest106741[m]>
there's no website where you can send a short message to someone without logging in
<Guest106741[m]>
ipfs is the closest thing i could think of and if there isn't a public node available for forwarding short messages, then i'm out of luck :(
reit has quit [Quit: Leaving]
tilgovi has joined #ipfs
Encrypt has quit [Quit: Quit]
ianopolous has joined #ipfs
arpu has quit [Quit: Ex-Chat]
ylp has quit [Ping timeout: 260 seconds]
ylp has joined #ipfs
ZaZ has joined #ipfs
<alterego>
Is there any decent visualisation tool for displaying DAGNodes?
<alterego>
Like, the DAG tree given a DAGNode as a root?
JustinDrake has joined #ipfs
tilgovi has quit [Remote host closed the connection]
tilgovi has joined #ipfs
kulelu88 has quit [Quit: Leaving]
ylp has quit [Ping timeout: 260 seconds]
ligi has quit [Quit: leaving]
ylp has joined #ipfs
kulelu88 has joined #ipfs
neuthral has joined #ipfs
ylp has quit [Ping timeout: 260 seconds]
ulrichard has quit [Remote host closed the connection]
maxlath has joined #ipfs
anonymus_ has quit [Remote host closed the connection]