<wlan2_2>
I should probably set one up in my home server.
<redfish>
wlan2_2: the more, the merrier; wouldn't want ipfs.io's gateway to get overwhelmed if/when demand spikes
peteyg has quit [Read error: Connection reset by peer]
peteyg has joined #ipfs
<wlan2_2>
redfish: well my uplink to Internet isn't fast enough for such gateway to be actually recommended for public use, though.
peteyg has quit [Read error: Connection reset by peer]
uncredulou has joined #ipfs
jhulten has joined #ipfs
patcon has joined #ipfs
r04r is now known as zz_r04r
Matoro has joined #ipfs
peteyg has joined #ipfs
neurosis12 has joined #ipfs
neurosis12 has quit [Changing host]
neurosis12 has joined #ipfs
peteyg has quit [Read error: Connection reset by peer]
peteyg has joined #ipfs
cemerick has quit [Ping timeout: 245 seconds]
* wlan2_2
thinks it would be awesome to be able to bootstrap using networkwise closeby nodes in addition to the bootstrap nodes.
fiatjaf has joined #ipfs
uncredulou has quit [Remote host closed the connection]
<redfish>
wlan2_2: yeah, public gateways ideally should be on high-bandwidth VPSs (the one I linked to is)
ygrek_ has joined #ipfs
jfis has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
<wlan2_2>
redfish: then I probably should not be running a public one until I assure I can afford to pay 5€ a month on a VPS for that speciphic purpose for long periods.
ygrek has quit [Ping timeout: 264 seconds]
ygrek_ has quit [Ping timeout: 240 seconds]
elasticdog has quit [Ping timeout: 276 seconds]
jfis has joined #ipfs
patcon has quit [Ping timeout: 264 seconds]
ygrek_ has joined #ipfs
<redfish>
wlan2_2: yeah, I use my VPS for a few other purposes, so IPFS was just a small cheap thing to add
<wlan2_2>
redfish: I forgot to ask, what is the expectable disk and memory footprint for a public gateway?
<redfish>
wlan2_2: I could only tell you what it's using while basically idle (since few users): memory ~128MB says 'top', disk usage for data repository is controllable via config file (I set it to a few GB). In summary, ipfs daemon seems very lightweight.
metaf5 has quit [Quit: WeeChat 1.3]
jrabbit has quit [Ping timeout: 245 seconds]
<wlan2_2>
redfish: It looks like you can have only one mutable per instance. Does that instance need to be running for the ipns to resolve?
voxelot has quit [Ping timeout: 250 seconds]
voxelot has joined #ipfs
Akaibu has quit [Quit: Connection closed for inactivity]
wlan2_2 has quit [Quit: AtomicIRC: The nuclear option.]
<richardlitt>
.tell lgierth to prepare his sprint for tomorrow
voxelot has quit [Ping timeout: 240 seconds]
dignifiedquire has quit [Quit: Connection closed for inactivity]
jfis has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
enterocinetic has joined #ipfs
voxelot has joined #ipfs
Tv` has quit [Quit: Connection closed for inactivity]
fiatjaf has quit [Remote host closed the connection]
groxx has joined #ipfs
_rht has joined #ipfs
voxelot has quit [Ping timeout: 240 seconds]
voxelot has joined #ipfs
voxelot has quit [Ping timeout: 240 seconds]
voxelot has joined #ipfs
simonv3 has joined #ipfs
uhhyeahbret has joined #ipfs
uhhyeahbret has quit [Client Quit]
uhhyeahbret has joined #ipfs
patcon has joined #ipfs
anticore has quit [Ping timeout: 240 seconds]
computerfreak has joined #ipfs
voxelot has quit [Quit: Leaving]
patcon has quit [Ping timeout: 240 seconds]
chris6131 has quit [Read error: Connection reset by peer]
enterocinetic has quit [Ping timeout: 255 seconds]
prosoma has joined #ipfs
prf has quit [Remote host closed the connection]
<Kubuxu>
lgierth: If you tweak it for more performance, ofc.
yellowsir has joined #ipfs
voxelot has joined #ipfs
patcon has joined #ipfs
IlanGodik has joined #ipfs
yellowsir has left #ipfs [#ipfs]
jhulten has quit [Ping timeout: 240 seconds]
ylp1 has joined #ipfs
mildred has joined #ipfs
Akaibu is now known as shrek
shrek is now known as Guest28345
Guest28345 is now known as akaibu
akaibu is now known as Akaibu
rombou has joined #ipfs
Akaibu is now known as kool-aid-man
_rht has quit [Quit: Connection closed for inactivity]
kool-aid-man is now known as teh_police
rombou has quit [Ping timeout: 260 seconds]
teh_police is now known as teh_partyvan
elima has joined #ipfs
zz_r04r is now known as r04r
patcon has quit [Ping timeout: 265 seconds]
groxx has quit [Quit: Connection closed for inactivity]
reit has joined #ipfs
patcon has joined #ipfs
rombou has joined #ipfs
rombou has quit [Client Quit]
konubinix_ has quit [Ping timeout: 245 seconds]
mildred has quit [Ping timeout: 260 seconds]
rombou has joined #ipfs
konubinix has joined #ipfs
mildred has joined #ipfs
simonv3 has quit [Quit: Connection closed for inactivity]
dignifiedquire has joined #ipfs
rendar has joined #ipfs
jfis has joined #ipfs
shyamsk has quit [Ping timeout: 276 seconds]
shyamsk has joined #ipfs
patcon has quit [Ping timeout: 255 seconds]
rombou has quit [Ping timeout: 260 seconds]
patcon has joined #ipfs
<dignifiedquire>
good morning everyone
<Stskeeps>
morn
zorglub27 has joined #ipfs
ygrek_ has quit [Ping timeout: 260 seconds]
voxelot has quit [Ping timeout: 250 seconds]
s_kunk has joined #ipfs
spikebike has quit [Ping timeout: 265 seconds]
IlanGodik has quit [Quit: Connection closed for inactivity]
patcon has quit [Ping timeout: 245 seconds]
rombou has joined #ipfs
rombou has left #ipfs [#ipfs]
<Codebird>
Morning.
<chriscool>
Good morning!
computerfreak has quit [Remote host closed the connection]
anticore has joined #ipfs
rombou has joined #ipfs
rombou has left #ipfs [#ipfs]
ulrichard has joined #ipfs
<jbenet>
morning
ecloud has quit [Ping timeout: 256 seconds]
ecloud has joined #ipfs
teh_partyvan has quit [Quit: Connection closed for inactivity]
maxlath has joined #ipfs
zorglub27 has quit [Ping timeout: 240 seconds]
maxlath is now known as zorglub27
<Kubuxu>
morning
<Codebird>
Bah. Another drive gone.
<Codebird>
Do not buy those 8TB Seagate SMR drives! They suck!
<Kubuxu>
I've heard that they suck.
<Codebird>
They have issues. Under certain patterns of write activity they'll start silently corrupting data, or just die and require a power cycle, or both.
<Codebird>
And sometimes corrupt their internal structures to the point the drive no longer functions at all.
<Codebird>
This one, though, just has a read error.
Encrypt has joined #ipfs
zorglub27 has quit [Read error: Connection reset by peer]
chriscool has quit [Ping timeout: 276 seconds]
rombou has joined #ipfs
computerfreak has joined #ipfs
zorglub27 has joined #ipfs
m0ns00n has joined #ipfs
<Kubuxu>
Isn't it definition of drive that should land in rubbish bin?
m0ns00n has quit [Client Quit]
m0ns00n has joined #ipfs
yellowsir has joined #ipfs
anticore has quit [Ping timeout: 256 seconds]
rombou has quit [Ping timeout: 260 seconds]
anticore has joined #ipfs
O47m341 has quit [Ping timeout: 256 seconds]
anticore has quit [Quit: bye]
keorn has joined #ipfs
rombou has joined #ipfs
O47m341 has joined #ipfs
zorglub27 has quit [Ping timeout: 265 seconds]
M-whyrusleeping has quit [Quit: node-irc says goodbye]
e-lima has joined #ipfs
elima has quit [Ping timeout: 256 seconds]
Encrypt has quit [Quit: Quitte]
zorglub27 has joined #ipfs
voxelot has joined #ipfs
rombou has left #ipfs [#ipfs]
kalkin- has joined #ipfs
<kalkin->
hi
<kalkin->
I do not understand if ipfs saves everything, who is paying for storage?
<kalkin->
I.e. in Freenet you allocate some part of your disk space for Freenet data
<yellowsir>
ipfs does not save random stuff, it only saves what you request add or pin
<kalkin->
yellowsir: where does it saves the added and pined data, besides on my machine?
chriscool has joined #ipfs
<yellowsir>
as far as i know that only happens if people start requesting your data
<yellowsir>
if your data is not popular, you have to care about hosting it on other hosts by yourself
<M-roblabla1>
Only on your machine afaik
<M-roblabla1>
(IIRC)
<Codebird>
As I understand it, anyone who views your data also serves it to others. So the number of hosts increases with demand.
<M-roblabla1>
You have to add if to other machines yourself. Which is where filecoins come into play.
<kalkin->
Reading some russian article on IPFS looks like it's more like bitterrent. Every one who has a copy is a peer
<Codebird>
Data is fragile if no-one ever requests it, but that's an inescapble limitation: There is only so much storage in play.
<kalkin->
Thanks for the clarification guys
Teruyuki has joined #ipfs
teh_partyvan has joined #ipfs
<kalkin->
Is it possible to distrubte the data encrypted, so only machines/people who i give the key to are able to sync and work with the data?
<kalkin->
Or is everything public in ipfs?
<Stskeeps>
kalkin-: encrypted data is just data deep down
<Codebird>
Not as part of IPFS, but there's nothing to stop you encrypting a file before you add it.
<Codebird>
Put it in a passworded 7z file or something.
<kalkin->
Codebird: i want to use fuse
prosoma has quit [Ping timeout: 245 seconds]
<kalkin->
but i fear that a luks container in a file would be to slow for ipfs
<Kubuxu>
kalkin-: there are plans for build in encryption but few things have to be done first.
<kalkin->
i.e. if i create an 512MB ipfs luks container it need to download the whole file before mounting
<Codebird>
What would be the purpose of encryption? That seems to be something best handled externally.
<kalkin->
I guess you could use encfs, which encrypts on file level but it's also not great
<kalkin->
Codebird: I want to share some data between my machines via ipfs, but no one else should see this data.
<kalkin->
i guess something simmilar to git-annex
<Ape>
You could use ipfs with git-annex
<Kubuxu>
Codebird: encryption would be transparent, want to make webpage usable by only few people? Encrypt it and share key with them.
<lgierth>
Kubuxu: ok sure -- can i see code? :)
<Kubuxu>
lgierth: pushing to git.
shyamsk has quit [Ping timeout: 260 seconds]
shyamsk has joined #ipfs
BananaLotus has quit [Remote host closed the connection]
guruvan has quit [Remote host closed the connection]
<Kubuxu>
It might not be beautiful but works, with caching it should be as fast as normal gateway if run on host that already is gateway.
<Kubuxu>
Also nothing prevents you from running two versions of IPFS on one node, one just won't be used for bootstrapping.
<patagonicus>
kalkin-: It should be possible to open a LUKS container without downloading it completely - LUKS is designed for random access - but IPFS does not "like" data that is changing, which means you'd have to modify the data in the container and then add the "new" LUKS volume which currently means that you need the whole file.
<patagonicus>
But if it's for read-only it should just work.
<kalkin->
patagonicus: thanks for the explanation.
<kalkin->
so i undestand right, that when i mount ipfs and access a dir it shows me a file, but the actual content of the file is not yet local? it will only fetch the needed bits on access?
hellertime has joined #ipfs
Myagui has quit [Ping timeout: 265 seconds]
<patagonicus>
I haven't tried with fuse, but the HTTP gateway can do streaming and jumping to different parts of the file, without having to download the whole file.
<Ape>
Yeah, it works with fuse, too. You only download the parts you use
<Ape>
You can use 'ipfs pin' to download something completely
<myveryown>
Hi All ... looking for a bit of help if you can please? Got IPFS running on Raspi Pi 2 .. but the webui says 0 connections - i can do the ipfs cat readme stuff and that works ok but would like gui to help me publish files etc
<myveryown>
am using 5001 .. returns the GUI but on home page i dont have a peer id or anything
<lgierth>
thanks Kubuxu, i'll have a look in a bit :)
<myveryown>
no agent version no protocol version - its just all empty
<dignifiedquire>
myveryown: ah okay
flounders has joined #ipfs
<dignifiedquire>
also this guide is not entriely correct, there is no need to clone the webui, you can just get it via localhost:5001/webui and it downloads it automatically
<dignifiedquire>
how are you accessing the webui, over the network or directly on the box?
<myveryown>
direct on box with iceweasel browser - and i connect to box via vnc
<myveryown>
i could remove the git clone and re load webui and let it re download n see what happens
<dignifiedquire>
okay, can you open the developer tools and tell me what errors are in the console?
<myveryown>
how would i open the developer tools?
<dignifiedquire>
probably right click on some element on the page and then something like "inspect element"
<myveryown>
my config page is blank
<dignifiedquire>
(developer console from the browser)
<myveryown>
yeah ok got that open
<cow_2001>
is there a browser plugin that takes an address that fits the /ipfs/.../ mould and uses an hash function to see if the data fits?
<cow_2001>
i mean, uses the multihash function
<dignifiedquire>
myveryown: there should be a tab called "console", are there any messages in there?
<cow_2001>
it can be useful for single files hosted on gateways
<dignifiedquire>
also is your daemon running?
<myveryown>
yes the daemon is running and nothing in the console for errors or any warnings etc
<dignifiedquire>
hmm try reloading the page and see if errors start showing up
<myveryown>
hmmm .. i just rebooted to make sure everything was fresh and now its working ... 3 reboots last night n at midnight i tweeted n got sent here - thanks soo much for quick response now i got the gui up i going to play some more
<dignifiedquire>
you can always come back if you have further issues/questions
simonv3 has joined #ipfs
<myveryown>
dignifiedquire - me too .. got some docs i want to publish on IPFS as i think its hella cool
mildred has quit [Quit: Leaving.]
<myveryown>
the only thing i did diff this time - was i did not bother to use npm start in the webui folder i just loaded the localhost:5001/webui url - so you may wish to update the webui readme.md thats on github
IlanGodik has joined #ipfs
ulrichard has quit [Read error: Connection reset by peer]
<dignifiedquire>
yeah already left a comment on that article, you don't need to anything in that section (cloning, installing node, etc.) the webui is distributed via that url. The setup there described is if you want to develop the webui
<Kubuxu>
Does someone has v04 IPv6 node running, I can't connect to two I know of.
<dignifiedquire>
Kubuxu: I got a 04 node running, with v6 addresses
<Kubuxu>
dignifiedquire: can you send me peering info?
<dignifiedquire>
Kubuxu: here is my id:QmdzFAbnFTXCr7RRzsYE1vXKbPzvisyC7EHqXr4zyfnumr
<dignifiedquire>
is that enough, or do you need more?
<ion>
cat config … >config might do bad things. You'll want to use sponge.
<achin>
mrow
<Kubuxu>
Yup, just got caught on it, already fixed it.
<Kubuxu>
It is my fix for IPFS not saving used addresses for future bootstrapping.
<Kubuxu>
s/used/known
<richardlitt>
All week, yep!
<achin>
woo!
<lgierth>
richardlitt: so, rptin sync tomorrow?
<lgierth>
s/rptin/sprint/ :)
<whyrusleeping>
lgierth: I heard that sarcasm
<lgierth>
:)
bedeho has quit [Ping timeout: 240 seconds]
<dignifiedquire>
whyrusleeping: we need proof
<dignifiedquire>
;)
<dignifiedquire>
jbenet: now that the sprint is pretty much canceled are you around for a quick chat?
prf has quit [Remote host closed the connection]
<whyrusleeping>
dignifiedquire: jbenet is gone for ever
<dignifiedquire>
lol
<dignifiedquire>
bus factor? ;)
<richardlitt>
Yes. I think so.
prf has joined #ipfs
<dignifiedquire>
great, so if you don't make it back ipfs is pretty much dead or woot?
<dignifiedquire>
or I got to do it all by myself :(
<lgierth>
there's one more person with infrastructure access, at least
<dignifiedquire>
true
<dignifiedquire>
so lgierth does infra and I need to learn go :/
<lgierth>
both of us
<richardlitt>
Yeah. You guys should have the chat if you like?
<lgierth>
unless you're gonna take on SmartSwarm (tm)
<dignifiedquire>
SmartSwarm oo
<dignifiedquire>
richardlitt: are we skipping completely or do we do it tomorrow?
<richardlitt>
Let's do it tomorrow.
<dignifiedquire>
ok
<whyrusleeping>
dignifiedquire: go home
<dignifiedquire>
whyrusleeping: I am home
<voxelot>
i'm home too! mlk day ftw
bedeho has joined #ipfs
Teruyuki has quit [Ping timeout: 260 seconds]
Soft has quit [Read error: Connection reset by peer]
vijayee has joined #ipfs
m0ns00n has quit [Quit: undefined]
m0ns00n has joined #ipfs
m0ns00n has quit [Client Quit]
m0ns00n has joined #ipfs
Soft has joined #ipfs
jhulten has joined #ipfs
libman has joined #ipfs
s_kunk has quit [Ping timeout: 240 seconds]
<jbenet>
richardlitt: are you guys actually going to be able to do tomorrow?
m0ns00n has quit [Quit: undefined]
<jbenet>
richardlitt whyrusleeping if you're going to skip it tomorrow too, then we'll do it today. It's not good to just move the sprint moments before it starts. Other people make plans to stick to the schedule we have, for example I booked a flight tomorrow and not today to not interfere with the sprint.
ygrek_ has joined #ipfs
voxelot has quit [Ping timeout: 240 seconds]
m0ns00n has joined #ipfs
devbug has joined #ipfs
The_8472 has quit [Ping timeout: 264 seconds]
<dignifiedquire>
jbenet: are we doing some hangouts now or not?
Peer3Peer has joined #ipfs
<jbenet>
dignifiedquire: idk. i think lgierth and i can probably discuss infra stuff later (lgierth: 040 stuff, and notices)
voxelot has joined #ipfs
<jbenet>
dignifiedquire: i dont have anything for ipfs apps myself, if you do and want to talk today, happy to discuss it. but the others may be here tomorrow.
<dignifiedquire>
jbenet: not enough to fill a full sync so will try doing that tomorroe
reit has quit [Ping timeout: 264 seconds]
m0ns00n has quit [Quit: undefined]
m0ns00n has joined #ipfs
m0ns00n has quit [Client Quit]
m0ns00n has joined #ipfs
m0ns00n has quit [Client Quit]
Peer3Peer has quit [Quit: Peer3Peer]
Matoro has quit [Ping timeout: 265 seconds]
<noffle>
sorry about this, we did a poor job of communicating D:
<lgierth>
will take care of it, writing up notes and getting something to eat beforehand
<lgierth>
ssl will have to wait til tomorrow or so
tanizaki has joined #ipfs
metaf5 has joined #ipfs
keorn has quit [Ping timeout: 260 seconds]
<jbenet>
dignifiedquire: lgierth we can use dnslink
ispeedtoo has quit [Quit: Page closed]
<jbenet>
and A records to gateway
<lgierth>
yeah
<lgierth>
dignifiedquire: that hash ^ ?
<dignifiedquire>
yep, it's on the 0.4 network
<dignifiedquire>
pinning on biham right now
<lgierth>
oh yeah we need to update pinbot too
hashcore has quit [Quit: Leaving]
<jbenet>
We should get it onto the 0.3 net too
<tanizaki>
Dear Community, I am writing to enquire about ipfs and networking. Would you mind recommending any preliminary reading list on p2p, ipfs, dhts, algorithms and related topics? What is the background knowledge required to understand how ipfs works (including DAGs, content-addressed file systems, etc)? I would be glad to receive any suggestions of books, papers, articles or other resource. My email is junichro.tanizaki at gmail dot com.
<tanizaki>
Could you please also tell me how ipfs relates to gnunet? Both projects seem to have common objectives.
<lgierth>
is that ok? i'm getting something to eat and will be back in a bit
<jbenet>
tanizaki look at github.com/ipfs/papers github.com/ipfs/specs (particularly network) and github.com/ipfs/faq
m0ns00nfup has joined #ipfs
<ianopolous2>
jbenet: we're about to do a "multi-key-pair" format for peergos, but last time I checked there wasn't an equivalent for IPNS signing keys yet, particularly for Ed25519 keys. Is that still the case?
ianopolous2 is now known as ianopolous
<whyrusleeping>
ianopolous: we just use a protobuf right now
<whyrusleeping>
its not the 'final' thing we want
<daviddias>
tanizaki: have you had the chance to go through the IPFS paper and the papers that it references?
<whyrusleeping>
so any work you do towards that would be interesting
<tanizaki>
Jbenet, I am very lucky to have an opportunity to talk to you! Do you have any resources or skills you consider crucial to be able to contribute to ipfs as a developer?
<daviddias>
tanizaki: nevertheless, if you are starting from scratch, better try to understand how IPFS works by its subsystems
<daviddias>
libp2p, the network layer, has its spec here https://github.com/ipfs/specs/tree/master/libp2p, it includes everything related with networking (Routing, DHT, Peer Discovery, Dialing, Stream Multiplexing, etc)
rombou has quit [Ping timeout: 240 seconds]
chriscool has quit [Quit: Leaving.]
nashant has quit [Ping timeout: 265 seconds]
Not_ has joined #ipfs
chriscool has joined #ipfs
<ianopolous>
whyrusleeping: okay thanks. We only need to support one kind - Ed25519, but I was just thinking a header byte which specifies the type, and each type can have it's own decoding after that. In Ed25519, it's a fixed 32 bytes after the header for a public key.
<tanizaki>
Daviddias, thank you very much for your question and recommendations! I have seen the paper, and it presupposes a great deal about, as you have mentioned, its subsystems, as well as knowledge about the structure of DAG and distributed systems in general. I would definitely delve into the resources you have given.
<jbenet>
ianopolous: the multikey spec I'm writing depends on ipld. This is because I want to be able to link between keys and to algorithms themselves. It's more involved than multihash. You can do what you describe if you want it ready now.
<ianopolous>
jbenet: so a key might have a direct link to the code for it's algorithm? nice.
m0ns00nfup has quit [Quit: undefined]
O47m341 has quit [Ping timeout: 260 seconds]
m0ns00nfup has joined #ipfs
<jbenet>
ianopolous: yep :)
<jbenet>
ianopolous: want it to be so you can check signatures of stuff with new algorithms
reit has joined #ipfs
<ianopolous>
jbenet: sounds awesome
<ianopolous>
code is data is code
prf has quit [Remote host closed the connection]
Encrypt has joined #ipfs
e-lima has quit [Ping timeout: 255 seconds]
<Kubuxu>
jbenet: Small request: nice summary of recommended IPFS URI handling would be great. https://github.com/ipfs/go-ipfs/issues/1678 is really messy, in wrong place, linked comment is probably not the one supposed to be linked and people are still confused about it. It would be nice thing to clear up finally.
tanizaki has quit [Ping timeout: 252 seconds]
m0ns00nfup has quit [Quit: undefined]
m0ns00nfup has joined #ipfs
O47m341 has joined #ipfs
<ipfsbot>
[go-ipfs] Foxcool opened pull request #2218: Minor change: Show link to quickly copy-paste when adding file (master...master) https://github.com/ipfs/go-ipfs/pull/2218
tlevine has joined #ipfs
tlevine has quit [Client Quit]
tlevine has joined #ipfs
rombou has joined #ipfs
O47m341 has quit [Ping timeout: 276 seconds]
reit has quit [Quit: Leaving]
<lgierth>
achin: sorry i didn't get to look more into the wikispecies thing -- on the upside i'm pretty sure it's related to the sheer size of these directories (in terms of links), and directory sharding is going to solve this very very soon
<lgierth>
battery's running out any moment, heading hoe
<achin>
lgierth: pind me when you get back, i want to run a thought by you
reit has joined #ipfs
Matoro has quit [Ping timeout: 245 seconds]
gaboose has joined #ipfs
<lgierth>
achin:
<achin>
ohi!
<achin>
i agree that the massive number of links per directoy was a problem, but did you see the follow up comment i made? i manually sharded the directories (each has no more than ~300 links), yet still some problems remine
<achin>
i am concerned there is some other stuble problem at play