stebalien changed the topic of #ipfs to: Heads Up: To talk, you need to register your nick! Announcements: go-ipfs 0.4.19 and js-ipfs 0.34 are out! Get them from dist.ipfs.io and npm respectively! | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS, the InterPlanetary FileSystem: https://github.com/ipfs/ipfs | Logs: https://view.matrix.org/room/!yhqiEdqNjyPbxtUjzm:matrix.org/ | Forums: https://discuss.ipfs.io | Code of
_nkls_ has quit [Remote host closed the connection]
_nkls_ has joined #ipfs
r0n1n has joined #ipfs
cthorley has quit [Ping timeout: 250 seconds]
_nkls_ has quit [Remote host closed the connection]
ronin has quit [Ping timeout: 276 seconds]
cthorley has joined #ipfs
_nkls_ has joined #ipfs
_nkls_ has quit [Remote host closed the connection]
cthorley has quit [Ping timeout: 244 seconds]
stavros has joined #ipfs
<stavros>
Hello
<stavros>
I run an IPFS pinning service, Eternum, and I'm having quite a few problems with the IPFS node's pinning interface (basically, the service is having major problems with the fact that it's synchronous)
griffinbyatt has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
<stavros>
I just discovered IPFS cluster and I'm wondering whether this might be the solution to my problems. Can I run a single IPFS Cluster instance (the master) on top of one IPFS node and have the Cluster instance manage all pins?
<stavros>
Is that indicated/useful? Will the Cluster instance work like a "download manager" of sorts?
jesse22 has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
<stavros>
Also, how stable is IPFS Cluster?
_nkls_ has joined #ipfs
_nkls_ has quit [Remote host closed the connection]
dsiypl4_ has quit [Ping timeout: 246 seconds]
chris613 has quit [Ping timeout: 246 seconds]
Fessus has joined #ipfs
chris613 has joined #ipfs
null1337 has quit [Quit: Never underestimate the power of stupid people in large groups.]
peaceguy has quit [Quit: leaving]
metadaemon has quit [Remote host closed the connection]
stavros_ has joined #ipfs
<stavros>
lgierth, perhaps?
<stavros>
Switching users
johnhmay has quit [Ping timeout: 258 seconds]
sebhoss has quit [Read error: Connection reset by peer]
andrewosh has quit [Ping timeout: 258 seconds]
prettymuchbryce has quit [Ping timeout: 258 seconds]
ec has quit [Ping timeout: 258 seconds]
achingbrain has quit [Ping timeout: 268 seconds]
metalrain has quit [Ping timeout: 250 seconds]
blahah_ has quit [Ping timeout: 264 seconds]
ctOS has quit [Ping timeout: 276 seconds]
jbenet has quit [Ping timeout: 276 seconds]
sneak has quit [Ping timeout: 252 seconds]
RamRanRa has quit [Read error: Connection reset by peer]
rvagg has quit [Ping timeout: 264 seconds]
merle_ has quit [Ping timeout: 268 seconds]
alanshaw has quit [Ping timeout: 240 seconds]
abhiyerr_ has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
jbenet has joined #ipfs
hacdias has quit [Ping timeout: 264 seconds]
victorbjelkholm has quit [Ping timeout: 276 seconds]
englishm has quit [Ping timeout: 258 seconds]
stavros has quit [Quit: Leaving]
lennox has joined #ipfs
jameshaydon has quit [Ping timeout: 240 seconds]
nickjohnson has quit [Ping timeout: 258 seconds]
zeden has joined #ipfs
voxelot has quit [Ping timeout: 250 seconds]
jesseclay has quit [Ping timeout: 252 seconds]
jbenet has quit [Ping timeout: 258 seconds]
merle_ has joined #ipfs
jameshaydon has joined #ipfs
cyfex has quit [Ping timeout: 276 seconds]
merle_ has quit [Ping timeout: 245 seconds]
cyfex has joined #ipfs
rvagg has joined #ipfs
prettymuchbryce has joined #ipfs
metalrain has joined #ipfs
ec has joined #ipfs
blahah_ has joined #ipfs
merle_ has joined #ipfs
sneak has joined #ipfs
jbenet has joined #ipfs
johnhmay has joined #ipfs
voxelot has joined #ipfs
jesseclay has joined #ipfs
alanshaw has joined #ipfs
achingbrain has joined #ipfs
andrewosh has joined #ipfs
englishm has joined #ipfs
godel[m] has joined #ipfs
nickjohnson has joined #ipfs
sebhoss has joined #ipfs
hacdias has joined #ipfs
ctOS has joined #ipfs
victorbjelkholm has joined #ipfs
boredmanicrobot has joined #ipfs
boredmanicrobot has quit [Client Quit]
_nkls_ has joined #ipfs
JonD has joined #ipfs
stavros_ is now known as stavors
stavors is now known as stavros
<stavros>
Anyone here familiar with IPFS Cluster?
godel[m] has left #ipfs ["User left"]
<postables1337[m]>
Yes ive been using it for about a year
<stavros>
postables1337[m]: Is it stable?
JonD has quit [Quit: Leaving]
<postables[m]>
Pretty damn stable, haven't had many issues. Most of the issues I've had are related to not properly bootstrapping a peer to the cluster, or some kind of network issue
<postables[m]>
depending on where your nodes are located, you may need to alter some config settings like setting higher heartbeat timeouts,
Bad_Fish_2 has joined #ipfs
user_51_ has joined #ipfs
Belkaar has quit [Ping timeout: 250 seconds]
<stavros>
postables[m]: That's great, thanks! How has pinning been? Is it retrying properly, etc?
<stavros>
My biggest issue right now is that pinning with the node is synchronous
<stavros>
I would like to make it async and it looks like IPFS cluster can do that
<postables[m]>
yea you can do multiple pins at the same time
Bad_Fish_2 has quit [Client Quit]
<postables[m]>
basically when you talk with IPFS cluster you tell the cluster to pin something, and it'll insert it into the queue. You can process up to i think 10 pins at a time or something like that but its configurable
Belkaar has joined #ipfs
Belkaar has joined #ipfs
verin0x has quit [Ping timeout: 258 seconds]
verin0x has joined #ipfs
user_51 has quit [Ping timeout: 255 seconds]
<stavros>
postables[m]: Do you know what happens if all 10 pins freeze (ie are waiting for data)?
<stavros>
Does it just never pin the rest?
<postables[m]>
pretty sure it just times out the pin like what happens with `go-ipfs`
<stavros>
Ah, thanks
<postables[m]>
but its pretty easy to recover if that happens
<postables[m]>
`ipfs-cluster-ctl recover --local` will recover any `ERROR` pins on your local node
<postables[m]>
there's also `ipfs-cluster-ctl sync`
<stavros>
postables[m]: what does `sync` do? I haven't figured that one out yet
<postables[m]>
pretty sure sync is just to verify that pinned items are correct in their pinning strategies, how many nodes are pining them, etc..
<postables[m]>
`recover` is just for pinned content in error states
<stavros>
Ah, right, thank you
<stavros>
Do you use the proxy as well?
<stavros>
I guess the proxy is a proxy to the node's port 5001, not the gateway
<postables[m]>
oh one thing I didnt say about it being stable, its really stable, and reliable. I've stress tested my cluster by completely filling up the queue (50K items) and although it took a long time to filter through the queue, it was cleared without any issues.
<postables[m]>
If you're using cluster, you shouldn't ever use the ipfs node API for pinning
<postables[m]>
If you're using cluster, you shouldn't ever use the ipfs node API for pinning always use the cluster API, port 9094 by default i believe
<postables[m]>
I've broken raft state before by telling an ipfs node directly to remove a pinned item
<stavros>
postables[m]: I already have a node that has pinned items, can I add them all again to the cluster and manage them from there from now on?
_nkls_ has quit [Remote host closed the connection]
<postables[m]>
No you dont need to do that. Just dump your pin list and run over it in a for loop or some shit, telling ipfs-cluster to pin each CID
_nkls_ has joined #ipfs
<postables[m]>
`for i in $(ipfs pin ls | awk '{print $1}'); do ipfs-cluster-ctl pin add "$i"; done` something like that
<postables[m]>
once you've started using ipfs-cluster though just do all your pins and removals through cluster
<stavros>
Yeah, I will, I just need to migrate them there initially
<stavros>
Plus I need to do a bunch of testing to make sure everything works well
whyrusleeping[m] has quit [Ping timeout: 252 seconds]
emceeaich_ is now known as emceeaich
AlexanderDeLarge has quit [Ping timeout: 252 seconds]
dobrosketchkun[m has quit [Ping timeout: 252 seconds]
Polychrome[m] has quit [Ping timeout: 252 seconds]
SmileRobot[m] has quit [Ping timeout: 252 seconds]
maht0rz[m] has quit [Ping timeout: 252 seconds]
LordFenixNC[m]1 has quit [Ping timeout: 252 seconds]
card[m] has quit [Ping timeout: 252 seconds]
reedhhw[m] has quit [Ping timeout: 252 seconds]
stigo[m] has quit [Ping timeout: 252 seconds]
jimt[m] has quit [Ping timeout: 252 seconds]
LordPtolemy[m] has quit [Ping timeout: 252 seconds]
jackmurray[m] has quit [Ping timeout: 252 seconds]
leoalvarezh[m] has quit [Ping timeout: 252 seconds]
mspiri[m] has quit [Ping timeout: 252 seconds]
mindhog[m] has quit [Ping timeout: 252 seconds]
Giovanni[m] has quit [Ping timeout: 252 seconds]
piajesse[m]1 has quit [Ping timeout: 252 seconds]
frislie[m] has quit [Ping timeout: 252 seconds]
dietrich[m] has quit [Ping timeout: 252 seconds]
angreifer has quit [Ping timeout: 252 seconds]
feross has quit [Ping timeout: 252 seconds]
mpname[m] has quit [Ping timeout: 252 seconds]
NastyEbilPiwate[ has quit [Ping timeout: 252 seconds]
Enmerkar[m] has quit [Ping timeout: 252 seconds]
test21562[m] has quit [Ping timeout: 252 seconds]
feross_ is now known as feross
cyberward_matrix has quit [Ping timeout: 252 seconds]
malaclyps[m] has quit [Ping timeout: 252 seconds]
marcocastignoli[ has quit [Ping timeout: 252 seconds]
johnlong[m] has quit [Ping timeout: 252 seconds]
opal[m] has quit [Ping timeout: 252 seconds]
mattober[m] has quit [Ping timeout: 252 seconds]
anastiel has quit [Ping timeout: 252 seconds]
icebal[m] has quit [Ping timeout: 252 seconds]
peterk[m] has quit [Ping timeout: 252 seconds]
fuga123[m] has quit [Ping timeout: 252 seconds]
asthma[m] has quit [Ping timeout: 252 seconds]
genartr[m] has quit [Ping timeout: 252 seconds]
daopu[m] has quit [Ping timeout: 252 seconds]
tomaka[m] has quit [Ping timeout: 252 seconds]
myelinated_torto has quit [Ping timeout: 252 seconds]
dexter0 has quit [Ping timeout: 252 seconds]
ecloud[m] has quit [Ping timeout: 252 seconds]
fuga123[m] has joined #ipfs
Klara[m] has quit [Ping timeout: 252 seconds]
ad87657[m] has quit [Ping timeout: 252 seconds]
chadalpha[m] has quit [Ping timeout: 252 seconds]
MaximOrlovsky[m] has quit [Ping timeout: 252 seconds]
axtim19[m] has quit [Ping timeout: 252 seconds]
lilz[m] has quit [Ping timeout: 252 seconds]
delta[m]1 has quit [Ping timeout: 252 seconds]
pps96[m] has quit [Ping timeout: 252 seconds]
ZeugeIotas[m] has quit [Ping timeout: 252 seconds]
WildFox has quit [Ping timeout: 252 seconds]
xtream1101[m] has quit [Ping timeout: 252 seconds]
backkem[m] has quit [Ping timeout: 252 seconds]
davidar[m] has quit [Ping timeout: 252 seconds]
toma[m] has quit [Ping timeout: 252 seconds]
elesito[m] has quit [Ping timeout: 252 seconds]
edrex has quit [Ping timeout: 252 seconds]
elwisp has joined #ipfs
ecloud[m] has joined #ipfs
elwisp has quit [Ping timeout: 252 seconds]
fuga123[m] has joined #ipfs
ecloud[m] has joined #ipfs
ecloud[m] has quit [Changing host]
fuga123[m] has quit [Changing host]
angreifer has joined #ipfs
myidport[m] has quit [Ping timeout: 252 seconds]
marsprobe_phd_2x has quit [Ping timeout: 252 seconds]
igel[m] has quit [Ping timeout: 252 seconds]
backkem[m] has joined #ipfs
ad87657[m] has joined #ipfs
mindhog[m] has joined #ipfs
MaximOrlovsky[m] has joined #ipfs
elesito[m] has joined #ipfs
marsprobe_phd_2x has joined #ipfs
axtim19[m] has joined #ipfs
myidport[m] has joined #ipfs
WildFox has joined #ipfs
edrex has joined #ipfs
runde has quit [Ping timeout: 252 seconds]
spinza has quit [Quit: Coyote finally caught up with me...]
dexter0 has joined #ipfs
WildFox is now known as Guest5330
igel[m] has joined #ipfs
piajesse[m]1 has joined #ipfs
runde has joined #ipfs
freeflying has quit [Ping timeout: 255 seconds]
Mitar has quit [Ping timeout: 255 seconds]
freeflying has joined #ipfs
Mitar has joined #ipfs
toxync01- has quit [Remote host closed the connection]
toxync01 has joined #ipfs
Steverman has joined #ipfs
manray has joined #ipfs
manray has quit [Ping timeout: 255 seconds]
spinza has joined #ipfs
manray has joined #ipfs
merethan has quit [Remote host closed the connection]
manray has quit [Ping timeout: 258 seconds]
manray has joined #ipfs
<yeehi>
Any suggestions for Free DNS servers?
<yeehi>
Also, if there is a content provider who would like to try supporting their content using IPFS, what would be the best way to go about this? (podcast/website articles/ vlog)
<yeehi>
Who would they contact for help? Is there a case study of how to "port" a website onto IPFS?
<olizilla>
porting a large existing site to IPFS would make a great case study! Such a thing may exist already but I haven't seen it
manray has quit [Ping timeout: 268 seconds]
<yeehi>
olizilla - thank you very much- that sounds exactly what i am looking for.
<yeehi>
Cloudflare is a weakness in the internet. It is a single choke point on much of what is available.
<yeehi>
is there some sort of alternative to cloudflare rwhich supports dnscrypt
<olizilla>
i understand that concern
<yeehi>
The reasonable clouldflare alternatives of which I am aware are:
<olizilla>
I've no good advice there. the free part is tricky. I use dnsimple for some things, gandi.net for others, iwantmyname, digitalocean, bytemark, never had any problems with them