stebalien changed the topic of #ipfs to: Heads Up: To talk, you need to register your nick! Announcements: go-ipfs 0.4.21 and js-ipfs 0.35 are out! Get them from dist.ipfs.io and npm respectively! | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS, the InterPlanetary FileSystem: https://github.com/ipfs/ipfs | Logs: https://view.matrix.org/room/!yhqiEdqNjyPbxtUjzm:matrix.org/ | Forums: https://discuss.ipfs.io | Code of
}ls{ has quit [Ping timeout: 268 seconds]
}ls{ has joined #ipfs
Fessus has joined #ipfs
kchz has joined #ipfs
thomasan_ has joined #ipfs
thomasan_ has quit [Remote host closed the connection]
dqx has quit [Remote host closed the connection]
ygrek has quit [Ping timeout: 248 seconds]
Newami has quit [Read error: Connection reset by peer]
englishm has quit [Excess Flood]
englishm has joined #ipfs
wschenk has joined #ipfs
wschenk has quit [Ping timeout: 268 seconds]
kyan has joined #ipfs
Belkaar has quit [Ping timeout: 244 seconds]
Belkaar has joined #ipfs
Belkaar has joined #ipfs
toxync01 has quit [Ping timeout: 258 seconds]
toxync01 has joined #ipfs
SunflowerSociety has joined #ipfs
ONI_Ghost has quit [Ping timeout: 272 seconds]
toxync01 has quit [Ping timeout: 268 seconds]
toxync01 has joined #ipfs
sirn has quit [Ping timeout: 248 seconds]
wschenk has joined #ipfs
sirn has joined #ipfs
wschenk has quit [Ping timeout: 258 seconds]
kevin5 has joined #ipfs
kchz has quit [Quit: ZZzzz…]
user_51_ has joined #ipfs
baojg has joined #ipfs
othello has joined #ipfs
user_51 has quit [Ping timeout: 245 seconds]
griffinbyatt has joined #ipfs
othello has left #ipfs [#ipfs]
Mx8v has quit []
zeden has joined #ipfs
ygrek has joined #ipfs
kevin5 has quit [Quit: Ping timeout (120 seconds)]
verin0x5 has joined #ipfs
kakra has joined #ipfs
verin0x has quit [Ping timeout: 268 seconds]
Newami has joined #ipfs
hurikhan77 has quit [Ping timeout: 258 seconds]
wschenk has joined #ipfs
wschenk has quit [Ping timeout: 245 seconds]
accounts has quit [Ping timeout: 245 seconds]
griffinbyatt has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
hkaddoil has quit [Ping timeout: 245 seconds]
toxync01 has quit [Ping timeout: 246 seconds]
toxync01 has joined #ipfs
_whitelogger has joined #ipfs
hkaddoil has joined #ipfs
wschenk has joined #ipfs
wschenk has quit [Ping timeout: 272 seconds]
midisek1 has joined #ipfs
midisek has quit [Ping timeout: 268 seconds]
Oatmeal has joined #ipfs
zeden has quit [Quit: WeeChat 2.4]
DavidPH has quit [Remote host closed the connection]
blallo has quit [Ping timeout: 246 seconds]
blallo has joined #ipfs
Anduck has quit [Ping timeout: 245 seconds]
Anduck has joined #ipfs
wschenk has joined #ipfs
englishm has quit [Excess Flood]
englishm has joined #ipfs
wschenk has quit [Ping timeout: 248 seconds]
}ls{ has quit [Quit: real life interrupt]
deploring has joined #ipfs
piotrszegda[m] has joined #ipfs
shomodj has joined #ipfs
skywavesurfer has quit [Quit: ZNC - https://znc.in]
airwind has joined #ipfs
skywavesurfer has joined #ipfs
wschenk has joined #ipfs
wschenk has quit [Ping timeout: 246 seconds]
The_8472 has quit [Ping timeout: 252 seconds]
The_8472 has joined #ipfs
SunflowerSociety has quit [Read error: Connection reset by peer]
hillie has joined #ipfs
abaiste^ has quit []
mb^ has joined #ipfs
hillie has left #ipfs [#ipfs]
wschenk has joined #ipfs
shomodj has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
wschenk has quit [Ping timeout: 245 seconds]
shomodj has joined #ipfs
ShandySipper1 has quit [Read error: Connection reset by peer]
gts has joined #ipfs
rendar has joined #ipfs
shomodj has quit [Read error: Connection reset by peer]
shomodj has joined #ipfs
hkaddoil has quit [Ping timeout: 248 seconds]
hkaddoil has joined #ipfs
ni638629 has joined #ipfs
dot9sh[m] has joined #ipfs
ni638629 has quit [Remote host closed the connection]
wschenk has joined #ipfs
wschenk has quit [Ping timeout: 248 seconds]
hkaddoil has quit [Ping timeout: 246 seconds]
hkaddoil has joined #ipfs
gts has quit [Remote host closed the connection]
gts has joined #ipfs
redfish has quit [Ping timeout: 250 seconds]
gts has quit [Remote host closed the connection]
gts has joined #ipfs
midisek1 has quit [Remote host closed the connection]
Newami has quit [Read error: Connection reset by peer]
hkaddoil has quit [Ping timeout: 245 seconds]
hkaddoil has joined #ipfs
Oatmeal has quit [Ping timeout: 264 seconds]
gts has quit [Remote host closed the connection]
redfish has joined #ipfs
yosafbridge has quit [Quit: Leaving]
hkaddoil has quit [Ping timeout: 246 seconds]
hkaddoil has joined #ipfs
yosafbridge has joined #ipfs
hkaddoil has quit [Ping timeout: 245 seconds]
<Johanntplusdev[m> Is there a nice or recommend way to run a ipfs node but with s3 storage backend?
is_null has joined #ipfs
wschenk has joined #ipfs
wschenk has quit [Ping timeout: 258 seconds]
<moritonal[m]> Hi all, I'm fairly new to the IPFS scene, but I've implemented the Storage driver within Docker Registry to turn it into a gateway for pushing and pulling images from IPFS. It's a complete POC at the moment with issues and is fairly slow with big images, but there's ton of room for improvements and discussion. I've done a write-up here and would love some feedback before I really start to promote this:
gts has joined #ipfs
<moritonal[m]> <moritonal[m] "Hi all, I'm fairly new to the IP"> I imagine there'll be some structural changse to the filestructure I went for (just normal `ipfs files`), but if anyone wants to prove the pro's of Docker and IPFS you can pin "QmWL6tdbf9ctmHGfZwNQVwfxWYoPy5ENiTashGsFdgWdpV" which is the various blobs for alpine and my image on top of it.
dethos has joined #ipfs
is_null has quit [Ping timeout: 245 seconds]
hr[m] has joined #ipfs
<voker57> great stuff! I was just cursing at docker for having no way to content-address images
verin0x5 is now known as verin0x
<Johanntplusdev[m> <voker57 "great stuff! I was just cursing "> You can pull images by their sha256 digest if that's what you mean?
<moritonal[m]> Yep, see Docker uses what it calls digests to content-address images. Their digests are our CID. What I've built is a way for us to use IPFS to share both the digests and the blobs they refer to through a gateway.
<moritonal[m]> `docker images --digests` = `localhost:5000/test/busybox sha256:cbbf2f9a99b47fc460d422812b6a5adff7dfee951d8fa2e4a98caa0382cfbdbf`
sfx2496 has joined #ipfs
chiui has joined #ipfs
mowcat has joined #ipfs
ZaZ has joined #ipfs
dpl has joined #ipfs
wschenk has joined #ipfs
reit has quit [Ping timeout: 248 seconds]
wschenk has quit [Ping timeout: 245 seconds]
kaotisk has joined #ipfs
is_null has joined #ipfs
farlyrbw9 has joined #ipfs
<voker57> iirc docker ignored my sha256 sometimes when added to image tags, maybe i was doing it wrong
farlyrbw9 has quit [Read error: Connection reset by peer]
noby has joined #ipfs
clemo has joined #ipfs
eldin has joined #ipfs
noby has quit [Ping timeout: 244 seconds]
reit has joined #ipfs
<Swedneck2> any ideas what might cause my node to not prune connections? It just climbs up to 8000 no matter what i do
eldin has quit [Ping timeout: 272 seconds]
OKTAVIUS has quit [Ping timeout: 246 seconds]
OKTAVIUS has joined #ipfs
Oatmeal has joined #ipfs
sfx2496 has quit [Ping timeout: 246 seconds]
wschenk has joined #ipfs
sargent has joined #ipfs
ygrek has quit [Ping timeout: 268 seconds]
wschenk has quit [Ping timeout: 245 seconds]
vmx has joined #ipfs
sargent has quit [K-Lined]
<swedneck3> 8000 peers*
pattenbpc6 has joined #ipfs
pattenbpc6 has quit [Ping timeout: 245 seconds]
Caterpillar2 is now known as Caterpillar
gmoro has joined #ipfs
hkaddoil has joined #ipfs
kchz has joined #ipfs
polman has quit [Ping timeout: 245 seconds]
polman has joined #ipfs
}ls{ has joined #ipfs
kchz has quit [Quit: ZZzzz…]
dethos has quit [Ping timeout: 258 seconds]
user__ has joined #ipfs
brianhoffman_ has joined #ipfs
cwiz89 has quit [Read error: Connection reset by peer]
lsl88 has quit [Ping timeout: 272 seconds]
lsl88 has joined #ipfs
brianhoffman has quit [Ping timeout: 272 seconds]
brianhoffman_ is now known as brianhoffman
kapilp has joined #ipfs
webox has joined #ipfs
Soo_Slow has joined #ipfs
<webox> hi
<webox> I was looking for a list of public write nodes like infura.io. We have a nodejs server that uploads files to ipfs using infura node, but from time to time the node is superslow or down so we wanted to switch to other nodes dynamically. Any chance to get a list of public writable nodes??
malaclyps has quit [Read error: Connection reset by peer]
malaclyps has joined #ipfs
mowcat has quit [Remote host closed the connection]
zeden has joined #ipfs
sfx2496 has joined #ipfs
reit has quit [Quit: Leaving]
internetman1337[ has joined #ipfs
<internetman1337[> Hi
kena has joined #ipfs
Oatmeal has quit [Ping timeout: 276 seconds]
Newami has joined #ipfs
reit has joined #ipfs
webox has quit [Quit: Leaving.]
ZaZ has quit [Read error: Connection reset by peer]
Wiox has quit [Ping timeout: 244 seconds]
DavidPH has joined #ipfs
Wiox has joined #ipfs
m_tadeu has quit [Remote host closed the connection]
m_tadeu has joined #ipfs
airwind has quit [Quit: airwind]
toxync01 has quit [Ping timeout: 245 seconds]
octav1a has joined #ipfs
toxync01 has joined #ipfs
chiui has quit [Ping timeout: 245 seconds]
Guest32 has joined #ipfs
Guest32 has quit [Client Quit]
chiui has joined #ipfs
Belkaar has quit [Ping timeout: 248 seconds]
Belkaar has joined #ipfs
Belkaar has joined #ipfs
Belkaar_ has joined #ipfs
Belkaar has quit [Ping timeout: 248 seconds]
dplan has joined #ipfs
webox has joined #ipfs
Belkaar_ has quit [Ping timeout: 272 seconds]
mateusbs17|brb is now known as mateusbs17
Belkaar has joined #ipfs
Belkaar has joined #ipfs
webox has quit [Quit: Leaving.]
Belkaar has quit [Ping timeout: 258 seconds]
Belkaar has joined #ipfs
Belkaar has joined #ipfs
webox has joined #ipfs
webox has quit [Client Quit]
jonnycrunch has joined #ipfs
gts has quit [Remote host closed the connection]
webox has joined #ipfs
gts has joined #ipfs
<jenzzens[m]> webox: Try if https://pinata.cloud/ fits your needs.
gts has quit [Ping timeout: 248 seconds]
mindCrime has joined #ipfs
m_tadeu has quit [Quit: No Ping reply in 180 seconds.]
m_tadeu has joined #ipfs
<webox> but isn't pinata a cloud service for uploading files? we are directly interacting with IPFS api but we don't want to setup a node, does pinata have a public api gateway?
sfx2496 has quit [Ping timeout: 244 seconds]
baojg has quit [Remote host closed the connection]
Roger[m]2 has joined #ipfs
spinza has quit [Ping timeout: 248 seconds]
Newami has quit [Read error: Connection reset by peer]
spinza has joined #ipfs
dplan has quit [Quit: dplan]
mowcat has joined #ipfs
kena has quit [Quit: kena]
webox has quit [Quit: Leaving.]
sav-at-work has joined #ipfs
webox has joined #ipfs
dpl has quit [Read error: Connection reset by peer]
webox has quit [Quit: Leaving.]
webox has joined #ipfs
Soo_Slow has quit [Remote host closed the connection]
angreifer has quit [Ping timeout: 252 seconds]
Wiox has quit [Ping timeout: 244 seconds]
angreifer has joined #ipfs
aeroplain[m] is now known as ColinG[m]
sfx2496 has joined #ipfs
Wiox has joined #ipfs
Soo_Slow has joined #ipfs
jonnycrunch has quit [Ping timeout: 250 seconds]
Obo[m]3 has joined #ipfs
<Obo[m]3> swedneck [GMT+1] What version of IPFS are you running? That sounds like a bug we ran into with an older version
<mattober[m]> webox: Pinata currently doesn't have write access opened up on the pinata public gateway. The only way to upload files to us is through our REST API.
<webox> hey! I figured, do you have any plan that is not based on gb of storage but requests? we only need to send files trough a write gateway and infura is really saturated sometimes.
vmx has quit [Ping timeout: 248 seconds]
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
webox has quit [Quit: Leaving.]
<swedneck3> Obo: 0.4.21
camey has joined #ipfs
shomodj has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
<mattober[m]> webox: We do not, but we also have unlimited requests.
<mattober[m]> swedneck:permaweb.io: that's odd. I didn't think 0.4.21 suffered from that, although it's been awhile since I've ran it. You might want to try upgrading to 0.4.22-rc1 just in case
deltab has quit [Ping timeout: 245 seconds]
<swedneck3> will do
<mattober[m]> I'd also reach out to stebalien on that if it's still an issues on 0.4.22
camey has quit [Read error: Connection reset by peer]
<swedneck3> yep still happens with v0.4.22-rc1
<swedneck3> (i presume i don't have to do anything other than `ipfs update install latest`)
<swedneck3> peer count starts small and steadily rises until about 8000, until the grace period ends and then it repeats
merethan has joined #ipfs
deltab has joined #ipfs
<aschmahmann[m]> swedneck:permaweb.io: perhaps related to this https://github.com/libp2p/go-libp2p-connmgr/issues/46 ?
adrianbrink has quit [Ping timeout: 252 seconds]
<mattober[m]> swedneck:permaweb.io: what are your highwater / lowwater settings?
adrianbrink has joined #ipfs
<swedneck3> definitely sounds like it
<swedneck3> high: 900, low: 600
<swedneck3> i.e. default
webox has joined #ipfs
balupton[m]1 has joined #ipfs
webox has quit [Client Quit]
underikar has quit [Ping timeout: 252 seconds]
<mattober[m]> swedneck:permaweb.io: looks like there's a fix in master, you might want to pull that
<swedneck3> i presume i'll have to compile it?
cdjaco has joined #ipfs
<mattober[m]> I'd imagine so. I'm not sure if this is into go-ipfs yet
<swedneck3> oh i thought you meant go-ipfs master, not libp2p
Guest23720 has joined #ipfs
underikar has joined #ipfs
<aschmahmann[m]> not sure if that issue is what you're running into, but also it looks like that issue won't make the number of connections smaller since it's just not counting the ones in the grace period. However, other people like stebalien or raulk would know probably know better.
underikar has quit [Max SendQ exceeded]
underikar has joined #ipfs
Guest23720 has quit [K-Lined]
arnoldo has joined #ipfs
arnoldo has quit [Read error: Connection reset by peer]
<swedneck3> another detail: it seems to only prune the peers once it reaches 8000, if i set the grace period to something like 5s it takes significantly longer than 5s for the peers to be pruned
rjknight_ has joined #ipfs
rjknight has quit [Ping timeout: 245 seconds]
rjknight_ is now known as rjknight
xcm has quit [Ping timeout: 246 seconds]
frannie has joined #ipfs
xcm has joined #ipfs
frannie has quit [Read error: Connection reset by peer]
webox has joined #ipfs
chiui has quit [Ping timeout: 245 seconds]
manfredfle8 has joined #ipfs
rkzel has quit [Ping timeout: 245 seconds]
rkzel has joined #ipfs
manfredfle8 has quit [Ping timeout: 244 seconds]
<mattober[m]> It's almost as if your node has a fault config?
<mattober[m]> the behavior you're describing is how IPFS handles highwater / lowater
<mattober[m]> IE, accumulate until high water and then prune down to low water
<mattober[m]> are you sure your node is reading from the right config location?
<swedneck3> well my config very much so says highwater is 900
<swedneck3> how can i make sure?
<swedneck3> hmm, well it complains when i move the config file to .config temporarily
<swedneck3> so presumably it's using the right file
shomodj has joined #ipfs
rkzel has quit [Ping timeout: 244 seconds]
ucodespace has left #ipfs [#ipfs]
rkzel has joined #ipfs
scj_ has joined #ipfs
plexigras has joined #ipfs
Ecran has joined #ipfs
rkzel has quit [Ping timeout: 268 seconds]
rendar has quit []
rkzel has joined #ipfs
mcgriff has joined #ipfs
Guest48862 has joined #ipfs
mcgriff has quit [Remote host closed the connection]
Guest48862 has left #ipfs [#ipfs]
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
kapilp has quit [Quit: Connection closed for inactivity]
rkzel has quit [Read error: No route to host]
maggotbrain has quit [Remote host closed the connection]
rkzel has joined #ipfs
doodlemania[m] has joined #ipfs
maggotbrain has joined #ipfs
webox has quit [Quit: Leaving.]
markos has joined #ipfs
webox has joined #ipfs
rkzel has quit [Ping timeout: 248 seconds]
ganfra[m] has left #ipfs ["User left"]
rkzel has joined #ipfs
redfish has quit [Ping timeout: 252 seconds]
markos has left #ipfs [#ipfs]
plexigras has quit [Ping timeout: 244 seconds]
pecastro has joined #ipfs
ober has joined #ipfs
<mattober[m]> can you set the config setting via the CLI?
<swedneck3> i'm not sure how to do that
<mattober[m]> ipfs config Swarm.ConnMgr.HighWater 1000
<mattober[m]> is what you would type into the cli
redfish has joined #ipfs
Newami has joined #ipfs
<swedneck3> yeah that just edited the same file, and the peer count still goes up to 8000
Oatmeal has joined #ipfs
crosbyymx8 has joined #ipfs
KempfCreative has quit [Ping timeout: 248 seconds]
crosbyymx8 has left #ipfs [#ipfs]
webox has quit [Quit: Leaving.]
ZaZ has joined #ipfs
plexigras has joined #ipfs
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
antonykqg6 has joined #ipfs
raphael has joined #ipfs
<mattober[m]> That's really odd. stebalien you might want to take a look at this. Do you know how to prepare debugging logs? https://github.com/ipfs/go-ipfs/blob/master/docs/debug-guide.md
antonykqg6 has left #ipfs [#ipfs]
a09sd8f has joined #ipfs
<aschmahmann[m]> perhaps worth noting that 8192 is the default file descriptor limit.
<stebalien> swedneck:permaweb.io: could you file an issue? Long-running conversations on IRC are difficult to follow.
<stebalien> Note: The fix in libp2p master will only make this worse.
<stebalien> swedneck:permaweb.io: actually... I see the issue. The issue is that we rate-limit trim events to once every minute. We should trim more frequently.
<swedneck3> i did already comment on an issue i thought was related
<swedneck3> so the default of 20s doesn't do anything? lol
<stebalien> Well, it trims everything not opened in the last 20s, but only does so every minute...
<stebalien> (note, comments on closed issues will often get lost)
<swedneck3> ah
<swedneck3> so file a new issue then?
<stebalien> I'll file one against go-libp2p with all the relevent context.
<stebalien> swedneck:permaweb.io: are you acting as a relay by any chance?
<swedneck3> ah yes disablerelay is false
<swedneck3> very confusing how that is inverse to the other settings..
<stebalien> Sorry, Swarm.EnableRelayHop.
<swedneck3> ah
<stebalien> We use disable/enable so that the defaults are all "false'
<swedneck3> that is set to false
<stebalien> Good.
<stebalien> So, we should also be trimming connections whenever we receive a new one, rate-limited to once every 10 seconds.
<swedneck3> should disablerelay be true or false?
<stebalien> DisableRelay can be false.
<swedneck3> alright
<stebalien> Unless EnableRelayHop is set to true, your node won't act as an active relay.
<stebalien> Note: EnableAutoNATService should also be false.
cwahlers_ has joined #ipfs
<swedneck3> it is
<stebalien> Good.
<stebalien> So, how frequently are connections being trimmed?
<swedneck3> i'll try to time it but it's kinda hard to judge
cwahlers has quit [Ping timeout: 244 seconds]
ZaZ1 has joined #ipfs
<stebalien> Basically, as long as you're getting new connections, it should be once every 10 seconds.
<swedneck3> yeah it's about a minute
<stebalien> Hm. I wonder if something is going wrong with notification delivery.
<swedneck3> fwiw this issue just kinda came out of nowhere
<stebalien> Ah... libp2p doesn't use notifications to determine when to trim.
ZaZ has quit [Ping timeout: 248 seconds]
<stebalien> Wait, no, we do.
<stebalien> Ok, back to "no we don't".
<stebalien> Final time, I swear.
<swedneck3> it hurt itself in confusion!
zeden has quit [Quit: WeeChat 2.4]
<stebalien> swedneck:permaweb.io: so, I'm not sure _why_ you're suddenly seeing so many new connections. My only guess is that, well, you're now at a popular position in the DHT. You _could_ set Routing.Type to `dhtclient` if you want to stop acting like a DHT server.
sfx2496 has quit [Ping timeout: 248 seconds]
<swedneck3> anything to make my node usable again
<swedneck3> well that didn't help
zeden has joined #ipfs
zeden has quit [Client Quit]
<stebalien> You ran `ipfs config Routing.Type dhtclient` and then restarted your node?
<stebalien> Are you providing some really popular content?
<swedneck3> well i edited the config in vim and then restarted it
zeden has joined #ipfs
<stebalien> It may take the network a few minutes to forget your node but it should be pretty fast.
<stebalien> Yeah, that should have done it.
<swedneck3> well this is the node for permaweb.io
<stebalien> Have you ever set both EnableRelayHop and EnableAutoRelay to true at the same time (note: DON'T DO THIS)
<swedneck3> i think so, yes
<stebalien> When...
<stebalien> Also, is that a public gateway?
<swedneck3> iirc after this started, but it could have been before
<swedneck3> yes it's a public gateway
ORAORAORAORAORA[ has joined #ipfs
<stebalien> So, if you enabled autorelay + relayhop, you've told the network that you're willing to be a relay. Those announcements will expire in 12-24 hours.
<swedneck3> yeah i reverted that more than 24h ago
<stebalien> Got it. What's the output of `ipfs swarm peers --direction | grep -c outbound` versus `grep -c inbound`?
<stebalien> (trying to figure out if your node is dialing or if others are dialing you)
<swedneck3> 77 vs 3000+ and growing
<swedneck3> actually outbound seems stable around 250
<stebalien> Got it, so inbound.
<stebalien> Can you run `ipfs bitswap stat`, sleep 10 seconds, then run that again?
<stebalien> (determine if it's just popular content)
<stebalien> Ok. Nobody wants stuff from you...
<swedneck3> :(
<stebalien> Uptime?
<swedneck3> for the server?
<stebalien> Yes.
<swedneck3> 5 days
<stebalien> Sorry, for IPFS.
<swedneck3> well i restarted it not long ago
<stebalien> (trying to determine if this is just a lull)
<swedneck3> 11 min i guess?
<swedneck3> (from systemctl)
ZaZ2 has joined #ipfs
ZaZ has joined #ipfs
<swedneck3> oh and idk if this is relevant but
<swedneck3> `http: Accept error: accept tcp4 127.0.0.1:8080: accept4: too many open files; retrying in 5ms`
ZaZ has quit [Client Quit]
plexigras has quit [Ping timeout: 246 seconds]
<stebalien> Yeah, you're running out of file descriptors. Honestly, that's probably why you're stopping at ~8000 connections and not climbing higher. The limit is 8192.
<stebalien> (by default)
mindCrime has quit [Ping timeout: 245 seconds]
ZaZ1 has quit [Ping timeout: 244 seconds]
<swedneck3> ah, nice to know why it's stopping at that number at least
ZaZ2 has quit [Ping timeout: 246 seconds]
<stebalien> But, of course, that's killing your gateway as you can't accept gateway connections.
<swedneck3> i've noticed..
<swedneck3> at least this prompted me to set up caching for nginx
Ecran has quit [Remote host closed the connection]
<swedneck3> any other ideas what i could do to fix this at least temporarily?
<aschmahmann[m]> out of curiousity if you generated a new peerID for yourself, but kept the same repo and everything else do you get the same behavior?
<swedneck3> how do i do that?
<aschmahmann[m]> brute force way would be to create a new IPFS repo (ipfs init after setting IPFS_PATH to a new location), and then copy+paste the Identity section from that config file to your own. There might be something easier though
v3ry3arly has quit [Quit: sleeping or rebooting or something iunno]
<stebalien> swedneck:permaweb.io: does `ipfs --api /dns4/ipfs.ipfi/tcp/5001 swarm peers | sed -n 's|^/ip[46]/\([^/]*\)/.*|\1|p' | sort | uniq -c | sort -g -r | head` show anything interesting?
<aschmahmann[m]> idk if it'll help, but it should both make peers find you fresh and shift your DHT position. Either of these could potentially impact your inbound connections.
<stebalien> It should definitely help.
<swedneck3> ipfi?
<stebalien> Sorry, ignore the `--api` part.
<stebalien> (that's me running it against my local node on a different machien)
<stebalien> `ipfs swarm peers | sed -n 's|^/ip[46]/\([^/]*\)/.*|\1|p' | sort | uniq -c | sort -g -r | head`
<stebalien> Got it. So no obvious DoS.
<stebalien> `ipfs swarm peers | grep -c 'p2p-circuit'`?
<swedneck3> 144
<stebalien> Ok, that's sane. And you're now running in with `Routing.Type` set to "dhtclient"?
<swedneck3> yes
<stebalien> Any flags passed to `--daemon`?
<stebalien> Sorry, to `ipfs daemon`
<swedneck3> `--enable-namesys-pubsub --enable-pubsub-experiment --enable-gc`
<stebalien> `ipfs name pubsub subs`?
<stebalien> (probably won't spit out anything if you've restarted...)
<swedneck3> `/ipns/QmXC7Feu47jh6pNXQg3CSwtVNmBYr7fpshF4qVu5vAu92Y`
<swedneck3> `/ipns/QmSPPXiNnFAh3SPFng8fS4KWGP4DZWKrauQzFo1YvjfZJd`
<swedneck3> that's permaweb.io and riot.permaweb.io respectively
<stebalien> Ah. Yeah, that's probably not the issue.
DavidPH has quit [Ping timeout: 272 seconds]
<stebalien> Ok, let's have some fun! Please install `jq` and then run: `ipfs log tail | jq 'select(.Operation == "handleGetProviders" and .Tags.system == "dht") | .Tags.key'`
<stebalien> swedneck:permaweb.io: ^^
<swedneck3> on it
<stebalien> Look for any keys that pop out.
<stebalien> Thanks!
DavidPH has joined #ipfs
<swedneck3> nothing
octav1a has quit [Ping timeout: 258 seconds]
<stebalien> Ah, because you've turned off the DHT.
<stebalien> Can you turn it back on for a test?
<swedneck3> ye
<stebalien> ty
<swedneck3> shall i let it run for a bit?
<stebalien> 20s is enough.
<swedneck3> ah yeah now i get stuff
<swedneck3> bafkreibel3v5edjm2tebwxkkyj6hg5dcph2dnvrph32syrjkg2pg555wca
<stebalien> Yeah, that's people looking for autorelays....
miceiken has quit [Quit: ZNC 1.7.4 - https://znc.in]
<stebalien> I'm seeing that on another machine as well.
<stebalien> But turning off the DHT should help.
brianhoffman_ has joined #ipfs
<swedneck3> hmm
<swedneck3> i'll turn it off again and see if it does anything this time
brianhoffman has quit [Ping timeout: 245 seconds]
brianhoffman_ is now known as brianhoffman
<swedneck3> nope, still 8000 peers
<stebalien> Let's give it 30m and see what happens.
<swedneck3> aight
cesardv_ has joined #ipfs
griffinbyatt has joined #ipfs
<swedneck3> no change yet
mowcat has quit [Remote host closed the connection]
<swedneck3> no change after 30+ minutes
<stebalien> Hm. For some reason, your node isn't getting removed from soneone's routing table. Is there any way to turn this node off for 10 minutes before restarting it? There's a chance that it's reconnecting before peers realize that it actually disconnected.
<swedneck3> yeah i'll just.. turn it off for 10 minutes before restarting it.. :D
<stebalien> Thanks! Hopefully that'll do it. I'll also make sure that nobody changed something important in the DHT code.
<swedneck3> i'm on 0.4.22-rc1 rn
merethan has quit [Remote host closed the connection]
cdjaco has quit [Quit: Leaving]
scj_ has quit [Remote host closed the connection]
sav-at-work has quit [Quit: sav-at-work]
griffinbyatt has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
Soo_Slow has quit [Ping timeout: 245 seconds]
<swedneck3> didn't help
<lidel> swedneck3, did you enable EnableRelayHop=true at some point? it can be false now, but was it true in past?
<stebalien> That's really odd.
<stebalien> What's the peer ID?
<stebalien> Also, aschmahmann are your boosters runnign?
<swedneck3> lidel: stebalien already asked that
<swedneck3> stebalien: you mean the ID of my node?
MuffinPimp has quit [Ping timeout: 248 seconds]
<stebalien> Yes.
<swedneck3> QmXC7Feu47jh6pNXQg3CSwtVNmBYr7fpshF4qVu5vAu92Y
<stebalien> lidel: it was enabled but that was over 24 hours ago.
<aschmahmann[m]> stebalien: nope, none of the trie boosters are running AFAIK.
<stebalien> ?
<stebalien> No, there are definitely boosters running.
<stebalien> I hope...
<aschmahmann[m]> right, but I don't think any of them are using the trie code
<lidel> yeah, when I set EnableRelayHop=true by mistake and switched it off, I had a lot of incoming connections and it took time to calm down
<aschmahmann[m]> could be wrong about which code is running though
<stebalien> lidel: but it shouldn't take days.
Papa_Alpaka has joined #ipfs
<swedneck3> it'd also be nice if it didn't kill the node
<lidel> correct, it should calm down in a day or so
<stebalien> aschmahmann: I asked because I'm trying to make sure that there are no DHT nodes running that keep peers in their tables after those peers go offline.
<stebalien> swedneck:permaweb.io: I'm going to just remove that option from IPFS.
<stebalien> Relays should be separate nodes.
<swedneck3> sounds good
<aschmahmann[m]> stebalien: swedneck:permaweb.io what do you think about trying to rotate the PeerID just to confirm this all checks out?
<stebalien> swedneck:permaweb.io: can you do that without breaking something?
MuffinPimp has joined #ipfs
<swedneck3> uhh well the IPNS record for permaweb.io is the current peer ID
<swedneck3> i mean we can change the dnslink record but then i have to contact shoku and that'll take a while
<aschmahmann[m]> ya, it'll break the DNSLink things so it's mostly a test thing (unless you want to rotate the DNSLink PeerID as well)
<swedneck3> but hey it's not like stuff's working anyway rn
a09sd8f has quit [Quit: Ping timeout (120 seconds)]
<swedneck3> what do i do to change the peer id?
<aschmahmann[m]> if there's a way to force your ISP to give you a new dynamic IP that'd work also
<stebalien> Yeah, don't change the peer ID.
<stebalien> Well, you could move it to a separate key slot but that's tricky.
a09sd8f has joined #ipfs
<stebalien> aschmahmann: that won't necessarily work.
<swedneck3> i mean i can add floating IPs in hetzner but i think that costs $$
<aschmahmann[m]> stebalien: true, if the node is being tracked through the DHT by PeerID then new IP won't help.
<aschmahmann[m]> but if it's just by stored multiaddr then it should
<swedneck3> i could move the current repo to .ipfs-bak and make a new repo to test?
<aschmahmann[m]> stebalien: turns out I was wrong. The node was running (I just killed it), it just wasn't in graphana so I assumed it had been taken down.
<stebalien> aschmahmann (@aschmahmann:matrix.org): did your node persist routing entries after a disconnect.
<aschmahmann[m]> yep, it couldn't maintain that many active connections so it needed to
clemo has quit [Ping timeout: 258 seconds]
<stebalien> Got it. swedneck:permaweb.io, your node should stop receiving connections now.
<swedneck3> oh?
<stebalien> raulk ^^^ please see why we need to be careful about this.
<stebalien> <stebalien "Got it. swedneck:permaweb.io, yo"> swedneck:permaweb.io: we had a bunch of dht nodes that were remembering prior DHT nodes even after they disconnected.
<swedneck3> still seeing thousands of peers
<aschmahmann[m]> current hypothesis then is that your PeerID became an important forwarding point in the DHT and so a well connected node was forwarding people to you.
<swedneck3> i'm flattered
<aschmahmann[m]> I think you'll still need to do a reset with some downtime (maybe the 10min stebalien mentioned before). We'll see if that helps
<swedneck3> aight
MuffinPimp has quit [Read error: Connection reset by peer]
raphael has quit [Quit: Leaving]
MuffinPimp has joined #ipfs
MDude has quit [Ping timeout: 245 seconds]
<aschmahmann[m]> I'm not sure I understand why you'd keep getting connections even with DHT Client mode on though. stebalien If I try and connect to a peer I think is a full DHT node and it isn't will we still have a connection, but no streams?
Papa_Alpaka has quit [Remote host closed the connection]
<stebalien> Yes.
<aschmahmann[m]> ah interesting, I guess I didn't really expect that. thought the connection would close
<swedneck3> nope, still getting thousands of peers
<stebalien> We may have more nodes doing that.
<raulk> Is it possible that your peer ID is close to the CID of the autorelay provider record key?
<swedneck3> lost me at the end there
<raulk> If we suspect of the DHT, you can enable the debug log level on the dht logger; that might turn up the reason
<stebalien> He turned off the DHT.
<raulk> Peers looking for relays locate them by performing a provider record lookup on the DHT
<raulk> And is still receiving connections? That’s odd.
<stebalien> Are the other boosters remembering peers not in their routing tables?
<raulk> can somebody make a dht provider lookup against the live network for the autorelay key?
lidel has quit [Ping timeout: 272 seconds]
<raulk> and check if in the results you find @swedneck3’s node
<swedneck3> oh god damnit it changed my irc nick again?
swedneck3 is now known as swednec5
swednec5 is now known as swednec7
Swedneck is now known as Guest99480
<postables[m]> slightly related to the peer discussing. What's a more appropriate way to determine the currently connected peers via the peerstore? I'm guessing using `PeersWithAddrs` ?
swednec7 is now known as swedneck9
swedneck9 is now known as swedneck___
swedneck___ is now known as swedneck__
<swedneck__> did i need to do something more?
MDude has joined #ipfs
toxync01 has quit [Read error: Connection reset by peer]
<raulk> @postables[m]: using host.Network(). There was an accessor there to get connected peers
<postables[m]> raulk: noice, thank you 🚀
scj_ has joined #ipfs
toxync01 has joined #ipfs
<stebalien> swedneck:permaweb.io: your peer is still in that list.
<stebalien> The expiration is 24 hours. However, there was a bug fixed in 0.4.21 that prevented nodes from forgetting provider records.
scj_ has quit [Ping timeout: 245 seconds]
<swedneck__> so i just gotta wait?
<stebalien> Well, how long ago did you you turn this off?
Ugrastil has quit [Quit: Ugrastil]
<swedneck__> has to be more than 24h ago
<swedneck__> unless i did some time travelling
Ugrastil has joined #ipfs
shomodj has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
pecastro has quit [Read error: Connection reset by peer]
zeden has quit [Quit: WeeChat 2.4]
v3ry3arly has joined #ipfs
<postables[m]> raulk: ok `host.Network()` is working as expected for returning connected peers. However I'm still getting an issue with the `Peerstore()` of `Network()` not acting as expected when using the `Addrs` function. Additionally attempted to use the `Connectedness()` function is also not working as expected, even though I absolutely have a peer connection