stebalien changed the topic of #ipfs to: Heads Up: To talk, you need to register your nick! Announcements: go-ipfs 0.5.1 and js-ipfs 0.43.1 are out! Get them from dist.ipfs.io and npm respectively! | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS: https://github.com/ipfs/ipfs | Logs: https://view.matrix.org/room/!yhqiEdqNjyPbxtUjzm:matrix.org/ | Forums: https://discuss.ipfs.io | Code of Conduct: https://git.io/vVBS0
<bleonard252>
* I'm not a fan of brave, and I'm not talking about that here
kn0rki has quit [Quit: Leaving]
Soo_Slow has joined #ipfs
AbramAdelmo has joined #ipfs
AbramAdelmo has quit [Ping timeout: 260 seconds]
nettle has left #ipfs ["WeeChat 1.9-dev"]
sz0 has quit [Quit: Connection closed for inactivity]
<RubenKelevra[m]>
Nato Boram (Discord): you're online?
Soo_Slow has quit [Quit: Soo_Slow]
digitalnomad91_ has joined #ipfs
<NatoBoramDiscor7>
Yeah
<RubenKelevra[m]>
Nato Boram (Discord): saw your ticket. I run a mirror with packages as well. While mine isn't that complex. Do you use rsync for your import?
<NatoBoramDiscor7>
Yep, `rsync -a`
digitalnomad91 has quit [Ping timeout: 256 seconds]
<RubenKelevra[m]>
rsync can resolve all symlinks on a sync and replace them with the actual files. I than go ahead and specify all stuff I want receive and don't receive to eliminate the duplicated (in my case a folder just contain basically everything and the individual repos contain just symlinks).
<RubenKelevra[m]>
Not sure how much your repos would grow if you resolve all symlinks... is one deb package used for different repos?
<NatoBoramDiscor7>
Yeah, I figured I could try to follow some links and ignore others, but then it wouldn't be a perfect mirror. Also there's recursive links so following everything wouldn't work
<NatoBoramDiscor7>
I haven't tried to deduplicate the Btrfs drive yet, but that might help with resolving too many links
Trieste has quit [Ping timeout: 260 seconds]
<NatoBoramDiscor7>
… but not with `..` links
<RubenKelevra[m]>
You don't need to replicate a "perfect" mirror, since nobody is mirroring from you back to a regular mirror. You just have to modify the mirror content for your needs to make apt work with it. That's the way I choose
<NatoBoramDiscor7>
Indeed, that would be practical. For now I think I'll let it be broken, I think it might be useful to fix the underlying issue with IPFS
<NatoBoramDiscor7>
It's not like I'm actually going to use it over the standard http mirrors since those are just way faster than IPFS even on the same network
<RubenKelevra[m]>
It will be fixed, but not in the absolutly near future (I guess). They are working on UnixFS 1.5 and UnixFS 2.0. At least the second one will fix it
<RubenKelevra[m]>
I had reports for my setup that it's actually faster than http :)
Trieste has joined #ipfs
arthuredelstein has joined #ipfs
<NatoBoramDiscor7>
Ah? I guess using a raspi might be prone to slowness 🤔
<RubenKelevra[m]>
Well, I use a virtual server with 4 Xeon cores and 16 GB memory for import to the cluster, and there are multiple cluster followers who replicate the data.
<NatoBoramDiscor7>
Ah, that could also help
<NatoBoramDiscor7>
Xeon vs Raspi. Nice!
<RubenKelevra[m]>
My script is just bash, it basically imports the full file structure on the first run and pushes each file as individual pin to the cluster and create a file/folder structure in the local MFS.
<RubenKelevra[m]>
On every rsync update, it will parse the rsync log and update the MFS and the cluster pins.
<RubenKelevra[m]>
Might not be the prettiest thing in the world, but it can even recover from hard shutdowns while parsing an rsync log :)
kivutar has quit [Ping timeout: 256 seconds]
ipfs-stackbot1 has quit [Remote host closed the connection]
ipfs-stackbot1 has joined #ipfs
kivutar has joined #ipfs
opal has quit [Ping timeout: 240 seconds]
halbeno_ has joined #ipfs
halbeno has quit [Ping timeout: 260 seconds]
ljmf00_ has joined #ipfs
ljmf00 has quit [Ping timeout: 246 seconds]
drathir_tor has quit [Remote host closed the connection]
mowcat has quit [Remote host closed the connection]
opal has joined #ipfs
Acacia has quit [Ping timeout: 260 seconds]
Acacia has joined #ipfs
drathir_tor has joined #ipfs
Belkaar_ has quit [Ping timeout: 256 seconds]
Belkaar has joined #ipfs
Belkaar has joined #ipfs
Belkaar has quit [Changing host]
AbramAdelmo has joined #ipfs
AbramAdelmo_ has joined #ipfs
AbramAdelmo has quit [Ping timeout: 256 seconds]
<NatoBoramDiscor7>
I tried to add LineageOS builds as separate pins on a cluster, but the problem with that is that I needed to have enough space to host the full thing anyway, and that wasn't possible on a 5$ Digital Ocean node
<NatoBoramDiscor7>
For MFS, it would be nice if we could mount MFS and just put things there then later get a pin hash from the node
<NatoBoramDiscor7>
If I could `rsync` Ubuntu Archives into a MFS mount point then share the hash of the result, that would be totally awesome
Guest42310 has quit [Quit: Guest42310]
jcea has quit [Quit: jcea]
Guest42310 has joined #ipfs
stripedpajamas has quit [Quit: sleeping...]
stripedpajamas has joined #ipfs
<RubenKelevra[m]>
Sure, but I actually would like to see the fuse mount option of IPFS disappear. It's a security issue. A second daemon could create something like an NFS server and create the datastructure on a IPFS cluster for example
user_51 has quit [Ping timeout: 272 seconds]
user_51 has joined #ipfs
kivutar has quit [Ping timeout: 258 seconds]
CCR5-D32 has quit [Quit: ZZZzzz…]
kivutar has joined #ipfs
jrt has quit [Killed (orwell.freenode.net (Nickname regained by services))]
jrt has joined #ipfs
ddahl has quit [Ping timeout: 272 seconds]
misuto has quit [Quit: Ping timeout (120 seconds)]
<NatoBoramDiscor7>
Actually, do you use `--nocopy` when adding the mirror?
<NatoBoramDiscor7>
Hm, wait, if you only add the changed files from the rsync log, then it probably doesn't take 3 hours for IPFS to update the mirror...
<NatoBoramDiscor7>
So the InRelease file wouldn't be a problem even if it was changed on disk because it's already backed up by a cluster 🤔
<NatoBoramDiscor7>
So the `InRelease` file wouldn't be a problem even if it was changed on disk because it's already backed up by a cluster 🤔
<NatoBoramDiscor7>
So... what's your mirror's IPNS? 😆
pcheek has quit [Read error: Connection reset by peer]
MDude has quit [Quit: Going offline, see ya! (www.adiirc.com)]
daregap has joined #ipfs
Trieste has quit [Ping timeout: 246 seconds]
Trieste has joined #ipfs
xcm has quit [Read error: Connection reset by peer]
<Daniel0011[m]>
how do i use ipfs behind a carrier grade nat
<Daniel0011[m]>
aka with double nat 4g
Acacia has joined #ipfs
aldente has joined #ipfs
Ecran_ has joined #ipfs
Ecran has quit [Ping timeout: 256 seconds]
kivutar has quit [Ping timeout: 256 seconds]
<foxcpp>
Daniel0011[m]: as usual, but do not expect to be able to share files easily and reliably
benjamingr__ has joined #ipfs
Ecran__ has joined #ipfs
Ecran_ has quit [Ping timeout: 260 seconds]
witt-designsDi10 has joined #ipfs
<hsn>
Daniel0011[m]: get ipv6 tunnel
<Daniel0011[m]>
cannot
<Daniel0011[m]>
he.net require ICMP
<Daniel0011[m]>
he.net require ICMP
<Daniel0011[m]>
he.net require ICMP allowed, can't control isp network
jrabe has quit [Disconnected by services]
jrabe has joined #ipfs
jrabe is now known as Guest42490
Guest42490 has quit [Killed (egan.freenode.net (Nickname regained by services))]
Guest42490 has joined #ipfs
kivutar has joined #ipfs
ercthedestroyer4 has joined #ipfs
ddahl has joined #ipfs
Pie-jacker875 has quit [Read error: Connection reset by peer]
Pie-jacker875 has joined #ipfs
mauz555 has joined #ipfs
memobook[m] has joined #ipfs
aldente has quit [Read error: Connection reset by peer]
aldente has joined #ipfs
mowcat has joined #ipfs
mowcat has quit [Remote host closed the connection]
kivutar has quit [Ping timeout: 260 seconds]
MDude has joined #ipfs
<ZorPrime>
Daniel0011[m]: openvpn and tunnel ipv6 that way? Who is your ISP?
stripedpajamas has joined #ipfs
AbramAdelmo has joined #ipfs
pasticcio3 has quit [Ping timeout: 260 seconds]
kivutar has joined #ipfs
AbramAdelmo has quit [Ping timeout: 256 seconds]
<Daniel0011[m]>
> Daniel\: openvpn and tunnel ipv6 that way? Who is your ISP?
<Daniel0011[m]>
@ZorPrime#0000
<Daniel0011[m]>
I have tried all 3 mobile carriers in Australia, they all CGNAT.. and i've been unable to get a dynamic IPv4 from any, yes also on postpaid!.. Only 1 has IPv6, but they firewall incoming on the ipv6.. 😦
<bleonard252>
Try getting an actual ISP instead of a mobile carrier?
Ecran__ has quit [Quit: Going offline, see ya! (www.adiirc.com)]
pasticcio3 has joined #ipfs
Trieste has quit [Ping timeout: 240 seconds]
jesse22 has quit [Ping timeout: 244 seconds]
jesse22 has joined #ipfs
Trieste has joined #ipfs
KeiraT has quit [Remote host closed the connection]
KeiraT has joined #ipfs
kivutar has quit [Ping timeout: 260 seconds]
Landryl has joined #ipfs
riemann has joined #ipfs
pjz has quit [Ping timeout: 265 seconds]
pjz has joined #ipfs
ZaZ has quit [Read error: Connection reset by peer]
<hsn>
Just buy some cloud machine for $5 per month and run ipfs there.
<hsn>
Now we have that self - updating fedora bazmeg, you don't have to care about it.
<hsn>
or you can buy just some ipfs hosting. such as temporal 0.07 per GB.
<foxcpp>
do w have pin-cluster-as-a-service already?