aschmahmann changed the topic of #ipfs to: Heads Up: To talk, you need to register your nick! Announcements: go-ipfs 0.7.0 and js-ipfs 0.52.3 are out! Get them from dist.ipfs.io and npm respectively! | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS: https://github.com/ipfs/ipfs | Logs: https://view.matrix.org/room/!yhqiEdqNjyPbxtUjzm:matrix.org/ | Forums: https://discuss.ipfs.io | Code of Conduct: https://git.io/vVBS0
<aschmahmann> I guess one more thing I'd recommend is if you're freshly adding your data to consider doing it with `--cid-version=1` it'll make all the CIDs used in your DAG be more browser friendly and it'll make the leaf nodes of your files be encoded as raw bytes (i.e. it implies `--raw-leaves`) instead of wrapped with some protobuf.
<aschmahmann> It's not a huge deal and they both work fine but just an FYI
<aschmahmann> For the purposes of managing replicas yourself and making it easier for others to help you might want to look at collaborative clusters https://cluster.ipfs.io/documentation/collaborative/.
<aschmahmann> Not required to do what you're trying to do, but might make your time easier.
<kallisti5[m]> the main issue is bar to entry. Trying to keep it low as possible
<kallisti5[m]> pin /ipns/hpkg.haiku-os.org == pretty easy
<aschmahmann> for sure, although they'll have to do it periodically to catch up. All depends on your constraints
<kallisti5[m]> yeah, the repinning thing is a big issue
musalbas has joined #ipfs
mamu has joined #ipfs
mindCrime_ has joined #ipfs
<kallisti5[m]> aschmahmann: so from a badger standpoint, is there anything that could be done to help prevent stuff like the issue I saw? I think the most likely issue was a hard reboot from the hosting company or something. I checked the logs and I provisioned the server 3 days ago... uptime is 2 days.
<kallisti5[m]> I don't think I was adding files or anything then... but who knows. It feels like the CID got to disk, but the data in it didn't
Arwalk has quit [Read error: Connection reset by peer]
dsrt^ has quit [Ping timeout: 252 seconds]
<kallisti5[m]> most databases are transnational to avoid stuff like this (setting a "complete" flag or something after disks have been flushed). I see people talking about badger v3, do you think there are any scenarios which could be improved here?
<kallisti5[m]> I mean... from my perspective the data was working 100%. The only way I even noticed the issue was the pin silently not completing
dsrt^ has joined #ipfs
Arwalk has joined #ipfs
<kallisti5[m]> I guess badgerdb isn't an IPFS thing but a more general thing
mamu has quit [Ping timeout: 246 seconds]
cubemonkey has quit [Ping timeout: 260 seconds]
LHLaurini has quit [Quit: Konversation terminated!]
devdevgoat has joined #ipfs
russ152 has quit [Ping timeout: 265 seconds]
}ls{ has quit [Ping timeout: 246 seconds]
}ls{ has joined #ipfs
ipfs-stackbot has quit [Remote host closed the connection]
ipfs-stackbot has joined #ipfs
Ringtailed-Fox has joined #ipfs
RingtailedFox has quit [Read error: Connection reset by peer]
chiuii has joined #ipfs
chiui has quit [Ping timeout: 276 seconds]
nsh has quit [Quit: ZNC - http://znc.in]
arcatech has joined #ipfs
gumman has quit [Read error: Connection reset by peer]
gumman has joined #ipfs
nsh has joined #ipfs
dpl has quit [Ping timeout: 240 seconds]
Arwalk has quit [Read error: Connection reset by peer]
russ152 has joined #ipfs
Arwalk has joined #ipfs
LHLaurini has joined #ipfs
devdevgoat has quit [Ping timeout: 240 seconds]
lapse[m] has joined #ipfs
teal has joined #ipfs
jrt is now known as Guest49693
Guest49693 has quit [Killed (weber.freenode.net (Nickname regained by services))]
jrt has joined #ipfs
reit has quit [Ping timeout: 252 seconds]
chiuii has quit [Ping timeout: 245 seconds]
arcatech has quit [Quit: Be back later.]
chachasmooth has quit [Ping timeout: 250 seconds]
chachasmooth has joined #ipfs
russ152 has quit [Quit: Leaving]
mindCrime_ has quit [Ping timeout: 268 seconds]
mindCrime_ has joined #ipfs
Arwalk has quit [Read error: Connection reset by peer]
chachasmooth has quit [Ping timeout: 245 seconds]
Arwalk has joined #ipfs
chachasmooth has joined #ipfs
arcatech has joined #ipfs
mindCrime_ has quit [Ping timeout: 240 seconds]
cthulhupunk0[m] has joined #ipfs
KempfCreative has quit [Ping timeout: 260 seconds]
teal has quit [Quit: thanks for the help, everyone]
tayari has joined #ipfs
zeden has quit [Quit: WeeChat 3.0.1]
Acacia has quit [Quit: leaving]
arcatech has quit [Quit: Be back later.]
opa7331 has joined #ipfs
opa has quit [Ping timeout: 250 seconds]
tayari has left #ipfs ["Leaving"]
Acacia has joined #ipfs
<ipfsbot> @Altaergo posted in Can I save multiple images to one url or is there a subfolder system in IPFS - https://discuss.ipfs.io/t/can-i-save-multiple-images-to-one-url-or-is-there-a-subfolder-system-in-ipfs/11150/1
LiftLeft has quit [Ping timeout: 265 seconds]
Adbray has quit [Ping timeout: 250 seconds]
<ipfsbot> @Altaergo posted in How to load IPFS image into Unity or Access that Database in general? - https://discuss.ipfs.io/t/how-to-load-ipfs-image-into-unity-or-access-that-database-in-general/11151/1
daregap has joined #ipfs
Arwalk has quit [Read error: Connection reset by peer]
Arwalk has joined #ipfs
Adbray has joined #ipfs
henriquev has quit [Quit: henriquev]
Arwalk has quit [Read error: Connection reset by peer]
LiftLeft has joined #ipfs
Arwalk has joined #ipfs
kimmovanschaik has joined #ipfs
LiftLeft has quit [Ping timeout: 252 seconds]
hsn has joined #ipfs
Arwalk has quit [Read error: Connection reset by peer]
Arwalk has joined #ipfs
probono has quit [Quit: Ping timeout (120 seconds)]
probono has joined #ipfs
sjchou[m] has joined #ipfs
kimmovanschaik has quit [Read error: Connection reset by peer]
Arwalk has quit [Read error: Connection reset by peer]
Adbray has quit [Read error: Connection reset by peer]
Adbray has joined #ipfs
Arwalk has joined #ipfs
Adbray has quit [Read error: Connection reset by peer]
Adbray has joined #ipfs
gimzmoe has quit [Ping timeout: 265 seconds]
henriquev has joined #ipfs
Arwalk has quit [Read error: Connection reset by peer]
ValeraRozuvan has joined #ipfs
Arwalk has joined #ipfs
valera_ has joined #ipfs
ValeraRozuvan has quit [Ping timeout: 260 seconds]
valera_ has quit [Quit: valera_]
Nact has joined #ipfs
__jrjsmrtn__ has joined #ipfs
_jrjsmrtn has quit [Ping timeout: 240 seconds]
pecastro has joined #ipfs
hsn has quit [Remote host closed the connection]
hsn has joined #ipfs
Arwalk has quit [Read error: Connection reset by peer]
Arwalk has joined #ipfs
Arwalk has quit [Read error: Connection reset by peer]
Arwalk has joined #ipfs
chiuii has joined #ipfs
nsh has quit [Quit: ZNC - http://znc.in]
destroyinator666 has quit [Quit: Idle for 30+ days]
JulianoStefano[m has quit [Quit: Idle for 30+ days]
irisvita[m] has quit [Quit: Idle for 30+ days]
berryzbeta[m] has quit [Quit: Idle for 30+ days]
phanein[m] has quit [Quit: Idle for 30+ days]
henriquev has quit [Quit: henriquev]
dpl has joined #ipfs
musalbas has quit [Quit: ZNC - http://znc.in]
supercoven has joined #ipfs
henriquev has joined #ipfs
mindCrime_ has joined #ipfs
LinusCDE has quit [Ping timeout: 260 seconds]
mindCrime_ has quit [Ping timeout: 240 seconds]
henriquev has quit [Quit: henriquev]
Arwalk has quit [Read error: Connection reset by peer]
Arwalk has joined #ipfs
LinusCDE has joined #ipfs
justanotherdude has joined #ipfs
Arwalk has quit [Read error: Connection reset by peer]
Arwalk has joined #ipfs
aLeSD has joined #ipfs
musalbas has joined #ipfs
nsh has joined #ipfs
gimzmoe has joined #ipfs
atopal[m] has joined #ipfs
Arwalk has quit [Read error: Connection reset by peer]
Arwalk has joined #ipfs
grinja has quit [Ping timeout: 240 seconds]
grinja has joined #ipfs
xyhhx[m] has joined #ipfs
Arwalk has quit [Read error: Connection reset by peer]
Arwalk has joined #ipfs
zeden has joined #ipfs
}ls{ has quit [Quit: real life interrupt]
zeden has quit [Quit: WeeChat 3.0.1]
zeden has joined #ipfs
Arwalk has quit [Read error: Connection reset by peer]
teal has joined #ipfs
Arwalk has joined #ipfs
ipfs-stackbot has quit [Remote host closed the connection]
teal has quit [Quit: WeeChat 3.1]
ipfs-stackbot has joined #ipfs
royal_screwup21 has joined #ipfs
Arwalk has quit [Read error: Connection reset by peer]
Arwalk has joined #ipfs
Manolis has quit [Ping timeout: 246 seconds]
Manolis has joined #ipfs
hooway has joined #ipfs
tech_exorcist has joined #ipfs
McSinyx[m] is now known as McSinyx
McSinyx has quit [Quit: authenticating]
McSinyx has joined #ipfs
Arwalk has quit [Read error: Connection reset by peer]
LHLaurini has quit [Quit: Konversation terminated!]
Arwalk has joined #ipfs
Mikaela has quit [Remote host closed the connection]
Mikaela has joined #ipfs
arcatech has joined #ipfs
<ipfsbot> @Discordian posted in WEEK 4 QUESTIONS | April 25 - May 2, 2021 - https://discuss.ipfs.io/t/week-4-questions-april-25-may-2-2021/11154/1
ValeraRozuvan has joined #ipfs
<kallisti5[m]> aschmahmann: Thanks for the help! I blew away our repo and rebuilt it on a Rasberry Pi 4 at my house (more ram than the silly Vultr node lol). Things seem to be working now. Went with "flat file" over badger since data integrity on the "central seeding node" is more important that on nodes pinning content.
<kallisti5[m]> <shameless plug>, please pin (and occasionally repin) ```/ipns/hpkg.haiku-os.org``` if you have a bit of extra space (~20 GiB today) and want to help host Haiku's package repositories + artifacts on IPFS :-) </shameless plug>
Soni has joined #ipfs
<Soni> how do you make an ipfs mutable?
<McSinyx> you don't, you make a new one
<McSinyx> think of git
<McSinyx> btw i have some data pinned by pinata, which is reachable via public gateways but not through the local ones (timed out) on a CI
<Soni> dat allows things to evolve
<McSinyx> <McSinyx "btw i have some data pinned by p"> would explicitly connecting the local node to the gateway helps the latency and how can I find the multiaddr to `ipfs swarm connect`
<McSinyx> you can try ipfs mfs if i understand correctly what you meant by evolving
jrvlima has joined #ipfs
<aschmahmann> Soni: There are a variety of ways to build mutable systems that link to immutable IPFS data. Some of the ones off the top of my head are IPNS, DNSLink, and Textile Threads
royal_screwup21 has quit [Quit: Connection closed]
royal_screwup21 has joined #ipfs
voker57 has quit [Quit: No Ping reply in 180 seconds.]
voker57 has joined #ipfs
<Discordian[m]> <McSinyx "btw i have some data pinned by p"> I wonder, I would imagine you could add some pinata nodes to your bootstrap to assist with this, but I can't find where you'd get a pinata multiaddress to bootstrap with.
hooway_ has joined #ipfs
hooway has quit [Read error: Connection reset by peer]
<McSinyx> that'd be even better, but I couldn't find that documented anywhere either
<McSinyx> how about the public gateways, can i connect to them directly?
<kallisti5[m]> you can access files on public gateways, you really can't push files via public gateways
<kallisti5[m]> One hard lesson is IPFS isn't magic. Everyone temporarily pulls data from your nodes when requested.
<McSinyx> that's not wat I meant, kallisti5 (@kallisti5:matrix.org)
<McSinyx> let me try to rephrase, I already have the files pinned locally and on pinata
<McSinyx> since I want to have the checksum done by ipfs I want to access it via the local gateway
<kallisti5[m]> If you have your data pinned locally, then you can connect to any gateway to access it.
<Discordian[m]> <McSinyx "how about the public gateways, c"> I think so, but I'd personally try emailing them. I mean, they are selling a service of course ;p
<McSinyx> yes, kallisti5 (@kallisti5:matrix.org), but I also need to run the thing on a CI
<kallisti5[m]> (keeping in mind the speed will be dependent on the gateway "finding and pulling" the data from your node)
<McSinyx> Discordian, yea that sounds like a good idea, let me try
<kallisti5[m]> McSinyx: You need a "IPFS server" to host the data then.
<McSinyx> I do
<kallisti5[m]> and push from CI to that server to host it
<kallisti5[m]> (making sure to securely expose the API from your IPFS node to the CI system
<McSinyx> the data is on pinata (well my local bandwidth is shit so let's not count on it) and I cannot afford a dedicated machine with decent bandwidth and domain at the moment
<kallisti5[m]> ok, then Pinata is your "IPFS server"
<kallisti5[m]> Push to pinata, then you can access from any gateway
<McSinyx> yep but it is slow, so I'm asking if I can explicitly connect to pinata or a public gateway to speed it up
<McSinyx> (by slow I meant after a few minutes the content's still not found)
<kallisti5[m]> yes. Pinata offers a gateway as well... it's https://gateway.pinata.cloud/
<McSinyx> I don't want to trust the host
<McSinyx> https would warrant the connection, not the actual content
<McSinyx> driving the data through a ipfs node I can control would verify the integrity of the data
<kallisti5[m]> That kinda goes back to my original statement. "IPFS isn't magic" You need to convince more folks to pin your data (and re-pin it) The more folks who pin it, the faster your data will be located in IPFS
<McSinyx> eventually, yes
<kallisti5[m]> I wasn't being a jerk saying that... it was a hard learned lesson on my part early on :-)
<McSinyx> it's like the chicken an egg problem
<kallisti5[m]> yup
<kallisti5[m]> I have a ton of fast moving data I want to try and host on IPFS
<kallisti5[m]> I stick it out there... but have to convince people to pin it (and re-pin it) so it becomes reliable
<kallisti5[m]> Really can't wait for automatic ipns re-pinning... wink wink nudge nudge
<kallisti5[m]> also keep bandwidth in mind. You're going to have "inbound and outbound" bandwidth on pretty much every IPFS node / gateway
<McSinyx> my use case is providing a software repository which would change less often
<McSinyx> i kinda expect when it's used it'd behave similar to peertube and stuff will balance themselves and eventually dropping the need for a pinning service in favor of people running their own mirrors
<Soni> sure, it's no ipfs:// support, but at least it doesn't straight-up break
Soni has left #ipfs ["http://quassel-irc.org - Chat comfortably. Anywhere."]
LiftLeft has joined #ipfs
mindCrime_ has joined #ipfs
royal_screwup21 has quit [Quit: Connection closed]
royal_screwup21 has joined #ipfs
soswag[m] has quit [Quit: Idle for 30+ days]
buskila[m] has quit [Quit: Idle for 30+ days]
wayne has joined #ipfs
<wayne> o/
<McSinyx> \o
arcatech has quit [Quit: Be back later.]
royal_screwup21 has quit [Quit: Connection closed]
royal_screwup21 has joined #ipfs
arcatech has joined #ipfs
royal_screwup21 has quit [Ping timeout: 268 seconds]
mindCrime_ has quit [Ping timeout: 265 seconds]
jesse22 has joined #ipfs
Nact has quit [Quit: Konversation terminated!]
zeden has quit [Quit: WeeChat 3.0.1]
zeden has joined #ipfs
<RomeSilvanus[m]> (\ 🐴
royal_screwup21 has joined #ipfs
royal_screwup21 has quit [Ping timeout: 252 seconds]
royal_screwup21 has joined #ipfs
dpl has quit [Ping timeout: 240 seconds]
distributedGuru has joined #ipfs
MJCD has joined #ipfs
cp- has quit [Quit: Disappeared in a puff of smoke]
cp- has joined #ipfs
jesse22 has quit [Ping timeout: 276 seconds]
reit has joined #ipfs
jesse22 has joined #ipfs
<Piddle> /)
<Piddle> * Rome Silvanus: lol /)
royal_screwup21 has quit [Quit: Connection closed]
royal_screwup21 has joined #ipfs
royal_screwup213 has joined #ipfs
royal_screwup21 has quit [Quit: Connection closed]
royal_screwup213 has quit [Ping timeout: 265 seconds]
Arwalk has quit [Read error: Connection reset by peer]
Arwalk has joined #ipfs
hooway_ has quit [Quit: Gone fishing.]
reit has quit [Ping timeout: 246 seconds]
royal_screwup213 has joined #ipfs
royal_screwup213 has quit [Ping timeout: 246 seconds]
<Discordian[m]> I just sent myself Diablo 2 at 193MB/s over IPFS through a gateway and just wow. Those gateways really do have a lot of speed.
HardcoreSushi[m] has joined #ipfs
jess has joined #ipfs
<romanblanco[m]> <Discordian[m] "When you figure it out, please t"> Setting up port forwarding helped.
lord| has quit [Ping timeout: 246 seconds]
ValeraRozuvan has quit [Remote host closed the connection]
ValeraRozuvan has joined #ipfs
ValeraRozuvan has quit [Remote host closed the connection]
lord| has joined #ipfs
}ls{ has joined #ipfs
koo5 has joined #ipfs
mowcat has joined #ipfs
mowcat has quit [Remote host closed the connection]
zeden has quit [Ping timeout: 265 seconds]
zeden has joined #ipfs
ValeraRozuvan has joined #ipfs
dpl has joined #ipfs
koo5 has quit [*.net *.split]
cp- has quit [*.net *.split]
daregap has quit [*.net *.split]
gumman has quit [*.net *.split]
moony has quit [*.net *.split]
xentec has quit [*.net *.split]
null1337 has quit [*.net *.split]
jeanlouie6 has quit [*.net *.split]
rsheftel1 has quit [*.net *.split]
Moonspell has quit [*.net *.split]
g2anj has quit [*.net *.split]
tedious has quit [*.net *.split]
arthuredelstein has quit [*.net *.split]
cxl000 has quit [*.net *.split]
cypher has quit [*.net *.split]
wking has quit [*.net *.split]
graffen has quit [*.net *.split]
dexter0 has quit [*.net *.split]
paddymahoney has quit [*.net *.split]
null1337 has joined #ipfs
g2anj has joined #ipfs
daregap has joined #ipfs
koo5 has joined #ipfs
cypher has joined #ipfs
cxl000 has joined #ipfs
graffen has joined #ipfs
wking has joined #ipfs
gumman has joined #ipfs
rsheftel1 has joined #ipfs
xentec has joined #ipfs
jeanlouie6 has joined #ipfs
arthuredelstein has joined #ipfs
Moonspell has joined #ipfs
tedious has joined #ipfs
cp- has joined #ipfs
moony has joined #ipfs
paddymahoney has joined #ipfs
dexter0 has joined #ipfs
cp- has quit [Max SendQ exceeded]
null1337 has quit [Max SendQ exceeded]
moony has quit [Max SendQ exceeded]
cp- has joined #ipfs
null1337 has joined #ipfs
moony has joined #ipfs
royal_screwup213 has joined #ipfs
Arwalk has quit [Read error: Connection reset by peer]
Arwalk has joined #ipfs
coniptor has quit [Ping timeout: 268 seconds]
<ipfsbot> @smixqse posted in Pinning a file without maintaining it in storage - https://discuss.ipfs.io/t/pinning-a-file-without-maintaining-it-in-storage/11156/1
coniptor has joined #ipfs
supercoven has quit [Ping timeout: 268 seconds]
royal_screwup213 has quit [Quit: Connection closed]
royal_screwup213 has joined #ipfs
royal_screwup213 has quit [Ping timeout: 265 seconds]
<kallisti5[m]> question. How does pinning handle old references?
<kallisti5[m]> if data from the first pin disappears, will it be garbage collected? I mean... it was technically a CID that's pinned
kn0rki has joined #ipfs
mindCrime_ has joined #ipfs
benjamingr__ has joined #ipfs
royal_screwup213 has joined #ipfs
kn0rki has quit [Quit: Leaving]
jadedctrl has quit [Ping timeout: 246 seconds]
mindCrime_ has quit [Ping timeout: 240 seconds]
Arwalk has quit [Read error: Connection reset by peer]
coniptor has quit [Ping timeout: 252 seconds]
Arwalk has joined #ipfs
asimons04[m] has joined #ipfs
mowcat has joined #ipfs
coniptor has joined #ipfs
Landryl has joined #ipfs
justanotherdude has quit [Quit: RAGEQUIT]
MrSprinkles has joined #ipfs
royal_screwup213 has quit [Quit: Connection closed]
royal_screwup213 has joined #ipfs
MrSparkle has quit [Ping timeout: 245 seconds]
qrpnxz has left #ipfs [#ipfs]
qrpnxz has joined #ipfs
qrpnxz has left #ipfs [#ipfs]
qrpnxz has joined #ipfs
royal_screwup213 has quit [Ping timeout: 260 seconds]
qrpnxz has left #ipfs [#ipfs]
qrpnxz has joined #ipfs
coniptor has quit [Ping timeout: 265 seconds]
tryte has quit [Remote host closed the connection]
tryte has joined #ipfs
tech_exorcist has quit [Quit: tech_exorcist]
ipfslog has joined #ipfs
coniptor has joined #ipfs
royal_screwup213 has joined #ipfs
pecastro has quit [Ping timeout: 260 seconds]
hax404 has quit [Quit: WeeChat 2.9]
hax404 has joined #ipfs
mowcat has quit [Remote host closed the connection]
Acacia has quit [Ping timeout: 250 seconds]
royal_screwup213 has quit [Quit: Connection closed]
qrpnxz has left #ipfs ["Disconnected: closed"]
royal_screwup213 has joined #ipfs
royal_screwup213 has quit [Ping timeout: 265 seconds]
LHLaurini has joined #ipfs
dpl has quit [Read error: Connection reset by peer]
dpl has joined #ipfs
royal_screwup213 has joined #ipfs
halbeno has quit [Quit: Leaving.]
qrpnxz has joined #ipfs
halbeno has joined #ipfs
royal_screwup213 has quit [Quit: Connection closed]
royal_screwup213 has joined #ipfs
royal_screwup213 has quit [Ping timeout: 240 seconds]
opa7331 has quit [Ping timeout: 265 seconds]
royal_screwup213 has joined #ipfs
mindCrime_ has joined #ipfs
royal_screwup213 has quit [Quit: Connection closed]
royal_screwup213 has joined #ipfs
opa7331 has joined #ipfs