alanshaw changed the topic of #ipfs to: Heads Up: To talk, you need to register your nick! Announcements: go-ipfs 0.4.22 and js-ipfs 0.40 are out! Get them from dist.ipfs.io and npm respectively! | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS, the InterPlanetary FileSystem: https://github.com/ipfs/ipfs | Logs: https://view.matrix.org/room/!yhqiEdqNjyPbxtUjzm:matrix.org/ | Forums: https://discuss.ipfs.io | Code of
bsm117532 has quit [Ping timeout: 258 seconds]
jcea has quit [Remote host closed the connection]
jcea has joined #ipfs
mowcat has quit [Remote host closed the connection]
llorllale has quit [Quit: WeeChat 1.9.1]
mithilarun has quit [Remote host closed the connection]
galactus314 has joined #ipfs
galactus314 has quit [Remote host closed the connection]
galactus314 has joined #ipfs
mithilarun has joined #ipfs
mithilarun has quit [Read error: Connection reset by peer]
mithilarun has joined #ipfs
Adbray has joined #ipfs
Vaelatern has quit [Ping timeout: 240 seconds]
Vaelatern has joined #ipfs
mithilarun has quit [Remote host closed the connection]
lord| has quit [Read error: Connection reset by peer]
lord| has joined #ipfs
__jrjsmrtn__ has joined #ipfs
_jrjsmrtn has quit [Ping timeout: 258 seconds]
galactus314 has quit [Quit: Leaving]
manray has quit [Ping timeout: 268 seconds]
Z[m]1 has joined #ipfs
jadedctrl has quit [Quit: WeeChat 2.2]
jcea has quit [Remote host closed the connection]
g2anj_ has quit [Quit: .]
g2anj has joined #ipfs
MrAureliusR has joined #ipfs
jcea has joined #ipfs
iczero has quit [Remote host closed the connection]
zeden has quit [Quit: WeeChat 2.6]
Clarth has joined #ipfs
user_51 has quit [Ping timeout: 240 seconds]
user_51 has joined #ipfs
Belkaar has quit [Ping timeout: 258 seconds]
Belkaar has joined #ipfs
Belkaar has joined #ipfs
hurikhan77 has joined #ipfs
jcea has quit [Read error: Connection reset by peer]
ctOS has quit [Quit: Connection closed for inactivity]
shizy has joined #ipfs
blueingress has quit [Quit: leaving]
kakra has quit [Ping timeout: 268 seconds]
DavidPH has joined #ipfs
xcm has quit [Read error: Connection reset by peer]
xcm has joined #ipfs
wlp1s1 has joined #ipfs
Elfo_ has joined #ipfs
verin0x3 has joined #ipfs
Clarth has quit [Ping timeout: 246 seconds]
Elfo has quit [Ping timeout: 265 seconds]
blueingress has joined #ipfs
lidel` has joined #ipfs
verin0x has quit [Ping timeout: 268 seconds]
verin0x3 is now known as verin0x
shah^ has joined #ipfs
ipfs-stackbot1 has quit [Remote host closed the connection]
lidel has quit [Ping timeout: 258 seconds]
lidel` is now known as lidel
ipfs-stackbot1 has joined #ipfs
_whitelogger has joined #ipfs
tryte has quit [Remote host closed the connection]
tryte has joined #ipfs
joocain2 has quit [Ping timeout: 240 seconds]
joocain2 has joined #ipfs
_whitelogger has joined #ipfs
jadedctrl has joined #ipfs
albsen[m] has joined #ipfs
shizy has quit [Remote host closed the connection]
Intensity has quit [*.net *.split]
v3ry3arly has joined #ipfs
Intensity has joined #ipfs
tryte has quit [Remote host closed the connection]
tryte has joined #ipfs
fleeky has quit [Ping timeout: 258 seconds]
q-u-a-n2 has quit [Remote host closed the connection]
q-u-a-n2 has joined #ipfs
cp- has quit [Quit: Disappeared in a puff of smoke]
cp- has joined #ipfs
hairstorm has joined #ipfs
devolves has quit [Ping timeout: 258 seconds]
xcm has quit [Remote host closed the connection]
ibnesayeed[m] has joined #ipfs
fleeky has joined #ipfs
xcm has joined #ipfs
xcm has quit [Read error: Connection reset by peer]
xcm has joined #ipfs
ARandomUser78578 has quit [Read error: Connection reset by peer]
rendar has joined #ipfs
<ShadowJonathanDi> @dgold#0000 you're not serving 250kb, you're being a part of the network, which with go-ipfs means that it's managing dht, peerstore, blockstore, and many more things
<ShadowJonathanDi> @hsanjuan#0000 exactly
Trieste has quit [Ping timeout: 265 seconds]
Belkaar has quit [Read error: Connection reset by peer]
Trieste has joined #ipfs
Belkaar has joined #ipfs
Belkaar has joined #ipfs
ylp has joined #ipfs
awk1314 has joined #ipfs
awk1314 has quit [Max SendQ exceeded]
awk1314 has joined #ipfs
brainiac[m] has joined #ipfs
ryrick[m] has joined #ipfs
brainiac[m] has left #ipfs ["User left"]
awk1314 has quit [Quit: Leaving]
vmx has joined #ipfs
jdloft has quit [Read error: Connection reset by peer]
jdloft has joined #ipfs
Adbray has quit [Quit: Ah! By Brain!]
<dgold> ShadowJonathanDi: that's fine - but the network needs to adapt to users who have a) limited computing resources or b) limited financial resources
<dgold> its all very well saying that the network is open and censor-proof, but if all you're doing is providing those for the wealthy, then you're just gatekeeping like the rest
ARandomUser74624 has joined #ipfs
ARandomUser74624 has quit [Read error: Connection reset by peer]
<ShadowJonathanDi> Technically
<ShadowJonathanDi> You can strip a libp2p client to just serve a few blocks
<eleitlDiscord[m]> bonedaddy Is the connection manager saw-toothing an artefact, or does it actually kill some 50% of active connections?
<ShadowJonathanDi> Only maintain peer connections, enough of the DHT to self-identity, and a minimal static block-store
<ShadowJonathanDi> That's really possible
<ShadowJonathanDi> Generate IPFS file structures via a normal client, collect all the blocks, and submit them manually/directly to the minimal block store client, which then starts serving those blocks to the network
<ShadowJonathanDi> Limit the possible connections, and boom
<ShadowJonathanDi> You just have a node sitting on a raspberry pi that's able to serve 10GB of files from just about anywhere
<ShadowJonathanDi> Maybe that's the future, connect to it via Bluetooth, add a battery, carry it around
<ShadowJonathanDi> Make it contain a chunk of important files, bring them all together in a mesh network to serve files to the local and interplanetary network
<ShadowJonathanDi> * Make it contain a chunk of important blocks, bring them all together in a mesh network to serve files to the local and interplanetary network
teleton has joined #ipfs
<ShadowJonathanDi> Maybe use a protocol to push/delete blocks onto that minimal implimentation, maybe make an `auth` protocol where you can authenticate yourself or any node by private-public key authentication, whereafter you can indeed do those operations
<ShadowJonathanDi> * Maybe use a custom libp2p protocol to push/delete blocks onto that minimal implimentation, maybe make an `auth` protocol where you can authenticate yourself or any node by private-public key authentication, whereafter you can indeed do those operations
<ShadowJonathanDi> The point of libp2p is to be a blank canvas that everyone can use and manipulate
<ShadowJonathanDi> Making building common protocols on top of generalised channels extremely easy to do
<eleitlDiscord[m]> How much resources do I need to publish and pin ~1 Tb? 10 Tb? Is the node RAM use going to go up?
Adbray has joined #ipfs
lecom[m] has joined #ipfs
<ShadowJonathanDi> Depends on the blockstore implimentation
<ShadowJonathanDi> If you're going to pin 1TB of ipfs data (presumably)... one second
<ShadowJonathanDi> You're going to be publishing 4 million multihashes onto the network
<ShadowJonathanDi> Dividing 1 TB with 256 kb, the standard chunk of an ipfs file (presumably)
<ShadowJonathanDi> It depends on how efficiently your blockstore implimentation stores those blocks, and how it maps to hashes
<ShadowJonathanDi> But your DHT is gonna be filled with those 4 million hashes, and it needs to check any incoming request against that
<ShadowJonathanDi> I'd say you would want (at least) 2 TB to store this (I'm gonna guess it's gonna take 1.1TB for the blockstore, but I have no reference or experience), and then a moderate CPU (just think any normal old corporate desktop computer from 2 years ago) with about 4 GB of ram minimally to be able to efficiently serve this
<ShadowJonathanDi> Please know this is my calculation though, and it's not founded in much substantial experience/evidence
<ShadowJonathanDi> RAM use going up depends on how the peerstore and DHT behaves, and the amount of connections you wanna accept (and thus allocate protocol resources with them)
mubelotix[m] has joined #ipfs
<ShadowJonathanDi> I recommend limiting connections in general, I *don't* recommend putting the thing in dht client mode, else it's possible it's never able to announce the blocks it's serving
dethos has joined #ipfs
mollusque[m] has joined #ipfs
chardy has quit [Quit: ircN 8.00 for mIRC (20100904) - www.ircN.org]
woss has joined #ipfs
<mollusque[m]> Is there an Android app that can sync data from an ipfs node? I'd like one folder, let's say "MyMusic" hosted on my desktop to be continuously synced with my android device
funnymania[m] has joined #ipfs
ctOS has joined #ipfs
Kevin_ has joined #ipfs
<eleitlDiscord[m]> ShadowJonathan Thank you, extremely useful information.
<eleitlDiscord[m]> I'll try testing IPFS cluster for replication between these instances.
<ShadowJonathanDi> @mollusque#0000 there's a bunch of android apps that impliment IPFS, though I don't have any good recommendations
<mollusque[m]> ShadowJonathan (Discord): But do they sync automatically? I'd like my files to be downloaded to the phone's internal storage
<mollusque[m]> Basically so that local music players can access the files and play them
<ShadowJonathanDi> No, you will have to manually copy and paste the multihash that contains the folder
<mollusque[m]> Without needing to understand the ipfs protocol
<ShadowJonathanDi> I know what you're hinting at, but it's very unlikely that it's widely/extensively supported in an application atm
<mollusque[m]> <ShadowJonathanDi "No, you will have to manually co"> That would work too, as long as all the files stay on my phone's local storage
<ShadowJonathanDi> It requires versioning, something that I haven't yet seen done properly in IPFS
<mollusque[m]> Alright
<mollusque[m]> I was thinking of something more like Syncthing, if you're familiar with that
<mollusque[m]> But okay, I will try a bunch of apps and see what/if they work for my use case
<mollusque[m]> Thank you
Kevin_ has quit []
xcm has quit [Remote host closed the connection]
RamRanRa has joined #ipfs
xcm has joined #ipfs
kiwi_uk[m]1 has left #ipfs ["User left"]
kiwi_uk[m]2 has joined #ipfs
kiwi_uk[m]2 is now known as kiwi_uk[m]4
mowcat has joined #ipfs
manray has joined #ipfs
kiwi_uk[m]4 is now known as kiwi_uk[m]6
brianhoffman has quit [Ping timeout: 265 seconds]
jcea has joined #ipfs
kiwi_uk[m]6 has left #ipfs ["User left"]
<ShadowJonathanDi> Yeah np
mowcat has quit [Remote host closed the connection]
stoopkid has quit [Quit: Connection closed for inactivity]
hairstorm has quit [Quit: hairstorm]
zeden has joined #ipfs
woss has quit [Remote host closed the connection]
woss has joined #ipfs
bengates has joined #ipfs
bengates has quit [Remote host closed the connection]
llorllale has joined #ipfs
lazyarmadillo[m] has joined #ipfs
fleeky has quit [Ping timeout: 240 seconds]
<hsanjuan[m]> Ah, the connection manager is set to 5000-10000 with grace period of 20s. Bloom filter size to 10485760
KempfCreative has joined #ipfs
<eleitlDiscord[m]> @hsanjuan: Thank you, great info!
teleton has quit [Ping timeout: 248 seconds]
Markus72[m] has left #ipfs ["User left"]
brianhoffman has joined #ipfs
teleton has joined #ipfs
woss has quit [Ping timeout: 268 seconds]
jdloft has quit [Ping timeout: 260 seconds]
Jybz has joined #ipfs
rardiol has quit [Ping timeout: 265 seconds]
rardiol has joined #ipfs
mattsse[m] has joined #ipfs
matt-h has quit [Quit: Leaving]
Safavid has joined #ipfs
matt-h has joined #ipfs
xcm has quit [Read error: Connection reset by peer]
xcm has joined #ipfs
manray has quit [Ping timeout: 265 seconds]
manray has joined #ipfs
manray has quit [Ping timeout: 258 seconds]
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
Safavid has quit [Ping timeout: 268 seconds]
burg has joined #ipfs
teleton has quit [Quit: Leaving]
<eleitlDiscord[m]> The CX11 instances https://www.hetzner.com/cloud seem to hold up fine with ipfs (started as ipfs daemon --enable-pubsub-experiment --enable-namesys-pubsub )
<eleitlDiscord[m]> Anything I should enable in the config to help the network? I can spare 20 Tb/month, so some extra traffic is no problem.
<eleitlDiscord[m]> This is with ipfs init --profile=badgerds
manray has joined #ipfs
vmx has quit [Quit: Leaving]
<eleitlDiscord[m]> Added ipfs config server apply
dethos has quit [Quit: Time to Go!]
<mollusque[m]> @elei
<hsanjuan[m]> <eleitlDiscord[m] "Added ipfs config server apply"> yes, otherwise hetzner will block you
<mollusque[m]> eleitl (Discord): what are you planning to serve on the CX11? If you don't mind sharing
lufi has quit [Quit: Free ZNC ~ Powered by LunarBNC: https://LunarBNC.net]
lufi has joined #ipfs
<hsanjuan[m]> eleitl (Discord): you can enable QUIC (add a .../udp/4001/quic listen multiaddress to the list along the default .../tcp/4001). And it probably good if you regularly "ipfs swarm connect /dnsaddr/ipfs-nodes.cluster.ipfs.io"
fleeky has joined #ipfs
<eleitlDiscord[m]> @mollusque: just playing around with several instances, config options, see how things scale
<eleitlDiscord[m]> I can scale up these if I run into limitations.
<hsanjuan[m]> <bonedaddyDiscord "Jk maybe 2-5 months. The latest "> Seems 0.5.0 will be released in early January
<eleitlDiscord[m]> ipfs config --json Experimental.QUIC true doesn't seem to rewrite the config, so I have to do it manually.
jamiew has quit [Quit: ZNC - https://znc.in]
bsm117532 has joined #ipfs
<eleitlDiscord[m]> Swarm announcing /ip6/::1/tcp/4001
<eleitlDiscord[m]> Swarm announcing /ip6/::1/udp/4001/quic
jamiew has joined #ipfs
<eleitlDiscord[m]> How regularly regulary "ipfs swarm connect /dnsaddr/ipfs-nodes.cluster.ipfs.io" ? Should I crontab it hourly, daily?
ipfs-stackbot1 has quit [Remote host closed the connection]
<JorropoDiscord[m> eleitl you shouldn't, add it to bootstrap that enough, if your node is not very smart but if nodes are in the same dht there is no reason to keep connection open
Aranjedeath has quit [Quit: Three sheets to the wind]
<eleitlDiscord[m]> Three nodes are in different DCs, so no idea if they're in the same DHT. I'll add the line to the bootstrap then.
ipfs-stackbot1 has joined #ipfs
<eleitlDiscord[m]> Thank you all for the helpful hints. Appreciated.
ylp has quit [Quit: Leaving.]
<hsanjuan[m]> I'd suggest crontab every minute. The peers in the bootstrap list are not reconnected again. And the connection might get dropped from the other side. Sure this is hack which ideally would not be necessary, but it may improve discoverability of some content from your node. It is not overly important to do this though. I'm looking forward dht improvements in the next release...
<eleitlDiscord[m]> Yes, hope 0.5.0 also fixes IPNS lookup.
riemann has quit [Read error: Connection reset by peer]
stoopkid has joined #ipfs
ZaZ has joined #ipfs
jcea has quit [Quit: jcea]
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
ctOS has quit [Quit: Connection closed for inactivity]
dennwc[m] has joined #ipfs
rardiol has quit [Ping timeout: 260 seconds]
DavidPH has quit [Quit: Leaving]
aaskldjasld has joined #ipfs
jarboot[m] has joined #ipfs
aaskldjasld has quit [Quit: leaving]
VoiceOfReason has quit [Quit: Free ZNC ~ Powered by LunarBNC: https://LunarBNC.net]
VoiceOfReason has joined #ipfs
Elfo_ has quit [Ping timeout: 258 seconds]
zeden has quit [Quit: WeeChat 2.6]
shah^ has quit []
nehh^ has joined #ipfs
Ai9zO5AP has joined #ipfs
<bonedaddyDiscord> hsanjuan: early January would be fantastic
ZaZ has quit [Read error: Connection reset by peer]
Obscurity[m] has joined #ipfs
JeanDiscord[m] is now known as Jean6739[m]
griffinbyatt has joined #ipfs
griffinbyatt has quit [Client Quit]
<humbleElitist_Di> I have some files pinned in go-ipfs , but in my ipfs-web-ui they aren't shown in the Files tab . Any reason why not?
<humbleElitist_Di> (specifically, I have a few of the xkcd comics pinned)
b12b has quit [Quit: The Lounge - https://thelounge.chat]
<bonedaddyDiscord> the files tab uses mfs iirc
<bonedaddyDiscord> you probably uploaded/pinned your stuff using unixfs
<humbleElitist_Di> oh
<humbleElitist_Di> I pinned it using "ipfs pin [the multihash thing]"
<humbleElitist_Di> if I upload/pin using the files tab, will it show up if I say `ipfs pin ls` ?
<humbleElitist_Di> well I guess I can just try that instead of asking, huh
rendar has quit []
<gizagaldu[m]> ^^
jokoon has joined #ipfs
<humbleElitist_Di> it does not appear to have done so
<humbleElitist_Di> yeah, it didn't.
<humbleElitist_Di> It does give me the address so that I am now able to pin it
<humbleElitist_Di> hm
<humbleElitist_Di> I mean, I suppose I'm now pinning it in two different ways, somehow?
<humbleElitist_Di> this seems counterintuitive
<gizagaldu[m]> ipfs pin add <ipfs-path>...
pescobar has quit [Quit: No Ping reply in 180 seconds.]
mowcat has joined #ipfs
pescobar has joined #ipfs
lvlinux is now known as ruel
b12b has joined #ipfs
seba- has joined #ipfs
Fessus has quit [Remote host closed the connection]
Fessus has joined #ipfs
seba-- has quit [Ping timeout: 268 seconds]
gimzmoe has quit [Read error: No route to host]
appa has joined #ipfs
jonoberg[m] has joined #ipfs
MDude has joined #ipfs
silotis has quit [Ping timeout: 260 seconds]
silotis has joined #ipfs
disynthetic[m] has joined #ipfs
is_null has quit [Ping timeout: 240 seconds]
gooseduck has joined #ipfs
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
silotis has quit [Ping timeout: 255 seconds]
silotis has joined #ipfs
KempfCreative has quit [Ping timeout: 240 seconds]
Jybz has quit [Quit: Konversation terminated!]
fotocyte has joined #ipfs
jokoon has quit [Read error: Connection reset by peer]
shiyida[m] has joined #ipfs
fotocyte has quit [Quit: Leaving]
rardiol has joined #ipfs
Trieste has quit [Max SendQ exceeded]
gooseduck has quit [Ping timeout: 260 seconds]
Trieste has joined #ipfs
Trieste has quit [Max SendQ exceeded]