stebalien changed the topic of #ipfs to: Heads Up: To talk, you need to register your nick! Announcements: go-ipfs 0.4.23 and js-ipfs 0.41 are out! Get them from dist.ipfs.io and npm respectively! | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS, the InterPlanetary FileSystem: https://github.com/ipfs/ipfs | Logs: https://view.matrix.org/room/!yhqiEdqNjyPbxtUjzm:matrix.org/ | Forums: https://discuss.ipfs.io | Code of
<bonedaddyDiscor4>
parody on good night moon and his "go the fuck to sleep" version
<M4lfr3d04m4y4[m]>
Sup yall
<RubenKelevra>
Is there a way to download a file to the cache, while not pinning it?
<RubenKelevra>
For prefetching purposes
<RubenKelevra>
`ipfs cat > /dev/null 2>&1` doesn't feel right :D
JRWR has quit [Ping timeout: 240 seconds]
JRWR has joined #ipfs
fleeky has quit [Ping timeout: 240 seconds]
}ls{ has quit [Ping timeout: 256 seconds]
}ls{ has joined #ipfs
runde has quit [Ping timeout: 240 seconds]
runde has joined #ipfs
<RubenKelevra>
Oh wow. I upgraded one of my servers to the dev branch... now I'm seeing 7 MB/s while it was stuck before at like 400 KB/s
<RubenKelevra>
The client was on 0.5 before
<RubenKelevra>
7 MB/s is the maximum lte is doing right now :(
JRWR has quit [Ping timeout: 265 seconds]
dethos has quit [Ping timeout: 256 seconds]
JRWR has joined #ipfs
doubtingben has quit [Ping timeout: 256 seconds]
Pie-jacker875 has quit [Read error: Connection reset by peer]
Pie-jacker875 has joined #ipfs
boredmanicrobot has joined #ipfs
stoopkid has quit [Quit: Connection closed for inactivity]
ygrek_ has quit [Ping timeout: 265 seconds]
user_51 has quit [Ping timeout: 256 seconds]
jcea has quit [Quit: jcea]
user_51 has joined #ipfs
boredmanicrobot has quit [Quit: boredmanicrobot]
mowcat has quit [Remote host closed the connection]
Belkaar has quit [Ping timeout: 256 seconds]
Belkaar has joined #ipfs
Belkaar has joined #ipfs
Belkaar has quit [Changing host]
sewds has quit [Ping timeout: 265 seconds]
opal has quit [Remote host closed the connection]
opal has joined #ipfs
boredmanicrobot has joined #ipfs
boredmanicrobot has quit [Client Quit]
}ls{ has quit [Quit: real life interrupt]
ygrek_ has joined #ipfs
stoopkid has joined #ipfs
zeden has quit [Quit: WeeChat 2.7.1]
wlp1s1 is now known as [iczero]
Mateon3 has joined #ipfs
Mateon1 has quit [Ping timeout: 256 seconds]
Mateon3 is now known as Mateon1
MDude has quit [Quit: Going offline, see ya! (www.adiirc.com)]
captain_morgan has quit [Remote host closed the connection]
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
captain_morgan has joined #ipfs
dwilliams has quit [Ping timeout: 265 seconds]
ygrek_ has quit [Ping timeout: 265 seconds]
<nickdex[m]>
what happens if the files that I added using filestore (ipfs add --nocopy) I move them somewhere else (same hdd)
the_master[m] has left #ipfs ["User left"]
<nickdex[m]>
And do I need to run ipfs add again to add them back?
[iczero] is now known as iczero
khaledmimoune[m] has joined #ipfs
rendar has joined #ipfs
Sajesajama has joined #ipfs
Sajesajama_ has quit [Ping timeout: 250 seconds]
Sajesajama has quit [Quit: Leaving]
biiiiiipon has joined #ipfs
Acacia has quit [Ping timeout: 265 seconds]
biiiiiipon has quit [Quit: biiiiiipon]
biiiiiipon has joined #ipfs
Sajesajama has joined #ipfs
xcm has quit [Ping timeout: 260 seconds]
biiiiiipon has quit [Quit: biiiiiipon]
biiiiiipon has joined #ipfs
biiiiiipon has quit [Remote host closed the connection]
biiiiiipon has joined #ipfs
biiiiiipon has quit [Remote host closed the connection]
xcm has joined #ipfs
biiipon has joined #ipfs
moinmoin has joined #ipfs
<moinmoin>
If I understand correctly I can also run an IPFS node in my browser? if so, how the heck does that even work?
Acacia has joined #ipfs
<moinmoin>
like I can host a file on the IPFS network via my browser? but that means (if the content is not shared) once I close my browser it is gone?
Ringtailed-Fox has quit [Ping timeout: 260 seconds]
Ecran has joined #ipfs
Acacia has joined #ipfs
mm_ has joined #ipfs
<aphelionz[m]>
moinmoin: that's alll more or less correct. In the browser it stores the files in IndexedDb
<aphelionz[m]>
* moinmoin: that's alll more or less correct. In the browser it stores the files in IndexedDB
mm_ has quit [Ping timeout: 260 seconds]
xdecimal has joined #ipfs
danrobi has left #ipfs [#ipfs]
<moinmoin>
aphelionz[m] some really noob clarification question...so now I have installed ipfs on my machine. I see peers are automatically discovered. I guess these are the folks I can retrieve content within the network from?
<moinmoin>
what if I add content to my node, is it automatically synced to other nodes in the network?
<moinmoin>
I watched this video https://www.youtube.com/watch?v=-cW7QCQkhKo&t=789s where the guy added some stuff to his node and immediately he was able to retrieve it though the cloudflare gateway...so it looks like contents gets automatically synched
<aphelionz[m]>
When he made the request to the cloudflare gateway, the cloudflare gateway requested the content from the network and then served it back to the person in the video. If he hadnt requested it from the gateway it wouldnt have ended up there
<moinmoin>
Ok so I put content in my node. It only stays in my node. Not synced anywhere...If I give someone else the CID of my node and they ask it from within the network, then the content goes to their node. I guess this is the basic idea?
<aphelionz[m]>
Yep!
<moinmoin>
Once the content is requested, is it now automatically part of their node? So let's say my node is down, will my content live on within the network?
<moinmoin>
> "So let's say my node is down" Or I even removed it from my own node
<aphelionz[m]>
In a default configuration, the data stay on a node for 30 days (I believe this is the default time period, YMMV) before it's gargbage collected. However, if the hashes are pinned the data will stay there indefinitely
<aphelionz[m]>
pinned = via the `ipfs pin` commmands
<moinmoin>
wait...pinned? so if I pin the content on my node, another node requests it, my node goes down...but because I pinned it, it will stay within their node?
<aphelionz[m]>
they would have to also pin it
<aphelionz[m]>
I forget whether right now content is pinned by default when it's added via `ipfs add` or `ipfs get`
<moinmoin>
wait...so my default content is ephemeral? What if my node does not go down and I don't pin the content, does it still get removed by the GC?
<moinmoin>
after say 30 days?
<moinmoin>
so by* default
<aphelionz[m]>
Yeah, see my above message. I don't want to steer you in the wrong direction so hopefully somebody else can confirm but I believe there are some pinning guarantees when adding content to your node
<aphelionz[m]>
> Objects added through ipfs add are pinned recursively by default.
<aphelionz[m]>
so, generally speaking content that _you_ add to _your own_ node is not ephemeral, but content added via `ipfs get` for example, from somebody else's node, is not.
<moinmoin>
No problem I am not worried about the exact details (if pin is on by default or not) or (if the duration is 30 days or not) I am currently interested in understanding the general setup
<moinmoin>
It is not ephemeral because it is pinned by default. I will need to unpin it if I want it to go away after a while
<aphelionz[m]>
correct, or you can manually run `ipfs repo gc` which will garbage collect all unpinned data
<moinmoin>
Cool
<moinmoin>
I think it is all coming together in my mind now
<moinmoin>
Stuff I clarified by chatting with you. 1) Content is not synced. It is only requested. 2) Content only lives on in the network as long there is a node somewhere that has it "pinned"
<aphelionz[m]>
👍️
sphoenixdw[m] has joined #ipfs
<moinmoin>
Thanks
sphoenixdw[m] has left #ipfs [#ipfs]
<aphelionz[m]>
no problem
<moinmoin>
I am pretty sure there must be a way to enable confidentiality on the network right? Say in case the CID of a confidential content leaks out...how do I, as the owner of such content ensure that it is impenetrable on the network?
<moinmoin>
some way to encrypt the content I guess
dethos has joined #ipfs
jpaa has quit [Ping timeout: 256 seconds]
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
ipfs-stackbot has quit [Remote host closed the connection]
ipfs-stackbot has joined #ipfs
jpaa has joined #ipfs
<swedneck>
encrypt the content, and don't distribute it on the public network
t4skforce has quit [Ping timeout: 265 seconds]
Acacia has quit [Quit: Lost terminal]
moinmoin has quit [Remote host closed the connection]
opal has quit [Ping timeout: 240 seconds]
t4skforce has joined #ipfs
opal has joined #ipfs
InvisibleRasta has quit [Quit: WeeChat 2.3]
InvisibleRasta has joined #ipfs
biiipon has quit [Remote host closed the connection]
Ringtailed-Fox has joined #ipfs
Ringtailed-Fox has quit [Ping timeout: 260 seconds]
<aphelionz[m]>
Thank you @ruben_kelevra:matrix.org !
<RubenKelevra>
You're welcome!
<RubenKelevra>
But this will both add a truncated file if the file is larger
<RubenKelevra>
If you want to add files which do not exceed a certain file size I would use find
<RubenKelevra>
@aphelionz:matrix.org: I'm sure you find a lot of examples how to use find, but it's basically a find with -size and -1K for example and find will than exec ipfs with the path of each matching file
<RubenKelevra>
Since you can specify the path of the file for find it will either 'find' and output it, or don't do any output
<RubenKelevra>
@aphelionz:matrix.org: I'm curious: what's your usecase? :)
<RubenKelevra>
Also do you add single files or do you add folders and just want to skip certain files?
<aphelionz[m]>
I really was asking for somebody else but I think it's just user uploaded content and wanting to make sure an abuser doesn't upload huge files
<RubenKelevra>
> I really was asking for somebody else but I think it's just user uploaded content and wanting to make sure an abuser doesn't upload huge files
<RubenKelevra>
In this case a simple `du -b /path/to/file` should do the trick :)
RingtailedFox has quit [Read error: Connection reset by peer]
dopplergange has quit [Read error: Connection reset by peer]
RingtailedFox has joined #ipfs
dopplergange has joined #ipfs
gimzmoe has joined #ipfs
RBB has joined #ipfs
dopplerg- has joined #ipfs
dopplergange has quit [Ping timeout: 265 seconds]
RingtailedFox has quit [Read error: Connection reset by peer]
RingtailedFox has joined #ipfs
Pie-jacker875 has quit [Remote host closed the connection]
Pie-jacker875 has joined #ipfs
ygrek_ has quit [Remote host closed the connection]
ygrek_ has joined #ipfs
xcm has quit [Read error: Connection reset by peer]
xcm has joined #ipfs
opal has quit [Ping timeout: 240 seconds]
fleeky has joined #ipfs
ygrek_ has quit [Ping timeout: 265 seconds]
themsay has joined #ipfs
opal has joined #ipfs
tglman has quit [Ping timeout: 240 seconds]
xcm has quit [Ping timeout: 240 seconds]
xcm has joined #ipfs
joocain2 has quit [Ping timeout: 240 seconds]
ljmf00 has joined #ipfs
victor9[m] has joined #ipfs
fleeky has quit [Ping timeout: 256 seconds]
caskd has quit [Quit: Freeman you fool!!]
fleeky has joined #ipfs
rappet has quit [Ping timeout: 272 seconds]
rappet has joined #ipfs
tglman has joined #ipfs
ZaZ has joined #ipfs
fleeky has quit [Ping timeout: 258 seconds]
<RubenKelevra>
Alex Siman: I have no idea about javascript or the javascript client. I'm sorry.
<RubenKelevra>
But I'm sure javascript can check for a filesize of an item which you get referenced by the browser :)
<RubenKelevra>
* But I'm sure javascript can check for the filesize of an item which you get referenced by the browser :)
<RubenKelevra>
Alex Siman: Btw - I might understood something wrong but: Wouldn't it make more sense if the IPFS client runs in the browser and get's just the 'connect to this peer' information? This way you can fetch the file from the user via IPFS.
<RubenKelevra>
This way you can simply check the size of the object before you're going to pin it.
<aphelionz[m]>
Isn't there also a limit in bitswap itself? That was my first instinct here
<RubenKelevra>
aphelionz: well, there's a chunk-size, but that is by default 256 KByte and doesn't matter. You can add files which are multiple terabyte in size - they just get chunked
<aphelionz[m]>
gotcha
<aphelionz[m]>
I guess I'm surprised there isn't something just in the config JSON where you can set such a limit
<RubenKelevra>
Alex Siman: I think it's the easist way if you just fetch a CID from the clients and fetch the file from the IPFS node running in the browser.
<RubenKelevra>
You can see the size of an object with like `ipfs object stat /ipfs/<CID>`
<aphelionz[m]>
like the old MaxUploadFileSize in apache configs or what have you
<aphelionz[m]>
can you stat an object without getting it?
<RubenKelevra>
aphelionz: why would adding a limit make sense? IPFS is great on handling large data sizes
<aphelionz[m]>
Alex Siman explained why he wants a limit
<aphelionz[m]>
different folks have different use cases, I don't see the harm in making it an option, I guess
<RubenKelevra>
<aphelionz[m] "can you stat an object without g"> well, you need to fetch the object, but you don't need to fetch the references. So the maximum size you would *theoretical* fetch is 2 MB with the command I showed
<aphelionz[m]>
gotcha, that makes sense
<RubenKelevra>
<aphelionz[m] "different folks have different u"> yeah but I don't see a reason why the system should be restricted. It's better to restrict the application
fleeky has joined #ipfs
<RubenKelevra>
You can also use `ipfs object get /ipfs/<CID>` which usually gets you some JSON as output