stebalien changed the topic of #ipfs to: Heads Up: To talk, you need to register your nick! Announcements: go-ipfs 0.4.22 and js-ipfs 0.35 are out! Get them from dist.ipfs.io and npm respectively! | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS, the InterPlanetary FileSystem: https://github.com/ipfs/ipfs | Logs: https://view.matrix.org/room/!yhqiEdqNjyPbxtUjzm:matrix.org/ | Forums: https://discuss.ipfs.io | Code of
uniquerockrz has quit [Read error: Connection reset by peer]
<PhoenixDiscord[m>
would it be practical to do efficient concatinations on IPFS unixfs? like, a file is a DAG object that lists blocks containing ranges of data, right? so, theoretically, it should be possible to do stuff like run a HLS video stream over IPFS, and build both the segment files of a few seconds in an MP4, and also build a concatinated MP4 that contains the entire video in one file, by just referencing the blocks from the
<PhoenixDiscord[m>
segment files in another DAG listing?
JohnFromAtl1 has quit [Remote host closed the connection]
JohnFromAtl has quit [Remote host closed the connection]
<PhoenixDiscord[m>
another thought about ways to use it would be if you were building a blog, you could have a file containing the json data for each blog post, and then build a jsonfeed by building a filesystem entry which links to the blocks for each json section, and rebuild the feed when a new post is added without invalidating all the blocks, so subscribed clients would only need to pull the updated data and the file's dag listing
<PhoenixDiscord[m>
also makes me wonder, nothing stops you from referencing the same block repeatedly in a unixfs file definition, right? so you could have a very small block that's just something like ",\n " and use it repeatedly throughout a file to add seperators in a json array, when building complex plaintext json structures out of filesystem blocks
<PhoenixDiscord[m>
do ifps nodes have any restrictions on what blocks they'll accept as reasonable? like, will they be upset about very small blocks in the middle of a file?
<PhoenixDiscord[m>
the HLS example is probably a better case since each segment is likely to be hundreds of kilobytes big up to maybe a megabyte, and they don't need any structural stuff concatinated between them, as a streaming format the segments can just concatinate and still be valid
<PhoenixDiscord[m>
i guess these kinds of things will be easier to do when unixfs2 is deployed and (i assume) as end users we can just build valid filesystem structures through the DAG and Blocks APIs as needed
uniquerockrz has quit [Read error: Connection reset by peer]
<PhoenixDiscord[m>
could be a pretty powerful way to deduplicate data that has multiple views
<PhoenixDiscord[m>
easy to imagine building an abstraction filesystem api that allows passing a list of buffers or read streams as the file's contents, hinting to the filesystem builder under it where to segment the blocks to increase deduplication of large pieces of data like videos
<PhoenixDiscord[m>
it also makes me wonder if there maybe stratergies that are fairly general that would increase deduplication across all sorts of files. like what if instead of just making a list of full sized blocks and ending it with one short one to represent a file, IPFS defaulted to making full size blocks at the start and the end and putting the short one in the middle. then any kind of file which often has the same prefix or
<PhoenixDiscord[m>
suffix would deduplicate better, i think? as long as those sections tend to be large enough to fill at least one block. like if you were a video editor who always starts their videos with a bit-identical intro section, that would (hopefully) encode the same in each video and deduplicate already, but what about a credits sequence at the end? the offsets would constantly shift around and become globally unique data again
mowcat has quit [Remote host closed the connection]
<PhoenixDiscord[m>
then again, putting the small one in the middle would mean append-only files would be less efficiently replicated when they're appended to. maybe too complex to figure out the most optimal stratergy there in a general way, better to leave it up to app developers to dig in to the filesystem data where optimization is worth it and build it in a structure aware way?
duyuyi[m] has joined #ipfs
uniquerockrz has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
jcea has quit [Quit: jcea]
kakra has joined #ipfs
uniquerockrz has joined #ipfs
hurikhan77 has quit [Ping timeout: 252 seconds]
uniquerockrz has quit [Read error: Connection reset by peer]
RamRanRa has quit [Read error: Connection reset by peer]
uniquerockrz has joined #ipfs
andi- has quit [Ping timeout: 252 seconds]
verin0x7 has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
verin0x has quit [Ping timeout: 240 seconds]
uniquerockrz has joined #ipfs
thomasanderson has joined #ipfs
andi- has joined #ipfs
thomasanderson has quit [Ping timeout: 240 seconds]
fleeky has quit [Ping timeout: 252 seconds]
KempfCreative has quit [Ping timeout: 252 seconds]
baojg has quit [Remote host closed the connection]
CCR5-D32 has quit [Quit: CCR5-D32]
fleeky has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
uniquerockrz has joined #ipfs
baojg has joined #ipfs
Clarth has quit [Remote host closed the connection]
Clarth has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
}ls{ has quit [Quit: real life interrupt]
uniquerockrz has joined #ipfs
Jybz has joined #ipfs
Jybz has quit [Quit: Konversation terminated!]
uniquerockrz has quit [Read error: Connection reset by peer]
baojg has quit [Remote host closed the connection]
woss_io has quit [Ping timeout: 250 seconds]
airstorm has joined #ipfs
uniquerockrz has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
uniquerockrz has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
uniquerockrz has joined #ipfs
Sigma has quit [Ping timeout: 276 seconds]
Sigma has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
uniquerockrz has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
ygrek__ has quit [Ping timeout: 252 seconds]
uniquerockrz has joined #ipfs
baojg has joined #ipfs
rendar has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
uniquerockrz has joined #ipfs
lord| has quit [Read error: Connection reset by peer]
lord| has joined #ipfs
lord| has quit [Read error: Connection reset by peer]
jayjo has quit [Remote host closed the connection]
jayjo has joined #ipfs
lord| has quit [Read error: Connection reset by peer]
ylp has joined #ipfs
lord| has joined #ipfs
lord| has quit [Read error: Connection reset by peer]
scde has joined #ipfs
verin0x7 is now known as verin0x
lord| has joined #ipfs
scde_ has joined #ipfs
lord| has quit [Ping timeout: 250 seconds]
lord| has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
scde_ has quit [Quit: Leaving]
uniquerockrz has joined #ipfs
toxync01 has quit [Ping timeout: 276 seconds]
lord| has quit [Read error: Connection reset by peer]
toxync01 has joined #ipfs
lord| has joined #ipfs
lord| has quit [Read error: Connection reset by peer]
uniquerockrz has quit [Read error: Connection reset by peer]
uniquerockrz has joined #ipfs
DemiN_ has quit [Ping timeout: 240 seconds]
uniquerockrz has quit [Read error: Connection reset by peer]
digitalnomad91_ has quit [Ping timeout: 276 seconds]
uniquerockrz has joined #ipfs
digitalnomad91 has joined #ipfs
lord| has joined #ipfs
lord| has quit [Client Quit]
amrbz[m] has joined #ipfs
digitalnomad91 has quit [Read error: Connection reset by peer]
uniquerockrz has quit [Read error: Connection reset by peer]
graffen has quit [Ping timeout: 250 seconds]
scde has quit [Ping timeout: 265 seconds]
minhoryang has quit [Quit: Connection closed for inactivity]
uniquerockrz has joined #ipfs
CGretski has quit [Ping timeout: 252 seconds]
ZaZ has joined #ipfs
teleton has joined #ipfs
CGretski has joined #ipfs
verin0x has quit [Ping timeout: 240 seconds]
verin0x0 has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
teleton has quit [Quit: Leaving]
uniquerockrz has joined #ipfs
verin0x0 is now known as verin0x
woss_io has joined #ipfs
deltab has quit [Ping timeout: 240 seconds]
rappet has joined #ipfs
toxync01 has quit [Ping timeout: 250 seconds]
deltab has joined #ipfs
toxync01 has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
gmoro has joined #ipfs
graffen has joined #ipfs
dethos has joined #ipfs
uniquerockrz has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
zeden has joined #ipfs
uniquerockrz has joined #ipfs
jcea has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
uniquerockrz has joined #ipfs
gts has joined #ipfs
mateusbs17|brb is now known as mateusbs17
DavidPH has quit [Quit: Leaving]
toxync01 has quit [Ping timeout: 265 seconds]
toxync01 has joined #ipfs
RamRanRa has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
jcea has quit [Remote host closed the connection]
jcea has joined #ipfs
uniquerockrz has joined #ipfs
egs[m] has joined #ipfs
The_8472 has quit [Ping timeout: 248 seconds]
uniquerockrz has quit [Read error: Connection reset by peer]
The_8472 has joined #ipfs
Newami has joined #ipfs
hsn has joined #ipfs
uniquerockrz has joined #ipfs
_jrjsmrtn has joined #ipfs
__jrjsmrtn__ has quit [Ping timeout: 240 seconds]
<olizilla[m]>
Phoenix (Discord): > it should be possible to do stuff like run a HLS video stream over IPFS, and build both the segment files of a few seconds in an MP4
<olizilla[m]>
that is a thing! Folks do that and it seems to work well.
<hsn>
any fix for concurrent write error to websocket? crashing several times per hour here
* olizilla[m]
sent a long message: < >
<olizilla[m]>
hsn: in the short term using go-ipfs master has greatly reduced the that issue... the ipfs.io gateway nodes were crashing mulitple times per hour too, but updating to a more recent commit from master, we've only seen 1 node panic in the last 6 days since we updated. Folks are investigating in the meantime.
uniquerockrz has quit [Read error: Connection reset by peer]
uniquerockrz has quit [Read error: Connection reset by peer]
gts has quit [Remote host closed the connection]
uniquerockrz has joined #ipfs
jesse22 has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
mauz555 has joined #ipfs
<fling>
How do I use it on gentoo?
<fling>
the daemon is running as ipfs user
anonymous-hippo has joined #ipfs
uniquerockrz has joined #ipfs
ylp has quit [Quit: Leaving.]
<anonymous-hippo>
Hi! I'm having trouble figuring out how to set where my ipfs node is intialized if I don't want it at the default location. Can someone point me in the right direction?
uniquerockrz has quit [Read error: Connection reset by peer]
<Jorropo4529[m]>
`ipfs init` will create the repo and config in ~/.ipfs/
<anonymous-hippo>
cool - if I'm already up and running, is this going to cause me major trouble?
<Jorropo4529[m]>
* `ipfs init` will create the repo and config in `~/.ipfs/`
<anonymous-hippo>
I know, I want it somewhere else.
Fessus has quit [Ping timeout: 250 seconds]
<anonymous-hippo>
fling do I need to migrate if I'm already running?
<fling>
Jorropo4529[m]: should I run commands as the same user running the daemon?
<fling>
anonymous-hippo: probably could stop and move files over to new location
<fling>
then set the variable
<anonymous-hippo>
got it, cheers
salomaa[m]1 is now known as salomaa[m]2
anonymous-hippo has quit [Remote host closed the connection]
uniquerockrz has joined #ipfs
<Jorropo4529[m]>
@fling, it depends your docker is configurated, but probably yes
<fling>
I don't have docker
<Jorropo4529[m]>
A sorry, I miss readed
<Jorropo4529[m]>
yes you should run it with the same user of the daemon
<fling>
I should probably configure the initscript
<fling>
What about mount? should I mount as the same user too?
<Jorropo4529[m]>
? once the daemon is initialised you don't need to do it again, and set `/usr/local/bin/ipfs daemon` in your systemd file
<fling>
I don't have systemd
<Jorropo4529[m]>
I personaly don't use mount but yes maybe
mauz555 has quit []
vd4w6[m] has joined #ipfs
mowcat has joined #ipfs
t4skforce has quit [Ping timeout: 276 seconds]
t4skforce has joined #ipfs
thomasanderson has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
yagmi96 has joined #ipfs
uniquerockrz has joined #ipfs
<olizilla[m]>
fling: if you dont docker and just want the binary you could extract if from the docker image on a machine that does or you could build go-ipfs from source... https://github.com/ipfs/go-ipfs#build-from-source
<olizilla[m]>
oh wait, sorry... crossed wires
<fling>
olizilla[m]: I have a working binary which runs :P
<fling>
Everyone is so helpful
<olizilla[m]>
🎉
scde has joined #ipfs
<fling>
olizilla[m]: should I mount as the same user runnig commands and/or daemon?
<olizilla[m]>
i've not used `ipfs mount`
andrewnez[m] has left #ipfs ["User left"]
<fling>
Why are not you using mount?
uniquerockrz has quit [Read error: Connection reset by peer]
uniquerockrz has joined #ipfs
jesse22 has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
<olizilla[m]>
haven't needed it. Am using ipfs desktop or the `ipfs` commands to noodle around with my repo
<fling>
I wanted to use it with beets
jesse22 has joined #ipfs
jesse22 has quit [Client Quit]
uniquerockrz has quit [Read error: Connection reset by peer]
jesse22 has joined #ipfs
uniquerockrz has joined #ipfs
thomasanderson has quit [Ping timeout: 240 seconds]
ctOS has quit [Quit: Connection closed for inactivity]
Ai9zO5AP has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]
jcea has quit [Remote host closed the connection]
jcea has joined #ipfs
uniquerockrz has joined #ipfs
uniquerockrz has quit [Read error: Connection reset by peer]