leeola has quit [Quit: Connection closed for inactivity]
<massino>
how mature is the fuse integration with ipfs?
upperdeck has quit [Ping timeout: 248 seconds]
<massino>
Is it frequently used?
upperdeck has joined #ipfs
Steverman has joined #ipfs
<Steverman>
I am not sure whatever is causing this, but I can't seem to do this right. Node <> Browser works fine with just pubsub. I use pubsub to broadcast new files to be downloaded from Node by Browser. Whenever I launch my Node server it begins adding files to ipfs, and broadcast it to pubsub, but I this error 7 out of 10 times:
<nicolagreco>
weird that I see `/home/steb` in my logs after the panic attack
<voker57>
probably because ipfs was compiled on stebalien's machine
<nicolagreco>
mm ok (not a pro in go)
<nicolagreco>
I don't want my gateway to serve ANY files :/
<voker57>
don't expose it to the network then?
<nicolagreco>
I literally want a gateway for the stuff I pin
<nicolagreco>
or the stuff I have in my ipfs node
<nicolagreco>
when I run an ipfs node and nodes ask me for things that I dont have
<nicolagreco>
I don't have them, I don't fetch for them
larpanet has quit [Remote host closed the connection]
<nicolagreco>
since you can fetch it yourself
<voker57>
but you just sayd that you don't want it to serve any files
larpanet has joined #ipfs
<nicolagreco>
only the files that I have locally
<voker57>
that's what my patch does
<nicolagreco>
I literally want to expose my current ipfs folder no more
<nicolagreco>
(actually I could just run a simple http server on top of my ipfs folder)
<voker57>
expose folder? what would that accomplish?
<voker57>
also you'd expose your private key this way
<nicolagreco>
no no I will "mount" ipfs on a folder or something similar to that
<nicolagreco>
voker57: I need to do something really simple
<nicolagreco>
1) expose the files that I pin - no more
kirby__ has quit [Remote host closed the connection]
cockbrain has quit [Remote host closed the connection]
kirby__ has joined #ipfs
rendar has quit [Ping timeout: 248 seconds]
<voker57>
again, that's what my patch does
<nicolagreco>
(and I love that!)
<nicolagreco>
voker57: related question I remember of the filestore project, is there a folder on my disk with the filesystem of all the hashes that I have locally?
<voker57>
~/.ipfs/blocks is that if you use flatfs (default). except filestore, pointers to chunks in files are stored in datastore
onikuma has quit [Ping timeout: 248 seconds]
musicmatze_ has joined #ipfs
<nicolagreco>
alright so there is no such a folder that lists in my filesystem the hashes that I have pinned
mtodor has quit [Remote host closed the connection]
mtodor has joined #ipfs
musicmatze has quit [Ping timeout: 248 seconds]
Steverman has joined #ipfs
<JCaesar>
say, given a list of ipfs hashes and names, can I make a folder out of that? I've seen the occasional hack (like here https://github.com/kpcyrd/ipfs-mirror, scroll down) to do so, but that can't really be the preferred way, can it?
musicmatze_ is now known as musicmatze
rendar has joined #ipfs
rendar has quit [Changing host]
rendar has joined #ipfs
<JCaesar>
(what I'd really like is an api I can hand a JSON object that represents a type t = (NameString × (t + IpfsHashString)), i.e. a folder tree where the leaves are IPFS hashes, and it gives me back a pinned hash of that folder structure.)
<voker57>
JCaesar: if I understand you correctly, you can use ipfs files API for that
<JCaesar>
not quite as comfy as what I'd imagined, but yes, so it would seem.
<Steverman>
Installing it through npm and using 'require' would just give me the transport module right?
upperdeck has quit [Ping timeout: 240 seconds]
<Steverman>
I'll just use the CLI
<Steverman>
Hopefully my RPI can handle it
<Steverman>
If even it works on it
upperdeck has joined #ipfs
jkilpatr has joined #ipfs
<JCaesar>
voker57: Thanks, it does indeed work. (It's a bit slow, even with -f=false, 16s for a folder of 66 files, but I guess that will do.)
upperdeck has quit [Remote host closed the connection]
Steverman has quit [Quit: WeeChat 1.9.1]
upperdeck has joined #ipfs
Steverman has joined #ipfs
AliasSpider has joined #ipfs
dhruvbaldawa has quit [Remote host closed the connection]
jaboja has joined #ipfs
dhruvbaldawa has joined #ipfs
dhruvbaldawa has quit [Ping timeout: 248 seconds]
dhruvbaldawa has joined #ipfs
dhruvbaldawa has quit [Ping timeout: 252 seconds]
girrrrrrr2 has joined #ipfs
girrrrrrr2 has quit [Changing host]
girrrrrrr2 has joined #ipfs
dhruvbaldawa has joined #ipfs
ygrek has joined #ipfs
dhruvbaldawa has quit [Remote host closed the connection]
dhruvbaldawa has joined #ipfs
dhruvbaldawa has quit [Ping timeout: 268 seconds]
pat36 has joined #ipfs
upperdeck has quit [Ping timeout: 248 seconds]
upperdeck has joined #ipfs
erictapen has joined #ipfs
<flyingzumwalt>
nicolagreco in order to make your gateway only serve the stuff you have pinned you would need ipfs nodes to support allow lists. It’s a feature I really want but it’s not implemented yet.
AliasSpider has quit [Ping timeout: 246 seconds]
<flyingzumwalt>
in the meantime the most effective solution is to run an http proxy in front of your gateway and have it do url filtering based on hashes. Not particularly fun, but it works
dhruvbaldawa has joined #ipfs
leeola has joined #ipfs
<Steverman>
Hmm, can someone help me with designing my app to use pubsub between nodejs and browser properly? I currently have chokidar that monitors any filechanges in a directory, which then notifies if there is any change. On that notification, I then add to ipfs, and append a type property to the object it returns on that callback: {path, hash, size, type}.
<pjz>
whee, pinbits.io is back up and running
<pjz>
slight rearchitecture to accomodate larger files
<Steverman>
The client then sees the notification and then retrives the files with ipfs.files.cat, but I am not sure if I should use .get
Alpha64 has joined #ipfs
<raziellight>
so let me get this straight. each node has it's own merkle DAG, so there will be a mass of disorganized DAGS that you can look through
girrrrrrr2 has quit [Read error: Connection reset by peer]
larpanet has quit [Ping timeout: 248 seconds]
<pjz>
Steverman: why not pin the new directory and then unpin the old hash?
<pjz>
Steverman: let IPFS do all the change tracking for you
<Steverman>
I don't think js-ipfs has pinning
<pjz>
oh, hunh. So work on fixing that instead :)
<Steverman>
As in implement the featuer?
<Steverman>
feature*
<Steverman>
My problem is that the directory constantly adds files, and I need to notify the browser clients that they need to download that as well
upperdeck has quit [Ping timeout: 248 seconds]
<Steverman>
Pubsub seems to be the right tool for the job
<Steverman>
It would be even better if I could use IPNS, but I don't think browsers can resolve that
pat36 has quit [Read error: No route to host]
upperdeck has joined #ipfs
pat36 has joined #ipfs
pat36 has quit [Read error: Connection reset by peer]
pat36 has joined #ipfs
<raziellight>
one interesting thing is random walks to find users, so all you really need is one other user. 2^32 = 8 billion so it would only take 32 steps on a 2 way divided tree to get every person on earth
<Icefoz_>
2^32 is 4.3 billion...?
<r0kk3rz>
and remember that nodes will probably be greater than people
nicolagreco has quit [Quit: Connection closed for inactivity]
<raziellight>
erm 2^33 or 2^32.7 to be exact
<raziellight>
it's amazing .7 is the difference between 4 and 7 billion
<pjz>
Icefoz_: someone tried to get pinbits to pin a 240GB file
<kpcyrd>
this snippet fails because Foo needs a lifetime specifier which I would need to add to the type of Container, even though it's supposed to contain all of Foos dependencies/borrows
<Steverman>
I was running js-ipfs with (explicit or not) 'dht:true', and I am wondering why it's outputting: 'bitswap:QmbTUBnw:error Error: DHT is not available' when debugging
<Steverman>
sorry, I meant dht: false
<Steverman>
bitswap still expects dht to be enabled?
<Icefoz_>
pjz: Sounds reasonable, if they can pay for it.
l__q has joined #ipfs
<l__q>
how to limit connections to only 10-20 peers?
upperdeck has quit [Ping timeout: 248 seconds]
Vaelatern is now known as TotallyGottox
TotallyGottox is now known as Vaelatern
upperdeck has joined #ipfs
<Icefoz_>
l__q: I think in 0.4.12 there is (will be?) a config option for that, but 10-20 might be too few to work terribly well.
AliasSpider has joined #ipfs
Steverman has quit [Quit: WeeChat 1.9.1]
<l__q>
I have the latest version, but I do not see any limit in the configuration
<miflow[m]>
Can I use js ipfs API with js ipfs both in Bowser?
upperdeck has quit [Ping timeout: 258 seconds]
Kaz|Away is now known as Kazarelth
erictapen has quit [Ping timeout: 258 seconds]
upperdeck has joined #ipfs
<victorbjelkholm>
miflow[m]: js-ipfs in the browser doesn't start a http-api, but the interface for js-ipfs is the same as the one for js-ipfs-api so you should be able to change them out without changing the code
Oxters has joined #ipfs
plexigras has quit [Ping timeout: 240 seconds]
<Oxters>
Hello everyone
<Oxters>
I'm new to ipfs, and I'm still trying to wrap my head around it
<Oxters>
I have a few questions if anyone would be kind to answer, I'd be much obliged
upperdeck has quit [Ping timeout: 255 seconds]
<lime_>
never ask to ask
<Oxters>
Hehehe thanks lime
<lime_>
before long we'll be asking to ask to ask
<Oxters>
Hahaha
plexigras has joined #ipfs
<Oxters>
My first question has to do with adding to ipfs, if someone adds something, does it have to be on their device for it to stay up in ipfs?
<ansuz>
ipfs makes a copy of the component blocks
<ansuz>
they get stored somewhere in ~/.ipfs, last I checked
<Oxters>
So does that mean that you technically can't get rid of what you upload forever?
<Oxters>
Or could anyone delete something as long as they have the right hash?
<appa_>
I think it is copied to your .ipfs path
<lime_>
depends if it gets copied to another device, blocks of it may be copied around
Encrypt has quit [Quit: Quit]
<lime_>
but it isn't a backup system
<appa_>
The data isnt pushed to anyone who doesn't ask for it
upperdeck has joined #ipfs
<lime_>
but if you ask for it it's uncensorable
<lime_>
cross between tor, blockchain and bittorrent
espadrine has joined #ipfs
appa_ has quit [Remote host closed the connection]
<voker57>
how is ipfs related to tor and blockchain?
<pjz>
Oxters: when you add it to ipfs, it's added to your local ipfs store, which is by default .ipfs. It's also "pinned" by default, meaning it won't be gc'd
<pjz>
Oxters: as long as it's pinned, anyone anywhere can download it and look at it, and when they do, they'll also help upload it to anyone ELSE who wants a copy
<pjz>
Oxters: BUT unless they pin it, they will eventually gc it and it will get removed from their ipfs node
<pjz>
Oxters: contrarily, if they DO pin it, it won't be removed from their node, even if YOU unpin it from yours
shizy has joined #ipfs
Mateon3 has joined #ipfs
shizy has quit [Client Quit]
<pjz>
voker57: it shares some datastructures (merkle-dag) with the blockchain. It's not directly related to tor, though it's ideally possible to run ipfs over tor.
Mateon1 has quit [Ping timeout: 248 seconds]
Mateon3 is now known as Mateon1
<miflow[m]>
victorbjelkholm: thx, it it would be great though. Then you could use ipfs http apis for the Browser and native daemons
rendar has quit [Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!]
appa has joined #ipfs
<victorbjelkholm>
miflow[m]: unless browsers get the ability of opening sockets, we won't be able to do it though :/
erictapen has joined #ipfs
erictapen has quit [Remote host closed the connection]
erictapen has joined #ipfs
<Oxters>
If someone does not have ipfs installed but instead uses an ipfs link to access something uploaded to ipfs, would that cause them to store the file on their system for others to access through ipfs?
<Icefoz_>
Oxters: If they don't have IPFS installed then they have to access it through someone else's IPFS system somehow. There are websites that allow anyone to download IPFS objects through a gateway.
<Oxters>
So would that mean that a gateway would store the data temporarily for anyone else accessing through that gateway?
<Icefoz_>
Yes.
<Oxters>
Is it possible to host a database on ipfs?
pat36 has quit [Read error: Connection reset by peer]
<Icefoz_>
Yes but it's tricky. orbitdb is the only one currently existing afaik.
pat36 has joined #ipfs
<Oxters>
If this database becomes very populated, will the system it was originally created on have to store all the new information?
<miflow[m]>
victorbjelkholm: :/
<Icefoz_>
I don't know. But the general rule of IPFS is "someone has to host it somewhere, and there's no built-in guarentees that someone else will do it for you".
<Icefoz_>
Getting someone else to do it for you is what Filecoin will be for.
<Oxters>
But what about the gateways?
<Icefoz_>
They'll eventually garbage-collect stuff like any other node.
<Icefoz_>
There's several sites that will pin IPFS objects for you in exchange for money.
<ansuz>
I will promise to pin for you in exchange for money
<ansuz>
what's your budget?
<Icefoz_>
At which point the main advantage over Dropbox or whatever becomes the fact that it's very hard to censor, very easy to distribute and very hard to DoS intentionally or otherwise.
<Icefoz_>
Oh, and content-addressing.
<Icefoz_>
Content-addressing is awesome.
<Oxters>
Hehehe thanks ansuz, but I'm just brainstorming for now
<Oxters>
I'm thinking for multiplayer match-making in a game, the temporary part is not a bad thing
<Oxters>
Since all you need to know is who is online at the moment
<Oxters>
The only problem is having a place to connect to where everyone can see everyone else
<Oxters>
So if there is one device up as the original database
<Icefoz_>
For matchmaking I'd imagine some pubsub type system would be more useful...
<Oxters>
What is pubsub?
<Icefoz_>
Publish-subscribe messaging.
<Oxters>
I'll google that, brb
<Oxters>
That sounds perfect
<Oxters>
It will still go over ipfs, but using pubsub
<Oxters>
One main database everyone connects to and puts their pubsubs
<Icefoz_>
IPFS is more about distributing data than messages, though you can build messaging atop it.
<Oxters>
then gateways will have the pubsubs
<Icefoz_>
Now if you wanted to distribute game updates
<Icefoz_>
IPFS would be perfect for that.
upperdeck has quit [Ping timeout: 248 seconds]
<Oxters>
Game updates like where players are and stuff, or an update to the game itself?
<Icefoz_>
Update to the game itself.
<Oxters>
That is a nice idea, very efficient
upperdeck has joined #ipfs
<Oxters>
I don't think I have anymore questions, thanks for the help guys <3
jaboja has joined #ipfs
<lime_>
<3
<lime_>
❤
<Oxters>
oooh how'd you do that?
<Oxters>
Dow, that's another question
<lime_>
depends on your client
<lime_>
but short answer, use a client that supports mark down
<lime_>
brb, let's see if this kernel boots
<Oxters>
Good luck
ianopolous has joined #ipfs
guideline has quit [Read error: Connection reset by peer]
kirby__ has quit [Remote host closed the connection]
mikedd has quit [Quit: Connection closed for inactivity]
<lime_>
Yep, killed it
Aranjedeath has joined #ipfs
mentos1386 has joined #ipfs
upperdeck has quit [Ping timeout: 268 seconds]
upperdeck has joined #ipfs
sim590 has quit [Ping timeout: 248 seconds]
<Steverman>
Hmm, my js-ipfs crashes crashes when I try to get a file
<Steverman>
nodejs <> browser
<Steverman>
I then let it get it from the public gateway, and it works fine
<Steverman>
So it's nodejs
erictapen has quit [Ping timeout: 240 seconds]
erictapen has joined #ipfs
erictapen has quit [Remote host closed the connection]
erictapen has joined #ipfs
upperdeck has quit [Ping timeout: 248 seconds]
<raziellight>
so a transport is really just sockets?
trqx has quit [Ping timeout: 248 seconds]
upperdeck has joined #ipfs
<raboof>
I'm looking for a preferably-distributed way of sharing smallish (~4kb) files. These files are part of a 2- or 3-level hierarchy, and the common query pattern will be 'give me all files under foo/bar'. Being content-addressable, do I understand correctly that ipfs would probably not be a great model for this? are there alternatives you can recommend that might be more suitable?
trqx has joined #ipfs
<r0kk3rz>
raboof: how often do the files change
<raboof>
rarely, they might get archived eventually (for cleanup) but it's mostly-append
mentos1386__ has joined #ipfs
<raboof>
'append' being adding more files, not appending to existing files
mentos1386 has quit [Ping timeout: 255 seconds]
mentos1386__ is now known as mentos1386
<pjz>
raboof: you want to just pin and re-add when files change, most likely
<r0kk3rz>
ipfs would be ok for that
<pjz>
raboof: use ipns
<pjz>
raboof: sockets are a transport, yes
<pjz>
raboof: there could be others. Even sockets aren't uniform: network sockets or unix domain sockets?
<raboof>
pjz: I bet that was meant for raziellight (the 'other ra' :) )
upperdeck has quit [Ping timeout: 248 seconds]
<pjz>
raboof: .... ah, that last was, yes.
<pjz>
raboof: the first bit about how ipfs and ipns should work for all your 4k files was for you :)
<pjz>
raziellight: sockets are a transport, yes, but there could be others. Even sockets aren't uniform: network sockets or domain sockets?
<raboof>
yeah got that :)
upperdeck has joined #ipfs
<raziellight>
wow i just found what i'm interested in working on... content routing
<raboof>
pjz: does ipns mean only my (as the holder of my private key) can manipulate 'my' namespace? because the reason I'm interested in distribution is because I don't want to be a single point of failure :)
<raziellight>
this is great..
<raziellight>
thanks for the response pjz. ya they seemed similar. they are connections
<Icefoz_>
raboof: Yes, though you can have multiple nodes with the same private key, as long as their namespaces are consistent with each other.
wmoh has quit [Ping timeout: 250 seconds]
wmoh has joined #ipfs
<Icefoz_>
I think ipfs-cluster has some functionality to do this, or if not then it's planned.
guideline has joined #ipfs
<massino>
Icefoz_: raboof : I thought that any node could host any IPNS record, even if it doesn't have the private key to publish them? I don't understand the SPOF.
<raboof>
massino: I have no idea, I just saw that your namespace was the hash of your public key and asked whether that meant I needed my private key to write to it - total newbie here :)
<massino>
I guess the SPOF is on publishing changes? As opposed to hosting the data after the change?
<raboof>
massino: yes, that's what I meant
<massino>
Got it
<massino>
I'm pretty new myself :)
mentos1386 has quit [Quit: mentos1386]
mentos1386 has joined #ipfs
mentos1386 has quit [Client Quit]
Jesin has joined #ipfs
guideline has quit [Read error: Connection reset by peer]
MDude has joined #ipfs
jaboja has quit [Ping timeout: 248 seconds]
<Steverman>
Anyone having success with NodeJS <> Browser?
upperdeck has quit [Ping timeout: 255 seconds]
upperdeck has joined #ipfs
pcctw has joined #ipfs
guideline has joined #ipfs
pcctw has quit [Remote host closed the connection]
upperdeck has quit [Ping timeout: 240 seconds]
<pjz>
raboof: if you're the source of updates, then you're a single point of failure
<pjz>
raboof: though 'failure of what?' is my actual answer to your question
jaboja has joined #ipfs
warner` has joined #ipfs
pcctw has joined #ipfs
warner has quit [Ping timeout: 268 seconds]
pcctw has quit [Remote host closed the connection]
pcctw has joined #ipfs
pcctw has quit [Quit: Leaving]
pcctw has joined #ipfs
warner` is now known as warner
<Steverman>
Since I can't use electron-webrtc or wrtc, is there any way to "talk" to browser nodes from node?
ianopolous has quit [Ping timeout: 248 seconds]
dsal has quit [Read error: Connection reset by peer]
dsal has joined #ipfs
dd77 has joined #ipfs
pat36 has quit []
e0f has quit [Quit: end of file reached]
e0f has joined #ipfs
tombusby has quit [Ping timeout: 248 seconds]
M|tar has joined #ipfs
toXel has quit [Ping timeout: 250 seconds]
Mitar has quit [Ping timeout: 250 seconds]
M|tar is now known as Mitar
toXel has joined #ipfs
tombusby has joined #ipfs
alpharde has quit [Ping timeout: 240 seconds]
gaf_ has quit [Ping timeout: 260 seconds]
koshii has quit [Ping timeout: 260 seconds]
nivekuil has quit [Ping timeout: 260 seconds]
Jesin has quit [Quit: Leaving]
nivekuil has joined #ipfs
gaf_ has joined #ipfs
alpharde has joined #ipfs
ashark has quit [Ping timeout: 268 seconds]
Jesin has joined #ipfs
koshii has joined #ipfs
<raziellight>
is ipfs able to use chord based routing?
<raziellight>
it needs to be symmetric, so all the nodes have to be like in a circle...
pcctw has quit [Read error: Connection reset by peer]
<r0kk3rz>
raziellight: for the moment it doesnt do routing outside of an experimental feature
<raziellight>
ah ok thanks
cxl000 has quit [Quit: Leaving]
TheGuyWho has quit [Ping timeout: 248 seconds]
TheGuyWho has joined #ipfs
ashark has joined #ipfs
<Steverman>
I think I solved my issue
<Steverman>
Adding nodejs as a bootstrap would do
TheGuyWho has quit [Ping timeout: 260 seconds]
<Steverman>
Isn't it possible to just use libp2p-webrtc-star for discovery purposes? I trid to comment transport out, while leaving discovery in. No luck :/
<Steverman>
tried*
chris6131 is now known as chris613
Steverman has quit [Quit: WeeChat 1.9.1]
Steverman has joined #ipfs
TheGuyWho has joined #ipfs
Alpha64_ has quit [Ping timeout: 255 seconds]
TheGuyWho has quit [Ping timeout: 255 seconds]
dd77 has quit [Quit: Leaving]
sim590 has joined #ipfs
Mateon1 has quit [Remote host closed the connection]