newhouse has quit [Read error: Connection reset by peer]
larpanet has joined #ipfs
MDude has joined #ipfs
domanic has joined #ipfs
mildred has joined #ipfs
droman has quit [Quit: WeeChat 2.0.1]
rodolf0 has quit [Ping timeout: 265 seconds]
colatkinson has joined #ipfs
mildred has quit [Ping timeout: 240 seconds]
infinity0 has quit [Ping timeout: 240 seconds]
infinity0 has joined #ipfs
asegura has joined #ipfs
asegura is now known as rngkll
larpanet has quit [Ping timeout: 268 seconds]
rngkll has quit [Client Quit]
robattila256 has quit [Quit: WeeChat 2.0.1]
rngkll has joined #ipfs
r3c0d3x has joined #ipfs
r3c0d3x has joined #ipfs
r3c0d3x has quit [Changing host]
r3c0d3x has quit [Remote host closed the connection]
r3c0d3x has joined #ipfs
r3c0d3x has joined #ipfs
Thominus has quit [Remote host closed the connection]
r3c0d3x has quit [Client Quit]
Thominus has joined #ipfs
r3c0d3x has joined #ipfs
colatkinson has quit [Quit: colatkinson]
colatkinson has joined #ipfs
colatkinson has quit [Client Quit]
colatkinson has joined #ipfs
vivus has joined #ipfs
ygrek has joined #ipfs
Anton_ has quit [Ping timeout: 255 seconds]
Anton_ has joined #ipfs
trqx has quit [Remote host closed the connection]
athan has joined #ipfs
colatkinson has quit [Quit: colatkinson]
colatkinson has joined #ipfs
muravey has joined #ipfs
colatkinson has quit [Client Quit]
colatkinson has joined #ipfs
detran` has joined #ipfs
detran has quit [Ping timeout: 268 seconds]
colatkinson has quit [Quit: colatkinson]
colatkinson has joined #ipfs
jrockjiggz has joined #ipfs
<jrockjiggz>
Hello. I just found out about IPFS and I think it's brilliant! I'm a little confused though... If a deamon is running which connects your local ipfs (???) if the deamon is killed, then do the files go dead on the gateway?
<jrockjiggz>
The website mentions immutable, permanent IPFS links.. how is it permanent?
colatkinson has quit [Quit: colatkinson]
colatkinson has joined #ipfs
dimitarvp has quit [Quit: Bye]
<voker57>
jrockjiggz: they are permanent as in "available regardless of who is hosting the file"
vivus has quit [Quit: Leaving]
<jrockjiggz>
voker57: so... the data is uploaded to the gateway, then. distributed?
<voker57>
data is advertised, not uploaded. If gateway receives request for your data, it downloads it and serves
<voker57>
there is no implicit distribution of your data
<jrockjiggz>
So if a web app is deployed from a server running the daemon. If that server goes down, then the files are inaccessable. I do not understand the decentrilization
<voker57>
if somebody else "pins" the web app data, it's still available
<jrockjiggz>
where does the data live? (if the server is offline)
<voker57>
on other servers which chose to download the data (like any gateway you access the web app from, for some time)
mauz555 has quit [Remote host closed the connection]
<jrockjiggz>
The gateways must need quite a bit of storage?
<voker57>
so, like, you at 1.1.1.1 add data to IPFS -> somebody else downloads it at 2.2.2.2 -> somebody else at 3.3.3.3 downloads data from you both, or whoever is available
<jrockjiggz>
Do you know how long on the data persists? on average..
mauz555 has joined #ipfs
<jrockjiggz>
oh ic
<jrockjiggz>
thats perfect for web apps.
<jrockjiggz>
nice stuff
<voker57>
depends on server administrator, hard to know
<jrockjiggz>
thank you for explaining
<voker57>
gateways can provide as much space as that like, there's automatic GC routine to keep cache size to set limits
<jrockjiggz>
I didn't understand archiving, because most of archived data isn't accessed frequently.. so all the archived works would be centralized
<voker57>
yeah... but it's very easy to mirror while not changing links
<jrockjiggz>
true
<voker57>
there's Filecoin project associated with IPFS which tries to address such problems
<MikeFair>
But I can't pull the file using my local commandline Go ipfs command
<MikeFair>
Any thoughts anyone?
mtodor has joined #ipfs
domanic has quit [Read error: Connection reset by peer]
Sunflowery has joined #ipfs
Adbray has quit [Quit: Quit]
Sunflowery is now known as sunflowersociety
sunflowersociety has quit [Changing host]
sunflowersociety has joined #ipfs
JohnX has quit [Ping timeout: 240 seconds]
domanic has joined #ipfs
cmbrnt has quit [Ping timeout: 248 seconds]
yuhl has joined #ipfs
JohnX has joined #ipfs
domanic has quit [Read error: Connection reset by peer]
domanic has joined #ipfs
colatkinson has quit [Quit: colatkinson]
_whitelogger_ has joined #ipfs
_whitelogger has quit [Ping timeout: 276 seconds]
domanic has quit [Ping timeout: 256 seconds]
Caterpillar has quit [Quit: You were not made to live as brutes, but to follow virtue and knowledge.]
ylp has joined #ipfs
Caterpillar has joined #ipfs
mike_new[m] has joined #ipfs
shekbek1 has joined #ipfs
flyinglasanga[m] has joined #ipfs
jbb[m] has joined #ipfs
senwang[m] has joined #ipfs
bustillo[m] has joined #ipfs
jofa[m] has joined #ipfs
Mitchk[m] has joined #ipfs
suduyujiqing[m] has joined #ipfs
jutta_steiner[m] has joined #ipfs
juni[m] has joined #ipfs
CHOAM[m] has joined #ipfs
mingchan88[m] has joined #ipfs
modrone[m] has joined #ipfs
frabcus[m] has joined #ipfs
vd[m] has joined #ipfs
dani9[m] has joined #ipfs
M1trace[m] has joined #ipfs
scheutsch[m] has joined #ipfs
sanjivrai[m] has joined #ipfs
cdetrio[m] has joined #ipfs
samhefnawy[m] has joined #ipfs
arcalinea has joined #ipfs
Scio[m] has joined #ipfs
puminya[m] has joined #ipfs
GoodGuyGreg[m] has joined #ipfs
xiao2hei[m] has joined #ipfs
maqbool[m] has joined #ipfs
ryanmiller[m] has joined #ipfs
steven[m] has joined #ipfs
fredrikj[m] has joined #ipfs
musoke[m] has joined #ipfs
sickill[m] has joined #ipfs
abbiya has joined #ipfs
chrono[m] has joined #ipfs
Gratin[m] has joined #ipfs
appa[m] has joined #ipfs
hef[m] has joined #ipfs
thejohnhenry[m] has joined #ipfs
fujexo[m] has joined #ipfs
renatocan[m] has joined #ipfs
tomaka has joined #ipfs
plindner has joined #ipfs
tealferret[m] has joined #ipfs
chihiro[m] has joined #ipfs
cranau[m] has joined #ipfs
fabrixxm has joined #ipfs
user1234[m] has joined #ipfs
floppypocket[m] has joined #ipfs
null_radix[m] has joined #ipfs
M-hash has joined #ipfs
dby[m] has joined #ipfs
yayota[m] has joined #ipfs
kittydoor[m] has joined #ipfs
janosberghorn[m] has joined #ipfs
sureshj0[m] has joined #ipfs
wervenyt[m] has joined #ipfs
M-flyingzumwalt has joined #ipfs
lypticdna[m] has joined #ipfs
Luke[m]1 has joined #ipfs
Rajdharma[m] has joined #ipfs
mrdrdz[m] has joined #ipfs
Kalq[m] has joined #ipfs
testingotro[m] has joined #ipfs
YuFanLovezYou[m] has joined #ipfs
stardot[m] has joined #ipfs
Mike[m] has joined #ipfs
ekroon1 has joined #ipfs
eluc[m] has joined #ipfs
Cosmo[m] has joined #ipfs
keks[m] has joined #ipfs
DokterBob1 has joined #ipfs
saggad[m] has joined #ipfs
RossSchulman[m] has joined #ipfs
badamson[m] has joined #ipfs
zacklocx[m] has joined #ipfs
sid226 has joined #ipfs
<sid226>
Hi! need help on ipfs-cluster
metric has quit [Quit: No Ping reply in 180 seconds.]
metric has joined #ipfs
metric is now known as Guest42423
<sid226>
getting following on starting the docker ipfs-cluster : > IPFS ERROR: Post http://127.0.0.1:5001/api/v0/id: dial tcp 127.0.0.1:5001: getsockopt: connection refused
<sid226>
basically ipfs daemon is not starting in ipfs-cluster container
muravey has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
muravey has joined #ipfs
e0f has quit [Quit: end of file reached]
dpuzikov has joined #ipfs
mauz555 has joined #ipfs
bomb-on has joined #ipfs
robattila256 has joined #ipfs
mauz555 has quit [Ping timeout: 240 seconds]
yuhl has quit [Ping timeout: 246 seconds]
<sid226>
i switched to IPFS Cluster v0.3.0. was using latest earlier
soesoe has joined #ipfs
JohnX has joined #ipfs
Adbray has joined #ipfs
dvn has joined #ipfs
e0f has joined #ipfs
yuhl_ has joined #ipfs
domanic has joined #ipfs
vicken has quit [Remote host closed the connection]
MikeFair has quit [Ping timeout: 255 seconds]
clemo has joined #ipfs
domanic has quit [Read error: Connection reset by peer]
domanic has joined #ipfs
raynold has quit [Quit: Connection closed for inactivity]
domanic has quit [Read error: Connection reset by peer]
domanic has joined #ipfs
Monokles has quit [Ping timeout: 255 seconds]
<TyrfingMjolnir>
sid226: ?
<TyrfingMjolnir>
How?
<TyrfingMjolnir>
Is there some bugs in latest iteration?
<sid226>
i was getting above error for latest one. i swiched to v0.3.0 in docker-compose file
<sid226>
now the ipfs daemon i starting fine
soesoe has quit [Ping timeout: 265 seconds]
domanic has quit [Read error: Connection reset by peer]
domanic has joined #ipfs
robattila256 has quit [Quit: WeeChat 2.0.1]
<JCaesar>
Hm, did something change about the CORS headers on gateway.ipfs.io? The little thingy I have running on https://goecam.liftm.de doesn't work anymore when I open it from firefox…
<natewalck>
@Icefoz O rly? I didn't realize that data was available via the HTTP API. That is way better than shelling out. Thanks! :)
bomb-on has joined #ipfs
Encrypt has quit [Quit: Quit]
pjz has joined #ipfs
Caterpillar has joined #ipfs
sim590 has joined #ipfs
onikuma has quit [Remote host closed the connection]
jaboja has quit [Ping timeout: 248 seconds]
rngkll has joined #ipfs
anewuser has joined #ipfs
Fess_ has joined #ipfs
colatkinson has quit [Quit: colatkinson]
Fess has quit [Ping timeout: 248 seconds]
domanic has joined #ipfs
bomb-on is now known as n00bMinerXMR
n00bMinerXMR is now known as bomb-on
domanic has quit [Read error: Connection reset by peer]
domanic has joined #ipfs
Encrypt has joined #ipfs
kaotisk has joined #ipfs
domanic has quit [Read error: Connection reset by peer]
tglman1 has quit [Quit: WeeChat 1.9.1]
jungly has quit [Quit: No Ping reply in 180 seconds.]
<rngkll>
Hi, I'm trying to add a large number of files, about 1TB(ubuntu repository), when the add was just finishing, the server rebooted, Is there a way to resume the add or check if it finished?
tglman has joined #ipfs
<voker57>
rngkll: if you ipfs add it again, already present chunks will not be written again
jungly has joined #ipfs
vicken has joined #ipfs
<rngkll>
great
<rngkll>
Every time I run the add, it was taking a lot of time, is a recursive add, lets check this time.
colatkinson has joined #ipfs
anewuser has quit [Quit: anewuser]
ZaZ has joined #ipfs
rodolf0 has quit [Quit: Leaving]
<Icefoz>
rngkll: It will still have to re-hash all the files to see if anything has changed, but it won't consume more storage.
<rngkll>
Icefoz: would it take less time by not writing to disk?
<voker57>
it does for me
<voker57>
I use spinning disks so might be more pronounced for me though
vivus_ has joined #ipfs
anewuser has joined #ipfs
vivus_ has quit [Client Quit]
<rngkll>
voker57: we are using HDDs as well :(
<Icefoz>
rngkll: Yeah, depending on how fast your CPU is compared to your disks.
<Icefoz>
Though the default ipfs web portal also won't follow symlinks
<rngkll>
is there a way to parallelize the hashing of files?, i've been searching for ways, we have multiple CPUs and we are not stressing them
fredthomsen has joined #ipfs
<Icefoz>
So now that I think of it, if the ubuntu repo is structured like the debian one then it will break when trying to follow symlinks. :-(
<Icefoz>
idk, I thought the hashing was parallelized already.
droman has joined #ipfs
<rngkll>
Icefoz: if I see the output, it goes sequentially file by file, not sure if that is only human perception
<voker57>
it's just output format
<voker57>
check your CPU and IO usage
<rngkll>
As soon as the rsync finishes, I'll check the CPU and IO when the add starts
fredthomsen1 has joined #ipfs
fredthomsen has quit [Ping timeout: 260 seconds]
domanic has joined #ipfs
colatkinson has quit [Quit: colatkinson]
colatkinson has joined #ipfs
domanic has quit [Ping timeout: 264 seconds]
MDude has quit [Ping timeout: 240 seconds]
colatkinson has quit [Quit: colatkinson]
domanic has joined #ipfs
<JCaesar>
rngkll: Just so you know, somebody named elopio tried playing around with debian-style repos on ipfs and got bitten by the symlinks problem. /ipfs/QmTNL3t9h23ZUUSsRj1h4CaZ6SLQF6xFoLcve2gAMcLdWA contains the test-repo produced at that time, I think.
<JCaesar>
(meanwhile, I'm updating my archlinuxes through ipfs. Works mehishly…)
spread has quit [Remote host closed the connection]
melvin has joined #ipfs
<rngkll>
voker57: I have 32 xeon cores and the load average: 1.50, with iotop I only see 2 adds
<Icefoz>
Aha, awesome.
<Icefoz>
Though it should be able to use the ipfs daemon's existing HTTP gateway if we fix the symlink issue. :-P
<rngkll>
:( I wanted to see something similar to 32 on the load averaga
<Icefoz>
Though a proper apt transport would be cooler.
<Icefoz>
...yeah, that would be ideal. Hmm.
melvin has quit [Quit: Page closed]
domanic has joined #ipfs
<voker57>
yeah, looks like it's non-multicore
<voker57>
bottleneck might be in announcing though
MDude has joined #ipfs
robattila256 has quit [Quit: WeeChat 2.0.1]
domanic has quit [Read error: Connection reset by peer]
domanic has joined #ipfs
<rngkll>
If I stop the daemon, is way faster and now I see a lot of process
<voker57>
yeah, it's announcing
<voker57>
if you add it w/o daemon availability will still be initially zero so that's not a real solution
<rngkll>
what will be initially zero?
Encrypt has quit [Quit: Quit]
<JCaesar>
availability of the content.
<voker57>
network will not know of your added data until it gets randomly announced
<voker57>
iirc there's some work going on on making deferred but reliable announcing
domanic has quit [Ping timeout: 240 seconds]
Fess_ has quit [Quit: Leaving]
<JCaesar>
I'll eventually have to understand the technical details… I wonder if there could be some heuristic like "he had the parent node. chances are, he's gonna have the child."
<rngkll>
is it the same as adding --local?
ZaZ has quit [Read error: Connection reset by peer]
<voker57>
JCaesar: I believe bitswap code already makes that assumption
joocain2 has quit [Remote host closed the connection]
<voker57>
rngkll: to what?
joocain2 has joined #ipfs
<voker57>
ah, it's undocumented
<JCaesar>
voker57: Then it should be so bad to not have everything announced, no? A package repo would be accessed starting from some root node anyway… As soon as that is announced…
<voker57>
not necessarily
<voker57>
also there might be different root nodes for bytes you're seeking
<voker57>
so lowers availability
nibble has quit [Ping timeout: 264 seconds]
<voker57>
rngkll: yes, it's the same
domanic has joined #ipfs
plexigras has quit [Ping timeout: 240 seconds]
<rngkll>
if the daemon is running, with --local I get between 2 and 3 process
<rngkll>
if daemon is not running I get more that 8
girlhood has joined #ipfs
sickill has quit [Quit: Updating details, brb]
<voker57>
interesting
sickill has joined #ipfs
rodolf0 has quit [Ping timeout: 276 seconds]
domanic has quit [Read error: Connection reset by peer]
espadrine has joined #ipfs
ygrek has joined #ipfs
domanic has joined #ipfs
mildred has joined #ipfs
Fess has joined #ipfs
netsan has quit [Ping timeout: 276 seconds]
domanic has quit [Read error: Connection reset by peer]
domanic has joined #ipfs
jesse22 has joined #ipfs
domanic has quit [Read error: Connection reset by peer]
domanic has joined #ipfs
colatkinson has joined #ipfs
robattila256 has joined #ipfs
fredthomsen1 has quit [Ping timeout: 263 seconds]
domanic has quit [Read error: Connection reset by peer]
<jesse22>
how do i cross compile with the go-ipfs makefile?
mildred has quit [Ping timeout: 260 seconds]
ruby32 has quit [Remote host closed the connection]
jesse22 has quit [Quit: Page closed]
jesse22_ has joined #ipfs
jesse22_ is now known as jesse22
Neomex has joined #ipfs
edrex has joined #ipfs
newhouse has quit [Read error: Connection reset by peer]