stebalien changed the topic of #ipfs to: Heads Up: To talk, you need to register your nick! Announcements: go-ipfs 0.5.0 and js-ipfs 0.43.1 are out! Get them from dist.ipfs.io and npm respectively! | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS: https://github.com/ipfs/ipfs | Logs: https://view.matrix.org/room/!yhqiEdqNjyPbxtUjzm:matrix.org/ | Forums: https://discuss.ipfs.io | Code of Conduct: https://git.io/vVBS0
Mitar has joined #ipfs
johnl[m] has joined #ipfs
johnl[m] has left #ipfs [#ipfs]
rodolf0 has quit [Quit: Leaving]
silvermere has joined #ipfs
mauz555 has quit [Remote host closed the connection]
Ecran has quit [Quit: Going offline, see ya! (www.adiirc.com)]
cipres has joined #ipfs
<aschmahmann[m]>
> What has been changed that the minute timeout is now enforced, but in 0.4.23 wasn't?
<aschmahmann[m]>
I think what was going on is that the timeout was still being enforced in v0.4.23, however the error wasn't being properly propagated to the user.
butcher has quit [Ping timeout: 260 seconds]
indisturbed has joined #ipfs
evanmn has quit [Ping timeout: 240 seconds]
euod[m] has joined #ipfs
Newami has joined #ipfs
Newami has quit [Remote host closed the connection]
ipfs-stackbot1 has quit [Remote host closed the connection]
risk has quit [Quit: Connection closed for inactivity]
catchers has quit [Read error: Connection reset by peer]
ipfs-stackbot1 has joined #ipfs
cipres has quit [Ping timeout: 246 seconds]
benjamingr__ has quit [Quit: Connection closed for inactivity]
evanmn has joined #ipfs
Belkaar has quit [Ping timeout: 246 seconds]
Belkaar has joined #ipfs
Belkaar has joined #ipfs
ddefraude has joined #ipfs
butcher has joined #ipfs
jcea has quit [Quit: jcea]
ygrek has quit [Ping timeout: 260 seconds]
KempfCreative has joined #ipfs
turona has quit [Ping timeout: 272 seconds]
turona has joined #ipfs
jonfle has quit [Quit: My MacBook Air has gone to sleep. ZZZzzz…]
Xeyame has quit [Read error: Connection reset by peer]
Xeyame has joined #ipfs
ipfs-stackbot1 has quit [Remote host closed the connection]
ipfs-stackbot2 has joined #ipfs
choward has quit [Quit: Ping timeout (120 seconds)]
choward has joined #ipfs
KempfCreative has quit [Ping timeout: 260 seconds]
<RubenKelevra[m]>
> I think what was going on is that the timeout was still being enforced in v0.4.23, however the error wasn't being properly propagated to the user.
<RubenKelevra[m]>
Well I'm running this in a shell script, so I didn't care about the error messages, just about the return code.
<RubenKelevra[m]>
(Not sure which one you meant)
endvra has quit [Read error: Connection reset by peer]
<RubenKelevra[m]>
Afterwards I just killed the process (not the daemon one) and it completed the other two or three publishes fine.
<RubenKelevra[m]>
IPFS was always memory hungry for me, but it's a 16 GB server. It didn't run out of memory, but it's quite often using between 5 and 7 GB (probably due to the recently discovered QUIC timer leaks).
<RubenKelevra[m]>
But no, nothing unordinary except for the hanging ipfs publish call. It worked fine afterwards.
<RubenKelevra[m]>
Then I've added the `--timeout 3m` and never had any issues with it again.
andresmazzo[m] has joined #ipfs
daregap has joined #ipfs
freeRanger has joined #ipfs
butcher has quit [Ping timeout: 256 seconds]
chrismoos[m] has joined #ipfs
butcher has joined #ipfs
fabianhjr has quit [Quit: Leaving.]
jesse22 has joined #ipfs
tsrt^ has joined #ipfs
rendar has joined #ipfs
bmwiedemann has joined #ipfs
<bmwiedemann>
Hi, I noticed that go-ipfs 0.5.0 redirects localhost:8080/opensuse.zq1.de/ to opensuse.zq1.de.ipns.localhost but on Linux that name is not resolvable by default. Is there anything I miss there?
xcm has quit [Remote host closed the connection]
seba- has quit [Ping timeout: 246 seconds]
xcm has joined #ipfs
zero33 has joined #ipfs
zero33 has quit [Remote host closed the connection]
zerollzeng has joined #ipfs
zerollzeng has quit [Remote host closed the connection]
seba- has joined #ipfs
fred[m]2 has joined #ipfs
jesse22 has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
zerollzeng has joined #ipfs
jesse22 has joined #ipfs
fazo96 has joined #ipfs
alibosworth[m] has joined #ipfs
fazo96 has quit [Ping timeout: 260 seconds]
zerollzeng has quit [Remote host closed the connection]
<zerollzeng>
I'm newbie to ipfs and I just try it for days with linux, does anybody can share a ipfs file hash that I can retrieve with ipfs get? just for test
jesse22 has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
<ZerXes>
zerollzeng: you should really upgrade to go-ipfs 0.5
<ZerXes>
It has major improvments
<zerollzeng>
different version of go-ipfs is incompatible?
<ZerXes>
go-ipfs 0.5 has some breaking changes yes, I think it still can talk to 0.4-clients, but you should upgrade, it will be much much faster for you
<zerollzeng>
Ok I will try it now
eyenx[m] has quit [Ping timeout: 246 seconds]
eyenx has quit [Ping timeout: 256 seconds]
Ecran has joined #ipfs
<bmwiedemann>
I think, I will prefer to wait for 0.5.1 so that /ipns and the localhost gateway works again (issues #7246 , #7290)
<zerollzeng>
I reinstall go-ipfs, remove old ~/.ipfs, ipfs init, ipfs daemon, ipfs get QmZvS6E5QFLkKcqHosqLcuuNG1QohxC3BsNCh9mhaECddD, still stuck and doesn't have any other output
<zerollzeng>
ZerXes: Any suggestion?
<ZerXes>
zerollzeng: try something smaller like QmePw8gVcBMb8x6kAep6aMBAX23hCSk6iZW3i9VKkiFhu1
<zerollzeng>
It works, Hello world=D
<ZerXes>
:)
<zerollzeng>
I think maybe the content based dns took so much time, it that right? ipfs is build over libp2p but does not have tracker, content search is from node to node until find the wanted hash
eyenx has joined #ipfs
eyenx has quit [Changing host]
eyenx has joined #ipfs
eyenx[m] has joined #ipfs
Adbray has quit [Quit: Ah! By Brain!]
leotaku has joined #ipfs
eyenx[m] has quit [Quit: killed]
<zerollzeng>
I try download some image or text from ipfs-search.com, but none of them success.
<zerollzeng>
does the node host the content is not online?
<zerollzeng>
or network reason
Nact has joined #ipfs
eyenx[m] has joined #ipfs
eyenx[m] has quit [Client Quit]
eyenx[m] has joined #ipfs
captain_morgan has quit [Quit: Ping timeout (120 seconds)]
captain_morgan has joined #ipfs
pecastro has joined #ipfs
ZaZ has joined #ipfs
cybertani[m] has joined #ipfs
hexagonsun[m] has joined #ipfs
RWDS[m] has joined #ipfs
borispaing[m] has joined #ipfs
Sajesajama has joined #ipfs
butcher_ has joined #ipfs
kivutar has quit [Ping timeout: 256 seconds]
butcher has quit [Ping timeout: 264 seconds]
<swedneck1>
works for me
shepeng[m] has joined #ipfs
kivutar has joined #ipfs
xcm has quit [Remote host closed the connection]
xcm has joined #ipfs
fazo96 has quit [Ping timeout: 264 seconds]
fazo96 has joined #ipfs
jrt is now known as Guest73774
Guest73774 has quit [Killed (tolkien.freenode.net (Nickname regained by services))]
jrt has joined #ipfs
hsanjuan has quit [Quit: Connection closed for inactivity]
<RubenKelevra[m]>
<bmwiedemann "Hi, I noticed that go-ipfs 0.5.0"> *.localhost has a catch-all or wildcard functionality under linux. Which browser / client do you use?
<RubenKelevra[m]>
bmwiedemann: see above (not sure if quoting works towards IRC) 🤔
aLeSD has quit [Read error: Connection reset by peer]
hqdruxn08 has quit [Read error: Connection reset by peer]
hqdruxn08 has joined #ipfs
hqdruxn08 has quit [Read error: Connection reset by peer]
hqdruxn08 has joined #ipfs
xcm has joined #ipfs
sneak has quit [Ping timeout: 256 seconds]
sneak has joined #ipfs
ZaZ has quit [Read error: Connection reset by peer]
TheLugal has joined #ipfs
mowcat has joined #ipfs
daregap has quit [Quit: daregap]
Trieste has quit [Ping timeout: 256 seconds]
Trieste has joined #ipfs
kivutar has quit [Ping timeout: 272 seconds]
kivutar has joined #ipfs
KempfCreative has joined #ipfs
xcm has quit [Read error: Connection reset by peer]
reit has quit [Ping timeout: 260 seconds]
xcm has joined #ipfs
<RubenKelevra[m]>
Who's maintaining @ipfsbot:matrix.org ? New issues in gitulhub.com/ipfs/go-ipfs doesn't seem to show up 🤔
<RubenKelevra[m]>
Is this intentional?
f8e4 has quit [Remote host closed the connection]
f8e4 has joined #ipfs
benjamingr__ has joined #ipfs
jcea has joined #ipfs
Ecran has quit [Ping timeout: 260 seconds]
fazo96 has quit [Ping timeout: 256 seconds]
ipfs-stackbot2 has quit [Remote host closed the connection]
esph has quit [Ping timeout: 256 seconds]
kivutar has quit [Ping timeout: 256 seconds]
esph has joined #ipfs
ipfs-stackbot1 has joined #ipfs
f8e4 has quit [Quit: WeeChat 2.8]
kivutar has joined #ipfs
fazo96 has joined #ipfs
sammacbeth has quit [Quit: sammacbeth]
Ecran has joined #ipfs
mowcat has quit [Remote host closed the connection]
sammacbeth has joined #ipfs
KeiraT has quit [Remote host closed the connection]
sammacbeth has quit [Client Quit]
KeiraT- has joined #ipfs
sammacbeth has joined #ipfs
KeiraT- is now known as KeiraT
butcher_ has quit [Ping timeout: 260 seconds]
graffen[m] has joined #ipfs
kivutar has quit [Ping timeout: 272 seconds]
endvra has quit [Read error: Connection reset by peer]
endvra has joined #ipfs
jonuzij1[m] has joined #ipfs
kivutar has joined #ipfs
ZaZ has joined #ipfs
fabianhjr has joined #ipfs
<RubenKelevra[m]>
zerollzeng: yeah it's node to node - but usually pretty fast - and since there's bitswap, you can ask for all further chunks of the file without asking the DHT (in most cases)
Xeyame has quit [Read error: Connection reset by peer]
Xeyame has joined #ipfs
<Rumblestiltskin[>
Is there an IPNS hash that points to an updated version of wikipedia? Or only IPFS hash that points to a specific version?
<RubenKelevra[m]>
Rumblestiltskin: I don't think so, right now. There was some efforts to create a cluster for Wikipedia, but I have some other projects right now I care more about :)
kivutar has joined #ipfs
jesse22 has joined #ipfs
jesse22 has quit [Client Quit]
jesse22 has joined #ipfs
DanielMaybien has joined #ipfs
<Rumblestiltskin[>
RubenKelevra: When you set up clusters, you are just setting up multiple IPFS servers with the content pinned? People wouldn't pin content like Wikipedia and the availability would scale organically? Or am I hoping for too much?
jesse22 has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
jesse22 has joined #ipfs
<RubenKelevra[m]>
<Rumblestiltskin[ "RubenKelevra: When you set up cl"> Well, I'm not really sure I want to be the guy who maintains the Wikipedia Cluster 🤔
andresmazzo[m] has left #ipfs ["User left"]
<jon1012>
cipres, just saw a new release of aioipfs, any quick changelog ?
<Rumblestiltskin[>
I wonder if projects like FIlecoin Discover will host data like Wikipedia
DanielMaybien has quit [Remote host closed the connection]
<RubenKelevra[m]>
Rumblestiltskin: the idea was to save the latest version as plaintext, to be readily available. Those files could be easily cached and the availability would scale dynamically, since everyone reading an article would just cache it.
<RubenKelevra[m]>
Older versions could be saved as diffs, using the cluster to guarantee that old versions keep beeing available.
<RubenKelevra[m]>
The requests for the article itself would be reduced to the cluster somewhat organically. The cluster would be hit by requests probably like spikes on each update, and then the requests would spread out... but haven't really thought much about that.
<RubenKelevra[m]>
Rumblestiltskin: I'm pretty interested in doing it, without Filecoins :)
jesse22 has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
ddefraude has quit [Remote host closed the connection]
dqx_ has joined #ipfs
<bmwiedemann>
RubenKelevra[m]: curl, firefox and even ping cannot resolve the names. on openSUSE that is. /etc/nsswitch has "files dns" in it
jorge_ has joined #ipfs
loganX has joined #ipfs
jesse22 has quit [Ping timeout: 252 seconds]
xcm is now known as Guest44839
Guest44839 has quit [Killed (verne.freenode.net (Nickname regained by services))]
xcm has joined #ipfs
jesse22 has joined #ipfs
rendar has quit []
<RubenKelevra[m]>
bmwiedemann: yeah, it seems to be a SUSE related issue, see for details your ticket :)
<RubenKelevra[m]>
bmwiedemann: there's a workaround provided for the time it takes the upstream to fix it.
xcm has quit [Remote host closed the connection]
kivutar has quit [Ping timeout: 256 seconds]
xcm has joined #ipfs
Ayporos has joined #ipfs
Ayporos has left #ipfs [#ipfs]
Ayporos has joined #ipfs
<Ayporos>
Hey guys, I'm trying out IPFS on Win10 and I cannot seem to add a folder (with subfolders). It doesn't recreate folder structure and merely appends the folder structure to the start of the filenames.
<Ayporos>
Is it even possible in IPFS? Do I need to use a CLI command for that?.. or is the only way to manually create folders in IPFS itself and then paste files there?
kivutar has joined #ipfs
<Ayporos>
nvm... dragging and dropping folders appears to maintain folder structure
<Ayporos>
why the hell doesn't the +Add -> Folder button do that though.. =/
buttocks has joined #ipfs
<voker57>
you're talking about some specific IPFS GUI
<voker57>
ipfs itself does not include any graphical interface
Nact has quit [Quit: Konversation terminated!]
<voker57>
oh, or is it the web gui
loganX has quit [Remote host closed the connection]
loganX has joined #ipfs
Soo_Slow has joined #ipfs
<swedneck1>
webui and ipfs-desktop are basically identical
<swedneck1>
ipfs-desktop is just the webui in electron and it runs a go-ipfs node if you don't already have one
robjtede[m] has joined #ipfs
jorge_ has quit [Quit: jorge_]
jorge_ has joined #ipfs
<cipres>
jon1012: hello. No changelog sorry, mainly it's been about updating it to make it work well with go-ipfs 0.5.0 (switch everything to POST requests)
loganX has quit [Quit: loganX]
loganX has joined #ipfs
<Ayporos>
"ipfs itself does not include any graphical interface" I love how some devs say that like they're proud of it.
<Ayporos>
Anyway, it is the webui/ipfs-desktop
<Ayporos>
If I select a small folder it seems to work fine. If I select a large folder it does seem to be working.. I'm seeing disc and CPU activity so I'm going to assume it's processing the data.. would have loved to see a progress bar or some sort of indication that it's working though :)
<Ayporos>
It's 2020, I don't think asking for a bit of GUI creature comforts are too much to ask. Then again, I suppose the project might just be in a phase where that's just not a priority (yet). I apologize if that's the case. ;)
benjamingr__ has quit [Quit: Connection closed for inactivity]
dethos has joined #ipfs
<cipres>
Ayporos: what OS do you use ?
<Ayporos>
Win10 Pro, as I stated before. ;)
ZaZ has joined #ipfs
<cipres>
no linux machine you have access to ?
<Ayporos>
No? Why is that relevant?
dwilliams has quit [Ping timeout: 260 seconds]
<swedneck1>
there is definitely merit in not having the base software include a GUI
<swedneck1>
because that means 1) it's not using unneccessary resources, 2) you can build a GUI ontop of it, and easily change that GUI
jorge_ has quit [Ping timeout: 260 seconds]
<Ayporos>
Oh don't get me wrong, I get that completely. I'm just talking from an end-user perspective. Obviously detaching the GUI from the actual functional part of a piece of software is a solid philosophy
kivutar has quit [Ping timeout: 246 seconds]
kivutar has joined #ipfs
mowcat has joined #ipfs
jonfle_ has joined #ipfs
jonfle has quit [Ping timeout: 244 seconds]
cheet has quit [Ping timeout: 272 seconds]
risk has quit [Quit: Connection closed for inactivity]
<Ayporos>
Silly question: (Win10 webui) I'm trying to add data from disk X to my repo on disk H but when it's adding the data (GB's worth of files) it's literally caching through my C (OS) disk?
<Ayporos>
Is this an inherent 'feature'?.... because thrashing my expensive boot SSD to move files from spinning rust array to another spinning rust array doesn't sound like a fun time to me. It's hogging up ~3GB of RAM while doing all this work so I really don't see what/why the fuck it's doing that.
<Ayporos>
Is this just a Windows thing and does the Linux version not unnecessarily rape unrelated disks or is the program just a piece of disk-destroying shit? :D
<Ayporos>
(Or maybe it's related to the repo first being on my C disk and then I moved it to the H disk after finding out it wasn't just gonna link to the original data (like a good boi should) and LITERALLY COPY THE FUCK OUT OF EVERY FILE I ADD?)
<Ayporos>
Sorry if I sound mad, just a bit disappointed after first thinking I found 'the future of file sharing/distribution' only to realize it's totally not designed for sharing anything other than a few small documents. =/
<aschmahmann[m]>
lmk how it goes, if it's the %TEMP% thing then it's pretty easily fixable but also a pretty unsurprising thing when the OS gives you a directory and says "please you me to store temporary files"
<aschmahmann[m]>
* lmk how it goes, if it's the %TEMP% thing then it's pretty easily fixable but also a pretty unsurprising thing when the OS gives you a directory and says "please use me to store temporary files"
<Ayporos>
Ty for the response aschmahmann, that actually helped me. I will investigate the usage of badgerds and changing the envvar
Kamilion has quit [Ping timeout: 258 seconds]
<Ayporos>
from an end-user perspective I assumed, if any such things would be relevant to the operation of the program (which it clearly is), it'd be an install-time/setup-time option the user could set/configure.. I'm not a developer nor a linux guy so reading through config files and their github explanation pages isn't a 'default action' I perform when
<Ayporos>
trying out new software :D
Forkk has quit [Ping timeout: 240 seconds]
<aschmahmann[m]>
np, you may also want to investigate the experimental filestore. It allows you to import data without copying it. The filestore isn't great if you want to update your data (basically because you've just covertly deleted data from IPFS), but for data you're not going to change should work pretty well (I'd look into the docs for more info)
zopsi has quit [Ping timeout: 256 seconds]
<Ayporos>
and yes, the %TEMP% folder has been the bane of my existence for as long as its existed. Here I am sitting on 48GB of RAM only for programs to prefer to destroy my OS SSD instead.
cruxeternus has quit [Ping timeout: 260 seconds]
trn has quit [Ping timeout: 260 seconds]
<aschmahmann[m]>
So maybe just change where %TEMP% points to one of your slow drives. May slow down some programs but 🤷♂️
<Ayporos>
hmm that sounds great. All I really want is for it to function as an index that doesn't take up a lot of space and points towards the actual data
<Ayporos>
I'm trying to share 110GB, 10k folders, ~500k files... I don't want to have to keep two copies of that shit sitting around if I don't have to. It's already duplicated by way of being on a RAID1 :P
<aschmahmann[m]>
Right, but as a heads up if you added a large CAD model to IPFS using the filestore and then updated the CAD file you'd be sad
<Ayporos>
it's all non-volatile files. Nothing like documents that can/could change.
<Ayporos>
I don't really want to change %TEMP% though, it's fine being on a fast disk.. I'm just annoyed at so many programs unnecessarily offloading shit to disk that should/could really be cached in memory. I mean, in this case it's going to be writing to the repo anyway so why would it FIRST write to %TEMP%?
<Ayporos>
I checked the volumes and it wasn't like it was caching small shit.. it was literally reading a big chunk of data from the source disk, dumping it into %TEMP% and then once it was done reading all the source data dumping it all over into the repo folder.. at least, that's what it looked like
loganX has joined #ipfs
<aschmahmann[m]>
Makes sense, or at least trying a bit harder to put the temporary directory close to where the data will end up living (e.g. use a temp directory wherever flatfs lives)
Forkk has joined #ipfs
<Ayporos>
well, if what it writes to %TEMP% is literally 1 for 1 what it will cope to the repo then that would work.. NTFS would simply adjust the indexes and not actually need to perform any read/write actions on the physical data...
<Ayporos>
I don't know that though, do you? :)
zopsi has joined #ipfs
xcm has quit [Remote host closed the connection]
loganX has quit [Remote host closed the connection]
<aschmahmann[m]>
Pretty sure that's correct, but you'd need to make sure that the temporary directory and target directory are on the same drives which AFAIK is impossible (e.g. a custom filesystem driver/FUSE implementation that puts all files in the folder starting with A on drive A and all other files on drive B), although you can try to get closer if you make sane assumptions.
katian_ has joined #ipfs
<aschmahmann[m]>
Badger is way faster than flatfs anyway (although it has some garbage collection issues) so I suspect using a real database instead of the filesystem is the future here
xcm has joined #ipfs
jorge_ has joined #ipfs
cruxeternus has joined #ipfs
jorge_ has quit [Client Quit]
trn has joined #ipfs
jorge_ has joined #ipfs
Kamilion has joined #ipfs
kivutar has quit [Ping timeout: 260 seconds]
kivutar has joined #ipfs
xcm has quit [Remote host closed the connection]
Alex-Dj has joined #ipfs
zopsi has quit [Ping timeout: 246 seconds]
xcm has joined #ipfs
Ayporos has quit [Remote host closed the connection]
cruxeternus has quit [Ping timeout: 258 seconds]
pederdm000[m] has joined #ipfs
Kamilion has quit [Ping timeout: 240 seconds]
Forkk has quit [Ping timeout: 244 seconds]
trn has quit [Ping timeout: 256 seconds]
Alex-Dj has quit [Excess Flood]
null1337 has quit [Quit: If you're not living on the edge, you're taking up too much space]
Forkk has joined #ipfs
zopsi has joined #ipfs
trn has joined #ipfs
ygrek has quit [Ping timeout: 240 seconds]
cruxeternus has joined #ipfs
jorge_ has quit [Quit: jorge_]
jorge_ has joined #ipfs
eyenx[m] has quit [Quit: killed]
eyenx has quit [Quit: bye]
ZaZ has quit [Read error: Connection reset by peer]
KempfCreative has quit [Ping timeout: 258 seconds]
danimal-moo[m] has joined #ipfs
eyenx has joined #ipfs
eyenx has joined #ipfs
eyenx has quit [Changing host]
Kamilion has joined #ipfs
eyenx[m] has joined #ipfs
Hory has joined #ipfs
eyenx[m] has quit [Quit: killed]
eyenx[m] has joined #ipfs
jorge_ has quit [Quit: jorge_]
jorge_ has joined #ipfs
benjamingr__ has joined #ipfs
kivutar has quit [Ping timeout: 256 seconds]
Soo_Slow has quit [Quit: Soo_Slow]
kivutar has joined #ipfs
TheLugal has quit [Remote host closed the connection]