aschmahmann changed the topic of #ipfs to: Heads Up: To talk, you need to register your nick! Announcements: go-ipfs 0.7.0 and js-ipfs 0.50.2 are out! Get them from dist.ipfs.io and npm respectively! | Also: #libp2p #ipfs-cluster #filecoin #ipfs-dev | IPFS: https://github.com/ipfs/ipfs | Logs: https://view.matrix.org/room/!yhqiEdqNjyPbxtUjzm:matrix.org/ | Forums: https://discuss.ipfs.io | Code of Conduct: https://git.io/vVBS0
ZaZ has quit [Read error: Connection reset by peer]
jrt has joined #ipfs
ZorPrime has quit [Ping timeout: 260 seconds]
user_51 has joined #ipfs
user_51_ has quit [Ping timeout: 240 seconds]
<JCaesar>
aschmahmann: Hm. Maybe that "too much content" is the problem I'm running into with /ipns/12D3KooWAivw38E5ohfpYo66FJTqYuWCsrBPPXjpHiCHh7fB5YYn ? How much would be too much?
jrt is now known as Guest47814
Guest47814 has quit [Killed (tolkien.freenode.net (Nickname regained by services))]
jrt has joined #ipfs
<aschmahmann>
Not sure off hand, but if you do `ipfs dht findprovs /ipfs/bafyabc` (on a node that's not the publisher) and it's taking a while to return then that's probably you're issue. If you then do `ipfs dht provide /ipfs/bafyabc` from the providing node and things start working you have your culprit
zeden has quit [Quit: WeeChat 2.9]
ib07 has quit [Remote host closed the connection]
ksclarke[m] has joined #ipfs
ib07 has joined #ipfs
Belkaar has quit [Ping timeout: 260 seconds]
Belkaar has joined #ipfs
Belkaar has joined #ipfs
KempfCreative has quit [Ping timeout: 246 seconds]
drathir_tor has quit [Ping timeout: 240 seconds]
ZorPrime has joined #ipfs
cheet has quit [Read error: Connection reset by peer]
stoopkid has joined #ipfs
cheet has joined #ipfs
cheet has quit [Quit: ZNC 1.8.x-nightly-20190530-13450c7f - https://znc.in]
cheet has joined #ipfs
Jeanne-Kamikaze has joined #ipfs
LHLaurini has quit [Quit: Konversation terminated!]
opal has quit [Ping timeout: 240 seconds]
opal has joined #ipfs
<JCaesar>
chrm. About 10 seconds after the provide, the findprovs finished. After blocking without result for a minute before that.
<JCaesar>
(then again, the findprovs didn't return any actual providers, and the provide is still running. weird…)
<JCaesar>
2.5 mio objects is not a lot, is it?
MDude has quit [Quit: Going offline, see ya! (www.adiirc.com)]
jeeebz_ has joined #ipfs
jeeebz has quit [Ping timeout: 244 seconds]
katian_ has quit [Remote host closed the connection]
katian_ has joined #ipfs
<aschmahmann>
ˈt͡sɛːzaɐ̯: 2.5 million objects? you will definitely have problems with that. Do you have 2.5 million pins, or blocks?
daregap has joined #ipfs
ipfs-stackbot1 has quit [Remote host closed the connection]
ipfs-stackbot1 has joined #ipfs
drathir_tor has joined #ipfs
stoopkid has quit [Quit: Connection closed for inactivity]
Jeanne-Kamikaze has quit [Ping timeout: 246 seconds]
Ecran10 has joined #ipfs
opal has quit [Ping timeout: 240 seconds]
opal has joined #ipfs
ctOS has quit [Quit: Connection closed for inactivity]
<JCaesar>
blocks, I hope. I didn't pin a single thing and put everything into mfs. (Well, except ipfs name publish counts as a pin, right? I do do ipfs name publish $(ipfs files stat --hash /))
<aschmahmann>
ya there's no way you'll be able to provide that many. You should probably turn off reproviding and manually provide the root blocks of files that you want to be found.
<aschmahmann>
Unfortunately the only the only built in automatic reproviders currently are none, all blocks, all pinned blocks, and roots of pins. This means setting up a script that calls `ipfs dht provide` on your relevant CIDs.
<aschmahmann>
I'd like to both add more defaults as well as an `ipfs provide` command that does providing for you automatically once you specify what you want to provide.
<JCaesar>
Oh, providing the root blocks is sufficient?
Telemachus[m] has left #ipfs ["User left"]
bengates has joined #ipfs
jeeebz_ is now known as jeeebz
<aschmahmann>
ummm sort of, but not really. As soon as you're connected to the peer that has the data you will get it via Bitswap even without an explicit provider record. However, Bitswap is currently really simple and if you request the whole DAG under QmRoot and you happen to have QmRoot but not its children (e.g. you restarted IPFS during a download) then it'll start looking for QmChild in the DHT and not find anything so it won't
<aschmahmann>
find the data. If you manually did `ipfs dht findpeer QmRoot` and connected to those peers your download would complete though.
<aschmahmann>
Making Bitswap smart enough to realize that it should search the DHT for QmRoot if it finds nothing for QmChild is another one of those on the todo list things
<aschmahmann>
I don't think this one or the one above will make 0.8.0, but hopefully should make 0.9.0
is_null has joined #ipfs
pecastro has joined #ipfs
misuto has quit [Quit: Ping timeout (120 seconds)]
misuto has joined #ipfs
graffen has joined #ipfs
aLeSD has joined #ipfs
bengates has quit [Remote host closed the connection]
bengates has joined #ipfs
<jeeebz>
Thank you aschmahmann, but node B can not connect to node A manually. It is strange, because on my side, I can access through ipfs.io/ipfs/...
<jeeebz>
But I ignore this problem, and go further
is_null has quit [Ping timeout: 264 seconds]
<jeeebz>
I set a folder in ipns/OneOfMyPeerId (and I confirm it is accessible via ipfs.io)
<jeeebz>
inside, there are few files, and a second of my peers also have the ipfs daemon activ, and the file.
lnoferin has joined #ipfs
<jeeebz>
When a third try to download ipfs.io/ipns/theFirstPeer/fileHash, "what" will provide the file ? Only theFirstPeer, or the closed-hash-peer ? Or all availables peers ?
pecastro has quit [Ping timeout: 240 seconds]
<aschmahmann>
jeeebz: the TLDR here is that p2p systems are complex and surprisingly resilient. IPFS in particular has a number of mechanisms that make things work even in adverse conditions.
<aschmahmann>
If B cannot connect to A manually you have a problem you need to resolve. Otherwise what could be happening is A connects to the gateway and then the gateway downloads the data from A even though A is not dialable since A dialed the gateway. This makes it seem as though everything is working fine even though A is having issues
<JCaesar>
"ummm sort of, … [goes wrong if you happen to have the root but not the rest]", i see, that behavior was expected from all what I know of IPFS. Guess I need to find a way to reduce the number of objects. (The data is still 500 GB, no way around that.
<jeeebz>
aschmahmann: is it possible that B have a problem ? (specialy with CGN/NAT444 ?)
is_null has joined #ipfs
<aschmahmann>
ˈt͡sɛːzaɐ̯: what do you mean by reduce the number of objects? Sure you could just have fewer CIDs (e.g. increasing the chunk size to 1 MiB), but just reducing the number of things being provided should be sufficient (e.g. only provide the files and folders but not every block in the file)
<JCaesar>
Hm. It sounded like that would be more difficult… I have about 70000 files in there, iirc.
<aschmahmann>
jeeebz: Anything is possible 🤷♂️ there are all kinds of weird networks out there. Connecting outbound isn't normally the problem though.
<aschmahmann>
If you want to share the peerID of the machine hosting the content or the CID of the data you're having trouble with (either here or via DM) I can ping it for you and see
<aschmahmann>
jeeebz: I found the ipns record, and I found two peers providing the CID behind it. However, I can't connect to either of them so I suspect you've got some network configuration issues
<jessicara>
question: does ipfs need more than just opening it's port? like responding to icmp ping?
<aschmahmann>
don't think so, port forwarding or UPnP should be sufficient.
supercoven has joined #ipfs
<JCaesar>
aschmahmann: I was trying to do a gentoo source file mirror on IPFS. So single file download is pretty much necessary.
<aschmahmann>
ˈt͡sɛːzaɐ̯: I'm not familiar with how gentoo operates. Are you trying to operate this as a thing that integrates with a package manager, or just getting source files to be viewable on ipfs?
<jeeebz>
ok, aschmahmann can you retry ?
<aschmahmann>
Am I connecting to QmYQH... or QmYQZ...?
<jeeebz>
QmYQH
msg2aag[m] has joined #ipfs
<aschmahmann>
Nope. I'm gonna head out for now, but you can test on your own by using `ipfs id` to get the list of multiaddrs and then using some online port checker (e.g. https://portchecker.co/ is the first one I found) and checking to see if your port is open/reachable.
<jeeebz>
thank you, I will continue to try
Nact has joined #ipfs
is_null has quit [Ping timeout: 272 seconds]
is_null has joined #ipfs
karolus has joined #ipfs
<jeeebz>
which ports NEED to be open ? Only 4001 is sufficient ? (tcp right ?)
<jeeebz>
8080, every one can use any gateway, I don't have to provides one ?
<jeeebz>
What about the "api server" 5001 ?
<aschmahmann>
opening 4001 tcp should be sufficient (Note you can do udp also to support QUIC)
<aschmahmann>
unless you have a good reason to don't expose 8080, and unless you are ok with remote people performing various actions on your IPFS node don't expose 5001.
is_null has quit [Ping timeout: 264 seconds]
<aschmahmann>
the above is short hand, read the docs for more info on what gateways and the API port are for
opal has quit [Ping timeout: 240 seconds]
Micah99 has joined #ipfs
Micah99 has quit [Remote host closed the connection]
MicahZoltu has joined #ipfs
<MicahZoltu>
I am being prompted to update IPFS Desktop on Windows to a new version, but clicking the "Restart" button (which the prompt says to click to upgrade) doesn't do anything and I am unable to disable the prompt.
<MicahZoltu>
If I manually restart the app, I just get prompted again. I cannot start or turn on the node, it just immediately prompts me to update which doesn't work.
<MicahZoltu>
Is this a known issue? Is there a more targeted location I can get assistance with IPFS Desktop?
<jeeebz>
I set the ports on my box, 4001 is open and forward it localy to my node.
<jeeebz>
but when I start the daemon, I read that line : Swarm announcing /ip4/81.xx.xx.xxx/tcp/19172
drathir_tor has quit [Remote host closed the connection]
drathir_tor has joined #ipfs
drathir_tor has quit [Remote host closed the connection]
drathir_tor has joined #ipfs
<jessicara>
yeah i was thinking only expose 8080 via /ipfs/ on nginx
<jessicara>
(and ipns)
MicahZoltu has quit [Remote host closed the connection]
p8m has joined #ipfs
p8m_ has quit [Ping timeout: 260 seconds]
opal has joined #ipfs
_jrjsmrtn has joined #ipfs
__jrjsmrtn__ has quit [Ping timeout: 240 seconds]
poundwise has joined #ipfs
zootella has quit [Quit: Connection closed for inactivity]
p8m has quit [Ping timeout: 272 seconds]
p8m has joined #ipfs
bengates has quit [Remote host closed the connection]
bengates has joined #ipfs
<lidel[m]>
MicahZoltu: there was a bug on Windows and you need to manually update to v0.13.2. From there it will work fine.
<lidel[m]>
I've updated release notes, thank you for catching that.
zeden has joined #ipfs
Ecran10 has quit [Quit: Going offline, see ya! (www.adiirc.com)]
misuto has quit [Ping timeout: 265 seconds]
misuto has joined #ipfs
oo1o1oo1[m] has left #ipfs ["User left"]
is_null has joined #ipfs
lnoferin has quit [Ping timeout: 240 seconds]
<JCaesar>
aschmahmann: I'm trying for the same thing that VictorBjelkholm is doing with his archlinux mirror, in case you're familliar with that. And yes, it's just "make the original directory structure on the HTTP mirrors visible on IPFS and then add ipfs http gateway + ipns path as a download source".
Anth0mk has joined #ipfs
<JCaesar>
(Except well, gentoo keeps several versions around of everything, and some packages require a lot of source files to be built (texlive is probably the worst culprit), ..., so there's just a lot more files around.)
p-core has quit [Remote host closed the connection]
<aschmahmann>
jeeebz: why it doesn't use the port 4001 ? Probably due to UPnP. You can turn off UPnP usage by IPFS via https://github.com/ipfs/go-ipfs/blob/master/docs/config.md#swarmdisablenatportmap, however UPnP should also work if your router supports it. Note you can also configure announce addresses manually, but I wouldn't do that unless you have a static IP address for your machine.
<aschmahmann>
Try waiting a minute or two after starting and then running `ipfs id` and seeing what ip addresses are spit out. Those are the ones your node is telling the world about.
dopplergange has joined #ipfs
brianhoffman_ has joined #ipfs
brianhoffman has quit [Ping timeout: 272 seconds]
brianhoffman_ is now known as brianhoffman
ZaZ has quit [Ping timeout: 260 seconds]
ipfs-stackbot1 has quit [Remote host closed the connection]
lord| has joined #ipfs
ipfs-stackbot1 has joined #ipfs
pecastro has joined #ipfs
pecastro has quit [Ping timeout: 256 seconds]
psyk has joined #ipfs
LHLaurini2 has quit [Remote host closed the connection]