<slothbag>
hey all.. i've been battling with resource usage with IPFS for a while now.. I tried to get my head around the code, but came to the conclusion the fastest solution is to create a very simple http based content sharing wrapper that calls IPFS from the command line.. Is it worth me creating an issue on github re resource issues?
dguttman has quit [Quit: dguttman]
ygrek has quit [Ping timeout: 252 seconds]
reit has quit [Quit: Leaving]
changeName has joined #ipfs
changeName has quit [Client Quit]
pfraze has joined #ipfs
rgrinberg has quit [Ping timeout: 240 seconds]
apiarian has quit [Ping timeout: 240 seconds]
apiarian has joined #ipfs
asdsa has joined #ipfs
asdsa has quit [Client Quit]
Akaibu has quit [Quit: Connection closed for inactivity]
dmr has joined #ipfs
slothbag has quit [Ping timeout: 244 seconds]
slothbag has joined #ipfs
PrinceOfPeeves has quit [Quit: Leaving]
gmcquillan_ has quit [Quit: gmcquillan_]
gmcquillan has joined #ipfs
gmcquillan is now known as gmcquillan_
slothbag has quit [Read error: No route to host]
slothbag has joined #ipfs
ashark has quit [Ping timeout: 276 seconds]
Arakela007 has joined #ipfs
M-slang has joined #ipfs
Arakela0_ has joined #ipfs
Arakela007 has quit [Read error: Connection reset by peer]
ashark has joined #ipfs
mpi has joined #ipfs
pfraze has quit [Remote host closed the connection]
reit has joined #ipfs
Arakela007 has joined #ipfs
Arakela0_ has quit [Read error: Connection reset by peer]
redfish has quit [Ping timeout: 264 seconds]
herzmeister has quit [Ping timeout: 244 seconds]
dignifiedquire has quit [Quit: Connection closed for inactivity]
bertschneider has joined #ipfs
bertschneider has quit [Client Quit]
JEntrep has joined #ipfs
JEntrep has quit [Client Quit]
matoro has quit [Ping timeout: 260 seconds]
gmcquillan_ has quit [Ping timeout: 244 seconds]
redfish has joined #ipfs
edubai__ has joined #ipfs
ecloud_wfh is now known as ecloud
mildred has joined #ipfs
Tv` has quit [Quit: Connection closed for inactivity]
cblgh has quit [Ping timeout: 252 seconds]
cblgh has joined #ipfs
ashark has quit [Ping timeout: 260 seconds]
ygrek has joined #ipfs
ygrek_ has joined #ipfs
mildred has quit [Read error: Connection reset by peer]
mildred has joined #ipfs
ygrek has quit [Ping timeout: 260 seconds]
edrex has joined #ipfs
ylp has joined #ipfs
disgusting_wall has quit [Quit: Connection closed for inactivity]
dignifiedquire has joined #ipfs
warner has quit [Quit: ERC (IRC client for Emacs 24.5.1)]
edrex has quit [Read error: Connection reset by peer]
herzmeister has joined #ipfs
edrex has joined #ipfs
eleuwhavercamp has joined #ipfs
slothbag has quit [Quit: Leaving.]
s_kunk has quit [Ping timeout: 260 seconds]
matoro has joined #ipfs
<daviddias>
noffle: merged and releasing unixfs-engine
<daviddias>
dignifiedquire morning, how are you feeling about streams today
<daviddias>
anything I can help you test?
<dignifiedquire>
good morning
<dignifiedquire>
let's have a call in a bit, that's probably easier to talk about
<daviddias>
ok :)
<ipfsbot>
[js-ipfs] diasdavid closed pull request #276: Update peer-info to version 0.7.0
<daviddias>
Error: Uncaught TypeError: SWS.createServer is not a function (/home/ubuntu/js-ipfs/test/browser.js:104064 <- webpack:///~/libp2p-websockets/lib/index.js:47:0)
<daviddias>
it looks like it is not using my simple-websocket fork anymore
<dignifiedquire>
daviddias: whoo
infinity0 has quit [Remote host closed the connection]
<dignifiedquire>
I figured out the issue why it's hanging
<daviddias>
woot! that is rad, got a solution too?
<dignifiedquire>
length-prefixed-message uses `.read` that means it does not properly respect pause and resume
<dignifiedquire>
so I think if I move multistream-select to use length-prefixed-stream instead this part should work
<daviddias>
ah, that is a really dark one
* dignifiedquire
goes in to the dark corners of the internet
infinity0 has joined #ipfs
<dignifiedquire>
daviddias: yeah that's a really weird one
<dignifiedquire>
daviddias: are you seeing this locally as well?
<daviddias>
yep
<daviddias>
locally as well
<dignifiedquire>
then try running a debug build in chrome, that should give you an idea
<daviddias>
libp2p-ipfs-browser passed just fined
<daviddias>
the installed version is the right on
<daviddias>
and only one version of simple-websocket get installed
<dignifiedquire>
also might be that bitswap needs updating for the new peer id
<Magik6k>
Hmm, I'd just get ipfs/master and put that code into single commit, but I have code from guy that did #2005(it's based on that), but he didn't sign-off (but he is alive)
<Magik6k>
Is there any way he could sign-off my commit with his code or something?
<lgierth>
once they've signed off that commit, you can just rebase on top of tha
<lgierth>
you can still open the PR, and you can also leave the intermediary commits
<Magik6k>
So he signs-off his commit, then I merge it into master and put/rebase my changes onto that, right?
<lgierth>
either: the commit gets signed off and merged, then you rebase on top of master
<lgierth>
or: the commits gets signed off and not (yet) merged, then you rebase on top of the signed off commit
<Magik6k>
his commit was not really done to the stage where it could be merged, it was more of a POC
<lgierth>
ah i see
<lgierth>
if you're the one making it actually work then i think there's a case for you also being the author
<lgierth>
jbenet: wdyt? ^
<Magik6k>
I implemented some things and my commits are signed off
<r0kk3rz>
lgierth: what can you actually access via this fc00/cjdns thing?
<lgierth>
not much, one or the other website
<lgierth>
there are a few ipfs nodes there too
<Kubuxu>
r0kk3rz: cjdns allows you for ipbased access control for example.
<r0kk3rz>
ah cool
<lgierth>
r0kk3rz: you can also use it as a vpn replacement, for tunneling internet traffic -- it's doing that very well and has helped me tremendously while travelling
<Kubuxu>
Or exposing otherwise unsecured services (http only) in more secure way.
<r0kk3rz>
i do need a good vpn back to aus
<lgierth>
let Kubuxu and me know if you have any questions
<lgierth>
or ansuz
rendar has quit [Ping timeout: 244 seconds]
<r0kk3rz>
i thought about putting it on my phone, just because i can
<ipfsbot>
[go-ipfs] magik6k opened pull request #2765: Expose corenet API (master...feature/corenet) https://git.io/vrSQi
lispmeister has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
mildred1 has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
<lgierth>
r0kk3rz: there's a proper android app on its way
cketti has quit [Ping timeout: 244 seconds]
Encrypt has joined #ipfs
ashark has quit [Read error: Connection reset by peer]
pfraze has quit [Remote host closed the connection]
<ansuz>
ohai
* ansuz
domain expert
<ansuz>
ish
ashark has joined #ipfs
cketti has joined #ipfs
Looking has quit [Ping timeout: 244 seconds]
Looking has joined #ipfs
wallacoloo has joined #ipfs
<Kubuxu>
Magik6k: awesome job
rendar has joined #ipfs
mpi has joined #ipfs
ygrek has joined #ipfs
Guest75133 is now known as special
special has quit [Changing host]
special has joined #ipfs
bearbin has joined #ipfs
jedahan has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
jedahan has joined #ipfs
gmcquillan has joined #ipfs
gmcquillan_ has quit [Ping timeout: 252 seconds]
Looking has quit [Ping timeout: 264 seconds]
fuznuts has quit [Ping timeout: 240 seconds]
Looking has joined #ipfs
mpi_ has joined #ipfs
mpi has quit [Read error: Connection reset by peer]
Arakela007 has quit [Remote host closed the connection]
mildred1 has quit [Ping timeout: 240 seconds]
mpi has joined #ipfs
mpi_ has quit [Ping timeout: 272 seconds]
gmcquillan has quit [Quit: gmcquillan]
gmcquillan has joined #ipfs
fleeky has quit [Ping timeout: 240 seconds]
pfraze has joined #ipfs
arpu has quit [Ping timeout: 252 seconds]
mpi has quit [Remote host closed the connection]
MadcapJake is now known as MadcapJake_afk
ygrek has quit [Ping timeout: 258 seconds]
Encrypt has quit [Quit: Quitte]
Encrypt has joined #ipfs
Oatmeal has quit [Ping timeout: 260 seconds]
fuznuts has joined #ipfs
arpu has joined #ipfs
pfraze has quit [Remote host closed the connection]
wallacoloo has quit [Ping timeout: 252 seconds]
ashark has quit [Ping timeout: 240 seconds]
ploop has quit [Ping timeout: 250 seconds]
hammerkop has quit [Remote host closed the connection]
gnathonic has joined #ipfs
pfraze has joined #ipfs
tdmps has joined #ipfs
tdmps has left #ipfs [#ipfs]
pfraze has quit [Remote host closed the connection]
ploop has joined #ipfs
computerfreak has joined #ipfs
pfraze has joined #ipfs
Confiks has quit [Ping timeout: 260 seconds]
Oatmeal has joined #ipfs
ashark has joined #ipfs
pfraze has quit [Remote host closed the connection]
johnchalekson has joined #ipfs
johnchalekson has quit [Max SendQ exceeded]
johnchalekson has joined #ipfs
johnchalekson has quit [Max SendQ exceeded]
johnchalekson has joined #ipfs
pfraze has joined #ipfs
pfraze has quit [Remote host closed the connection]
pfraze has joined #ipfs
pfraze has quit [Remote host closed the connection]
wallacoloo has joined #ipfs
Confiks has joined #ipfs
pfraze has joined #ipfs
dguttman has quit [Quit: dguttman]
pfraze has quit [Remote host closed the connection]
Confiks has quit [Ping timeout: 240 seconds]
galois_dmz has joined #ipfs
Confiks has joined #ipfs
rgrinberg has joined #ipfs
computerfreak has quit [Remote host closed the connection]
pfraze has joined #ipfs
wallacoloo has quit [Quit: wallacoloo]
wallacoloo has joined #ipfs
chriscool has quit [Quit: Leaving.]
pfraze has quit [Remote host closed the connection]
wallacoloo has quit [Client Quit]
<galois_dmz>
Hi there! A question about IPFS communication overhead. I've spun up a set of 3 IPFS nodes that only know about each other (no external bootstrap servers, so they're not on the global network). They seem to work fine; I can create and access files/blocks, register names, exactly as I'd expect. But it seems like there's very high overhead. For example, if on one node I run a command to create a single small file, us
<galois_dmz>
ing the "files" command (i.e., something like "echo "hello there" | ipfs files write --create /msg1"), it results in between 20KB and 60KB of network traffic, in each direction, on each of the other two nodes. That seems to me like an awful lot of traffic for creating one little file and updating the DHT.
<galois_dmz>
(it also results in similar traffic on the node on which I create the file)
<galois_dmz>
Does that seem like the expected level of overhead, or might there be something odd going on?
<galois_dmz>
Also, is there a threshold below which the content of small files is simply stored in the DHT, rather than as pointers to blocks that need to be separately downloaded with BitSwap? That possibility was mentioned in the white paper, but it's not clear to me whether the Go implementation (which I should have mentioned is what I'm using - version 0.4.2) actually works that way.
jedahan has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
jedahan has joined #ipfs
jedahan has quit [Client Quit]
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
ashark has quit [Ping timeout: 272 seconds]
pfraze has joined #ipfs
pfraze has quit [Remote host closed the connection]