<kevina>
there is actually very little code outside of the filestore that is not already in a p.r.
<kevina>
thanks, I think the biggest barrier to getting this merged outside of code review of the filestore code itself is https://github.com/ipfs/go-ipfs/pull/3257
lassulus has quit [Ping timeout: 245 seconds]
lassulus has joined #ipfs
32NAAFYY2 has quit [Ping timeout: 245 seconds]
Monokles has quit [Ping timeout: 245 seconds]
Monokles has joined #ipfs
<whyrusleeping>
kevina: i still don't know what i think of 3257...
<whyrusleeping>
i'll dive into that tomorrow
slothbag has joined #ipfs
<slothbag>
Hey guys, whats the status on IPLD? Can we use it in/with go-ipfs?
<whyrusleeping>
slothbag: you can if you're feeling like trying out my PR
<whyrusleeping>
otherwise wait a couple days :D
<whyrusleeping>
its going to ship as 'experimental' in 0.4.5
<whyrusleeping>
then we're going to harden it and ship it officially in 0.5.0
<slothbag>
nice.. happy to wait a few days.. exciting!
chax has quit [Remote host closed the connection]
OstlerDev has joined #ipfs
OstlerDev has joined #ipfs
OstlerDev has quit [Changing host]
chax has joined #ipfs
<slothbag>
will it completely replace the old merkedag object?
Monokles_2 has joined #ipfs
zopsi has joined #ipfs
<whyrusleeping>
nope
<whyrusleeping>
it will just be a 'recommended' alternative
<whyrusleeping>
and in 0.5.0 it will be the default for most applications
<kevina>
whyrusleeping: thanks.
Monokles has quit [Ping timeout: 245 seconds]
OstlerDev_ has quit [Ping timeout: 245 seconds]
<slothbag>
sounds good
<whyrusleeping>
though things like `ipfs add` will likely still generate protobuf objects
<lgierth>
tl;dr "combine code written in Go 1.0 and a proposed Go 2.0 in one program using the package level as the boundary between language versions"
paul_lelo has joined #ipfs
<lgierth>
it's a bit many words for that of course, but it doesn't sound bad?
<lgierth>
i'm definitely writing down the "central park effect" for multiformats
<whyrusleeping>
yeah
<whyrusleeping>
sounds about right
<lgierth>
.php3
<lgierth>
#neverforget
mildred has quit [Ping timeout: 244 seconds]
<whyrusleeping>
lol
up_dn has joined #ipfs
mildred has joined #ipfs
<lgierth>
it'll lead to interesting linking problems but hey
screensaver has quit [Ping timeout: 244 seconds]
screensaver has joined #ipfs
tangent128 has quit [Quit: ZNC 1.6.2 - http://znc.in]
* lgierth
zzz
seharder has joined #ipfs
seharder has quit [Client Quit]
up_dn has quit [Quit: up_dn]
tangent128 has joined #ipfs
robogoat_ is now known as robogoar
robogoar is now known as robogoat
Boomerang has quit [Ping timeout: 265 seconds]
dignifiedquire has quit [Quit: Connection closed for inactivity]
Spyros has quit [Remote host closed the connection]
mgue has quit [Ping timeout: 260 seconds]
misuto_ has quit [Remote host closed the connection]
misuto has joined #ipfs
anewuser has quit [Quit: anewuser]
mgue has joined #ipfs
sixeth has quit [Ping timeout: 265 seconds]
slothbag has left #ipfs [#ipfs]
seharder has joined #ipfs
djdv has joined #ipfs
seharder has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
yoosi has quit [Remote host closed the connection]
yoosi has joined #ipfs
summons has joined #ipfs
banqiao has joined #ipfs
ygrek has quit [Ping timeout: 250 seconds]
SuperPhly has joined #ipfs
banqiao_ has quit [Ping timeout: 250 seconds]
BananaMagician has quit [Ping timeout: 260 seconds]
sixeth has quit [Ping timeout: 256 seconds]
ec is now known as ELLIOTTCABLE
<alu>
anyone here going to ccc
gmcquillan has quit [Quit: gmcquillan]
sixeth has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
locusf_ is now known as locusf
captain_morgan has quit [Read error: No route to host]
sixeth has quit [Ping timeout: 256 seconds]
dmr has joined #ipfs
captain_morgan has joined #ipfs
Oatmeal has quit [Ping timeout: 250 seconds]
DiCE1904 has joined #ipfs
ELLIOTTCABLE is now known as purr
sixeth has joined #ipfs
Akaibu has joined #ipfs
chris613 has quit [Quit: Leaving.]
pfrazee has quit [Remote host closed the connection]
Oatmeal has joined #ipfs
uzyn has quit [Quit: uzyn]
chax_ has joined #ipfs
chax has quit [Read error: Connection reset by peer]
Aranjedeath has quit [Quit: Three sheets to the wind]
lkcl has quit [Ping timeout: 250 seconds]
SuperPhly has quit [Quit: My MacBook Pro has gone to sleep. ZZZzzz…]
dignifiedquire has joined #ipfs
uzyn has joined #ipfs
chax_ has quit [Remote host closed the connection]
installgen2 has quit [Remote host closed the connection]
ulrichard has joined #ipfs
ygrek has joined #ipfs
sixeth has quit [Remote host closed the connection]
rendar has joined #ipfs
herzmeister has quit [Ping timeout: 256 seconds]
ulrichard has quit [Remote host closed the connection]
ulrichard has joined #ipfs
herzmeister has joined #ipfs
gmcquillan__ has joined #ipfs
gmcquillan__ is now known as gmcquillan
steefmin_ has joined #ipfs
steefmin has quit [Ping timeout: 265 seconds]
fleeky_ has quit [Ping timeout: 265 seconds]
fleeky_ has joined #ipfs
bsm117532 has quit [Ping timeout: 265 seconds]
steefmin_ is now known as steefmin
bsm117532 has joined #ipfs
lidel has quit [Ping timeout: 252 seconds]
matoro has quit [Ping timeout: 276 seconds]
lidel has joined #ipfs
gmcquillan has quit [Ping timeout: 245 seconds]
ylp1 has joined #ipfs
uuu_john has quit [Remote host closed the connection]
banqiao has quit [Ping timeout: 244 seconds]
banqiao has joined #ipfs
captain_morgan has quit [Ping timeout: 260 seconds]
tangent128 has quit [Ping timeout: 256 seconds]
ygrek has quit [Ping timeout: 260 seconds]
s_kunk has quit [Ping timeout: 260 seconds]
<A124>
I have a thing to say.
nivekuil` is now known as nivekuil
<A124>
Not sure if you know about it, if it is written down anywhere, but... very easy solution to the memory problem is setting a soft limit using cgroups or alike.
<A124>
It seemed growing slowly, but when set, it went down and the level stays around the softlimt.
sixeth has joined #ipfs
warner has quit [Quit: ERC (IRC client for Emacs 25.1.2)]
polezaivsani has joined #ipfs
sixeth has quit [Remote host closed the connection]
<dignifiedquire>
yes because we rely on it emitting which files have been written
<dignifiedquire>
it's technically a transform stream
<dignifiedquire>
that's why it has a source
<daviddias>
I get that the 'metadata' is being emitted, but not sure if I understand why exactly we need to 'rely' on tha
<daviddias>
s/tha/that
<dignifiedquire>
because that way we can log in a streaming fashion when things have been written
<dignifiedquire>
for example if you put 10000 blocks a callback would be called only after all of them were written
<dignifiedquire>
but like this it'll inform you for each block when it was written
<daviddias>
Oh, I see, my confusion really comes from reading putStream and thinking of it as a fs.createWriteStream, where it really is 'writeFilesStream'
<dignifiedquire>
yes
<dignifiedquire>
it's like the put in abstract-blob-store
<dignifiedquire>
did I manage to remove all of understanding? ;)
<dignifiedquire>
*your
robattil1 has quit [Quit: WeeChat 1.6]
<daviddias>
abstract-blob-store only does one file per createWriteStream
<dignifiedquire>
right okay
<dignifiedquire>
nvm that then
<dignifiedquire>
it's a place to sink all your blocks into
<dignifiedquire>
daviddias: one question, is it wise to make the resolve interface sync? I can easily see many cases where this would need to be async
<dignifiedquire>
same goes for tree
<daviddias>
for example?
<daviddias>
at the local resolver level
<daviddias>
is block scope
<daviddias>
it should not need to touch anything external
<dignifiedquire>
yes but you could have blocks that don't fit in meomry
<dignifiedquire>
or you need to do hashing to process them
<daviddias>
hm.. to generate the CIDs
<dignifiedquire>
yeah all cid generation will be async soon
<daviddias>
damn WebCrypto async API
<dignifiedquire>
lol
<daviddias>
yeah, that is correct
<daviddias>
async it is then
<dignifiedquire>
sorry 😊
<dignifiedquire>
I also like sync code more
PseudoNoob has joined #ipfs
uzyn has quit [Quit: uzyn]
<daviddias>
ok, down to last 3 PR to make RFM
<daviddias>
going to update interface-ipld-format
<daviddias>
and then dag-pb
<daviddias>
dag-cbor
<daviddias>
and ipld-resolver
<daviddias>
are you tackling the array thing as well?
banqiao has joined #ipfs
<dignifiedquire>
just finished the array
<dignifiedquire>
will update dag-cbor to use asyn interface now?
<daviddias>
sounds good, thank you :)
banqiao_ has quit [Ping timeout: 260 seconds]
uzyn has joined #ipfs
uzyn has quit [Client Quit]
corvinux has quit [Ping timeout: 276 seconds]
<Stskeeps>
how does something like html5 local storage fare with an ipfs gateway? given 'Local storage is per origin (per domain and protocol). All pages, from one origin, can store and access the same data.
Oatmeal has quit [Quit: Oatmeal]
mildred has quit [Ping timeout: 260 seconds]
<ion>
The gateway sets a suborigin header.
<Stskeeps>
ion: thanks
<ion>
Not sure how many browsers follow it at the moment.
<dignifiedquire>
daviddias: just pushed all them fixes for dag-cbor
lidel has joined #ipfs
<dignifiedquire>
daviddias: are you doing ipld-dag-pb already? otherwise I can do that too
<daviddias>
dignifiedquire: yeah, I am, thank you for pushing dag-cbor
<dignifiedquire>
👍
mildred has joined #ipfs
sixeth has joined #ipfs
lidel has quit [Ping timeout: 250 seconds]
yoosi has quit [Remote host closed the connection]
yoosi has joined #ipfs
uzyn has joined #ipfs
lidel has joined #ipfs
uzyn has quit [Client Quit]
neary has joined #ipfs
lidel has quit [Ping timeout: 250 seconds]
neary has quit [Read error: Connection reset by peer]
neary has joined #ipfs
neary has quit [Read error: Connection reset by peer]
neary has joined #ipfs
neary_ has joined #ipfs
neary has quit [Read error: Connection reset by peer]
lidel has joined #ipfs
banqiao has quit [Ping timeout: 252 seconds]
banqiao has joined #ipfs
banting has quit [Ping timeout: 245 seconds]
mildred has quit [Ping timeout: 244 seconds]
intern has joined #ipfs
mildred has joined #ipfs
herzmeister has quit [Quit: Leaving]
herzmeister has joined #ipfs
<dignifiedquire>
daviddias: all good? need any more help?
PseudoNoob has quit [Quit: Leaving]
banqiao has quit [Ping timeout: 256 seconds]
anewuser has joined #ipfs
<daviddias>
all good for now, thank you :)
Hory_ has joined #ipfs
BananaMagician has joined #ipfs
rgrinberg has joined #ipfs
SuperPhly has joined #ipfs
reit has joined #ipfs
anonymuse has joined #ipfs
tangent128 has joined #ipfs
sixeth has quit [Ping timeout: 276 seconds]
lkcl has joined #ipfs
PseudoNoob has joined #ipfs
pfrazee has joined #ipfs
lindybrits has joined #ipfs
seharder has joined #ipfs
sixeth has joined #ipfs
mildred has quit [Ping timeout: 250 seconds]
jmelis has joined #ipfs
Geertiebear has joined #ipfs
<jmelis>
IPFS currently on in OpenNebulaConf
<jmelis>
looks awesome :)
Puppet_Master has joined #ipfs
Puppet_Master has left #ipfs ["WeeChat 1.6"]
sixeth has quit [Remote host closed the connection]
<lgierth>
thanks jmelis
<lgierth>
say hi to hsanjuan for me
<lindybrits>
Hi all! I have been struggling a lot - I can't seem to get the basics right of adding/retrieving a simple file via js-ipfs or js-ipfs-api. Would anyone be able to assist?
<jmelis>
lgierth: will do
anonymus_ has joined #ipfs
anonymuse has quit [Read error: Connection reset by peer]
<lindybrits>
@jmelis? @lgierth? Anyone? :)
<hsanjuan>
:) thanks @jmelis
<Geertiebear>
lindybrits: What exactly are you having trouble with? Like is it command line related?
Boomerang has joined #ipfs
mildred has joined #ipfs
<lindybrits>
Geertiebear: I am trying to add files in the browser. Firstly - I have a problems with require('ipfs') and browserifying. I get the error fs.readFileSync is not a function. I have resulted to adding <script src="https://unpkg.com/ipfs/dist/index.js"></script> in my html file.
ilyaigpetrov has joined #ipfs
cemerick has quit [Ping timeout: 276 seconds]
itsgremlin has joined #ipfs
<itsgremlin>
hi all, got a question about ipfs… anyone around?
<lindybrits>
Geertiebear: It seems I am getting somewhere by using ipfs.files.add() and I even get a returned hash. But then, I am struggling to identify where the file is, to retrieve it again?
<Geertiebear>
Ah
<Geertiebear>
Hm
<A124>
itsgremlin Hello. It is customary on irc to ask and wait around if anyone in knows is around to answer.
<Geertiebear>
Sorry I'm not well versed in javascript/browser stuff
<itsgremlin>
A124: ok, is it possible to run an ipfs server client side… i.e. create a website that people can load that will run their server as well
<A124>
js is being updated, but I stopped watching that, since I am waiting for it to be shipped.
<lindybrits>
Geertiebear: Thanks anyways!
<A124>
itsgremlin IPFS is completely decentralized. When someone view a resource it is cached. They also can choose to store, 'pin', the resource.
<A124>
If it is static, that's it. If not, there is more involved.
itsgremlin has quit [Quit: itsgremlin]
Oatmeal has joined #ipfs
ylp1 has quit [Ping timeout: 260 seconds]
SuperPhly has quit [Quit: My MacBook Pro has gone to sleep. ZZZzzz…]
shizy has joined #ipfs
yoosi has quit [Remote host closed the connection]
yoosi has joined #ipfs
installgen2 has quit [Quit: ZNC 1.6.3 - http://znc.in]
installgen2 has joined #ipfs
SuperPhly has joined #ipfs
anonymus_ has quit [Read error: Connection reset by peer]
anonymuse has joined #ipfs
anonymuse has quit [Read error: Connection reset by peer]
<daviddias>
lol tmpDir got deprecated in node.js 7?
<daviddias>
for tmpdir
<daviddias>
oh well
<dignifiedquire>
seems like a super important change :D
chris613 has joined #ipfs
<lindybrits>
dignifiedquire: Hah! I see you! :) I've been wanting to chat to you. I need to get a working js browser example running on my side. I PR #485 is merging soon, but any hopes of me playing around with the concept beforehand?
<lindybrits>
* I know PR #485 is merging...
reit has quit [Ping timeout: 260 seconds]
<dignifiedquire>
hey lindybrits
tirej has quit [Read error: Connection reset by peer]
<dignifiedquire>
so you can already use it in the browser without #458 that just makes things easier
<dignifiedquire>
that way you get just the content
SuperPhly has quit [Quit: My MacBook Pro has gone to sleep. ZZZzzz…]
bastianilso__ has joined #ipfs
eibriel has quit [Ping timeout: 260 seconds]
jedahan has joined #ipfs
maxlath has joined #ipfs
cjohns has quit [Ping timeout: 260 seconds]
ylp1 has quit [Quit: Leaving.]
ashay has joined #ipfs
cjohns has joined #ipfs
<cjohns>
dignifiedquire: thanks! trying that now.
<ashay>
Anyone use Haad's orbit-db in a project? Trying to get the examples working but running into some errors
SuperPhly has joined #ipfs
ulrichard has quit [Remote host closed the connection]
eibriel has joined #ipfs
dmr has quit [Quit: Leaving]
matoro has joined #ipfs
cjohns has quit [Ping timeout: 260 seconds]
ygrek has joined #ipfs
shizy has quit [Quit: WeeChat 1.6]
krzysiek1 has quit [Ping timeout: 276 seconds]
shizy has joined #ipfs
andoma has quit [Ping timeout: 256 seconds]
<lindybrits>
dignifiedquire: Seems things are progressing. What I have done - browserified the code at the bottom of https://github.com/interfect/js-ipfs/blob/211b5ddb2ee55f89fc4831b4a503a466aef20d3c/README.md. I include the bundle.js in my html file. It says "Online status: online", but in the console I have the following error: Firefox can’t establish a connection to the server at ws://127.0.0.1:9090/socket.io/?EIO=3&transport=websocket
<lindybrits>
dignifiedquire: What does this mean?
Hory_ has quit [Quit: Leaving]
<lindybrits>
Another error in the web console: The connection to ws://127.0.0.1:9090/socket.io/?EIO=3&transport=websocket was interrupted while the page was loading.
anonymuse has quit [Read error: Connection reset by peer]
anonymuse has joined #ipfs
andoma has joined #ipfs
captain_morgan has joined #ipfs
matoro has quit [Ping timeout: 244 seconds]
pfrazee has quit [Remote host closed the connection]
ashay has quit [Ping timeout: 260 seconds]
<A124>
lindybrits I bet that just means you are not running local node with ws support.
<victorbjelkholm_>
think most people use /ipfs & /ipns
<bronzo>
victorbjel: where to put the folders, i want to put them in /srv
<victorbjelkholm_>
bronzo, ah, take a look at ~/.ipfs/config where you can change the mountpoints
<victorbjelkholm_>
it's under Mounts.IPFS and Mounts.IPNS
<bronzo>
victorbjel: k, will give it a shot, thanks!
sixeth has joined #ipfs
gmcquillan has quit [Quit: gmcquillan]
<haad>
!tell ashay left a comment in the issue you opened re. orbit-db. tl;dr: it works on my machine with a frsh clone and npm install/build. not sure why it's throwing an error for you.
sixeth has quit [Ping timeout: 260 seconds]
<Mateon1>
haad: "Trying to get some examples working", so I assume it properly installed but crashes at runtime (or something)
<Mateon1>
I'm not able to test any NPM package at the moment, due to my internet silently corrupting stuff
sixeth has joined #ipfs
bastianilso__ has quit [Ping timeout: 256 seconds]
* pjz
updates his ancient ipfs-update update script to use the new(?) distributions page
<whyrusleeping>
alu: CCC?
<Kubuxu>
Battery driver on my laptop's battery is weird.
<Kubuxu>
3rd time it keeps working for like 30min with 0%.
<whyrusleeping>
Kubuxu: yeah, i've had that at times
<whyrusleeping>
i've also noticed it dying at 7% before
<Kubuxu>
yeah had that before too
maxlath has joined #ipfs
<dignifiedquire>
daviddias: ready to ship ipld? :P
<dignifiedquire>
whyrusleeping: I haven't killed your machine yet :)
<whyrusleeping>
dignifiedquire: woooo!
sixeth has quit [Ping timeout: 256 seconds]
lindybrits has quit [Quit: Page closed]
<daviddias>
going to finish it up tomorrow, the async changes require me to update the unixfs engine and js-ipfs and js-ipfs-api too
<daviddias>
but yeah, updated everything up to IPLD resolver
<dignifiedquire>
schweet
pfrazee has joined #ipfs
<whyrusleeping>
haad: i dont think we have a 'tell' thing in this channel
<dignifiedquire>
daviddias: any more thoughts on the runtime changes etc?
<whyrusleeping>
i kicked mubot for taking pinbots snacks
domanic has joined #ipfs
krzysiekj has joined #ipfs
reit has joined #ipfs
captain_morgan has quit [Read error: No route to host]
<haad>
:(
domanic has quit [Read error: Connection reset by peer]
domanic has joined #ipfs
<whyrusleeping>
i know! poor pinbot...
<whyrusleeping>
he does all this hard work for us only to have his treats stolen
jedahan_ has joined #ipfs
<whyrusleeping>
arkadiy[m]: awesome stuff over there :)
<alu>
I have the opportunity to go again this year
lindybrits has joined #ipfs
sixeth has quit [Ping timeout: 256 seconds]
chax has joined #ipfs
Mizzu has joined #ipfs
<A124>
!botsnack
<pinbot>
om nom nom
<whyrusleeping>
alu: you should! i'm very likely going
<whyrusleeping>
and so are a bunch of other ipfs people
chax has quit [Read error: Connection reset by peer]
ulrichard has joined #ipfs
<dignifiedquire>
whyrusleeping: where?
<whyrusleeping>
a teamcity js-ipfs-api test failure
sixeth has joined #ipfs
<dignifiedquire>
that's odd, why should that suddenly vanish
<A124>
dignifiedquire Chaos Comm Con
<A124>
Nevermind.
chax has joined #ipfs
polezaivsani has quit [Remote host closed the connection]
sixeth has quit [Ping timeout: 260 seconds]
ygrek has quit [Ping timeout: 265 seconds]
Encrypt_ has joined #ipfs
s_kunk has quit [Ping timeout: 265 seconds]
Encrypt_ has quit [Client Quit]
Mizzu has quit [Quit: WeeChat 1.5]
elico has left #ipfs [#ipfs]
chax has quit [Remote host closed the connection]
chax has joined #ipfs
<dignifiedquire>
whyrusleeping: added flush false, lets see what happens
Guest59851 has quit [Ping timeout: 244 seconds]
<dignifiedquire>
this could be so much faster if I would use multiple cores..
domanic has quit [Read error: Connection reset by peer]
<dignifiedquire>
but it's definitely faster now with flush:false
domanic has joined #ipfs
<dignifiedquire>
whyrusleeping: will it flush eventually, or do I have to do sth manually for sth to be flushed?
whyrusleeping has quit [Ping timeout: 248 seconds]
dominic_ has joined #ipfs
domanic has quit [Remote host closed the connection]
ygrek has joined #ipfs
rendar has quit [Ping timeout: 252 seconds]
kobigurk has joined #ipfs
<pjz>
so I'm working on a paid pinning service
s_kunk has joined #ipfs
s_kunk has quit [Changing host]
s_kunk has joined #ipfs
<pjz>
the model being: you send bitcoin and provide an address to pin and that address gets pinned for as long as the bitcoin lasts at the specified rate
<pjz>
no accounts needed, etc
dominic_ is now known as domanic
<lemmi>
so you are going to host my warez for a few coins and deal with the lawyers?
ulrichard has quit [Remote host closed the connection]
jedahan has joined #ipfs
jedahan_ has quit [Ping timeout: 260 seconds]
ulrichard has joined #ipfs
<victorbjelkholm_>
pjz, yay! Sounds interesting! Any demo/prototype to share?
harder has joined #ipfs
<geoah>
pjz nice!
AkhILman has quit [Ping timeout: 245 seconds]
domanic has quit [Quit: Konversation terminated!]
domanic has joined #ipfs
ulrichard has quit [Ping timeout: 244 seconds]
lindybrits has quit [Quit: Page closed]
<pjz>
not quite there yet :)
<pjz>
I'm trying to use lambda for the frontend and then random VPS for the back end
<pjz>
communicating via a kind of database in the middle
chax has quit [Remote host closed the connection]
<daviddias>
dignifiedquire: afaik you have to flush manually, or it will flush when there is nothing more to add
<daviddias>
but yeah, not having to bubble up the changes saves a lot of writes (and space)
<pjz>
lemmi: well, the nice thing about hashes is that I don't know the contents. That said, I won't bother fighting DMCA notices for hash takedowns, I'll just take them down and unpin them.
neary_ has joined #ipfs
ulrichard has joined #ipfs
chax has joined #ipfs
anonymuse has quit [Read error: Connection reset by peer]
anonymuse has joined #ipfs
chax has quit [Remote host closed the connection]
chax has joined #ipfs
chax has quit [Remote host closed the connection]
chax has joined #ipfs
rendar has joined #ipfs
chax has quit [Remote host closed the connection]
neary_ has quit [Ping timeout: 260 seconds]
chax has joined #ipfs
<pjz>
is there a standard safe way to talk to an ipfs node's API across the internet? safe for the node to be listening, I mean.
<pjz>
I can't seem to find anything. I guess I could set up some kind of access-limited proxy on the server but that seems a bit overkill
neary_ has joined #ipfs
rgrinberg has quit [Remote host closed the connection]
<pjz>
I was just looking at using paramiko to ssh in :)
cemerick has quit [Ping timeout: 260 seconds]
domanic has quit [Quit: Konversation terminated!]
domanic has joined #ipfs
<victorbjelkholm_>
pjz, have a nginx in front, only accessing traffic with right token + ip
<pjz>
victorbjelkholm_: ugh, too much setup :)
captain_morgan has quit [Ping timeout: 252 seconds]
<pjz>
python has an sshtunnel that will tunnel over ssh
SuperPhly has joined #ipfs
<pjz>
oh, wait, nothing will work in python because the ipfsapi module won't know how to use it
<pjz>
maybe I just punt and figure out how to do this without talking direct to ipfs
<Kubuxu>
whyrusleeping is still offline\
<Kubuxu>
I don't know how long he can survive in this state :p
cemerick has joined #ipfs
SuperPhly has quit [Quit: My MacBook Pro has gone to sleep. ZZZzzz…]
maxlath has quit [Ping timeout: 245 seconds]
Encrypt_ has joined #ipfs
chax has quit [Ping timeout: 252 seconds]
chax has joined #ipfs
<victorbjelkholm_>
Kubuxu, old stories say that once whyrusleeping goes offline for more than 20 minutes, it indicates an extra strong winter this year
<victorbjelkholm_>
let's hope that's not true
neary_ has quit [Ping timeout: 256 seconds]
<Kubuxu>
I like winter
bsm117532 has quit [Ping timeout: 252 seconds]
Encrypt_ has quit [Quit: Quit]
Encrypt_ has joined #ipfs
neary_ has joined #ipfs
bsm117532 has joined #ipfs
domanic has quit [Remote host closed the connection]
domanic has joined #ipfs
SuperPhly has joined #ipfs
mildred has quit [Quit: Leaving.]
SuperPhly has quit [Max SendQ exceeded]
captain_morgan has joined #ipfs
mildred has joined #ipfs
domanic has quit [Ping timeout: 250 seconds]
domanic has joined #ipfs
ulrichard_ has joined #ipfs
ulrichard_ has quit [Quit: Ex-Chat]
domanic has quit [Read error: Connection reset by peer]
domanic has joined #ipfs
pfrazee has quit [Quit: pfraze has joined]
<thufir>
winter kills
pfrazee has joined #ipfs
matoro has joined #ipfs
chax has quit [Remote host closed the connection]
<pjz>
winter is coming
chax has joined #ipfs
chax has quit [Remote host closed the connection]
chax has joined #ipfs
galois_d_ has joined #ipfs
ianopolous_ has quit [Ping timeout: 260 seconds]
domanic has quit [Remote host closed the connection]
domanic has joined #ipfs
<Geertiebear>
Winter is awesome
soloojos has quit [Ping timeout: 245 seconds]
galois_dmz has quit [Ping timeout: 260 seconds]
bastianilso__ has joined #ipfs
<thufir>
agreed, purges the weak
captain_morgan has quit [Ping timeout: 245 seconds]
bastianilso__ has quit [Quit: bastianilso__]
domanic has quit [Quit: Konversation terminated!]
domanic has joined #ipfs
domanic has quit [Ping timeout: 260 seconds]
Geertiebear has quit [Quit: Leaving]
<demize>
Winter disagrees with my arthritis, sadly.
herzmeister has quit [Ping timeout: 256 seconds]
neary_ has quit [Quit: neary_]
herzmeister has joined #ipfs
<thufir>
I'm purposely creating the harshest winter I can, where virtue will provide the only warmth.
domanic has joined #ipfs
ckwaldon has quit [Read error: Connection reset by peer]
whyrusleeping has joined #ipfs
<whyrusleeping>
vps was down for over an hour... meh
<dignifiedquire>
whyrusleeping: is your machine alright? sth seems to be not right, checking with files ls and it hangs
<dignifiedquire>
also the cloning processing seems to be stuck
ckwaldon has joined #ipfs
<dignifiedquire>
could this be related with your vps issues?
<whyrusleeping>
>.>
<whyrusleeping>
thats separate
<whyrusleeping>
let me chekc
maxlath has joined #ipfs
<whyrusleeping>
ipfs files ls will take a while to run with flush=false
<whyrusleeping>
how long did it hang?
<whyrusleeping>
machine itself seems fine
<alu>
is there a guide to essentially setting up an ipfs seedbox
<dignifiedquire>
well I started it a couple mintues before I wrote you
<dignifiedquire>
and it still hasn't finished
<dignifiedquire>
2h ago it took < 30s to complete
<dignifiedquire>
scrap that, my ssh dropped -..-
<whyrusleeping>
dignifiedquire: a files stat call is hanging
<whyrusleeping>
thats odd
<dignifiedquire>
not stat, ls
<whyrusleeping>
(ipfs diag cmds is a great tool to use btw)
<whyrusleeping>
no, its stat. trust me
<dignifiedquire>
oh you mean there is one lying around?
<whyrusleeping>
run ipfs diag stat
<whyrusleeping>
er
<whyrusleeping>
ipfs diag cmds
iovoid has joined #ipfs
herzmeister has quit [Quit: Leaving]
<dignifiedquire>
what does the "true"/"false" mean?
<whyrusleeping>
true means the command is still live
<dignifiedquire>
I se
<dignifiedquire>
should I try to call a flush on the folder to make sure the data stays?
<whyrusleeping>
did you restart the process since the buggy bit last night?
<whyrusleeping>
like, nuke the repo
gmcquillan__ has joined #ipfs
gmcquillan__ is now known as gmcquillan
<dignifiedquire>
I did not nuke the repo
<whyrusleeping>
okay
<whyrusleeping>
can you shut down the process?
<whyrusleeping>
i want to check a few things without having the whole thing running
<dignifiedquire>
daemon or registry clone?
<whyrusleeping>
registry clone
chax has joined #ipfs
<dignifiedquire>
stopped
<whyrusleeping>
thanks
<whyrusleeping>
odd, are you sure?
<whyrusleeping>
some of the requests are still active
wallacoloo_ has joined #ipfs
<dignifiedquire>
yes I'm sure
<whyrusleeping>
okay
chax_ has joined #ipfs
chax has quit [Read error: Connection reset by peer]
<whyrusleeping>
dignifiedquire: where does the stderr from the daemon go?
<dignifiedquire>
the daemon runs in a named tmux session called "daemon"
<whyrusleeping>
and also, are you setting the fd limit to be something high like 4096 ?
<dignifiedquire>
I did not touch and fd limits
<dignifiedquire>
*any
<whyrusleeping>
ah, yeap
<whyrusleeping>
thats the issue
<whyrusleeping>
cool
<whyrusleeping>
annoying though
<whyrusleeping>
i thought i had fixed that...
<whyrusleeping>
'13:41:08.811 ERROR engine: tried to execute a task and errored fetching block: ran out of retries trying to get past temporary error: open /home/ipfs/npm/blocks/CIQNB/CIQNBEJRTPTHL5KS4YBNO73UVTXXHFFVLSALBFZK4BVE42PQL3ZNSBI.data: too many open files engine.go:174
<whyrusleeping>
'
<dignifiedquire>
ahh
<lgierth>
time for nightlies
<whyrusleeping>
lgierth: you setting them up for me? :D
mildred has quit [Ping timeout: 260 seconds]
ianopolous has joined #ipfs
<whyrusleeping>
dignifiedquire: okay, restart it
<whyrusleeping>
should be good now
kobigurk has quit [Ping timeout: 245 seconds]
<lgierth>
i wanted to yesterday
<lgierth>
but then there korean food
<dignifiedquire>
whyrusleeping: starting
<whyrusleeping>
lgierth: i'll get you a large bucket of korean food if you set up nightlies for me
<lgierth>
one can only eat so much
<lgierth>
sadly!
<dignifiedquire>
it's running again :)
<dignifiedquire>
what did you do?
<dignifiedquire>
just increased the fd limit?
<whyrusleeping>
raised the fd limit
<whyrusleeping>
yeah
<whyrusleeping>
it got hung up trying to fetch blocks from disk
<whyrusleeping>
too many open file descriptors
<whyrusleeping>
npm-registry should really be named 'mfs stress test'
<dignifiedquire>
:D
<dignifiedquire>
also some stuff is not there anymore I think :/
<whyrusleeping>
eh?
<lgierth>
pinsets *cough*
<lgierth>
:D
<dignifiedquire>
let me verify
<dignifiedquire>
hmm so there are only 17417 folders in /npm-registry but it processed much more than that, roughly 80k
<dignifiedquire>
I think there were more before :/
<dignifiedquire>
maybe sth didn't get flushed and was lost when I restarted?
<whyrusleeping>
Yeah, thats likely
<whyrusleeping>
should be fine though
<dignifiedquire>
(my bash history is not long enough)
<dignifiedquire>
(to go back and check)
<whyrusleeping>
daviddias: made registry mirror able to handle all sorts of shit going wrong
anonymuse has quit [Remote host closed the connection]
<dignifiedquire>
well lets see how it goes from here :)
galois_d_ has quit [Remote host closed the connection]
<dignifiedquire>
the numer is steadily growing so I am happy
anonymuse has joined #ipfs
galois_dmz has joined #ipfs
anonymuse has quit [Ping timeout: 252 seconds]
rgrinberg has joined #ipfs
<whyrusleeping>
:D
Boomerang has quit [Remote host closed the connection]
captain_morgan has joined #ipfs
ulrichard has quit [Remote host closed the connection]
bauruine has quit [Read error: Connection reset by peer]
bauruine has joined #ipfs
harder has left #ipfs ["Leaving"]
harder has joined #ipfs
harder has left #ipfs ["Leaving"]
rendar has quit [Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!]
seharder has joined #ipfs
jedahan has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
chax_ has quit [Read error: Connection reset by peer]
rgrinberg has quit [Remote host closed the connection]
bauruine has joined #ipfs
<seharder>
Question? I setup two ipfs daemon's and added a file to one of them. I then used cat to successfully view file on both. I then unpinned and then ipfs repo gc" on both. I can still cat the file."
domanic has quit [Ping timeout: 260 seconds]
<seharder>
Is "ipfs repo gc" not really deleting the file or is the file somehow on a 3rd machine still.
<seharder>
The command returns with no output on both.
<lgierth>
can you still cat it after a restart?
<lgierth>
restart of the daemon
<lgierth>
i'm suspecting some caching issue
maxlath has quit [Quit: maxlath]
<seharder>
Is it true that the only place where this file could be found is on these two computers?
<seharder>
Let me try the restart
<lgierth>
no, whenever you create or get a block, a provider record is created, which is sent to certain peers of yours
<lgierth>
so there's room for scanner-fetcher tools
<lgierth>
who knows what's out there
<seharder>
when I cat the file after a restart it hangs on both computers.
<lgierth>
and ipfs dht findprovs <hash> on that restarted node?
<lgierth>
that's expected to hang and eventually exit without output, because there should be no providers for it
<lgierth>
i suspect there's some caching that kept the cat command working
<lgierth>
whyrusleeping Kubuxu ^
<seharder>
that makes sense. Thanks
espadrine is now known as espadrine_
espadrine_ is now known as espadrine`
espadrine` is now known as espadrine
<seharder>
Another Question: If I make up a random hash that most likely doesn't exist and try to cat, it will hang.
<seharder>
Is this because it is trying to ask the universe if this file exists?
<lgierth>
yeah it just keeps looking
<lgierth>
until you abort the request, i.e. kill the command or stop the http api request if it's http you're using
<lgierth>
on the ipfs.io gateway you'll get a 504 response after 30 minutes
<seharder>
I'm trying to document how a file can be removed from IPFS. Is it safe to say that if the file is unpinned and removed from the cache of every daemon that touched it, it will eventually be gone.
espadrine has quit [Ping timeout: 260 seconds]
chris6131 has joined #ipfs
chris613 has quit [Ping timeout: 252 seconds]
<lgierth>
if it's unpinned and gc is run, and given no other node has it, it's gone
grosscol has quit [Quit: Leaving]
<seharder>
Thanks
<lgierth>
the issue you saw with cat still working is a bug in my opinion
<lgierth>
would be good if you could file an issue for that
wak-work has quit [Remote host closed the connection]
<lgierth>
with the additional info we gathered ^
wak-work has joined #ipfs
zombu2 is now known as Anonymous
Anonymous is now known as Guest10669
Guest10669 is now known as zombu2
<seharder>
I will take some time tomorrow and create an issue.
chax has quit [Remote host closed the connection]
kvda has joined #ipfs
chax has joined #ipfs
matoro has quit [Ping timeout: 260 seconds]
<lgierth>
thanks :)
chax has quit [Ping timeout: 260 seconds]
ylp has quit [Ping timeout: 260 seconds]
ylp has joined #ipfs
Aeon has joined #ipfs
anonymuse has quit [Remote host closed the connection]
rgrinberg has joined #ipfs
captain_morgan has quit [Ping timeout: 252 seconds]
herzmeister has quit [Ping timeout: 245 seconds]
shizy has quit [Ping timeout: 244 seconds]
captain_morgan has joined #ipfs
matoro has joined #ipfs
chax has joined #ipfs
herzmeister has joined #ipfs
herzmeister has quit [Client Quit]
herzmeister has joined #ipfs
fleeky__ has joined #ipfs
pfrazee has quit [Remote host closed the connection]
fleeky_ has quit [Ping timeout: 265 seconds]
captain_morgan has quit [Ping timeout: 245 seconds]
bsm117532 has quit [Ping timeout: 256 seconds]
rmorey has joined #ipfs
rgrinberg has quit [Read error: Connection reset by peer]