<Kubuxu>
I love how sites of IPFS are easy to archive
<SchrodingersScat>
^^^
<SchrodingersScat>
we'll never have another imdb debacle
akkad has joined #ipfs
infinity0 has quit [Ping timeout: 240 seconds]
ygrek has joined #ipfs
<WiredDude[m]>
can i have a sample site to archive? from the docs it looks like it would be ipfs add pin <hash> right?
<deltab>
I think it's ipfs pin add, but otherwise right
infinity0 has joined #ipfs
<WiredDude[m]>
so lets say i find a site i think is interesting and would like to archive. https://fauux.neocities.org/ how does one find the hash for the neocities site?
<deltab>
normally it'd be on the profile page, I think; ask kyledrake
<AphelionZ>
The alex jones crew is gonna have a field day with that one
<WiredDude[m]>
it seemed a bit smaller than pinning that 32GB alpha-linux distro. I want to help, but i'm just starting out here with IPFS and don't have that much space free on my little macbook air :)
infinity0 has quit [Ping timeout: 255 seconds]
infinity0 has joined #ipfs
<AphelionZ>
Its all good, im mostly joking
<AphelionZ>
Every now and again somebody will come through here and post conspiracy theory videos and / or call everbody pedos
<WiredDude[m]>
i wish there was an easy way to find a cause, or a site you felt you wants to help preserve and then just pin it.
<AphelionZ>
And yeah not to get political but thats def a worthy cause
[1]MikeFair has joined #ipfs
<Rad[m]>
Storing it locally is of course sometimes nontrivial. If you are going to do this for a lot of sites heritrix (archive.org's crawler) or somesuch might help.
<Rad[m]>
Many of these -heritix included- aren't easy to operate.
MikeFair has quit [Ping timeout: 268 seconds]
[1]MikeFair is now known as MikeFair
<AphelionZ>
Not sure what else to do if the data arent in ipfs already
<WiredDude[m]>
just used wget locally. it's a start.
<WiredDude[m]>
will look at the aersome-* repos. tried the first one, but the binary for osx wget must have slightly different nomenclature than for linux
Guest162792[m] has joined #ipfs
zabirauf has quit [Remote host closed the connection]
dignifiedquire has quit [Quit: Connection closed for inactivity]
zabirauf has joined #ipfs
aquentson1 has quit [Ping timeout: 260 seconds]
zabirauf has quit [Ping timeout: 268 seconds]
zabirauf has joined #ipfs
zsck has joined #ipfs
<WiredDude[m]>
ok, made a quick edit to the script for an outdated version of wget my system had. now the runs.sh script worked great!
<WiredDude[m]>
so for my earlier experiment cloning the GlobalWarming wikipedia entry and add/pinning it (https://ipfs.io/ipfs/QmcAK21rzpqfGqWebgm4ED9BeS3SfcgZEWphnrGfLVPBnp/) shut down my daemon and the localhost URL obviously fails. However I was surprised that the ipfs.io URL persisted. How did that happen? Did someone on this chat also pin it or are there other automated replication things at play?
<jbenet>
the gateway is an ipfs node-- probably has it for a while
<WiredDude[m]>
so not archived permanently, I'd need to start up my daemon to keep it going until I can get my peers to also pin it, in otherwords?
<deltab>
others could fetch it from the gateway while it's cached there, right?
<WiredDude[m]>
yes i suppose so. how long would it be cached at the gateway?
<deltab>
if it's popular enough, it could stay available in the network even without being pinned
<WiredDude[m]>
but not 30 years
<deltab>
but I suspect there isn't much yet with the critical mass to do that
dimitarvp has quit [Quit: Bye]
<AphelionZ>
I got a versioning UI "working"
<AphelionZ>
forward and backwards history
Mateon1 has quit [Read error: Connection reset by peer]
chris613 has quit [Quit: Leaving.]
gmcabrita has quit [Quit: Connection closed for inactivity]
appa has quit [Quit: WeeChat 0.4.2]
g0d355__ has joined #ipfs
antiantonym has joined #ipfs
appa has joined #ipfs
jedahan has joined #ipfs
Aranjedeath has quit [Quit: Three sheets to the wind]
<jbenet>
AphelionZ nice! could i check it out?
steefmin[m] has joined #ipfs
<lidel>
AphelionZ, Buffer is used by both, in browser bundle of js-ipfs-api it is exposed as window.IpfsApi().Buffer
realisation has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
tmg has quit [Ping timeout: 240 seconds]
kekrunnr_ has joined #ipfs
jedahan has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
aquentson has joined #ipfs
wkennington has joined #ipfs
Mateon1 has joined #ipfs
matoro has quit [Ping timeout: 240 seconds]
wallacoloo_____ has joined #ipfs
lothar_m has quit [Quit: WeeChat 1.7-dev]
matoro has joined #ipfs
vandemar has quit [Read error: Connection reset by peer]
vandemar has joined #ipfs
vandemar has joined #ipfs
vandemar has quit [Changing host]
ylp has quit [Ping timeout: 255 seconds]
spilotro has quit [Read error: Connection reset by peer]
ylp has joined #ipfs
Foxcool has joined #ipfs
wireddude_ has joined #ipfs
wireddude_ has quit [Remote host closed the connection]
wkennington has quit [Read error: Connection reset by peer]
ygrek has quit [Ping timeout: 268 seconds]
wkennington has joined #ipfs
erde74 has joined #ipfs
maxlath has joined #ipfs
minibar[m] has quit [Ping timeout: 240 seconds]
minibar[m] has joined #ipfs
s_kunk has quit [Ping timeout: 240 seconds]
mildred has joined #ipfs
mildred4 has quit [Ping timeout: 240 seconds]
BreakIt_ has joined #ipfs
mildred1 has joined #ipfs
mildred has quit [Ping timeout: 268 seconds]
<BreakIt_>
Ok, so I made this yesterday. Simple script to check a domain with ipfs dns, search local repo and if not found as pinned ask for pinning or not.
<BreakIt_>
My coding skills are "google-it-trial-and-error" level. ;)
ylp1 has joined #ipfs
zabirauf_ has quit [Remote host closed the connection]
zabirauf has joined #ipfs
gully-foyle has quit [Remote host closed the connection]
s_kunk has joined #ipfs
ylp1 has quit [Ping timeout: 252 seconds]
zabirauf has quit [Ping timeout: 260 seconds]
zabirauf has joined #ipfs
mildred2 has joined #ipfs
ianopolous has quit [Ping timeout: 260 seconds]
zabirauf has quit [Ping timeout: 240 seconds]
mildred1 has quit [Ping timeout: 260 seconds]
kenshyx has joined #ipfs
mildred3 has joined #ipfs
mildred2 has quit [Ping timeout: 260 seconds]
zabirauf has joined #ipfs
ecloud has quit [Ping timeout: 240 seconds]
zabirauf has quit [Ping timeout: 268 seconds]
kthnnlg has joined #ipfs
<Mateon1>
BreakIt_: I think that's everybody's skill level :) Try things until they break, then RTFM
<Mateon1>
That's a nice script, but won't detect if a site is pinned indirect
ecloud has joined #ipfs
M-liberdiko has joined #ipfs
Foxcool has quit [Ping timeout: 260 seconds]
rcat has joined #ipfs
aquentson has quit [Ping timeout: 260 seconds]
Arwalk has quit [Ping timeout: 240 seconds]
Arwalk has joined #ipfs
mildred4 has joined #ipfs
cemerick has joined #ipfs
mildred has joined #ipfs
mildred3 has quit [Ping timeout: 264 seconds]
tmg has joined #ipfs
mildred4 has quit [Ping timeout: 252 seconds]
wallacoloo_____ has quit [Quit: wallacoloo_____]
cemerick has quit [Ping timeout: 260 seconds]
cemerick has joined #ipfs
pcre has joined #ipfs
aquentson has joined #ipfs
robogoat has quit [Ping timeout: 260 seconds]
espadrine has joined #ipfs
<Mateon1>
BreakIt_: After a bunch of messing around, you can remove the bash magic in the script entirely. Just do: if ipfs pin ls $hash > /dev/null; then (hash is pinned); else (not pinned, or IPFS errored); fi
<BreakIt_>
Mateon1: Nice, Thanksgiving
<Mateon1>
Oh, actually, that doesn't check if it's pinned direct or indirect, a small change might fix it
erde74 has quit [Ping timeout: 240 seconds]
<BreakIt_>
Mateon1: Damn. Writing on a phone. I meant thanks!
<Mateon1>
if ipfs --enc=json pin ls QmUNLLsPACCz1vLxQVkXqqLX5R1X345qqfHbsf67hvA3Nn | jq -e '.Keys[].Type | . == "recursive" or . == "direct"' > NUL; then ...; else ...; fi
<Mateon1>
BreakIt_: ^
<Mateon1>
Uh, sorry, not direct but indirect
A124 has joined #ipfs
palkeo has joined #ipfs
mildred has quit [Ping timeout: 240 seconds]
mildred has joined #ipfs
muvlon has joined #ipfs
BreakIt_ has quit [Read error: Connection reset by peer]
BreakIt_ has joined #ipfs
erde74 has joined #ipfs
palkeo has quit [Ping timeout: 268 seconds]
palkeo has joined #ipfs
palkeo has joined #ipfs
palkeo has quit [Changing host]
gmcabrita has joined #ipfs
palkeo has quit [Ping timeout: 260 seconds]
kenshyx has quit [Quit: Leaving]
jkilpatr has quit [Ping timeout: 240 seconds]
BreakIt_ has quit [Quit: Bye]
palkeo has joined #ipfs
palkeo has joined #ipfs
palkeo has quit [Changing host]
ShalokShalom has joined #ipfs
<apiarian>
how is ipfs development funded? (was listening to the opencollective changelog account, didn't find ipfs on the opencollective website, am now wondering)
wkennington has quit [Read error: Connection reset by peer]
<BreakIt>
Mateon1: Thnx for that last post! Will try that.
<Mateon1>
Also, not NUL but /dev/null... the joys of working on a Windows-linux frankenstein's monster and ripping commands between CMD and bash
<Kubuxu>
apiarian: it does soft kill and waits for daemon to exit
<apiarian>
so the soft kill isn't working?
<Kubuxu>
there should be hard kill added after some time
ckwaldon has joined #ipfs
<Kubuxu>
yeah, softkill might not kill the daemon always :|
<apiarian>
weird thing is that this used to work, and it does seem to work from the command line, but not from my test harness.
<Kubuxu>
yeah, daemon might sometimes hang, do you have 100% reproduction?
<apiarian>
so it would seem
<apiarian>
every time i run go test, i get passing tests and hanging kill
<apiarian>
hmm, it's only one of the daemons that's hanging. i've got 2 set up in a star, and one is hanging while the other seems to get killed correctly
<Kubuxu>
have you updated IPTB
<Kubuxu>
we have fixed something like that recently
<apiarian>
added a third to the star, the first gets killed, the other two hang around
<apiarian>
yup, just pulled master
<apiarian>
i can reliably kill them with a SIGKILL. will try to work that into a PR if you don't mind
<Kubuxu>
Yeah, but we want to give them time to clean up.
<Kubuxu>
So SIGINT, poll every 10ms for clean exit, after 5s SIGKILL
Foxcool has joined #ipfs
<AphelionZ>
dignifiedquire: can you help me with browser peering at some point today?
<dignifiedquire>
hey AphelionZ, sure thing just leave your questions here and I will try and get you answers
step21 has quit [Ping timeout: 256 seconds]
<AphelionZ>
Ok cool. Really its just "how???" But ill try to be more detailed. Id like to use the knowledge to create a nice user friendly workflow
step21_ has joined #ipfs
rabbitface3 has quit [Ping timeout: 256 seconds]
step21_ is now known as step21
stoopkid has joined #ipfs
BreakIt has quit [Remote host closed the connection]
<Kubuxu>
apiarian: aah, I've forgot, send second SIGKILL (this is still softkill but it will be handled differently), and maybe after next 10s send SIGINT, this will be hardkill
mildred4 has joined #ipfs
<Kubuxu>
so, SIGKILL, poll 5s, SIGKILL, poll 10s, SIGINT
<gruu>
i made a shared folder with some Linux isos, mostly thanks to VictorBjelkholm who shared alot of Alpine-linux files and on top of that I added some more distros/files. Feel free to download/pin.
tabrath has quit [Read error: Connection reset by peer]
tmg has quit [Ping timeout: 260 seconds]
<gruu>
And as always. If you for some reason decide to use any of these files for installation, please verify the checksums of the file/files with the original developer.
ShalokShalom has quit [Remote host closed the connection]
dj_fitymahurok is now known as Iulzbot
Iulzbot is now known as I_ulzbot
I_ulzbot is now known as vapid
phorse` has joined #ipfs
aquentson has quit [Ping timeout: 264 seconds]
pfrazee has joined #ipfs
aquentson has joined #ipfs
<kenshyx>
hello, running `~/Downloads/ipfs daemon --migrate` fails to find ipfs executable `failed to resolve go-ipfs: exec: "ipfs": executable file not found in $PATH`
<Kubuxu>
you need to have ipfs installed in path
<kenshyx>
should I open an issue with this?
<Kubuxu>
`which ipfs` has to return path to ipfs
<Kubuxu>
but IDK why it is a limitation
<kenshyx>
I tried to set it from process.env.PATH
<kenshyx>
still doesnt respect
<Kubuxu>
not sure
realisation has joined #ipfs
<afdudley[m]1>
kenshyx: why are you running from the downloads dir? are you running from the command line or from inside something else?
<kenshyx>
this is just an example, I start ipfs from electron process
<kenshyx>
as a child process
<afdudley[m]1>
so when you set the path explicitly, does that work?
<kenshyx>
when I specify full path to ipfs executable it doesn't work
ashark has joined #ipfs
realisation has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
chris613 has joined #ipfs
gmoro has joined #ipfs
realisation has joined #ipfs
aquentson has quit [Ping timeout: 264 seconds]
aquentson has joined #ipfs
realisation has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
pfrazee has quit [Ping timeout: 240 seconds]
realisation has joined #ipfs
erde74 has quit [Ping timeout: 240 seconds]
pfrazee has joined #ipfs
<afdudley[m]1>
What's the error then?
<afdudley[m]1>
can you execute the file via the full path, from the command line?
ylp1 has joined #ipfs
shizy has joined #ipfs
ylp1 has quit [Ping timeout: 264 seconds]
BreakIt has quit [Ping timeout: 240 seconds]
BreakIt has joined #ipfs
jadddd has joined #ipfs
<noffle>
dignifiedquire: thanks for thinking of me
jadddd has quit [Quit: Page closed]
zabirauf_ has joined #ipfs
BreakIt has quit [Ping timeout: 240 seconds]
lohkey has quit [Ping timeout: 240 seconds]
lohkey has joined #ipfs
nu11p7r has joined #ipfs
ylp has left #ipfs [#ipfs]
matoro has quit [Ping timeout: 260 seconds]
Foxcool has quit [Ping timeout: 260 seconds]
maciejh has joined #ipfs
erde74 has joined #ipfs
robogoat has joined #ipfs
aquentson1 has joined #ipfs
aquentson has quit [Ping timeout: 260 seconds]
maciejh has quit [Ping timeout: 260 seconds]
matoro has joined #ipfs
espadrine has quit [Ping timeout: 260 seconds]
maciejh has joined #ipfs
zabirauf_ has quit [Ping timeout: 255 seconds]
<AphelionZ>
ok, im setting up my first cloud node
<AphelionZ>
i created an EC2 nano instance, attached a 30GB EBS volume to it
<AphelionZ>
mounted said volume at ~/ipfs
<AphelionZ>
should I set my IPFS_PATH to ~/ipfs and init my repo there?
<dignifiedquire>
AphelionZ: yes
<AphelionZ>
I basically want to give that 30GB up for ipfs, and be able to expand it later with EBS
<AphelionZ>
ok cool
<dignifiedquire>
just make sure IPFS_PATH is set when running `daemon` and `init`
sprint-helper has joined #ipfs
<AphelionZ>
and is there a proper process to "daemonize" the daemon
<AphelionZ>
you know what i mean
<AphelionZ>
like as a startup task, etc
<richardlitt>
Huh. Why did sprinthelper fail.
<richardlitt>
lgierth: where is the log again?
<richardlitt>
Found it.
<dignifiedquire>
AphelionZ: not sure if there is a template somewhere, but should be pretty simple to write a systemd definition that runs `IPFS_PATH=mypath ipfs daemon`
<AphelionZ>
ok cool, I'll look into that
<AphelionZ>
running screen now :p
<AphelionZ>
dignifiedquire: now I just need to know how I can point my browser node at this cloud go node and start peering
<dignifiedquire>
also I'm not sure what nano instances provide in terms of ram, but you should have > 512Mb or ideally 1024 to be sure if you want a long running instance
<AphelionZ>
hehe its 512 but so far so good
<AphelionZ>
i'll play it by ear. i can scale these up and down as needed
<dignifiedquire>
as long as you enable it in systemd that it restarts when it crashes you should be fine then :)
<gruu>
Trying to do a wget of ftp://ftp.sunet.se/mirror/ubuntu-releases/ to mirror it into ipfs but I can't seem to get it to download the folders named 12.04, 12.04.5 etc, anyone out there with some tips?
<dignifiedquire>
now you need to add the ws address, so that you can connect from the browser
<dignifiedquire>
and then make sure that the ports are open to the internetzs
<dignifiedquire>
and then you will want to swarm.connect in your js-ipfs browser node to /ip4/<public-ip-of-aws-node>/tcp/<port>/ipfs/<id of the aws-node>
<AphelionZ>
seems.... reasonable
<dignifiedquire>
:D
<dignifiedquire>
this setup is a bit alpha at this point :D
<dignifiedquire>
we only got it to work for the first time on friday
<dignifiedquire>
ah also you need to run go-ipfs@0.4.6-rc.1
<dignifiedquire>
0.4.5 has outdated multiplex code
<kevina>
I am thinking it is worth the effort to push a per-add option through
<kevina>
for now at least, changing to CidV1 everywhere is likely to break things and in general just cause problems
<kevina>
whyrusleeping: thoughts?
<kevina>
pushing through CidV1 is going to take a lot of work
<kevina>
Kubuxu (and anyone else): thoughts?
tmg has joined #ipfs
<Kubuxu>
that is true, and I don't think we should pressure it yet
<Kubuxu>
it doesn't block us anywhere, does it?
<kevina>
Kubuxu: don't know, waiting for whyrusleeping feedback
<whyrusleeping>
kevina: what Kubuxu is saying is that this doesnt *need* to be done immediately
<whyrusleeping>
its not blocking any of the other work we're doing
<Kubuxu>
what this means is that we can carefully create list of tasks that need to be done for it to work
<Kubuxu>
in this list of task there for sure be some tasks that could be beneficial right away
BreakIt has quit [Quit: Konversation terminated!]
Caterpillar has quit [Quit: You were not made to live as brutes, but to follow virtue and knowledge.]
<kevina>
whyrusleeping: okay, so I can probably push through a per-add option in a day or two if we want this
<kevina>
a global option is going to take some more planning
<AphelionZ>
lgierth: thanks!
<whyrusleeping>
kevina: alright, write out your planned approach in the issue before starting
<kevina>
whyrusleeping: there is really now plan, just push through an option to make it work
cxl000 has quit [Quit: Leaving]
<kevina>
whyrusleeping: I can create a RFC p.r.
<kevina>
whyrusleeping: and if it ends up being too much work I can abadon it
<AphelionZ>
lgierth: I fixed the dial error and now i'm just trying to move content between the browser node and my cloud go node
<whyrusleeping>
I'd just like a small comment about what bits of code will be changed how. Doesnt have to be very long or super detailed, just a description of the wiring
<kevina>
whyrusleeping: I won't know until I try
<Kubuxu>
kevina: I have moved a lot of unmerged branches to go-ipfs-archived, including some of yours. Telling you just in case you would be looking for that code.
<Kubuxu>
I moved branches that were older than a month.
<whyrusleeping>
kevina: i would appreciate it being thought out before attempting a PR
<kevina>
whyrusleeping: a p.r. will be my attempt at thinking it out
<kevina>
Kubuxu: okay thanks for letting me know
<whyrusleeping>
a PR takes me significantly longer to review than a design description comment
<whyrusleeping>
If i have to review a PR, say it needs to be different, then review a very different PR, thats a large time expenditure
<kevina>
whyrusleeping: well I need to write the code before I can do a design description
<AphelionZ>
dignifiedquire: ok got that in... should I expect it to immediately connect and start peering with my bootstrap nodes? It seems I have to connnect manually
pfrazee has quit [Remote host closed the connection]
<mildred1>
hi
mildred1 is now known as mildred
<AphelionZ>
You know what i still need to upgrade to 0.22
<AphelionZ>
Lemme do that first
<mildred>
is there a reason why bootstrap of Host is in go-ipfs/core and not in go-libp2p/p2p/host?
<mildred>
bootstrap of routing is in libp2p-kad-dht...
jkilpatr has joined #ipfs
<AphelionZ>
Hi mildred
<lgierth>
mildred: i don't have a precise answer, but part of it is that bootstrap is a discovery mechanism, not a routing mechanism
<mildred>
I meant, the bootstrapping process for the dht is in the dht package
<mildred>
why isn't the bootstrapping process for the host is not in the host package?
<mildred>
bootstrapping the host is a generic process that could live in the libp2p package
espadrine has quit [Ping timeout: 240 seconds]
<mildred>
the reason I'm asking is that I am rebuilding the complete ipfs stack to use as a library with a simple API
<mildred>
and I need to bootstrap my node
<lgierth>
ah that sounds super interesting
<lgierth>
i'm a bit interested in that too because i've been (slowly) working on adopting the core api in go-ipfs too
<mildred>
but I can't depend on core which is tied too much with the go-ipfs program
<lgierth>
yup core is very big
<lgierth>
i'm not entirely sure what the history of that is
<lgierth>
and gotta prep for a presentation tomorrow