aseriousgogetta has quit [Ping timeout: 255 seconds]
<jfmherokiller[m]>
its the restart page but made to use completely static well hopefully completely static assets
aseriousgogetta has joined #ipfs
<jfmherokiller[m]>
also wow bash.org has alot of data 187833 pages of data it looks like
anewuser has quit [Ping timeout: 240 seconds]
<kode54>
that restart page is lovely
<jfmherokiller[m]>
the only issue with the restart page is ironicly you must completely restart your browser and clear the cache for some of the things to work
<kode54>
MacOS 9 startup froze for a while
fredthomsen has quit [Remote host closed the connection]
<jfmherokiller[m]>
well as far as i can tell my shell i have on some old website might be the only endpoint hosting it
<kode54>
well, ipfs.io is also mirroring it, since you have it alive
anewuser has joined #ipfs
<jfmherokiller[m]>
good to hear because that thing took a whole afternoon of rewriting the html so that it worked staticly
ianopolous has quit [Ping timeout: 240 seconds]
ianopolous has joined #ipfs
<kode54>
looks like patchwork has a nice bug that got worse with the latest release's attempt to fix it
upperdeck has quit [Ping timeout: 248 seconds]
<kode54>
ooh lovely
<kode54>
3.6.5 has a memory leak, recommending 3.6.6
<kode54>
3.6.6 has a locking bug present in all versions, recommends 3.6.5
<kpcyrd>
jfmherokiller: is the data available somewhere?
<jfmherokiller[m]>
also i had to restart the download because some of the files were being messed with because of stupid networking issues so yay 1/187833
<jfmherokiller[m]>
also kpcyrd it might be a good idrea to extract the text so that the website can be repurposed into some static form involving dhtml
<kpcyrd>
you could store the plain text, then copy the css and write some js to insert the text into the website. I'd feel like bash.org, but it'd be way more efficient to store
<kpcyrd>
*it'd
<jfmherokiller[m]>
kpcyrd: ill pass you the hash of the complete set of data once it finishes downloading on my end so you can parse it into a better form
<jfmherokiller[m]>
im stuck on a lowly macbook that chugs when whatching videos so im not even gonna try to parse large amounts of data
anewuser has quit [Quit: anewuser]
}ls{ has quit [Quit: real life interrupt]
Oatmeal has joined #ipfs
chxr has left #ipfs ["WeeChat 1.0.1"]
vindelschtuffen has quit [Remote host closed the connection]
upperdeck has quit [Ping timeout: 240 seconds]
upperdeck has joined #ipfs
Oatmeal has quit [Ping timeout: 240 seconds]
jkilpatr has quit [Ping timeout: 240 seconds]
chriscool has joined #ipfs
igorline has joined #ipfs
jkilpatr has joined #ipfs
ShalokShalom_ has joined #ipfs
ShalokShalom has quit [Ping timeout: 240 seconds]
vindelschtuffen has joined #ipfs
gmoro has quit [Remote host closed the connection]
gmoro has joined #ipfs
rendar has joined #ipfs
srpx has quit [Ping timeout: 260 seconds]
ShalokShalom_ is now known as ShalokShalom
ianopolous has quit [Ping timeout: 248 seconds]
ianopolous has joined #ipfs
chris613 has left #ipfs [#ipfs]
akagetsu01 has joined #ipfs
mildred has joined #ipfs
jkilpatr has quit [Ping timeout: 240 seconds]
mildred has quit [Ping timeout: 240 seconds]
jkilpatr has joined #ipfs
chriscool has quit [Ping timeout: 255 seconds]
chriscool has joined #ipfs
lothar_m has joined #ipfs
Milijus has quit [Remote host closed the connection]
Mateon1 has quit [Remote host closed the connection]
ianopolous has joined #ipfs
jkilpatr has quit [Ping timeout: 276 seconds]
X-Scale has joined #ipfs
X-Scale has left #ipfs [#ipfs]
jkilpatr has joined #ipfs
erictapen has joined #ipfs
erictapen has quit [Ping timeout: 240 seconds]
dimitarvp has joined #ipfs
igorline has quit [Ping timeout: 240 seconds]
mildred has joined #ipfs
Mateon1 has joined #ipfs
Henark[m] has joined #ipfs
saki has joined #ipfs
fredthomsen has joined #ipfs
erictapen has joined #ipfs
blahah has joined #ipfs
robattila256 has joined #ipfs
IlanGodik has joined #ipfs
erictapen has quit [Ping timeout: 248 seconds]
erictapen has joined #ipfs
<voker57>
is there a command to download certain dag to blockstore without outputting its data?
erictapen has quit [Ping timeout: 240 seconds]
<voker57>
(will ipfs refs -r download raw leaves?)
<Kubuxu>
yes
cwahlers has joined #ipfs
jaboja has joined #ipfs
cwahlers_ has quit [Ping timeout: 240 seconds]
Guest16577 has quit [Quit: No Ping reply in 180 seconds.]
Lymkwi has joined #ipfs
Lymkwi is now known as Guest83693
fredthomsen has quit [Remote host closed the connection]
jaboja has quit [Ping timeout: 248 seconds]
jaboja has joined #ipfs
shizy has joined #ipfs
aseriousgogetta has quit [Quit: leaving]
bitbit has joined #ipfs
Milijus has joined #ipfs
jaboja has quit [Ping timeout: 255 seconds]
jaboja has joined #ipfs
ygrek has joined #ipfs
fredthomsen has joined #ipfs
athan has joined #ipfs
shizy has quit [Ping timeout: 248 seconds]
erictapen has joined #ipfs
<SchrodingersScat>
I contest that it doesn't make sense to put an entire line in ()s on irc.
erictapen has quit [Ping timeout: 240 seconds]
jaboja has quit [Ping timeout: 255 seconds]
m0ns00n has quit [Quit: quit]
Encrypt has joined #ipfs
chungy has joined #ipfs
igorline has joined #ipfs
igorline has quit [Ping timeout: 255 seconds]
clownpriest has joined #ipfs
igorline has joined #ipfs
Foxcool has joined #ipfs
jnerula0 is now known as cblgh
chriscool has quit [Ping timeout: 240 seconds]
igorline has quit [Ping timeout: 248 seconds]
saki has quit [Quit: saki]
clownpriest has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
cwahlers_ has joined #ipfs
chriscool has joined #ipfs
cwahlers has quit [Ping timeout: 255 seconds]
stinkrat has joined #ipfs
charley has joined #ipfs
Foxcool has quit [Ping timeout: 255 seconds]
mildred has quit [Ping timeout: 248 seconds]
momo_ has joined #ipfs
<momo_>
hi guys
<SchrodingersScat>
momo_: oh hey
<momo_>
is this the right place to ask questions about ipfs performance?
<SchrodingersScat>
momo_: it is possible
<momo_>
Suppose I would like to do reasonably intensive scientific computation in a web-browser. When I have no database server, ipfs appears to be very simple. Questions:
<momo_>
1) Has anyone tested doing this kind of thing on large datasets?
<momo_>
2) What is the limiting agent preventing myself from dumping petabytes of data into ipfs?
<SchrodingersScat>
2. Generally you have to be able to host the things yourself, although if I joined in whatever computation was happening then my ipfs node would download whatever parts it requests and then I would also be a node in that hypothetical situation.
<SchrodingersScat>
basically you can't force a foreign node to fetch anything, but you can offer things
<SchrodingersScat>
but, say you had an ipfs server with this petabytes of data, hypothetically it would be a good way to divy up the data if not all browser based computations needed the full petabyte(s)
mildred has joined #ipfs
<momo_>
so I can, without malice, use a local ipfs node to dump effectively arbitrary data, and I have access to it anywhere without requiring any additional networking so long as I maintain a single root ipns key?
tilgovi has joined #ipfs
<SchrodingersScat>
that sounds right, so long as you can access ipfs
<momo_>
i'm not seeing how this is free
<momo_>
seems too useful
<SchrodingersScat>
momo_: maybe you're thinking about the gateways then? Because yeah, afaik I could share something on ipfs from my desktop, and then pull it somewhere else, especially with the ipfs gateways. Although I consider the gateways more of a proof of concept convenience for now.
jkilpatr has quit [Remote host closed the connection]
<SchrodingersScat>
er, the public ones, or idk how things would go, maybe there just needs to be many more of them
<momo_>
right, I think that's where my confusion was. The gateways make things especially convenient
<SchrodingersScat>
momo_: and they only hold x amount of data before garbage collect, but very handy as like a proxy.
jkilpatr has joined #ipfs
<SchrodingersScat>
momo_: all the same, you only need one machine on the network hosting the file at any given point and it should be able to propagate quickly if needed.
charley has quit [Remote host closed the connection]
<momo_>
i'll have to do some benchmarking to see what i can achieve. this goes directly at the problem of networked database administration, whereby it becomes very costly to make frequent requests and one has to face tradeoffs in sharing data
charley has joined #ipfs
<SchrodingersScat>
there's definitely a cost :/
<SchrodingersScat>
momo_: and note, idk about question 1, and I have no idea what performance you could expect
<momo_>
i mean, in contrast to traditional database systems
charley has quit [Remote host closed the connection]
charley has joined #ipfs
<momo_>
Basically just need to benchmark many frequent read/write operations. The upper bound on reading will provide intuition towards what applications actually make sense, for now at least
<momo_>
what client-side applications, that is
<SchrodingersScat>
momo_: and people talk about ipfs-js, idk if that helps you or not.
<momo_>
yeah I was just playing around with ipfs-mini
<kpcyrd>
momo_: with petabytes of data, you might run into performance issues when adding it. It might be worth it to patch out some fsync calls if you want to do something like this
<momo_>
right, thanks
tilgovi has quit [Ping timeout: 246 seconds]
<momo_>
thank you too SchrodingersScat
<SchrodingersScat>
welcome, hope it works out for you
<kpcyrd>
momo_: btw, any chance you're the momo from #tk :) ?
<momo_>
nope
rendar has quit [Quit: std::lower_bound + std::less_equal *works* with a vector without duplicates!]
<jfmherokiller[m]>
kpcyrd: im rn pinning the complete contents of that hash to my local node so that i can work on it
ianopolous has joined #ipfs
<jfmherokiller[m]>
also the site i suggest extracting the webpage used to display the quotes as a template
ianopolous has quit [Ping timeout: 240 seconds]
chmanie has quit [Quit: My MacBook has gone to sleep. ZZZzzz…]
chriscool has quit [Ping timeout: 240 seconds]
anewuser has joined #ipfs
erictapen has joined #ipfs
ianopolous has joined #ipfs
erictapen has quit [Ping timeout: 240 seconds]
droman has joined #ipfs
clownpriest has joined #ipfs
chriscool has joined #ipfs
<Noxarivis[m]>
Orbit is fun
<Noxarivis[m]>
Needs more users
dignifiedquire has quit [Quit: Connection closed for inactivity]
upperdeck has quit [Ping timeout: 240 seconds]
upperdeck has joined #ipfs
fredthomsen has quit [Ping timeout: 240 seconds]
chriscool has quit [Ping timeout: 240 seconds]
upperdeck has quit [Ping timeout: 248 seconds]
upperdeck has joined #ipfs
fredthomsen has joined #ipfs
shizy has quit [Ping timeout: 255 seconds]
spacebar_ has joined #ipfs
spacebar_ has quit [Client Quit]
Encrypt has quit [Quit: Quit]
IlanGodik has quit [Quit: Connection closed for inactivity]
larpanet has joined #ipfs
clownpriest has quit [Quit: My Mac has gone to sleep. ZZZzzz…]
jaboja has joined #ipfs
kaotisk has joined #ipfs
mildred has quit [Ping timeout: 255 seconds]
bitbit has quit [Ping timeout: 240 seconds]
spacebar_ has joined #ipfs
larpanet has quit [Ping timeout: 240 seconds]
stech[m] has joined #ipfs
spacebar_ has quit [Client Quit]
_whitelogger has joined #ipfs
Oatmeal has quit [Ping timeout: 240 seconds]
igorline has joined #ipfs
fredthomsen has quit [Remote host closed the connection]
clownpriest has joined #ipfs
igorline has quit [Ping timeout: 255 seconds]
Oatmeal has joined #ipfs
pcctw has quit [Quit: Leaving]
film42424242 has joined #ipfs
<film42424242>
I had a conceptual question that I can't seem to find. How is the merkle dag setup in terms of my file structure. For example, when I lookup a large file, I can check its refs and see each 256KB chunk. But given a Merkle dag is drawn from the "chunk" to the "file" ("root"), how does the "file" know how to locate its "chunks"?
<film42424242>
Or maybe I'm thinking about it wrong?