<mnutt>
I’m looking into implementing a webdav database backend for davros to cache things like etags, are there sandstorm-specific pros and cons between sqlite/mongo/postgres/other?
<mnutt>
I’m guessing memory usage is an important one
bb010g has joined #sandstorm
<asheesh>
mnutt: memory usage; also startup time arguably
<asheesh>
And also arguably complexity for you as the package maintainer.
<mnutt>
ah, those are good points
<asheesh>
Also arguably "Sandstorm may kill the process at any moment" though IMHO we should have a clearer API for that.
<asheesh>
Like apps should get sent a signal or something indicating they can exit() themselves if they want, else in 30 seconds they'll be reaped, or something.
<asheesh>
But anyway, pedantically every app is buggy if it doesn't save state properly in the face of being pkill'd when idle, so if you can be on the safe side of that I'm sure it'd be glorious.
<asheesh>
That's surely doable with any of these tools, but good to be aware of it as a design goal of how you're integrating the DB and the app.
<asheesh>
Also disk usage is one.
<asheesh>
MongoDB used to preallocate lots of space; it doesn't anymore, but it's nice to be aware of what your thing does cost in disk use.
<asheesh>
I think that's all I can think of.
<zarvox>
sqlite has very fast startup, which is great
<zarvox>
(because it's in-process)
<zarvox>
depending on if you're using mongo in a replica set, it may spend two to four seconds twiddling its thumbs electing itself as the master on startup
<zarvox>
postgres will require a baseline of ~30MB per grain for the empty DB, and is also less than trivial to set up and doesn't start up super fast either
<zarvox>
sqlite is my usual recommendation, for simplicity of interface, good enough data storage/indexing, great startup speed, and general unobtrusiveness
<zarvox>
in terms of general well-suitedness-for-Sandstorm, I'd probably rank things sqlite > mongo3 > mongo2/niscu > mysql ~= postgres
<zarvox>
mysql and postgres are annoying because mysql_install_db and initdb (or the equivalent copy from the app's root) take a bit of time to run on grain launch
<mnutt>
zarvox: any thoughts on something like leveldb? I haven’t used it, but the key/value nature seems like it might fit well
heliostatic has quit [Ping timeout: 246 seconds]
jadewang has quit [Remote host closed the connection]
heliostatic has joined #sandstorm
<zarvox>
mnutt: I haven't done anything with leveldb. I guess you could do something that's designed for key-value, but you can also do CREATE TABLE data (key string, value string);
<mnutt>
yeah. in a completely different direction, I wonder if filesystem extended attributes are usable
<zarvox>
the nice thing about SQL is not the query language, it's that you can change your schema without giving up on consistency
<zarvox>
I suggest not using xattrs - that will break your app on certain underlying filesystem implementations
<zarvox>
(we give you ext4 with xattrs on Oasis, but self-hosters can be running who-knows-what)
<mnutt>
good to know
<zarvox>
or if xattrs are disabled as a mount flag
<zarvox>
both of these cases should be rare, but no need to hit them if they can be avoided entirely without too much additional trouble
<zarvox>
:)
dograt has quit [Quit: Quitting]
heliostatic has quit [Ping timeout: 276 seconds]
<mnutt>
right, I totally agree. I’ll be fielding all sorts of unreproducible bug reports :)
jadewang has joined #sandstorm
jadewang has quit [Ping timeout: 265 seconds]
|jemc| has quit [Ping timeout: 240 seconds]
ArcTanSusan has joined #sandstorm
heliostatic has joined #sandstorm
heliostatic has quit [Ping timeout: 272 seconds]
jadewang has joined #sandstorm
jadewang has quit [Ping timeout: 276 seconds]
dograt has joined #sandstorm
kentonv has quit [Ping timeout: 255 seconds]
ArcTanSusan has quit [Quit: ArcTanSusan]
ArcTanSusan has joined #sandstorm
mnutt has quit [Quit: mnutt]
kentonv has joined #sandstorm
kentonv has quit [Ping timeout: 250 seconds]
simonv3 has quit [Quit: Connection closed for inactivity]
heliostatic has joined #sandstorm
heliostatic has quit [Ping timeout: 256 seconds]
xet7 has quit [Quit: Leaving]
pod has left #sandstorm ["WeeChat 1.3"]
ArcTanSusan has quit [Quit: ArcTanSusan]
xet7 has joined #sandstorm
heliostatic has joined #sandstorm
heliostatic has quit [Ping timeout: 260 seconds]
amyers has joined #sandstorm
xet7 has quit [Quit: Leaving]
xet7 has joined #sandstorm
amyers has quit [Remote host closed the connection]
amyers has joined #sandstorm
amyers has quit [Remote host closed the connection]
amyers has joined #sandstorm
amyers has quit [Remote host closed the connection]
amyers has joined #sandstorm
heliostatic has joined #sandstorm
heliostatic has quit [Ping timeout: 240 seconds]
asmyers has joined #sandstorm
amyers has quit [Read error: Connection reset by peer]
asmyers has quit [Remote host closed the connection]
asmyers has joined #sandstorm
heliostatic has joined #sandstorm
heliostatic has quit [Ping timeout: 260 seconds]
tobald has joined #sandstorm
mnutt has joined #sandstorm
asmyers has quit [Remote host closed the connection]
amyers has joined #sandstorm
amyers has quit [Read error: Connection reset by peer]
heliostatic has joined #sandstorm
mnutt has quit [Quit: mnutt]
amyers has joined #sandstorm
mnutt has joined #sandstorm
simonv3 has joined #sandstorm
mnutt has quit [Quit: mnutt]
mnutt has joined #sandstorm
|jemc| has joined #sandstorm
bb010g has quit [Quit: Connection closed for inactivity]
notevil has joined #sandstorm
asmyers has joined #sandstorm
asmyers has quit [Max SendQ exceeded]
asmyers has joined #sandstorm
amyers has quit [Ping timeout: 240 seconds]
asmyers has quit [Remote host closed the connection]
amyers has joined #sandstorm
amyers has quit [Read error: Connection reset by peer]
amyers has joined #sandstorm
mrdomino has quit [Remote host closed the connection]
mrdomino has joined #sandstorm
jadewang has joined #sandstorm
heliostatic has quit [Ping timeout: 260 seconds]
amyers has quit [Read error: Connection reset by peer]
* zarvox
goes and files 30000 issues to get another key number
tobald has quit [Quit: Ex-Chat]
heliostatic has quit [Ping timeout: 246 seconds]
bb010g has quit [Quit: Connection closed for inactivity]
mnutt has joined #sandstorm
notevil has quit [Quit: Leaving]
derf- has quit [Ping timeout: 240 seconds]
rolig has quit [Ping timeout: 240 seconds]
rolig has joined #sandstorm
derf- has joined #sandstorm
<mrdomino>
issue: i'm not 31337 part n
ckocagil has quit [Ping timeout: 250 seconds]
ckocagil has joined #sandstorm
jadewang has quit [Remote host closed the connection]
jadewang has joined #sandstorm
mnutt has quit [Quit: mnutt]
asmyers has joined #sandstorm
amyers has quit [Remote host closed the connection]
<zarvox>
mnutt: I appear to be hitting an issue with davros 0.15.1 wherein I can no longer upload a file through the webui.
<zarvox>
I observe that you're not online right now, but in case you read scrollback, I'm leaving you a note. I'll ping you again later when you're around.