00:08
icco has quit [Read error: Operation timed out]
00:10
icco has joined #rubygems
00:12
ZachBeta has quit [Quit: Computer has gone to sleep.]
00:16
pib1978 has quit [Remote host closed the connection]
00:22
icco has quit [Read error: Operation timed out]
00:25
icco has joined #rubygems
00:34
jcaudle has quit [Quit: jcaudle]
00:35
nz_ has joined #rubygems
00:35
icco has quit [Read error: Operation timed out]
00:39
icco has joined #rubygems
00:39
<
qrush >
I forgot how to deploy again
00:40
<
qrush >
is cap rubygems.org chef:app still it?
00:40
<
qrush >
from rubygems-aws?
00:40
<
qrush >
vertis: samkottler evan yo
00:40
<
evan >
yeah, thats fine.
00:41
<
qrush >
its very unnerving we have to use chef to deploy :/
00:41
<
vertis >
qrush, it does feel like that a bit when you first start
00:42
<
vertis >
but you get used to it
00:42
<
vertis >
I've not found it any more prone to problems than capistrano
00:42
<
vertis >
and in fact it handles idempotence(?) somewhat better
00:43
<
qrush >
can we get a .ruby-version in that repo?
00:43
<
qrush >
i dont know what you guys are using. 1.9.3? 2.0?
00:43
<
qrush >
running deploy
00:44
<
qrush >
/Users/qrush/.rbenv/versions/1.9.3-p327/lib/ruby/gems/1.9.1/gems/librarian-0.0.26/lib/librarian/action/persist_resolution_mixin.rb:11:in `persist_resolution': undefined method `correct?' for nil:NilClass (NoMethodError)
00:44
<
qrush >
got that but i think it's uploading chef.tar.gz
00:44
snooc has joined #rubygems
00:45
<
qrush >
seems to be taking a long time
00:45
<
qrush >
for this upload...
00:45
<
vertis >
you should see from Australia
00:46
<
vertis >
did you guys end up getting pagerduty or whatever sorted out?
00:48
<
qrush >
wow the site is really hanging
00:48
* qrush
pokes the site nervously, wtf
00:48
<
qrush >
does this not do a rolling restart? :(
00:48
<
samkottler >
qrush: hey
00:49
<
samkottler >
qrush: nope
00:49
<
qrush >
ok we're down because i deployed, wtf
00:49
<
samkottler >
it takes about 30 seconds to bounce right now
00:49
<
qrush >
please halp :(
00:49
<
samkottler >
it'll come back, it's a waiting game
00:49
<
samkottler >
gem installs still work
00:49
<
qrush >
504 Gateway Time-out
00:50
<
qrush >
it was never this bad on the old setup. are we still using passenger?
00:50
<
samkottler >
no, it unicorn
00:50
<
qrush >
can we start looking into if it's coming back or we need to roll back?
00:50
* samkottler
starts digging in
00:51
<
qrush >
now it's just a 500 error
00:52
icco has quit [Read error: Operation timed out]
00:52
<
qrush >
there is nothing in less -R log/production.log
00:53
<
qrush >
rails production console works
00:53
<
vertis >
it shouldn't take any time at all to come right
00:53
<
vertis >
after a deploy
00:53
<
samkottler >
yeah it should be back now
00:53
<
vertis >
it should be a rolling restart
00:53
<
qrush >
Can we roll back please?
00:53
<
qrush >
I don't know how to do that with chef
00:54
icco has joined #rubygems
00:54
dvu has joined #rubygems
00:55
<
vertis >
samkottler, correct me if I'm wrong, but a rollback is just deploying from an older tag/commitsha
00:55
<
samkottler >
and yet again, deploying with chef is a horrible idea
00:55
<
qrush >
this is a fucking mess
00:56
<
qrush >
we need to find out why unicorn is broken
00:56
<
qrush >
or how to roll back
00:56
<
qrush >
where are the unicorn logs?
00:56
<
samkottler >
I'm stracing the unicorn master and it's just cycling over and over
00:57
<
qrush >
Can we just do a full restart?
00:57
<
samkottler >
I just restarted the service
00:57
ZachBeta has joined #rubygems
00:58
<
samkottler >
we're back
00:58
<
vertis >
i'm a bit annoyed it was switched unicorn to be honest.
00:58
<
vertis >
not because I don't love unicorn
00:58
<
vertis >
but because we discussed not changing anything
00:58
<
qrush >
where are the logs for unicorn?
00:58
<
qrush >
that did it
00:58
<
qrush >
and it's deployed correctly
00:59
<
vertis >
logs for unicorn are configured in something like config/unicorn.rb…let me just check
00:59
<
qrush >
phew. thanks samkottler
01:00
<
vertis >
… /etc/unicorn/...
01:00
<
qrush >
ok added a card to figure out the roll back
01:00
<
qrush >
and another to get to the bottom of this
01:01
<
samkottler >
qrush: there should just a be a "rip out chef from the deployment process" ticket
01:01
<
samkottler >
because there is
*no* reason for the app devs to need to know about chef to deploy
01:01
<
vertis >
this is not chef's fault
01:02
<
samkottler >
agreed, but it's just a horrible deployment system and adds confusion
01:02
<
qrush >
i think `cap production deploy` from the rubygems.org repo should work
01:02
<
vertis >
if you want a better deployment mechanism we should package everything as rpms
01:02
<
samkottler >
vertis: and we switched to unicorn kind of naively, it wasn't really on purpose, it was just what phil was using
01:03
<
vertis >
samkottler, not pointing fingers
01:03
<
qrush >
we are definitely not packagin stuff as rpms :)
01:03
<
vertis >
we probably should have rectified that rather than moving forward
01:03
<
qrush >
I just want `cap production deploy` to work
01:03
<
qrush >
same with `cap staging deploy`
01:03
<
qrush >
and cap production deploy:rollback
01:03
<
samkottler >
vertis: I'm just pointing out why it happened ;)
01:03
<
qrush >
and deploy:full_restart
01:03
<
samkottler >
qrush: WHY NOT
01:03
<
qrush >
Let's keep the discussion civil please :)
01:04
<
vertis >
packaging everything as rpms works quite well
01:04
<
vertis >
can't get simpler than yum install rubygems
01:04
<
qrush >
added some other notes on the cards
01:04
<
qrush >
vertis: samkottler can you please investigate why this happened? would be nice to do a writeup
01:04
<
qrush >
i can publish it if you can find out why
01:04
<
samkottler >
qrush: I can write another post-mortem ;)
01:04
<
qrush >
samkottler: if you're feeling up to it i'd appreciate it
01:04
icco has quit [Read error: Operation timed out]
01:05
<
vertis >
in any case, I can make capistrano work properly on the weekend
01:05
<
qrush >
samkottler: what did you run in case we need to do that again?
01:05
<
samkottler >
vertis: cool, I can't this weekend but I'm down to pair any other weekend
01:05
dvu has quit [Ping timeout: 264 seconds]
01:05
<
samkottler >
qrush: just /etc/init.d/rubygems restart
01:06
<
pipework >
qrush: service rubygems fuckoff-already
01:06
<
qrush >
i need to run. adios and thanks
01:07
<
samkottler >
qrush: later, have a nice night
01:08
mockra has quit [Remote host closed the connection]
01:09
<
vertis >
qrush, will talk to you on the weekend
01:09
icco has joined #rubygems
01:09
<
vertis >
so we can try capistrano in staging then prod
01:11
<
samkottler >
we need to add preload_app to the unicorn config
01:11
<
samkottler >
and add some COW support
01:12
<
vertis >
that'd do it
01:13
<
samkottler >
alright let me clean up this config
01:13
<
samkottler >
I'm insanely busy this week :(
01:14
<
vertis >
you're changing the unicorn config?
01:15
<
samkottler >
I need food bbiab
01:21
icco has quit [Read error: Operation timed out]
01:23
markalanevans has quit [Ping timeout: 246 seconds]
01:23
icco has joined #rubygems
01:23
pipework has quit [Remote host closed the connection]
01:26
lsegal has joined #rubygems
01:26
mando has joined #rubygems
01:27
DonOtreply has quit []
01:30
tarcieri has joined #rubygems
01:30
<
tarcieri >
umm, how exactly are you guys terminating TLS?
01:31
<
tarcieri >
because it doesn't seem to be working very well ;)
01:31
<
tarcieri >
also: I like crypto!
01:32
<
tarcieri >
also: unless you're hardened against Lucky13, you should probably be using RC4 instead of AES-CBC
01:32
<
tarcieri >
especially important for TLS 1.0 clients
01:32
<
tarcieri >
(who are vulnerable to BEAST)
01:35
icco has quit [Read error: Operation timed out]
01:38
icco has joined #rubygems
01:42
<
dwradcliffe >
tarcieri: there are about a thousand opinions on the best way to handle the ciphers :)
01:43
<
tarcieri >
dwradcliffe: I would go with Adam Langely's opinion
01:43
<
tarcieri >
and Matt Green's
01:43
<
tarcieri >
and Marsh Ray's
01:43
<
tarcieri >
and they all more or less agree
01:46
<
dwradcliffe >
tarcieri: our config is all on github. feel free to take a look and propose a change
01:47
<
tarcieri >
dwradcliffe: what's the actual termination done with?
01:47
<
tarcieri >
and can you perhaps give me a URL to the config?
01:50
<
tarcieri >
o_O !ECDH
01:50
icco has quit [Read error: Operation timed out]
01:52
<
tarcieri >
dwradcliffe: I've had a lot of build failures on Travis due to TLS-related problems/timeouts/etc
01:52
<
tarcieri >
and a lot of problems locally too
01:52
<
tarcieri >
perhaps stud would be a better choice than nginx?
01:52
icco has joined #rubygems
01:57
<
dwradcliffe >
tarcieri: I hadn't heard of stud before. We're probably not going to make that jump anytime soon.
01:59
<
dwradcliffe >
looks interesting though. I'll have to try it out sometime
01:59
<
tarcieri >
FWIW it's not terribly difficult to deploy. stud would handle the TLS termination and pass the request to nginx in plaintext via local loopback
02:00
<
tarcieri >
so basically all you have to do is tell nginx not to listen on 443 and have stud listen there instead
02:00
<
dwradcliffe >
yeah the idea is pretty simple
02:01
<
dwradcliffe >
plenty of sites are using nginx with no problems though
02:01
crandquist has quit [Ping timeout: 245 seconds]
02:03
<
tarcieri >
I would not say rubygems is in no problems territory
02:04
mando has quit [Remote host closed the connection]
02:05
icco has quit [Ping timeout: 252 seconds]
02:05
wolfeidau has quit [Remote host closed the connection]
02:07
icco has joined #rubygems
02:19
icco has quit [Read error: Operation timed out]
02:21
icco has joined #rubygems
02:24
chimmy has joined #rubygems
02:27
baburdick has joined #rubygems
02:33
icco has quit [Read error: Operation timed out]
02:34
snooc has joined #rubygems
02:35
icco has joined #rubygems
02:39
sbeam has quit [Remote host closed the connection]
02:47
icco has quit [Read error: Operation timed out]
02:50
icco has joined #rubygems
02:50
pipework has joined #rubygems
03:01
icco has quit [Read error: Operation timed out]
03:02
dvu has joined #rubygems
03:04
icco has joined #rubygems
03:05
<
samkottler >
tarcieri: we should tune the SSL config for sure
03:05
<
samkottler >
I'm not sure stud vs. nginx would yield any performance improvement, though
03:06
<
tarcieri >
I was trying to find some of the build failures
03:07
<
tarcieri >
I've personally had a lot of issues with RubyGems TLS
03:07
<
tarcieri >
handshake failures, timeouts, etc
03:07
<
samkottler >
I've used stud before and frankly it performs like shit with a high number of concurrent connections
03:08
<
tarcieri >
well I guess ymmv, heh
03:08
<
tarcieri >
about all I can say is that RubyGems TLS is presently not very reliable
03:09
<
samkottler >
tarcieri: I wouldn't disagree
03:09
<
tarcieri >
I'm a bit confused as to how AES-CBC is being selected as well
03:11
<
indirect >
stunnel is pretty nice if your openssl version is thread-safe… but I don't think it's significantly more performant than nginx
03:11
<
indirect >
I tried to use stunnel for a while until some rogue clients revealed that my openssl was not thread-safe, and wound up just using nginx to haproxy back to nginx in the end
03:12
<
tarcieri >
maybe I should ask Adam Langley ;)
03:12
<
indirect >
but I had to configure nginx pretty damn specifically to get SSL performance similar to stud and stunnel
03:12
dvu has quit [Ping timeout: 264 seconds]
03:12
<
samkottler >
well performance and reliability are two different things :)
03:13
<
samkottler >
we have a reliability problem, probably (haven't profiled) a performance one
03:13
<
samkottler >
probably not**
03:13
<
tarcieri >
I'm entirely concerned with reliability
03:13
<
tarcieri >
it's pretty annoying to have build failures on Travis because bundler can't talk to RubyGems
03:14
<
indirect >
that's pretty bad
03:14
ZachBeta has quit [Quit: Computer has gone to sleep.]
03:14
<
samkottler >
tarcieri: I should talk to mathias about that, because they are wasting a shitload of bandwidth by not running a mirror
03:15
<
tarcieri >
seems good
03:15
<
tarcieri >
"someone told me to just shut off certificate validation! seems good?" o_O
03:16
<
indirect >
samkottler: honestly it seems like they should build a VMRACO>Gpneou
03:16
icco has quit [Read error: Operation timed out]
03:16
<
indirect >
...dammit
03:16
<
tarcieri >
my deadbolt keeps jamming, so someone told me to just take my deadbolt off my door
03:16
<
indirect >
they should build a VM with a local copy of rubygems on it and update it once a day or something
03:17
<
indirect >
tarcieri: oh man his gemrc has been preserved since 2007 or so
03:17
<
indirect >
bulk_threshhold!
03:17
<
indirect >
gems.rubyforge.org!
03:17
<
indirect >
that's amazing
03:17
<
samkottler >
indirect: exactly - or even more simply, just setup a S3 bucket
03:17
<
samkottler >
hackin' on his g3 or some shit
03:18
<
indirect >
samkottler: TiBooks forever?
03:19
icco has joined #rubygems
03:19
<
samkottler >
haha I think that was the first laptop I ever personally owned
03:20
<
samkottler >
indirect: there was something I meant to ask you earlier today, but it's totally slipped my mind now
03:21
* samkottler
will hopefully remember it
03:22
<
indirect >
haha no worries
03:22
<
indirect >
feel free to bug me once you remember
03:22
<
indirect >
or just email me
03:22
* samkottler
is heading to sleep
03:22
<
samkottler >
tarcieri++ indirect++
03:25
<
tarcieri >
I asked Adam Langley, fwiw
03:25
<
tarcieri >
we'll see if he responds
03:27
mockra has joined #rubygems
03:32
icco has quit [Ping timeout: 252 seconds]
03:33
icco has joined #rubygems
03:36
ZachBeta has joined #rubygems
03:40
crandquist has joined #rubygems
03:41
reset has quit [Ping timeout: 272 seconds]
03:46
icco has quit [Read error: Operation timed out]
03:48
icco has joined #rubygems
03:57
ckrailo has joined #rubygems
04:00
markalanevans has joined #rubygems
04:02
icco has quit [Ping timeout: 252 seconds]
04:03
icco has joined #rubygems
04:06
<
raggi >
for the file mirror sections of RG.org, using RC4 makes some sense
04:07
<
raggi >
until we can use some EC
04:07
<
raggi >
all the data for the files is public, so there's not really any content to protect
04:07
<
raggi >
and if privacy is your concern, you have bigger problems
04:15
icco has quit [Read error: Operation timed out]
04:17
icco has joined #rubygems
04:30
icco has quit [Read error: Operation timed out]
04:32
icco has joined #rubygems
04:43
icco has quit [Read error: Operation timed out]
04:46
icco has joined #rubygems
04:57
icco has quit [Read error: Operation timed out]
04:58
vertis has quit [Quit: Leaving.]
05:00
<
tarcieri >
raggi: until you can use EC? o_O
05:00
vertis has joined #rubygems
05:00
<
tarcieri >
raggi: are you talking about ECDH?
05:00
<
tarcieri >
if so, that's orthogonal
05:01
icco has joined #rubygems
05:01
<
tarcieri >
the alternatives are using AES-CBC for TLS 1.1 clients if you're hardened against Lucky 13
05:01
<
tarcieri >
and falling back to RC4 for TLS 1.0 clients (to prevent BEAST)
05:02
<
raggi >
tarcieri: no, i mean until tls supports somethign that is not a cpu hog
05:03
<
raggi >
tarcieri: having just had to shift 100G over a network, i'm a little raw on openssl cpu performance right now
05:03
<
tarcieri >
it would be nice if XSalsa20 + HMAC encrypt-then-MAC made it into TLS
05:03
<
tarcieri >
but chances are we will probably wind up with AES-GCM, and shitty implementations thereof
05:03
<
tarcieri >
it's NIST approved!
*facepalm*
05:04
<
raggi >
i'm once again forced into a world of splitting shit up and runnign parallel tunnels
05:04
<
tarcieri >
I'm guessing AES-GCM with AES NI would probably be faster... not sure
05:04
<
raggi >
it needs to be a LOT faster though
05:04
<
tarcieri >
it's 3 clock cycles per block on Intel CPUs, iirc
05:04
<
raggi >
take your typical EC2 box
05:05
<
raggi >
it can ship data at a cool 100MB/s given a low CPU protocol
05:05
<
raggi >
put gzip(1) in the middle, you're down to 50MB/s immediately
05:05
<
raggi >
put AES in the middle, you're down to 10MB/s
05:05
<
raggi >
and life suuuuuuuuucks
05:05
<
tarcieri >
hmm, this just has the ref implementation
05:06
<
tarcieri >
here's aes256ctr:
05:07
<
raggi >
what are these times?
05:07
<
raggi >
ns/block or something?
05:07
<
tarcieri >
not entirely sure
05:08
<
tarcieri >
"mebibytes per second"
05:09
dvu has joined #rubygems
05:12
vertis has quit [Ping timeout: 240 seconds]
05:13
vertis has joined #rubygems
05:14
icco has quit [Ping timeout: 252 seconds]
05:14
dvu has quit [Ping timeout: 272 seconds]
05:15
icco has joined #rubygems
05:28
icco has quit [Read error: Operation timed out]
05:30
icco has joined #rubygems
05:35
wolfeidau has joined #rubygems
05:37
ckrailo has quit [Quit: Computer has gone to sleep.]
05:42
icco has quit [Read error: Operation timed out]
05:45
icco has joined #rubygems
05:50
mockra has quit [Remote host closed the connection]
05:55
botton has joined #rubygems
05:55
botton has left #rubygems [#rubygems]
05:56
botton has joined #rubygems
05:56
botton has left #rubygems [#rubygems]
05:58
vertis has quit [Quit: Leaving.]
05:58
icco has quit [Ping timeout: 252 seconds]
05:59
icco has joined #rubygems
06:00
vertis has joined #rubygems
06:01
mockra has joined #rubygems
06:02
workmad3 has joined #rubygems
06:09
markalanevans has quit [Quit: markalanevans]
06:09
mockra has quit [Remote host closed the connection]
06:11
icco has quit [Read error: Operation timed out]
06:11
dvu has joined #rubygems
06:14
icco has joined #rubygems
06:16
vertis1 has joined #rubygems
06:16
vertis has quit [Read error: Connection reset by peer]
06:20
dvu has quit [Ping timeout: 272 seconds]
06:23
markalanevans has joined #rubygems
06:26
icco has quit [Read error: Operation timed out]
06:28
icco has joined #rubygems
06:34
workmad3 has quit [Ping timeout: 245 seconds]
06:41
icco has quit [Ping timeout: 252 seconds]
06:43
icco has joined #rubygems
06:47
vertis1 has quit [Quit: Leaving.]
06:54
vertis has joined #rubygems
06:56
icco has quit [Ping timeout: 252 seconds]
06:57
icco has joined #rubygems
07:01
wolfeidau has quit [Remote host closed the connection]
07:10
icco has quit [Ping timeout: 252 seconds]
07:11
vertis has quit [Quit: Leaving.]
07:12
icco has joined #rubygems
07:14
dbussink has quit [Quit: bye]
07:15
dbussink has joined #rubygems
07:20
closer has joined #rubygems
07:22
closer009 has quit [*.net *.split]
07:25
icco has quit [Read error: Operation timed out]
07:26
icco has joined #rubygems
07:30
huoxito has quit [Quit: Leaving]
07:35
tekin has joined #rubygems
07:39
icco has quit [Read error: Operation timed out]
07:41
icco has joined #rubygems
07:47
stabbylambda has quit [Ping timeout: 252 seconds]
07:47
stabbylambda has joined #rubygems
07:49
evan has quit [Ping timeout: 252 seconds]
07:50
evan- has joined #rubygems
07:52
icco has quit [Read error: Operation timed out]
07:55
icco has joined #rubygems
08:07
icco has quit [Read error: Operation timed out]
08:10
icco has joined #rubygems
08:21
lsegal has quit [Quit: Quit: Quit: Quit: Stack Overflow.]
08:23
icco has quit [Ping timeout: 252 seconds]
08:23
vertis has joined #rubygems
08:23
clouder`g has joined #rubygems
08:24
icco has joined #rubygems
08:27
clouder`grr has quit [Ping timeout: 264 seconds]
08:37
icco has quit [Ping timeout: 252 seconds]
08:39
icco has joined #rubygems
08:40
havenwood has quit [Remote host closed the connection]
08:51
icco has quit [Ping timeout: 252 seconds]
08:53
icco has joined #rubygems
08:59
charliesome_ has joined #rubygems
09:01
ZachBeta has quit [Read error: Connection reset by peer]
09:02
charliesome_ is now known as charliesome
09:02
ZachBeta has joined #rubygems
09:04
Elhu has joined #rubygems
09:04
icco has quit [Read error: Operation timed out]
09:07
icco has joined #rubygems
09:17
dvu has joined #rubygems
09:18
kgrz has joined #rubygems
09:20
icco has quit [Ping timeout: 252 seconds]
09:21
icco has joined #rubygems
09:22
dvu has quit [Ping timeout: 264 seconds]
09:34
icco has quit [Ping timeout: 252 seconds]
09:36
icco has joined #rubygems
09:40
kgrz has quit [Quit: Computer has gone to sleep.]
09:49
icco has quit [Ping timeout: 252 seconds]
09:51
icco has joined #rubygems
09:55
kgrz has joined #rubygems
10:04
icco has quit [Ping timeout: 251 seconds]
10:06
icco has joined #rubygems
10:12
workmad3 has joined #rubygems
10:18
pipework has quit [Remote host closed the connection]
10:18
dvu has joined #rubygems
10:19
icco has quit [Read error: Operation timed out]
10:20
icco has joined #rubygems
10:23
dvu has quit [Ping timeout: 264 seconds]
10:24
tekin has quit [Ping timeout: 252 seconds]
10:25
workmad3 has quit [Ping timeout: 255 seconds]
10:33
workmad3 has joined #rubygems
10:34
icco has quit [Ping timeout: 252 seconds]
10:34
icco has joined #rubygems
10:37
Elhu has quit [Quit: Computer has gone to sleep.]
10:38
hakunin has quit [Read error: Connection reset by peer]
10:39
hakunin has joined #rubygems
10:47
icco has quit [Read error: Operation timed out]
10:47
tekin has joined #rubygems
10:47
tekin has joined #rubygems
10:48
yeban has quit [Ping timeout: 258 seconds]
10:48
icco has joined #rubygems
10:49
yeban has joined #rubygems
11:00
icco has quit [Read error: Operation timed out]
11:03
icco has joined #rubygems
11:08
wolfeidau has joined #rubygems
11:16
icco has quit [Read error: Operation timed out]
11:17
icco has joined #rubygems
11:19
dvu has joined #rubygems
11:25
dvu has quit [Ping timeout: 264 seconds]
11:27
Reville has joined #rubygems
11:28
icco has quit [Read error: Operation timed out]
11:31
Elhu has joined #rubygems
11:31
icco has joined #rubygems
11:34
urlicht has joined #rubygems
11:34
tcopeland has quit [Quit: Leaving.]
11:35
urlicht has left #rubygems [#rubygems]
11:35
urlicht has joined #rubygems
11:40
workmad3 has quit [Ping timeout: 272 seconds]
11:40
newUser1234 has joined #rubygems
11:42
icco has quit [Read error: Operation timed out]
11:46
icco has joined #rubygems
11:52
urlicht has quit [Quit: urlicht]
11:59
icco has quit [Ping timeout: 252 seconds]
12:00
icco has joined #rubygems
12:05
Reville has quit [Quit: Reville]
12:12
icco has quit [Read error: Operation timed out]
12:15
snooc has joined #rubygems
12:15
icco has joined #rubygems
12:20
workmad3 has joined #rubygems
12:21
dvu has joined #rubygems
12:26
dvu has quit [Ping timeout: 272 seconds]
12:27
icco has quit [Read error: Operation timed out]
12:29
icco has joined #rubygems
12:29
ZachBeta has quit [Quit: Computer has gone to sleep.]
12:35
yerhot has joined #rubygems
12:35
newUser1234 has quit [Remote host closed the connection]
12:42
icco has quit [Read error: Operation timed out]
12:43
dvu has joined #rubygems
12:44
icco has joined #rubygems
12:47
newUser1234 has joined #rubygems
12:52
ZachBeta has joined #rubygems
12:56
Elhu has quit [Quit: Computer has gone to sleep.]
12:56
icco has quit [Read error: Operation timed out]
12:58
icco has joined #rubygems
12:59
ZachBeta has quit [Quit: Computer has gone to sleep.]
13:00
Elhu has joined #rubygems
13:02
cowboyd has joined #rubygems
13:04
ZachBeta has joined #rubygems
13:05
ZachBeta has quit [Client Quit]
13:10
icco has quit [Read error: Operation timed out]
13:11
jcaudle has joined #rubygems
13:13
icco has joined #rubygems
13:20
newUser1234 has quit [Remote host closed the connection]
13:23
kgrz has quit [Quit: Computer has gone to sleep.]
13:26
icco has quit [Read error: Operation timed out]
13:27
icco has joined #rubygems
13:29
tcopeland has joined #rubygems
13:35
therealadam has joined #rubygems
13:39
icco has quit [Read error: Operation timed out]
13:41
icco has joined #rubygems
13:42
pipework has joined #rubygems
13:47
therealadam has quit [Remote host closed the connection]
13:51
yerhot has quit [Remote host closed the connection]
13:53
icco has quit [Read error: Operation timed out]
13:55
icco has joined #rubygems
13:59
tbuehlmann has joined #rubygems
14:01
workmad3 has quit [Ping timeout: 255 seconds]
14:06
snooc has joined #rubygems
14:09
icco has quit [Read error: Operation timed out]
14:10
icco has joined #rubygems
14:21
yerhot has joined #rubygems
14:22
icco has quit [Read error: Operation timed out]
14:24
icco has joined #rubygems
14:36
icco has quit [Read error: Operation timed out]
14:36
fromonesrc has joined #rubygems
14:39
icco has joined #rubygems
14:39
kgrz has joined #rubygems
14:39
huoxito has joined #rubygems
14:39
<
dwradcliffe >
qrush: I just pushed a new command to meg
14:39
<
dwradcliffe >
qrush: to tail the app logs
14:40
newUser1234 has joined #rubygems
14:52
icco has quit [Ping timeout: 252 seconds]
14:53
icco has joined #rubygems
15:05
icco has quit [Read error: Operation timed out]
15:07
icco has joined #rubygems
15:10
yerhot_ has joined #rubygems
15:12
yerhot has quit [Ping timeout: 256 seconds]
15:14
mando has joined #rubygems
15:20
icco has quit [Ping timeout: 252 seconds]
15:22
icco has joined #rubygems
15:24
ckrailo has joined #rubygems
15:34
icco has quit [Read error: Operation timed out]
15:35
gaffneyc has joined #rubygems
15:36
icco has joined #rubygems
15:39
markalanevans has quit [Ping timeout: 252 seconds]
15:44
kobier has joined #rubygems
15:48
crandquist has quit [Ping timeout: 252 seconds]
15:49
icco has quit [Read error: Operation timed out]
15:51
icco has joined #rubygems
15:53
<
qrush >
dwradcliffe: aweosme!!!
15:58
<
dwradcliffe >
qrush: hopefully that will help next time
15:58
<
qrush >
any ideas what happened to make unicorn freak out?
16:02
<
dwradcliffe >
looking at the logs now
16:03
icco has quit [Read error: Operation timed out]
16:04
<
dwradcliffe >
undefined method `secure_cookie=' for #<Clearance::Configuration:0x00000003e2b6b8> (NoMethodError)
16:05
markalanevans has joined #rubygems
16:05
kgrz has quit [Ping timeout: 260 seconds]
16:05
icco has joined #rubygems
16:16
kobier has quit [Read error: Connection reset by peer]
16:16
tcopeland1 has joined #rubygems
16:17
tcopeland has quit [Read error: Operation timed out]
16:17
<
dwradcliffe >
ah, I think I know what happened
16:18
icco has quit [Read error: Operation timed out]
16:19
<
dwradcliffe >
the Clearance gem was updated, and the secure cookie config set
16:19
<
dwradcliffe >
0a82c13ce0c7f83af9ec89c1175b7f9e292e3343 and b8f5008259a37882ae5e66bad2d3bef912498a26
16:20
icco has joined #rubygems
16:20
<
dwradcliffe >
and sometimes when unicorn tries to restart it doesn't pickup the new gems
16:20
<
dwradcliffe >
without a full restart
16:22
markalanevans has quit [Quit: markalanevans]
16:23
markalanevans has joined #rubygems
16:23
markalanevans has quit [Remote host closed the connection]
16:23
markalanevans has joined #rubygems
16:24
markalanevans has quit [Client Quit]
16:32
dvu has quit [Remote host closed the connection]
16:33
icco has quit [Read error: Operation timed out]
16:34
icco has joined #rubygems
16:43
tenderlove has joined #rubygems
16:46
icco has quit [Read error: Operation timed out]
16:47
tcopeland1 has quit [Quit: Leaving.]
16:49
icco has joined #rubygems
16:51
tcopeland has joined #rubygems
16:51
yerhot_ has quit [Read error: Connection reset by peer]
16:51
yerhot has joined #rubygems
17:01
icco has quit [Read error: Operation timed out]
17:03
dvu has joined #rubygems
17:03
icco has joined #rubygems
17:06
kgrz has joined #rubygems
17:06
Elhu has quit [Quit: Computer has gone to sleep.]
17:07
xymox is now known as list
17:07
list is now known as remove
17:07
remove is now known as reset
17:08
reset is now known as Guest89997
17:11
dvu has quit [Ping timeout: 256 seconds]
17:15
snooc has quit [Ping timeout: 245 seconds]
17:15
crandquist has joined #rubygems
17:15
mockra has joined #rubygems
17:17
icco has quit [Read error: Operation timed out]
17:18
icco has joined #rubygems
17:18
snooc has joined #rubygems
17:19
crandquist has quit [Ping timeout: 255 seconds]
17:24
dvu has joined #rubygems
17:29
icco has quit [Read error: Operation timed out]
17:32
icco has joined #rubygems
17:35
Guest89997 has quit [Quit: leaving]
17:36
xymox has joined #rubygems
17:44
icco has quit [Read error: Operation timed out]
17:45
workmad3 has joined #rubygems
17:47
icco has joined #rubygems
17:58
icco has quit [Read error: Operation timed out]
18:01
icco has joined #rubygems
18:10
yerhot has quit [Read error: Connection reset by peer]
18:11
yerhot has joined #rubygems
18:12
workmad3 has quit [Ping timeout: 246 seconds]
18:13
yerhot has quit [Read error: Connection reset by peer]
18:13
icco has quit [Read error: Operation timed out]
18:14
yerhot has joined #rubygems
18:16
icco has joined #rubygems
18:20
sbeam has joined #rubygems
18:25
Elhu has joined #rubygems
18:26
yerhot_ has joined #rubygems
18:26
yerhot has quit [Read error: Connection reset by peer]
18:28
icco has quit [Read error: Operation timed out]
18:30
icco has joined #rubygems
18:43
icco has quit [Read error: Operation timed out]
18:45
icco has joined #rubygems
18:48
baburdick has quit [Quit: Leaving.]
18:54
imajes has quit [Excess Flood]
18:55
yashshah has quit [Read error: Connection reset by peer]
18:56
icco has quit [Read error: Operation timed out]
18:57
imajes has joined #rubygems
18:57
yashshah has joined #rubygems
18:59
mando_ has joined #rubygems
18:59
icco has joined #rubygems
19:00
mando_ has quit [Remote host closed the connection]
19:00
icco has left #rubygems [#rubygems]
19:01
mando has quit [Ping timeout: 240 seconds]
19:02
yerhot_ has quit [Remote host closed the connection]
19:03
yerhot has joined #rubygems
19:04
baphled has joined #rubygems
19:04
mando has joined #rubygems
19:07
Elhu has quit [Quit: Computer has gone to sleep.]
19:07
yerhot has quit [Read error: Connection reset by peer]
19:07
yerhot has joined #rubygems
19:12
tenderlove has quit [Remote host closed the connection]
19:19
Elhu has joined #rubygems
19:20
fromonesrc has quit [Ping timeout: 272 seconds]
19:21
Elhu has quit [Client Quit]
19:23
icco has joined #rubygems
19:31
kgrz has quit [Quit: Computer has gone to sleep.]
19:32
Elhu has joined #rubygems
19:32
shtirlic has quit [Read error: Operation timed out]
19:33
Spaceghost|work has joined #rubygems
19:33
shtirlic has joined #rubygems
19:35
icco has quit [Read error: Operation timed out]
19:35
pipework has quit [Ping timeout: 252 seconds]
19:36
baburdick has joined #rubygems
19:37
baburdick has quit [Remote host closed the connection]
19:38
baburdick has joined #rubygems
19:38
icco has joined #rubygems
19:38
mando has quit [Remote host closed the connection]
19:41
Spaceghost|work is now known as pipework
19:44
wdperson has joined #rubygems
19:50
icco has quit [Read error: Operation timed out]
19:51
Elhu has quit [Quit: Computer has gone to sleep.]
19:53
icco has joined #rubygems
19:53
dvu has quit [Remote host closed the connection]
20:06
icco has quit [Read error: Operation timed out]
20:07
icco has joined #rubygems
20:20
dvu has joined #rubygems
20:20
icco has quit [Ping timeout: 252 seconds]
20:22
icco has joined #rubygems
20:23
mando has joined #rubygems
20:23
tenderlove has joined #rubygems
20:23
tcopeland has quit [Ping timeout: 245 seconds]
20:24
fromonesrc has joined #rubygems
20:26
huoxito has quit [Quit: Leaving]
20:27
kgrz has joined #rubygems
20:34
icco has quit [Read error: Operation timed out]
20:36
icco has joined #rubygems
20:37
tenderlove has quit [Remote host closed the connection]
20:39
tenderlove has joined #rubygems
20:40
tbuehlmann has quit [Remote host closed the connection]
20:50
icco has quit [Ping timeout: 252 seconds]
20:50
icco has joined #rubygems
20:55
kgrz has quit [Quit: Computer has gone to sleep.]
20:59
yerhot has quit [Remote host closed the connection]
21:04
icco has quit [Ping timeout: 252 seconds]
21:05
icco has joined #rubygems
21:05
kgrz has joined #rubygems
21:07
yerhot has joined #rubygems
21:14
tenderlove has quit [Remote host closed the connection]
21:17
icco has quit [Read error: Operation timed out]
21:19
icco has joined #rubygems
21:20
jcaudle has quit [Quit: jcaudle]
21:22
baburdick1 has joined #rubygems
21:24
baburdick has quit [Ping timeout: 256 seconds]
21:25
baburdick has joined #rubygems
21:26
baburdick1 has quit [Ping timeout: 260 seconds]
21:31
imajes has quit [Excess Flood]
21:32
icco has quit [Read error: Operation timed out]
21:33
imajes has joined #rubygems
21:33
icco has joined #rubygems
21:33
icco has quit [Client Quit]
21:34
icco has joined #rubygems
21:36
tenderlove has joined #rubygems
21:42
imajes has quit [Excess Flood]
21:43
imajes has joined #rubygems
21:47
icco has quit [Read error: Operation timed out]
21:48
icco has joined #rubygems
21:49
kgrz has quit [Quit: Computer has gone to sleep.]
21:50
imajes has quit [Excess Flood]
21:50
imajes_ has joined #rubygems
21:50
imajes_ is now known as imajes
21:53
pipework has quit [Remote host closed the connection]
21:58
tcopeland has joined #rubygems
21:59
cowboyd has quit [Read error: Connection reset by peer]
22:00
icco has quit [Read error: Operation timed out]
22:03
icco has joined #rubygems
22:08
pipework has joined #rubygems
22:16
icco has quit [Ping timeout: 252 seconds]
22:17
icco has joined #rubygems
22:18
baburdick has quit [Quit: Leaving.]
22:18
newUser1234 has quit [Remote host closed the connection]
22:23
icco has quit [Quit: Run Away!]
22:25
vertis has quit [Quit: Leaving.]
22:27
fromonesrc has quit [Ping timeout: 264 seconds]
22:29
dvu has quit [Remote host closed the connection]
22:31
wolfeidau has quit [Remote host closed the connection]
22:33
pipework has quit [Ping timeout: 248 seconds]
22:34
yerhot has quit [Remote host closed the connection]
22:37
huoxito has joined #rubygems
22:46
mando has quit [Remote host closed the connection]
22:46
wolfeidau has joined #rubygems
22:59
baphled has quit [Ping timeout: 276 seconds]
22:59
dvu has joined #rubygems
23:05
yerhot has joined #rubygems
23:08
dvu has quit [Ping timeout: 256 seconds]
23:08
dvu has joined #rubygems
23:13
huoxito has quit [Ping timeout: 245 seconds]
23:13
yerhot has quit [Ping timeout: 255 seconds]
23:19
dvu has quit [Remote host closed the connection]
23:25
huoxito has joined #rubygems
23:42
pipework has joined #rubygems
23:50
huoxito has quit [Quit: Leaving]