00:00
<
dwradcliffe >
redis log is 6.6G
00:00
<
evan >
thats on /var/lib/redis_data
00:00
<
evan >
or it's supposed to be
00:00
<
dwradcliffe >
/var/log/redis/redis-server.log
00:01
<
evan >
truncate it.
00:01
<
evan >
i'm on there now too
00:01
<
dwradcliffe >
permission denied
00:01
<
samkottler >
let's move it to /mnt
00:01
<
samkottler >
actually I guess it can go on /var/lib/redis_data
00:01
<
samkottler >
k thanks evan
00:01
baburdick has joined #rubygems
00:01
<
samkottler >
once that's done we can start the DB upgrade
00:02
<
evan >
ok, truncated
00:02
<
evan >
using my favorite truncation method
00:02
<
samkottler >
/dev/null?
00:04
<
samkottler >
okay I'm going to put the site into maintenence mode if everyone's cool with that
00:04
<
evan >
we should setup some aggressive policys for all logs written to /var/log
00:04
<
evan >
yep, go ahead
00:04
<
evan >
i'll tweet about it.
00:05
<
evan >
ok, go ahead.
00:06
baburdick has quit [Ping timeout: 252 seconds]
00:06
<
samkottler >
evan: where is the maintenence mode enabled? I can't even find that string in /etc/nginx
00:06
<
evan >
I should take the time to also rewrite the redis AOF file
00:07
<
evan >
we might have moved it
00:08
<
evan >
we were previously doing it via changing SetEnv in the apache conf
00:08
<
evan >
i'm not sure we've done maint mode since moving
00:08
<
evan >
give me a sec
00:08
<
samkottler >
ah so it might not be there anymore
00:08
<
dwradcliffe >
I don't remember seeing it
00:09
baburdick has joined #rubygems
00:11
<
evan >
yeah, I don't think we have
00:11
<
evan >
do you guys have a recommended way to do it?
00:11
<
evan >
setting RailsEnv to maintanence and restarting unicorn seems the easiest
00:12
<
samkottler >
agreed
00:13
<
evan >
we can use unicorns -E option
00:13
baburdick has quit [Ping timeout: 252 seconds]
00:15
<
samkottler >
wanna do that evan?
00:15
<
samkottler >
or should I?
00:15
<
evan >
i'll do it the quick way right now
00:16
<
samkottler >
I'll update the sysvinit script to load the environment from /etc/default/rubygems at some point so it doesn't require too much hacking to do this
00:16
<
evan >
ok, into maint mode
00:17
<
evan >
something is up though.
00:17
<
evan >
it's not responding
00:17
<
evan >
I think -E maintenance isn't working
00:17
<
samkottler >
this is unicorn being ridiculous
00:17
baburdick has joined #rubygems
00:17
<
samkottler >
no, it's loading - check out top
00:17
<
evan >
the workers are starting then exitting
00:18
<
evan >
uninitialized constant NewRelic
00:18
<
evan >
maint mode got broken.
00:19
<
samkottler >
yeah, I get a 500 now
00:19
<
evan >
ok, fixed it
00:19
<
evan >
we're in maint now
00:19
<
evan >
go about your business
00:19
<
evan >
i'm going to have redis rewrite the AOF file now too.
00:20
yashshah has quit [Ping timeout: 252 seconds]
00:20
<
samkottler >
upgrading the packages on dbmaster01
00:21
<
evan >
once AOF is rewritten
00:21
<
evan >
i'm going to change the redis config to turn down the log level
00:21
<
evan >
that log file it's writing is useless
00:21
<
evan >
i've never used it.
00:21
<
dwradcliffe >
evan: sounds good
00:21
<
dwradcliffe >
evan: it was spewing out of memory errors a few minutes ago
00:21
baburdick has quit [Ping timeout: 252 seconds]
00:22
<
evan >
"oh hey, the LB incremented hits on the rails gem, yippy kia yae"
00:22
* samkottler
wonders why the hell pulseaudio is installed on this machine
00:22
<
evan >
dwradcliffe: redis was
00:22
<
evan >
we need to fix the stats
00:22
<
evan >
i should be able to dump some RAM from it
00:22
<
samkottler >
did someone install a desktop packagegroup on this box?
00:22
<
samkottler >
it has some gnome shit
00:23
<
samkottler >
and libreoffice
00:23
<
samkottler >
ugh....
00:23
<
evan >
we'll schedule another time to fully redo the app server out of chef
00:24
<
samkottler >
"oh look guys, gnome account system is installed on our db master"
00:25
baburdick has joined #rubygems
00:25
<
evan >
thats why the redis log was so big
00:25
rhinux1 has joined #rubygems
00:25
<
evan >
it complaining about memory probably
00:26
huoxito has quit [Quit: Leaving]
00:27
<
samkottler >
okay DB upgrade is complete
00:27
yashshah has joined #rubygems
00:27
huoxito has joined #rubygems
00:28
rhinux has quit [Ping timeout: 264 seconds]
00:29
<
samkottler >
want to take it out of maintenence evan?
00:29
baburdick has quit [Ping timeout: 248 seconds]
00:29
<
evan >
i'm going to do a little more redis cleanup
00:29
<
samkottler >
okay no problem
00:30
<
evan >
and i'm going to have redis write it's log to /var/lib/redis_data
00:30
<
samkottler >
evan: awesome - thanks :)
00:30
<
evan >
i'll change it on the server
00:30
<
evan >
and port the changes into chef afterward
00:30
<
samkottler >
works for me
00:30
<
dwradcliffe >
want to deploy datadog tonight so we can start monitoring?
00:30
<
evan >
that would be great
00:30
<
samkottler >
evan: we should have the maintenence page on the balancer instead of the app. I'll work on that this week
00:31
<
samkottler >
dwradcliffe: yep definitely
00:31
<
evan >
i played with datadog about 6 months ago
00:31
<
evan >
looked great
00:31
<
evan >
didn't have the time to dig into it much.
00:31
<
evan >
samkottler: yeah, agreed.
00:32
yashshah has quit [Ping timeout: 240 seconds]
00:32
baburdick has joined #rubygems
00:33
<
evan >
my prune_redis script is running
00:33
<
evan >
i shouldn't have waited so long to run it :)
00:33
<
evan >
it's got a lot to prune.
00:33
xymox has quit [Ping timeout: 256 seconds]
00:34
<
samkottler >
evan: should we just run that as a cronjob each month or something?
00:34
<
evan >
i'm going to take us out of maint
00:34
<
evan >
this can run concurrently
00:35
<
dwradcliffe >
who has access to the status page?
00:35
<
evan >
it's mostly automated
00:35
<
evan >
I do, a few others
00:35
<
evan >
i can give you cacess
00:35
<
dwradcliffe >
I want to remove the link at the top from that incident
00:36
<
dwradcliffe >
not really current anymore
00:36
<
samkottler >
can I have access, too
00:36
xymox has joined #rubygems
00:36
<
dwradcliffe >
heroku right?
00:36
baburdick has quit [Ping timeout: 248 seconds]
00:37
<
evan >
unicorn restarting into production now.
00:37
<
samkottler >
site is back
00:37
<
samkottler >
evan++ dwradcliffe++
00:38
<
evan >
samkottler: whats your email to add to status?
00:39
<
samkottler >
evan: shk@linux.com
00:40
baburdick has joined #rubygems
00:43
<
evan >
ok, added you both to rubygems-status
00:43
<
dwradcliffe >
evan: thanks
00:44
<
samkottler >
evan: thank you
00:44
<
evan >
i think stat-update is probably my favorite little program I wrote for rubygems
00:44
<
dwradcliffe >
I'll fix the twitter integration on the page too
00:44
<
evan >
uses 1M of RAM resident
00:44
<
evan >
barely gets above 5% CPU ever
00:45
baburdick has quit [Ping timeout: 256 seconds]
00:45
<
evan >
replaced like 10 passenger processes running at 80%
00:46
<
samkottler >
one day when I'm less tired this week I'll remove all the desktop crap from the db machine
00:47
<
samkottler >
because...yeah :P
00:48
<
evan >
prune is about half way done
00:48
baburdick has joined #rubygems
00:52
baburdick has quit [Ping timeout: 248 seconds]
00:54
yerhot has joined #rubygems
00:56
rhinux has joined #rubygems
00:56
baburdick has joined #rubygems
00:59
rhinux1 has quit [Ping timeout: 264 seconds]
00:59
<
samkottler >
evan: I'd also like to move redis off the app machine at some point so it's completely ephemeral
00:59
<
samkottler >
the DB box seems like the obvious place for it to go
00:59
<
dwradcliffe >
samkottler: sounds logical
01:00
<
dwradcliffe >
status page is updated
01:00
baburdick has quit [Ping timeout: 240 seconds]
01:04
<
dwradcliffe >
we can move it when we rebuild the db server
01:04
baburdick has joined #rubygems
01:04
<
samkottler >
dwradcliffe: oh are we planning on doing that?
01:05
<
dwradcliffe >
oh no, that was the app server. nevermind
01:06
<
dwradcliffe >
so, right before we rebuild the app server
01:07
rhinux has quit [Ping timeout: 264 seconds]
01:08
baburdick has quit [Ping timeout: 252 seconds]
01:09
<
samkottler >
does anyone know some peeps over at pagerduty?
01:11
rhinux has joined #rubygems
01:11
ZachBeta has quit [Quit: Computer has gone to sleep.]
01:11
<
dwradcliffe >
not I
01:12
baburdick has joined #rubygems
01:16
<
kseifried >
cool concept
01:16
baburdick has quit [Ping timeout: 256 seconds]
01:17
<
samkottler >
kseifried: pagerduty, you mean?
01:20
baburdick has joined #rubygems
01:21
<
samkottler >
dwradcliffe: you deploying the datadog stuff?
01:23
<
dwradcliffe >
I can. I'll need to get the secrets, etc
01:23
rhinux has quit [Ping timeout: 264 seconds]
01:23
rhinux1 has joined #rubygems
01:24
baburdick has quit [Ping timeout: 264 seconds]
01:24
<
dwradcliffe >
samkottler: want to merge it?
01:25
<
samkottler >
dwradcliffe: yep, I'll do that now. I also just updated the typo fix PR
01:26
<
samkottler >
merged
01:27
baburdick has joined #rubygems
01:32
baburdick has quit [Ping timeout: 248 seconds]
01:34
rhinux has joined #rubygems
01:34
rhinux1 has quit [Read error: Connection reset by peer]
01:35
baburdick has joined #rubygems
01:38
* samkottler
is heading offline
01:38
<
samkottler >
if you need help rolling that out dwradcliffe I'll be on my cell
01:38
<
samkottler >
OTR message incoming with the #
01:39
<
dwradcliffe >
samkottler: thx
01:39
jfelchner has joined #rubygems
01:40
jfelchner has left #rubygems [#rubygems]
01:40
baburdick has quit [Ping timeout: 252 seconds]
01:40
<
samkottler >
later y'all. nice work tonight
01:43
baburdick has joined #rubygems
01:47
mando has joined #rubygems
01:48
baburdick has quit [Ping timeout: 252 seconds]
01:49
<
evan >
got redis down to 1.7G
01:49
<
evan >
my work here is done
01:52
baburdick has joined #rubygems
01:52
mando has quit [Ping timeout: 248 seconds]
01:56
<
dwradcliffe >
evan: nice!
01:56
<
dwradcliffe >
datadog is runnint on the app server
01:56
baburdick has quit [Ping timeout: 256 seconds]
01:58
<
evan >
can you add me to the account?
02:00
<
dwradcliffe >
email?
02:00
baburdick has joined #rubygems
02:04
baburdick has quit [Ping timeout: 252 seconds]
02:08
baburdick has joined #rubygems
02:11
<
dwradcliffe >
evan: what email should I send the invite?
02:13
baburdick has quit [Ping timeout: 256 seconds]
02:14
newUser1234 has quit [Remote host closed the connection]
02:16
baburdick has joined #rubygems
02:19
Spaceghost|work has quit [Remote host closed the connection]
02:20
pipework has joined #rubygems
02:21
baburdick has quit [Ping timeout: 256 seconds]
02:25
baburdick has joined #rubygems
02:30
baburdick has quit [Ping timeout: 256 seconds]
02:33
baburdick has joined #rubygems
02:35
nezumi has joined #rubygems
02:38
baburdick has quit [Ping timeout: 256 seconds]
02:42
baburdick has joined #rubygems
02:47
baburdick has quit [Ping timeout: 256 seconds]
02:51
baburdick has joined #rubygems
02:52
ZachBeta has joined #rubygems
02:55
baburdick has quit [Ping timeout: 256 seconds]
02:59
baburdick has joined #rubygems
03:04
baburdick has quit [Ping timeout: 248 seconds]
03:04
yerhot has quit [Remote host closed the connection]
03:08
baburdick has joined #rubygems
03:11
rhinux has quit [Ping timeout: 264 seconds]
03:13
baburdick has quit [Ping timeout: 256 seconds]
03:15
yashshah has joined #rubygems
03:18
baburdick has joined #rubygems
03:22
baburdick has quit [Ping timeout: 252 seconds]
03:27
baburdick has joined #rubygems
03:31
baburdick has quit [Ping timeout: 248 seconds]
03:37
baburdick has joined #rubygems
03:39
nateberkopec has quit [Read error: Connection reset by peer]
03:41
baburdick has quit [Ping timeout: 256 seconds]
03:46
baburdick has joined #rubygems
03:50
baburdick has quit [Ping timeout: 240 seconds]
03:56
baburdick has joined #rubygems
04:00
baburdick has quit [Ping timeout: 252 seconds]
04:08
baburdick has joined #rubygems
04:11
nezumi has quit [Ping timeout: 252 seconds]
04:13
baburdick has quit [Ping timeout: 256 seconds]
04:21
baburdick has joined #rubygems
04:25
baburdick has quit [Ping timeout: 252 seconds]
04:31
baburdick has joined #rubygems
04:33
wolfeidau has joined #rubygems
04:33
newUser1234 has joined #rubygems
04:35
baburdick has quit [Ping timeout: 248 seconds]
04:41
baburdick has joined #rubygems
04:45
wolfeidau has quit [Remote host closed the connection]
04:46
baburdick has quit [Ping timeout: 256 seconds]
04:55
baburdick has joined #rubygems
05:00
baburdick has quit [Ping timeout: 252 seconds]
05:10
baburdick has joined #rubygems
05:15
baburdick has quit [Ping timeout: 248 seconds]
05:15
huoxito has quit [Ping timeout: 248 seconds]
05:17
wolfeidau has joined #rubygems
05:19
nezumi has joined #rubygems
05:26
baburdick has joined #rubygems
05:27
huoxito has joined #rubygems
05:30
baburdick has quit [Ping timeout: 256 seconds]
05:42
baburdick has joined #rubygems
05:46
baburdick has quit [Ping timeout: 256 seconds]
05:47
kgrz has joined #rubygems
05:58
baburdick has joined #rubygems
06:02
baburdick has quit [Ping timeout: 248 seconds]
06:14
tenderlove has quit [Remote host closed the connection]
06:15
baburdick has joined #rubygems
06:15
tenderlove has joined #rubygems
06:19
baburdick has quit [Ping timeout: 256 seconds]
06:22
adkron has joined #rubygems
06:30
kgrz has quit [Quit: Computer has gone to sleep.]
06:31
adkron has quit [Ping timeout: 245 seconds]
06:48
kgrz has joined #rubygems
06:52
wolfeidau has quit [Ping timeout: 276 seconds]
06:54
tbuehlmann has joined #rubygems
07:23
newUser1234 has quit [Remote host closed the connection]
07:31
wolfeidau has joined #rubygems
07:38
wolfeida_ has joined #rubygems
07:38
wolfeidau has quit [Ping timeout: 248 seconds]
07:41
kgrz has quit [Quit: Computer has gone to sleep.]
08:28
workmad3 has joined #rubygems
08:29
wolfeida_ has quit [Ping timeout: 256 seconds]
08:38
charliesome has joined #rubygems
08:57
wolfeidau has joined #rubygems
09:09
lsegal has quit [Ping timeout: 245 seconds]
09:33
wolfeidau has quit [Remote host closed the connection]
10:04
huoxito has quit [Ping timeout: 248 seconds]
10:11
Elhu has joined #rubygems
10:14
Elhu has quit [Client Quit]
10:18
huoxito has joined #rubygems
10:49
stoffus has joined #rubygems
10:50
workmad3 has quit [Ping timeout: 245 seconds]
10:59
baburdick has joined #rubygems
11:04
baburdick has quit [Ping timeout: 252 seconds]
11:21
<
stoffus >
I'm currently experiencing lots of timeouts when using https, is this a known issue?
11:21
kgrz has joined #rubygems
11:31
baburdick has joined #rubygems
11:32
kgrz has quit [Read error: Connection reset by peer]
11:36
baburdick has quit [Ping timeout: 256 seconds]
12:11
workmad3 has joined #rubygems
12:27
nezumi has quit [Ping timeout: 260 seconds]
13:01
workmad3 has quit [Ping timeout: 264 seconds]
13:07
newUser1234 has joined #rubygems
13:08
workmad3 has joined #rubygems
13:38
newUser1234 has quit [Remote host closed the connection]
13:46
tbuehlmann has quit [Remote host closed the connection]
14:08
huoxito has quit [Quit: Leaving]
14:33
ddd has quit [Quit: restarting tmux]
14:35
ddd has joined #rubygems
14:39
yashshah has quit [Ping timeout: 245 seconds]
14:39
ddd has quit [Client Quit]
14:39
ddd has joined #rubygems
14:40
ddd has quit [Client Quit]
14:41
tekin has joined #rubygems
14:42
ddd has joined #rubygems
14:43
ddd has quit [Client Quit]
14:49
ddd has joined #rubygems
14:50
ddd has quit [Client Quit]
14:54
ddd has joined #rubygems
14:56
Elhu has joined #rubygems
15:08
ddd has quit [Quit: ok restarting with no tmux. just means I will disconnect when done]
15:08
ddd has joined #rubygems
15:11
tbuehlmann has joined #rubygems
15:19
workmad3 has quit [Ping timeout: 248 seconds]
15:20
Elhu has quit [Quit: Computer has gone to sleep.]
15:37
workmad3 has joined #rubygems
15:52
ddd has quit [Quit: Lost terminal]
15:58
Elhu has joined #rubygems
16:04
ZachBeta has joined #rubygems
16:12
workmad3 has quit [Ping timeout: 245 seconds]
16:24
ddd has joined #rubygems
16:39
yerhot has joined #rubygems
16:42
yerhot has quit [Remote host closed the connection]
16:49
nezumi has joined #rubygems
17:08
ZachBeta has quit [Quit: Computer has gone to sleep.]
17:10
dwradcliffe_ has joined #rubygems
17:12
dwradcliffe has quit [Ping timeout: 246 seconds]
17:22
kgrz has joined #rubygems
17:24
Elhu has quit [Quit: Computer has gone to sleep.]
17:25
tenderlove has quit [Remote host closed the connection]
17:25
tenderlove has joined #rubygems
17:25
tenderlove has quit [Remote host closed the connection]
17:27
yashshah has joined #rubygems
17:35
markalanevans has joined #rubygems
17:35
nezumi has quit [Ping timeout: 245 seconds]
17:44
fidothe_ has quit [Ping timeout: 246 seconds]
17:46
fidothe_ has joined #rubygems
17:48
kgrz has quit [Quit: Computer has gone to sleep.]
18:03
workmad3 has joined #rubygems
18:07
nezumi has joined #rubygems
18:27
workmad3 has quit [Ping timeout: 252 seconds]
18:28
stoffus has quit []
18:38
nezumi has quit [Ping timeout: 240 seconds]
18:48
Elhu has joined #rubygems
18:51
workmad3 has joined #rubygems
18:56
tbuehlmann has quit [Remote host closed the connection]
19:00
nomadic has quit [Ping timeout: 245 seconds]
19:05
nateberkopec has joined #rubygems
19:06
nomadic has joined #rubygems
19:11
Elhu has quit [Quit: Computer has gone to sleep.]
19:29
baphled has joined #rubygems
19:51
workmad3 has quit [Ping timeout: 246 seconds]
19:53
lsegal has joined #rubygems
19:57
Elhu has joined #rubygems
20:07
Elhu has quit [Quit: Computer has gone to sleep.]
20:07
kyzh has joined #rubygems
20:07
kyzh is now known as Guest63016
20:18
workmad3 has joined #rubygems
20:24
havenwood has joined #rubygems
20:35
Elhu has joined #rubygems
20:51
Elhu has quit [Quit: Computer has gone to sleep.]
21:02
workmad3 has quit [Ping timeout: 252 seconds]
21:07
baphled has quit [Ping timeout: 256 seconds]
21:13
baphled has joined #rubygems
21:26
adkron has joined #rubygems
21:29
Elhu has joined #rubygems
21:32
nateberkopec has quit [Quit: Leaving...]
21:39
Elhu has quit [Quit: Computer has gone to sleep.]
21:47
adkron has quit [Ping timeout: 264 seconds]
21:52
ckrailo has joined #rubygems
21:53
Guest63016 has quit [Read error: Operation timed out]
21:57
rhinux has joined #rubygems
21:58
ckrailo has quit [Ping timeout: 276 seconds]
21:58
gramos has joined #rubygems
22:01
adkron has joined #rubygems
22:07
gramos has quit [Ping timeout: 260 seconds]
22:25
nezumi has joined #rubygems
22:27
nateberkopec has joined #rubygems
22:27
mpapis has quit [Excess Flood]
22:28
mpapis has joined #rubygems
22:35
baphled has quit [Ping timeout: 252 seconds]
22:41
ZachBeta has joined #rubygems
22:48
yerhot has joined #rubygems
22:50
ZachBeta has quit [Quit: Computer has gone to sleep.]
22:54
ZachBeta has joined #rubygems
22:56
ZachBeta has quit [Client Quit]
23:01
yerhot has quit [Remote host closed the connection]
23:06
ZachBeta has joined #rubygems
23:09
calmyournerves is now known as Guest
23:20
havenwood has quit [Remote host closed the connection]
23:23
ZachBeta has quit [Quit: Computer has gone to sleep.]
23:26
ZachBeta has joined #rubygems
23:26
huoxito has joined #rubygems
23:27
ZachBeta has quit [Client Quit]
23:39
lsegal has quit [Quit: Quit: Quit: Quit: Stack Overflow.]
23:49
ZachBeta has joined #rubygems
23:54
huoxito has quit [Ping timeout: 264 seconds]
23:58
ZachBeta has quit [Quit: Computer has gone to sleep.]