22:29 <tonyflint> hello world! I'm seeing some errors installing a specific gem that just started happening a few minutes ago. 'gem install busser' was working fine up until ~30 minutes ago, and now that command is returning "ERROR: Could not find a valid gem 'busser' (>= 0) in any repository\nERROR: While executing gem ... (Gem::RemoteFetcher::FetchError) bad response Not Found 404 (http://rubygems.global.ssl.fastly.net/latest_specs.4.8.gz)"

22:30 <tonyflint> sure enough, that URL is returning a 404 for me; potentially something with the local POP of the fastly CDN network?

22:59 <havenwood> `gem search` seems broken at the moment

23:01 <ejfinneran> I'm getting 404s when redirected to the fastly mirror of latest_specs.4.8.gz depending on which network I'm coming from. https://gist.github.com/ejfinneran/8986935a00c27c888612

23:34 <shevy> hi - can you people push new gems right now? I keep getting errors such as " Can't find 'rubygems-update' in any repo. Check `gem source list`."

23:34 <shevy> ohhh it seems to work again...

23:37 <nickname2> Hello, apologize in advance for my possible ignorance but as of about 1hr ago I started running into the following issue

23:37 <tonyflint> shevy, ejfinneran, havenwood, nickname2: I have been unable to perform many gem commands for a while

23:37 <nickname2> gem install sensu-plugin

23:37 <nickname2> ERROR: Could not find a valid gem 'sensu-plugin' (>= 0), here is why:

23:37 <nickname2> Unable to download data from https://rubygems.org/ - bad response Not Found 404 (https://rubygems.global.ssl.fastly.net/latest_specs.4.8.gz)

23:37 <nickname2> ERROR: Possible alternatives: sensu-plugin

23:37 <nickname2> oh good tonyflint

23:37 <nickname2> so im not alone

23:37 <sschwartzBB> Hello -- I've been getting a weird result, wonder if anyone else is seeing it--- exactly, nickname2.

23:38 <sschwartzBB> Not at all, nickname2

23:38 <nickname2> Wonderful!

23:38 <nickname2> :)

23:38 <tonyflint> it seems a proximate cause, and potentially ultimate cause, is the 404 for http://rubygems.global.ssl.fastly.net/latest_specs.4.8.gz)

23:38 <sschwartzBB> What's weird is I've gotten it to work sporadically.

23:39 <shevy> tonyflint I just tried with two gems, it seems to work for me again now

23:39 <shevy> but it did not work like 10 minutes ago or so... or 15

23:40 <sschwartzBB> Just retried, same error.

23:40 <shevy> yeah

23:40 <ejfinneran> It seems to relate to which IP rubygems.global.ssl.fastly.net resolves to.

23:40 <shevy> you are right

23:40 <tonyflint> is there a prescribed way to report problems such as this to the appropriate rubygems.org folks?

23:40 <havenwood> bad response Not Found 404 (https://rubygems.global.ssl.fastly.net/latest_specs.4.8.gz)

23:40 <shevy> File: sanitize_cookbook_dataset-0.0.131.gem

23:40 <shevy> gem push *.gem

23:40 <shevy> ERROR: While executing gem ... (RuntimeError)

23:40 <shevy> Can't find 'rubygems-update' in any repo. Check `gem source list`.

23:40 <shevy> :(

23:41 <havenwood> ping drbrain qrush samkottler ^

23:42 <ejfinneran> Looks like help.rubygems.org is the best bet? https://twitter.com/qrush/status/681613748063334400

23:42 <shevy> we are doooooomed!

23:42 <shevy> so close at the end of 2015

23:42 <havenwood> ejfinneran: Ah, nice.

23:42 <dwradcliffe> Tldr?

23:43 <havenwood> 404: https://rubygems.global.ssl.fastly.net/latest_specs.4.8.gz

23:45 <shevy> and now it worked again sschwartzBB ... this is like playing russian roulette :)

23:46 <dwradcliffe> working for me but could be a bad cache in your POP

23:46 <nickname2> worked for me just now as well

23:46 <sschwartzBB> Indeed. Very, very strange.

23:46 <nickname2> 5/5 success

23:46 <nickname2> :)

23:46 <havenwood> dwradcliffe: Working now. :)

23:46 <sschwartzBB> OK. Now I've got it working on one machine, but ...ah-hah! There we go.

23:47 <dwradcliffe> I've purged across every POP so should recover

23:47 <sschwartzBB> Drumroll, please.

23:47 <havenwood> dwradcliffe: tyty

23:48 <shevy> :D

23:48 <dwradcliffe> sorry for the trouble folks :( not sure how we got a 404 cached

23:49 <nickname2> thanks a ton for the quick resolution!

23:50 <dwradcliffe> np

23:50 <shevy> \o/

23:52 <tonyflint> aww yiss