dkubb changed the topic of #datamapper to: Datamapper v1.2.0 | Mailing List: http://is.gd/aa9D | Logs: http://is.gd/qWAL7V | DataMapper 2 Renamed to ROM, see #rom-rb for development
brianpWins has quit [Quit: brianpWins]
brianpWins has joined #datamapper
brianpWins_ has joined #datamapper
brianpWins_ has quit [Client Quit]
snusnu has quit [Quit: Leaving.]
rsim has joined #datamapper
rsim has quit [Ping timeout: 240 seconds]
v0n has quit [Ping timeout: 260 seconds]
lgierth has joined #datamapper
knowtheory has joined #datamapper
rsim has joined #datamapper
rsim has quit [Ping timeout: 240 seconds]
rsim has joined #datamapper
mikecmpbll has joined #datamapper
zombor has joined #datamapper
mikecmpbll has quit [Quit: ["Textual IRC Client: www.textualapp.com"]]
zombor has quit [Remote host closed the connection]
zombor has joined #datamapper
zombor has quit [Changing host]
zombor has joined #datamapper
mikecmpbll has joined #datamapper
snusnu has joined #datamapper
skade has joined #datamapper
zombor has quit [Remote host closed the connection]
snusnu has quit [Quit: Leaving.]
zombor has joined #datamapper
zombor has quit [Remote host closed the connection]
snusnu has joined #datamapper
snusnu has joined #datamapper
snusnu has quit [Client Quit]
snusnu has joined #datamapper
g0bl1n has joined #datamapper
v0n has joined #datamapper
mikecmpbll has quit [Quit: ["Textual IRC Client: www.textualapp.com"]]
zombor has joined #datamapper
rafaelfranca has joined #datamapper
mikecmpbll has joined #datamapper
akasper has joined #datamapper
akasper has quit [Client Quit]
akasper has joined #datamapper
akasper has quit [Ping timeout: 246 seconds]
akasper has joined #datamapper
rafaelfr_ has joined #datamapper
rafaelfranca has quit [Ping timeout: 245 seconds]
v0n has quit [Quit: WeeChat 0.4.3-dev]
v0n has joined #datamapper
v1n has joined #datamapper
v0n has quit [Ping timeout: 240 seconds]
knowtheory has quit [Quit: Computer has gone to sleep]
knowtheory has joined #datamapper
knowtheory has quit [Ping timeout: 252 seconds]
knowtheory has joined #datamapper
akasper1 has joined #datamapper
akasper has quit [Ping timeout: 248 seconds]
mikecmpbll has quit [Quit: ["Textual IRC Client: www.textualapp.com"]]
mikecmpbll has joined #datamapper
zombor has quit [Remote host closed the connection]
zombor_ has joined #datamapper
zombor_ has quit [Changing host]
zombor_ has joined #datamapper
mikecmpbll has quit [Quit: ["Textual IRC Client: www.textualapp.com"]]
skade has quit [Quit: Computer has gone to sleep.]
zombor_ is now known as zombor
snusnu has quit [Quit: Leaving.]
mbj has joined #datamapper
rsim has quit [Quit: Leaving.]
skade has joined #datamapper
snusnu has joined #datamapper
akasper1 has quit [Quit: Leaving.]
akasper has joined #datamapper
rsim has joined #datamapper
Eiam has quit [Quit: ╯°□°）╯︵ǝpouǝǝɹɟ]
postmodern has joined #datamapper
Eiam has joined #datamapper
rsim has quit [Quit: Leaving.]
brianpWins has joined #datamapper
dkubb has joined #datamapper
<dkubb> Eiam: you can probably repro that issue more easily than I can
<Eiam> well I cannot "repro" it on demand at all
<Eiam> but my users can repro it
<Eiam> and I get an email every time they do =0
<dkubb> Eiam: I was seeing it on one contract I worked on, but I've moved to another contract so I don't know if I can easily repro it now
<dkubb> heh
<Eiam> and for them its just "use the service"
<Eiam> occasionally, that error will pop up on one of the requests
<Eiam> its not consistent which request, or the request content.
<Eiam> worse since re trying the exact same query can succeed
<dkubb> maybe try writing a stand-alone script that does the same query in a tight loop and see if you can repro it that way?
<dkubb> just let it run overnight and see
<Eiam> MyModel.get(#)
<Eiam> 10000 times
<dkubb> maybe dm-mysql-adapter need to handle the empty fields case?
<dkubb> or it could be pushed up do dm-do-adapter
<Eiam> that its empty is weird
<Eiam> because there is data
<dkubb> since I presume it's part of the DO contract?
<Eiam> (in the DB)
<dkubb> well, it is something across the network, which could fail in all sorts of weird ways
<dkubb> Eiam: when you do model get 10k times, does it repeat at all, or is it always a clean run?
<dkubb> I would just let it repeat infinitely using loop { ... } and check it later
<Eiam> no that was a bit of an exaggeration as to what the script might do
<dkubb> allow it to bomb out if it fails
<Eiam> every http request does do a model.get()
<Eiam> and almost every request does similar basic lookups on the model
<dkubb> once you have some kind of a repro, then you can fix it and run it again to see if it fixed it
<Eiam> its really nothing fancy
<dkubb> maybe try doing something where you spawn 2 threads and run them in parallel
<Eiam> yeah I've been thinking about getting a database pool spun up on some VMs
<Eiam> so I just talk to "the DB" but the VM's behind it are managing a few DBs
<Eiam> then I can make the support team deal with the problem =)
<Eiam> "gosh guys, why isn't your DB pool working/replicating/load balancing properly?!"
<dkubb> lol
<Eiam> instead of letting the DB remain on my production VM thats also the web server
<Eiam> I know, thats mean of me
<dkubb> I suspect it's not particularly hard to solve. what would be hard is to know if your fix actually worked or just worked the time you tested it
<Eiam> sure the hard part is just the repro case
<Eiam> once I've got that, I'm a binding.pry away from figuring out the issue
<dkubb> it could also just be a random network failure
<Eiam> hmm
<Eiam> doubtful
<Eiam> corporate network is pretty solid
<dkubb> a network can still fail for any reason, even the best
<Eiam> sure
<Eiam> but a packet dropout would be handled way below me
<dkubb> although I guess you say it happens regularly
<Eiam> well since I added in the retries
<Eiam> I went from several times per day
<Eiam> to a few times a week
<Eiam> https://github.com/datamapper/do/issues/58 I see maybe once a day though
<Eiam> correlation is "when people are at work using the service"
<dkubb> heh
<dkubb> you've gotta narrow it down a bit more :P
<Eiam> of course =)
* Eiam looks at the 67 issues assigned to him
<dkubb> I wonder if the C code should retry with some kind of exponential backoff
<dkubb> I totally understand that
<Eiam> gotta do a lot of things! don't we all
<dkubb> the C code is inside do_mysql_cReader_next, which should be safe to reexecute if the reader container pointer is NULL
<dkubb> not that I could write such a thing
<mbj> Eiam: Can you monitor network traffic and correlate the dump with the event?
<mbj> Eiam: Might be impossible on a production box. But a tcpdump geneated pcap file helped me a lot in similar scenarios ;)
<Eiam> hmm
<Eiam> I own the production box so
<Eiam> i can certainly dump all the traffic
<Eiam> its all ssl though
<Eiam> i've never reproduced it locally so charles proxy wouldn't be of help there
rsim has joined #datamapper
<dkubb> ssl to mysql, or is it connecting via the loopback or unixsocket?
<mbj> Eiam: Even under ssl to mysql you could use stunnel to terminate ssl on a local "plain" socket and dump this.
<Eiam> postgres
<Eiam> not sure I could get away with that in production
<Eiam> security would probably flip their shit
rsim has quit [Ping timeout: 240 seconds]
<Eiam> I'll noodle on it see what I can do
<Eiam> maybe just step 1 find a repro case
<dkubb> yeah, I think a tight loop with 2 threads doing the same query would be what I start with.. assuming it's a concurrency issue
<mbj> Eiam: SSL is a "Secure-Socket-LAYER", per definition you can strip it away. And communications on localhost should be "secure" anyway?
<mbj> Eiam: Dunno, but my prod boxes only have "one" job ;)
<mbj> Eiam: Mabe stunnel can expose a unix socket locally, with termiated ssl.
lgierth has quit [Ping timeout: 252 seconds]
lgierth has joined #datamapper
knowtheory has quit [Ping timeout: 252 seconds]
mbj has quit [Read error: Connection reset by peer]
mbj has joined #datamapper
mbj has quit [Quit: leaving]
knowtheory has joined #datamapper
zombor has quit [Remote host closed the connection]
zombor has joined #datamapper
mbj has joined #datamapper
v1n has quit [Quit: WeeChat 0.4.3-dev]
mbj has quit [Quit: leaving]
rafaelfranca has joined #datamapper
rsim has joined #datamapper
rafaelfr_ has quit [Ping timeout: 272 seconds]
zombor has quit [Remote host closed the connection]
v0n has joined #datamapper
rtyler has quit [Read error: Connection reset by peer]
rtyler has joined #datamapper
rtyler has quit [Changing host]
rtyler has joined #datamapper
lgierth has quit [Quit: Ex-Chat]
Cinchy_ has joined #datamapper
DireFog has quit [Quit: No Ping reply in 180 seconds.]
Cinchy has quit [Remote host closed the connection]
DireFog has joined #datamapper
pietia has joined #datamapper
v0n has quit [Ping timeout: 245 seconds]
v0n has joined #datamapper
knowtheory has quit [Quit: Computer has gone to sleep]
knowtheory has joined #datamapper
knowtheory has quit [Ping timeout: 245 seconds]
rafaelfranca has quit [Remote host closed the connection]
rafaelfranca has joined #datamapper
rafaelfranca has quit [Ping timeout: 272 seconds]
pietia has quit [Quit: Leaving...]
rsim has quit [Quit: Leaving.]
<Eiam> hmm will poke at it thanks for the suggestions
zombor has joined #datamapper
skade has quit [Quit: Textual IRC Client: www.textualapp.com]