~ev/daisy/filter-out-and-monitor-bad-data : changes

~ev/daisy/filter-out-and-monitor-bad-data » Changes from revision 377

From Revision 377 to 358

Rev	Summary	Authors	Date
377	Monitor whether we're getting anything useful out of attempt... Monitor whether we're getting anything useful out of attempting to repair the SAS. Only filter out reports that have absolutely no chance of producing something useful. A missing DistroRelease field means it will only ever count towards the total for 'All releases' and show up in the counts on the problem pages, but that's still something. Only filter out reports that are either missing the ProblemType and Package or the ProblemType and some sort of signature.	Evan Dandrea	10 years ago
376	Comment. Comment.	Evan Dandrea	10 years ago
375	Don't create fields that don't exist in the db. Don't create fields that don't exist in the db.	Evan Dandrea	10 years ago
374	Reports like 074e85be-7cdd-11e2-b545-2c768aafd08c only have ... Reports like 074e85be-7cdd-11e2-b545-2c768aafd08c only have the SystemIdentifier field, which we insert. They're effectively empty, so don't accept them.	Evan Dandrea	10 years ago
373	Don't just throw everything into the Stacktrace CF. We have ... Don't just throw everything into the Stacktrace CF. We have a lot of that data in the OOPS CF, and we're not actually using anything from Stacktrace except the 'Stacktrace' columns.	Evan Dandrea	10 years ago
372	Add some more instrumentation to submit_core. Add some more instrumentation to submit_core.	Evan Dandrea	10 years ago
371	Don't use the MissingSAS or KernelCrash rows in the Counters... Don't use the MissingSAS or KernelCrash rows in the Counters CF anymore - this is what statsd and graphite are for. Do not proceed if the report is missing the DistroRelease or ProblemType keys. Increment statsd meters when we are dropping invalid reports.	Evan Dandrea	10 years ago
370	Tune the buffer_size down to 1K to give the cluster a bit mo... Tune the buffer_size down to 1K to give the cluster a bit more breathing room.	Evan Dandrea	10 years ago
369	Make build_errors_by_release faster by caching FirstError. T... Make build_errors_by_release faster by caching FirstError. This will require multiple runs, but it already need that because FirstError isn't accurate until it is entirely populated.	Evan Dandrea	10 years ago
368	This is now BucketVersionSystems2. This is now BucketVersionSystems2.	Evan Dandrea	10 years ago
367	Merge Brian's branch to use the new update_bucket_systems() ... Merge Brian's branch to use the new update_bucket_systems() functions with changes to the argument structure.	Evan Dandrea	10 years ago
366	Bump max_retries to 10, given conversation in #webops on 11/... Bump max_retries to 10, given conversation in #webops on 11/6/2013 at 9:36am BST (massive connection failures on the retracers this morning).	Evan Dandrea	10 years ago
365	Don't completely bail out if we cannot generate a Don't completely bail out if we cannot generate a crash_signature_addresses.	Evan Dandrea	10 years ago
364	Refactor metrics. Separate out retracer metrics into another Refactor metrics. Separate out retracer metrics into another namespace.	Evan Dandrea	10 years ago
363	Do not ever use METRICS.increment. It's absolute, so we'll o... Do not ever use METRICS.increment. It's absolute, so we'll only ever get 1 out of it unless we keep a running count in the application: [12:35:03] <sidnei> ev: ah, duh. you're using the non-standard statsd mode (which we added), so counters there are absolute, not incremental [12:35:43] <sidnei> ev: switch to meter instead [12:36:49] <sidnei> ev: standard statsd doesn't have the timer percentiles and stuff so it's easier to change to meter where you would use the standard counter [12:39:55] <sidnei> ev: the difference is that the meter gives you both the old-style counter + the rate as a separate metric	Evan Dandrea	10 years ago
362	Do not cache swift connections to see if this is what's caus... Do not cache swift connections to see if this is what's causing the authentication issues after a while.	Evan Dandrea	10 years ago
361	Keep track of the number of bytes used in Swift, in case we ... Keep track of the number of bytes used in Swift, in case we OOPS when writing to it.	Evan Dandrea	10 years ago
360	Oh datetime... Oh datetime...	Evan Dandrea	10 years ago
359	Add timestamps to the verbose pycassa connection listener. Add timestamps to the verbose pycassa connection listener.	Evan Dandrea	10 years ago
358	Add statsd metrics of swift connection failures. Add statsd metrics of swift connection failures.	Evan Dandrea	10 years ago

Older »