• Committer: Tarmac
  • Author(s): Brad Crittenden
  • Date: 2014-04-14 20:07:28 UTC
  • mfrom: (500.1.9 es-missing-data)
  • Revision ID: tarmac-20140414200728-ew38mtkdrsuprcff
Do not index charm annotations in bundles.

Charms in bundles have "annotations" which include information relating to the
widget layout when placed in the GUI ('gui-x' and 'gui-y').  This information
is ancilliary to the actual bundle and should not be searchable.

The presence of such data has also caused operational problems.  In
production, some bundles are not being indexed due to parsing errors of the x
and y coordinates.

An example failure is shown here:
2014-04-11 19:12:30,096 DEBUG [pyelasticsearch][MainThread] got response {u'items': [{u'index': {u'_type': u'bundle', u'_id': u'~charmers/muletrain/wiki', u'error': u'MapperParsingException[failed to parse [data.data.services.mediawiki.annotations.gui-y]]; nested: NumberFormatException[For input string: "-117.5"]; ', u'_index': u'charms-78512'}}], u'took': 4}

Unfortunately, this ingestion failure cannot be reproduced on staging or
locally.  Further, it appears pyelasticsearch is not returning an error in
this situation but is instead silently failing to index the bundle.

To QA the branch, in one window run 'make run'.  In another, ingest some

% bin/ingest-queued --prefix="~charmers/charms/bundles"

Afterwards, go to 'localhost:2464' in your browser.  Search for 'bundles' and
see the ones that got ingested.  Next search for 'gui-x' and see no results.



Approved by Juju Gui Bot.
Filename Latest Rev Last Changed Committer Comment Size
charmworld 1 12 years ago kapil.foss at gmail charmworld pyramid starter Diff
docs 33 12 years ago kapil.foss at gmail add install doc Diff
scripts 21 12 years ago Kapil Thangavelu add ctl scripts Diff
.bzrignore 458.1.3 10 years ago j.c.sackett Bzr should ignore our conventional lp credentials 430 bytes Diff Download File
.lbox 419.1.2 10 years ago Brad Crittenden lbox defaults to -cr and sets project to charmworl 31 bytes Diff Download File
File .lbox.check 491.1.2 10 years ago Brad Crittenden Move lint before test in lbox.check 66 bytes Diff Download File
CHANGES.txt 67.1.10 11 years ago Kapil Thangavelu put back accidentally yanked changes 28 bytes Diff Download File
default.ini 474.1.6 10 years ago j.c.sackett Changes to address commentar in review. 2.9 KB Diff Download File
distribute_setup.py 71.1.2 11 years ago Rick Harding Add missing files 15.3 KB Diff Download File
LICENSE.txt 61 11 years ago kapil.foss at gmail add license 33.7 KB Diff Download File
Makefile 482.1.1 10 years ago Brad Crittenden Turn on lint for migrations and fix 5.1 KB Diff Download File
MANIFEST.in 1 12 years ago kapil.foss at gmail charmworld pyramid starter 133 bytes Diff Download File
README.txt 7 12 years ago kapil.foss at gmail work in progress on multi namespace support 252 bytes Diff Download File
requirements.txt 487.2.1 10 years ago Brad Crittenden Check charm constraints when doing proof. Lots of 1.3 KB Diff Download File
setup.cfg 304.4.26 10 years ago Aaron Bentley Move logging filters to nose config. 569 bytes Diff Download File
setup.py 461.3.2 10 years ago Benji York checkpoint 1.4 KB Diff Download File
test-setup.ini 474.1.6 10 years ago j.c.sackett Changes to address commentar in review. 668 bytes Diff Download File