~jbicha/firefox/update-dependencies

« back to all changes in this revision

Viewing changes to debian/testing/results-filter-manifest.json

  • Committer: Chris Coulson
  • Date: 2013-09-17 11:05:10 UTC
  • mto: This revision was merged to the branch mainline in revision 1023.
  • Revision ID: chris.coulson@canonical.com-20130917110510-chob2tiw2glco8b9
* New upstream release from the beta channel (FIREFOX_25_0b1_BUILD1)
* Refresh patches
  - update d/p/test-fixes/xpcshell-docshell-no-writes-to-appdir.patch
  - update d/p/test-integration/xpcshell-write-time-for-failed-test.patch
  - update debian/patches/ubuntu-ua-string-changes.patch
  - update d/p/test-fixes/xpcshell-exthandler-no-writes-to-appdir.patch
  - update d/p/test-integration/automation-output-junit-xml.patch
  - update d/p/test-integration/mochitest-allow-test-manifest-for-browser-chrome.patch
  - update d/p/test-integration/xpcshell-disable-tests-which-need-appdir-write-access.patch
  - update debian/patches/unity-menubar.patch
* Drop patches
  - remove d/p/test-fixes/xpcshell-docshell-no-writes-to-appdir.patch
  - remove d/p/test-fixes/xpcshell-contentprefs-no-writes-to-appdir.patch
  - remove d/p/test-fixes/mochitest-browser-plugincrash-with-no-crashreporter.patch
  - update debian/patches/series
* Refactor the test results post-process script a bit so that it can use
  regular expressions in the configuration
  - update debian/testing/filter_results
  - update debian/testing/results-filter-manifest.json
  - update debian/tests/post-process
* Run mochitest-plain in 5 chunks, similar to upstream. This should fix
  some test failures we see that seem to be caused by some tests not
  cleaning up properly (seems to fix LP: #1158781 and LP: #1194448)
  - update debian/testing/run_mochitest.in
  - update debian/tests/control
  - move debian/tests/mochitest => debian/tests/mochitest-1
  - add debian/tests/mochitest-2
  - add debian/tests/mochitest-3
  - add debian/tests/mochitest-4
  - add debian/tests/mochitest-5
* Drop d/p/test-integration/test-sameoriginpolicy-debug.patch now that
  we run mochitest-plain in chunks
* Add OCSPStaplingServer binary to testsuite
  - update debian/firefox-testsuite.install.in
  - update debian/build/rules.mk
* Don't let make check failures fail the build for now, as there are some
  jit test failures
  - update debian/build/testsuite.mk
* Try to stop the buildd's from terminating the build during long links
  (use a hack based on the one for the Chromium package)
  - add debian/build/keepalive-wrapper.py
  - update debian/build/rules.mk
* Disable no_neon_on_arm.patch for now

Show diffs side-by-side

added added

removed removed

Lines of Context:
1
1
[
2
 
  { "testsuite": "mochitest.chrome", "classname": "editor.composer.test", "name": "test_async_UpdateCurrentDictionary.html", "note": "https://launchpad.net/bugs/1194236" },
3
 
  { "testsuite": "mochitest.chrome", "classname": "editor.composer.test", "name": "test_bug678842.html", "note": "https://launchpad.net/bugs/1158866" },
4
 
  { "testsuite": "mochitest.chrome", "classname": "editor.libeditor.html.tests", "name": "test_bug636465.xul", "note": "https://launchpad.net/bugs/1158870" },
5
 
  { "testsuite": "mochitest.chrome", "classname": "layout.base.tests.chrome", "name": "test_printpreview.xul", "note": "https://launchpad.net/bugs/1162991" },
6
 
  { "testsuite": "mochitest.chrome", "classname": "layout.inspector.tests.chrome", "name": "test_bug467669.xul", "note": "https://launchpad.net/bugs/1158875" },
7
 
  { "testsuite": "mochitest.chrome", "classname": "toolkit.content.tests.chrome", "name": "test_arrowpanel.xul", "note": "https://launchpad.net/bugs/1158881" },
8
 
  { "testsuite": "mochitest.chrome", "classname": "toolkit.content.tests.chrome", "name": "test_richlist_direction.xul", "note": "https://launchpad.net/bugs/1158882" },
9
 
  { "testsuite": "mochitest.chrome", "classname": "widget.tests", "name": "test_wheeltransaction.xul", "note": "https://launchpad.net/bugs/1158887" },
10
 
  { "testsuite": "mochitest.plain", "classname": "content.media.test", "name": "test_a4_tone.html", "note": "https://launchpad.net/bugs/1159075" },
11
 
  { "testsuite": "mochitest.plain", "classname": "content.media.webaudio.test", "name": "test_maxChannelCount.html", "note": "https://launchpad.net/bugs/1194436" },
12
 
  { "testsuite": "mochitest.plain", "classname": "dom.plugins.test.mochitest", "name": "test_crashing.html", "note": "https://launchpad.net/bugs/1158781" },
13
 
  { "testsuite": "mochitest.plain", "classname": "dom.plugins.test.mochitest", "name": "test_hanging.html", "note": "https://launchpad.net/bugs/1158781" },
14
 
  { "testsuite": "mochitest.plain", "classname": "layout.base.tests", "name": "test_reftests_with_caret.html", "note": "https://launchpad.net/bugs/1194440" },
15
 
  { "testsuite": "reftest", "classname": "editor.reftests", "name": "spellcheck-hyphen-valid.html", "note": "https://launchpad.net/bugs/1159073" },
16
 
  { "testsuite": "reftest", "classname": "layout.reftests.bidi", "name": "with-first-letter-1a.html", "condition": "reftest_fuzzy(9,3)" },
17
 
  { "testsuite": "reftest", "classname": "layout.reftests.bidi", "name": "with-first-letter-1b.html", "condition": "reftest_fuzzy(9,3)" },
18
 
  { "testsuite": "reftest", "classname": "layout.reftests.bidi", "name": "with-first-letter-2a.html", "condition": "reftest_fuzzy(9,3)" },
19
 
  { "testsuite": "reftest", "classname": "layout.reftests.bidi", "name": "with-first-letter-2b.html", "condition": "reftest_fuzzy(9,3)" },
20
 
  { "testsuite": "reftest", "classname": "layout.reftests.bugs", "name": "321402-4.xul", "condition": "reftest_fuzzy(33,1)", "note": "subpixel AA?" },
21
 
  { "testsuite": "reftest", "classname": "layout.reftests.bugs", "name": "321402-5.xul", "condition": "reftest_fuzzy(33,1)", "note": "subpixel AA?" },
22
 
  { "testsuite": "reftest", "classname": "layout.reftests.bugs", "name": "321402-6.xul", "condition": "reftest_fuzzy(33,1)", "note": "subpixel AA?" },
23
 
  { "testsuite": "reftest", "classname": "layout.reftests.bugs", "name": "482592-1a.xhtml", "condition": "reftest_fuzzy(13,2)", "note": "subpixel AA?" },
24
 
  { "testsuite": "reftest", "classname": "layout.reftests.bugs", "name": "482592-1b.xhtml", "condition": "reftest_fuzzy(13,2)", "note": "subpixel AA?" },
25
 
  { "testsuite": "reftest", "classname": "layout.reftests.bugs", "name": "621918-1.svg", "condition": "reftest_fuzzy(49,3)" },
26
 
  { "testsuite": "reftest", "classname": "layout.reftests.counters", "name": "text-boundaries-subpixel.html", "condition": "reftest_fuzzy(1,1)" },
27
 
  { "testsuite": "reftest", "classname": "layout.reftests.first-letter", "name": "329069-2.html", "note": "https://launchpad.net/bugs/1158924" },
28
 
  { "testsuite": "reftest", "classname": "layout.reftests.font-face", "name": "src-list-local-full.html", "note": "https://launchpad.net/bugs/1158933" },
29
 
  { "testsuite": "reftest", "classname": "layout.reftests.font-face", "name": "src-list-local-full-quotes.html", "note": "https://launchpad.net/bugs/1158933" },
30
 
  { "testsuite": "reftest", "classname": "layout.reftests.font-face", "name": "local-1.html", "note": "https://launchpad.net/bugs/1158933" },
31
 
  { "testsuite": "reftest", "classname": "layout.reftests.font-features", "name": "font-variant-caps.html", "note": "https://launchpad.net/bugs/1181340" },
32
 
  { "testsuite": "reftest", "classname": "layout.reftests.font-features", "name": "font-variant-east-asian.html", "note": "https://launchpad.net/bugs/1181340" },
33
 
  { "testsuite": "reftest", "classname": "layout.reftests.font-features", "name": "font-variant-ligatures.html", "note": "https://launchpad.net/bugs/1181340" },
34
 
  { "testsuite": "reftest", "classname": "layout.reftests.font-features", "name": "font-variant-numeric.html", "note": "https://launchpad.net/bugs/1181340" },
35
 
  { "testsuite": "reftest", "classname": "layout.reftests.font-features", "name": "font-variant-position.html", "note": "https://launchpad.net/bugs/1181340" },
36
 
  { "testsuite": "reftest", "classname": "layout.reftests.list-item", "name": "numbering-1.html", "pass-ok": true, "condition": "reftest_fuzzy(7,1)" },
37
 
  { "testsuite": "reftest", "classname": "layout.reftests.selection", "name": "splitText-normalize.html", "pass-ok": true, "condition": "reftest_fuzzy(1,2)" },
38
 
  { "testsuite": "reftest", "classname": "layout.reftests.svg", "name": "text-scale-02.svg", "condition": "reftest_fuzzy(64,400)" },
39
 
  { "testsuite": "reftest", "classname": "layout.reftests.svg.smil.transform", "name": "additive-1.svg", "note": "https://launchpad.net/bugs/1181348" },
40
 
  { "testsuite": "reftest", "classname": "layout.reftests.svg.text", "name": "mask-content.svg", "condition": "reftest_fuzzy(10,112)" },
41
 
  { "testsuite": "reftest", "classname": "layout.reftests.svg.text", "name": "mask-content-2.svg", "condition": "reftest_fuzzy(10,112)" },
42
 
  { "testsuite": "reftest", "classname": "layout.reftests.table-anonymous-boxes", "name": "394402-1a.html", "condition": "reftest_fuzzy(1,2)" },
43
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "wordbreak-4a.html", "note": "https://launchpad.net/bugs/1158928" },
44
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "475092-pos.html", "condition": "reftest_fuzzy(70,490)" },
45
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-1.html", "pass-ok": true },
46
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-1a.html", "pass-ok": true },
47
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-2.html", "pass-ok": true },
48
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-3.html", "pass-ok": true },
49
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-4.html", "pass-ok": true },
50
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-5.html", "pass-ok": true },
51
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-6.html", "pass-ok": true },
52
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-7.html", "pass-ok": true },
53
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-8.html", "pass-ok": true },
54
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-9.html", "pass-ok": true },
55
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-10.html", "pass-ok": true },
56
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-af-1.html", "pass-ok": true },
57
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-bg-1.html", "pass-ok": true },
58
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-ca-1.html", "pass-ok": true },
59
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-cy-1.html", "pass-ok": true },
60
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-da-1.html", "pass-ok": true },
61
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-de-1901-1.html", "pass-ok": true },
62
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-de-1996-1.html", "pass-ok": true },
63
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-de-ch-1.html", "pass-ok": true },
64
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-eo-1.html", "pass-ok": true },
65
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-es-1.html", "pass-ok": true },
66
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-et-1.html", "pass-ok": true },
67
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-fi-1.html", "pass-ok": true },
68
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-fr-1.html", "pass-ok": true },
69
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-gl-1.html", "pass-ok": true },
70
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-hr-1.html", "pass-ok": true },
71
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-hsb-1.html", "pass-ok": true },
72
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-hu-1.html", "pass-ok": true },
73
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-ia-1.html", "pass-ok": true },
74
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-is-1.html", "pass-ok": true },
75
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-it-1.html", "pass-ok": true },
76
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-kmr-1.html", "pass-ok": true },
77
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-la-1.html", "pass-ok": true },
78
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-lt-1.html", "pass-ok": true },
79
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-mn-1.html", "pass-ok": true },
80
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-nb-1.html", "pass-ok": true },
81
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-nl-1.html", "pass-ok": true },
82
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-nn-1.html", "pass-ok": true },
83
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-pt-1.html", "pass-ok": true },
84
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-ru-1.html", "pass-ok": true },
85
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-sh-1.html", "pass-ok": true },
86
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-sl-1.html", "pass-ok": true },
87
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-sr-1.html", "pass-ok": true },
88
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-sv-1.html", "pass-ok": true },
89
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-tr-1.html", "pass-ok": true },
90
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-uk-1.html", "pass-ok": true },
91
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-xmllang-1.xhtml", "pass-ok": true },
92
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-xmllang-1a.xhtml", "pass-ok": true },
93
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-xmllang-5.xhtml", "pass-ok": true },
94
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-xmllang-6.xhtml", "pass-ok": true },
95
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-xmllang-7.xhtml", "pass-ok": true },
96
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-xmllang-11a.xhtml", "pass-ok": true },
97
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-xmllang-11b.xhtml", "pass-ok": true },
98
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-xmllang-13a.xhtml", "pass-ok": true },
99
 
  { "testsuite": "reftest", "classname": "layout.reftests.text", "name": "auto-hyphenation-xmllang-13b.xhtml", "pass-ok": true },
100
 
  { "testsuite": "reftest", "classname": "layout.reftests.text-overflow", "name": "block-padding.html", "condition": "reftest_fuzzy(11,12)" },
101
 
  { "testsuite": "reftest", "classname": "layout.reftests.text-overflow", "name": "selection.html", "condition": "reftest_fuzzy(1,2)" },
102
 
  { "testsuite": "reftest", "classname": "layout.reftests.text-overflow", "name": "two-value-syntax.html", "condition": "reftest_fuzzy(11,48)" },
103
 
  { "testsuite": "reftest", "classname": "layout.reftests.text-overflow", "name": "atomic-under-marker.html", "condition": "reftest_fuzzy(11,15)" },
104
 
  { "testsuite": "reftest", "classname": "layout.reftests.transform-3d", "name": "scale3d-all.html", "condition": "reftest_fuzzy(111,996)", "note": "subpixel AA?" },
105
 
  { "testsuite": "reftest", "classname": "layout.reftests.transform-3d", "name": "scale3d-all-separate.html", "condition": "reftest_fuzzy(111,996)", "note": "subpixel AA?" },
106
 
  { "testsuite": "reftest", "classname": "layout.reftests.xul", "name": "accesskey.xul", "condition": "reftest_fuzzy(1,2)" },
107
 
  { "testsuite": "reftest", "classname": "parser.htmlparser.tests.reftest", "name": "view-source:bug535530-2.html", "condition": "reftest_fuzzy(13,15)", "note": "subpixel AA?" },
108
 
  { "testsuite": "xpcshell", "classname": "toolkit.components.search.tests.xpcshell", "name": "test_nocache.js", "pass-ok": true, "note": "https://bugzilla.mozilla.org/show_bug.cgi?id=828223#c14" },
109
 
  { "testsuite": "xpcshell", "classname": "toolkit.components.telemetry.tests.unit", "name": "test_TelemetryPing.js" },
110
 
  { "testsuite": "xpcshell", "classname": "toolkit.mozapps.extensions.test.xpcshell", "name": "test_update.js", "note": "https://launchpad.net/bugs/1194159" },
111
 
  { "testsuite": "xpcshell", "classname": "toolkit.mozapps.extensions.test.xpcshell-unpack", "name": "test_update.js", "note": "https://launchpad.net/bugs/1194159" },
112
 
  { "testsuite": "xpcshell", "classname": "uriloader.exthandler.tests.unit", "name": "test_handlerService.js", "note": "https://launchpad.net/bugs/1158899" }
 
2
  { "id": "^mochitest\\.chrome\\.editor\\.composer\\.test\\.test_async_UpdateCurrentDictionary\\.html$",
 
3
    "expected_count": 1,
 
4
    "note": "https://launchpad.net/bugs/1194236" },
 
5
  { "id": "^mochitest\\.chrome\\.editor\\.composer\\.test\\.test_bug678842\\.html$",
 
6
    "expected_count": 1,
 
7
    "note": "https://launchpad.net/bugs/1158866" },
 
8
  { "id": "^mochitest\\.chrome\\.layout\\.base\\.tests\\.chrome\\.test_printpreview\\.xul$",
 
9
    "expected_count": 1,
 
10
    "note": "https://launchpad.net/bugs/1162991" },
 
11
  { "id": "^mochitest\\.chrome\\.layout\\.inspector\\.tests\\.chrome\\.test_bug467669\\.xul$",
 
12
    "expected_count": 1,
 
13
    "note": "https://launchpad.net/bugs/1158875" },
 
14
  { "id": "^mochitest\\.chrome\\.toolkit\\.content\\.tests\\.chrome\\.test_arrowpanel\\.xul$",
 
15
    "expected_count": 1,
 
16
    "note": "https://launchpad.net/bugs/1158881" },
 
17
  { "id": "^mochitest\\.chrome\\.toolkit\\.content\\.tests\\.chrome\\.test_richlist_direction\\.xul$",
 
18
    "expected_count": 1,
 
19
    "note": "https://launchpad.net/bugs/1158882" },
 
20
  { "id": "^mochitest\\.chrome\\.widget\\.tests\\.test_wheeltransaction\\.xul$",
 
21
    "expected_count": 1,
 
22
    "note": "https://launchpad.net/bugs/1158887" },
 
23
  { "id": "^mochitest\\.plain\\.1\\.content\\.media\\.test\\.test_a4_tone\\.html$",
 
24
    "expected_count": 1,
 
25
    "note": "https://launchpad.net/bugs/1159075" },
 
26
  { "id": "^mochitest\\.plain\\.1\\.content\\.media\\.webaudio\\.test\\.test_maxChannelCount\\.html$",
 
27
    "expected_count": 1,
 
28
    "note": "https://launchpad.net/bugs/1194436" },
 
29
  { "id": "^mochitest\\.plain\\.4\\.layout\\.base\\.tests\\.test_reftests_with_caret\\.html$",
 
30
    "expected_count": 1,
 
31
    "note": "https://launchpad.net/bugs/1194440" },
 
32
  { "id": "^reftest\\.editor\\.reftests\\.spellcheck-hyphen-valid\\.html$",
 
33
    "expected_count": 1,
 
34
    "note": "https://launchpad.net/bugs/1159073" },
 
35
  { "id": "^reftest\\.layout\\.reftests\\.bidi\\.with-first-letter-[^-\\.]+\\.html$",
 
36
    "expected_count": 4,
 
37
    "condition": "reftest_fuzzy_pass(9,3)" },
 
38
  { "id": "^reftest\\.layout\\.reftests\\.bugs\\.321402-(?:4|5|6)\\.xul$",
 
39
    "expected_count": 3,
 
40
    "condition": "reftest_fuzzy_pass(33,1)",
 
41
    "note": "subpixel AA?" },
 
42
  { "id": "^reftest\\.layout\\.reftests\\.bugs\\.482592-[^-\\.]+\\.xhtml$",
 
43
    "expected_count": 2,
 
44
    "condition": "reftest_fuzzy_pass(13,2)",
 
45
    "note": "subpixel AA?" },
 
46
  { "id": "^reftest\\.layout\\.reftests\\.bugs\\.621918-1\\.svg$",
 
47
    "expected_count": 1,
 
48
    "condition": "reftest_fuzzy_pass(49,3)" },
 
49
  { "id": "^reftest\\.layout\\.reftests\\.counters\\.text-boundaries-subpixel\\.html$", 
 
50
    "expected_count": 1,
 
51
    "condition": "reftest_fuzzy_pass(1,1)" },
 
52
  { "id": "^reftest\\.layout\\.reftests\\.first-letter\\.329069-2\\.html$",
 
53
    "expected_count": 1,
 
54
    "note": "https://launchpad.net/bugs/1158924" },
 
55
  { "id": "^reftest\\.layout\\.reftests\\.font-face\\.src-list-local-full[^\\.]*\\.html$",
 
56
    "expected_count": 2,
 
57
    "note": "https://launchpad.net/bugs/1158933" },
 
58
  { "id": "^reftest\\.layout\\.reftests\\.font-face\\.local-1\\.html$",
 
59
    "expected_count": 1,
 
60
    "note": "https://launchpad.net/bugs/1158933" },
 
61
  { "id": "^reftest\\.layout\\.reftests\\.font-features\\.font-variant-(?:caps|east-asian|ligatures|numeric|position)\\.html$",
 
62
    "expected_count": 5,
 
63
    "note": "https://launchpad.net/bugs/1181340" },
 
64
  { "id": "^reftest\\.layout\\.reftests\\.list-item\\.numbering-1\\.html$",
 
65
    "random": true,
 
66
    "condition": "reftest_fuzzy_pass(7,1)" },
 
67
  { "id": "^reftest\\.layout\\.reftests\\.selection\\.splitText-normalize\\.html$",
 
68
    "random": true,
 
69
    "condition": "reftest_fuzzy_pass(1,2)" },
 
70
  { "id": "^reftest\\.layout\\.reftests\\.svg\\.smil\\.transform\\.additive-1\\.svg$",
 
71
    "expected_count": 1,
 
72
    "note": "https://launchpad.net/bugs/1181348" },
 
73
  { "id": "^reftest\\.layout\\.reftests\\.svg\\.text\\.mask-content-?[0-9]?\\.svg$",
 
74
    "expected_count": 2,
 
75
    "condition": "reftest_fuzzy_pass(10,112)" },
 
76
  { "id": "^reftest\\.layout\\.reftests\\.table-anonymous-boxes\\.394402-1a\\.html$",
 
77
    "expected_count": 1,
 
78
    "condition": "reftest_fuzzy_pass(1,2)" },
 
79
  { "id": "^reftest\\.layout\\.reftests\\.text\\.475092-pos\\.html$",
 
80
    "expected_count": 1,
 
81
    "condition": "reftest_fuzzy_pass(70,490)" },
 
82
  { "id": "^reftest\\.layout\\.reftests\\.text\\.auto-hyphenation-[^\\.]*\\.(?:|x)html$",
 
83
    "random": true,
 
84
    "note": "Needs hyphenation patterns" },
 
85
  { "id": "^reftest\\.layout\\.reftests\\.text\\.wordbreak-4a\\.html$",
 
86
    "expected_count": 1,
 
87
    "note": "https://launchpad.net/bugs/1158928" },
 
88
  { "id": "^reftest\\.layout\\.reftests\\.text-overflow\\.atomic-under-marker\\.html$",
 
89
    "expected_count": 1,
 
90
    "condition": "reftest_fuzzy_pass(11,15)" },
 
91
  { "id": "^reftest\\.layout\\.reftests\\.text-overflow\\.block-padding\\.html$",
 
92
    "expected_count": 1,
 
93
    "condition": "reftest_fuzzy_pass(11,12)" },
 
94
  { "id": "^reftest\\.layout\\.reftests\\.text-overflow\\.selection\\.html$",
 
95
    "expected_count": 1,
 
96
    "condition": "reftest_fuzzy_pass(1,2)" },
 
97
  { "id": "^reftest\\.layout\\.reftests\\.text-overflow\\.two-value-syntax\\.html$",
 
98
    "expected_count": 1,
 
99
    "condition": "reftest_fuzzy_pass(11,48)" },
 
100
  { "id": "^reftest\\.layout\\.reftests\\.transform-3d\\.scale3d-all-?[^\\.]*\\.html$",
 
101
    "expected_count": 2,
 
102
    "condition": "reftest_fuzzy_pass(111,996)",
 
103
    "note": "subpixel AA?" },
 
104
  { "id": "^reftest\\.layout\\.reftests\\.xul\\.accesskey\\.xul$",
 
105
    "expected_count": 1,
 
106
    "condition": "reftest_fuzzy_pass(1,2)" },
 
107
  { "id": "^reftest\\.parser\\.htmlparser\\.tests\\.reftest\\.view-source:bug535530-2\\.html$",
 
108
    "expected_count": 1,
 
109
    "condition": "reftest_fuzzy_pass(13,15)",
 
110
    "note": "subpixel AA?" },
 
111
  { "id": "^xpcshell\\.toolkit\\.components\\.search\\.tests\\.xpcshell\\.test_nocache\\.js$",
 
112
    "random": true,
 
113
    "note": "https://bugzilla.mozilla.org/show_bug.cgi?id=828223#c14" },
 
114
  { "id": "^xpcshell\\.toolkit\\.components\\.telemetry\\.tests\\.unit\\.test_TelemetryPing\\.js$",
 
115
    "expected_count": 1,
 
116
    "note": "No telemetry on Ubuntu" },
 
117
  { "id": "^xpcshell\\.toolkit\\.mozapps\\.extensions\\.test\\.xpcshell(?:|-unpack)\\.test_update\\.js$",
 
118
    "expected_count": 2,
 
119
    "note": "https://launchpad.net/bugs/1194159" },
 
120
  { "id": "^xpcshell\\.uriloader\\.exthandler\\.tests\\.unit\\.test_handlerService\\.js$",
 
121
    "expected_count": 1,
 
122
    "note": "https://launchpad.net/bugs/1158899" }
113
123
]