~wesley-wiedenmeier/curtin/reporting-cleanup-rebase : changes

~wesley-wiedenmeier/curtin/reporting-cleanup-rebase » Changes from revision 385

From Revision 367 to 348

Rev	Summary	Authors	Date
367	add s390x support to curtin and vmtest add s390x support to curtin and vmtest - use virtio ccw bus by default - bump install_timeout to 30 minutes (kvm on zvm can be slow, installing things across the atlantic) - query "default" architecture from python - add zipl support - use a bootloader agnostic "successful" installation watermark - vmtests: Add arch_skip field to allow vmtests to be skipped on specific arches For example, bcache is currently broken on s390x, and uefi will never work.	Ryan Harper	8 years ago
366	curtin: fix tox errors in curtin/commands/main.py due to ups... curtin: fix tox errors in curtin/commands/main.py due to upstream pylint upload pylint levels changed upstream in pipi causing new failures: E:208,13: Instance of 'argv' has no 'reportstack' member (but some types could not be inferred) (maybe-no-member) E:209,18: Instance of 'argv' has no 'func' member (but some types could not be inferred) (maybe-no-member) Resolve by specifying the pylint version in tox.ini In addition, update curtin/commands/main.py to not fail upstream tox checks as well.	Ryan Harper	8 years ago
365	debian/control: fix build-depends for xenial build debian/control: fix build-depends for xenial build python3 support was moved out of pyflakes into python3-pyflakes. Adjust the package to build on trusty where python3-pyflakes was not present and also on xenial where it is. Note, this does mean that sbuild now requires '--resolve-alternatives'. That is how it is used on launchpad but is not the default in sbuild.	Scott Moser	8 years ago
364	fix pep8 issue on trusty, add a tox environment to catch tha... fix pep8 issue on trusty, add a tox environment to catch that. Recent merge worked fine in tox, but build on trusty failed due to pep8 complaints. This adds a 'trusty-check' environment to tox that will catch errors like that.	Scott Moser	8 years ago
363	mkfs: handle fstype: vfat mkfs: handle fstype: vfat Prior to commit 343, block_meta custom handled 'fstype: vfat' via fallthrough and invoked mkfs.vfat without options. Restore this by adding 'vfat' to the fstype dictionary. Add a unittest to ensure we don't break fstype: vfat in the future.	Scott Moser	8 years ago
362	save the curtin install config to /root/curtin-install-cfg.y... save the curtin install config to /root/curtin-install-cfg.yaml this is configurable via 'save_install_config'. Setting the value to non-true value ("" or null) will stop the writing of this file.	Scott Moser	8 years ago
361	deps: install dependencies without apt recommends deps: install dependencies without apt recommends Curtin should list the dependencies it has explicitly rather than relying on recommends. That has 2 benefits: a.) better knowing what the dependencies actually are b.) smaller footprint/less installed packages. Specifically, this means that on the following releases, we do not install the listed packages: precise: default-mta mail-transport-agent trusty: default-mta mail-transport-agent vivid: default-mta mail-transport-agent wily: default-mta mail-transport-agent module-init-tools There are no changes to packages installed as deps in xenial, as xenial maas/cloud image already has all dependencies. Note, this only affects how curtin installs its own dependencies (through 'curtin --install-deps') not how apt would install it.	Scott Moser	8 years ago
360	fix tox running for python2 on trusty fix tox running for python2 on trusty This is similar to commit 350. We do not run python2 checkers against tests/vmtests. For some reason this just started failing. The change is to just add a py2-flake8 and py3-flake8 environment. Note, we are not running py2-flake8 by default right now (its not in the env list)	Scott Moser	8 years ago
359	tools/ssh-keys-list: fix a bug in modes, add argparse tools/ssh-keys-list: fix a bug in modes, add argparse There was actually no way to request 'json' output. And the mode 'public-keys' would result in a stack trace. This fixes those 2 issues and adds argparse so we get some help.	Scott Moser	8 years ago
358	Add bond parsing & improved source, source-directory parsing... Add bond parsing & improved source, source-directory parsing for /e/n/i. This give the ability for the parser to handle bond interface in the /etc/network/interfaces configuration. The resulting dictionary will contain a bond dictionary if any bond options are defined for that interface definition in /etc/network/interfaces. Improves the source and source-directory parsing to match was is documented in /etc/network/interfaces for ubuntu. Supports parsing glob in both source and source-directory and performs regex matching for source-directory to parse the same as /etc/network/interfaces is defined. A _source_path key is provided in each dictionary entry for each element defining the path the interface was created.	Ryan Harper	8 years ago
357	tox.ini: run with 'python3' rather than python3.4 or python3... tox.ini: run with 'python3' rather than python3.4 or python3.5 There is python3 on xenial, but it is python3.5 which differs from the python3.4 which is on trusty. This change still allows 'tox' to work on trusty. Admittedly, we do test python3.5 only on xenial and python3.4 only on trusty, but we can solve that at a future date.	Scott Moser	8 years ago
356	curtin/net: move global dns-* options under auto lo in ENI curtin/net: move global dns-* options under auto lo in ENI ifupdown expects any dns-* options to be related to an iface stanza The only iface ensured to be called with ifup is lo; moving the dns-* parameters under iface lo allows dns options to always be present even if other interfaces are not ifup'ed. Update unittests and add new vmtest (TestNetworkStatic) to confirm proper configuration under lo iface.	Ryan Harper	8 years ago
355	vmtests: implement uefi boot mode via pflash vmtests: implement uefi boot mode via pflash Add support for uefi to tools/launch and teach vmtests to switch to uefi pflash mode if requested. vmtests generates and supplies the writable nvram file that's passed to launch now. The basic uefi test currently checks that expected files are in /sys/firmware/efi/*. Handle older combined OVMF format found on trusty hosts as well as the newer split firmware in Wily and newer.	Ryan Harper	8 years ago
354	vmtest: fix regression in psuedo tests vmtest: fix regression in psuedo tests The psuedo test class was broken by the last commit. This is a simple fix for: nosetests3 tests/vmtests/test_vmtests.py	Scott Moser	8 years ago
353	Hardware Enablement Stack (HWE) Tests for Trusty and Precise Hardware Enablement Stack (HWE) Tests for Trusty and Precise This series strives for better vmtest coverage of HWE Kernels by: - Provide infrastructure for HWE Tests - Defining Trusty-HWE-[uvw] in various tests (all working). - Basic - Bonding - Network - Raid5Bcache - LVM - We didn't define all (where we considered them covered otherwise) - we did not enable all of them as a tradeoff to CI test execution time. - Define minimal Precise-HWE-T Tests - enabled one Disk case (Bcache basic) - enabled one Net case (bonding) - some more defined but disabled (comment lists last known issue)	Scott Moser	8 years ago
352	vmtest: when putting console to debug log, decode with error... vmtest: when putting console to debug log, decode with errors=replace The console logs from boot and install are not guaranteed to have utf-8 decodable content written to them. This would cause a stacktrace on the failure to decode. In practice, I saw this when testing precise while working on UEFI.	Scott Moser	9 years ago
351	partitioning: limited support for odd ordering of partition ... partitioning: limited support for odd ordering of partition numbers This fixes a bug in the partitioning code where it assumes that the previous partition is numbered N-1. That is not always the case. The change here is very focused on: a.) Being non-invasive. b.) fixing bug 1543263 and allowing maas to send configuration for power that "hides" the PReP partition as number 15 so they don't have to really show it to the user. Ultimately, we want to re-write the partitioning code to walk through the storage config and correctly fill in number, start and end for each entry. That is a more invasive and time-consuming change though. This also adds another disk to examples/tests/basic.yaml and tests that it is partitioned as expected in tests/vmtests/test_lvm.py	Scott Moser	9 years ago
350	fix dpkg build and make check on trusty fix dpkg build and make check on trusty Change run-pyflakes to not run python2 pyflakes on tests/vmtests. On trusty's version of pyflakes 'make check' will fail with: Running: pyflakes curtin/ tests/ tests/vmtests/__init__.py:221: undefined name 'FileNotFoundError' Interestingly, xenial's pyflakes is ok with that. The vmtests/ code is not intended to be python2, so there is no reason to run pyflakes for python2 on that.	Scott Moser	9 years ago
349	Add strict flag to sys_block_path and verify path exists Add strict flag to sys_block_path and verify path exists This adds 'strict=True' to sys_block_path so it will verify that the path exists and raise an ENOENT OSError if it does not.	Scott Moser	9 years ago
348	vmtest: image_sync: fix removal of old directories vmtest: image_sync: fix removal of old directories The net of these changes is that we now cleanup old directories when we were not doing so before. The changes specifically: - use remove_item rather than remove_version. remove_version had nothing in the data that was being passed to us as the tree had already had all the items removed from it. So when walking 'for item in ...' there were no items. - change a print to a LOG.info() info is admittedly a bit loud, but for now we want to see it. - remove_empty_dir: one clear bug fix. the indentation was broken and we would only call recursively if it did end with a /. instead remove trailing / before calling dirname. Now calls look like: remove_empty_dir("foo/bar/zee/////") # remove foo/bar/zee remove_empty_dir("foo/bar") remove_empty_dir("foo")	Scott Moser	9 years ago

Older »