~wesley-wiedenmeier/curtin/vmtest-webhook-delay : changes

~wesley-wiedenmeier/curtin/vmtest-webhook-delay » Changes from revision 397

From Revision 377 to 358

Rev	Summary	Authors	Date
377	tools/vmtest-sync-images: fix insertion of top-level curtin ... tools/vmtest-sync-images: fix insertion of top-level curtin path Fix up sys.path to import realpath of top-level curtin directory to make it equivalent to running PYTHONPATH=`pwd` from top-level. This fixed an issue with sub-module level imports.	Ryan Harper	8 years ago
376	block: wipe_volume improvements block: wipe_volume improvements - move wipe_volume, find_sysfs_path, from block_meta to block - improve wipe_volume: - do not shell out for 'dd' and ignore errors - add 'superblocks' mode that wipes start and end of existing partitions in addition to volume. - pick 4M as the default size for writes. This is easily modified. - add block-wipe subcommand for: curtin block-wipe --mode=random /dev/vdb /dev/vdc - sysfs_partition_data: this returns information on partitions on a given block device. - sys_block_path: handle case where devpath is a partition and prepend parent dev into path. Note, this does not call rereadpt as sgdisk --zap-all would. We probably want to add the ability to do that. The reason I dont have it yet is that in newer ubuntu systemd is watching readwrite opens on the block devices and will issue rereadpt when those are closed.	Ryan Harper	8 years ago
375	reporter: enhance reporting events to include levels and use... reporter: enhance reporting events to include levels and user-friendly messages Much of the output from curtin reporting is not user-friendly. Address this by introducing message levels to supress debugging information as well as adding higher-level messages that inform users of the progress of the curtin installation.	Ryan Harper	8 years ago
374	network,unittest: add bonding tests and cleanup newline rend... network,unittest: add bonding tests and cleanup newline rendering - Add a unittest to validate bonding network config render, specifically when to emit auto $iface for dependent bond slaves. - Cleanup newline logic so we always have a clean '\n\n' between stanzas - Add '# Autogenerated by curtin' header to to 70-persistent-net.rules file - Add Xenial bonding testcase	Ryan Harper	8 years ago
373	block: fix partition path issue with nvme devices block: fix partition path issue with nvme devices - added vmtest test case for nvme devices using qemu nvme emulation - when finding the kname of a partition curtin will check if the partition is a nvme device and prepend a 'p' before the partition number to ensure that the kname is in the format nvme<DEVNUM>p<PARTNUM> - curtin will do the same for mmcblk devices since they also prepend a 'p' to the partition number - since the partition number is still represented numerically and is only converted to this format when used, previous determine_partition_number code does not need to be modified, so there will not be any change to config files needed for nvme devices - Disable nvme on precise (does not support it without HWE kernels) Trusty and Vivid do not have /sys/class/nvme, use /dev/nvme* instead Add additional collect files for easier debugging. - disable arch s390x, does not support nvme pci disks	Ryan Harper	8 years ago
372	curthooks: fix logic error in kernel installation curthooks: fix logic error in kernel installation If a kernel package was available but not installed the code would use the fallback path, rather than installing it. This fixes the logic error and uses 'has_pkg_available'.	Ryan Harper	8 years ago
371	block: add debug regarding raid modules being missing on mda... block: add debug regarding raid modules being missing on mdadm create While testing for Precise with HWE Kernels we ran into Launchpad bug 1519470 again. To make the error more readable to what actually causes it we add some lsmod and modinfo before. Before just: Stderr: u'mdadm: Defaulting to version 1.2 metadata\nmdadm: RUN_ARRAY failed: Invalid argument\n' Now augmented by a clear: mdadm_create failed - extra debug regarding md modules Running command ['lsmod'] with allowed return codes [0] (shell=False, capture=True) modules loaded: Module Size Used by dm_crypt 23456 0 iscsi_tcp 18587 0 libiscsi_tcp 25377 1 iscsi_tcp libiscsi 57717 2 iscsi_tcp,libiscsi_tcp scsi_transport_iscsi 89953 3 iscsi_tcp,libiscsi floppy 70207 0 pata_acpi 13038 0 Running command ['find', '/lib/modules/3.13.0-77-generic/kernel/drivers/md'] with allowed return codes [0, 1] (shell=False, capture=True) no available md modules found Along it fixes an issue in PsuedoTests that was introduced with the HWE testing.	Ryan Harper	8 years ago
370	debian/control: fix coverage package typo debian/control: fix coverage package typo	Ryan Harper	8 years ago
369	Enable "showtrace: true" in all of curtin's vmtest configs Enable "showtrace: true" in all of curtin's vmtest configs	Ryan Harper	8 years ago
368	Enable python coverage for unittests Enable python coverage for unittests make check runs coverage results for both pythons. Update tox to also run coverage targets	Ryan Harper	8 years ago
367	add s390x support to curtin and vmtest add s390x support to curtin and vmtest - use virtio ccw bus by default - bump install_timeout to 30 minutes (kvm on zvm can be slow, installing things across the atlantic) - query "default" architecture from python - add zipl support - use a bootloader agnostic "successful" installation watermark - vmtests: Add arch_skip field to allow vmtests to be skipped on specific arches For example, bcache is currently broken on s390x, and uefi will never work.	Ryan Harper	8 years ago
366	curtin: fix tox errors in curtin/commands/main.py due to ups... curtin: fix tox errors in curtin/commands/main.py due to upstream pylint upload pylint levels changed upstream in pipi causing new failures: E:208,13: Instance of 'argv' has no 'reportstack' member (but some types could not be inferred) (maybe-no-member) E:209,18: Instance of 'argv' has no 'func' member (but some types could not be inferred) (maybe-no-member) Resolve by specifying the pylint version in tox.ini In addition, update curtin/commands/main.py to not fail upstream tox checks as well.	Ryan Harper	8 years ago
365	debian/control: fix build-depends for xenial build debian/control: fix build-depends for xenial build python3 support was moved out of pyflakes into python3-pyflakes. Adjust the package to build on trusty where python3-pyflakes was not present and also on xenial where it is. Note, this does mean that sbuild now requires '--resolve-alternatives'. That is how it is used on launchpad but is not the default in sbuild.	Scott Moser	8 years ago
364	fix pep8 issue on trusty, add a tox environment to catch tha... fix pep8 issue on trusty, add a tox environment to catch that. Recent merge worked fine in tox, but build on trusty failed due to pep8 complaints. This adds a 'trusty-check' environment to tox that will catch errors like that.	Scott Moser	8 years ago
363	mkfs: handle fstype: vfat mkfs: handle fstype: vfat Prior to commit 343, block_meta custom handled 'fstype: vfat' via fallthrough and invoked mkfs.vfat without options. Restore this by adding 'vfat' to the fstype dictionary. Add a unittest to ensure we don't break fstype: vfat in the future.	Scott Moser	8 years ago
362	save the curtin install config to /root/curtin-install-cfg.y... save the curtin install config to /root/curtin-install-cfg.yaml this is configurable via 'save_install_config'. Setting the value to non-true value ("" or null) will stop the writing of this file.	Scott Moser	8 years ago
361	deps: install dependencies without apt recommends deps: install dependencies without apt recommends Curtin should list the dependencies it has explicitly rather than relying on recommends. That has 2 benefits: a.) better knowing what the dependencies actually are b.) smaller footprint/less installed packages. Specifically, this means that on the following releases, we do not install the listed packages: precise: default-mta mail-transport-agent trusty: default-mta mail-transport-agent vivid: default-mta mail-transport-agent wily: default-mta mail-transport-agent module-init-tools There are no changes to packages installed as deps in xenial, as xenial maas/cloud image already has all dependencies. Note, this only affects how curtin installs its own dependencies (through 'curtin --install-deps') not how apt would install it.	Scott Moser	8 years ago
360	fix tox running for python2 on trusty fix tox running for python2 on trusty This is similar to commit 350. We do not run python2 checkers against tests/vmtests. For some reason this just started failing. The change is to just add a py2-flake8 and py3-flake8 environment. Note, we are not running py2-flake8 by default right now (its not in the env list)	Scott Moser	8 years ago
359	tools/ssh-keys-list: fix a bug in modes, add argparse tools/ssh-keys-list: fix a bug in modes, add argparse There was actually no way to request 'json' output. And the mode 'public-keys' would result in a stack trace. This fixes those 2 issues and adds argparse so we get some help.	Scott Moser	8 years ago
358	Add bond parsing & improved source, source-directory parsing... Add bond parsing & improved source, source-directory parsing for /e/n/i. This give the ability for the parser to handle bond interface in the /etc/network/interfaces configuration. The resulting dictionary will contain a bond dictionary if any bond options are defined for that interface definition in /etc/network/interfaces. Improves the source and source-directory parsing to match was is documented in /etc/network/interfaces for ubuntu. Supports parsing glob in both source and source-directory and performs regex matching for source-directory to parse the same as /etc/network/interfaces is defined. A _source_path key is provided in each dictionary entry for each element defining the path the interface was created.	Ryan Harper	8 years ago