~wesley-wiedenmeier/curtin/reporting-cleanup-rebase : changes

~wesley-wiedenmeier/curtin/reporting-cleanup-rebase » Changes from revision 385

From Revision 385 to 366

Rev	Summary	Authors	Date
385	Reverted local revision 383 which was a fix for reporter tim... Reverted local revision 383 which was a fix for reporter timestamps not being set correctly, as a different implementation of the same fix already went into trunk	Wesley Wiedenmeier	8 years ago
384	Merged from trunk Merged from trunk	Wesley Wiedenmeier	8 years ago
383	In reporter.events, set timestamp on reporting events as rep... In reporter.events, set timestamp on reporting events as report_event() is being called rather than as the event is being created. This prevents timestamps from being duplicated as seen in http://paste.ubuntu.com/15951580/	Wesley Wiedenmeier	8 years ago
382	A bit more verification of reporting in vmtests A bit more verification of reporting in vmtests	Wesley Wiedenmeier	8 years ago
381	Cleaned up reporting event descript alterations. Where the p... Cleaned up reporting event descript alterations. Where the prvious solution changed description strings for all start and finish events, this only changes them as they are being reported for webhooks without modifying the event. This means that for print handler and log handler output will not have extraneous 'started: ' messages in it as event.as_string() already appends a 'start: ' and 'finish: ' prefix message as needed	Wesley Wiedenmeier	8 years ago
380	Added webhooks reporting data capture to vmtests. Added webhooks reporting data capture to vmtests. - In tools/report_webhook_logger.py a new context manager has been added that runs a webserver in a separate thread to capture reporting data - A function has been added to vmtests/__init__.py to determine the lan ip of the host of the vmtests using iproute2 - In vmtests/__init__.py an additional configuration file is written and passed into curtin that instructs it to report events to the host of the vmtests - New test function added to verify contents of captured reporting. currently only contains basic check, more to be added later	Wesley Wiedenmeier	8 years ago
379	Replaced tools/report-webhook-logger with tools/report_webho... Replaced tools/report-webhook-logger with tools/report_webhook_logger.py: - refactored to work as a module to capture curtin reporting - module contains a generator for a http handler that logs wehbook events to a json dump instead of stdout - can still be run as a script that outputs to stdout	Wesley Wiedenmeier	8 years ago
378	Improved formatting of error messages for ProcessExecutionEr... Improved formatting of error messages for ProcessExecutionError. Instead of displaying message as a byte sequence with \n characters, format onto separate lines with indentation. Pulled from lp:~wesley-wiedenmeier/curtin/error-output	Wesley Wiedenmeier	8 years ago
377	tools/vmtest-sync-images: fix insertion of top-level curtin ... tools/vmtest-sync-images: fix insertion of top-level curtin path Fix up sys.path to import realpath of top-level curtin directory to make it equivalent to running PYTHONPATH=`pwd` from top-level. This fixed an issue with sub-module level imports.	Ryan Harper	8 years ago
376	block: wipe_volume improvements block: wipe_volume improvements - move wipe_volume, find_sysfs_path, from block_meta to block - improve wipe_volume: - do not shell out for 'dd' and ignore errors - add 'superblocks' mode that wipes start and end of existing partitions in addition to volume. - pick 4M as the default size for writes. This is easily modified. - add block-wipe subcommand for: curtin block-wipe --mode=random /dev/vdb /dev/vdc - sysfs_partition_data: this returns information on partitions on a given block device. - sys_block_path: handle case where devpath is a partition and prepend parent dev into path. Note, this does not call rereadpt as sgdisk --zap-all would. We probably want to add the ability to do that. The reason I dont have it yet is that in newer ubuntu systemd is watching readwrite opens on the block devices and will issue rereadpt when those are closed.	Ryan Harper	8 years ago
375	reporter: enhance reporting events to include levels and use... reporter: enhance reporting events to include levels and user-friendly messages Much of the output from curtin reporting is not user-friendly. Address this by introducing message levels to supress debugging information as well as adding higher-level messages that inform users of the progress of the curtin installation.	Ryan Harper	8 years ago
374	network,unittest: add bonding tests and cleanup newline rend... network,unittest: add bonding tests and cleanup newline rendering - Add a unittest to validate bonding network config render, specifically when to emit auto $iface for dependent bond slaves. - Cleanup newline logic so we always have a clean '\n\n' between stanzas - Add '# Autogenerated by curtin' header to to 70-persistent-net.rules file - Add Xenial bonding testcase	Ryan Harper	8 years ago
373	block: fix partition path issue with nvme devices block: fix partition path issue with nvme devices - added vmtest test case for nvme devices using qemu nvme emulation - when finding the kname of a partition curtin will check if the partition is a nvme device and prepend a 'p' before the partition number to ensure that the kname is in the format nvme<DEVNUM>p<PARTNUM> - curtin will do the same for mmcblk devices since they also prepend a 'p' to the partition number - since the partition number is still represented numerically and is only converted to this format when used, previous determine_partition_number code does not need to be modified, so there will not be any change to config files needed for nvme devices - Disable nvme on precise (does not support it without HWE kernels) Trusty and Vivid do not have /sys/class/nvme, use /dev/nvme* instead Add additional collect files for easier debugging. - disable arch s390x, does not support nvme pci disks	Ryan Harper	8 years ago
372	curthooks: fix logic error in kernel installation curthooks: fix logic error in kernel installation If a kernel package was available but not installed the code would use the fallback path, rather than installing it. This fixes the logic error and uses 'has_pkg_available'.	Ryan Harper	8 years ago
371	block: add debug regarding raid modules being missing on mda... block: add debug regarding raid modules being missing on mdadm create While testing for Precise with HWE Kernels we ran into Launchpad bug 1519470 again. To make the error more readable to what actually causes it we add some lsmod and modinfo before. Before just: Stderr: u'mdadm: Defaulting to version 1.2 metadata\nmdadm: RUN_ARRAY failed: Invalid argument\n' Now augmented by a clear: mdadm_create failed - extra debug regarding md modules Running command ['lsmod'] with allowed return codes [0] (shell=False, capture=True) modules loaded: Module Size Used by dm_crypt 23456 0 iscsi_tcp 18587 0 libiscsi_tcp 25377 1 iscsi_tcp libiscsi 57717 2 iscsi_tcp,libiscsi_tcp scsi_transport_iscsi 89953 3 iscsi_tcp,libiscsi floppy 70207 0 pata_acpi 13038 0 Running command ['find', '/lib/modules/3.13.0-77-generic/kernel/drivers/md'] with allowed return codes [0, 1] (shell=False, capture=True) no available md modules found Along it fixes an issue in PsuedoTests that was introduced with the HWE testing.	Ryan Harper	8 years ago
370	debian/control: fix coverage package typo debian/control: fix coverage package typo	Ryan Harper	8 years ago
369	Enable "showtrace: true" in all of curtin's vmtest configs Enable "showtrace: true" in all of curtin's vmtest configs	Ryan Harper	8 years ago
368	Enable python coverage for unittests Enable python coverage for unittests make check runs coverage results for both pythons. Update tox to also run coverage targets	Ryan Harper	8 years ago
367	add s390x support to curtin and vmtest add s390x support to curtin and vmtest - use virtio ccw bus by default - bump install_timeout to 30 minutes (kvm on zvm can be slow, installing things across the atlantic) - query "default" architecture from python - add zipl support - use a bootloader agnostic "successful" installation watermark - vmtests: Add arch_skip field to allow vmtests to be skipped on specific arches For example, bcache is currently broken on s390x, and uefi will never work.	Ryan Harper	8 years ago
366	curtin: fix tox errors in curtin/commands/main.py due to ups... curtin: fix tox errors in curtin/commands/main.py due to upstream pylint upload pylint levels changed upstream in pipi causing new failures: E:208,13: Instance of 'argv' has no 'reportstack' member (but some types could not be inferred) (maybe-no-member) E:209,18: Instance of 'argv' has no 'func' member (but some types could not be inferred) (maybe-no-member) Resolve by specifying the pylint version in tox.ini In addition, update curtin/commands/main.py to not fail upstream tox checks as well.	Ryan Harper	8 years ago

Older »