~linaro-infrastructure/linaro-license-protection/master : changes

~linaro-infrastructure/linaro-license-protection/master » Changes from revision 522

From Revision 460 to 441

Rev	Summary	Authors	Date
460	s3_purge: fix the releases deletemarker bug and code cleanup s3_purge: fix the releases deletemarker bug and code cleanup When testing this the releases/ bucket wasn't checking that the deletemarker was being set. Obviously this is very dangerous so a fix has been put in to ensure a deletemarker is set before deleting the file. Since we handle the same call a couple of times, I have put handle_permanent_deletes, into its own function which has reduced a lot of reputation. Along with those fix, the code has been cleaned up to be a bit more readable Change-Id: Iffd2f55d04bc889050bfd7a19e6f62fe205de0c6 Reviewed-on: https://review.linaro.org/29085 Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Benjamin Copeland	5 years ago
459	s3_purge: Delete S3 versioned objects s3_purge: Delete S3 versioned objects Our bucket has grown too big over time, this change will allow S3 objects to be fully deleted from S3. The script is split into two ways (ish): 1. No options will mark the objects that are over --markdays as deleted. This is only a version marker in S3 and as such will now delete the file. 2. --forcedelete is used to permanently delete that marked file. This is only ran within the deletedays period. 2a. --cleanup_releases. This cleans up all marked objects in the releases/ prefix. This needs to be used with --forcedelete since it will permanently delete objects. Since we don't have a life time policy for releases/ this is only ever going to delete files that are older than deletedays. Change-Id: I438526978c186f96af4ee689bd0eb2340bc94c01 Reviewed-on: https://review.linaro.org/28796 Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Benjamin Copeland	5 years ago
458	Whitelist: Add lkft.validation.linaro.org Whitelist: Add lkft.validation.linaro.org Change-Id: I4308a9c9feb5ca1ae7ec4064f9cfbbc89d8c8657 Reviewed-on: https://review.linaro.org/28709 Reviewed-by: Fathi Boudra <fathi.boudra@linaro.org>	Benjamin Copeland	5 years ago
457	Whitelist: Update whitelist for ARM Whitelist: Update whitelist for ARM Change-Id: Id0d88667e8db2254aa2c6107c25ea14ee54837c8 Reviewed-on: https://review.linaro.org/28015 Reviewed-by: Julien Duraj <julien.duraj@linaro.org> Reviewed-by: Kelley Spoon <kelley.spoon@linaro.org> Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Benjamin Copeland	5 years ago
456	Settings: import proxy_settings file if present Settings: import proxy_settings file if present Change-Id: I02bc268554a31b17e0f78a4c518ddf8575091cb2 Reviewed-on: https://review.linaro.org/25516 Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Kelley Spoon	6 years ago
455	Settings: expand check for SECRET_KEY Settings: expand check for SECRET_KEY Previously we just tried to import local_settings and assumed SECRET_KEY was set if successful. Now that we store other settings in there, we have to explicitly check that SECRET_KEY is defined and not None. Change-Id: If3b34e2733c2f0189694f7e9cdc70b6de0b4363a Reviewed-on: https://review.linaro.org/25502 Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Kelley Spoon	6 years ago
454	Settings: Move report csv to prevent overwrites in docker Settings: Move report csv to prevent overwrites in docker Because our docker design allows us to run multiple containers that all share the same project directory, we need a way to distinguish report CSVs and their lock files running on different hosts. This change moves the report CSV up one directory (which will be /srv in docker and /srv/<container> on the host). Change-Id: I451ea1c454be00e0f98f897ff450c6197c7b001f Reviewed-on: https://review.linaro.org/25394 Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Kelley Spoon	6 years ago
453	Revert "Settings: Remove legacy folder creation" Revert "Settings: Remove legacy folder creation" This reverts commit b5a105b5b43f3f72b7758553bd203b6ad99c0328 due to showing the sampleroot folder. Change-Id: Ibca02b5f6f7849f457bbe346b2de448cc1ef9e6e Reviewed-on: https://review.linaro.org/25419 Reviewed-by: Kelley Spoon <kelley.spoon@linaro.org> Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Benjamin Copeland	6 years ago
452	Settings: Remove legacy folder creation Settings: Remove legacy folder creation We don't need to create these folders anymore using S3, lets get rid of it. Change-Id: I246ff38c0ac23724a59d235da963f5b47f2e3ad9 Reviewed-on: https://review.linaro.org/25143 Reviewed-by: Kelley Spoon <kelley.spoon@linaro.org> Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Benjamin Copeland	6 years ago
451	Docker: Update docker command Docker: Update docker command We should run collectstatic and migrate every time, lets be able to define it in CLI. Also when running docker in production mode we should define the hostname, then we do not need to put edit production settings to have DEBUG=True Change-Id: I3edd69b53e9c542e8ed385fd7adea665f8e206bf Reviewed-on: https://review.linaro.org/25201 Reviewed-by: Kelley Spoon <kelley.spoon@linaro.org> Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Benjamin Copeland	6 years ago
450	site_name: Set hostname using settings file site_name: Set hostname using settings file Setting the hostname using environmental variables is causing issues with our docker/gunicorn. It also makes config sit in Apache file or another location. Lets localize the config and set it in ansible using secrets.py. Change-Id: I3d804419cffae1adbafa781c3857c7e23cfa644f Reviewed-on: https://review.linaro.org/25144 Reviewed-by: Kelley Spoon <kelley.spoon@linaro.org> Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Benjamin Copeland	6 years ago
449	Docker: add a script to reload gunicorn from outside the con... Docker: add a script to reload gunicorn from outside the container Change-Id: I020bc19a4c2e2cc80035feaa56f3350063f394ca Reviewed-on: https://review.linaro.org/24392 Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Kelley Spoon	6 years ago
448	Whitelist: Update whitelist IPS Whitelist: Update whitelist IPS Update whitelist IPS to the current slave list Change-Id: I716c25957bbbdf0591061c1e224b9a8a69ac5458 Reviewed-on: https://review.linaro.org/25054 Reviewed-by: Vishal Bhoj <vishal.bhoj@linaro.org> Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Benjamin Copeland	6 years ago
447	Dockerfile: Update README Dockerfile: Update README Update README to use the commands to use Django in runserver mode and gunicorn mode. Change-Id: Ibe7e41aa762071eb16c41f3866cf7efc1ce6fd28 Reviewed-on: https://review.linaro.org/24657 Reviewed-by: Kyle Kirkby <kyle.kirkby@linaro.org> Reviewed-by: Fathi Boudra <fathi.boudra@linaro.org>	Benjamin Copeland	6 years ago
446	Revert "Views: Option to disable protection." Revert "Views: Option to disable protection." This reverts commit bf46de697e99716ebe37943ca26d7081b8831f52. Change-Id: I18b7c219aa40198a0b01762594e2e51bf7044a73 Reviewed-on: https://review.linaro.org/24375 Reviewed-by: Kelley Spoon <kelley.spoon@linaro.org>	Benjamin Copeland	6 years ago
445	License: Make Digest field unique License: Make Digest field unique In very rare cases its possible to have two digest files, I don't see the need for this other than breaking Django query. Lets make it a unique field. Change-Id: I9bb8d1bba30b90b922bb76814bca8b77203f46fe Reviewed-on: https://review.linaro.org/24359 Reviewed-by: Kelley Spoon <kelley.spoon@linaro.org> Reviewed-by: Fathi Boudra <fathi.boudra@linaro.org> Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Benjamin Copeland	6 years ago
444	Template: Use a default icon if one does not exist Template: Use a default icon if one does not exist We have had quite a few bugs in the past where the icon does not exist. This causes the directory listing to break, instead of 404'ing on the image because we don't have the correct mimetype icon stored, lets default the "other.png" file Change-Id: If76fd561ef351af5ee06a22185a7734ff06333ba Reviewed-on: https://review.linaro.org/24365 Reviewed-by: Kelley Spoon <kelley.spoon@linaro.org> Reviewed-by: Fathi Boudra <fathi.boudra@linaro.org> Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Benjamin Copeland	6 years ago
443	Docker: Update to correct port Docker: Update to correct port We use 8080 so this command is wrong, lets update to correct port. Change-Id: I45b6bb47c4ac899fdcb11cfeedc78c6f89872a30 Reviewed-on: https://review.linaro.org/24348 Reviewed-by: Kelley Spoon <kelley.spoon@linaro.org>	Benjamin Copeland	6 years ago
442	Views: Option to disable protection. Views: Option to disable protection. Due to testdata not publishing BUILD_INFO files, we need to just serve static S3 content. In order to do this we need to disable license protection, since there isn't any. This setting should be set in our secrets.py file, and obviously set with extreme caution. Change-Id: Id25e017747b9fd4f2e4f8074ef65f5f4aa31f201 Reviewed-on: https://review.linaro.org/24331 Reviewed-by: Kelley Spoon <kelley.spoon@linaro.org>	Benjamin Copeland	6 years ago
441	Settings: Update TEMPLATES for django 1.11 Settings: Update TEMPLATES for django 1.11 The TEMPLATES config option was changed from a a list to a dict in 1.8 and deprecated. This removes a bug in code that's only triggered if header_override.html is present. Change-Id: I3e65fc5c41ba1ad12881061352be0567f8e49e6b Reviewed-on: https://review.linaro.org/24202 Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>	Kelley Spoon	6 years ago