← Back to branch summary

~linaro-infrastructure/linaro-license-protection/master

  • Committer: Kelley Spoon
  • Date: 2019-11-27 02:34:16 UTC
  • Revision ID: git-v1:70b49fc7aa6f108285721094b05199f7ecd1b341
s3_flatten: break bucket listing up by delimiters

Boto's bucket.list_version() function has the option to specify
a delimiter for the key names that are returned.  Delimiters
will treat any occurance of the character as if it was a new
directory and will not "descend" into it.

This change uses delimiters to traverse through all s3 file keys
in the given --prefix, and will clean up the objects table before
descending into a subdirectory in order to prevent wasting memory
storing s3 key data for objects that are no longer going to be
accessed.

Change-Id: I294937c99c60e89a87439789b9031f50e2e5cefc
Reviewed-on: https://review.linaro.org/c/infrastructure/linaro-license-protection/+/33359
Reviewed-by: Benjamin Copeland <ben.copeland@linaro.org>
Filename Latest Rev Last Changed Committer Comment Size
..
css 131 11 years ago Stevan Radakovic Predefined textfiles rendering support. Reviewed b Diff
js 131 11 years ago Stevan Radakovic Predefined textfiles rendering support. Reviewed b Diff
license_protected_downloads 86 11 years ago Danilo Segan Merge in django-refactoring. Diff
sampleroot 105 11 years ago Danilo Šegan Clean up unused files and READMEs (provide INSTALL Diff
scripts 29 12 years ago Danilo Segan Add uncommitted stuff: licenses/nolicense.html and Diff
templates 86 11 years ago Danilo Segan Merge in django-refactoring. Diff
testplans 75 12 years ago Stevan Radakovic Renamed directory with doctests for the new produc Diff
tests 76 12 years ago Danilo Šegan Clean up the Python code to adhere to PEP-8, do a Diff
.gitignore 435 6 years ago Benjamin Copeland Dockerfile: Include a dockerfile for debugging No 108 bytes Diff Download File
.gitreview 233 10 years ago Milo Casagrande Add .gitreview file. 93 bytes Diff Download File
.testr.conf 75.1.2 12 years ago Danilo Šegan Rename "testing" subdirectory to "tests". 91 bytes Diff Download File
__init__.py 84.1.2 11 years ago James Tunnicliffe Moved files out od django-rewrite. Combines .bzrig Empty Diff Download File
Dockerfile 473 4 years ago Benjamin Copeland Docker: Fix broken production command We need to 1.1 KB Diff Download File
HACKING 193.1.1 10 years ago James Tunnicliffe Updated buildinfo logic to be much faster at machi 3.8 KB Diff Download File
INSTALL 208.1.1 10 years ago Milo Casagrande Merged James branch. 1.6 KB Diff Download File
File manage.py 295 9 years ago Andy Doan fix import issues with recent versions of django 699 bytes Diff Download File
manage.sh 284 9 years ago Paul Sokolovsky manage.sh: Add helper script to call manage.py wit 527 bytes Diff Download File
README 468 4 years ago Riku Voipio Improve documentation Signed-off-by: Riku Voipio 7.8 KB Diff Download File
reload.sh 449 6 years ago Kelley Spoon Docker: add a script to reload gunicorn from outsi 96 bytes Diff Download File
requirements.txt 467 5 years ago Kelley Spoon textile: revert change to lockdown version of Text 178 bytes Diff Download File
settings.py 456 5 years ago Kelley Spoon Settings: import proxy_settings file if present C 10.5 KB Diff Download File
settings_production.py 454 6 years ago Kelley Spoon Settings: Move report csv to prevent overwrites in 1.1 KB Diff Download File
File unit-test.sh 397 8 years ago Ben Copeland unit-test: define python version Due to some OS'e 519 bytes Diff Download File
urls.py 439 6 years ago Benjamin Copeland URLS: Add missing view Our reports page is missin 4.5 KB Diff Download File
version.py 262 9 years ago Andy Doan bug #322: fix version information for snapshots T 642 bytes Diff Download File
wsgi_production.py 393 8 years ago Ben Copeland allowed_hosts: allow llp code to use a hosts file 776 bytes Diff Download File