mirror of
https://github.com/anchore/syft.git
synced 2026-10-30 22:12:28 +01:00
* migrate fixtures to testdata Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> * fix: correct broken symlinks after testdata migration The migration from test-fixtures to testdata broke several symlinks: - elf-test-fixtures symlinks pointed to old test-fixtures paths - elf-test-fixtures needed to be renamed to elf-testdata - image-pkg-coverage symlink pointed to test-fixtures instead of testdata Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> * fix: handle missing classifiers/bin directory in Makefile The clean-fingerprint target was failing when classifiers/bin doesn't exist (e.g., on fresh clone without downloaded binaries). Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> * fix: add gitignore negation for jar/zip fixtures in test/cli The jar and zip files in test/cli/testdata/image-unknowns were being gitignored by the root .gitignore patterns. This caused them to be untracked and not included when building docker images in CI, resulting in Test_Unknowns failures since the test expects errors from corrupt archive files that weren't present. Add a .gitignore in test/cli/testdata to negate the exclusions for these specific test fixture files. Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> * switch fixture cache to v2 Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> * test: update expected versions for rebuilt fixtures Update test expectations for packages that have been updated in upstream repositories when docker images are rebuilt: - glibc: 2.42-r4 → 2.43-r1 (wolfi) - php: 8.2.29 → 8.2.30 (ubuntu/apache) Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> * upgrade go Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> * fix: add go-shlex dependency for testdata manager tool The manager tool in syft/pkg/cataloger/binary/testdata/ imports go-shlex, but since it's in a testdata directory, Go doesn't track its dependencies. This caused CI failures when go.mod didn't explicitly list the dependency. Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> * refactor: move binary classifier manager to internal/ Move the manager tool from testdata/manager to internal/manager so that Go properly tracks its dependencies. Code in testdata directories is ignored by Go for dependency tracking, which caused CI failures when go.mod didn't explicitly list transitive dependencies. This is a cleaner solution than manually adding dependencies to go.mod for code that happens to live in testdata. Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> * fix: add gitignore negations for test fixtures blocked by root patterns Multiple test fixtures were being blocked by root-level gitignore patterns like bin/, *.jar, *.tar, and *.exe. This adds targeted .gitignore files with negation patterns to allow these specific test fixtures to be tracked: - syft/linux/testdata/os/busybox/bin/busybox (blocked by bin/) - syft/pkg/cataloger/java/testdata/corrupt/example.{jar,tar} (blocked by *.jar, *.tar) - syft/pkg/cataloger/binary/testdata/classifiers/snippets/go-version-hint/**/bin/go (blocked by bin/) - syft/pkg/cataloger/bitnami/testdata/no-rel/.../bin/redis-server (blocked by bin/) Also updates the bitnami test expectation to include the newly required .gitignore files in the test fixture. Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> * test: update glibc version expectation (2.43-r1 -> 2.43-r2) Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> * add capability drift check as unit step Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> * dont clear test observations before drift detection Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> * bump stereoscope commit to main Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com> --------- Signed-off-by: Alex Goodman <wagoodman@users.noreply.github.com>
71 lines
2.2 KiB
Python
Executable File
71 lines
2.2 KiB
Python
Executable File
#!/usr/bin/env python3
|
|
|
|
import os
|
|
import subprocess
|
|
import hashlib
|
|
|
|
BOLD = '\033[1m'
|
|
YELLOW = '\033[0;33m'
|
|
RESET = '\033[0m'
|
|
|
|
|
|
def print_message(message):
|
|
print(f"{YELLOW}{message}{RESET}")
|
|
|
|
|
|
def sha256sum(filepath):
|
|
h = hashlib.sha256()
|
|
with open(filepath, 'rb') as f:
|
|
for chunk in iter(lambda: f.read(4096), b""):
|
|
h.update(chunk)
|
|
return h.hexdigest()
|
|
|
|
|
|
def is_git_tracked_or_untracked(directory):
|
|
"""Returns a sorted list of files in the directory that are tracked or not ignored by Git."""
|
|
result = subprocess.run(
|
|
["git", "ls-files", "--cached", "--others", "--exclude-standard"],
|
|
cwd=directory,
|
|
stdout=subprocess.PIPE,
|
|
text=True
|
|
)
|
|
return sorted(result.stdout.strip().splitlines())
|
|
|
|
|
|
def find_test_fixture_dirs_with_images(base_dir):
|
|
"""Find directories that contain 'testdata' and at least one 'image-*' directory."""
|
|
for root, dirs, files in os.walk(base_dir):
|
|
if 'testdata' in root:
|
|
image_dirs = [d for d in dirs if d.startswith('image-')]
|
|
if image_dirs:
|
|
yield os.path.realpath(root)
|
|
|
|
|
|
def generate_fingerprints():
|
|
print_message("creating fingerprint files for docker fixtures...")
|
|
|
|
for test_fixture_dir in find_test_fixture_dirs_with_images('.'):
|
|
cache_fingerprint_path = os.path.join(test_fixture_dir, 'cache.fingerprint')
|
|
|
|
with open(cache_fingerprint_path, 'w') as fingerprint_file:
|
|
for image_dir in find_image_dirs(test_fixture_dir):
|
|
for file in is_git_tracked_or_untracked(image_dir):
|
|
file_path = os.path.join(image_dir, file)
|
|
checksum = sha256sum(file_path)
|
|
path_from_fixture_dir = os.path.relpath(file_path, test_fixture_dir)
|
|
fingerprint_file.write(f"{checksum} {path_from_fixture_dir}\n")
|
|
|
|
|
|
def find_image_dirs(test_fixture_dir):
|
|
"""Find all 'image-*' directories inside a given test-fixture directory."""
|
|
result = []
|
|
for root, dirs, files in os.walk(test_fixture_dir):
|
|
for dir_name in dirs:
|
|
if dir_name.startswith('image-'):
|
|
result.append(os.path.join(root, dir_name))
|
|
return sorted(result)
|
|
|
|
|
|
if __name__ == "__main__":
|
|
generate_fingerprints()
|