Testing

Full test suite

task test

Runs all unit tests, sync tests, CLI tests, and payload execution tests. Some platform-specific execution cases still skip when required runners, QEMU binaries, ptrace support, or network primitives are unavailable.

Filtered runs

task test -- -v                           # verbose output
task test:payload                         # only payload execution tests
task test:unit                            # only unit/sync tests
task test -- --os linux --arch x86_64     # filter by platform
task test -- --type hello                 # filter by blob type
task test -- -k test_payload_hello        # pytest -k expression

Via picblobs-cli

picblobs-cli test                          # run pytest
picblobs-cli test -v -k test_sync         # specific tests
picblobs-cli test --os linux --arch x86_64 # filtered

Test architecture

Tests are organized by category:

File	What it tests
`test_payload_hello.py`	hello + hello_windows execution on all platforms, structural checks
`test_payload_nacl.py`	nacl_hello self-test on all platforms, nacl_client + nacl_server e2e encrypted handshake
`test_payload_alloc_jump.py`	alloc_jump execution + edge cases
`test_payload_reflective.py`	reflective_pe loader
`test_payload_stager.py`	TCP, FD, pipe, mmap stagers with infrastructure fixtures
`test_payload_ul_exec.py`	Userland exec: load and run ELF binaries without execve()
`test_extractor.py`	Sidecar loading helpers
`test_freebsd_syscall_wrapper.py`	FreeBSD syscall wrapper generation and compatibility
`test_packaging_metadata.py`	Python package metadata and release catalog checks
`test_python_api.py`	Public Python API and builder behavior
`test_quality_paths.py`	Shared quality-tool path filtering
`test_release_loading.py`	Runtime loading path (.bin + .json sidecar, manifest)
`test_runner.py`	QEMU runner orchestration, blob preparation
`test_sync.py`	Registry sync: generated files, platform configs, syscall tables
`python_cli/tests/test_picblobs_cli.py`	CLI argument parsing and commands

Payload tests are registry-driven: the test matrix is blob_type x os x arch, generated from tools/registry.py. Tests auto-skip when a blob or runner isn't staged. Adding a new payload and building it is sufficient to activate its tests.

See spec/verification/TEST-011-payload-pytest-suite.md for the full test specification.