Drop GIMP workload; make Inkscape export a tunable subset
GIMP 3 removed/renamed the Script-Fu PDB calls the workload relied on (plug-in-unsharp-mask, gimp-levels-stretch), so it is removed rather than maintained as best-effort. Inkscape now exports the first INKSCAPE_FILES SVGs (default 25) instead of all 121, cutting that step to well under a minute.
This commit is contained in:
smill
parent
13da8e986a
commit
cc9354e136
133 changed files with 32 additions and 5235 deletions
19
README.md
19
README.md
|
|
@ -63,7 +63,7 @@ You can run the parts in any order; run both on the same machine back to back.
|
|||
| `compare-report.py` | Cross-device / before-after results table + one bar chart per benchmark (`results/graphs/compare-*.png`). |
|
||||
| `results/` | Created at runtime: CSVs, logs, `results/graphs/*.png`. |
|
||||
| `tools/` | Bundled binaries: PassMark (`tools/pt/`). Ships with the kit — no download needed. |
|
||||
| `tools/corpus/` | Fixed sample inputs for the app workloads (LibreOffice docs, a GEGL/GIMP photo, Inkscape SVGs), fetched once and checksum-pinned. |
|
||||
| `tools/corpus/` | Fixed sample inputs for the app workloads (LibreOffice docs, a GEGL photo, Inkscape SVGs), fetched once and checksum-pinned. |
|
||||
|
||||
---
|
||||
|
||||
|
|
@ -94,7 +94,7 @@ hardware.
|
|||
for PassMark. Set `INSTALL_DEPS=0` to never install.
|
||||
- The LLM test needs **no** install: `llama-bench` and its small model are
|
||||
bundled under `tools/llama/` (see §4).
|
||||
- The **app workloads** (LibreOffice, GEGL, Inkscape, GIMP; see §4) are optional:
|
||||
- The **app workloads** (LibreOffice, GEGL, Inkscape; see §4) are optional:
|
||||
each step runs only if its command is installed, otherwise it is skipped and
|
||||
listed by `./run-benchmarks.sh doctor`.
|
||||
|
||||
|
|
@ -136,7 +136,7 @@ tools/llama/bin/llama-bench \
|
|||
```
|
||||
Override with `LLAMA_MODEL=` (any GGUF), or `LLAMA_NGL=` to offload to GPU.
|
||||
|
||||
### App workloads — LibreOffice / GEGL / Inkscape / GIMP (optional)
|
||||
### App workloads — LibreOffice / GEGL / Inkscape (optional)
|
||||
Stock distro applications are driven over a fixed sample corpus. Each is the
|
||||
app's own CLI, timed, named after the benchmark. Install the ones you want to
|
||||
measure:
|
||||
|
|
@ -144,14 +144,12 @@ measure:
|
|||
sudo dnf install -y libreoffice-writer libreoffice-calc # documents -> PDF
|
||||
sudo dnf install -y gegl04-tools # GEGL operations
|
||||
sudo dnf install -y inkscape # SVG -> PNG
|
||||
sudo dnf install -y gimp # GIMP batch operations (GIMP 3)
|
||||
```
|
||||
On first run the corpora are **fetched once** into `tools/corpus/` and
|
||||
checksum-verified (`lo-sample-documents-1.zip`, `sample-photo-6000x4000-1.zip`,
|
||||
`svg-test-files-1.zip`; ~12 MB total), then reused so both sides process identical
|
||||
bytes. Missing apps are skipped; skip the whole group with `RUN_APPS=0`. GIMP 3
|
||||
reshaped the Script-Fu API, so the GIMP step picks a version-appropriate script
|
||||
and is best-effort — check `results/gimp-<tag>.txt` if a number looks wrong.
|
||||
bytes. Set INKSCAPE_FILES=N to change how many SVGs Inkscape exports (default 25).
|
||||
Missing apps are skipped; skip the whole group with `RUN_APPS=0`.
|
||||
|
||||
> `run-benchmarks.sh` finds PassMark at `tools/pt/pt_linux_x64` **or**
|
||||
> `tools/pt/PerformanceTest/PerformanceTest_Linux_x86-64`. Override the location
|
||||
|
|
@ -225,8 +223,7 @@ Headless part (`~25-30 min` per pass):
|
|||
| 6 | llama.cpp generation (`2B`, CPU/RAM) | ~15 s | bundled; token-generation tok/s |
|
||||
| 6b | LibreOffice docs→PDF (20 docs) | ~0.5-1 min | fixed corpus |
|
||||
| 6c | GEGL image ops (9 on one 6000×4000 photo) | ~0.5-1 min | fixed corpus |
|
||||
| 6d | Inkscape SVG→PNG (fixed set) | ~1-2 min | fixed corpus |
|
||||
| 6e | GIMP batch ops (4) | ~1-2 min | GIMP 3, best-effort |
|
||||
| 6d | Inkscape SVG→PNG (first 25) | ~20-30 s | fixed corpus |
|
||||
| 7 | `fio` 4×30 s | 3-4 min | same SSD, control; runs as your user |
|
||||
| 8 | `stress-ng` 5 min + `turbostat` | ~8 min | thermals/power |
|
||||
| 9 | `systemd-analyze` | <1 min | informational |
|
||||
|
|
@ -334,7 +331,7 @@ a phase marker (exact or substring). Phase names:
|
|||
env idle PassMark-cpu PassMark-mem 7zip 7zip-1t openssl
|
||||
sysbench-1t sysbench-nt sysbench-mem llama
|
||||
fio-seqread fio-seqwrite fio-randread fio-randwrite
|
||||
thermal-load systemd libreoffice gegl inkscape gimp
|
||||
thermal-load systemd libreoffice gegl inkscape
|
||||
glmark2 vkmark
|
||||
```
|
||||
|
||||
|
|
@ -350,7 +347,6 @@ llama-tg,18.2
|
|||
libreoffice,3.9
|
||||
gegl,1.8
|
||||
inkscape,12.4
|
||||
gimp,0.33
|
||||
fio-seqread,2010.4
|
||||
glmark2,5989
|
||||
```
|
||||
|
|
@ -424,7 +420,6 @@ before-headed`.
|
|||
| Governor left on `performance` | Shouldn't happen (restored on exit); set it back with `sudo cpupower frequency-set -g powersave`. |
|
||||
| App step says `skip (… missing)` | That app isn't installed; `sudo dnf install -y <pkg>`, or `RUN_APPS=0` to silence. |
|
||||
| App step says `skip (corpus unavailable)` | Corpus download failed (no curl/wget or no network); re-run with network, or pre-seed `tools/corpus/`. |
|
||||
| GIMP step errors / odd number | GIMP 3 reshaped Script-Fu; inspect `results/gimp-<tag>.txt` (see §4). |
|
||||
|
||||
---
|
||||
|
||||
|
|
|
|||
Loading…
Reference in a new issue