dtourolleandClaude Opus 5
e000068384
Rendering a page re-measured and re-rasterised the same words constantly: at
1404x1872 a page issued ~2800 textlength calls and ~2500 draw.text calls for
fewer than 1000 distinct (font, string) pairs. Profiling a page turn showed
FreeType glyph rendering at 57% of total time and width measurement at 38% of
layout.
Both are now cached. Measured on Crime and Punishment at 1404x1872, one page:
layout 35ms -> 19ms
render 84ms -> 41ms
total 120ms -> 60ms
Eviction ranks by use count rather than recency. Word frequency in prose is
Zipfian and stationary, so the words worth keeping are the ones used most, and
unlike recency this lets a document's own frequencies be seeded up front --
see prewarm_caches(). Two details keep the policy from costing more than it
saves, since get() runs once per word drawn:
- counting is O(1) with no reordering, because structures that reorder on
every hit measured 3-5ms/page slower than the hit rate they bought;
- eviction samples 8 entries and drops the least used of those, rather than
maintaining a global order.
Aging (halving all counts periodically) is on by default. Without it a font
size change drove the hit rate to 0% on a real access trace: every key was new
and the previous size's entries held counts nothing could beat.
Both caches are bounded, since the glyph bitmaps reach ~19MB over a long
session and the target is a 512MB Pi Zero 2. Defaults are 4MB of bitmaps and
8192 widths; configure_text_caches() tunes them. Cache size barely affects
speed (2MB is within 13% of unbounded) because a miss costs only one ~44us
rasterisation, so the bound can be set for memory, not throughput.
EreaderLayoutManager.prewarm_caches() counts the book's word frequencies and
preloads the most common ones, seeding each with its document frequency. This
moves that rasterisation to open time and cut misses by 27%, for ~15% faster
page turns at a one-off ~300ms cost. It is opt-in; nothing calls it yet.
Rendering is no longer bit-identical. PIL positions text at sub-pixel offsets,
so the cache buckets that phase, defaulting to 2 buckets per axis. Total ink
per page is unchanged and the mean pixel difference is 3.6/255 -- a fifth of
one step of a 16-level e-ink panel. subpixel_steps=4 halves that if wanted.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
37 lines
736 B
Python
37 lines
736 B
Python
"""
|
|
Concrete layer for the pyWebLayout library.
|
|
|
|
This package contains concrete implementations that can be directly rendered.
|
|
"""
|
|
|
|
from .text import (
|
|
Text,
|
|
Line,
|
|
configure_text_caches,
|
|
clear_text_caches,
|
|
text_cache_stats,
|
|
prewarm_text_caches,
|
|
)
|
|
from .box import Box
|
|
from .image import RenderableImage
|
|
from .page import Page
|
|
from pyWebLayout.abstract.block import Table, TableRow as Row, TableCell as Cell
|
|
from .functional import LinkText, ButtonText
|
|
|
|
__all__ = [
|
|
'Text',
|
|
'Line',
|
|
'Box',
|
|
'RenderableImage',
|
|
'Page',
|
|
'Table',
|
|
'Row',
|
|
'Cell',
|
|
'LinkText',
|
|
'ButtonText',
|
|
'configure_text_caches',
|
|
'clear_text_caches',
|
|
'text_cache_stats',
|
|
'prewarm_text_caches',
|
|
]
|