mixle.stats.compute.encoded module

Metadata wrappers and transfer helpers for sequence-encoded data batches.

The module attaches count, byte-size, encoder, and engine metadata to encoded payloads and moves numeric fields to resident engines without disturbing object or string metadata.

class EncodedData(count, payload, engine, nbytes, encoder=None)

Bases: object

A one-chunk encoded payload with planner-visible metadata.

Parameters:

• count (int)

• payload (Any)

• engine (ComputeEngine)

• nbytes (int)

• encoder (DataSequenceEncoder | None)

classmethod from_payload(payload, count, encoder=None, engine=None)

Wrap an already encoded payload with count, engine, and byte metadata.

Parameters:

• payload (Any)

• count (int)

• encoder (DataSequenceEncoder | None)

• engine (ComputeEngine | None)

Return type:

EncodedData

classmethod from_data(data, encoder, engine=None)

Encode raw data once and attach planner-visible metadata.

Parameters:

• data (Any)

• encoder (DataSequenceEncoder)

• engine (ComputeEngine | None)

Return type:

EncodedData

as_seq_chunk()

Return the legacy (count, encoded_payload) chunk tuple.

Return type:

tuple[int, Any]

class ResidentEncodedPayload(host_payload, engine_payload)

Bases: object

Pair a host encoding with a resident engine encoding for one chunk.

Parameters:

• host_payload (Any)

• engine_payload (Any)

as_encoded_data(payload, count, encoder=None, engine=None)

Wrap an existing encoded payload with count, engine, and byte metadata.

Parameters:

• payload (Any)

• count (int)

• encoder (DataSequenceEncoder | None)

• engine (ComputeEngine | None)

Return type:

EncodedData

move_encoded_payload(payload, engine)

Move numeric encoded arrays into engine while preserving object fields.

Encoders remain backend-agnostic and produce their historical Python/NumPy payloads. Orchestrators can call this exactly once after encoding a shard so scoring kernels see resident engine arrays. Object/string arrays and non-array Python metadata stay on the host because many distribution encodings intentionally carry labels, maps, or structural metadata.

Parameters:

• payload (Any)

• engine (ComputeEngine)

Return type:

Any