mixle.data.sources.arrow_source module

Apache Arrow connectors – Parquet / Arrow / Feather into a DataSource.

Optional: requires pyarrow (pip install mixle[arrow]). Schema is inferred from the Arrow types when none is supplied; reading is columnar and zero-copy where Arrow allows.

read_parquet(path, columns=None, *, structure=EXCHANGEABLE, schema=None)[source]

Read a Parquet file/dataset into a lazy DataSource of scalar/tuple records.

Parameters:

  • path (str)

  • columns (list[str] | None)

  • structure (SampleStructure)

  • schema (Schema | None)

Return type:

LazySource

read_feather(path, columns=None, *, structure=EXCHANGEABLE, schema=None)[source]

Read an Arrow/Feather file into a lazy DataSource of scalar/tuple records.

Parameters:

  • path (str)

  • columns (list[str] | None)

  • structure (SampleStructure)

  • schema (Schema | None)

Return type:

LazySource