Expand description
Encode an Arrow RecordBatch to Arrow IPC stream bytes.
This is the version bridge: thalweg is pinned to Arrow 58 (ADR-0003), the
Databricks SDK is on Arrow 59. Rather than couple the two majors, the sink
serialises to the stable IPC wire format here and hands the bytes to the SDK’s
ingest_ipc_batch. IPC is forward/backward compatible across these majors, so
no Arrow-59 type ever crosses into the sink.
Functions§
- encode_
ipc - Serialise
batchto a self-describing Arrow IPC stream (schema + one batch).