feat: TsFile 2.x table-model real dataset (read + generate) - #545

Open

SpriCoder wants to merge 15 commits into

masterfrom

feat/tsfile-real-dataset-table-model

Commits on Jun 4, 2026

build(core): add org.apache.tsfile:tsfile 2.2.1 for TsFile real dataset
SpriCoder
committed
954286d
test(core): TsFile table-model raw round-trip + reusable fixture
SpriCoder
committed
547f394
feat(core): TsFile table-model <-> benchmark type/column mapping
SpriCoder
committed
991de1c
feat(core): add REAL_DATASET_FORMAT config parameter
SpriCoder
committed
e937290
refactor(core): move checkDataSet to SchemaReader base for CSV/TsFile reuse
SpriCoder
committed
f328eaf
feat(core): TsFileSchemaReader enumerates devices/sensors from table-model TsFiles
SpriCoder
committed
6ca6330
feat(core): TsFileDataReader streams device-grouped batches
SpriCoder
committed
ebce80f
feat(core): dispatch real-dataset read path to TsFile + file-level distribution
SpriCoder
committed
c0ee963
feat(core): TsFileSchemaWriter writes dataset info.txt for generate mode
SpriCoder
committed
017a7ac
feat(core): TsFileDataWriter exports batches to table-model TsFiles
SpriCoder
committed
38753ca
fix(core): close DataWriter when generate mode finishes (TsFile footer)
SpriCoder
committed
3d6457d
test(core): end-to-end TsFile generate->read round-trip
SpriCoder
committed
4a7ab2b
fix(core): checkDataSet tolerates shorter info.txt instead of throwing
SpriCoder
committed
f562e14
fix(core): real-dataset assigns a device bucket to every client id (avoid NPE when client count > device count)
SpriCoder
committed
0f763e0
fix(core): TsFile readers skip rows with no usable device id (avoid NPE on malformed/external datasets)
SpriCoder
committed
f6ecd72

Navigation Menu

Uh oh!

feat: TsFile 2.x table-model real dataset (read + generate) - #545

feat: TsFile 2.x table-model real dataset (read + generate)#545
SpriCoder wants to merge 15 commits into
masterfrom
feat/tsfile-real-dataset-table-model

Commits on Jun 4, 2026

build(core): add org.apache.tsfile:tsfile 2.2.1 for TsFile real dataset

test(core): TsFile table-model raw round-trip + reusable fixture

feat(core): TsFile table-model <-> benchmark type/column mapping

feat(core): add REAL_DATASET_FORMAT config parameter

refactor(core): move checkDataSet to SchemaReader base for CSV/TsFile reuse

feat(core): TsFileSchemaReader enumerates devices/sensors from table-model TsFiles

feat(core): TsFileDataReader streams device-grouped batches

feat(core): dispatch real-dataset read path to TsFile + file-level distribution

feat(core): TsFileSchemaWriter writes dataset info.txt for generate mode

feat(core): TsFileDataWriter exports batches to table-model TsFiles

fix(core): close DataWriter when generate mode finishes (TsFile footer)

test(core): end-to-end TsFile generate->read round-trip

fix(core): checkDataSet tolerates shorter info.txt instead of throwing

fix(core): real-dataset assigns a device bucket to every client id (avoid NPE when client count > device count)

fix(core): TsFile readers skip rows with no usable device id (avoid NPE on malformed/external datasets)