Can arrow skip a certain number of lines when reading data? I want to do distributed training, read data through arrow, my code is as follows
dataset = getDatasetFromS3() scanner_builder = dataset->NewScan() scanner_builder->project() scanner = scanner_builder->finish() batch_reader = scanner->ToBatchReader() current_batch_ = batch_reader->ReadNext() deal the batch ?????? Can I skip a certain number of lines before calling ReadNext()? Or is there a skip() interface or an offset() interface??
