commits  

Messages by Thread

• Re: [PR] docs: add a python write quick start to the readme [hudi-rs] via GitHub
• [I] Expose commit completion time on Python write results [hudi-rs] via GitHub
• [I] README has no quick start for writing tables [hudi-rs] via GitHub
• [PR] docs: cover native python and rust writes in the hudi-rs quick start [hudi] via GitHub
• (hudi) branch master updated: feat(flink): support per-table Hadoop configuration directories (#20433) danny0405
• [I] Copy-on-write upsert with an ordering field merges every stored row of a file group [hudi-rs] via GitHub
• [PR] perf(core): merge only matched keys in event-time copy-on-write upserts [hudi-rs] via GitHub
• [I] Add a reproducible single-node benchmark for the write path [hudi-rs] via GitHub
• [PR] fix(spark): stop treating integral Add/Multiply/ShiftLeft as order-preserving for data skipping [hudi] via GitHub
  • Re: [PR] fix(spark): stop treating integral Add/Multiply/ShiftLeft as order-preserving for data skipping [hudi] via GitHub
• Re: [PR] perf(core): read only the requested keys' record index shards and blocks [hudi-rs] via GitHub
• Re: [PR] perf(core): encode record index entries directly as Avro binary [hudi-rs] via GitHub
• Re: [PR] fix(core): accept list and fixed-size list columns on upsert and update [hudi-rs] via GitHub
  • Re: [PR] fix(core): accept list and fixed-size list columns on upsert and update [hudi-rs] via GitHub
• [PR] feat(core): return the commit completion time from writes [hudi-rs] via GitHub
  • Re: [PR] feat(core): return the commit completion time from writes [hudi-rs] via GitHub
• [PR] feat(python): add write APIs to the Python binding [hudi-rs] via GitHub
• [I] Write results do not expose the commit completion time needed for incremental reads [hudi-rs] via GitHub
• [I] Table::create ignores storage options from environment variables [hudi-rs] via GitHub
• [PR] feat(spark): add Superset and Zeppelin Spark Connect integration [hudi] via GitHub
  • Re: [PR] feat(spark): add Superset and Zeppelin Spark Connect integration [hudi] via GitHub
• [I] Record index entries are encoded through a generic Avro value tree on every written row [hudi-rs] via GitHub
• [PR] feat(core): write composite and non-string record keys [hudi-rs] via GitHub
  • Re: [PR] feat(core): write composite and non-string record keys [hudi-rs] via GitHub
• [I] refactor(core): check write batches against the table schema in one place [hudi-rs] via GitHub
• [I] Upsert rejects list columns written by append; fixed-size lists rejected outright [hudi-rs] via GitHub
• [I] Record index lookup decodes the whole index on every write [hudi-rs] via GitHub
• [I] Accept Utf8View, LargeUtf8, BinaryView and LargeBinary columns in the write path [hudi-rs] via GitHub
• [I] C++ and C ABI bindings for the native write API [hudi-rs] via GitHub
• [I] refactor(core): remove the timeline layout 1 branch of rollback completion [hudi-rs] via GitHub
• [I] fix(core): keep NaN in the column stats range of float and double columns [hudi-rs] via GitHub
• [I] refactor(core): move shared writer helpers out of write/append.rs [hudi-rs] via GitHub
• (hudi) branch master updated: fix(spark)!: forward session settings to streaming sinks (#20455) sivabalan
• [I] Integrate Superset and Zeppelin with Spark Connect [hudi] via GitHub
• (hudi) branch master updated: fix(client): do not block the writer on a running async table service when switching write clients (#20444) sivabalan
• [I] refactor(core): align RecordMergeStrategyValue with record merge mode naming [hudi-rs] via GitHub
• (hudi) branch dependabot/pip/hudi-lakehouse/local-dev/example/pyarrow-23.0.1 created (now 58c0d20caa6a) github-bot
• [PR] docs(rfc): claim RFC-117 for the snapshot manifest proposal [hudi] via GitHub
  • Re: [PR] docs(rfc): claim RFC-117 for new files metadata design [hudi] via GitHub
• [I] RFC-117: snapshot manifest for read-path metadata on small and medium tables [hudi] via GitHub
• [PR] chore(deps): bump pyarrow from 18.1.0 to 23.0.1 in /hudi-lakehouse/local-dev/example [hudi] via GitHub
• [PR] feat(spark): add end-to-end validation and documentation for Spark Connect [hudi] via GitHub
  • Re: [PR] feat(spark): add end-to-end validation and documentation for Spark Connect [hudi] via GitHub
• (hudi-rs) branch main updated: fix(reader): apply the logical timestamp repair to parquet log block records (#815) yihua
• Re: [I] [SUPPORT]Parquet is not a valid Parquet File [hudi] via GitHub
• [I] refactor(core): mint write instants per table instead of through a process-wide timezone flag [hudi-rs] via GitHub
• [PR] [HUDI-8935] Fix partitioned record index point lookups for empty keys or empty partitions [hudi] via GitHub
  • Re: [PR] [HUDI-8935] Fix partitioned record index point lookups for empty keys or empty partitions [hudi] via GitHub
• (hudi) branch master updated: docs(rfc): claim RFC-116 for branch and tag support (#20456) vhs
• Re: [PR] feat(core): stream file slices by partition [hudi-rs] via GitHub
  • Re: [PR] feat(core): stream file slices by partition [hudi-rs] via GitHub
  • Re: [PR] feat(core): stream file slices by partition [hudi-rs] via GitHub
• (hudi-rs) branch main updated: fix(hfile): count checksum chunks over header + data (#836) yihua
• (hudi-rs) branch main updated: fix(reader): map Avro local-timestamp logical types instead of panicking (#813) yihua
• Re: [I] [SUPPORT]How to resolve small file? [hudi] via GitHub
• (hudi) branch asf-site updated: docs(spark): explain streaming session option compatibility (#20454) sivabalan
• (hudi) branch master updated (d1ec4d3b043d -> ec36124f5e54) sivabalan
• [I] Metadata table listing drops file groups that have only log files [hudi-rs] via GitHub
• [PR] fix(spark): reject collation-changing casts in data skipping [hudi] via GitHub
  • Re: [PR] fix(spark): reject collation-changing casts in data skipping [hudi] via GitHub
  • Re: [PR] fix(spark): reject collation-changing casts in data skipping [hudi] via GitHub
• [I] [BUG] Spark data skipping: integral overflow in Add, Multiply and ShiftLeft prunes files with matching rows [hudi] via GitHub
• Re: [I] Handle file group building for log file only case [hudi-rs] via GitHub
  • Re: [I] Handle file group building for log file only case [hudi-rs] via GitHub
• (hudi-rs) branch main updated: fix(python): run the DataFusion FFI provider on the binding's tokio runtime (#829) yihua
• (hudi-rs) branch main updated: build(ffi): forward the spill-rocksdb feature through hudi-ffi (#849) yihua
• (hudi-rs) branch main updated: refactor(ffi): rename hudi-jvm-ffi to hudi-ffi (#847) yihua
• [PR] fix(spark): reject negative factors in data skipping multiply/divide [hudi] via GitHub
  • Re: [PR] fix(spark): reject negative factors in data skipping multiply/divide [hudi] via GitHub
  • Re: [PR] fix(spark): reject negative factors in data skipping multiply/divide [hudi] via GitHub
  • Re: [PR] fix(spark): reject negative factors in data skipping multiply/divide [hudi] via GitHub
• [PR] docs(rfc): RFC-116 Support Branches and Tags [hudi] via GitHub
• Re: [PR] feat(gateway): add Spark Thrift Server as a selectable lakehouse engine [hudi] via GitHub
• [PR] fix(core): replace deprecated ParquetObjectReader with AsyncFileReader [hudi-rs] via GitHub
  • Re: [PR] fix(core): replace deprecated ParquetObjectReader with AsyncFileReader [hudi-rs] via GitHub
• Re: [I] [SUPPORT]File does not exist [hudi] via GitHub
  • Re: [I] [SUPPORT]File does not exist [hudi] via GitHub
• Re: [PR] feat(gateway): schema hints -- live schema context for the model [hudi] via GitHub
• [PR] fix(core): treat missing column-stat bounds as unknown when merging [hudi-rs] via GitHub
  • Re: [PR] fix(core): treat missing column-stat bounds as unknown when merging [hudi-rs] via GitHub
• [PR] docs(rfc): claim RFC-116 for branch and tag support [hudi] via GitHub
  • Re: [PR] docs(rfc): claim RFC-116 for branch and tag support [hudi] via GitHub
  • Re: [PR] docs(rfc): claim RFC-116 for branch and tag support [hudi] via GitHub
• Re: [PR] fix(spark)!: forward session settings to streaming sinks [hudi] via GitHub
  • Re: [PR] fix(spark)!: forward session settings to streaming sinks [hudi] via GitHub
  • Re: [PR] fix(spark)!: forward session settings to streaming sinks [hudi] via GitHub
• [PR] docs(spark): explain streaming session option compatibility [hudi] via GitHub
  • Re: [PR] docs(spark): explain streaming session option compatibility [hudi] via GitHub
  • Re: [PR] docs(spark): explain streaming session option compatibility [hudi] via GitHub
• [PR] test(spark): add Spark Connect SDP integration harness and CI coverage [hudi] via GitHub
  • Re: [PR] test(spark): add Spark Connect SDP integration harness and CI coverage [hudi] via GitHub
  • Re: [PR] test(spark): add Spark Connect SDP integration harness and CI coverage [hudi] via GitHub
  • Re: [PR] test(spark): add Spark Connect SDP integration harness and CI coverage [hudi] via GitHub
  • Re: [PR] test(spark): add Spark Connect SDP integration harness and CI coverage [hudi] via GitHub
• [I] Consolidate the native bindings around one C ABI [hudi-rs] via GitHub
• [PR] fix(spark): fail streaming queries instead of exiting the JVM [hudi] via GitHub
  • Re: [PR] fix(spark): fail streaming queries instead of exiting the JVM [hudi] via GitHub
  • Re: [PR] fix(spark): fail streaming queries instead of exiting the JVM [hudi] via GitHub
  • Re: [PR] fix(spark): fail streaming queries instead of exiting the JVM [hudi] via GitHub
• [PR] fix(spark): skip partition stats pruning for historical snapshots [hudi] via GitHub
  • Re: [PR] fix(spark): skip partition stats pruning for time travel queries [hudi] via GitHub
  • Re: [PR] fix(spark): skip partition stats pruning for time travel queries [hudi] via GitHub
  • Re: [PR] fix(spark): skip partition stats pruning for time travel queries [hudi] via GitHub
  • Re: [PR] fix(spark): skip partition stats pruning for time travel queries [hudi] via GitHub
• Re: [PR] fix: replace Windows backslashes with forward slashes in paths [hudi-rs] via GitHub
• (hudi-rs) branch main updated: feat(core): add append_only writes for append-only tables (#588) yihua
• (hudi-rs) branch main updated: docs(python): add doctests to builder and config APIs, enable --doctest-modules (#623) yihua
• (hudi-rs) branch main updated: feat(core): add support for in and not in file pruning (#800) yihua
• Re: [PR] fix(core): Prune Partition-Directory descent by filters during storage listing [hudi-rs] via GitHub
• Re: [I] Add bulk insert write support for append-only tables [hudi-rs] via GitHub
• [I] File-level column stats ignore row groups without min/max, so files with matching rows get pruned [hudi-rs] via GitHub
• (hudi) branch dependabot/maven/hudi-agent-gateway/fixtures/hudi-architect-flink-1.20/org.apache.hive-hive-exec-4.0.1 created (now a55e38e63a9a) github-bot
• [PR] chore(deps-dev): bump org.apache.hive:hive-exec from 2.3.10 to 4.0.1 in /hudi-agent-gateway/fixtures/hudi-architect-flink-1.20 [hudi] via GitHub
• Re: [I] Setup doc testing for Python APIs [hudi-rs] via GitHub
• [I] Track Spark data skipping correctness issues [hudi] via GitHub
  • Re: [I] [Umbrella] Track Spark data skipping correctness issues [hudi] via GitHub
• Re: [PR] feat(core): add append_only writes for append-only tables [hudi-rs] via GitHub
  • Re: [PR] feat(core): add append_only writes for append-only tables [hudi-rs] via GitHub
• Re: [PR] docs(python): add doctests to builder and config APIs, enable --doctest-modules [hudi-rs] via GitHub
  • Re: [PR] docs(python): add doctests to builder and config APIs, enable --doctest-modules [hudi-rs] via GitHub
  • Re: [PR] docs(python): add doctests to builder and config APIs, enable --doctest-modules [hudi-rs] via GitHub
• (hudi-rs) branch main updated: build(deps): upgrade lance to 13 (#845) yihua
• (hudi-rs) branch main updated: feat(core): read any metadata table partition as Arrow (#819) yihua
• [PR] Fix/pr666 review fixes [hudi-rs] via GitHub
  • Re: [PR] fix(core): follow-up fixes for native table writes and Java interop [hudi-rs] via GitHub
• [I] Add the first set of contributor development skills under .claude/skills [hudi] via GitHub
• [PR] build(deps): zip 8 → 9.0.3 [hudi-rs] via GitHub
  • Re: [PR] build(deps): zip 8 → 9.0.3 [hudi-rs] via GitHub
  • Re: [PR] build(deps): zip 8 → 9.0.3 [hudi-rs] via GitHub
• [PR] feat(dev): add contributor development skills for coding agents [hudi] via GitHub
  • Re: [PR] feat(dev): add contributor development skills for coding agents [hudi] via GitHub
  • Re: [PR] feat(dev): add contributor development skills for coding agents [hudi] via GitHub
• [I] Contributor development skills for coding agents [hudi] via GitHub
• [PR] build(ffi): forward the spill-rocksdb feature through hudi-jvm-ffi [hudi-rs] via GitHub
  • Re: [PR] build(ffi): forward the spill-rocksdb feature through hudi-jvm-ffi [hudi-rs] via GitHub
  • Re: [PR] build(ffi): forward the spill-rocksdb feature through hudi-ffi [hudi-rs] via GitHub
• [PR] refactor(ffi): rename hudi-jvm-ffi to hudi-ffi [hudi-rs] via GitHub
  • Re: [PR] refactor(ffi): rename hudi-jvm-ffi to hudi-ffi [hudi-rs] via GitHub
  • Re: [PR] refactor(ffi): rename hudi-jvm-ffi to hudi-ffi [hudi-rs] via GitHub
• Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
  • Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
  • Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
  • Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
  • Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
  • Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
  • Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
  • Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
  • Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
  • Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
  • Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
  • Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
  • Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
  • Re: [PR] feat(core): native table write support with spark storage parity [hudi-rs] via GitHub
• [PR] fix(spark): retry streaming sink async table service runs failed by a write client swap [hudi] via GitHub
  • Re: [PR] fix(spark): retry streaming sink async table service runs failed by a write client swap [hudi] via GitHub
• (hudi) branch master updated: feat(utilities): add fail-fast continuous mode for HoodieMultiTableStreamer (#19811) yihua
• Re: [I] Fix HoodieMultiTableDeltaStreamer to write all tables in continuous mode [hudi] via GitHub
• Re: [PR] feat(utilities): add fail-fast continuous mode for HoodieMultiTableStreamer [hudi] via GitHub
• [I] [Spark] Time travel queries can return incorrect results when partition stats pruning is enabled [hudi] via GitHub
• [PR] fix(client): do not block the writer on a running async table service when switching write clients [hudi] via GitHub
  • Re: [PR] fix(client): restore non-blocking write client switch for async table services [hudi] via GitHub
  • Re: [PR] fix(client): restore non-blocking write client switch for async table services [hudi] via GitHub
  • Re: [PR] fix(client): restore non-blocking write client switch for async table services [hudi] via GitHub
• Re: [PR] feat(cpp): forward read options through file slice reads [hudi-rs] via GitHub
  • Re: [PR] feat(cpp): forward read options through file slice reads [hudi-rs] via GitHub
• Re: [PR] feat(core): support variant reads via arrow-rs [hudi-rs] via GitHub
  • Re: [PR] feat(core): support variant reads via arrow-rs [hudi-rs] via GitHub
  • Re: [PR] feat(core): support variant reads via arrow-rs [hudi-rs] via GitHub
  • Re: [PR] feat(core): support variant reads via arrow-rs [hudi-rs] via GitHub
• (hudi-rs) branch main updated: fix(cpp): catch panics at the FFI boundary so they surface as errors (#766) yihua
• Re: [I] cpp: guard FFI entry points with catch_unwind so panics don't abort the host process [hudi-rs] via GitHub
• Re: [PR] fix(cpp): catch panics at the FFI boundary so they surface as errors [hudi-rs] via GitHub
• (hudi) branch master updated: fix(spark): read shredded variant leaves like Spark 4 (#20332) vhs
• [I] Variant parquet layout: vanilla Spark vs Hudi vs Iceberg, unshredded and shredded [hudi] via GitHub
• (hudi) branch master updated: fix(spark): re-create the streaming sink write client when the writer schema changes (#20415) danny0405
• (hudi) branch master updated: fix(spark): create Hudi tables via the DSv2 Column API and accept unchanged properties in HoodieCatalog (#20426) danny0405
• Re: [PR] fix(spark): apply procedure filters before the limit, not after [hudi] via GitHub
• [I] Repair historical partition statistics with incomplete file coverage after indexed-column expansion [hudi] via GitHub
• (hudi) branch master updated: fix(core): write the key generator class for tables below version 8 (#20276) yihua
• [PR] docs: describe Lance column and partition statistics [hudi] via GitHub
• Re: [PR] [HUDI-7948] RFC-80: Support column families for wide tables [hudi] via GitHub
• [PR] test(spark): add a data skipping oracle test [hudi] via GitHub
  • Re: [PR] test(spark): add a data skipping oracle test [hudi] via GitHub
• Re: [I] Introduce Column Groups in Hudi to support wide tables (RFC-80) [hudi] via GitHub
  • Re: [I] Introduce Column Groups in Hudi to support wide tables (RFC-80) [hudi] via GitHub
• Re: [PR] feat(common): add hoodie.table.version.pinned ceiling guard [hudi] via GitHub
• [I] COW scan shows repeated UnsafeProjection in Hudi and Spark row paths [hudi] via GitHub
  • Re: [I] [Support] COW scan shows repeated UnsafeProjection in Hudi and Spark row paths [hudi] via GitHub
  • Re: [I] [Support] COW scan shows repeated UnsafeProjection in Hudi and Spark row paths [hudi] via GitHub
  • Re: [I] [Support] COW scan shows repeated UnsafeProjection in Hudi and Spark row paths [hudi] via GitHub
  • Re: [I] [Support] COW scan shows repeated UnsafeProjection in Hudi and Spark row paths [hudi] via GitHub
  • Re: [I] [Support] COW scan shows repeated UnsafeProjection in Hudi and Spark row paths [hudi] via GitHub
• [I] [perf] COW scan shows repeated UnsafeProjection in Hudi and Spark row paths [hudi] via GitHub
  • Re: [I] [perf] COW scan shows repeated UnsafeProjection in Hudi and Spark row paths [hudi] via GitHub
• (hudi) branch master updated: feat(spark): stop forcing direct markers in the streaming sink (#20413) danny0405
• (hudi) branch master updated: fix(spark): reuse one embedded timeline server across streaming sink micro-batches (#20412) danny0405
• (hudi) branch master updated: fix(agent): treat existing-table identity mismatch as evidence conflict (#20410) danny0405
• Re: [PR] fix: #18691 Honor IF NOT EXISTS when creating indexes [hudi] via GitHub
• (hudi) branch asf-site updated: docs: add Wordfully to adopters (#20432) vhs
• (hudi) branch master updated: feat(agent): add Hudi optimizer catalogs and Agent (#20197) sivabalan

• Earlier messages