Re: [PR] chore: Fury header add language field [incubator-fury]
LiangliangSui commented on PR #1612: URL: https://github.com/apache/incubator-fury/pull/1612#issuecomment-2099630106 PTAL @chaokunyang @theweipeng -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
[PR] chore: Fury header add language field [incubator-fury]
LiangliangSui opened a new pull request, #1612: URL: https://github.com/apache/incubator-fury/pull/1612 ## What does this PR do? Add serialization language field for Fury Header in xlang_spec. ## Related issues https://github.com/apache/incubator-fury/issues/1607 ## Does this PR introduce any user-facing change? - [ ] Does this PR introduce any public API change? - [x] Does this PR introduce any binary protocol compatibility change? ## Benchmark -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
Re: [PR] feat(java): support user context for serialize global data(#1595) [incubator-fury]
chaokunyang commented on code in PR #1596:
URL: https://github.com/apache/incubator-fury/pull/1596#discussion_r1593293764
##
java/fury-core/src/main/java/org/apache/fury/resolver/UserContextResolver.java:
##
@@ -0,0 +1,40 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+
+package org.apache.fury.resolver;
+
+import org.apache.fury.Fury;
+import org.apache.fury.memory.MemoryBuffer;
+
+/** write/read user custom global data after metaContext data. */
+public abstract class UserContextResolver {
+
+ protected final Fury fury;
+
+ public UserContextResolver(Fury fury) {
+this.fury = fury;
+ }
+
+ public abstract void write(MemoryBuffer buffer);
+
+ public abstract void read(MemoryBuffer buffer);
+
+ /** write/read end should clear user data. */
+ public abstract void reset();
Review Comment:
If it's stateless, we can implement this like :
```java
@Override
public void write(MemoryBuffer buffer, Object value) {
Map o = (Map)
fury.getSerializationContext().get("dict");
if (o == null) {
o = xxx;
fury.getSerializationContext().add("dict", o);
fury.writeNonRef(buffer, o);
buffer.writeBoolean(true);
} else {
buffer.writeBoolean(false);
}
}
@Override
public Object read(MemoryBuffer buffer) {
Map o;
if (buffer.readBoolean()) {
o = (Map) fury.readNonRef(buffer);
fury.getSerializationContext().add("dict", o);
} else {
o = (Map) fury.getSerializationContext().get("dict");
}
}
```
But it introduce one extra byte
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org
For additional commands, e-mail: commits-h...@fury.apache.org
(incubator-fury) branch main updated: feat(javascript): add data to description util (#1609)
This is an automated email from the ASF dual-hosted git repository.
chaokunyang pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-fury.git
The following commit(s) were added to refs/heads/main by this push:
new 8b3fe0ed feat(javascript): add data to description util (#1609)
8b3fe0ed is described below
commit 8b3fe0ed6de30526d6dcfaa884b1212b3029a2c5
Author: 野声
AuthorDate: Wed May 8 09:33:21 2024 +0800
feat(javascript): add data to description util (#1609)
## What does this PR do?
Add a new util called `data2Description`, which can reduce the amount of
code
## Related issues
## Does this PR introduce any user-facing change?
- [ ] Does this PR introduce any public API change?
- [ ] Does this PR introduce any binary protocol compatibility change?
## Benchmark
---
javascript/benchmark/index.js| 4 +-
javascript/packages/fury/lib/util.ts | 90 ++
javascript/test/util.js | 104 ---
3 files changed, 92 insertions(+), 106 deletions(-)
diff --git a/javascript/benchmark/index.js b/javascript/benchmark/index.js
index 016b7710..52d0b267 100644
--- a/javascript/benchmark/index.js
+++ b/javascript/benchmark/index.js
@@ -18,7 +18,7 @@
*/
const Fury = require("@furyjs/fury");
-const utils = require("../test/util");
+const utils = require("@furyjs/fury/dist/lib/util");
const hps = require('@furyjs/hps');
const fury = new Fury.default({ hps, refTracking: false, useSliceString: true
});
const Benchmark = require("benchmark");
@@ -108,7 +108,7 @@ const sample = {
};
-const description = utils.mockData2Description(sample, "fury.test.foo");
+const description = utils.data2Description(sample, "fury.test.foo");
const { serialize, deserialize, serializeVolatile } =
fury.registerSerializer(description);
const furyAb = serialize(sample);
diff --git a/javascript/packages/fury/lib/util.ts
b/javascript/packages/fury/lib/util.ts
index b7e45a12..39042704 100644
--- a/javascript/packages/fury/lib/util.ts
+++ b/javascript/packages/fury/lib/util.ts
@@ -17,6 +17,9 @@
* under the License.
*/
+import { ObjectTypeDescription, Type, TypeDescription } from "./description";
+import { InternalSerializerType } from "./type";
+
export const isNodeEnv: boolean
= typeof process !== "undefined"
&& process.versions != null
@@ -24,3 +27,90 @@ export const isNodeEnv: boolean
&& process.versions.node != null;
export const hasBuffer = isNodeEnv && typeof Buffer !== "undefined";
+
+export function isUint8Array(obj: any): obj is Uint8Array {
+ return obj instanceof Uint8Array || Object.prototype.toString.call(obj) ===
"[object Uint8Array]";
+}
+
+export const data2Description = (
+ data: any,
+ tag: string,
+): TypeDescription | null => {
+ if (data === null || data === undefined) {
+return null;
+ }
+ if (Array.isArray(data)) {
+const item = data2Description(data[0], tag);
+if (!item) {
+ throw new Error("empty array can't convert");
+}
+return {
+ ...Type.array(item),
+ label: "array",
+};
+ }
+ if (data instanceof Date) {
+return {
+ ...Type.timestamp(),
+ label: "timestamp",
+};
+ }
+ if (typeof data === "string") {
+return {
+ ...Type.string(),
+ label: "string",
+};
+ }
+ if (data instanceof Set) {
+return {
+ ...Type.set(data2Description([...data.values()][0], tag)!),
+ label: "set",
+};
+ }
+ if (data instanceof Map) {
+return {
+ ...Type.map(
+data2Description([...data.keys()][0], tag)!,
+data2Description([...data.values()][0], tag)!,
+ ),
+ label: "map",
+};
+ }
+ if (typeof data === "boolean") {
+return {
+ ...Type.bool(),
+ label: "boolean",
+};
+ }
+ if (typeof data === "number") {
+if (data > Number.MAX_SAFE_INTEGER || data < Number.MIN_SAFE_INTEGER) {
+ return {
+...Type.int64(),
+label: "int64",
+ };
+}
+return {
+ ...Type.int32(),
+ label: "int32",
+};
+ }
+
+ if (typeof data === "object") {
+if (isUint8Array(data)) {
+ return Type.binary();
+}
+
+return Type.object(
+ tag,
+ Object.fromEntries(
+Object.entries(data)
+ .map(([key, value]) => {
+return [key, data2Description(value, `${tag}.${key}`)];
+ })
+ .filter(([_, v]) => Boolean(v)),
+ ),
+);
+ }
+
+ throw new Error(`unkonw data type ${typeof data}`);
+};
diff --git a/javascript/test/util.js b/javascript/test/util.js
deleted file mode 100644
index 12efe989..
--- a/javascript/test/util.js
+++ /dev/null
@@ -1,104 +0,0 @@
-/*
- * Licensed to the Apache Software Foundation (ASF) under one
- * or more contributor license agreements. See the NOTICE file
- * distributed with this work
Re: [PR] feat(javascript): add data to description util [incubator-fury]
chaokunyang merged PR #1609: URL: https://github.com/apache/incubator-fury/pull/1609 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
Re: [I] Upgrade dubbo-serialization-fury fury-core dependency to 0.5.0 [incubator-fury]
huisman6 closed issue #1610: Upgrade dubbo-serialization-fury fury-core dependency to 0.5.0 URL: https://github.com/apache/incubator-fury/issues/1610 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
Re: [I] Upgrade dubbo-serialization-fury fury-core dependency to 0.5.0 [incubator-fury]
huisman6 commented on issue #1610: URL: https://github.com/apache/incubator-fury/issues/1610#issuecomment-2099562258 Got it . We should have enough time to wait for the new version to be released. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
Re: [PR] feat(javascript): add data to description util [incubator-fury]
drewbitt commented on PR #1609: URL: https://github.com/apache/incubator-fury/pull/1609#issuecomment-2099326299 This was needed. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
[GH] (incubator-fury): Workflow run "Lint PR" is working again!
The GitHub Actions job "Lint PR" on incubator-fury.git has succeeded. Run started by GitHub user Munoon (triggered by Munoon). Head commit for run: b7069b176dbd3f099326789b983939104ee28e8c / Munoon refactoring(java): Remove Guava's Collection usages Report URL: https://github.com/apache/incubator-fury/actions/runs/8991645917 With regards, GitHub Actions via GitBox - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
[GH] (incubator-fury): Workflow run "Lint PR" failed!
The GitHub Actions job "Lint PR" on incubator-fury.git has failed. Run started by GitHub user Munoon (triggered by Munoon). Head commit for run: b7069b176dbd3f099326789b983939104ee28e8c / Munoon refactoring(java): Remove Guava's Collection usages Report URL: https://github.com/apache/incubator-fury/actions/runs/8991635227 With regards, GitHub Actions via GitBox - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
[PR] refactoring(java): Remove Guava's Collection usages [incubator-fury]
Munoon opened a new pull request, #1611: URL: https://github.com/apache/incubator-fury/pull/1611 ## What does this PR do? Remove Guava's Collection usages ## Related issues #1113 ## Does this PR introduce any user-facing change? - [ ] Does this PR introduce any public API change? - [ ] Does this PR introduce any binary protocol compatibility change? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
Re: [I] Upgrade dubbo-serialization-fury fury-core dependency to 0.5.0 [incubator-fury]
chaokunyang commented on issue #1610: URL: https://github.com/apache/incubator-fury/issues/1610#issuecomment-2098211186 We plan to upgrade [dubbo-serialization-fury](https://github.com/apache/dubbo-spi-extensions/tree/master/dubbo-serialization-extensions/dubbo-serialization-fury) next weeks. The 0.5.0 is just released, we'd like to get some feedbacks before upgrading downstream frameworks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
(incubator-fury) 01/01: bump version to 0.5.1
This is an automated email from the ASF dual-hosted git repository.
chaokunyang pushed a commit to branch releases-0.5.1
in repository https://gitbox.apache.org/repos/asf/incubator-fury.git
commit c68389213680bc392e287411f84dbbaa1da98da5
Author: chaokunyang
AuthorDate: Tue May 7 17:38:01 2024 +0800
bump version to 0.5.1
---
integration_tests/graalvm_tests/pom.xml | 2 +-
integration_tests/jdk_compatibility_tests/pom.xml | 2 +-
integration_tests/jpms_tests/pom.xml | 2 +-
integration_tests/latest_jdk_tests/pom.xml| 2 +-
java/benchmark/pom.xml| 2 +-
java/fury-core/pom.xml| 2 +-
java/fury-format/pom.xml | 2 +-
java/fury-test-core/pom.xml | 2 +-
java/fury-testsuite/pom.xml | 2 +-
java/pom.xml | 2 +-
javascript/packages/fury/package.json | 2 +-
javascript/packages/hps/package.json | 2 +-
rust/Cargo.toml | 2 +-
scala/build.sbt | 2 +-
14 files changed, 14 insertions(+), 14 deletions(-)
diff --git a/integration_tests/graalvm_tests/pom.xml
b/integration_tests/graalvm_tests/pom.xml
index d3f952c2..44e8cd61 100644
--- a/integration_tests/graalvm_tests/pom.xml
+++ b/integration_tests/graalvm_tests/pom.xml
@@ -25,7 +25,7 @@
org.apache.fury
fury-parent
-0.6.0-SNAPSHOT
+0.5.1
../../java
4.0.0
diff --git a/integration_tests/jdk_compatibility_tests/pom.xml
b/integration_tests/jdk_compatibility_tests/pom.xml
index f6af0074..238fc7cc 100644
--- a/integration_tests/jdk_compatibility_tests/pom.xml
+++ b/integration_tests/jdk_compatibility_tests/pom.xml
@@ -25,7 +25,7 @@
org.apache.fury
fury-parent
-0.6.0-SNAPSHOT
+0.5.1
../../java
4.0.0
diff --git a/integration_tests/jpms_tests/pom.xml
b/integration_tests/jpms_tests/pom.xml
index fca2007f..3744a267 100644
--- a/integration_tests/jpms_tests/pom.xml
+++ b/integration_tests/jpms_tests/pom.xml
@@ -25,7 +25,7 @@
org.apache.fury
fury-parent
-0.6.0-SNAPSHOT
+0.5.1
../../java
4.0.0
diff --git a/integration_tests/latest_jdk_tests/pom.xml
b/integration_tests/latest_jdk_tests/pom.xml
index 015633ec..a7852650 100644
--- a/integration_tests/latest_jdk_tests/pom.xml
+++ b/integration_tests/latest_jdk_tests/pom.xml
@@ -25,7 +25,7 @@
org.apache.fury
fury-parent
-0.6.0-SNAPSHOT
+0.5.1
../../java
4.0.0
diff --git a/java/benchmark/pom.xml b/java/benchmark/pom.xml
index 89a2cb6a..e7ab6b47 100644
--- a/java/benchmark/pom.xml
+++ b/java/benchmark/pom.xml
@@ -26,7 +26,7 @@
fury-parent
org.apache.fury
-0.6.0-SNAPSHOT
+0.5.1
benchmark
diff --git a/java/fury-core/pom.xml b/java/fury-core/pom.xml
index dcf87204..c2aad443 100644
--- a/java/fury-core/pom.xml
+++ b/java/fury-core/pom.xml
@@ -25,7 +25,7 @@
org.apache.fury
fury-parent
-0.6.0-SNAPSHOT
+0.5.1
4.0.0
diff --git a/java/fury-format/pom.xml b/java/fury-format/pom.xml
index 6c4c6cb6..33500a81 100644
--- a/java/fury-format/pom.xml
+++ b/java/fury-format/pom.xml
@@ -25,7 +25,7 @@
org.apache.fury
fury-parent
-0.6.0-SNAPSHOT
+0.5.1
4.0.0
diff --git a/java/fury-test-core/pom.xml b/java/fury-test-core/pom.xml
index b129d1ca..191e348c 100644
--- a/java/fury-test-core/pom.xml
+++ b/java/fury-test-core/pom.xml
@@ -25,7 +25,7 @@
fury-parent
org.apache.fury
-0.6.0-SNAPSHOT
+0.5.1
4.0.0
diff --git a/java/fury-testsuite/pom.xml b/java/fury-testsuite/pom.xml
index c5d91898..9ffb36a4 100644
--- a/java/fury-testsuite/pom.xml
+++ b/java/fury-testsuite/pom.xml
@@ -25,7 +25,7 @@
fury-parent
org.apache.fury
-0.6.0-SNAPSHOT
+0.5.1
4.0.0
diff --git a/java/pom.xml b/java/pom.xml
index 3f7f7b5f..b01550ce 100644
--- a/java/pom.xml
+++ b/java/pom.xml
@@ -33,7 +33,7 @@
org.apache.fury
fury-parent
pom
- 0.6.0-SNAPSHOT
+ 0.5.1
Fury Project Parent POM
Apache Fury™ is a blazingly fast multi-language serialization framework
powered by jit and zero-copy.
diff --git a/javascript/packages/fury/package.json
b/javascript/packages/fury/package.json
index 2aff4210..984c6fca 100644
--- a/javascript/packages/fury/package.json
+++ b/javascript/packages/fury/package.json
@@ -1,6 +1,6 @@
{
"name": "@furyjs/fury",
- "version": "0.6.0.dev",
+ "version": "0.5.1",
"description": "Apache Fury™(incubating) is a blazingly fast multi-language
serialization framework powered by jit and zero-copy",
"main": "dist/index.js",
"scripts": {
diff --git a/javascript/packages/hps/package.json
b/javascript/packages/hps/package.json
index 2bf5aea2..1211257b 100644
--- a/javascript/packages/hps/package.json
+++ b/javascript/packages/hps/package.json
@@ -1,6 +1,6 @@
{
"name":
(incubator-fury) branch releases-0.5.1 created (now c6838921)
This is an automated email from the ASF dual-hosted git repository. chaokunyang pushed a change to branch releases-0.5.1 in repository https://gitbox.apache.org/repos/asf/incubator-fury.git at c6838921 bump version to 0.5.1 This branch includes the following new commits: new c6838921 bump version to 0.5.1 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
(incubator-fury-site) branch deploy updated: deploy: 6fd68e642904e8adc6d3b8463d7c8cfb1489a104
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch deploy
in repository https://gitbox.apache.org/repos/asf/incubator-fury-site.git
The following commit(s) were added to refs/heads/deploy by this push:
new 1d8b129 deploy: 6fd68e642904e8adc6d3b8463d7c8cfb1489a104
1d8b129 is described below
commit 1d8b12981c553e316521765c104a1799522a3ac6
Author: chaokunyang
AuthorDate: Tue May 7 09:27:45 2024 +
deploy: 6fd68e642904e8adc6d3b8463d7c8cfb1489a104
---
404.html | 4 ++--
assets/js/b2f554cd.2a6dd19c.js | 1 +
assets/js/b2f554cd.4a851524.js | 1 -
assets/js/cc296a15.295f3a9f.js | 1 -
assets/js/cc296a15.7b72598a.js | 1 +
assets/js/f1aad19d.4f00ffe4.js | 1 +
assets/js/f1aad19d.634ce94b.js | 1 -
assets/js/{main.a8a3f08e.js => main.69d20728.js} | 4 ++--
.../{main.a8a3f08e.js.LICENSE.txt => main.69d20728.js.LICENSE.txt} | 0
assets/js/{runtime~main.4c4d0244.js => runtime~main.082de540.js} | 2 +-
blog/archive/index.html| 4 ++--
blog/atom.xml | 3 ++-
blog/fury_0_1_0_release/index.html | 4 ++--
blog/fury_0_1_1_release/index.html | 4 ++--
blog/fury_0_1_2_release/index.html | 4 ++--
blog/fury_0_2_0_release/index.html | 4 ++--
blog/fury_0_2_1_release/index.html | 4 ++--
blog/fury_0_3_0_release/index.html | 4 ++--
blog/fury_0_3_1_release/index.html | 4 ++--
blog/fury_0_4_0_release/index.html | 4 ++--
blog/fury_0_4_1_release/index.html | 4 ++--
blog/fury_0_5_0_release/index.html | 4 ++--
.../index.html | 4 ++--
.../index.html | 7 ---
blog/index.html| 7 ---
blog/page/2/index.html | 4 ++--
blog/rss.xml | 3 ++-
blog/tags/fury/index.html | 7 ---
blog/tags/fury/page/2/index.html | 4 ++--
blog/tags/index.html | 4 ++--
docs/guide/development/index.html | 4 ++--
docs/guide/graalvm_guide/index.html| 4 ++--
docs/guide/java_object_graph_guide/index.html | 4 ++--
docs/guide/row_format_guide/index.html | 4 ++--
docs/guide/scala_guide/index.html | 4 ++--
docs/guide/xlang_object_graph_guide/index.html | 4 ++--
docs/guide/xlang_type_mapping/index.html | 4 ++--
docs/introduction/benchmark/index.html | 4 ++--
docs/introduction/features/index.html | 4 ++--
docs/introduction/index.html | 4 ++--
docs/specification/fury_java_serialization_spec/index.html | 4 ++--
docs/specification/fury_row_format_spec/index.html | 4 ++--
docs/specification/fury_xlang_serialization_spec/index.html| 4 ++--
docs/start/install/index.html | 4 ++--
docs/start/usage/index.html| 4 ++--
download/index.html| 4 ++--
index.html | 4 ++--
lunr-index-1715049161377.json | 1 -
lunr-index-1715074035179.json | 1 +
lunr-index.json| 2 +-
markdown-page/index.html | 4 ++--
search-doc-1715049161377.json | 1 -
search-doc-1715074035179.json | 1 +
search-doc.json| 2 +-
54 files changed, 94 insertions(+), 89 deletions(-)
diff --git a/404.html b/404.html
index a5c24fc..f64c4a2 100644
--- a/404.html
+++ b/404.html
@@ -5,8 +5,8 @@
Page Not Found | Apache Fury (incubating)https://fury.apache.org/404.html;>
-
-
+
+
!function(){function
t(t){document.documentElement.setAttribute("data-theme",t)}var
(incubator-fury-site) branch main updated: add metastring spec link to metastring blog (#123)
This is an automated email from the ASF dual-hosted git repository. chaokunyang pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/incubator-fury-site.git The following commit(s) were added to refs/heads/main by this push: new 6fd68e6 add metastring spec link to metastring blog (#123) 6fd68e6 is described below commit 6fd68e642904e8adc6d3b8463d7c8cfb1489a104 Author: Shawn Yang AuthorDate: Tue May 7 17:26:43 2024 +0800 add metastring spec link to metastring blog (#123) --- blog/2024-05-06-metastring-space-efficient_encoding_for_string.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/blog/2024-05-06-metastring-space-efficient_encoding_for_string.md b/blog/2024-05-06-metastring-space-efficient_encoding_for_string.md index 550bfdd..9afee9e 100644 --- a/blog/2024-05-06-metastring-space-efficient_encoding_for_string.md +++ b/blog/2024-05-06-metastring-space-efficient_encoding_for_string.md @@ -14,7 +14,7 @@ will take one byte for every char, which is not space efficient actually. If we take a deeper look, we will found that most chars are **lowercase chars, `.`, `$` and `_`**, which can be expressed in a much smaller range **`0~32`**. But one byte can represent range `0~255`, the significant bits are wasted, and this cost is not ignorable. In a dynamic serialization -framework, such meta will take considerable cost compared to real data. +framework, such meta will take considerable cost compared to actual data. So we proposed a new string encoding algorithm which we called **meta string encoding** in Fury. It will encode most chars using `5` bits instead of `8` bits in utf-8 encoding, which can bring **37.5% space cost savings** compared to utf-8 encoding. @@ -26,6 +26,7 @@ Such a string is enumerated and limited, so the encoding performance is not impo Meta string encoding uses `5/6` bits instead of `8` bits in utf-8 encoding for every chars. Since it uses less bits than utf8, it can bring **37.5% space cost savings** compared to utf-8 and has a smaller encoded binary size, which uses less storage and makes the network transfer faster. +More details about meta string spec can be found in [Fury xlang serialization specification](https://fury.apache.org/docs/specification/fury_xlang_serialization_spec/#meta-string). ## Encoding Algorithms - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
Re: [PR] add metastring spec link to metastring blog [incubator-fury-site]
chaokunyang merged PR #123: URL: https://github.com/apache/incubator-fury-site/pull/123 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
[GH] (incubator-fury): Workflow run "Lint PR" is working again!
The GitHub Actions job "Lint PR" on incubator-fury.git has succeeded. Run started by GitHub user bytemain (triggered by bytemain). Head commit for run: b7c62af3373b8db985e9633f617e09e302a99bc4 / 野声 chore: update code Report URL: https://github.com/apache/incubator-fury/actions/runs/8982081810 With regards, GitHub Actions via GitBox - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
[PR] add metastring spec link to metastring blog [incubator-fury-site]
chaokunyang opened a new pull request, #123: URL: https://github.com/apache/incubator-fury-site/pull/123 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
[GH] (incubator-fury): Workflow run "Lint PR" failed!
The GitHub Actions job "Lint PR" on incubator-fury.git has failed. Run started by GitHub user bytemain (triggered by bytemain). Head commit for run: b7c62af3373b8db985e9633f617e09e302a99bc4 / 野声 chore: update code Report URL: https://github.com/apache/incubator-fury/actions/runs/8981730867 With regards, GitHub Actions via GitBox - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
[GH] (incubator-fury): Workflow run "Lint PR" failed!
The GitHub Actions job "Lint PR" on incubator-fury.git has failed. Run started by GitHub user bytemain (triggered by bytemain). Head commit for run: 91959d417fd120a0eaa5642d8654631b8c246f25 / 野声 chore: update code Report URL: https://github.com/apache/incubator-fury/actions/runs/8981719631 With regards, GitHub Actions via GitBox - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
[GH] (incubator-fury): Workflow run "Lint PR" failed!
The GitHub Actions job "Lint PR" on incubator-fury.git has failed. Run started by GitHub user bytemain (triggered by bytemain). Head commit for run: c361370288b0304db312e4478f0d8405cf6e0b24 / 野声 fix: use timestamp Report URL: https://github.com/apache/incubator-fury/actions/runs/8981633243 With regards, GitHub Actions via GitBox - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
[GH] (incubator-fury): Workflow run "Lint PR" failed!
The GitHub Actions job "Lint PR" on incubator-fury.git has failed. Run started by GitHub user bytemain (triggered by bytemain). Head commit for run: 5cccfe5376c10ff9b1591681284d9325fb1e06ed / 野声 feat: add data to description util Report URL: https://github.com/apache/incubator-fury/actions/runs/8981377131 With regards, GitHub Actions via GitBox - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
[PR] feat(javascript): add a data to description util [incubator-fury]
bytemain opened a new pull request, #1609: URL: https://github.com/apache/incubator-fury/pull/1609 ## What does this PR do? Add a new util called `data2Description`, which can reduce the amount of code ## Related issues ## Does this PR introduce any user-facing change? - [ ] Does this PR introduce any public API change? - [ ] Does this PR introduce any binary protocol compatibility change? ## Benchmark -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: commits-unsubscr...@fury.apache.org For additional commands, e-mail: commits-h...@fury.apache.org
