[jira] [Comment Edited] (IMPALA-11677) FireInsertEvents function can be very slow for tables with large number of partitions.

2022-10-19 Thread Qihong Jiang (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620713#comment-17620713 ] Qihong Jiang edited comment on IMPALA-11677 at 10/20/22 5:05 AM: - Hello

[jira] [Comment Edited] (IMPALA-11677) FireInsertEvents function can be very slow for tables with large number of partitions.

2022-10-19 Thread Qihong Jiang (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620713#comment-17620713 ] Qihong Jiang edited comment on IMPALA-11677 at 10/20/22 5:04 AM: - Hello

[jira] [Commented] (IMPALA-11677) FireInsertEvents function can be very slow for tables with large number of partitions.

2022-10-19 Thread Qihong Jiang (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620713#comment-17620713 ] Qihong Jiang commented on IMPALA-11677: --- Hello !, [~csringhofer] I'm only using non-transactional

[jira] [Created] (IMPALA-11677) FireInsertEvents function can be very slow for tables with large number of partitions.

2022-10-19 Thread Qihong Jiang (Jira)
Qihong Jiang created IMPALA-11677: - Summary: FireInsertEvents function can be very slow for tables with large number of partitions. Key: IMPALA-11677 URL: https://issues.apache.org/jira/browse/IMPALA-11677

[jira] [Created] (IMPALA-11677) FireInsertEvents function can be very slow for tables with large number of partitions.

2022-10-19 Thread Qihong Jiang (Jira)
Qihong Jiang created IMPALA-11677: - Summary: FireInsertEvents function can be very slow for tables with large number of partitions. Key: IMPALA-11677 URL: https://issues.apache.org/jira/browse/IMPALA-11677

[jira] [Created] (FLINK-27610) PrometheusPushGatewayReporter doesn't support basic authentication

2022-05-13 Thread Qihong Jiang (Jira)
Qihong Jiang created FLINK-27610: Summary: PrometheusPushGatewayReporter doesn't support basic authentication Key: FLINK-27610 URL: https://issues.apache.org/jira/browse/FLINK-27610 Project: Flink

[jira] [Created] (FLINK-27610) PrometheusPushGatewayReporter doesn't support basic authentication

2022-05-13 Thread Qihong Jiang (Jira)
Qihong Jiang created FLINK-27610: Summary: PrometheusPushGatewayReporter doesn't support basic authentication Key: FLINK-27610 URL: https://issues.apache.org/jira/browse/FLINK-27610 Project: Flink

[jira] [Created] (YARN-10851) Tez session close does not interrupt yarn's async thread

2021-07-07 Thread Qihong Wu (Jira)
Qihong Wu created YARN-10851: Summary: Tez session close does not interrupt yarn's async thread Key: YARN-10851 URL: https://issues.apache.org/jira/browse/YARN-10851 Project: Hadoop YARN Issue

[jira] [Created] (YARN-10851) Tez session close does not interrupt yarn's async thread

2021-07-07 Thread Qihong Wu (Jira)
Qihong Wu created YARN-10851: Summary: Tez session close does not interrupt yarn's async thread Key: YARN-10851 URL: https://issues.apache.org/jira/browse/YARN-10851 Project: Hadoop YARN Issue

[jira] [Created] (ZEPPELIN-5149) NPE in RemoteInterpreterServer#interpret

2020-12-01 Thread Qihong Wu (Jira)
Qihong Wu created ZEPPELIN-5149: --- Summary: NPE in RemoteInterpreterServer#interpret Key: ZEPPELIN-5149 URL: https://issues.apache.org/jira/browse/ZEPPELIN-5149 Project: Zeppelin Issue Type

[jira] [Created] (ARTEMIS-2806) deployQueue missing address argument

2020-06-15 Thread Qihong Xu (Jira)
Qihong Xu created ARTEMIS-2806: -- Summary: deployQueue missing address argument Key: ARTEMIS-2806 URL: https://issues.apache.org/jira/browse/ARTEMIS-2806 Project: ActiveMQ Artemis Issue Type

[jira] [Commented] (KAFKA-7500) MirrorMaker 2.0 (KIP-382)

2019-09-18 Thread Qihong Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932616#comment-16932616 ] Qihong Chen commented on KAFKA-7500: Hi [~ryannedolan], Thanks for your quick response (y)(y)(y) Now

[jira] [Comment Edited] (KAFKA-7500) MirrorMaker 2.0 (KIP-382)

2019-09-17 Thread Qihong Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931743#comment-16931743 ] Qihong Chen edited comment on KAFKA-7500 at 9/17/19 7:22 PM: - Hi

[jira] [Commented] (KAFKA-7500) MirrorMaker 2.0 (KIP-382)

2019-09-17 Thread Qihong Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931743#comment-16931743 ] Qihong Chen commented on KAFKA-7500: Hi [~ryannedolan], just listened your Kafka Power Chat talk

[jira] [Comment Edited] (KAFKA-7500) MirrorMaker 2.0 (KIP-382)

2019-09-11 Thread Qihong Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927863#comment-16927863 ] Qihong Chen edited comment on KAFKA-7500 at 9/11/19 6:13 PM: - [~ryannedolan

Is Xerces-c 3.2.2 slower than 3.1.4 part 2

2019-03-21 Thread Qihong Wang
Due to the limitation of the email size, I have to send the rest of attachment in a separate email. -- Qihong Wang Senior Software Developer ANSYS, Inc. www.ansys.com Southpointe 2600 ANSYS Drive Canonsburg, PA 15317-9565 Phone:724-820-3966 Fax:724-820-3816 E-Mail: qihong.w...@ansys.com

[jira] [Created] (ARTEMIS-2251) Large messages might not be deleted when server crashed

2019-02-12 Thread Qihong Xu (JIRA)
Qihong Xu created ARTEMIS-2251: -- Summary: Large messages might not be deleted when server crashed Key: ARTEMIS-2251 URL: https://issues.apache.org/jira/browse/ARTEMIS-2251 Project: ActiveMQ Artemis

[jira] [Updated] (ARTEMIS-2214) ARTEMIS-2214 Cache durable in PagedReference

2019-01-04 Thread Qihong Xu (JIRA)
[ https://issues.apache.org/jira/browse/ARTEMIS-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qihong Xu updated ARTEMIS-2214: --- Summary: ARTEMIS-2214 Cache durable in PagedReference (was: Cache durable in PagedReference

[jira] [Updated] (ARTEMIS-2216) Use a specific executor for pageSyncTimer

2018-12-29 Thread Qihong Xu (JIRA)
[ https://issues.apache.org/jira/browse/ARTEMIS-2216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qihong Xu updated ARTEMIS-2216: --- Description: Improving throughput on paging mode is one of our concerns since our cluster uses

[jira] [Created] (ARTEMIS-2216) Use a specific executor for pageSyncTimer

2018-12-29 Thread Qihong Xu (JIRA)
Qihong Xu created ARTEMIS-2216: -- Summary: Use a specific executor for pageSyncTimer Key: ARTEMIS-2216 URL: https://issues.apache.org/jira/browse/ARTEMIS-2216 Project: ActiveMQ Artemis Issue

[jira] [Created] (ARTEMIS-2214) Cache durable in PagedReference to avoid blocks in consuming paged messages

2018-12-25 Thread Qihong Xu (JIRA)
Qihong Xu created ARTEMIS-2214: -- Summary: Cache durable in PagedReference to avoid blocks in consuming paged messages Key: ARTEMIS-2214 URL: https://issues.apache.org/jira/browse/ARTEMIS-2214 Project

[jira] [Updated] (ARTEMIS-2214) Cache durable in PagedReference to avoid blocks in consuming paged messages

2018-12-25 Thread Qihong Xu (JIRA)
[ https://issues.apache.org/jira/browse/ARTEMIS-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qihong Xu updated ARTEMIS-2214: --- Attachment: (was: 0001-Add-durable-and-priority-to-pagedReference.patch) > Cache dura

[jira] [Updated] (ARTEMIS-2214) Cache durable in PagedReference to avoid blocks in consuming paged messages

2018-12-25 Thread Qihong Xu (JIRA)
[ https://issues.apache.org/jira/browse/ARTEMIS-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qihong Xu updated ARTEMIS-2214: --- Attachment: 0001-Add-durable-and-priority-to-pagedReference.patch > Cache dura

[jira] [Updated] (ARTEMIS-2214) Cache durable in PagedReference to avoid blocks in consuming paged messages

2018-12-25 Thread Qihong Xu (JIRA)
[ https://issues.apache.org/jira/browse/ARTEMIS-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qihong Xu updated ARTEMIS-2214: --- Attachment: stacks.txt > Cache durable in PagedReference to avoid blocks in consuming pa

I got an issue, when testing command like this :qemu–system–aarch64 -kernel uimage -smp 2...

2018-03-13 Thread Jiang qihong
The whole command , qemu–system–aarch64 -kernel uimage -M vexpress -a15 -cpu cortex-a57 -smp 2 -m256 --nographic The issue is that when running into shell, i didn't find two cpus. The parameter "-smp 2",didn't work. Does qemu support arch arm -v8 when using the parameter(-smp)? From jqh

[jira] [Commented] (ARTEMIS-1700) Server stopped responding and killed itself while exiting paging state

2018-02-23 Thread Qihong Xu (JIRA)
[ https://issues.apache.org/jira/browse/ARTEMIS-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375225#comment-16375225 ] Qihong Xu commented on ARTEMIS-1700: [~nigro@gmail.com] Yes, we just use the default setting

[jira] [Created] (ARTEMIS-1700) Server stopped responding and killed itself while exiting paging state

2018-02-23 Thread Qihong Xu (JIRA)
Qihong Xu created ARTEMIS-1700: -- Summary: Server stopped responding and killed itself while exiting paging state Key: ARTEMIS-1700 URL: https://issues.apache.org/jira/browse/ARTEMIS-1700 Project

[jira] [Updated] (ZOOKEEPER-2964) "Conf" command returns dataDir and dataLogDir opposingly

2018-01-08 Thread Qihong Xu (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qihong Xu updated ZOOKEEPER-2964: - Summary: "Conf" command returns dataDir and dataLogDir opposingly (was

[jira] [Updated] (ZOOKEEPER-2964) dataDir and dataLogDir are printed opposingly

2018-01-07 Thread Qihong Xu (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qihong Xu updated ZOOKEEPER-2964: - Attachment: ZOOKEEPER-2964.patch > dataDir and dataLogDir are printed opposin

[jira] [Updated] (ZOOKEEPER-2964) dataDir and dataLogDir are printed opposingly

2018-01-07 Thread Qihong Xu (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qihong Xu updated ZOOKEEPER-2964: - Description: I foung a bug that "conf" command would return dataDir and

[jira] [Created] (ZOOKEEPER-2964) dataDir and dataLogDir are printed opposingly

2018-01-07 Thread Qihong Xu (JIRA)
Qihong Xu created ZOOKEEPER-2964: Summary: dataDir and dataLogDir are printed opposingly Key: ZOOKEEPER-2964 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-2964 Project: ZooKeeper

[jira] [Updated] (ZOOKEEPER-2927) Local session reconnect validation not forward to leader

2017-10-28 Thread Qihong Xu (JIRA)
[ https://issues.apache.org/jira/browse/ZOOKEEPER-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qihong Xu updated ZOOKEEPER-2927: - Description: When zookeeper quorum recovers from shutdown/crash, a client with a local

Re: GSoC 2015 Students: "Pencils Down" and Final Evaluation Dates Approaching

2015-09-28 Thread Qihong Lin
Hi Dr. Jiang, Yes, the code have been submitted. Thanks for your kindly reminder. regards Qihong On Tue, Sep 22, 2015 at 10:32 AM, Ying Jiang <jpz6311...@gmail.com> wrote: > Hi Qihong, > > Have you submitted the code sample? If not, you'd better do it right > now

incubator-geode git commit: GEODE-77: improve restart locator error handling on corrupted state file

2015-08-19 Thread qihong
/incubator-geode/commit/7fd67b88 Tree: http://git-wip-us.apache.org/repos/asf/incubator-geode/tree/7fd67b88 Diff: http://git-wip-us.apache.org/repos/asf/incubator-geode/diff/7fd67b88 Branch: refs/heads/feature/GEODE-77 Commit: 7fd67b8836b1c0ff95034a9a6f25901e805354f2 Parents: c61fe34 Author: Qihong Chen qc

Re: Fwd: Final Deliveries of GSoC Project (JENA-491)

2015-08-18 Thread Qihong Lin
side separate model and dataset. It's kind of ugly in code. Any more suggestion? regards, Qihong On Mon, Aug 17, 2015 at 10:49 PM, Andy Seaborne a...@apache.org wrote: Thanks for the clarification. I had made a combined version to start testing and hopefully it's a close approximation

Re: svn commit: r1696184 - /jena/site/trunk/content/documentation/query/construct-quad.mdtext

2015-08-18 Thread Qihong Lin
Hi Dr. Jiang Thank you! I'll refine the doc following your instructions. regards, Qihong On Tue, Aug 18, 2015 at 12:21 PM, Ying Jiang jpz6311...@gmail.com wrote: Hi Qihong, You can improve the doc: 1) The grammar table collapses. I can see a | in the first row, which needs to be escaped

Re: Fwd: Final Deliveries of GSoC Project (JENA-491)

2015-08-17 Thread Qihong Lin
be ignored. Or, you can merge PR 89, and then go with PR 91. Hope it's clear. regards, Qihong On Sun, Aug 16, 2015 at 9:14 PM, Andy Seaborne a...@apache.org wrote: Hi - there are some problems with PR 91. PR 91 contains changes to jena-arq as well as jena-fuseki-core. Does PR 91 replace PR 89

Re: Fwd: Final Deliveries of GSoC Project (JENA-491)

2015-08-15 Thread Qihong Lin
construct_quad.mdtext under [2]. I also try to open [3], with Not Found error. Could you help me please? regards, Qihong [1] http://jena.staging.apache.org/documentation/query/construct-quad.html [2] https://cms.apache.org/jena/wc/edit/anonymous-LWMAVL/trunk/ [3] http://jena.apache.org

[2/3] incubator-geode git commit: GEODE-77: Implement Authenticator interface in class GMSAuthenticator with unit tests.

2015-08-13 Thread qihong
http://git-wip-us.apache.org/repos/asf/incubator-geode/blob/0a70d514/gemfire-core/src/main/java/com/gemstone/gemfire/distributed/internal/membership/gms/membership/GMSJoinLeave.java -- diff --git

Re: Fwd: Final Deliveries of GSoC Project (JENA-491)

2015-08-12 Thread Qihong Lin
Hi Andy, I can not find the branch of JENA-491-construct-quads in Jena git repository: https://github.com/apache/jena/branches regards, Qihong On Tue, Aug 11, 2015 at 4:12 PM, Andy Seaborne a...@apache.org wrote: On 11/08/15 03:35, Ying Jiang wrote: Hi Qihong, You may have received

Re: Fwd: Final Deliveries of GSoC Project (JENA-491)

2015-08-12 Thread Qihong Lin
Hi Andy, I've got the idea of projection. The bug has been fixed. I'll deliver more tests. Thanks! Qihong On Tue, Aug 11, 2015 at 4:52 PM, Andy Seaborne a...@apache.org wrote: On 11/08/15 09:11, Qihong Lin wrote: hi Andy, I'll further enrich the test data and add JUnit tests in TestAPI

Re: Fwd: Final Deliveries of GSoC Project (JENA-491)

2015-08-11 Thread Qihong Lin
saying the query string not working with the query method? Could you please tell me your opnions about the last 2 cases? regards, Qihong On Mon, Aug 10, 2015 at 9:58 PM, Andy Seaborne a...@apache.org wrote: I've managed to integrate the latest updates. The scripted ones look, at first glance OK

Re: Fwd: Final Deliveries of GSoC Project (JENA-491)

2015-08-10 Thread Qihong Lin
of the construct of ARQ. So I add the execution tests in jena-arq/testing/ARQ/Construct/manifest.ttl. The fuseki part of construct quad has been implemented (not committed yet). I'll submit the code as soon as the PR 89 [1] being merged. Anything to be improved for PR 89 from your reviews? regards, Qihong [1

[15/19] incubator-geode git commit: Fix GEODE-154: HDFS region with HeapLRU reports LowMemoryExceptions even when region size is less then the eviction threshold

2015-08-06 Thread qihong
Committer: Qihong Chen qc...@pivotal.io Committed: Thu Aug 6 10:07:48 2015 -0700 -- .../internal/cache/control/HeapMemoryMonitor.java | 13 + 1 file changed, 1 insertion(+), 12 deletions

[11/19] incubator-geode git commit: GEODE-172: Fixing an intermittent failure as reported by closing cache after each individual test.

2015-08-06 Thread qihong
: 0a555b9e7e1e36fb3e9f651f3691ff50efee45d6 Parents: 3cef2d7 Author: Vivek Bhaskar vbhas...@pivotal.io Authored: Thu Jul 30 17:14:57 2015 +0530 Committer: Qihong Chen qc...@pivotal.io Committed: Thu Aug 6 10:07:47 2015 -0700 -- .../gemfire/internal

[03/19] incubator-geode git commit: [GEODE-176] fixes the issue

2015-08-06 Thread qihong
/incubator-geode/diff/863c4ca3 Branch: refs/heads/feature/GEODE-137 Commit: 863c4ca3471b96344e26dda80e4d39c4f6a8da52 Parents: cd06fb9 Author: eshu e...@pivotal.io Authored: Thu Jul 30 11:42:28 2015 -0700 Committer: Qihong Chen qc...@pivotal.io Committed: Thu Aug 6 10:07:47 2015 -0700

[06/19] incubator-geode git commit: GEODE-162: remove race condititions and long sleeps from region expiration test methods in RegionTestCase

2015-08-06 Thread qihong
Committer: Qihong Chen qc...@pivotal.io Committed: Thu Aug 6 10:07:47 2015 -0700 -- .../gemfire/internal/cache/LocalRegion.java | 7 + .../gemfire/cache30/RegionTestCase.java | 132 --- 2 files

[13/19] incubator-geode git commit: GEODE-155: - Fixes intermittent failure in RegionWithHDFS*DUnitTest about incorrect number of hoplog files getting created. - Caused due to an earlier test not clea

2015-08-06 Thread qihong
/incubator-geode/tree/cb735a20 Diff: http://git-wip-us.apache.org/repos/asf/incubator-geode/diff/cb735a20 Branch: refs/heads/feature/GEODE-137 Commit: cb735a2045f124ee7c5c6ba84dbcafe4383008d7 Parents: 71f00b5 Author: ashetkar ashet...@pivotal.io Authored: Tue Aug 4 14:06:51 2015 +0530 Committer: Qihong

[1/2] incubator-geode git commit: GEODE-137: use local GemFire server to initialize ClientCache whenever possible.

2015-08-06 Thread qihong
/incubator-geode/commit/d0d48588 Tree: http://git-wip-us.apache.org/repos/asf/incubator-geode/tree/d0d48588 Diff: http://git-wip-us.apache.org/repos/asf/incubator-geode/diff/d0d48588 Branch: refs/heads/develop Commit: d0d48588c895cff7418090c50b57f9f4a740763c Parents: 2e2a795 Author: Qihong Chen qc

Git Push Summary

2015-08-06 Thread qihong
Repository: incubator-geode Updated Branches: refs/heads/feature/GEODE-137 [deleted] e596a4eec

[02/19] incubator-geode git commit: GEODE-168: remove Bug34011JUnitTest

2015-08-06 Thread qihong
/repos/asf/incubator-geode/diff/daeb077f Branch: refs/heads/feature/GEODE-137 Commit: daeb077f099545346f2ac8080689b2fe23db4aec Parents: 6f6075f Author: Darrel Schneider dschnei...@pivotal.io Authored: Wed Jul 29 14:47:42 2015 -0700 Committer: Qihong Chen qc...@pivotal.io Committed: Thu Aug 6 10:07:46

[01/19] incubator-geode git commit: GEODE-169: testEventsExpiryBug should expect Unexpected IOException.

2015-08-06 Thread qihong
dschnei...@pivotal.io Authored: Wed Jul 29 15:31:08 2015 -0700 Committer: Qihong Chen qc...@pivotal.io Committed: Thu Aug 6 10:07:46 2015 -0700 -- .../gemfire/internal/cache/ha/Bug36853EventsExpiryDUnitTest.java| 1 + 1 file

[18/19] incubator-geode git commit: Fix GEODE-186 by removing sleeps in tests

2015-08-06 Thread qihong
/diff/389e2a8c Branch: refs/heads/feature/GEODE-137 Commit: 389e2a8cac1f2b35aa3ebfd10e8c49ae993b0dc4 Parents: e4c77c6 Author: Darrel Schneider dschnei...@pivotal.io Authored: Tue Aug 4 11:43:39 2015 -0700 Committer: Qihong Chen qc...@pivotal.io Committed: Thu Aug 6 10:07:48 2015 -0700

[09/19] incubator-geode git commit: GEODE-181: Add new unit and integration tests for FastLogger

2015-08-06 Thread qihong
: Tue Aug 4 11:39:44 2015 -0700 Committer: Qihong Chen qc...@pivotal.io Committed: Thu Aug 6 10:07:47 2015 -0700 -- build.gradle| 1 + .../gemfire/internal/logging/LogService.java| 53

[10/19] incubator-geode git commit: GEODE-175: change test to use a wait criteria instead of pause and use millis instead of seconds

2015-08-06 Thread qihong
: Qihong Chen qc...@pivotal.io Committed: Thu Aug 6 10:07:47 2015 -0700 -- .../cache/RemoteTransactionDUnitTest.java | 42 +--- 1 file changed, 27 insertions(+), 15 deletions

Re: Fwd: Final Deliveries of GSoC Project (JENA-491)

2015-08-05 Thread Qihong Lin
{ } On Sun, Aug 2, 2015 at 9:14 AM, Ying Jiang jpz6311...@gmail.com wrote: Hi Qihong, I re-checked the code you commited. Most of the hashCode issues for arq.qparse that Andy pointed out are due to the incorrect serialization of the Template. The code can only deal with the quads with the same

Re: Fwd: Final Deliveries of GSoC Project (JENA-491)

2015-07-29 Thread Qihong Lin
Hi, I've fixed the bugs of arq.aparse and , with some minor improvements for Java 7/8 you mentioned. Please check the PR 89. I hope it can be merged into jena master ASAP, so that I can go on with merging the code for fuseki support. regard, Qihong On Wed, Jul 29, 2015 at 11:54 AM, Ying Jiang

Re: Merging GEODE-9 Spark Connector project into develop

2015-07-24 Thread Qihong Chen
+1 to merge On Fri, Jul 24, 2015 at 9:54 AM, Dan Smith dsm...@pivotal.io wrote: +1 to merge. -Dan On Thu, Jul 23, 2015 at 11:44 PM, Jianxia Chen jc...@pivotal.io wrote: +1 for merge On Thu, Jul 23, 2015 at 4:27 PM, Anilkumar Gingade aging...@pivotal.io wrote: +1 for merge.

JENA-491 Pull Request (First Half Part)

2015-07-22 Thread Qihong Lin
/master so that the JENA-491 functions can be applied. If it's OK, I'll further deal with construct quad support of fuseki. The code have done. I can merge them in the same way. regards, Qihong

Re: Final Deliveries of GSoC Project (JENA-491)

2015-07-18 Thread Qihong Lin
Hi, I've been taking some course exams for the last week. The current project status is ahead of plan. I'll continue the project next week after the exams. For 1), how to commit the documentation in Jena website? regards, Qihong On Wed, Jul 15, 2015 at 5:43 PM, Ying Jiang jpz6311...@gmail.com

[jira] [Created] (GEODE-137) Spark Connector: should connect to local GemFire server if possible

2015-07-17 Thread Qihong Chen (JIRA)
Qihong Chen created GEODE-137: - Summary: Spark Connector: should connect to local GemFire server if possible Key: GEODE-137 URL: https://issues.apache.org/jira/browse/GEODE-137 Project: Geode

[jira] [Resolved] (GEODE-120) RDD.saveToGemfire() can not handle big dataset (1M entries per partition)

2015-07-17 Thread Qihong Chen (JIRA)
[ https://issues.apache.org/jira/browse/GEODE-120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qihong Chen resolved GEODE-120. --- Resolution: Fixed RDD.saveToGemfire() can not handle big dataset (1M entries per partition

[jira] [Closed] (GEODE-114) There's race condition in DefaultGemFireConnection.getRegionProxy

2015-07-17 Thread Qihong Chen (JIRA)
[ https://issues.apache.org/jira/browse/GEODE-114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qihong Chen closed GEODE-114. - There's race condition in DefaultGemFireConnection.getRegionProxy

[1/2] incubator-geode git commit: GEODE-114: fix race condition in DefaultGemFireConnection.getRegionProxy

2015-07-16 Thread qihong
/incubator-geode/commit/dc1c1559 Tree: http://git-wip-us.apache.org/repos/asf/incubator-geode/tree/dc1c1559 Diff: http://git-wip-us.apache.org/repos/asf/incubator-geode/diff/dc1c1559 Branch: refs/heads/feature/GEODE-9 Commit: dc1c1559dd8a38ffade204f5440755338de2a5c8 Parents: 2793365 Author: Qihong Chen qc

[2/2] incubator-geode git commit: Merge branch 'GEODE-114' into feature/GEODE-9

2015-07-16 Thread qihong
-us.apache.org/repos/asf/incubator-geode/diff/89b9aaff Branch: refs/heads/feature/GEODE-9 Commit: 89b9aaff835cd3545a94bd5b06ce7f0a4c8a2b4b Parents: 60d074c dc1c155 Author: Qihong Chen qc...@pivotal.io Authored: Thu Jul 16 10:11:33 2015 -0700 Committer: Qihong Chen qc...@pivotal.io Committed: Thu Jul 16 10

[jira] [Updated] (GEODE-120) RDD.saveToGemfire() can not handle big dataset (1M entries per partition)

2015-07-16 Thread Qihong Chen (JIRA)
[ https://issues.apache.org/jira/browse/GEODE-120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qihong Chen updated GEODE-120: -- Summary: RDD.saveToGemfire() can not handle big dataset (1M entries per partition

Re: Review Request 36408: Resolve the Geode Spark Connector Build Issue

2015-07-14 Thread Qihong Chen
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36408/#review91625 --- Ship it! Ship It! - Qihong Chen On July 10, 2015, 11:32 p.m

Re: [ANN] GSoC 2015 Project Mid-term Evaluation (PASS)

2015-07-09 Thread Qihong Lin
/jena:master regards, Qihong On Tue, Jul 7, 2015 at 1:48 AM, Andy Seaborne a...@apache.org wrote: On 05/07/15 15:49, Qihong Lin wrote: Hi, Please check my latest commits [1]. Hi Qihong, As in my other message, that has crossed over at the same time you sent this, it is time to work out

Re: [GSoC 2015 - JENA-491] JavaCC with master.jj

2015-07-09 Thread Qihong Lin
tests for constructing quads. Thanks! regards, Qihong On Tue, Jun 16, 2015 at 9:24 PM, Andy Seaborne a...@apache.org wrote: On 16/06/15 09:06, Qihong Lin wrote: Hi, Thanks! I just marked GRAPH mandatory, and it worked without producing the warnings. I'll look into the details later. By the way

Re: Where to place Spark + GemFire connector.

2015-07-07 Thread Qihong Chen
to support this with single source repository? Thanks, Qihong

Re: [ANN] GSoC 2015 Project Mid-term Evaluation (PASS)

2015-07-05 Thread Qihong Lin
Hi, Please check my latest commits [1]. I just completed the function of QueryEngineHTTP.execConstructQuads(). You can try out the example of query_construct_quad_01() in TestQuery [2]. I'll improve the tests later on, with more questions in the other thread. Thanks! Regards, Qihong [1

Extend CONSTRUCT to build quads (JENA-491)

2015-07-02 Thread Qihong Lin
will bring more conveniences for the users manipulating RDF datasets with SPARQL. Now the code has been delivered [2], with some examples here [3]. You're welcome to try them out. Any comments are appropriated. Cheers, Qihong Lin [1] https://docs.google.com/document/d

Re: [GSoC 2015 - JENA-491] Refactoring Template

2015-06-21 Thread Qihong Lin
On Tue, Jun 16, 2015 at 7:19 PM, Andy Seaborne a...@apache.org wrote: On 15/06/15 11:36, Qihong Lin wrote: Hi, Please check my last 3 commits[1], related to refactoring Template. master.jj is modified accordingly, *without* implementing the new CONSTRUCT query function for quad. Just

Re: [GSoC 2015 - JENA-491] Refactoring Template

2015-06-21 Thread Qihong Lin
Hi, Here some examples to try: https://github.com/confidencesun/jena/blob/JENA-491/jena-arq/src-examples/arq/examples/constructquads/ExampleConstructQuads.java You can see that SPARQL 1.1 remains unchanged, both for sparql_11.jj and the generated parser code. regards, Qihong On Tue, Jun 16

Re: [ANN] GSoC 2015 Accepts a Student Project for Jena

2015-06-21 Thread Qihong Lin
Hi, Please check my commits [1]. For quick answers below: On Thu, Jun 18, 2015 at 6:18 PM, Ying Jiang jpz6311...@gmail.com wrote: Hi Qihong, You may have already received an email from Google, which reminded us of the mid-term evaluation for the GSoC project. The evaluation will start next

Re: [GSoC 2015 - JENA-491] JavaCC with master.jj

2015-06-16 Thread Qihong Lin
with org.apache.jena.sparql.junit.QueryTest (is that what I need to deal with?). Any guideline or documentation for arq test? regards, Qihong On Mon, Jun 15, 2015 at 11:45 PM, Ying Jiang jpz6311...@gmail.com wrote: Hi Qihong, In addition to Andy's explanation, You might take look at this tutorial for more details

Re: [ANN] GSoC 2015 Accepts a Student Project for Jena

2015-06-15 Thread Qihong Lin
Hi, I just opened 2 new threads. Your comments are welcome! regards, Qihong On Mon, Jun 15, 2015 at 4:45 PM, Rob Vesse rve...@dotnetrdf.org wrote: Folks Could you please either start new threads of change the subject line appropriately for future discussions on this The generic subject

Re: [ANN] GSoC 2015 Accepts a Student Project for Jena

2015-06-11 Thread Qihong Lin
the sparql_10.jj grammar manually, or re-generate SPARQL_10 with the grammar script (and how?) ? regards, Qihong [1] https://github.com/confidencesun/jena/blob/master/jena-arq/src/main/java/org/apache/jena/sparql/syntax/Template.java On Fri, Jun 12, 2015 at 12:10 AM, Ying Jiang jpz6311

Re: [ANN] GSoC 2015 Accepts a Student Project for Jena

2015-06-08 Thread Qihong Lin
successfully in arq.txt Fixing Java warnings in TokenManager ... Fixing Java warnings in Token ... Fixing Java warnings in TokenMgrError ... Fixing Java warnings in ARQParser ... Done Is that the expected behavior for the grammar script? Anything wrong? regard, Qihong On Sat

Re: [ANN] GSoC 2015 Accepts a Student Project for Jena

2015-06-05 Thread Qihong Lin
Hi, I added the grammar draft at the end of [1]. There're actually minor changes on the grammar of ConstructQuery, which are marked red. Much of the grammar from SPARQL INSERT can be reused, related to Quads. Any comments? regards, Qihong [1] https://docs.google.com/document/d

Re: [ANN] GSoC 2015 Accepts a Student Project for Jena

2015-05-28 Thread Qihong Lin
else? Complete form: CONSTRUCT { # Named graph GRAPH :g { ?s :p ?o } # Default graph { ?s :p ?o } # Named graph :g { ?s :p ?o } # Default graph ?s :p ?o } WHERE { ... } Short form: CONSTRUCT { } WHERE { ... } regards, Qihong On Tue, May 26, 2015 at 11:12 PM

Re: [ANN] GSoC 2015 Accepts a Student Project for Jena

2015-05-24 Thread Qihong Lin
master. In all, I think everything is ready. Let's begin coding! regards, Qihong [1] https://github.com/confidencesun/jena/tree/JENA-491 On Tue, May 19, 2015 at 4:55 AM, Andy Seaborne a...@apache.org wrote: On 05/05/15 11:52, Andy Seaborne wrote: On 28/04/15 13:09, Ying Jiang wrote: Hi all

Re: Fwd: Proposal submitted [JENA-491]

2015-04-12 Thread Qihong Lin
proposal. Not sure what the next step is. Maybe, ranking all the proposals with scores. I'm waiting for the notices from the mentors@. Hi, Qihong, I think we should take Andy's advice to start discussion on dev@. The proposal has been submitted, and you can not change it. But we can put some

Re: Fwd: Proposal submitted [JENA-491]

2015-04-02 Thread Qihong Lin
{ # Named graph GRAPH ?g { ?s :p ?o } } WHERE regards, Qihong On Wed, Apr 1, 2015 at 9:59 PM, Andy Seaborne a...@apache.org wrote: Hi there, What's the status on this? Was it submitted? I've put some notes on JENA-491 that related to the proposal about the proposed syntax and the way

Re: Fwd: Proposal submitted

2015-03-24 Thread Qihong Lin
Hi Andy, I just changed the settings. Is the proposal here [1] now visible for you? Dr. Ying Jiang mentioned to be the potential mentor. Is that OK? regards, Qihong Lin [1] http://www.google-melange.com/gsoc/proposal/public/google/gsoc2015/confidence_sun/5639274879778816 On Tue, Mar 24, 2015

Is possible to invoke updateStateByKey twice on the same RDD

2014-10-09 Thread qihong
I need to implement following logic in a spark streaming app: for the incoming dStream, do some transformation, and invoke updateStateByKey to update state object for each key (mark data entries that are updated as dirty for next step), then let state objects produce event(s) based (based on

RE: Change RDDs using map()

2014-09-17 Thread qihong
if you want the result as RDD of (key, 1) new_rdd = rdd.filter(x = x._2 == 1) if you want result as RDD of keys (since you know the values are 1), then new_rdd = rdd.filter(x = x._2 == 1).map(x = x._1) x._1 and x._2 are the way of scala to access the key and value from key/value pair.

Re: Dealing with Time Series Data

2014-09-17 Thread qihong
what are you trying to do? generate time series from your data in HDFS, or doing some transformation and/or aggregation from your time series data in HDFS? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Dealing-with-Time-Series-Data-tp14275p14482.html Sent

Re: Spark Streaming - batchDuration for streaming

2014-09-17 Thread qihong
Here's official spark document about batch size/interval: http://spark.apache.org/docs/latest/streaming-programming-guide.html#setting-the-right-batch-size spark is batch oriented processing. As you mentioned, the streaming is continuous flow, and core spark can not handle it. Spark streaming

Re: How to initialize StateDStream

2014-09-13 Thread qihong
there's no need to initialize StateDStream. Take a look at example StatefulNetworkWordCount.scala, it's part of spark source code. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-initialize-StateDStream-tp14113p14146.html Sent from the Apache Spark

Re: How to initialize StateDStream

2014-09-13 Thread qihong
I'm not sure what you mean by previous run. Is it previous batch? or previous run of spark-submit? If it's previous batch (spark streaming creates a batch every batch interval), then there's nothing to do. If it's previous run of spark-submit (assuming you are able to save the result somewhere),

Re: compiling spark source code

2014-09-12 Thread qihong
follow the instruction here: http://spark.apache.org/docs/latest/building-with-maven.html -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/compiling-spark-source-code-tp13980p14144.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

RE: how to setup steady state stream partitions

2014-09-10 Thread qihong
Thanks for your response! I found that too, and it does the trick! Here's refined code: val inputDStream = ... val keyedDStream = inputDStream.map(...) // use sensorId as key val partitionedDStream = keyedDstream.transform(rdd = rdd.partitionBy(new MyPartitioner(...))) val stateDStream =

Re: How to set java.library.path in a spark cluster

2014-09-09 Thread qihong
Add something like following to spark-env.sh export LD_LIBRARY_PATH=path of libmosekjava7_0.so:$LD_LIBRARY_PATH (and remove all 5 exports you listed). Then restart all worker nodes, and try again. Good luck! -- View this message in context:

Re: how to choose right DStream batch interval

2014-09-05 Thread qihong
or failures), then what's the right batch interval? 5 seconds (the worst case)? 2. What will happen to DStream processing if 1 batch took longer than batch interval? Can Spark recover from that? Thanks, Qihong -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com

Re: Running spark-shell (or queries) over the network (not from master)

2014-09-05 Thread qihong
the command should be spark-shell --master spark://master ip on EC2:7077. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Running-spark-shell-or-queries-over-the-network-not-from-master-tp13543p13593.html Sent from the Apache Spark User List mailing list

Re: Running spark-shell (or queries) over the network (not from master)

2014-09-05 Thread qihong
Since you are using your home computer, so it's probably not reachable by EC2 from internet. You can try to set spark.driver.host to your WAN ip, spark.driver.port to a fixed port in SparkConf, and open that port in your home network (port forwarding to the computer you are using). see if that

Re: [GSoC] less 1 month left

2014-07-31 Thread Qihong Lin
maintainable to move the translation into an RepositoryConnection wrapper or something like that? What's an RepositoryConnection wrapper? Why do we need that (i.e. why more maintainable )? Can you show me an example? Thanks! Best regards, Qihong Lin On Mon, Jul 28, 2014 at 9:00 PM, Sergio Fernández

Re: [GSoC] less 1 month left

2014-07-27 Thread Qihong Lin
, the SPARQL implementation is up to date to the ldp and develop branches. I'll make the translations soon after any new changes from upstreams, and report to you in time. Best regards, Qihong Lin On Thu, Jul 24, 2014 at 9:59 PM, Sergio Fernández wik...@apache.org wrote: Dear Qihong Lin, On 24/07

Re: [GSoC] less 1 month left

2014-07-24 Thread Qihong Lin
. I'll have a try in the next week and keep you posted. Best, Qihong Lin [1] https://github.com/confidencesun/marmotta/commit/cff11e06c0c13bd8d8a10fea5e9eccf8d31f86ba On Wed, Jul 23, 2014 at 3:45 PM, Sergio Fernández wik...@apache.org wrote: According the official time-line: http://www.google

  1   2   >