[GitHub] incubator-quickstep pull request #357: Fixed the command execution bug in th...

2018-05-21 Thread zuyu
GitHub user zuyu opened a pull request:

https://github.com/apache/incubator-quickstep/pull/357

Fixed the command execution bug in the distributed version.

This PR fixed the command execution bugs in the distributed version, and 
now it is consistent with the single-node version.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zuyu/incubator-quickstep dist-fix

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-quickstep/pull/357.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #357


commit 89ddcb48b32f352659600cdcdc55fe059184a06a
Author: Zuyu Zhang 
Date:   2018-05-21T21:39:42Z

Fixed the command execution bug in the distributed version.




---


[GitHub] incubator-quickstep pull request #338: Fixed the gRPC Problem for Data Excha...

2018-05-21 Thread zuyu
Github user zuyu commented on a diff in the pull request:

https://github.com/apache/incubator-quickstep/pull/338#discussion_r189711855
  
--- Diff: storage/StorageManager.cpp ---
@@ -687,8 +687,13 @@ StorageManager::BlockHandle 
StorageManager::loadBlockOrBlob(
 #ifdef QUICKSTEP_DISTRIBUTED
 const string domain_network_address = 
getPeerDomainNetworkAddress(BlockIdUtil::Domain(block));
 DLOG(INFO) << "Pulling Block " << BlockIdUtil::ToString(block) << " 
from " << domain_network_address;
+
+// Customize the grpc channel
+grpc::ChannelArguments channelArgs;
+channelArgs.SetMaxReceiveMessageSize(kGrpcChanelSize);
--- End diff --

Please add a condition wrapper based on the `GRPC` version number for this 
API call, since not every version has this API.


---


[GitHub] incubator-quickstep pull request #356: DO NOT MERGE: Added the grpc in Travi...

2018-05-21 Thread zuyu
GitHub user zuyu opened a pull request:

https://github.com/apache/incubator-quickstep/pull/356

DO NOT MERGE: Added the grpc in Travis CI.



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zuyu/incubator-quickstep travis-grpc-new

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-quickstep/pull/356.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #356


commit d6554af49ae003e7999f4367369dc3e6242ad18b
Author: Zuyu Zhang 
Date:   2018-05-21T18:42:15Z

Added the grpc in Travis CI.




---


[GitHub] incubator-quickstep issue #355: QUICKSTEP-127 Data provider thread

2018-05-21 Thread zuyu
Github user zuyu commented on the issue:

https://github.com/apache/incubator-quickstep/pull/355
  
We do not test the distributed version in CI due to previous time-out issue 
while installing `grpc` by source code.


---


[GitHub] incubator-quickstep pull request #355: QUICKSTEP-127 Data provider thread

2018-05-21 Thread zuyu
Github user zuyu commented on a diff in the pull request:

https://github.com/apache/incubator-quickstep/pull/355#discussion_r189664042
  
--- Diff: storage/DataProviderThread.hpp ---
@@ -0,0 +1,103 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ *   http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied.  See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ **/
+
+#ifndef QUICKSTEP_STORAGE_DATA_PROVIDER_THREAD_HPP_
+#define QUICKSTEP_STORAGE_DATA_PROVIDER_THREAD_HPP_
+
+#include 
+
+#include "query_execution/QueryExecutionTypedefs.hpp"
+#include "storage/StorageConfig.h"
+#include "threading/Thread.hpp"
+#include "utility/Macros.hpp"
+
+#include "tmb/native_net_client_message_bus.h"
+
+namespace quickstep {
+
+class CatalogDatabase;
+class CatalogRelation;
+class QueryProcessor;
+class StorageManager;
+
+/** \addtogroup Storage
+ *  @{
+ */
+
+/**
+ * @brief A thread that provides access to query results (e.g. storage 
blocks),
+ *to Quickstep clients.
--- End diff --

Could you please provide more info regarding this class, including which 
class will own this class, and why it needs write permissions to both 
`CatalogDatabase` and `QueryProcessor`? Thanks!


---


[GitHub] incubator-quickstep issue #355: QUICKSTEP-127 Data provider thread

2018-05-21 Thread hbdeshmukh
Github user hbdeshmukh commented on the issue:

https://github.com/apache/incubator-quickstep/pull/355
  
@zuyu Question: How do you run tests for distributed quickstep on Travis?


---


[GitHub] incubator-quickstep pull request #355: QUICKSTEP-127 Data provider thread

2018-05-21 Thread hbdeshmukh
GitHub user hbdeshmukh opened a pull request:

https://github.com/apache/incubator-quickstep/pull/355

QUICKSTEP-127 Data provider thread 

- Thread used for receiving block requests from clients and sending the
contents of a block back to the client.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/hbdeshmukh/incubator-quickstep 
data-provider-thread

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-quickstep/pull/355.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #355


commit 6967ca57c448a17b63e176bf8bc1576066fe893a
Author: Harshad Deshmukh 
Date:   2018-04-06T21:00:54Z

Data Provider thread added.

- Thread used for receiving block requests from clients and sending the
contents of a block back to the client.




---