[jira] [Commented] (IMPALA-4669) Add Kudu's RPC, util and security libraries
[ https://issues.apache.org/jira/browse/IMPALA-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16810076#comment-16810076 ] ASF subversion and git services commented on IMPALA-4669: - Commit 5dbd48f226f1061567da1c381ee2491dab3ceaf4 in impala's branch refs/heads/2.x from Lars Volker [ https://gitbox.apache.org/repos/asf?p=impala.git;h=5dbd48f ] IMPALA-4669: [KUTIL] Add kudu_util library to the build. NOTE: This commit is part of a set of changes for IMPALA-7006. It contains pieces of a previous commit that need to be cherry picked again after rebasing the code in be/src/kudu/{util,security,rpc}. The original commit message is below: A few miscellaneous changes to allow kudu_util to compile with Impala. Add kudu_version.cc to substitute for the version.cc file that is automatically built during the full Kudu build. Set LZ4_DISABLE_DEPRECATE_WARNINGS to allow Kudu's compressor utility to use deprecated names for LZ4 methods. Add NO_NVM_SUPPORT flag to Kudu build (plan to upstream this later) to disable building with nvm support, removing a library dependency. Also remove imported FindOpenSSL.cmake in favour of the standard one provided by cmake itself. Finally, a few changes to allow compilation on RHEL5: * Only use sched_getcpu() if supported * Only include magic.h if available * Workaround for kernels that don't have SOCK_NONBLOCK * Workaround for kernels that don't have O_CLOEXEC (ignore the flag) * Provide non-working implementation of fallocate() * Disable inclusion of linux/fiemap.h - although this exists on RHEL5, it does not compile due to other #includes in env_posix.cc. We disable the path this is used for, since Impala does not call that code. * Use Kudu's implementation of pipe(2), preadv(2) and pwritev(2) where it doesn't exist. In most cases these changes simply force kutil to revert to a different implementation that was already written for OSX support - this patch generalises the logic to provide the implementation whenever the required function doesn't exist. This patch compiles on RHEL5.5 and 6.0, SLES11 and 12, Ubuntu 12.04 and 14.04 and Debian 7.0 and 8.0. Change-Id: I451f02d3e4669e8a548b92fb1445cb2b322659a2 Reviewed-on: http://gerrit.cloudera.org:8080/5715 Tested-by: Impala Public Jenkins Reviewed-by: Henry Robinson Reviewed-on: http://gerrit.cloudera.org:8080/10758 Reviewed-by: Michael Ho Tested-by: Lars Volker > Add Kudu's RPC, util and security libraries > --- > > Key: IMPALA-4669 > URL: https://issues.apache.org/jira/browse/IMPALA-4669 > Project: IMPALA > Issue Type: Sub-task > Components: Distributed Exec >Affects Versions: Impala 2.8.0 >Reporter: Henry Robinson >Assignee: Henry Robinson >Priority: Major > Fix For: Impala 2.10.0 > > > To enable KRPC in Impala, we need to link against Kudu's {{rpc}}, > {{security}} and {{util}} libraries. The easiest way for now is to pull them > into trunk. > Doing this also requires upgrading our {{gutil}} version. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org
[jira] [Commented] (IMPALA-4669) Add Kudu's RPC, util and security libraries
[ https://issues.apache.org/jira/browse/IMPALA-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16810080#comment-16810080 ] ASF subversion and git services commented on IMPALA-4669: - Commit d10b34354c0d1616ed2faf78a6659e9be4aacd66 in impala's branch refs/heads/2.x from Lars Volker [ https://gitbox.apache.org/repos/asf?p=impala.git;h=d10b343 ] IMPALA-4669: [KRPC] Add kudu_rpc library to build NOTE: This commit is part of a set of changes for IMPALA-7006. It contains pieces of a previous commit that need to be cherry picked again after rebasing the code in be/src/kudu/{util,security,rpc}. The original commit message is below: Import FindKRPC.cmake from Apache Kudu. Add some files to protoc-gen-krpc link to allow it to find symbols now defined within Impala (without linking all of Impala's libraries). Change-Id: I5693288db90f2e9673b8c88ca4378c3790cba957 Reviewed-on: http://gerrit.cloudera.org:8080/5719 Reviewed-by: Henry Robinson Tested-by: Impala Public Jenkins Reviewed-on: http://gerrit.cloudera.org:8080/10760 Reviewed-by: Lars Volker Tested-by: Lars Volker > Add Kudu's RPC, util and security libraries > --- > > Key: IMPALA-4669 > URL: https://issues.apache.org/jira/browse/IMPALA-4669 > Project: IMPALA > Issue Type: Sub-task > Components: Distributed Exec >Affects Versions: Impala 2.8.0 >Reporter: Henry Robinson >Assignee: Henry Robinson >Priority: Major > Fix For: Impala 2.10.0 > > > To enable KRPC in Impala, we need to link against Kudu's {{rpc}}, > {{security}} and {{util}} libraries. The easiest way for now is to pull them > into trunk. > Doing this also requires upgrading our {{gutil}} version. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org
[jira] [Commented] (IMPALA-4669) Add Kudu's RPC, util and security libraries
[ https://issues.apache.org/jira/browse/IMPALA-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16542559#comment-16542559 ] ASF subversion and git services commented on IMPALA-4669: - Commit e1d3a616651c93a0164d3e6377f16aaae298d8cd in impala's branch refs/heads/master from [~lv] [ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=e1d3a61 ] IMPALA-4669: [KUTIL] Add kudu_util library to the build. NOTE: This commit is part of a set of changes for IMPALA-7006. It contains pieces of a previous commit that need to be cherry picked again after rebasing the code in be/src/kudu/{util,security,rpc}. The original commit message is below: A few miscellaneous changes to allow kudu_util to compile with Impala. Add kudu_version.cc to substitute for the version.cc file that is automatically built during the full Kudu build. Set LZ4_DISABLE_DEPRECATE_WARNINGS to allow Kudu's compressor utility to use deprecated names for LZ4 methods. Add NO_NVM_SUPPORT flag to Kudu build (plan to upstream this later) to disable building with nvm support, removing a library dependency. Also remove imported FindOpenSSL.cmake in favour of the standard one provided by cmake itself. Finally, a few changes to allow compilation on RHEL5: * Only use sched_getcpu() if supported * Only include magic.h if available * Workaround for kernels that don't have SOCK_NONBLOCK * Workaround for kernels that don't have O_CLOEXEC (ignore the flag) * Provide non-working implementation of fallocate() * Disable inclusion of linux/fiemap.h - although this exists on RHEL5, it does not compile due to other #includes in env_posix.cc. We disable the path this is used for, since Impala does not call that code. * Use Kudu's implementation of pipe(2), preadv(2) and pwritev(2) where it doesn't exist. In most cases these changes simply force kutil to revert to a different implementation that was already written for OSX support - this patch generalises the logic to provide the implementation whenever the required function doesn't exist. This patch compiles on RHEL5.5 and 6.0, SLES11 and 12, Ubuntu 12.04 and 14.04 and Debian 7.0 and 8.0. Change-Id: I451f02d3e4669e8a548b92fb1445cb2b322659a2 Reviewed-on: http://gerrit.cloudera.org:8080/5715 Tested-by: Impala Public Jenkins Reviewed-by: Henry Robinson Reviewed-on: http://gerrit.cloudera.org:8080/10758 Reviewed-by: Michael Ho Tested-by: Lars Volker > Add Kudu's RPC, util and security libraries > --- > > Key: IMPALA-4669 > URL: https://issues.apache.org/jira/browse/IMPALA-4669 > Project: IMPALA > Issue Type: Sub-task > Components: Distributed Exec >Affects Versions: Impala 2.8.0 >Reporter: Henry Robinson >Assignee: Henry Robinson >Priority: Major > Fix For: Impala 2.10.0 > > > To enable KRPC in Impala, we need to link against Kudu's {{rpc}}, > {{security}} and {{util}} libraries. The easiest way for now is to pull them > into trunk. > Doing this also requires upgrading our {{gutil}} version. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org
[jira] [Commented] (IMPALA-4669) Add Kudu's RPC, util and security libraries
[ https://issues.apache.org/jira/browse/IMPALA-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16542563#comment-16542563 ] ASF subversion and git services commented on IMPALA-4669: - Commit ae5eec774d3d064e92b5414ab5db3ed548eb69d6 in impala's branch refs/heads/master from [~lv] [ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=ae5eec7 ] IMPALA-4669: [KRPC] Add kudu_rpc library to build NOTE: This commit is part of a set of changes for IMPALA-7006. It contains pieces of a previous commit that need to be cherry picked again after rebasing the code in be/src/kudu/{util,security,rpc}. The original commit message is below: Import FindKRPC.cmake from Apache Kudu. Add some files to protoc-gen-krpc link to allow it to find symbols now defined within Impala (without linking all of Impala's libraries). Change-Id: I5693288db90f2e9673b8c88ca4378c3790cba957 Reviewed-on: http://gerrit.cloudera.org:8080/5719 Reviewed-by: Henry Robinson Tested-by: Impala Public Jenkins Reviewed-on: http://gerrit.cloudera.org:8080/10760 Reviewed-by: Lars Volker Tested-by: Lars Volker > Add Kudu's RPC, util and security libraries > --- > > Key: IMPALA-4669 > URL: https://issues.apache.org/jira/browse/IMPALA-4669 > Project: IMPALA > Issue Type: Sub-task > Components: Distributed Exec >Affects Versions: Impala 2.8.0 >Reporter: Henry Robinson >Assignee: Henry Robinson >Priority: Major > Fix For: Impala 2.10.0 > > > To enable KRPC in Impala, we need to link against Kudu's {{rpc}}, > {{security}} and {{util}} libraries. The easiest way for now is to pull them > into trunk. > Doing this also requires upgrading our {{gutil}} version. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org