[GitHub] incubator-hawq issue #1336: HAWQ-1514. TDE feature makes libhdfs3 require op...

2018-01-31 Thread radarwave
Github user radarwave commented on the issue:

https://github.com/apache/incubator-hawq/pull/1336
  
LGTM
+1


---


[jira] [Commented] (HAWQ-1514) TDE feature makes libhdfs3 require openssl1.1

2018-01-31 Thread Hongxu Ma (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347938#comment-16347938
 ] 

Hongxu Ma commented on HAWQ-1514:
-

We open a PR to check the openssl version in hawq configure (more detailed: 
find the needed function).

It prompt an error message if the check failed.

 

> TDE feature makes libhdfs3 require openssl1.1
> -
>
> Key: HAWQ-1514
> URL: https://issues.apache.org/jira/browse/HAWQ-1514
> Project: Apache HAWQ
>  Issue Type: Task
>  Components: libhdfs
>Reporter: Yi Jin
>Assignee: WANG Weinan
>Priority: Major
> Fix For: 2.3.0.0-incubating
>
>
> New TDE feature delivered in libhdfs3 requires specific version of openssl, 
> at least per my test, 1.0.21 does not work, and 1.1 source code built library 
> passed.
> So maybe we need some build and installation instruction improvement. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] incubator-hawq issue #1336: HAWQ-1514. TDE feature makes libhdfs3 require op...

2018-01-31 Thread wengyanqing
Github user wengyanqing commented on the issue:

https://github.com/apache/incubator-hawq/pull/1336
  
LGTM


---


[jira] [Resolved] (HAWQ-1580) Change PXF Port to 5888 for GPDB environments

2018-01-31 Thread Lav Jain (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lav Jain resolved HAWQ-1580.

   Resolution: Fixed
Fix Version/s: 2.3.0.0-incubating

> Change PXF Port to 5888 for GPDB environments
> -
>
> Key: HAWQ-1580
> URL: https://issues.apache.org/jira/browse/HAWQ-1580
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: PXF
>Reporter: Lav Jain
>Assignee: Lav Jain
>Priority: Major
> Fix For: 2.3.0.0-incubating
>
>
> Currently PXF server listens on port 51200 which could be occupied by 
> background GPDB processes. This causes CI to fail whenever 51200 is not 
> available. This change is to make PXF server not use a dynamic/ephemeral port 
> by setting it to 5888 (< 1).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (HAWQ-1545) pxf-private.classpath file for TARs refers to generic jackson libraries

2018-01-31 Thread Lav Jain (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lav Jain resolved HAWQ-1545.

   Resolution: Fixed
Fix Version/s: 2.3.0.0-incubating

> pxf-private.classpath file for TARs refers to generic jackson libraries
> ---
>
> Key: HAWQ-1545
> URL: https://issues.apache.org/jira/browse/HAWQ-1545
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: Lav Jain
>Assignee: Lav Jain
>Priority: Major
> Fix For: 2.3.0.0-incubating
>
>
> JSON profile requires Jackson libraries version 1.9 (and above). The 
> unit-tests and automation tests fail with Jackson 1.8.8, which seems to be 
> the default for Cloudera tarball based distribution.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] incubator-hawq pull request #1334: HAWQ-1584. Don't ignore exceptions during...

2018-01-31 Thread lavjain
Github user lavjain closed the pull request at:

https://github.com/apache/incubator-hawq/pull/1334


---


[GitHub] incubator-hawq pull request #1334: HAWQ-1584. Don't ignore exceptions during...

2018-01-31 Thread lavjain
GitHub user lavjain reopened a pull request:

https://github.com/apache/incubator-hawq/pull/1334

HAWQ-1584. Don't ignore exceptions during bridge.endIteration when writing 
to HDFS



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/lavjain/incubator-hawq fix_writable

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/1334.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1334


commit b0e86b7d89f5087582ad89d405ebbba6d962241d
Author: lavjain 
Date:   2018-01-30T07:16:14Z

HAWQ-1584. Do not ignore exceptions during bridge.endIteration when writing 
to HDFS




---


[GitHub] incubator-hawq issue #1336: HAWQ-1514. TDE feature makes libhdfs3 require op...

2018-01-31 Thread radarwave
Github user radarwave commented on the issue:

https://github.com/apache/incubator-hawq/pull/1336
  
Thanks @weinan003 help handle the openssl version issue. I think we should 
modify configure.in then generate configure.


---


[GitHub] incubator-hawq pull request #1336: HAWQ-1514. TDE feature makes libhdfs3 req...

2018-01-31 Thread weinan003
GitHub user weinan003 opened a pull request:

https://github.com/apache/incubator-hawq/pull/1336

HAWQ-1514. TDE feature makes libhdfs3 require openssl1.1

1. use environment HDFS_DEPENDENCY_INSTALL_PREFIX to indicate "libhdfs" 
used openssl path
2. do function check before HAWQ compilation in configure file

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/weinan003/incubator-hawq hdfs

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/1336.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1336


commit 13272f5d2d68ec702f2ae88c1e587e9b08eca923
Author: Weinan Wang 
Date:   2018-01-31T08:47:04Z

HAWQ-1514. TDE feature makes libhdfs3 require openssl1.1




---


[jira] [Created] (HAWQ-1584) Propagate any errors when closing stream for PXF writable tables

2018-01-31 Thread Lav Jain (JIRA)
Lav Jain created HAWQ-1584:
--

 Summary: Propagate any errors when closing stream for PXF writable 
tables 
 Key: HAWQ-1584
 URL: https://issues.apache.org/jira/browse/HAWQ-1584
 Project: Apache HAWQ
  Issue Type: Improvement
  Components: PXF
Reporter: Lav Jain
Assignee: Ed Espino


PXF ignores any errors when closing the stream, which does not affect reading 
HDFS data. However, in case of write HDFS might return an error and data might 
not get written. Therefore, any errors when closing the input stream must be 
passed to PXF client.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (HAWQ-1584) Propagate any errors when closing stream for PXF writable tables

2018-01-31 Thread Lav Jain (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lav Jain reassigned HAWQ-1584:
--

Assignee: Lav Jain  (was: Ed Espino)

> Propagate any errors when closing stream for PXF writable tables 
> -
>
> Key: HAWQ-1584
> URL: https://issues.apache.org/jira/browse/HAWQ-1584
> Project: Apache HAWQ
>  Issue Type: Improvement
>  Components: PXF
>Reporter: Lav Jain
>Assignee: Lav Jain
>Priority: Major
>
> PXF ignores any errors when closing the stream, which does not affect reading 
> HDFS data. However, in case of write HDFS might return an error and data 
> might not get written. Therefore, any errors when closing the input stream 
> must be passed to PXF client.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)