[jira] [Comment Edited] (HAWQ-1278) Investigate installcheck-good issue on Mac OSX

2017-01-18 Thread Ruilong Huo (JIRA) 

[ 
https://issues.apache.org/jira/browse/HAWQ-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15829417#comment-15829417
 ] 

Ruilong Huo edited comment on HAWQ-1278 at 1/19/17 6:58 AM:


[~espino], did you get a chance to help David to get access of hawq wiki?


was (Author: huor):
[~espino], did you get a chance to grant access of hawq wiki to David?

> Investigate installcheck-good issue on Mac OSX
> --
>
> Key: HAWQ-1278
> URL: https://issues.apache.org/jira/browse/HAWQ-1278
> Project: Apache HAWQ
>  Issue Type: Task
>  Components: Tests
>Reporter: Ed Espino
>Assignee: Ruilong Huo
> Fix For: 2.2.0.0-incubating
>
>
> I am filing this as a place holder for the Mac OSX installcheck-good 
> investigation work.  Ming Li originally reported installcheck-good testing 
> issues with errtable and hcatalog_lookup test suites.
> This issue is not seen on CentOS 6 & 7 environments.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Comment Edited] (HAWQ-1278) Investigate installcheck-good issue on Mac OSX

2017-01-18 Thread Ruilong Huo (JIRA) 

[ 
https://issues.apache.org/jira/browse/HAWQ-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827764#comment-15827764
 ] 

Ruilong Huo edited comment on HAWQ-1278 at 1/18/17 10:02 AM:
-

[~espino] and [~dyozie], per investigation with [~abai] and [~liming01], the 
root cause is that: 1) error table suite failure is due to gpfidst issue; 2) 
gpfdist failure is due to the client receive no response from gpfdist service 
after the http request is sent. To be specific, there is a bug in curl-7.51.0 
on osx 10.12 while curl-7.43.0 is good on that.

As for doc, we need to add below information:
{noformat}
Know issue: HAWQ-1278: curl 7.51.0 bug on osx 10.12 introduce gpfdist client 
fail to get response from gpfdist service after http request is sent.
Solution: use curl 7.43
{noformat}


was (Author: huor):
[~espino] and [~dyozie], per investigation with [~abai] and [~liming01], the 
root cause is that: 1) error table suite failure is due to gpfidst issue; 2) 
gpfdist failure is due to the client receive no response from gpfdist service 
after the http request is sent. To be specific, there is a bug in curl-7.51.0 
on osx 10.12 while curl-7.43.0 is good on that.

As for doc, we need to add below information:
{noformat}
Know issue: HAWQ-1278: curl 7.51.0 bug on osx 10.12 introduce gpfdist client 
fail to get response from gpfdist service after http request is sent.
The solution: use curl 7.43
{noformat}

> Investigate installcheck-good issue on Mac OSX
> --
>
> Key: HAWQ-1278
> URL: https://issues.apache.org/jira/browse/HAWQ-1278
> Project: Apache HAWQ
>  Issue Type: Task
>  Components: Tests
>Reporter: Ed Espino
>Assignee: Ruilong Huo
> Fix For: 2.2.0.0-incubating
>
>
> I am filing this as a place holder for the Mac OSX installcheck-good 
> investigation work.  Ming Li originally reported installcheck-good testing 
> issues with errtable and hcatalog_lookup test suites.
> This issue is not seen on CentOS 6 & 7 environments.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Comment Edited] (HAWQ-1278) Investigate installcheck-good issue on Mac OSX

2017-01-17 Thread Ed Espino (JIRA) 

[ 
https://issues.apache.org/jira/browse/HAWQ-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827492#comment-15827492
 ] 

Ed Espino edited comment on HAWQ-1278 at 1/18/17 6:30 AM:
--

[~huor] thanks for the review.  I have updated the Fix Version to 
2.2.0.0-incubating.  We will need to add a note for this issue in the release 
notes for the Apache HAWQ 2.1.0.0-incubating release. Please provide 
information so [~dyozie] can add it.


was (Author: espino):
[~huor] Thanks for the review.  I have updated the Fix Version to 
2.2.0.0-incubating.  We will need to add a note for this issue in the release 
notes for the Apache HAWQ 2.1.0.0-incubating release. Please provide 
information so [~dyozie] can add it.

> Investigate installcheck-good issue on Mac OSX
> --
>
> Key: HAWQ-1278
> URL: https://issues.apache.org/jira/browse/HAWQ-1278
> Project: Apache HAWQ
>  Issue Type: Task
>  Components: Tests
>Reporter: Ed Espino
>Assignee: Ruilong Huo
> Fix For: 2.2.0.0-incubating
>
>
> I am filing this as a place holder for the Mac OSX installcheck-good 
> investigation work.  Ming Li originally reported installcheck-good testing 
> issues with errtable and hcatalog_lookup test suites.
> This issue is not seen on CentOS 6 & 7 environments.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Comment Edited] (HAWQ-1278) Investigate installcheck-good issue on Mac OSX

2017-01-17 Thread Ruilong Huo (JIRA) 

[ 
https://issues.apache.org/jira/browse/HAWQ-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15827326#comment-15827326
 ] 

Ruilong Huo edited comment on HAWQ-1278 at 1/18/17 2:23 AM:


[~espino] and [~dyozie], given the RCA above, it is a known limitation of poll 
and curl on osx 10.12 that make gpfdist malfunction. We can investigate more on 
that it is not a blocker as it is ok with osx 10.10 and 11.


was (Author: huor):
[~espino] and [~dyozie], given the RCA above, it is a known limitation of poll 
and curl on osx 10.12 that make gpfdist malfunction. It is not a blocker as it 
is ok with osx 10.10 and 11.

> Investigate installcheck-good issue on Mac OSX
> --
>
> Key: HAWQ-1278
> URL: https://issues.apache.org/jira/browse/HAWQ-1278
> Project: Apache HAWQ
>  Issue Type: Task
>  Components: Tests
>Reporter: Ed Espino
>Assignee: Ruilong Huo
> Fix For: 2.1.0.0-incubating
>
>
> I am filing this as a place holder for the Mac OSX installcheck-good 
> investigation work.  Ming Li originally reported installcheck-good testing 
> issues with errtable and hcatalog_lookup test suites.
> This issue is not seen on CentOS 6 & 7 environments.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Comment Edited] (HAWQ-1278) Investigate installcheck-good issue on Mac OSX

2017-01-17 Thread Ruilong Huo (JIRA) 

[ 
https://issues.apache.org/jira/browse/HAWQ-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825779#comment-15825779
 ] 

Ruilong Huo edited comment on HAWQ-1278 at 1/17/17 10:10 AM:
-

Potential a curl issue on osx 10.12 with curl 7.51.0. While it is ok on osx 
10.10 ~ 11 with curl 7.43. To be specific, client does not receive response 
after sent http request to server.
{noformat}
# cat src/backend/access/external/url.c

 255 static int
 256 check_response(URL_FILE *file, int *rc, const char **response_string)
 257 {
..
 262
 263 /* get the response code from curl */
 264 if (curl_easy_getinfo(curl, CURLINFO_RESPONSE_CODE, &response_code) != 
CURLE_OK)
 265 {
 266 *rc = 500;
 267 *response_string = "curl_easy_getinfo failed";
 268 return -1;
 269 }
..
 277 if (! (200 <= response_code && response_code < 300))
 278 {
 279 if (response_code == 0)
 280 {
 281 longoserrno = 0;
 282 static char connmsg[64];
 283
 284 /* get the os level errno, and string representation of it */
 285 if (curl_easy_getinfo(curl, CURLINFO_OS_ERRNO, &oserrno) == 
CURLE_OK)
 286 {
 287 if (oserrno != 0)
 288 snprintf(connmsg, sizeof connmsg, "error code = %d 
(%s)",
 289  (int) oserrno, strerror((int)oserrno));
 290 }
 291
 292 ereport(ERROR, (errcode(ERRCODE_CONNECTION_FAILURE),
 293 errmsg("connection with gpfdist failed for %s. 
"
 294 "effective url: %s. %s", file->url, 
effective_url,
 295 (oserrno != 0 ? connmsg : "")),
 296 errOmitLocation(true)));
 297 }
{noformat}


was (Author: huor):
Potential a curl issue on osx 10.12 with curl 7.51.0. While it is ok on osx 
10.10 ~ 11 with curl 7.43. To be specific, client does not receive response 
after sent http request to server.
{noformat}
 255 static int
 256 check_response(URL_FILE *file, int *rc, const char **response_string)
 257 {
..
 262
 263 /* get the response code from curl */
 264 if (curl_easy_getinfo(curl, CURLINFO_RESPONSE_CODE, &response_code) != 
CURLE_OK)
 265 {
 266 *rc = 500;
 267 *response_string = "curl_easy_getinfo failed";
 268 return -1;
 269 }
..
 277 if (! (200 <= response_code && response_code < 300))
 278 {
 279 if (response_code == 0)
 280 {
 281 longoserrno = 0;
 282 static char connmsg[64];
 283
 284 /* get the os level errno, and string representation of it */
 285 if (curl_easy_getinfo(curl, CURLINFO_OS_ERRNO, &oserrno) == 
CURLE_OK)
 286 {
 287 if (oserrno != 0)
 288 snprintf(connmsg, sizeof connmsg, "error code = %d 
(%s)",
 289  (int) oserrno, strerror((int)oserrno));
 290 }
 291
 292 ereport(ERROR, (errcode(ERRCODE_CONNECTION_FAILURE),
 293 errmsg("connection with gpfdist failed for %s. 
"
 294 "effective url: %s. %s", file->url, 
effective_url,
 295 (oserrno != 0 ? connmsg : "")),
 296 errOmitLocation(true)));
 297 }
{noformat}

> Investigate installcheck-good issue on Mac OSX
> --
>
> Key: HAWQ-1278
> URL: https://issues.apache.org/jira/browse/HAWQ-1278
> Project: Apache HAWQ
>  Issue Type: Task
>  Components: Tests
>Reporter: Ed Espino
>Assignee: Ruilong Huo
> Fix For: 2.1.0.0-incubating
>
>
> I am filing this as a place holder for the Mac OSX installcheck-good 
> investigation work.  Ming Li originally reported installcheck-good testing 
> issues with errtable and hcatalog_lookup test suites.
> This issue is not seen on CentOS 6 & 7 environments.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Comment Edited] (HAWQ-1278) Investigate installcheck-good issue on Mac OSX

2017-01-17 Thread Ruilong Huo (JIRA) 

[ 
https://issues.apache.org/jira/browse/HAWQ-1278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15825631#comment-15825631
 ] 

Ruilong Huo edited comment on HAWQ-1278 at 1/17/17 9:27 AM:


Had a try with 10.10.5 and 10.11.5, it seems ok. While it is on 10.12.x.
{noformat}
rhuo-mbp:incubator-hawq rhuo$ make installcheck-good
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C src/test 
installcheck-good
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C regress 
installcheck-good
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C ../../../src/port all
make[3]: Nothing to be done for `all'.
rm -rf ./testtablespace
mkdir ./testtablespace
./checkinc.py
Greenplum INCLUDEDIR:
/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/include
Greenplum PKGINCLUDEDIR: 
/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/include/postgresql
Checking includes...
Include files are ok
cd . && ./makeschedule ./known_good_schedule 
/Users/rhuo/Repository/git/hawq/incubator-hawq/src/test/regress/current_good_schedule
Writing new schedule 
'/Users/rhuo/Repository/git/hawq/incubator-hawq/src/test/regress/current_good_schedule'.
rm -rf data/upg_catupgrade_12.sql
perl -pi \
-e 's/(, 
)?(indexid|relid|reltype_oid|toast_oid|toast_index|toast_relid|toast_reltype|shared|CamelCase)=[0-9a-zA-Z]+//gi;'
 \
-e 's/oid=false//g;' \
-e 's/with \([^a-zA-Z]*\)//g;' \
-e 's/\(oid=[0-9]+\)//;' \
-e 's/tablespace pg_global//g;' \
-e 's/oids=true, /oids=true/;' \
-e 's/\(,/(/;' \
< ./data/upgrade20/upg2_catupgrade_20.sql.in \
> data/upg_catupgrade_20.sql
-i used with no filenames on the command line, reading from STDIN.
./pg_regress --inputdir=. --multibyte=
--psqldir=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/bin 
--schedule=./current_good_schedule 
--srcdir=/Users/rhuo/Repository/git/hawq/incubator-hawq/src/test/regress 
--expected-statuses-file=expected_statuses
(using postmaster on Unix socket, port 5432)
== dropping database "regression" ==
NOTICE:  database "regression" does not exist, skipping
DROP DATABASE
== creating database "regression" ==
CREATE DATABASE
ALTER DATABASE
== checking optimizer status  ==
Optimizer enabled. Using optimizer answer files whenever possible
== running regression test queries==
test errortbl ... ok (3.99 sec)
test goh_create_type_composite ... ok (1.36 sec)
test goh_toast... ok (0.60 sec)
test goh_database ... ok (2.33 sec)
test goh_gp_dist_random   ... ok (0.10 sec)
test create_table_test... ok (0.16 sec)
...
{noformat}


was (Author: huor):
Had a try with 10.10.5, it seems ok:
{noformat}
rhuo-mbp:incubator-hawq rhuo$ make installcheck-good
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C src/test 
installcheck-good
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C regress 
installcheck-good
/Applications/Xcode.app/Contents/Developer/usr/bin/make -C ../../../src/port all
make[3]: Nothing to be done for `all'.
rm -rf ./testtablespace
mkdir ./testtablespace
./checkinc.py
Greenplum INCLUDEDIR:
/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/include
Greenplum PKGINCLUDEDIR: 
/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/include/postgresql
Checking includes...
Include files are ok
cd . && ./makeschedule ./known_good_schedule 
/Users/rhuo/Repository/git/hawq/incubator-hawq/src/test/regress/current_good_schedule
Writing new schedule 
'/Users/rhuo/Repository/git/hawq/incubator-hawq/src/test/regress/current_good_schedule'.
rm -rf data/upg_catupgrade_12.sql
perl -pi \
-e 's/(, 
)?(indexid|relid|reltype_oid|toast_oid|toast_index|toast_relid|toast_reltype|shared|CamelCase)=[0-9a-zA-Z]+//gi;'
 \
-e 's/oid=false//g;' \
-e 's/with \([^a-zA-Z]*\)//g;' \
-e 's/\(oid=[0-9]+\)//;' \
-e 's/tablespace pg_global//g;' \
-e 's/oids=true, /oids=true/;' \
-e 's/\(,/(/;' \
< ./data/upgrade20/upg2_catupgrade_20.sql.in \
> data/upg_catupgrade_20.sql
-i used with no filenames on the command line, reading from STDIN.
./pg_regress --inputdir=. --multibyte=
--psqldir=/Users/rhuo/Workspace/hawq/hawq-2.0/hawq-db-devel/bin 
--schedule=./current_good_schedule 
--srcdir=/Users/rhuo/Repository/git/hawq/incubator-hawq/src/test/regress 
--expected-statuses-file=expected_statuses
(using postmaster on Unix socket, port 5432)
== dropping database "regression" ==
NOTICE:  database "regression" does not exist, skipping
DROP DATABASE
== creating database "regression" ==
CREATE D