[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread amyrazz44
Github user amyrazz44 commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87323443
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -285,41 +354,42 @@ else:
 save_file = os.path.join(os.path.expanduser("~"), ".gtest-parallel-times")
 times = TestTimes(save_file)
 tests = []
+#pull all the tests into test_map dict, in order to mark the failed test 
in FAILED log 
+test_map = {} 
+# mark the end of paralell test id by parallel_id
+parallel_id = 0
+
 for test_binary in binaries:
   command = [test_binary]
   if options.gtest_also_run_disabled_tests:
 command += ['--gtest_also_run_disabled_tests']
-
   list_command = list(command)
+  
+  if options.gtest_schedule != '' and options.gtest_filter != '':
+sys.exit("Option input failure : gtest_schedule and gtest_filter can 
not use in the same time: \n")
+
+  if options.gtest_schedule != '':
+(pcount, filter_test) = get_schedule(options.gtest_schedule)
+for i in range(0, len(filter_test)):
--- End diff --

Will consider your suggestion in the future, while in this script this way 
will be more suitable due to the deal with test_map. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87323234
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -234,6 +234,71 @@ class TestTimes(object):
 except IOError:
   pass  # ignore errors---saving the times isn't that important
 
+
+def get_schedule(schedule_file):
+  "read schedule file from --gtest_schedule option"
+  try:
+file = open(schedule_file, 'r')
+  except (EOFError, IOError):
+sys.exit("Read file error")
+  
+  filter_test = []
+  ptest = []
+  stest = []
+
+  for line in file.readlines():
+if not line.strip():
+  continue
+if line[0] == '#':
+  continue
+
+testline = line.split('=')
+if len(testline) != 2 or (not testline[1].strip()):
+  sys.exit("format error in schedule file")
+
+(key, value) = testline
+if key == "PARALLEL":
+  ptest.append(value) 
+elif key == "SERIAL":
+  stest.append(value)
+else:
+  sys.exit("format error in schedule file")
+
+  filter_test = ptest + stest  
+  file.close()
+  return len(ptest), filter_test
+
+
+def do_gtest_filter(list_command, command, op_filter):
+"get tests by --gtest_filter and --gtest_list_tests"
+list_command += ['--gtest_filter=' + op_filter]
+try:
+  test_list = subprocess.Popen(list_command + ['--gtest_list_tests'],
+ stdout=subprocess.PIPE).communicate()[0]
+except OSError as e:
+  sys.exit("%s: %s" % (test_binary, str(e)))
+
+command += additional_args
+tests = []
+test_group = ''
+for line in test_list.split('\n'):
+  if not line.strip():
--- End diff --

If you use `test_list.split()`, it will handle this case. For example, 
`'a\n\nc\n'.split()` will return `['a', 'c']`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread amyrazz44
Github user amyrazz44 commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87322601
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -234,6 +234,71 @@ class TestTimes(object):
 except IOError:
   pass  # ignore errors---saving the times isn't that important
 
+
+def get_schedule(schedule_file):
+  "read schedule file from --gtest_schedule option"
+  try:
+file = open(schedule_file, 'r')
+  except (EOFError, IOError):
+sys.exit("Read file error")
+  
+  filter_test = []
+  ptest = []
+  stest = []
--- End diff --

Will consider , thank you


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread amyrazz44
Github user amyrazz44 commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87322394
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -170,7 +170,7 @@ class FilterFormat:
   self.out.permanent_line("FAILED TESTS (%d/%d):"
   % (len(self.failures), self.total_tests))
   for (binary, test) in self.failures:
-self.out.permanent_line(" " + binary + ": " + test)
+self.out.permanent_line(" " + binary + ": " + test + " [" + 
test_map[test] + "]")
--- End diff --

Just to keep consistence with the origin code.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread amyrazz44
Github user amyrazz44 commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87322353
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -234,6 +234,71 @@ class TestTimes(object):
 except IOError:
   pass  # ignore errors---saving the times isn't that important
 
+
+def get_schedule(schedule_file):
+  "read schedule file from --gtest_schedule option"
+  try:
+file = open(schedule_file, 'r')
--- End diff --

Will refine this, thank you.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread amyrazz44
Github user amyrazz44 commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87322273
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -234,6 +234,71 @@ class TestTimes(object):
 except IOError:
   pass  # ignore errors---saving the times isn't that important
 
+
+def get_schedule(schedule_file):
+  "read schedule file from --gtest_schedule option"
+  try:
+file = open(schedule_file, 'r')
+  except (EOFError, IOError):
+sys.exit("Read file error")
+  
+  filter_test = []
+  ptest = []
+  stest = []
+
+  for line in file.readlines():
--- End diff --

Will consider this, thank you.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread paul-guo-
Github user paul-guo- commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87320997
  
--- Diff: src/test/feature/schedule.txt ---
@@ -0,0 +1,6 @@
+#PARALLEL=* are the parallel tests to run, optional but should not be empty
+#SERIAL=* are the serial tests to run, optional but should not be empty
+#you can have several PARALLEL or SRRIAL
+

+PARALLEL=TestErrorTable.*:TestExternalTable.*:TestPreparedStatement.*:TestUDF.*:TestAOSnappy.*:TestAlterOwner.*:TestAlterTable.*:TestCreateTable.*:TestGuc.*:TestType.*:TestDatabase.*:TestParquet.*:TestPartition.*:TestSubplan.*:TestAggregate.*:TestCreateTypeComposite.*:TestGpDistRandom.*:TestInformationSchema.*:TestQueryInsert.*:TestQueryNestedCaseNull.*:TestQueryPolymorphism.*:TestQueryPortal.*:TestQueryPrepare.*:TestRowTypes.*:TestQuerySequence.*:TestCommonLib.*:TestToast.*:TestTransaction.*:TestCommand.*:TestCopy.*:TestExternalTable.TestExternalTableAll
--- End diff --

Just curious. Does that means if dev adds a test class, they must modify 
this file also. Maybe we should try to make the default cases run in parallel 
by default.

By the way, all of these in one line is really not human readable and is 
fragile. I'd suggest list them one line by line. You could use a custom format 
or yaml whatever format?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread paul-guo-
Github user paul-guo- commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87320349
  
--- Diff: src/test/feature/README.md ---
@@ -15,8 +15,7 @@ Before building the code of feature tests part, just make 
sure your compiler sup
 1. Make sure HAWQ is running correctly. If not, `init` or `start` HAWQ at 
first. Note please don't set locale related arguments for hawq init.
 2. Load environment configuration by running `source 
$INSTALL_PREFIX/greenplum_path.sh`.
 3. Load hdfs configuration. For example, `export 
HADOOP_HOME=/Users/wuhong/hadoop-2.7.2 && export 
PATH=${PATH}:${HADOOP_HOME}/bin`. Since some test cases need `hdfs` and 
`hadoop` command, just ensure these commands work before running. Otherwise you 
will get failure.
-4. Run the cases with`./parallel-run-feature-test.sh 8 ./feature-test`(in 
this case 8 threads in parallel), you could use `--gtest_filter` option to 
filter test cases(both positive and negative patterns are supported). Please 
see more options by running `./feature-test --help`.
-5. As for now, there are several cases which in the sequence.txt file can 
not parallel run. Run the cases with `./parallel-run-feature-test.sh 8 
./feature-test --gtest_filter=-`cat ./sequence.txt``.
+4. Run the cases with`./parallel-run-feature-test.sh 8 ./feature-test`(in 
this case 8 threads in parallel), you could use `--gtest_filter` option to 
filter test cases(both positive and negative patterns are supported). You can 
also run cases with `--gtest_schedule` (eg. --gtest_schedule=./schedule.txt) if 
you want to run cases in both parallel way and serial way. Please see more 
options by running `./feature-test --help`.
--- End diff --

1) use -> add the?
2) Maybe add a simple example for --gtest_filter.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87318413
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -234,6 +234,71 @@ class TestTimes(object):
 except IOError:
   pass  # ignore errors---saving the times isn't that important
 
+
+def get_schedule(schedule_file):
+  "read schedule file from --gtest_schedule option"
+  try:
+file = open(schedule_file, 'r')
+  except (EOFError, IOError):
+sys.exit("Read file error")
+  
+  filter_test = []
+  ptest = []
+  stest = []
+
+  for line in file.readlines():
--- End diff --

Actually I do not like the for-loop her because I think it is a little 
tricky. If you need a key-value dict information, could we change the file with 
json format?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87317799
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -234,6 +234,71 @@ class TestTimes(object):
 except IOError:
   pass  # ignore errors---saving the times isn't that important
 
+
+def get_schedule(schedule_file):
+  "read schedule file from --gtest_schedule option"
+  try:
+file = open(schedule_file, 'r')
+  except (EOFError, IOError):
+sys.exit("Read file error")
+  
+  filter_test = []
+  ptest = []
+  stest = []
--- End diff --

`filter_test, ptest, stest = [], [], []` is better in Python.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87318797
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -285,41 +354,42 @@ else:
 save_file = os.path.join(os.path.expanduser("~"), ".gtest-parallel-times")
 times = TestTimes(save_file)
 tests = []
+#pull all the tests into test_map dict, in order to mark the failed test 
in FAILED log 
+test_map = {} 
+# mark the end of paralell test id by parallel_id
+parallel_id = 0
+
 for test_binary in binaries:
   command = [test_binary]
   if options.gtest_also_run_disabled_tests:
 command += ['--gtest_also_run_disabled_tests']
-
   list_command = list(command)
+  
+  if options.gtest_schedule != '' and options.gtest_filter != '':
+sys.exit("Option input failure : gtest_schedule and gtest_filter can 
not use in the same time: \n")
+
+  if options.gtest_schedule != '':
--- End diff --

`if options.gtest_schedule `


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87317655
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -170,7 +170,7 @@ class FilterFormat:
   self.out.permanent_line("FAILED TESTS (%d/%d):"
   % (len(self.failures), self.total_tests))
   for (binary, test) in self.failures:
-self.out.permanent_line(" " + binary + ": " + test)
+self.out.permanent_line(" " + binary + ": " + test + " [" + 
test_map[test] + "]")
--- End diff --

I suggest you to use format string for readability and correctness. For 
example, use `" %s: %s [ %s ]" % (binary, test, test_map[test])` here.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87318783
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -285,41 +354,42 @@ else:
 save_file = os.path.join(os.path.expanduser("~"), ".gtest-parallel-times")
 times = TestTimes(save_file)
 tests = []
+#pull all the tests into test_map dict, in order to mark the failed test 
in FAILED log 
+test_map = {} 
+# mark the end of paralell test id by parallel_id
+parallel_id = 0
+
 for test_binary in binaries:
   command = [test_binary]
   if options.gtest_also_run_disabled_tests:
 command += ['--gtest_also_run_disabled_tests']
-
   list_command = list(command)
+  
+  if options.gtest_schedule != '' and options.gtest_filter != '':
--- End diff --

`if options.gtest_schedule  and options.gtest_filter:`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87317889
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -234,6 +234,71 @@ class TestTimes(object):
 except IOError:
   pass  # ignore errors---saving the times isn't that important
 
+
+def get_schedule(schedule_file):
+  "read schedule file from --gtest_schedule option"
+  try:
+file = open(schedule_file, 'r')
--- End diff --

Do not use default keyword `file`, it is risky.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87318874
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -285,41 +354,42 @@ else:
 save_file = os.path.join(os.path.expanduser("~"), ".gtest-parallel-times")
 times = TestTimes(save_file)
 tests = []
+#pull all the tests into test_map dict, in order to mark the failed test 
in FAILED log 
+test_map = {} 
+# mark the end of paralell test id by parallel_id
+parallel_id = 0
+
 for test_binary in binaries:
   command = [test_binary]
   if options.gtest_also_run_disabled_tests:
 command += ['--gtest_also_run_disabled_tests']
-
   list_command = list(command)
+  
+  if options.gtest_schedule != '' and options.gtest_filter != '':
+sys.exit("Option input failure : gtest_schedule and gtest_filter can 
not use in the same time: \n")
+
+  if options.gtest_schedule != '':
+(pcount, filter_test) = get_schedule(options.gtest_schedule)
+for i in range(0, len(filter_test)):
--- End diff --

It is like C-style, not pythonic. Use enumerate instead to make the code 
simple. You can implement this logic using less than 10 lines of code.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87318672
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -234,6 +234,71 @@ class TestTimes(object):
 except IOError:
   pass  # ignore errors---saving the times isn't that important
 
+
+def get_schedule(schedule_file):
+  "read schedule file from --gtest_schedule option"
+  try:
+file = open(schedule_file, 'r')
+  except (EOFError, IOError):
+sys.exit("Read file error")
+  
+  filter_test = []
+  ptest = []
+  stest = []
+
+  for line in file.readlines():
+if not line.strip():
+  continue
+if line[0] == '#':
+  continue
+
+testline = line.split('=')
+if len(testline) != 2 or (not testline[1].strip()):
+  sys.exit("format error in schedule file")
+
+(key, value) = testline
+if key == "PARALLEL":
+  ptest.append(value) 
+elif key == "SERIAL":
+  stest.append(value)
+else:
+  sys.exit("format error in schedule file")
+
+  filter_test = ptest + stest  
+  file.close()
+  return len(ptest), filter_test
+
+
+def do_gtest_filter(list_command, command, op_filter):
+"get tests by --gtest_filter and --gtest_list_tests"
+list_command += ['--gtest_filter=' + op_filter]
+try:
+  test_list = subprocess.Popen(list_command + ['--gtest_list_tests'],
+ stdout=subprocess.PIPE).communicate()[0]
+except OSError as e:
+  sys.exit("%s: %s" % (test_binary, str(e)))
+
+command += additional_args
+tests = []
+test_group = ''
+for line in test_list.split('\n'):
+  if not line.strip():
--- End diff --

What is the meaning of this line?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87318470
  
--- Diff: src/test/feature/gtest-parallel ---
@@ -234,6 +234,71 @@ class TestTimes(object):
 except IOError:
   pass  # ignore errors---saving the times isn't that important
 
+
+def get_schedule(schedule_file):
+  "read schedule file from --gtest_schedule option"
+  try:
+file = open(schedule_file, 'r')
+  except (EOFError, IOError):
+sys.exit("Read file error")
+  
+  filter_test = []
+  ptest = []
+  stest = []
+
+  for line in file.readlines():
--- End diff --

I do not understand, is it just one line of total file content here?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/1007#discussion_r87318201
  
--- Diff: src/test/feature/schedule.txt ---
@@ -0,0 +1,6 @@
+#PARALLEL=* are the parallel tests to run, optional but should not be empty
+#SERIAL=* are the serial tests to run, optional but should not be empty
+#you can have several PARALLEL or SRRIAL
+

+PARALLEL=TestErrorTable.*:TestExternalTable.*:TestPreparedStatement.*:TestUDF.*:TestAOSnappy.*:TestAlterOwner.*:TestAlterTable.*:TestCreateTable.*:TestGuc.*:TestType.*:TestDatabase.*:TestParquet.*:TestPartition.*:TestSubplan.*:TestAggregate.*:TestCreateTypeComposite.*:TestGpDistRandom.*:TestInformationSchema.*:TestQueryInsert.*:TestQueryNestedCaseNull.*:TestQueryPolymorphism.*:TestQueryPortal.*:TestQueryPrepare.*:TestRowTypes.*:TestQuerySequence.*:TestCommonLib.*:TestToast.*:TestTransaction.*:TestCommand.*:TestCopy.*:TestExternalTable.TestExternalTableAll
--- End diff --

Should we add some checks in the python script above to ensure the valid 
input schedule?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1007: HAWQ-1148. Update gtest-parallel to make sure te...

2016-11-09 Thread amyrazz44
Github user amyrazz44 commented on the issue:

https://github.com/apache/incubator-hawq/pull/1007
  
@paul-guo- @xunzhang  pls review this pr , thank you.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #1007: HAWQ-1148. Update gtest-parallel to make ...

2016-11-09 Thread amyrazz44
GitHub user amyrazz44 opened a pull request:

https://github.com/apache/incubator-hawq/pull/1007

HAWQ-1148. Update gtest-parallel to make sure test case can run in bo…

…th parallel way and serial way

Signed-off-by: wengyanqing 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/amyrazz44/incubator-hawq scheduleTest

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/1007.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1007


commit 1a5b421917efd9e3f89093647a5ce365e4b0c852
Author: amyrazz44 
Date:   2016-11-08T08:03:55Z

HAWQ-1148. Update gtest-parallel to make sure test case can run in both 
parallel way and serial way

Signed-off-by: wengyanqing 




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Resolved] (HAWQ-1141) Bump PXF and default HDB Stack version.

2016-11-09 Thread Ed Espino (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ed Espino resolved HAWQ-1141.
-
Resolution: Fixed

Merged to master.

> Bump PXF and default HDB Stack version.
> ---
>
> Key: HAWQ-1141
> URL: https://issues.apache.org/jira/browse/HAWQ-1141
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: Ed Espino
>Assignee: Ed Espino
> Fix For: 2.0.1.0-incubating
>
>
> Update PXF (3.1.0) and default Ambari default stack version (HDP-2.5).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq pull request #1005: HAWQ-1141: Bump PXF and default HDB Stack...

2016-11-09 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-hawq/pull/1005


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Resolved] (HAWQ-1150) Recent changes to "brew" have caused all HAWQ Travis CI builds to break.

2016-11-09 Thread Ed Espino (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ed Espino resolved HAWQ-1150.
-
   Resolution: Fixed
Fix Version/s: 2.0.1.0-incubating

Pushed to master.

> Recent changes to "brew" have caused all HAWQ Travis CI builds to break.
> 
>
> Key: HAWQ-1150
> URL: https://issues.apache.org/jira/browse/HAWQ-1150
> Project: Apache HAWQ
>  Issue Type: Task
>  Components: Build
>Reporter: Ed Espino
>Assignee: Lei Chang
> Fix For: 2.0.1.0-incubating
>
>
> Problem: A recent update to brew has exposed an issue with the 'brew tap 
> brona/iproute2mac' command. This causes an Travis error for all branches and 
> PRs using Travis to build.
> Solution: We can simply remove the command and allow the iproute2mac module 
> to come from the main brew repository.
> Here is the error encountered.
> {code}
> $ brew outdated libyaml || brew upgrade libyaml
> $ brew outdated json-c || brew upgrade json-c
> $ brew outdated boost || brew upgrade boost
> $ brew outdated maven || brew upgrade maven
> $ brew tap brona/iproute2mac
> ==> Tapping brona/iproute2mac
> Cloning into '/usr/local/Homebrew/Library/Taps/brona/homebrew-iproute2mac'...
> remote: Counting objects: 5, done.
> remote: Compressing objects: 100% (5/5), done.
> remote: Total 5 (delta 0), reused 4 (delta 0), pack-reused 0
> Unpacking objects: 100% (5/5), done.
> Error: Invalid formula: 
> /usr/local/Homebrew/Library/Taps/brona/homebrew-iproute2mac/iproute2mac.rb
> Calling Formula.sha1 is disabled!
> Use Formula.sha256 instead.
> /usr/local/Homebrew/Library/Taps/brona/homebrew-iproute2mac/iproute2mac.rb:6:in
>  `'
> Please report this to the brona/iproute2mac tap!
> Error: Cannot tap brona/iproute2mac: invalid syntax in tap!
> The command "brew tap brona/iproute2mac" failed and exited with 1 during .
> Your build has been stopped.
> /Users/travis/build.sh: line 138: shell_session_update: command not found
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq pull request #1006: HAWQ-1150. Fix Travis build issue (brona/...

2016-11-09 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-hawq/pull/1006


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (HAWQ-513) initdb.c failed on OSX 10.11.3 due to fgets error

2016-11-09 Thread hongwu (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15650441#comment-15650441
 ] 

hongwu commented on HAWQ-513:
-

Yes, I think after OSX 10.11, the environment variable `DYLD_LIBRARY_PATH` is 
closed unless users reset in recovery mode. Thanks [~hongxu ma] for detailing 
this. :beer

> initdb.c failed on OSX 10.11.3 due to fgets error
> -
>
> Key: HAWQ-513
> URL: https://issues.apache.org/jira/browse/HAWQ-513
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Unknown
>Reporter: xin zhang
>Assignee: Lei Chang
> Fix For: backlog
>
>
> we hit following strange issue on OSX 10.11.3:
> The error message in the initdb is: 
> {code}
> 20160301:00:00:26:075823 hawq_init:This-MacBook-Pro:vagrant-[INFO]:-Start to 
> init master node: 'localhost'
> sh: line 1: 76106 Trace/BPT trap: 5   "/usr/local/hawq/bin/postgres" -V 
> 2> /dev/null
> fgets failure: Undefined error: 0
> The program "postgres" is needed by initdb but was either not found in the 
> same directory as "/usr/local/hawq/bin/initdb" or failed unexpectedly.
> Check your installation; "postgres -V" may have more information.
> Master postgres initdb failed
> {code}
> We suspect the issue due to the newer version of the libSystem.B.dylib on OSX 
> 10.11.3.
> Here is the details of the dependencies of `postgres` and `initdb`:
> 10.10.5, postgres can start, and initdb succeed:
> {code}
> [bin: xzhang{master}]$ otool -L postgres
> postgres:
> /usr/lib/libc++.1.dylib (compatibility version 1.0.0, current version 
> 120.0.0)
> libhdfs3.1.dylib (compatibility version 1.0.0, current version 2.2.30)
> /usr/lib/libxml2.2.dylib (compatibility version 10.0.0, current version 
> 10.9.0)
> libyarn.1.dylib (compatibility version 1.0.0, current version 0.1.13)
> /usr/local/opt/json-c/lib/libjson-c.2.dylib (compatibility version 3.0.0, 
> current version 3.1.0)
> /usr/local/opt/snappy/lib/libsnappy.1.dylib (compatibility version 5.0.0, 
> current version 5.0.0)
> /usr/lib/libbz2.1.0.dylib (compatibility version 1.0.0, current version 
> 1.0.5)
> /usr/lib/libz.1.dylib (compatibility version 1.0.0, current version 1.2.5)
> /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 
> 1213.0.0)
> /usr/lib/libcurl.4.dylib (compatibility version 7.0.0, current version 
> 8.0.0)
> /System/Library/Frameworks/Kerberos.framework/Versions/A/Kerberos 
> (compatibility version 5.0.0, current version 6.0.0)
> libdxltranslators.dylib (compatibility version 0.0.0, current version 
> 0.0.0)
> /usr/local/opt/thrift/lib/libthrift-0.9.3.dylib (compatibility version 
> 0.0.0, current version 0.0.0)
> This-MacBook-Pro:bin vagrant$ otool -L initdb
> initdb:
> /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 
> 1226.10.1)
> {code}
> 10.11.3, postgres can start, but initdb failed:
> {code}
> This-MacBook-Pro:bin vagrant$ otool -L postgres
> postgres:
> /usr/lib/libc++.1.dylib (compatibility version 1.0.0, current version 
> 120.1.0)
> libhdfs3.1.dylib (compatibility version 1.0.0, current version 2.2.30)
> /usr/lib/libxml2.2.dylib (compatibility version 10.0.0, current version 
> 10.9.0)
> libyarn.1.dylib (compatibility version 1.0.0, current version 0.1.13)
> /usr/local/opt/json-c/lib/libjson-c.2.dylib (compatibility version 3.0.0, 
> current version 3.1.0)
> /usr/local/opt/snappy/lib/libsnappy.1.dylib (compatibility version 5.0.0, 
> current version 5.0.0)
> /usr/lib/libbz2.1.0.dylib (compatibility version 1.0.0, current version 
> 1.0.5)
> /usr/lib/libssl.0.9.8.dylib (compatibility version 0.9.8, current version 
> 0.9.8)
> /usr/lib/libcrypto.0.9.8.dylib (compatibility version 0.9.8, current 
> version 0.9.8)
> /usr/lib/libz.1.dylib (compatibility version 1.0.0, current version 1.2.5)
> /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 
> 1226.10.1)
> /usr/lib/libcurl.4.dylib (compatibility version 7.0.0, current version 
> 8.0.0)
> /System/Library/Frameworks/Kerberos.framework/Versions/A/Kerberos 
> (compatibility version 5.0.0, current version 6.0.0)
> libdxltranslators.dylib (compatibility version 0.0.0, current version 
> 0.0.0)
> /usr/local/opt/thrift/lib/libthrift-0.9.3.dylib (compatibility version 
> 0.0.0, current version 0.0.0)
> [bin: xzhang{master}]$ otool -L initdb
> initdb:
> /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 
> 1213.0.0)
> {code}
> In this case, there is a difference between the two OS regarding to the 
> libSystem.B.dylib.
> Question is how to fix it? For example, how to change the libSystem.B.dylib 
> to an older version? or, how to fix the postgres or initdb so that they works 
> on the new OSX 10.11.3?



--

[GitHub] incubator-hawq issue #1006: HAWQ-1150. Fix Travis build issue (brona/iproute...

2016-11-09 Thread xunzhang
Github user xunzhang commented on the issue:

https://github.com/apache/incubator-hawq/pull/1006
  
+1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (HAWQ-1150) Recent changes to "brew" have caused all HAWQ Travis CI builds to break.

2016-11-09 Thread Xiang Sheng (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15650433#comment-15650433
 ] 

Xiang Sheng commented on HAWQ-1150:
---

for the latest release of brew.  
https://github.com/Homebrew/brew/releases/tag/1.1.0
The commit 
https://github.com/Homebrew/brew/commit/fcaa48d80b0c2989ca95528def6d0c8fbd65aa79
 disable sha-1 check.  And the brew tap brona/iproute2mac failed. Since it was 
accepted to brew master branch. So we should install the iprout2mac use brew 
install directly without tap before it. 

> Recent changes to "brew" have caused all HAWQ Travis CI builds to break.
> 
>
> Key: HAWQ-1150
> URL: https://issues.apache.org/jira/browse/HAWQ-1150
> Project: Apache HAWQ
>  Issue Type: Task
>  Components: Build
>Reporter: Ed Espino
>Assignee: Lei Chang
>
> Problem: A recent update to brew has exposed an issue with the 'brew tap 
> brona/iproute2mac' command. This causes an Travis error for all branches and 
> PRs using Travis to build.
> Solution: We can simply remove the command and allow the iproute2mac module 
> to come from the main brew repository.
> Here is the error encountered.
> {code}
> $ brew outdated libyaml || brew upgrade libyaml
> $ brew outdated json-c || brew upgrade json-c
> $ brew outdated boost || brew upgrade boost
> $ brew outdated maven || brew upgrade maven
> $ brew tap brona/iproute2mac
> ==> Tapping brona/iproute2mac
> Cloning into '/usr/local/Homebrew/Library/Taps/brona/homebrew-iproute2mac'...
> remote: Counting objects: 5, done.
> remote: Compressing objects: 100% (5/5), done.
> remote: Total 5 (delta 0), reused 4 (delta 0), pack-reused 0
> Unpacking objects: 100% (5/5), done.
> Error: Invalid formula: 
> /usr/local/Homebrew/Library/Taps/brona/homebrew-iproute2mac/iproute2mac.rb
> Calling Formula.sha1 is disabled!
> Use Formula.sha256 instead.
> /usr/local/Homebrew/Library/Taps/brona/homebrew-iproute2mac/iproute2mac.rb:6:in
>  `'
> Please report this to the brona/iproute2mac tap!
> Error: Cannot tap brona/iproute2mac: invalid syntax in tap!
> The command "brew tap brona/iproute2mac" failed and exited with 1 during .
> Your build has been stopped.
> /Users/travis/build.sh: line 138: shell_session_update: command not found
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq issue #1006: HAWQ-1150. Fix Travis build issue (brona/iproute...

2016-11-09 Thread radarwave
Github user radarwave commented on the issue:

https://github.com/apache/incubator-hawq/pull/1006
  
LGTM +1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #1006: HAWQ-1150. Fix Travis build issue (brona/iproute...

2016-11-09 Thread stanlyxiang
Github user stanlyxiang commented on the issue:

https://github.com/apache/incubator-hawq/pull/1006
  
LGTM, +1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Updated] (HAWQ-1150) Recent changes to "brew" have caused all HAWQ Travis CI builds to break.

2016-11-09 Thread Ed Espino (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ed Espino updated HAWQ-1150:

Summary: Recent changes to "brew" have caused all HAWQ Travis CI builds to 
break.  (was: Recent changes to "brew" have caused all Travis CI builds to 
break.)

> Recent changes to "brew" have caused all HAWQ Travis CI builds to break.
> 
>
> Key: HAWQ-1150
> URL: https://issues.apache.org/jira/browse/HAWQ-1150
> Project: Apache HAWQ
>  Issue Type: Task
>  Components: Build
>Reporter: Ed Espino
>Assignee: Lei Chang
>
> Problem: A recent update to brew has exposed an issue with the 'brew tap 
> brona/iproute2mac' command. This causes an Travis error for all branches and 
> PRs using Travis to build.
> Solution: We can simply remove the command and allow the iproute2mac module 
> to come from the main brew repository.
> Here is the error encountered.
> {code}
> $ brew outdated libyaml || brew upgrade libyaml
> $ brew outdated json-c || brew upgrade json-c
> $ brew outdated boost || brew upgrade boost
> $ brew outdated maven || brew upgrade maven
> $ brew tap brona/iproute2mac
> ==> Tapping brona/iproute2mac
> Cloning into '/usr/local/Homebrew/Library/Taps/brona/homebrew-iproute2mac'...
> remote: Counting objects: 5, done.
> remote: Compressing objects: 100% (5/5), done.
> remote: Total 5 (delta 0), reused 4 (delta 0), pack-reused 0
> Unpacking objects: 100% (5/5), done.
> Error: Invalid formula: 
> /usr/local/Homebrew/Library/Taps/brona/homebrew-iproute2mac/iproute2mac.rb
> Calling Formula.sha1 is disabled!
> Use Formula.sha256 instead.
> /usr/local/Homebrew/Library/Taps/brona/homebrew-iproute2mac/iproute2mac.rb:6:in
>  `'
> Please report this to the brona/iproute2mac tap!
> Error: Cannot tap brona/iproute2mac: invalid syntax in tap!
> The command "brew tap brona/iproute2mac" failed and exited with 1 during .
> Your build has been stopped.
> /Users/travis/build.sh: line 138: shell_session_update: command not found
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq pull request #1006: HAWQ-1150. Fix Travis build issue (brona/...

2016-11-09 Thread edespino
GitHub user edespino opened a pull request:

https://github.com/apache/incubator-hawq/pull/1006

HAWQ-1150. Fix Travis build issue (brona/iproute2mac).

* Remove the "brew tap brona/iproute2mac" command as an update to "brew"
  has revealed an issue with the "tap".  We will be able to install the
  component (iproute2mac) directory from the main repository.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/edespino/incubator-hawq HAWQ-1150

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/1006.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1006


commit 89c82fa7c7fa8dc37593cebd429fa7c44954e6b9
Author: Ed Espino 
Date:   2016-11-09T09:06:26Z

HAWQ-1150. Fix Travis build issue (brona/iproute2mac).

* Remove the "brew tap brona/iproute2mac" command as an update to "brew"
  has revealed an issue with the "tap".  We will be able to install the
  component (iproute2mac) directory from the main repository.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (HAWQ-1150) Recent changes to "brew" have caused all Travis CI builds to break.

2016-11-09 Thread Ed Espino (JIRA)
Ed Espino created HAWQ-1150:
---

 Summary: Recent changes to "brew" have caused all Travis CI builds 
to break.
 Key: HAWQ-1150
 URL: https://issues.apache.org/jira/browse/HAWQ-1150
 Project: Apache HAWQ
  Issue Type: Task
  Components: Build
Reporter: Ed Espino
Assignee: Lei Chang


Problem: A recent update to brew has exposed an issue with the 'brew tap 
brona/iproute2mac' command. This causes an Travis error for all branches and 
PRs using Travis to build.

Solution: We can simply remove the command and allow the iproute2mac module to 
come from the main brew repository.

Here is the error encountered.

{code}
$ brew outdated libyaml || brew upgrade libyaml
$ brew outdated json-c || brew upgrade json-c
$ brew outdated boost || brew upgrade boost
$ brew outdated maven || brew upgrade maven
$ brew tap brona/iproute2mac
==> Tapping brona/iproute2mac
Cloning into '/usr/local/Homebrew/Library/Taps/brona/homebrew-iproute2mac'...
remote: Counting objects: 5, done.
remote: Compressing objects: 100% (5/5), done.
remote: Total 5 (delta 0), reused 4 (delta 0), pack-reused 0
Unpacking objects: 100% (5/5), done.
Error: Invalid formula: 
/usr/local/Homebrew/Library/Taps/brona/homebrew-iproute2mac/iproute2mac.rb
Calling Formula.sha1 is disabled!
Use Formula.sha256 instead.
/usr/local/Homebrew/Library/Taps/brona/homebrew-iproute2mac/iproute2mac.rb:6:in 
`'
Please report this to the brona/iproute2mac tap!
Error: Cannot tap brona/iproute2mac: invalid syntax in tap!
The command "brew tap brona/iproute2mac" failed and exited with 1 during .
Your build has been stopped.
/Users/travis/build.sh: line 138: shell_session_update: command not found
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq issue #1005: HAWQ-1141: Bump PXF, HDB Ambari plugin and defau...

2016-11-09 Thread radarwave
Github user radarwave commented on the issue:

https://github.com/apache/incubator-hawq/pull/1005
  
LGTM  +1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (HAWQ-513) initdb.c failed on OSX 10.11.3 due to fgets error

2016-11-09 Thread Hongxu Ma (JIRA)

[ 
https://issues.apache.org/jira/browse/HAWQ-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15650385#comment-15650385
 ] 

Hongxu Ma commented on HAWQ-513:


I had the same problems on osx 10.11.16, and solved it by this: 
enter the mac "Recovery Mode", and set csrutil disable.

more detail in: 
https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install
see the "Turning Off Rootless System Integrity Protection in OS X El Capitan 
10.11+" section.

after do that, the "DYLD_LIBRARY_PATH" can work well, that's the key to cause 
of this problem.
Try it.



> initdb.c failed on OSX 10.11.3 due to fgets error
> -
>
> Key: HAWQ-513
> URL: https://issues.apache.org/jira/browse/HAWQ-513
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Unknown
>Reporter: xin zhang
>Assignee: Lei Chang
> Fix For: backlog
>
>
> we hit following strange issue on OSX 10.11.3:
> The error message in the initdb is: 
> {code}
> 20160301:00:00:26:075823 hawq_init:This-MacBook-Pro:vagrant-[INFO]:-Start to 
> init master node: 'localhost'
> sh: line 1: 76106 Trace/BPT trap: 5   "/usr/local/hawq/bin/postgres" -V 
> 2> /dev/null
> fgets failure: Undefined error: 0
> The program "postgres" is needed by initdb but was either not found in the 
> same directory as "/usr/local/hawq/bin/initdb" or failed unexpectedly.
> Check your installation; "postgres -V" may have more information.
> Master postgres initdb failed
> {code}
> We suspect the issue due to the newer version of the libSystem.B.dylib on OSX 
> 10.11.3.
> Here is the details of the dependencies of `postgres` and `initdb`:
> 10.10.5, postgres can start, and initdb succeed:
> {code}
> [bin: xzhang{master}]$ otool -L postgres
> postgres:
> /usr/lib/libc++.1.dylib (compatibility version 1.0.0, current version 
> 120.0.0)
> libhdfs3.1.dylib (compatibility version 1.0.0, current version 2.2.30)
> /usr/lib/libxml2.2.dylib (compatibility version 10.0.0, current version 
> 10.9.0)
> libyarn.1.dylib (compatibility version 1.0.0, current version 0.1.13)
> /usr/local/opt/json-c/lib/libjson-c.2.dylib (compatibility version 3.0.0, 
> current version 3.1.0)
> /usr/local/opt/snappy/lib/libsnappy.1.dylib (compatibility version 5.0.0, 
> current version 5.0.0)
> /usr/lib/libbz2.1.0.dylib (compatibility version 1.0.0, current version 
> 1.0.5)
> /usr/lib/libz.1.dylib (compatibility version 1.0.0, current version 1.2.5)
> /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 
> 1213.0.0)
> /usr/lib/libcurl.4.dylib (compatibility version 7.0.0, current version 
> 8.0.0)
> /System/Library/Frameworks/Kerberos.framework/Versions/A/Kerberos 
> (compatibility version 5.0.0, current version 6.0.0)
> libdxltranslators.dylib (compatibility version 0.0.0, current version 
> 0.0.0)
> /usr/local/opt/thrift/lib/libthrift-0.9.3.dylib (compatibility version 
> 0.0.0, current version 0.0.0)
> This-MacBook-Pro:bin vagrant$ otool -L initdb
> initdb:
> /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 
> 1226.10.1)
> {code}
> 10.11.3, postgres can start, but initdb failed:
> {code}
> This-MacBook-Pro:bin vagrant$ otool -L postgres
> postgres:
> /usr/lib/libc++.1.dylib (compatibility version 1.0.0, current version 
> 120.1.0)
> libhdfs3.1.dylib (compatibility version 1.0.0, current version 2.2.30)
> /usr/lib/libxml2.2.dylib (compatibility version 10.0.0, current version 
> 10.9.0)
> libyarn.1.dylib (compatibility version 1.0.0, current version 0.1.13)
> /usr/local/opt/json-c/lib/libjson-c.2.dylib (compatibility version 3.0.0, 
> current version 3.1.0)
> /usr/local/opt/snappy/lib/libsnappy.1.dylib (compatibility version 5.0.0, 
> current version 5.0.0)
> /usr/lib/libbz2.1.0.dylib (compatibility version 1.0.0, current version 
> 1.0.5)
> /usr/lib/libssl.0.9.8.dylib (compatibility version 0.9.8, current version 
> 0.9.8)
> /usr/lib/libcrypto.0.9.8.dylib (compatibility version 0.9.8, current 
> version 0.9.8)
> /usr/lib/libz.1.dylib (compatibility version 1.0.0, current version 1.2.5)
> /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 
> 1226.10.1)
> /usr/lib/libcurl.4.dylib (compatibility version 7.0.0, current version 
> 8.0.0)
> /System/Library/Frameworks/Kerberos.framework/Versions/A/Kerberos 
> (compatibility version 5.0.0, current version 6.0.0)
> libdxltranslators.dylib (compatibility version 0.0.0, current version 
> 0.0.0)
> /usr/local/opt/thrift/lib/libthrift-0.9.3.dylib (compatibility version 
> 0.0.0, current version 0.0.0)
> [bin: xzhang{master}]$ otool -L initdb
> initdb:
> /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 
> 1213.0.0)
> {code}
> In this case, there is a difference 

[jira] [Updated] (HAWQ-1141) Bump PXF and default HDB Stack version.

2016-11-09 Thread Ed Espino (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ed Espino updated HAWQ-1141:

Description: Update PXF (3.1.0) and default Ambari default stack version 
(HDP-2.5).  (was: Update PXF (3.1.0), HDB Ambari plugin (2.1.0.0) and default 
Ambari default stack version (HDP-2.5).)

> Bump PXF and default HDB Stack version.
> ---
>
> Key: HAWQ-1141
> URL: https://issues.apache.org/jira/browse/HAWQ-1141
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: Ed Espino
>Assignee: Ed Espino
> Fix For: 2.0.1.0-incubating
>
>
> Update PXF (3.1.0) and default Ambari default stack version (HDP-2.5).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HAWQ-1141) Bump PXF and default HDB Stack version.

2016-11-09 Thread Ed Espino (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ed Espino updated HAWQ-1141:

Summary: Bump PXF and default HDB Stack version.  (was: Bump PXF, HDB 
Ambari plugin and default HDB Stack version.)

> Bump PXF and default HDB Stack version.
> ---
>
> Key: HAWQ-1141
> URL: https://issues.apache.org/jira/browse/HAWQ-1141
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: PXF
>Reporter: Ed Espino
>Assignee: Ed Espino
> Fix For: 2.0.1.0-incubating
>
>
> Update PXF (3.1.0), HDB Ambari plugin (2.1.0.0) and default Ambari default 
> stack version (HDP-2.5).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq issue #1001: HAWQ-1136. Disable .psqlrc in minirepro

2016-11-09 Thread liming01
Github user liming01 commented on the issue:

https://github.com/apache/incubator-hawq/pull/1001
  
@hsyuan, It seems that you skip checking about something. It is better to 
fix the root cause of this exception instead of skipping checking. Thanks.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---