[GitHub] incubator-hawq pull request #904: HAWQ-1060. Refactor hawq register with bet...

2016-09-18 Thread xunzhang
Github user xunzhang closed the pull request at:

https://github.com/apache/incubator-hawq/pull/904


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #904: HAWQ-1060. Refactor hawq register with better rea...

2016-09-18 Thread xunzhang
Github user xunzhang commented on the issue:

https://github.com/apache/incubator-hawq/pull/904
  
Merged into master, thanks.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #907: HAWQ-991. Check bucketnum and encoding con...

2016-09-18 Thread xunzhang
GitHub user xunzhang opened a pull request:

https://github.com/apache/incubator-hawq/pull/907

HAWQ-991. Check bucketnum and encoding consistency in hawq register.



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/xunzhang/incubator-hawq hawqregister-fix

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/907.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #907


commit 17ca886c939dc324487186536653f2278cddb1a8
Author: xunzhang 
Date:   2016-09-18T07:54:29Z

HAWQ-991. Check bucketnum and encoding consistency in hawq register.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #907: HAWQ-991. Check bucketnum and encoding consistenc...

2016-09-18 Thread xunzhang
Github user xunzhang commented on the issue:

https://github.com/apache/incubator-hawq/pull/907
  
cc @ictmalili @wengyanqing 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Resolved] (HAWQ-1034) add --repair option for hawq register

2016-09-18 Thread hongwu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

hongwu resolved HAWQ-1034.
--
Resolution: Incomplete

> add --repair option for hawq register
> -
>
> Key: HAWQ-1034
> URL: https://issues.apache.org/jira/browse/HAWQ-1034
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Command Line Tools
>Affects Versions: 2.0.1.0-incubating
>Reporter: Lili Ma
>Assignee: hongwu
> Fix For: 2.0.1.0-incubating
>
>
> add --repair option for hawq register
> Will change both file folder and catalog table pg_aoseg.pg_paqseg_$relid to 
> the state which .yml file configures. Note may some new generated files since 
> the checkpoint may be deleted here. Also note the all the files in .yml file 
> should all under the table folder on HDFS. Limitation: Do not support cases 
> for hash table redistribution, table truncate and table drop. This is for 
> scenario rollback of table: Do checkpoints somewhere, and need to rollback to 
> previous checkpoint. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (HAWQ-1060) Refactor hawq register with better readability and quality.

2016-09-18 Thread hongwu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

hongwu resolved HAWQ-1060.
--
Resolution: Implemented

> Refactor hawq register with better readability and quality.
> ---
>
> Key: HAWQ-1060
> URL: https://issues.apache.org/jira/browse/HAWQ-1060
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Command Line Tools
>Affects Versions: 2.0.1.0-incubating
>Reporter: hongwu
>Assignee: hongwu
> Fix For: 2.0.1.0-incubating
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Reopened] (HAWQ-1034) add --repair option for hawq register

2016-09-18 Thread hongwu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

hongwu reopened HAWQ-1034:
--

> add --repair option for hawq register
> -
>
> Key: HAWQ-1034
> URL: https://issues.apache.org/jira/browse/HAWQ-1034
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Command Line Tools
>Affects Versions: 2.0.1.0-incubating
>Reporter: Lili Ma
>Assignee: hongwu
> Fix For: 2.0.1.0-incubating
>
>
> add --repair option for hawq register
> Will change both file folder and catalog table pg_aoseg.pg_paqseg_$relid to 
> the state which .yml file configures. Note may some new generated files since 
> the checkpoint may be deleted here. Also note the all the files in .yml file 
> should all under the table folder on HDFS. Limitation: Do not support cases 
> for hash table redistribution, table truncate and table drop. This is for 
> scenario rollback of table: Do checkpoints somewhere, and need to rollback to 
> previous checkpoint. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (HAWQ-1034) add --repair option for hawq register

2016-09-18 Thread hongwu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

hongwu resolved HAWQ-1034.
--
Resolution: Implemented

> add --repair option for hawq register
> -
>
> Key: HAWQ-1034
> URL: https://issues.apache.org/jira/browse/HAWQ-1034
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Command Line Tools
>Affects Versions: 2.0.1.0-incubating
>Reporter: Lili Ma
>Assignee: hongwu
> Fix For: 2.0.1.0-incubating
>
>
> add --repair option for hawq register
> Will change both file folder and catalog table pg_aoseg.pg_paqseg_$relid to 
> the state which .yml file configures. Note may some new generated files since 
> the checkpoint may be deleted here. Also note the all the files in .yml file 
> should all under the table folder on HDFS. Limitation: Do not support cases 
> for hash table redistribution, table truncate and table drop. This is for 
> scenario rollback of table: Do checkpoints somewhere, and need to rollback to 
> previous checkpoint. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq issue #907: HAWQ-991. Check bucketnum and encoding consistenc...

2016-09-18 Thread xunzhang
Github user xunzhang commented on the issue:

https://github.com/apache/incubator-hawq/pull/907
  
also cc @wcl14 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Assigned] (HAWQ-1034) add --repair option for hawq register

2016-09-18 Thread Hubert Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hubert Zhang reassigned HAWQ-1034:
--

Assignee: Hubert Zhang  (was: hongwu)

> add --repair option for hawq register
> -
>
> Key: HAWQ-1034
> URL: https://issues.apache.org/jira/browse/HAWQ-1034
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Command Line Tools
>Affects Versions: 2.0.1.0-incubating
>Reporter: Lili Ma
>Assignee: Hubert Zhang
> Fix For: 2.0.1.0-incubating
>
>
> add --repair option for hawq register
> Will change both file folder and catalog table pg_aoseg.pg_paqseg_$relid to 
> the state which .yml file configures. Note may some new generated files since 
> the checkpoint may be deleted here. Also note the all the files in .yml file 
> should all under the table folder on HDFS. Limitation: Do not support cases 
> for hash table redistribution, table truncate and table drop. This is for 
> scenario rollback of table: Do checkpoints somewhere, and need to rollback to 
> previous checkpoint. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (HAWQ-1035) support partition table register

2016-09-18 Thread Hubert Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hubert Zhang reassigned HAWQ-1035:
--

Assignee: Hubert Zhang  (was: hongwu)

> support partition table register
> 
>
> Key: HAWQ-1035
> URL: https://issues.apache.org/jira/browse/HAWQ-1035
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Command Line Tools
>Reporter: Lili Ma
>Assignee: Hubert Zhang
> Fix For: 2.0.1.0-incubating
>
>
> Support partition table register, limited to 1 level partition table, since 
> hawq extract only supports 1-level partition table.
> Expected behavior:
> 1. Create a partition table in HAWQ, then extract the information out to .yml 
> file
> 2. Call hawq register and specify identified .yml file and a new table name, 
> the files should be registered into the new table.
> Work can be detailed down to implement partition table register:
> 1. modify .yml configuration file parsing function, add content for partition 
> table.
> 2. construct partition table DDL regards to .yml configuration file
> 3. map sub partition table name to the table list in .yml configuration file
> 4. register the subpartition table one by one



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq pull request #908: HAWQ-1035. add mL parser to support partit...

2016-09-18 Thread zhangh43
GitHub user zhangh43 opened a pull request:

https://github.com/apache/incubator-hawq/pull/908

HAWQ-1035. add mL parser to support partition table.



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zhangh43/incubator-hawq hawq10350

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/908.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #908


commit 2f06ae355d54c24b1f5adac6443728dc95fd5bd6
Author: hzhang2 
Date:   2016-09-18T08:19:55Z

HAWQ-1035. add mL parser to support partition table.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Updated] (HAWQ-1034) add --repair option for hawq register

2016-09-18 Thread Hubert Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hubert Zhang updated HAWQ-1034:
---
Assignee: hongwu  (was: Hubert Zhang)

> add --repair option for hawq register
> -
>
> Key: HAWQ-1034
> URL: https://issues.apache.org/jira/browse/HAWQ-1034
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Command Line Tools
>Affects Versions: 2.0.1.0-incubating
>Reporter: Lili Ma
>Assignee: hongwu
> Fix For: 2.0.1.0-incubating
>
>
> add --repair option for hawq register
> Will change both file folder and catalog table pg_aoseg.pg_paqseg_$relid to 
> the state which .yml file configures. Note may some new generated files since 
> the checkpoint may be deleted here. Also note the all the files in .yml file 
> should all under the table folder on HDFS. Limitation: Do not support cases 
> for hash table redistribution, table truncate and table drop. This is for 
> scenario rollback of table: Do checkpoints somewhere, and need to rollback to 
> previous checkpoint. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq issue #908: HAWQ-1035. add mL parser to support partition tab...

2016-09-18 Thread linwen
Github user linwen commented on the issue:

https://github.com/apache/incubator-hawq/pull/908
  
+1 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #908: HAWQ-1035. add mL parser to support partition tab...

2016-09-18 Thread liming01
Github user liming01 commented on the issue:

https://github.com/apache/incubator-hawq/pull/908
  
+1.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Updated] (HAWQ-1051) failing in reverse DNS lookup causes resource manager core dump

2016-09-18 Thread Ruilong Huo (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruilong Huo updated HAWQ-1051:
--
Fix Version/s: (was: 2.0.1.0-incubating)
   backlog

> failing in reverse DNS lookup causes resource manager core dump
> ---
>
> Key: HAWQ-1051
> URL: https://issues.apache.org/jira/browse/HAWQ-1051
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Resource Manager
>Reporter: Yi Jin
>Assignee: Yi Jin
> Fix For: backlog
>
>
> This is caused due to wrongly expecting gethostbyaddr() return values. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq pull request #837: HAWQ-779 support pxf filter pushdwon at th...

2016-09-18 Thread jiadexin
Github user jiadexin closed the pull request at:

https://github.com/apache/incubator-hawq/pull/837


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #907: HAWQ-991. Check bucketnum and encoding con...

2016-09-18 Thread ictmalili
Github user ictmalili commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/907#discussion_r79321399
  
--- Diff: tools/bin/hawqregister ---
@@ -242,6 +253,13 @@ class HawqRegister(object):
 logger.error('Files to be registered must be multiple 
times to the bucket number of hash table.')
 sys.exit(1)
 
+def check_database_encoding():
+encoding_indx = 
self.accessor.get_database_encoding_indx(self.database)
+encoding = self.accessor.get_database_encoding(encoding_indx)
+if self.encoding.strip() != encoding:
+logger.error('Database encoding is not consistent.')
--- End diff --

Shall we print out the two encodings?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #907: HAWQ-991. Check bucketnum and encoding con...

2016-09-18 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/907#discussion_r79322152
  
--- Diff: tools/bin/hawqregister ---
@@ -242,6 +253,13 @@ class HawqRegister(object):
 logger.error('Files to be registered must be multiple 
times to the bucket number of hash table.')
 sys.exit(1)
 
+def check_database_encoding():
+encoding_indx = 
self.accessor.get_database_encoding_indx(self.database)
+encoding = self.accessor.get_database_encoding(encoding_indx)
+if self.encoding.strip() != encoding:
+logger.error('Database encoding is not consistent.')
--- End diff --

ok


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #907: HAWQ-991. Check bucketnum and encoding con...

2016-09-18 Thread xunzhang
Github user xunzhang commented on a diff in the pull request:

https://github.com/apache/incubator-hawq/pull/907#discussion_r79322318
  
--- Diff: tools/bin/hawqregister ---
@@ -242,6 +253,13 @@ class HawqRegister(object):
 logger.error('Files to be registered must be multiple 
times to the bucket number of hash table.')
 sys.exit(1)
 
+def check_database_encoding():
+encoding_indx = 
self.accessor.get_database_encoding_indx(self.database)
+encoding = self.accessor.get_database_encoding(encoding_indx)
+if self.encoding.strip() != encoding:
+logger.error('Database encoding is not consistent.')
--- End diff --

done


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #907: HAWQ-991. Check bucketnum and encoding con...

2016-09-18 Thread xunzhang
Github user xunzhang closed the pull request at:

https://github.com/apache/incubator-hawq/pull/907


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq issue #907: HAWQ-991. Check bucketnum and encoding consistenc...

2016-09-18 Thread xunzhang
Github user xunzhang commented on the issue:

https://github.com/apache/incubator-hawq/pull/907
  
Merged into master.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #909: HAWQ-1044. Add normal path testcase for ha...

2016-09-18 Thread wcl14
GitHub user wcl14 opened a pull request:

https://github.com/apache/incubator-hawq/pull/909

HAWQ-1044. Add normal path testcase for hawq register when file exist…

…s, file does not exist and --force

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/wcl14/incubator-hawq HAWQ-1044

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/909.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #909


commit f87c234e127315aa2a0ab00a0dfe9c3acdef530a
Author: Chunling Wang 
Date:   2016-09-19T03:15:38Z

HAWQ-1044. Add normal path testcase for hawq register when file exists, 
file does not exist and --force




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (HAWQ-1061) Improve hawq register for already bugs found

2016-09-18 Thread Lili Ma (JIRA)
Lili Ma created HAWQ-1061:
-

 Summary: Improve hawq register for already bugs found
 Key: HAWQ-1061
 URL: https://issues.apache.org/jira/browse/HAWQ-1061
 Project: Apache HAWQ
  Issue Type: Sub-task
  Components: Command Line Tools
Reporter: Lili Ma
Assignee: Lei Chang


Fix the bugs found by the verification process



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HAWQ-1061) Improve hawq register for already bugs found

2016-09-18 Thread hongwu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

hongwu updated HAWQ-1061:
-
Affects Version/s: 2.0.1.0-incubating

> Improve hawq register for already bugs found
> 
>
> Key: HAWQ-1061
> URL: https://issues.apache.org/jira/browse/HAWQ-1061
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Command Line Tools
>Affects Versions: 2.0.1.0-incubating
>Reporter: Lili Ma
>Assignee: hongwu
> Fix For: 2.0.1.0-incubating
>
>
> Fix the bugs found by the verification process



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (HAWQ-1061) Improve hawq register for already bugs found

2016-09-18 Thread hongwu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

hongwu reassigned HAWQ-1061:


Assignee: hongwu  (was: Lei Chang)

> Improve hawq register for already bugs found
> 
>
> Key: HAWQ-1061
> URL: https://issues.apache.org/jira/browse/HAWQ-1061
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Command Line Tools
>Affects Versions: 2.0.1.0-incubating
>Reporter: Lili Ma
>Assignee: hongwu
> Fix For: 2.0.1.0-incubating
>
>
> Fix the bugs found by the verification process



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HAWQ-1061) Improve hawq register for already bugs found

2016-09-18 Thread hongwu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

hongwu updated HAWQ-1061:
-
Description: 
Fix the bugs found by the verification process:
- Data loss when file locations include directories
- Hash table registry consistent issue, which need to be check before register. 
Need check distributed policy and bucket number besides files number.
- Register multiple files need to be rollback when there is some error before 
done. It’s better to check source/target files exists and permissions.


  was:
Fix the bugs found by the verification process:
- Data loss when file locations include directories → needs to be fixed 
asap.
- Hash table registry consistent issue, which need to be check before register. 
Need check distributed policy and bucket number besides files number.
- Register multiple files need to be rollback when there is some error before 
done. It’s better to check source/target files exists and permissions.



> Improve hawq register for already bugs found
> 
>
> Key: HAWQ-1061
> URL: https://issues.apache.org/jira/browse/HAWQ-1061
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Command Line Tools
>Affects Versions: 2.0.1.0-incubating
>Reporter: Lili Ma
>Assignee: hongwu
> Fix For: 2.0.1.0-incubating
>
>
> Fix the bugs found by the verification process:
> - Data loss when file locations include directories
> - Hash table registry consistent issue, which need to be check before 
> register. Need check distributed policy and bucket number besides files 
> number.
> - Register multiple files need to be rollback when there is some error before 
> done. It’s better to check source/target files exists and permissions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HAWQ-1061) Improve hawq register for already bugs found

2016-09-18 Thread hongwu (JIRA)

 [ 
https://issues.apache.org/jira/browse/HAWQ-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

hongwu updated HAWQ-1061:
-
Description: 
Fix the bugs found by the verification process:
- Data loss when file locations include directories → needs to be fixed 
asap.
- Hash table registry consistent issue, which need to be check before register. 
Need check distributed policy and bucket number besides files number.
- Register multiple files need to be rollback when there is some error before 
done. It’s better to check source/target files exists and permissions.


  was:Fix the bugs found by the verification process


> Improve hawq register for already bugs found
> 
>
> Key: HAWQ-1061
> URL: https://issues.apache.org/jira/browse/HAWQ-1061
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Command Line Tools
>Affects Versions: 2.0.1.0-incubating
>Reporter: Lili Ma
>Assignee: hongwu
> Fix For: 2.0.1.0-incubating
>
>
> Fix the bugs found by the verification process:
> - Data loss when file locations include directories → needs to be fixed 
> asap.
> - Hash table registry consistent issue, which need to be check before 
> register. Need check distributed policy and bucket number besides files 
> number.
> - Register multiple files need to be rollback when there is some error before 
> done. It’s better to check source/target files exists and permissions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] incubator-hawq issue #909: HAWQ-1044. Add normal path testcase for hawq regi...

2016-09-18 Thread zhangh43
Github user zhangh43 commented on the issue:

https://github.com/apache/incubator-hawq/pull/909
  
+1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #908: HAWQ-1035. add yml parser to support parti...

2016-09-18 Thread zhangh43
Github user zhangh43 closed the pull request at:

https://github.com/apache/incubator-hawq/pull/908


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-hawq pull request #909: HAWQ-1044. Add normal path testcase for ha...

2016-09-18 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/incubator-hawq/pull/909


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---