[jira] [Created] (TRAFODION-1917) Trafodion fails to build HDP related jar files
Selvaganesan Govindarajan created TRAFODION-1917: Summary: Trafodion fails to build HDP related jar files Key: TRAFODION-1917 URL: https://issues.apache.org/jira/browse/TRAFODION-1917 Project: Apache Trafodion Issue Type: Bug Components: Build Infrastructure Affects Versions: 2.0-incubating Reporter: Selvaganesan Govindarajan Priority: Critical Fix For: 2.0-incubating -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TRAFODION-1915) support adding/retrieving comments to SQL objects
[ https://issues.apache.org/jira/browse/TRAFODION-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15224572#comment-15224572 ] Hans Zeller commented on TRAFODION-1915: Yes, and if someone wants to work on this, another thing they could consider to implement headings in addition to comments. A heading is used as the header of a result display, the effect is similar to an alias name. > support adding/retrieving comments to SQL objects > - > > Key: TRAFODION-1915 > URL: https://issues.apache.org/jira/browse/TRAFODION-1915 > Project: Apache Trafodion > Issue Type: New Feature >Reporter: liu ming >Priority: Minor > > It is desired to have compatible capability of Oracle's syntax to add/get > comments to SQL objects, like tables and columns, etc. > QiFan give a very good initial design for this: > 1.add a new type for column TEXT_TYPE in meta-table > TRAFODION."_MD_".TEXT, say COMMENT_TYPE; > 2.allow COMMENT ON syntax in the parser; > 3.convert the content of COMMENT ON stmt into insertion/update of a > row(s) in the TEXT meta-data table for the SQL object in question; > 4.write a UDF to show the comment easily for a SQL object, by hiding the > join of the meta-data TEXT and OBJECTS table. > Can be done increamentally since there are a lot of SQL objects. And multiple > changes to different components. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TRAFODION-1917) Trafodion fails to build HDP related jar files
[ https://issues.apache.org/jira/browse/TRAFODION-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15224672#comment-15224672 ] ASF GitHub Bot commented on TRAFODION-1917: --- GitHub user selvaganesang opened a pull request: https://github.com/apache/incubator-trafodion/pull/413 [TRAFODION-1917] Trafodion fails to build HDP related jar files You can merge this pull request into a Git repository by running: $ git pull https://github.com/selvaganesang/incubator-trafodion trafodion-1917 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/413.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #413 commit 6995fae9caa1d63e172b43d96ef184b5e8ca8691 Author: selvaganesang Date: 2016-04-04T18:03:08Z [TRAFODION-1917] Trafodion fails to build HDP related jar files > Trafodion fails to build HDP related jar files > -- > > Key: TRAFODION-1917 > URL: https://issues.apache.org/jira/browse/TRAFODION-1917 > Project: Apache Trafodion > Issue Type: Bug > Components: Build Infrastructure >Affects Versions: 2.0-incubating >Reporter: Selvaganesan Govindarajan >Priority: Critical > Fix For: 2.0-incubating > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (TRAFODION-1918) Remove AUTO flush concept in Trafodion
Selvaganesan Govindarajan created TRAFODION-1918: Summary: Remove AUTO flush concept in Trafodion Key: TRAFODION-1918 URL: https://issues.apache.org/jira/browse/TRAFODION-1918 Project: Apache Trafodion Issue Type: Bug Components: sql-cmp, sql-exe Affects Versions: 2.0-incubating Reporter: Selvaganesan Govindarajan Priority: Critical -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TRAFODION-1915) support adding/retrieving comments to SQL objects
[ https://issues.apache.org/jira/browse/TRAFODION-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225000#comment-15225000 ] Pierre Smits commented on TRAFODION-1915: - I suggest either creating a new JIRA for that, or improve the title and description. > support adding/retrieving comments to SQL objects > - > > Key: TRAFODION-1915 > URL: https://issues.apache.org/jira/browse/TRAFODION-1915 > Project: Apache Trafodion > Issue Type: New Feature >Reporter: liu ming >Priority: Minor > > It is desired to have compatible capability of Oracle's syntax to add/get > comments to SQL objects, like tables and columns, etc. > QiFan give a very good initial design for this: > 1.add a new type for column TEXT_TYPE in meta-table > TRAFODION."_MD_".TEXT, say COMMENT_TYPE; > 2.allow COMMENT ON syntax in the parser; > 3.convert the content of COMMENT ON stmt into insertion/update of a > row(s) in the TEXT meta-data table for the SQL object in question; > 4.write a UDF to show the comment easily for a SQL object, by hiding the > join of the meta-data TEXT and OBJECTS table. > Can be done increamentally since there are a lot of SQL objects. And multiple > changes to different components. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TRAFODION-1915) support adding/retrieving comments to SQL objects
[ https://issues.apache.org/jira/browse/TRAFODION-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225117#comment-15225117 ] Hans Zeller commented on TRAFODION-1915: Thanks, good point. I just wanted to point out the commonalities in the implementation. Personally, I don't need that feature. Therefore, my suggestion is that a) if someone needs headings, they should create a new JIRA, or b) if someone wants to work on this JIRA and also wants to address comments, they should create a new JIRA for comments and consider working on both at the same time. > support adding/retrieving comments to SQL objects > - > > Key: TRAFODION-1915 > URL: https://issues.apache.org/jira/browse/TRAFODION-1915 > Project: Apache Trafodion > Issue Type: New Feature >Reporter: liu ming >Priority: Minor > > It is desired to have compatible capability of Oracle's syntax to add/get > comments to SQL objects, like tables and columns, etc. > QiFan give a very good initial design for this: > 1.add a new type for column TEXT_TYPE in meta-table > TRAFODION."_MD_".TEXT, say COMMENT_TYPE; > 2.allow COMMENT ON syntax in the parser; > 3.convert the content of COMMENT ON stmt into insertion/update of a > row(s) in the TEXT meta-data table for the SQL object in question; > 4.write a UDF to show the comment easily for a SQL object, by hiding the > join of the meta-data TEXT and OBJECTS table. > Can be done increamentally since there are a lot of SQL objects. And multiple > changes to different components. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TRAFODION-1917) Trafodion fails to build HDP related jar files
[ https://issues.apache.org/jira/browse/TRAFODION-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225150#comment-15225150 ] ASF GitHub Bot commented on TRAFODION-1917: --- Github user asfgit closed the pull request at: https://github.com/apache/incubator-trafodion/pull/413 > Trafodion fails to build HDP related jar files > -- > > Key: TRAFODION-1917 > URL: https://issues.apache.org/jira/browse/TRAFODION-1917 > Project: Apache Trafodion > Issue Type: Bug > Components: Build Infrastructure >Affects Versions: 2.0-incubating >Reporter: Selvaganesan Govindarajan >Priority: Critical > Fix For: 2.0-incubating > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (TRAFODION-1919) Call to /var/lib/ambari-server/resources/scripts/configs.sh needs -u -p
Amanda Moran created TRAFODION-1919: --- Summary: Call to /var/lib/ambari-server/resources/scripts/configs.sh needs -u -p Key: TRAFODION-1919 URL: https://issues.apache.org/jira/browse/TRAFODION-1919 Project: Apache Trafodion Issue Type: Bug Reporter: Amanda Moran Assignee: Amanda Moran configs.sh scripts needs -u $ADMIN and -p $PASSWORD otherwise the defaults of admin:admin are used. When a different user name and password are used this script will fail. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TRAFODION-1688) Some missing records following a regionServer failure
[ https://issues.apache.org/jira/browse/TRAFODION-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225317#comment-15225317 ] Pierre Smits commented on TRAFODION-1688: - Is it still valid to have this with status OPEN? > Some missing records following a regionServer failure > - > > Key: TRAFODION-1688 > URL: https://issues.apache.org/jira/browse/TRAFODION-1688 > Project: Apache Trafodion > Issue Type: Bug > Components: dtm >Affects Versions: 1.3-incubating >Reporter: Sean Broeder >Assignee: Sean Broeder > Fix For: 1.3-incubating > > Original Estimate: 168h > Remaining Estimate: 168h > > Under heavy load if a regionServer dies some records might be missing from a > table after the regions recover. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TRAFODION-1912) support automatic convert DOS format during bulkload
[ https://issues.apache.org/jira/browse/TRAFODION-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225530#comment-15225530 ] ASF GitHub Bot commented on TRAFODION-1912: --- GitHub user traflm opened a pull request: https://github.com/apache/incubator-trafodion/pull/414 [TRAFODION-1912]support automatic convert DOS format during bulkload Introduce a new CQD : HIVE_SCAN_SPECIAL_MODE which is a bitmap, to allow different 'tolerance' suggested by JIRA 1911. This patch is for DOS format handling. When HIVE_SCAN_SPECIAL_MODE set to 1, HIVE_SCAN will automatically replace \r\n to space\n Please help to review. You can merge this pull request into a Git repository by running: $ git pull https://github.com/traflm/incubator-trafodion TRAFODION-1912 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/414.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #414 commit f48cc2b69043b33c1abd2b9cec9e3bf1e2299d11 Author: Liu Ming Date: 2016-04-05T02:05:48Z [TRAFODION-1912]support automatic convert DOS format during bulkload > support automatic convert DOS format during bulkload > > > Key: TRAFODION-1912 > URL: https://issues.apache.org/jira/browse/TRAFODION-1912 > Project: Apache Trafodion > Issue Type: Sub-task >Reporter: liu ming >Assignee: liu ming > > during bulkload, if the raw text file on HDFS is in DOS format, it is desired > to automaticlly convert to Unix format as Trafodion requires during the load > process. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Work started] (TRAFODION-1911) A special mode to be more tolerant during bulkloading and accessing HDFS raw data
[ https://issues.apache.org/jira/browse/TRAFODION-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on TRAFODION-1911 started by liu ming. --- > A special mode to be more tolerant during bulkloading and accessing HDFS raw > data > - > > Key: TRAFODION-1911 > URL: https://issues.apache.org/jira/browse/TRAFODION-1911 > Project: Apache Trafodion > Issue Type: Umbrella >Reporter: liu ming >Assignee: liu ming > > Raw data in HDFS sometimes are not well formatted or contains bad values. > Trafodion bulkloader will complain error or not work well by default once > that is the case. > It will be valuable to let Trafodion work in a special mode to tolerate bad > raw data in the HDFS. A not completed list below: > 1.Automatically remove ‘\r’ when it is used as ‘\r\n’ the DOS format line > delimiter. > 2.Donot raise SQL error, but convert bad data into null automatically, > and still be able to log this into error log files when required, don’t make > this change silent, and make this action traceable. > 3.Allow ‘\n’ in data field even ‘\n’ is the line terminator > 4.Auto truncate overflowed string, log it into the error log file, in > order to make it traceable. > 5.Tolerate ‘\0’ in source data > There may be more, this is an umbrella JIRA to track all related sub tasks. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (TRAFODION-1920) suppress SQL error during HIVE_SCAN when encounter invalid value, assign null to the invalid value
liu ming created TRAFODION-1920: --- Summary: suppress SQL error during HIVE_SCAN when encounter invalid value, assign null to the invalid value Key: TRAFODION-1920 URL: https://issues.apache.org/jira/browse/TRAFODION-1920 Project: Apache Trafodion Issue Type: Sub-task Reporter: liu ming -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TRAFODION-1688) Some missing records following a regionServer failure
[ https://issues.apache.org/jira/browse/TRAFODION-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225547#comment-15225547 ] Sean Broeder commented on TRAFODION-1688: - You are correct Pierre. I had attempted to get this closed automatically with my previous 'this closes' comment, but perhaps I needed the JIRA number, not the pull request. Perhaps there isn't an automated way to close this via a pull request. In any event, the security setting require a committer to close it, so perhaps Dave can? > Some missing records following a regionServer failure > - > > Key: TRAFODION-1688 > URL: https://issues.apache.org/jira/browse/TRAFODION-1688 > Project: Apache Trafodion > Issue Type: Bug > Components: dtm >Affects Versions: 1.3-incubating >Reporter: Sean Broeder >Assignee: Sean Broeder > Fix For: 1.3-incubating > > Original Estimate: 168h > Remaining Estimate: 168h > > Under heavy load if a regionServer dies some records might be missing from a > table after the regions recover. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TRAFODION-1920) suppress SQL error during HIVE_SCAN when encounter invalid value, assign null to the invalid value
[ https://issues.apache.org/jira/browse/TRAFODION-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225548#comment-15225548 ] liu ming commented on TRAFODION-1920: - suppress SQL error during HIVE_SCAN when encounter invalid value, assign null to the invalid value This should NOT be default behavior, Trafodion should not silently change the data without user's awareness. When it is desired (By setting the CQD), HIVE_SCAN will suppress the SQL error, and fill value with null, and dump the error row into HDFS log file if 'log' option is used. > suppress SQL error during HIVE_SCAN when encounter invalid value, assign null > to the invalid value > -- > > Key: TRAFODION-1920 > URL: https://issues.apache.org/jira/browse/TRAFODION-1920 > Project: Apache Trafodion > Issue Type: Sub-task >Reporter: liu ming > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TRAFODION-1917) Trafodion fails to build HDP related jar files
[ https://issues.apache.org/jira/browse/TRAFODION-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225602#comment-15225602 ] ASF GitHub Bot commented on TRAFODION-1917: --- GitHub user mashengchen opened a pull request: https://github.com/apache/incubator-trafodion/pull/415 [TRAFODION-1917] Trafodion fails to build HDP related jar files You can merge this pull request into a Git repository by running: $ git pull https://github.com/mashengchen/incubator-trafodion master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/415.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #415 commit 0dbf1d1bc8718990850b4cff6e5f955a213209ae Author: mashengchen Date: 2016-04-05T03:03:48Z Trafodion building troubles commit c0b3136c6e29afc97d299cfc3407df7093a20060 Author: mashengchen Date: 2016-04-05T03:07:20Z Merge branch 'master' of github.com:mashengchen/incubator-trafodion commit 897ea4b4013e55c691ffabb84fef804c7a623bf8 Author: mashengchen Date: 2016-04-05T03:09:01Z Merge pull request #13 from apache/master update head > Trafodion fails to build HDP related jar files > -- > > Key: TRAFODION-1917 > URL: https://issues.apache.org/jira/browse/TRAFODION-1917 > Project: Apache Trafodion > Issue Type: Bug > Components: Build Infrastructure >Affects Versions: 2.0-incubating >Reporter: Selvaganesan Govindarajan >Priority: Critical > Fix For: 2.0-incubating > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TRAFODION-1917) Trafodion fails to build HDP related jar files
[
https://issues.apache.org/jira/browse/TRAFODION-1917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225616#comment-15225616
]
ASF GitHub Bot commented on TRAFODION-1917:
---
Github user selvaganesang commented on a diff in the pull request:
https://github.com/apache/incubator-trafodion/pull/415#discussion_r58482948
--- Diff: core/sqf/sql/scripts/install_local_hadoop ---
@@ -614,7 +614,7 @@ HIVE_TAR=${HIVE_PREFIX}.tar.gz
HBASE_MIRROR_URL=http://archive.cloudera.com/cdh5/cdh/5
HBASE_TAR=hbase-${HBASE_DEP_VER_CDH}.tar.gz
if [[ "$HBASE_DISTRO" = "HDP" ]]; then
-HBASE_TAR=hbase-${HBASE_DEP_VER_HDP}.tar.gz
+HBASE_TAR=hbase-1.1.2.2.3.2.0-2950.tar.gz
--- End diff --
Prashanth brought this up already. I suggested that It would be better to
create a soft link is created at the local repository to point to the
HBASE_DEP_VER_HDP rather than changing the install_local_hadoop.
> Trafodion fails to build HDP related jar files
> --
>
> Key: TRAFODION-1917
> URL: https://issues.apache.org/jira/browse/TRAFODION-1917
> Project: Apache Trafodion
> Issue Type: Bug
> Components: Build Infrastructure
>Affects Versions: 2.0-incubating
>Reporter: Selvaganesan Govindarajan
>Priority: Critical
> Fix For: 2.0-incubating
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (TRAFODION-1918) Remove AUTO flush concept in Trafodion
[ https://issues.apache.org/jira/browse/TRAFODION-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225690#comment-15225690 ] ASF GitHub Bot commented on TRAFODION-1918: --- GitHub user selvaganesang opened a pull request: https://github.com/apache/incubator-trafodion/pull/416 [TRAFODION-1918] Remove auto flush concept in Trafodion The auto flush is on by default in insertRows method. But insertRows was incorrectly called with the wrong parameter. In fixing this issue, it was observed that auto flush is deprecated in HBase 1.x. It is also incorrect to disable auto flush in Trafodion. Hence removed the code related to auto flush, flush table and flush all tables in Trafodion. All these are dormant code in Trafodion. Also disabled executor/TEST106 for now because it seems to cause a hang at the time of drop table. You can merge this pull request into a Git repository by running: $ git pull https://github.com/selvaganesang/incubator-trafodion trafodion-1918 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/416.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #416 commit 8fb334ac59f49e23259956b28db932e909bad59d Author: selvaganesang Date: 2016-04-05T04:51:29Z [TRAFODION-1918] Remove auto flush concept in Trafodion The auto flush is on by default in insertRows method. But insertRows was incorrectly called with the wrong parameter. In fixing this issue, it was observed that auto flush is deprecated in HBase 1.x. It is also incorrect to disable auto flush in Trafodion. Hence removed the code related to auto flush, flush table and flush all tables in Trafodion. All these are dormant code in Trafodion. Also disabled executor/TEST106 for now because it seems to cause a hang at the time of drop table. > Remove AUTO flush concept in Trafodion > -- > > Key: TRAFODION-1918 > URL: https://issues.apache.org/jira/browse/TRAFODION-1918 > Project: Apache Trafodion > Issue Type: Bug > Components: sql-cmp, sql-exe >Affects Versions: 2.0-incubating >Reporter: Selvaganesan Govindarajan >Priority: Critical > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
