[jira] [Commented] (AMBARI-23179) Hive view 2.0 does not parse the TAB delimited CSV files while using 'Upload Table'
[ https://issues.apache.org/jira/browse/AMBARI-23179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396617#comment-16396617 ] Hudson commented on AMBARI-23179: - SUCCESS: Integrated in Jenkins build Ambari-trunk-Commit #8846 (See [https://builds.apache.org/job/Ambari-trunk-Commit/8846/]) AMBARI-23179 : Hive view 2.0 does not parse the TAB delimited CSV files (github: [https://gitbox.apache.org/repos/asf?p=ambari.git&a=commit&h=577bf7d08257300d96d6bc05178d6af065fa3afb]) * (edit) contrib/views/hive20/src/main/resources/ui/app/routes/databases/database/tables/upload-table.js > Hive view 2.0 does not parse the TAB delimited CSV files while using 'Upload > Table' > --- > > Key: AMBARI-23179 > URL: https://issues.apache.org/jira/browse/AMBARI-23179 > Project: Ambari > Issue Type: Bug > Components: ambari-views >Affects Versions: 2.6.0 > Environment: HDP 2.6.3 > Ambari 2.6.0 >Reporter: Sindhu Subhas >Assignee: Nitiraj Singh Rathore >Priority: Major > Labels: pull-request-available > Attachments: Screen Shot 2018-02-28 at 1.02.44 AM.png, Screen Shot > 2018-02-28 at 5.05.55 PM.png, Screen Shot 2018-02-28 at 5.06.47 PM.png, > Screen Shot 2018-02-28 at 5.07.30 PM.png, datatab.tsv > > Time Spent: 1h > Remaining Estimate: 0h > > Problem: > When trying to Upload table from Hive view 2.0 from a TAB delimited file, the > data is not parsed as expected. > Same feature works as expected in Hive view 1.5.0. > Attached output from Hive view 2.0 and output from Hive view 1.5.0. > From the code, we do see difference in the code for > src/main/java/org/apache/ambari/view/hive20/resources/uploads/UploadService.java. > Debug from Hive view 2.0: > {code:java} > 27 Feb 2018 20:27:28,169 DEBUG > [HiveViewActorSystem-akka.actor.default-dispatcher-4] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] OperationController:53 - } java.util.HashMap > 27 Feb 2018 20:27:28,169 DEBUG > [HiveViewActorSystem-akka.actor.default-dispatcher-4] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] HiveActor:41 - Message submitted: > 927343c0-5ed6-435c-be60-37448ac1a8b0 > 27 Feb 2018 20:27:30,925 INFO [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] UploadService:484 - isFirstRowHeader : false, > inputFileType : CSV > 27 Feb 2018 20:27:30,934 INFO [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] OpenCSVParser:50 - setting delimiter as T > 27 Feb 2018 20:27:30,934 INFO [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] OpenCSVParser:56 - setting Quote char : " > 27 Feb 2018 20:27:30,934 INFO [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] OpenCSVParser:62 - setting escapeChar : \ > 27 Feb 2018 20:27:30,939 INFO [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] Parser:75 - generating preview for : > ParseOptions{options={OPTIONS_CSV_QUOTE=", OPTIONS_CSV_DELIMITER=T, > HEADER=NONE, FILE_TYPE=CSV, OPTIONS_CSV_ESCAPE_CHAR=\}} > 27 Feb 2018 20:27:30,939 DEBUG [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] Parser:83 - Illegal number of preview columns supplied > null > 27 Feb 2018 20:27:30,943 DEBUG [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] ParseUtils:152 - error while parsing as timestamp > string column1 column2 column3 > java.lang.IllegalArgumentException: Timestamp format must be -mm-dd > hh:mm:ss[.f] > at java.sql.Timestamp.valueOf(Timestamp.java:204) > . > 27 Feb 2018 20:27:30,948 INFO [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] Parser:149 - datatype detected for column 0 : STRING > 27 Feb 2018 20:27:30,949 DEBUG [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] Parser:159 - return headers : > [ColumnInfo{name='column1', type='STRING', precision=null, scale=null, > comment='null'}] > {code} > Debug from Hive view 1.5.0: > {code:java} > 27 Feb 2018 20:13:15,881 INFO [ambari-client-thread-38] [HIVE 1.5.0 > AUTO_HIVE_INSTANCE] UploadService:499 - isFirstRowHeader : true, > inputFileType : CSV > 27 Feb 2018 20:13:15,918 INFO [ambari-client-thread-38] [HIVE 1.5.0 > AUTO_HIVE_INSTANCE] OpenCSVParser:50 - setting delimiter as > 27 Feb 2018 20:13:15,919 INFO [ambari-client-thread-38] [HIVE 1.5.0 > AUTO_HIVE_INSTANCE] OpenCSVParser:56 - setting Quote char : " > 27 Feb 2018 20:13:15,919 INFO [ambari-client-thread-38] [HIVE 1.5.0 > AUTO_HIVE_INSTANCE] OpenCSVParser:62 - setting escapeChar : \ > 27 Feb 2018 20:13:15,928 INFO [ambari-client-thread-38] [HIVE 1.5.0 > AUTO_HIVE_INSTANCE] Parser:75 - generating preview for : > ParseOptions{options={OPTIONS_CSV_QUOTE=", OPTIONS_CSV_DELIMITER= , > HEADER=FIRST_RECORD, FILE_TYPE=CSV, OPTIONS_CSV_ESCAPE_CHAR=\}} > 27 Feb 2018 20:13:15,929 DEB
[jira] [Commented] (AMBARI-23179) Hive view 2.0 does not parse the TAB delimited CSV files while using 'Upload Table'
[ https://issues.apache.org/jira/browse/AMBARI-23179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396560#comment-16396560 ] Hudson commented on AMBARI-23179: - FAILURE: Integrated in Jenkins build Ambari-branch-2.6 #654 (See [https://builds.apache.org/job/Ambari-branch-2.6/654/]) AMBARI-23179 : Hive view 2.0 does not parse the TAB delimited CSV files (github: [https://gitbox.apache.org/repos/asf?p=ambari.git&a=commit&h=200a9868c859d2be72d0729517bf6693a52b0aa5]) * (edit) contrib/views/hive20/src/main/resources/ui/app/routes/databases/database/tables/upload-table.js > Hive view 2.0 does not parse the TAB delimited CSV files while using 'Upload > Table' > --- > > Key: AMBARI-23179 > URL: https://issues.apache.org/jira/browse/AMBARI-23179 > Project: Ambari > Issue Type: Bug > Components: ambari-views >Affects Versions: 2.6.0 > Environment: HDP 2.6.3 > Ambari 2.6.0 >Reporter: Sindhu Subhas >Assignee: Nitiraj Singh Rathore >Priority: Major > Labels: pull-request-available > Attachments: Screen Shot 2018-02-28 at 1.02.44 AM.png, Screen Shot > 2018-02-28 at 5.05.55 PM.png, Screen Shot 2018-02-28 at 5.06.47 PM.png, > Screen Shot 2018-02-28 at 5.07.30 PM.png, datatab.tsv > > Time Spent: 1h > Remaining Estimate: 0h > > Problem: > When trying to Upload table from Hive view 2.0 from a TAB delimited file, the > data is not parsed as expected. > Same feature works as expected in Hive view 1.5.0. > Attached output from Hive view 2.0 and output from Hive view 1.5.0. > From the code, we do see difference in the code for > src/main/java/org/apache/ambari/view/hive20/resources/uploads/UploadService.java. > Debug from Hive view 2.0: > {code:java} > 27 Feb 2018 20:27:28,169 DEBUG > [HiveViewActorSystem-akka.actor.default-dispatcher-4] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] OperationController:53 - } java.util.HashMap > 27 Feb 2018 20:27:28,169 DEBUG > [HiveViewActorSystem-akka.actor.default-dispatcher-4] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] HiveActor:41 - Message submitted: > 927343c0-5ed6-435c-be60-37448ac1a8b0 > 27 Feb 2018 20:27:30,925 INFO [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] UploadService:484 - isFirstRowHeader : false, > inputFileType : CSV > 27 Feb 2018 20:27:30,934 INFO [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] OpenCSVParser:50 - setting delimiter as T > 27 Feb 2018 20:27:30,934 INFO [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] OpenCSVParser:56 - setting Quote char : " > 27 Feb 2018 20:27:30,934 INFO [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] OpenCSVParser:62 - setting escapeChar : \ > 27 Feb 2018 20:27:30,939 INFO [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] Parser:75 - generating preview for : > ParseOptions{options={OPTIONS_CSV_QUOTE=", OPTIONS_CSV_DELIMITER=T, > HEADER=NONE, FILE_TYPE=CSV, OPTIONS_CSV_ESCAPE_CHAR=\}} > 27 Feb 2018 20:27:30,939 DEBUG [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] Parser:83 - Illegal number of preview columns supplied > null > 27 Feb 2018 20:27:30,943 DEBUG [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] ParseUtils:152 - error while parsing as timestamp > string column1 column2 column3 > java.lang.IllegalArgumentException: Timestamp format must be -mm-dd > hh:mm:ss[.f] > at java.sql.Timestamp.valueOf(Timestamp.java:204) > . > 27 Feb 2018 20:27:30,948 INFO [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] Parser:149 - datatype detected for column 0 : STRING > 27 Feb 2018 20:27:30,949 DEBUG [ambari-client-thread-38] [HIVE 2.0.0 > AUTO_HIVE20_INSTANCE] Parser:159 - return headers : > [ColumnInfo{name='column1', type='STRING', precision=null, scale=null, > comment='null'}] > {code} > Debug from Hive view 1.5.0: > {code:java} > 27 Feb 2018 20:13:15,881 INFO [ambari-client-thread-38] [HIVE 1.5.0 > AUTO_HIVE_INSTANCE] UploadService:499 - isFirstRowHeader : true, > inputFileType : CSV > 27 Feb 2018 20:13:15,918 INFO [ambari-client-thread-38] [HIVE 1.5.0 > AUTO_HIVE_INSTANCE] OpenCSVParser:50 - setting delimiter as > 27 Feb 2018 20:13:15,919 INFO [ambari-client-thread-38] [HIVE 1.5.0 > AUTO_HIVE_INSTANCE] OpenCSVParser:56 - setting Quote char : " > 27 Feb 2018 20:13:15,919 INFO [ambari-client-thread-38] [HIVE 1.5.0 > AUTO_HIVE_INSTANCE] OpenCSVParser:62 - setting escapeChar : \ > 27 Feb 2018 20:13:15,928 INFO [ambari-client-thread-38] [HIVE 1.5.0 > AUTO_HIVE_INSTANCE] Parser:75 - generating preview for : > ParseOptions{options={OPTIONS_CSV_QUOTE=", OPTIONS_CSV_DELIMITER= , > HEADER=FIRST_RECORD, FILE_TYPE=CSV, OPTIONS_CSV_ESCAPE_CHAR=\}} > 27 Feb 2018 20:13:15,929 DEBUG [am