[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-192: Issue Type: Bug (was: New Feature) Fix Version/s: 0.3.0 Affects Version/s: (was: 0.6.0) Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Reporter: Johan Oskarsson Assignee: Shyam Sundar Sarkar Fix For: 0.3.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-192: Fix Version/s: (was: 0.3.0) Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Reporter: Johan Oskarsson Assignee: Shyam Sundar Sarkar Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-192: Fix Version/s: (was: 0.5.0) Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: New Feature Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Assignee: Shyam Sundar Sarkar Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Oskarsson updated HIVE-192: - Fix Version/s: (was: 0.4.0) 0.5.0 Issue Type: New Feature (was: Bug) Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: New Feature Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Assignee: Shyam Sundar Sarkar Fix For: 0.5.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12709931#action_12709931 ] Ashish Thusoo commented on HIVE-192: I agree with this route. The string conversions to and from timestamp can all be done in the query layers itself. So I am +1 on this. Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Assignee: Shyam Sundar Sarkar Fix For: 0.4.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12708221#action_12708221 ] Shyam Sundar Sarkar commented on HIVE-192: -- Dear Ashish and others, After inspecting many different options for implementation, following implementation seems have the right direction:: (1) TIMESTAMP values cannot be earlier than 1970 UTC or later than '2038-01-09 03:14:07' UTC. This means that a date such as '1968-01-01', while legal as a DATETIME or DATE value, is not valid as a TIMESTAMP value and is converted to 0. (2) The display width is fixed at 19 characters, and the format is '-MM-DD HH:MM:SS'. TIMESTAMP values are converted from the current time zone to UTC for storage, and converted back from UTC to the current time zone for retrieval. By default, the current time zone for each connection is the server's time. (3) The implementation involves conversion of TIMESTAMP string into UTC which is a long integer number representing number of seconds from 1970 UTC before storing through SERDE2. Similarly, a long integer type representing number of seconds from 1970 UTC will be converted in TIMESTAMP string type after retrieval through SERDE2. (4) In this implementation SERDE2 or thrift software layer will not be touched at all. The metadata store will maintain the information about TIMESTAMP type only. Actual storage will keep long integer values. Please comment on this observation and suggest and corrections! Thanks, shyam_sar...@yahoo.com Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Assignee: Shyam Sundar Sarkar Fix For: 0.4.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12708221#action_12708221 ] Shyam Sundar Sarkar edited comment on HIVE-192 at 5/11/09 2:08 PM: --- Dear Ashish and others, After inspecting many different options for implementation, following implementation seems have the right direction:: (1) TIMESTAMP values cannot be earlier than 1970 UTC or later than '2038-01-09 03:14:07' UTC. This means that a date such as '1968-01-01', while legal as a DATETIME or DATE value, is not valid as a TIMESTAMP value and is converted to 0. (2) The display width is fixed at 19 characters, and the format is '-MM-DD HH:MM:SS'. TIMESTAMP values are converted from the current time zone to UTC for storage, and converted back from UTC to the current time zone for retrieval. By default, the current time zone for each connection is the server's time. (3) The implementation involves conversion of TIMESTAMP string into UTC which is a long integer number representing number of seconds from 1970 UTC before storing through SERDE2. Similarly, a long integer type representing number of seconds from 1970 UTC will be converted in TIMESTAMP string type after retrieval through SERDE2. (4) In this implementation SERDE2 or thrift software layer will not be touched at all. The metadata store will maintain the information about TIMESTAMP type only. Actual storage will keep long integer values. Please comment on this observation and suggest any corrections! Thanks, shyam_sar...@yahoo.com was (Author: ssarkar): Dear Ashish and others, After inspecting many different options for implementation, following implementation seems have the right direction:: (1) TIMESTAMP values cannot be earlier than 1970 UTC or later than '2038-01-09 03:14:07' UTC. This means that a date such as '1968-01-01', while legal as a DATETIME or DATE value, is not valid as a TIMESTAMP value and is converted to 0. (2) The display width is fixed at 19 characters, and the format is '-MM-DD HH:MM:SS'. TIMESTAMP values are converted from the current time zone to UTC for storage, and converted back from UTC to the current time zone for retrieval. By default, the current time zone for each connection is the server's time. (3) The implementation involves conversion of TIMESTAMP string into UTC which is a long integer number representing number of seconds from 1970 UTC before storing through SERDE2. Similarly, a long integer type representing number of seconds from 1970 UTC will be converted in TIMESTAMP string type after retrieval through SERDE2. (4) In this implementation SERDE2 or thrift software layer will not be touched at all. The metadata store will maintain the information about TIMESTAMP type only. Actual storage will keep long integer values. Please comment on this observation and suggest and corrections! Thanks, shyam_sar...@yahoo.com Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Assignee: Shyam Sundar Sarkar Fix For: 0.4.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202
[jira] Commented: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12702362#action_12702362 ] Shyam Sundar Sarkar commented on HIVE-192: -- Hello, I was debugging Hive SQL. I found that Hive talks to Thrift software layer. From the documentation it is clear that there is no TIMESTAMP type in thrift type system. I am curious if we need to add TIMESTAMP type to Thrift as a basic type. TIMESTAMP type is there in almost all software systems. If we do not add TIMESTAMP type to Thrift, should we map it to long Integer or a struct type? Any suggestions? Thankls, shyam_sar...@yahoo.com Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Fix For: 0.4.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12702381#action_12702381 ] Ashish Thusoo commented on HIVE-192: Hi Shyam, 1. About unit tests, you should not have to play with velocity at all to add a new test. You can just add a xyz.q file with the query in ql/test/queries/clientpositive directory and in ql/test/queries/clientnegative directory. And you can capture the test results by ant -lib testlibs clean-test test -Dtestcase=TestCliDriver -Dqfile=xyz.q -Doverwrite=true for positive tests and ant -lib testlibs clean-test test -Dtestcase=TestNegativeCliDriver -Dqfile=xyzneg.q -Doverwrite=true and then run these tests again after removing the -Doverwrite part and after checking the results in the associated .q.out file formed in ql/test/results... directory. Will add these instructions to the Developer Guide. 2. Native timestamp support in thrift would help a lot to be able to support timestamps with thrift base serdes. Note that with zheng's work on lazy serdes we would remove the dependency on thrift for serializing and deserializing data. So at this point we should just say that TIMESTAMPS are not supported with thrift serde. On the use of thrift on as a client server transport, there should not be any issue as any data passing that boundary is also serialized/deserialized using serdes. Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Fix For: 0.4.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo reassigned HIVE-192: -- Assignee: Shyam Sundar Sarkar Added Shyam as a contributor and assigned. Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Assignee: Shyam Sundar Sarkar Fix For: 0.4.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shyam Sundar Sarkar updated HIVE-192: - Comment: was deleted (was: Functional test for Timestamp.) Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Fix For: 0.4.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[
https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shyam Sundar Sarkar updated HIVE-192:
-
Comment: was deleted
(was: Can someone please help me to find out why I am getting exception in
setUp() method inside TestCliTimestampDriver.java file (attached) ?
I followed all lines and methods from existing CliDriver test class in Hive and
modified just to test TIMESTAMP sysntax in some queries.
I stepped through the setUp under debug mode and it gave error in QTestUtil at
the line :
private String tmpdir = System.getProperty(user.dir)+/../build/ql/tmp;
where user.dir was home dir of hive (not inside build dir).
If I run the general CliDriver tests and then try to run my test for TIMESTAMP,
above exception does not show up.
However, I am getting exception at the line :
testFiles = conf.get(test.data.files).replace('\\', '/').replace(c:, );
inside QTestUtil constructor.
My question :: Why am I getting setUp() exception when I do not need a data
file ?
Can someone suggest a specific step that I am missing ?
Thanks,
shyam_sar...@yahoo.com)
Cannot create table with timestamp type column
--
Key: HIVE-192
URL: https://issues.apache.org/jira/browse/HIVE-192
Project: Hadoop Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 0.2.0
Reporter: Johan Oskarsson
Fix For: 0.4.0
Attachments: create_2.q.txt, TIMESTAMP_specification.txt
create table something2 (test timestamp);
ERROR: DDL specifying type timestamp which has not been defined
java.lang.RuntimeException: specifying type timestamp which has not been
defined
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879)
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545)
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501)
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171)
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497)
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439)
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101)
at
org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97)
at
org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180)
at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shyam Sundar Sarkar updated HIVE-192: - Comment: was deleted (was: This is the diff file for showing the changes in the Hive.g grammar with new TimestampType added. Thanks, shyam_sar...@yahoo.com) Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Fix For: 0.4.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shyam Sundar Sarkar updated HIVE-192: - Comment: was deleted (was: I added functional test cases for TIMESTAMP. Can someone suggest more test cases? The Java code for test driver is attached :: (/hive/build/ql/test/src/org/apache/hadoop/hive/cli/TestCliTimestampDriver.java) Can someone please tell me how do I get results and logs for the following call :: qt = new QTestUtil(/home/ssarkar/hive/ql/src/test/results/clientpositive, /home/ssarkar/hive/build/ql/test/logs/clientpositive); I am getting Exception. At this point can I add any arbitrary results and log files? Thanks, shyam_sar...@yahoo.com ) Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Fix For: 0.4.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12699818#action_12699818 ] Shyam Sundar Sarkar commented on HIVE-192: -- I was following Hive Developer Guide and found that one important section is missing. Section on 3.4. Adding new unit tests has no instructions about how to add a new unit test. I had to go through trial and error methods (with velocity templates) to add a new unit test in the test suite. I request that someone from original test suite designer team should write few words for this imporatnt subsection. Regards, shyam_sar...@yahoo.com Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Fix For: 0.4.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12697986#action_12697986 ] Shyam Sundar Sarkar commented on HIVE-192: -- Can someone please help me to find out why I am getting exception in setUp() method inside TestCliTimestampDriver.java file (attached) ? I followed all lines and methods from existing CliDriver test class in Hive and modified just to test TIMESTAMP sysntax in some queries. I stepped through the setUp under debug mode and it gave error in QTestUtil at the line : private String tmpdir = System.getProperty(user.dir)+/../build/ql/tmp; where user.dir was home dir of hive (not inside build dir). Thanks, shyam_sar...@yahoo.com Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Fix For: 0.4.0 Attachments: create_2.q.txt, TestCliTimestampDriver.java.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (HIVE-192) Cannot create table with timestamp type column
[
https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12697986#action_12697986
]
Shyam Sundar Sarkar edited comment on HIVE-192 at 4/10/09 3:10 PM:
---
Can someone please help me to find out why I am getting exception in setUp()
method inside TestCliTimestampDriver.java file (attached) ?
I followed all lines and methods from existing CliDriver test class in Hive and
modified just to test TIMESTAMP sysntax in some queries.
I stepped through the setUp under debug mode and it gave error in QTestUtil at
the line :
private String tmpdir = System.getProperty(user.dir)+/../build/ql/tmp;
where user.dir was home dir of hive (not inside build dir).
If I run the general CliDriver tests and then try to run my test for TIMESTAMP,
above exception does not show up.
However, I am getting exception at the line :
testFiles = conf.get(test.data.files).replace('\\', '/').replace(c:, );
inside QTestUtil constructor.
My question :: Why am I getting setUp() exception when I do not need a data
file ?
Can someone suggest a specific step that I am missing ?
Thanks,
shyam_sar...@yahoo.com
was (Author: ssarkar):
Can someone please help me to find out why I am getting exception in
setUp() method inside TestCliTimestampDriver.java file (attached) ?
I followed all lines and methods from existing CliDriver test class in Hive and
modified just to test TIMESTAMP sysntax in some queries.
I stepped through the setUp under debug mode and it gave error in QTestUtil at
the line :
private String tmpdir = System.getProperty(user.dir)+/../build/ql/tmp;
where user.dir was home dir of hive (not inside build dir).
Thanks,
shyam_sar...@yahoo.com
Cannot create table with timestamp type column
--
Key: HIVE-192
URL: https://issues.apache.org/jira/browse/HIVE-192
Project: Hadoop Hive
Issue Type: Bug
Components: Query Processor
Affects Versions: 0.2.0
Reporter: Johan Oskarsson
Fix For: 0.4.0
Attachments: create_2.q.txt, TestCliTimestampDriver.java.txt,
TIMESTAMP_specification.txt
create table something2 (test timestamp);
ERROR: DDL specifying type timestamp which has not been defined
java.lang.RuntimeException: specifying type timestamp which has not been
defined
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879)
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545)
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501)
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171)
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497)
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439)
at
org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101)
at
org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97)
at
org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180)
at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141)
at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202)
at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641)
at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johan Oskarsson updated HIVE-192: - Priority: Major (was: Critical) Fix Version/s: (was: 0.2.0) 0.4.0 Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Fix For: 0.4.0 Attachments: create_2.q.txt, TestCliTimestampDriver.java.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12694850#action_12694850 ] Neil Conway commented on HIVE-192: -- I'd suggest also looking at the SQL spec for the timestamp type (and/or the implementation in PostgreSQL), assuming SQL compliance is something you guys care about. Why are you storing timestamps as strings, rather than as a numeric offset from some epoch time? Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Priority: Critical Fix For: 0.2.0 Attachments: create_2.q.txt, TestCliTimestampDriver.java.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shyam Sundar Sarkar updated HIVE-192: - Attachment: create_2.q.txt Functional test for Timestamp. Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Priority: Critical Fix For: 0.2.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12693565#action_12693565 ] Shyam Sundar Sarkar commented on HIVE-192: -- I added functional test cases for TIMESTAMP. Can someone suggest more test cases? The Java code for test driver is attached :: (/hive/build/ql/test/src/org/apache/hadoop/hive/cli/TestCliTimestampDriver.java) Can someone please tell me how do I get results and logs for the following call :: qt = new QTestUtil(/home/ssarkar/hive/ql/src/test/results/clientpositive, /home/ssarkar/hive/build/ql/test/logs/clientpositive); I am getting Exception. At this point can I add any arbitrary results and log files? Thanks, shyam_sar...@yahoo.com Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Priority: Critical Fix For: 0.2.0 Attachments: create_2.q.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shyam Sundar Sarkar updated HIVE-192: - Attachment: TestCliTimestampDriver.java.txt Test Driver for TIMESTAMP. Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Priority: Critical Fix For: 0.2.0 Attachments: create_2.q.txt, TestCliTimestampDriver.java.txt, TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12690135#action_12690135 ] Shyam Sundar Sarkar commented on HIVE-192: -- I do not have permission to work on this issue. Can someone explain why I have no permission on worklog? I am currently working on it. Also what is the timeline for 0.3.0 release in terms of weeks or months? Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Priority: Critical Fix For: 0.2.0 Attachments: TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-192: --- Priority: Critical (was: Blocker) Downgrading this to a critical as this is more of a feature and can go into the release after 0.3.0. Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Priority: Critical Fix For: 0.2.0 Attachments: TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shyam Sundar Sarkar updated HIVE-192: - Attachment: (was: Hive_diff) Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Priority: Blocker Fix For: 0.2.0 Attachments: TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shyam Sundar Sarkar updated HIVE-192: - Attachment: TIMESTAMP_specification.txt This is the design document for Hive TIMESTAMP implementation. We are going to implement most of the specifications from MySQL 6.0. Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Priority: Blocker Fix For: 0.2.0 Attachments: TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12680575#action_12680575 ] Namit Jain commented on HIVE-192: - For the first cut, we dont need so much flexibility. Let us only support one default format. We can have a to_timestamp() function which takes in the format, that function can be enhanced to support more formats on demand. Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Priority: Blocker Fix For: 0.2.0 Attachments: TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12680595#action_12680595 ] Shyam Sundar Sarkar commented on HIVE-192: -- Ok. After lot of inspection over the MySQL 6.0 spec and Hive grammar, I decided to implement TIMESTAMP as a primitive type which will be stored and retrived as a string of characters. Also we have to implement one UDF to retrieve TIMESTAMP in certain formats from stored data. We have to implement eventually something called TimeZone inside Hive server for storage and retrieval of UTC time. Right now we can use system time. Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Priority: Blocker Fix For: 0.2.0 Attachments: TIMESTAMP_specification.txt create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shyam Sundar Sarkar updated HIVE-192: - Attachment: Hive_diff This is the diff file for showing the changes in the Hive.g grammar with new TimestampType added. Thanks, shyam_sar...@yahoo.com Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Priority: Blocker Fix For: 0.2.0 Attachments: Hive_diff create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
TIMESTAMP type
Hello, I inspected the grammar Hive.g and decided to create a new type for TIMESTAMP. TIMESTAMP is not a primitive type or list type or map type. It is a timestamp type of the form TIMESTAMP(MMDDHHMMSS) which is different from other types. Please let me know if there is any other suggestions. Thanks, shyam_sar...@yahoo.com
Re: TIMESTAMP type
HI Shyam, Conforming to the standard (like the MySQL 6.0 TIMESTAMP specification) is definitely the ultimate goal we want to achieve. Go ahead with the design and let us know when you have something ready for review. My previous point was basically that it might be much easier to add support for TIMESTAMP using UDFs. Of course that is more like a short-term plan. In the longer term we definitely need something like what you suggested. Zheng On Sat, Mar 7, 2009 at 8:30 PM, Shyam Sarkar shyam_sar...@yahoo.com wrote: Hi Zheng, From my earlier discussion with the group I got the suggestion that we should implement MySQL 6.0 TIMESTAMP specifications:: http://dev.mysql.com/doc/refman/6.0/en/timestamp.html Please suggest if all the properties described for MySQL 6.0 can be done by UDF or not. Are you suggesting that UDF should be explicitely called all the time to decode TIMESTAMP string? This may require may different UDFs to be defined and called. Also this may be non-standard way to implement TIMESTAMP. Please suggest. Thanks, SHyam --- On Sat, 3/7/09, Zheng Shao zsh...@gmail.com wrote: From: Zheng Shao zsh...@gmail.com Subject: Re: TIMESTAMP type To: hive-dev@hadoop.apache.org, shyam_sar...@yahoo.com Date: Saturday, March 7, 2009, 4:29 PM The problem is that different people may have different formats to store TIMESTAMP. The easiest way to go is to declare the field as STRING, and then use UDF to manipulate the content. Zheng On Sat, Mar 7, 2009 at 6:08 AM, Shyam Sarkar shyam_sar...@yahoo.com wrote: Hello, I inspected the grammar Hive.g and decided to create a new type for TIMESTAMP. TIMESTAMP is not a primitive type or list type or map type. It is a timestamp type of the form TIMESTAMP(MMDDHHMMSS) which is different from other types. Please let me know if there is any other suggestions. Thanks, shyam_sar...@yahoo.com -- Yours, Zheng -- Yours, Zheng
[jira] Commented: (HIVE-192) Cannot create table with timestamp type column
[ https://issues.apache.org/jira/browse/HIVE-192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12659295#action_12659295 ] Ashish Thusoo commented on HIVE-192: yup. we actually have not added support for timestamp yet... Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Priority: Blocker Fix For: 0.2.0 create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (HIVE-192) Cannot create table with timestamp type column
Cannot create table with timestamp type column -- Key: HIVE-192 URL: https://issues.apache.org/jira/browse/HIVE-192 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Johan Oskarsson Priority: Blocker Fix For: 0.2.0 create table something2 (test timestamp); ERROR: DDL specifying type timestamp which has not been defined java.lang.RuntimeException: specifying type timestamp which has not been defined at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldType(thrift_grammar.java:1879) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Field(thrift_grammar.java:1545) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.FieldList(thrift_grammar.java:1501) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Struct(thrift_grammar.java:1171) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.TypeDefinition(thrift_grammar.java:497) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Definition(thrift_grammar.java:439) at org.apache.hadoop.hive.serde2.dynamic_type.thrift_grammar.Start(thrift_grammar.java:101) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:97) at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:180) at org.apache.hadoop.hive.ql.metadata.Table.initSerDe(Table.java:141) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:202) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:641) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:98) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:215) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:174) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:207) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:305) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
