[jira] [Commented] (SPARK-6628) ClassCastException occurs when executing sql statement "insert into" on hbase table

2016-06-13 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327201#comment-15327201 ] Teng Qiu commented on SPARK-6628: - this is caused by missing interface implementation in

[jira] [Commented] (SPARK-13983) HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session)

2016-05-26 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302429#comment-15302429 ] Teng Qiu commented on SPARK-13983: -- Hi, we tried put spark.sql.hive.thriftServer.singleSession in spark

[jira] [Commented] (SPARK-13768) Set hive conf failed use --hiveconf when beeline connect to thriftserver

2016-04-25 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15256142#comment-15256142 ] Teng Qiu commented on SPARK-13768: -- perhaps it is a beeline issue, we used the beeline from official

[jira] [Commented] (SPARK-13983) HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session)

2016-04-25 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15256139#comment-15256139 ] Teng Qiu commented on SPARK-13983: -- Any update would be much appreciated... we are still using 1.5.2 due

[jira] [Updated] (SPARK-13983) HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session)

2016-03-19 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-13983: - Description: HiveThriftServer2 should be able to get "\--hiveconf" or ''\-\-hivevar" variables from

[jira] [Commented] (SPARK-13983) HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session)

2016-03-19 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200661#comment-15200661 ] Teng Qiu commented on SPARK-13983: -- now i can confirm that this issue was caused by PR

[jira] [Created] (SPARK-13983) HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session)

2016-03-19 Thread Teng Qiu (JIRA)
Teng Qiu created SPARK-13983: Summary: HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session) Key: SPARK-13983 URL:

[jira] [Updated] (SPARK-13983) HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session)

2016-03-19 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-13983: - Environment: ubuntu, scala 2.10.5, hadoop 2.6 spark 1.6.0 standalone, spark 1.6.1 standalone (tried

[jira] [Updated] (SPARK-13983) HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session)

2016-03-19 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-13983: - Description: HiveThriftServer2 should be able to get "\--hiveconf" or ''\-\-hivevar" variables from

[jira] [Updated] (SPARK-13983) HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session)

2016-03-19 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-13983: - Environment: ubuntu, spark 1.6.0 standalone, spark 1.6.1 standalone (tried spark branch-1.6 snapshot as

[jira] [Comment Edited] (SPARK-13983) HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session)

2016-03-18 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200661#comment-15200661 ] Teng Qiu edited comment on SPARK-13983 at 3/17/16 11:58 PM: now i can confirm

[jira] [Commented] (SPARK-13983) HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session)

2016-03-18 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200366#comment-15200366 ] Teng Qiu commented on SPARK-13983: -- also tried start the server in single session mode:

[jira] [Commented] (SPARK-12014) Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100)

2016-03-18 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199752#comment-15199752 ] Teng Qiu commented on SPARK-12014: -- any update on this? > Spark SQL query containing semicolon is

[jira] [Commented] (SPARK-6628) ClassCastException occurs when executing sql statement "insert into" on hbase table

2016-02-26 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168828#comment-15168828 ] Teng Qiu commented on SPARK-6628: - Spark 1.6.0 has same problem, and for "insert into" accumulo table, the

[jira] [Updated] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-12053: - Affects Version/s: (was: 1.6.0) > EventLog for completed applications always not found if >

[jira] [Commented] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032235#comment-15032235 ] Teng Qiu commented on SPARK-12053: -- bug found: caused by

[jira] [Updated] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-12053: - Description: EventLog for completed applications always not found with following settings in

[jira] [Created] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Teng Qiu (JIRA)
Teng Qiu created SPARK-12053: Summary: EventLog for completed applications always not found if spark.eventLog.compress is true Key: SPARK-12053 URL: https://issues.apache.org/jira/browse/SPARK-12053

[jira] [Updated] (SPARK-12053) EventLog for completed applications always not found if spark.eventLog.compress is true

2015-11-30 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-12053: - Affects Version/s: 1.6.0 > EventLog for completed applications always not found if >

[jira] [Updated] (SPARK-12014) Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100)

2015-11-26 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-12014: - Description: Actually it is known hive issue: https://issues.apache.org/jira/browse/HIVE-11100 patch

[jira] [Created] (SPARK-12014) Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100)

2015-11-26 Thread Teng Qiu (JIRA)
Teng Qiu created SPARK-12014: Summary: Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100) Key: SPARK-12014 URL: https://issues.apache.org/jira/browse/SPARK-12014 Project:

[jira] [Updated] (SPARK-12014) Spark SQL query containing semicolon is broken in Beeline (related to HIVE-11100)

2015-11-26 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-12014: - Description: Actually it is known hive issue: https://issues.apache.org/jira/browse/HIVE-11100 patch

[jira] [Commented] (SPARK-3173) Timestamp support in the parser

2014-08-25 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108936#comment-14108936 ] Teng Qiu commented on SPARK-3173: - vote on this ticket, it seems should link to this PR

[jira] [Commented] (SPARK-3124) Jar version conflict in the assembly package

2014-08-23 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108184#comment-14108184 ] Teng Qiu commented on SPARK-3124: - Hi all, i got same error: {noformat} sbt/sbt

[jira] [Updated] (SPARK-3131) Allow user to set parquet compression codec for writing ParquetFile in SQLContext

2014-08-19 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-3131: Summary: Allow user to set parquet compression codec for writing ParquetFile in SQLContext (was: Allow

[jira] [Updated] (SPARK-3131) Allow user to set parquet compression codec for writing ParquetFile in SQLContext

2014-08-19 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-3131: Description: There are 4 different compression codec available for ParquetOutputFormat in Spark SQL it

[jira] [Created] (SPARK-3138) sqlContext.parquetFile should be able to take a single file as parameter

2014-08-19 Thread Teng Qiu (JIRA)
Teng Qiu created SPARK-3138: --- Summary: sqlContext.parquetFile should be able to take a single file as parameter Key: SPARK-3138 URL: https://issues.apache.org/jira/browse/SPARK-3138 Project: Spark

[jira] [Commented] (SPARK-3138) sqlContext.parquetFile should be able to take a single file as parameter

2014-08-19 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14102961#comment-14102961 ] Teng Qiu commented on SPARK-3138: - be careful if someone is working on SPARK-2551, make

[jira] [Commented] (SPARK-3138) sqlContext.parquetFile should be able to take a single file as parameter

2014-08-19 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14102979#comment-14102979 ] Teng Qiu commented on SPARK-3138: - after this PR, we can pass the full path of a parquet

[jira] [Commented] (SPARK-2927) Add a conf to configure if we always read Binary columns stored in Parquet as String columns

2014-08-15 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098573#comment-14098573 ] Teng Qiu commented on SPARK-2927: - SPARK-2699 could also be closed, these two ticket are

[jira] [Commented] (SPARK-2700) Hidden files (such as .impala_insert_staging) should be filtered out by sqlContext.parquetFile

2014-08-08 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091256#comment-14091256 ] Teng Qiu commented on SPARK-2700: - Hi [~srowen] and [~marmbrus] , what do you think about

[jira] [Commented] (SPARK-2700) Hidden files (such as .impala_insert_staging) should be filtered out by sqlContext.parquetFile

2014-08-08 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091268#comment-14091268 ] Teng Qiu commented on SPARK-2700: - Oh, great, thanks :) Hidden files (such as

[jira] [Updated] (SPARK-2729) Forgot to match Timestamp type in ColumnBuilder

2014-07-29 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-2729: Description: after SPARK-2710 we can create a table in Spark SQL with ColumnType Timestamp from jdbc.

[jira] [Created] (SPARK-2729) Forgot to match Timestamp type in ColumnBuilder

2014-07-29 Thread Teng Qiu (JIRA)
Teng Qiu created SPARK-2729: --- Summary: Forgot to match Timestamp type in ColumnBuilder Key: SPARK-2729 URL: https://issues.apache.org/jira/browse/SPARK-2729 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2576) slave node throws NoClassDefFoundError $line11.$read$ when executing a Spark QL query on HDFS CSV file

2014-07-28 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076086#comment-14076086 ] Teng Qiu commented on SPARK-2576: - i get same problem, 1.0.1, standalone cluster slave

[jira] [Commented] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard code case class)

2014-07-27 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075799#comment-14075799 ] Teng Qiu commented on SPARK-2710: - a problem is, there is nothing to push down... have no

[jira] [Updated] (SPARK-2710) Build SchemaRDD from a JdbcRDD with MetaData (no hard code case class)

2014-07-27 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-2710: Description: Spark SQL can take Parquet files or JSON files as a table directly (without given a case

[jira] [Created] (SPARK-2700) Hidden files (such as .impala_insert_staging) should be filtered out by sqlContext.parquetFile

2014-07-25 Thread Teng Qiu (JIRA)
Teng Qiu created SPARK-2700: --- Summary: Hidden files (such as .impala_insert_staging) should be filtered out by sqlContext.parquetFile Key: SPARK-2700 URL: https://issues.apache.org/jira/browse/SPARK-2700

[jira] [Commented] (SPARK-2446) Add BinaryType support to Parquet I/O.

2014-07-25 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075232#comment-14075232 ] Teng Qiu commented on SPARK-2446: - Hi, thanks for the advice, i created a ticket for this:

[jira] [Updated] (SPARK-2700) Hidden files (such as .impala_insert_staging) should be filtered out by sqlContext.parquetFile

2014-07-25 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Teng Qiu updated SPARK-2700: Description: when creating a table in impala, a hidden folder .impala_insert_staging will be created in

[jira] [Commented] (SPARK-2699) Improve compatibility with parquet file/table

2014-07-25 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075256#comment-14075256 ] Teng Qiu commented on SPARK-2699: - added a config property: parquet.binarytype, default is

[jira] [Comment Edited] (SPARK-2699) Improve compatibility with parquet file/table

2014-07-25 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075256#comment-14075256 ] Teng Qiu edited comment on SPARK-2699 at 7/26/14 4:15 AM: -- added

[jira] [Comment Edited] (SPARK-2699) Improve compatibility with parquet file/table

2014-07-25 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075256#comment-14075256 ] Teng Qiu edited comment on SPARK-2699 at 7/26/14 4:17 AM: -- PR:

[jira] [Commented] (SPARK-2446) Add BinaryType support to Parquet I/O.

2014-07-22 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070310#comment-14070310 ] Teng Qiu commented on SPARK-2446: - hi [~marmbrus] impala creating parquet file also

[jira] [Comment Edited] (SPARK-2446) Add BinaryType support to Parquet I/O.

2014-07-22 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070310#comment-14070310 ] Teng Qiu edited comment on SPARK-2446 at 7/22/14 2:47 PM: -- hi

[jira] [Commented] (SPARK-2443) Reading from Partitioned Tables is Slow

2014-07-16 Thread Teng Qiu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063455#comment-14063455 ] Teng Qiu commented on SPARK-2443: - Hi, how can you access parquet table using HiveContext