[jira] [Commented] (SPARK-20004) Spark thrift server ovewrites spark.app.name

2017-03-19 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931800#comment-15931800 ] Egor Pahomov commented on SPARK-20004: -- [~srowen], 1.6 and 2.0 allowed to specify app.name. I have

[jira] [Updated] (SPARK-20005) There is no "Newline" in UI in describtion

2017-03-17 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pahomov updated SPARK-20005: - Description: There is no "newline" in UI in describtion: https://ibb.co/bLp2yv (was: Just see

[jira] [Created] (SPARK-20005) There is no "Newline" in UI in describtion

2017-03-17 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-20005: Summary: There is no "Newline" in UI in describtion Key: SPARK-20005 URL: https://issues.apache.org/jira/browse/SPARK-20005 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-20004) Spark thrift server ovewrites spark.app.name

2017-03-17 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pahomov updated SPARK-20004: - Summary: Spark thrift server ovewrites spark.app.name (was: Spark thrift server ovverides

[jira] [Created] (SPARK-20004) Spark thrift server ovverides spark.app.name

2017-03-17 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-20004: Summary: Spark thrift server ovverides spark.app.name Key: SPARK-20004 URL: https://issues.apache.org/jira/browse/SPARK-20004 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-10 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861869#comment-15861869 ] Egor Pahomov commented on SPARK-19524: -- [~sowen], probably yes. I don't know. "Should process only

[jira] [Commented] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-10 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861600#comment-15861600 ] Egor Pahomov commented on SPARK-19524: -- [~sowen], Folder, which connect my streaming to: {code}

[jira] [Commented] (SPARK-19523) Spark streaming+ insert into table leaves bunch of trash in table directory

2017-02-09 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15860025#comment-15860025 ] Egor Pahomov commented on SPARK-19523: -- Probably my bad. I have {code} rdd.sparkContext {code}

[jira] [Commented] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-09 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15860023#comment-15860023 ] Egor Pahomov commented on SPARK-19524: -- I'm really confused. I expected "new" to be the files

[jira] [Comment Edited] (SPARK-19523) Spark streaming+ insert into table leaves bunch of trash in table directory

2017-02-08 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858913#comment-15858913 ] Egor Pahomov edited comment on SPARK-19523 at 2/9/17 2:52 AM: -- @zsxwing, I

[jira] [Commented] (SPARK-19523) Spark streaming+ insert into table leaves bunch of trash in table directory

2017-02-08 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858913#comment-15858913 ] Egor Pahomov commented on SPARK-19523: -- @zsxwing, I haven't found the way to that. inside foreachRDD

[jira] [Commented] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-08 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858912#comment-15858912 ] Egor Pahomov commented on SPARK-19524: -- [~uncleGen], sorry, I haven't understood. > newFilesOnly

[jira] [Commented] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-08 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858910#comment-15858910 ] Egor Pahomov commented on SPARK-19524: -- [~srowen], based on documentation, which says "newFilesOnly

[jira] [Created] (SPARK-19524) newFilesOnly does not work according to docs.

2017-02-08 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-19524: Summary: newFilesOnly does not work according to docs. Key: SPARK-19524 URL: https://issues.apache.org/jira/browse/SPARK-19524 Project: Spark Issue Type:

[jira] [Created] (SPARK-19523) Spark streaming+ insert into table leaves bunch of trash in table directory

2017-02-08 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-19523: Summary: Spark streaming+ insert into table leaves bunch of trash in table directory Key: SPARK-19523 URL: https://issues.apache.org/jira/browse/SPARK-19523 Project:

[jira] [Commented] (SPARK-18930) Inserting in partitioned table - partitioned field should be last in select statement.

2016-12-29 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786368#comment-15786368 ] Egor Pahomov commented on SPARK-18930: -- I'm not sure, that such restriction buried in documentation

[jira] [Created] (SPARK-18931) Create empty staging directory in partitioned table on insert

2016-12-19 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-18931: Summary: Create empty staging directory in partitioned table on insert Key: SPARK-18931 URL: https://issues.apache.org/jira/browse/SPARK-18931 Project: Spark

[jira] [Created] (SPARK-18930) Inserting in partitioned table - partitioned field should be last in select statement.

2016-12-19 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-18930: Summary: Inserting in partitioned table - partitioned field should be last in select statement. Key: SPARK-18930 URL: https://issues.apache.org/jira/browse/SPARK-18930

[jira] [Closed] (SPARK-18336) SQL started to fail with OOM and etc. after move from 1.6.2 to 2.0.2

2016-11-09 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pahomov closed SPARK-18336. Resolution: Invalid Moving from 1.6 to 2.0 forced me use spark-submit instead of using spark

[jira] [Commented] (SPARK-18336) SQL started to fail with OOM and etc. after move from 1.6.2 to 2.0.2

2016-11-08 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15648912#comment-15648912 ] Egor Pahomov commented on SPARK-18336: -- [~srowen], I've read everything in documentation about new

[jira] [Created] (SPARK-18336) SQL started to fail with OOM and etc. after move from 1.6.2 to 2.0.2

2016-11-07 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-18336: Summary: SQL started to fail with OOM and etc. after move from 1.6.2 to 2.0.2 Key: SPARK-18336 URL: https://issues.apache.org/jira/browse/SPARK-18336 Project: Spark

[jira] [Created] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

2016-09-20 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-17616: Summary: Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate " Key: SPARK-17616 URL: https://issues.apache.org/jira/browse/SPARK-17616

[jira] [Created] (SPARK-17615) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

2016-09-20 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-17615: Summary: Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate " Key: SPARK-17615 URL: https://issues.apache.org/jira/browse/SPARK-17615

[jira] [Created] (SPARK-17557) SQL query on parquet table java.lang.UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary

2016-09-15 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-17557: Summary: SQL query on parquet table java.lang.UnsupportedOperationException: org.apache.parquet.column.values.dictionary.PlainValuesDictionary Key: SPARK-17557 URL:

[jira] [Created] (SPARK-17364) Can not query hive table starting with number

2016-09-01 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-17364: Summary: Can not query hive table starting with number Key: SPARK-17364 URL: https://issues.apache.org/jira/browse/SPARK-17364 Project: Spark Issue Type:

[jira] [Commented] (SPARK-16334) [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException

2016-08-22 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432040#comment-15432040 ] Egor Pahomov commented on SPARK-16334: -- (just reason for reopen) > [SQL] SQL query on parquet table

[jira] [Reopened] (SPARK-16334) [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException

2016-08-22 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pahomov reopened SPARK-16334: -- Seems like a lot of people still have a problem even after suggested fix > [SQL] SQL query on

[jira] [Commented] (SPARK-16334) [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException

2016-07-19 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15384736#comment-15384736 ] Egor Pahomov commented on SPARK-16334: -- [~sameerag] that particular case on which I experienced the

[jira] [Commented] (SPARK-16334) [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException

2016-07-15 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380249#comment-15380249 ] Egor Pahomov commented on SPARK-16334: -- Sure, would test on Monday. > [SQL] SQL query on parquet

[jira] [Commented] (SPARK-16548) java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data

2016-07-14 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378112#comment-15378112 ] Egor Pahomov commented on SPARK-16548: -- [~sowen] if your concern is "silently" we can wright errors

[jira] [Created] (SPARK-16548) java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data

2016-07-14 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-16548: Summary: java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data Key: SPARK-16548 URL: https://issues.apache.org/jira/browse/SPARK-16548

[jira] [Created] (SPARK-16334) [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException

2016-06-30 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-16334: Summary: [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException Key: SPARK-16334 URL: https://issues.apache.org/jira/browse/SPARK-16334 Project:

[jira] [Updated] (SPARK-16334) [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException

2016-06-30 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pahomov updated SPARK-16334: - Labels: sql (was: ) > [SQL] SQL query on parquet table java.lang.ArrayIndexOutOfBoundsException

[jira] [Commented] (SPARK-16228) "Percentile" needs explicit cast to double

2016-06-27 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351697#comment-15351697 ] Egor Pahomov commented on SPARK-16228: -- [~srowen] "blocker" is questionable, I agree. I just

[jira] [Updated] (SPARK-16228) "Percentile" needs explicit cast to double

2016-06-27 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pahomov updated SPARK-16228: - Description: {quote} select percentile(cast(id as bigint), cast(0.5 as double)) from temp.bla

[jira] [Created] (SPARK-16228) "Percentile" needs explicit cast to double

2016-06-27 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-16228: Summary: "Percentile" needs explicit cast to double Key: SPARK-16228 URL: https://issues.apache.org/jira/browse/SPARK-16228 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15934) Return binary mode in ThriftServer

2016-06-13 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328814#comment-15328814 ] Egor Pahomov commented on SPARK-15934: -- Sure, let me create a pull request tomorrow. I would test,

[jira] [Created] (SPARK-15934) Return binary mode in ThriftServer

2016-06-13 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-15934: Summary: Return binary mode in ThriftServer Key: SPARK-15934 URL: https://issues.apache.org/jira/browse/SPARK-15934 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-15409) Can't run spark odbc server on yarn the way I did it on 1.6.1

2016-05-19 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pahomov closed SPARK-15409. Resolution: Invalid > Can't run spark odbc server on yarn the way I did it on 1.6.1 >

[jira] [Created] (SPARK-15409) Can't run spark odbc server on yarn the way I did it on 1.6.1

2016-05-19 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-15409: Summary: Can't run spark odbc server on yarn the way I did it on 1.6.1 Key: SPARK-15409 URL: https://issues.apache.org/jira/browse/SPARK-15409 Project: Spark

[jira] [Created] (SPARK-13654) get_json_object fails with java.io.CharConversionException

2016-03-03 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-13654: Summary: get_json_object fails with java.io.CharConversionException Key: SPARK-13654 URL: https://issues.apache.org/jira/browse/SPARK-13654 Project: Spark

[jira] [Closed] (SPARK-4403) Elastic allocation(spark.dynamicAllocation.enabled) results in task never being execued.

2014-11-15 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pahomov closed SPARK-4403. --- Resolution: Invalid Elastic allocation(spark.dynamicAllocation.enabled) results in task never

[jira] [Updated] (SPARK-4403) Elastic allocation(spark.dynamicAllocation.enabled) results in task never being execued.

2014-11-14 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Egor Pahomov updated SPARK-4403: Attachment: ipython_out Elastic allocation(spark.dynamicAllocation.enabled) results in task never

[jira] [Commented] (SPARK-2157) Can't write tight firewall rules for Spark

2014-06-18 Thread Egor Pahomov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14035554#comment-14035554 ] Egor Pahomov commented on SPARK-2157: - Yep, I used patched version of spark. Can't