[jira] [Assigned] (SPARK-17406) Event Timeline will be very slow when there are too many executor events

[ https://issues.apache.org/jira/browse/SPARK-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17406: Assignee: Apache Spark > Event Timeline will be very slow when there are too many

[jira] [Commented] (SPARK-17406) Event Timeline will be very slow when there are too many executor events

[ https://issues.apache.org/jira/browse/SPARK-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466459#comment-15466459 ] Apache Spark commented on SPARK-17406: -- User 'cenyuhai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17406) Event Timeline will be very slow when there are too many executor events

[ https://issues.apache.org/jira/browse/SPARK-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17406: Assignee: (was: Apache Spark) > Event Timeline will be very slow when there are too

[jira] [Updated] (SPARK-17406) Event Timeline will be very slow when there are too many executor events

[ https://issues.apache.org/jira/browse/SPARK-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-17406: -- Summary: Event Timeline will be very slow when there are too many executor events (was: Event

[jira] [Updated] (SPARK-17406) Event Timeline will be very slow when there are very executor events

[ https://issues.apache.org/jira/browse/SPARK-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-17406: -- Description: The job page will be too slow to open when there are thousands of executor events(added

[jira] [Assigned] (SPARK-17369) MetastoreRelation toJSON throws exception

[ https://issues.apache.org/jira/browse/SPARK-17369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17369: Assignee: Sean Zhong (was: Apache Spark) > MetastoreRelation toJSON throws exception >

[jira] [Commented] (SPARK-17369) MetastoreRelation toJSON throws exception

[ https://issues.apache.org/jira/browse/SPARK-17369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466429#comment-15466429 ] Apache Spark commented on SPARK-17369: -- User 'clockfly' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17369) MetastoreRelation toJSON throws exception

[ https://issues.apache.org/jira/browse/SPARK-17369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17369: Assignee: Apache Spark (was: Sean Zhong) > MetastoreRelation toJSON throws exception >

[jira] [Commented] (SPARK-17409) Query in CTAS is Optimized Twice

[ https://issues.apache.org/jira/browse/SPARK-17409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466397#comment-15466397 ] Xiao Li commented on SPARK-17409: - Working on it. Thanks! > Query in CTAS is Optimized Twice >

[jira] [Created] (SPARK-17409) Query in CTAS is Optimized Twice

Xiao Li created SPARK-17409: --- Summary: Query in CTAS is Optimized Twice Key: SPARK-17409 URL: https://issues.apache.org/jira/browse/SPARK-17409 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-17072) generate table level stats:stats generation/storing/loading

[ https://issues.apache.org/jira/browse/SPARK-17072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17072: - Assignee: Zhenhua Wang > generate table level stats:stats generation/storing/loading >

[jira] [Commented] (SPARK-17408) Flaky test: org.apache.spark.sql.hive.StatisticsSuite

[ https://issues.apache.org/jira/browse/SPARK-17408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466358#comment-15466358 ] Yin Huai commented on SPARK-17408: -- cc [~cloud_fan] [~ZenWzh] > Flaky test:

[jira] [Created] (SPARK-17408) Flaky test: org.apache.spark.sql.hive.StatisticsSuite

Yin Huai created SPARK-17408: Summary: Flaky test: org.apache.spark.sql.hive.StatisticsSuite Key: SPARK-17408 URL: https://issues.apache.org/jira/browse/SPARK-17408 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17369) MetastoreRelation toJSON throws exception

[ https://issues.apache.org/jira/browse/SPARK-17369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466350#comment-15466350 ] Yin Huai commented on SPARK-17369: -- Let'e create a patch for branch 2.0. I have reverted the current one

[jira] [Updated] (SPARK-17369) MetastoreRelation toJSON throws exception

[ https://issues.apache.org/jira/browse/SPARK-17369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17369: - Fix Version/s: (was: 2.0.1) > MetastoreRelation toJSON throws exception >

[jira] [Reopened] (SPARK-17369) MetastoreRelation toJSON throws exception

[ https://issues.apache.org/jira/browse/SPARK-17369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reopened SPARK-17369: -- > MetastoreRelation toJSON throws exception > - > >

[jira] [Resolved] (SPARK-17358) Cached table(parquet/orc) should be shard between beelines

[ https://issues.apache.org/jira/browse/SPARK-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17358. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull

[jira] [Created] (SPARK-17407) Unable to update structured stream from CSV

Chris Parmer created SPARK-17407: Summary: Unable to update structured stream from CSV Key: SPARK-17407 URL: https://issues.apache.org/jira/browse/SPARK-17407 Project: Spark Issue Type:

[jira] [Updated] (SPARK-17358) Cached table(parquet/orc) should be shard between beelines

[ https://issues.apache.org/jira/browse/SPARK-17358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17358: Assignee: Yadong Qi > Cached table(parquet/orc) should be shard between beelines >

[jira] [Updated] (SPARK-17369) MetastoreRelation toJSON throws exception

[ https://issues.apache.org/jira/browse/SPARK-17369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17369: Fix Version/s: 2.0.1 > MetastoreRelation toJSON throws exception >

[jira] [Updated] (SPARK-17369) MetastoreRelation toJSON throws exception

[ https://issues.apache.org/jira/browse/SPARK-17369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17369: Assignee: Sean Zhong > MetastoreRelation toJSON throws exception >

[jira] [Updated] (SPARK-17406) Event Timeline will be very slow when there are very executor events

[ https://issues.apache.org/jira/browse/SPARK-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-17406: -- Description: The job page will be too slow to open when there are very executor events(added or

[jira] [Resolved] (SPARK-17369) MetastoreRelation toJSON throws exception

[ https://issues.apache.org/jira/browse/SPARK-17369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17369. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14928

[jira] [Updated] (SPARK-17406) Event Timeline will be very slow when there are very executor events

[ https://issues.apache.org/jira/browse/SPARK-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-17406: -- Attachment: timeline2.png > Event Timeline will be very slow when there are very executor events >

[jira] [Updated] (SPARK-17406) Event Timeline will be very slow when there are very executor events

[ https://issues.apache.org/jira/browse/SPARK-17406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cen yuhai updated SPARK-17406: -- Attachment: timeline1.png > Event Timeline will be very slow when there are very executor events >

[jira] [Updated] (SPARK-16943) CREATE TABLE LIKE generates a non-empty table when source is a data source table

[ https://issues.apache.org/jira/browse/SPARK-16943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16943: Fix Version/s: 2.0.1 > CREATE TABLE LIKE generates a non-empty table when source is a data source

[jira] [Updated] (SPARK-16942) CREATE TABLE LIKE generates External table when source table is an External Hive Serde table

[ https://issues.apache.org/jira/browse/SPARK-16942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-16942: Fix Version/s: 2.0.1 > CREATE TABLE LIKE generates External table when source table is an External

[jira] [Updated] (SPARK-17353) CREATE TABLE LIKE statements when Source is a VIEW

[ https://issues.apache.org/jira/browse/SPARK-17353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17353: Fix Version/s: 2.0.1 > CREATE TABLE LIKE statements when Source is a VIEW >

[jira] [Created] (SPARK-17406) Event Timeline will be very slow when there are very executor events

cen yuhai created SPARK-17406: - Summary: Event Timeline will be very slow when there are very executor events Key: SPARK-17406 URL: https://issues.apache.org/jira/browse/SPARK-17406 Project: Spark

[jira] [Resolved] (SPARK-17279) better error message for exceptions during ScalaUDF execution

[ https://issues.apache.org/jira/browse/SPARK-17279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17279. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14850

[jira] [Comment Edited] (SPARK-17397) what to do when awaitTermination() throws?

[ https://issues.apache.org/jira/browse/SPARK-17397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466183#comment-15466183 ] Spiro Michaylov edited comment on SPARK-17397 at 9/6/16 2:24 AM: -

[jira] [Commented] (SPARK-17397) what to do when awaitTermination() throws?

[ https://issues.apache.org/jira/browse/SPARK-17397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466183#comment-15466183 ] Spiro Michaylov commented on SPARK-17397: - Apologies: I was originally going to file it as a doc

[jira] [Commented] (SPARK-17396) Threads number keep increasing when query on external CSV partitioned table

[ https://issues.apache.org/jira/browse/SPARK-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466180#comment-15466180 ] pin_zhang commented on SPARK-17396: --- "Thread-1902" daemon prio=6 tid=0x14078800 nid=0x3a6c

[jira] [Commented] (SPARK-17404) [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R

[ https://issues.apache.org/jira/browse/SPARK-17404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466154#comment-15466154 ] Yin Huai commented on SPARK-17404: -- Thanks! > [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R >

[jira] [Closed] (SPARK-4957) TaskScheduler: when no resources are available: backoff after # of tries and crash.

[ https://issues.apache.org/jira/browse/SPARK-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout closed SPARK-4957. - Resolution: Won't Fix Closing this as won't fix since it's been open (with no activity) for a

[jira] [Resolved] (SPARK-17404) [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R

[ https://issues.apache.org/jira/browse/SPARK-17404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-17404. --- Resolution: Fixed Assignee: Sun Rui Fix Version/s: 1.6.3

[jira] [Commented] (SPARK-17072) generate table level stats:stats generation/storing/loading

[ https://issues.apache.org/jira/browse/SPARK-17072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466082#comment-15466082 ] Zhenhua Wang commented on SPARK-17072: -- My JIRA account name is ZenWzh, thanks! > generate table

[jira] [Created] (SPARK-17405) Simple aggregation query OOMing after SPARK-16525

Josh Rosen created SPARK-17405: -- Summary: Simple aggregation query OOMing after SPARK-16525 Key: SPARK-17405 URL: https://issues.apache.org/jira/browse/SPARK-17405 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-17404) [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R

[ https://issues.apache.org/jira/browse/SPARK-17404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-17404: -- Comment: was deleted (was: I've kicked off

[jira] [Commented] (SPARK-17404) [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R

[ https://issues.apache.org/jira/browse/SPARK-17404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465927#comment-15465927 ] Shivaram Venkataraman commented on SPARK-17404: --- I've kicked off

[jira] [Commented] (SPARK-17404) [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R

[ https://issues.apache.org/jira/browse/SPARK-17404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465929#comment-15465929 ] Shivaram Venkataraman commented on SPARK-17404: --- I've kicked off

[jira] [Commented] (SPARK-17404) [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R

[ https://issues.apache.org/jira/browse/SPARK-17404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465915#comment-15465915 ] Shivaram Venkataraman commented on SPARK-17404: --- Hmm - we upgraded the version of testthat

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465845#comment-15465845 ] Frank Dai commented on SPARK-17400: --- Currently I'm haunted by this issue in production, I have 6

[jira] [Comment Edited] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465845#comment-15465845 ] Frank Dai edited comment on SPARK-17400 at 9/5/16 9:52 PM: --- Currently I'm

[jira] [Updated] (SPARK-14649) DagScheduler re-starts all running tasks on fetch failure

[ https://issues.apache.org/jira/browse/SPARK-14649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-14649: --- Description: When a fetch failure occurs, the DAGScheduler re-launches the previous stage

[jira] [Commented] (SPARK-17302) Cannot set non-Spark SQL session variables in hive-site.xml, spark-defaults.conf, or using --conf

[ https://issues.apache.org/jira/browse/SPARK-17302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465818#comment-15465818 ] Sean Zhong commented on SPARK-17302: [~rdblue] Can you write a reproducer code sample to describe

[jira] [Comment Edited] (SPARK-17403) Fatal Error: SIGSEGV on Jdbc joins

[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465808#comment-15465808 ] Herman van Hovell edited comment on SPARK-17403 at 9/5/16 9:24 PM: ---

[jira] [Commented] (SPARK-17403) Fatal Error: SIGSEGV on Jdbc joins

[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465808#comment-15465808 ] Herman van Hovell commented on SPARK-17403: --- Well then we sorta know where to look. > Fatal

[jira] [Commented] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465799#comment-15465799 ] Herman van Hovell commented on SPARK-17364: --- This should work. For instance this works:

[jira] [Commented] (SPARK-17404) [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R

[ https://issues.apache.org/jira/browse/SPARK-17404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465781#comment-15465781 ] Yin Huai commented on SPARK-17404: -- cc [~felixcheung] and [~shivaram] > [BRANCH-1.6] Broken test:

[jira] [Created] (SPARK-17404) [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R

Yin Huai created SPARK-17404: Summary: [BRANCH-1.6] Broken test: showDF in test_sparkSQL.R Key: SPARK-17404 URL: https://issues.apache.org/jira/browse/SPARK-17404 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465754#comment-15465754 ] Sean Zhong edited comment on SPARK-17364 at 9/5/16 8:47 PM: [~epahomov]

[jira] [Commented] (SPARK-17364) Can not query hive table starting with number

[ https://issues.apache.org/jira/browse/SPARK-17364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465754#comment-15465754 ] Sean Zhong commented on SPARK-17364: [~epahomov] Spark 2.0 rewrites the Sql parser with antlr. You

[jira] [Commented] (SPARK-17403) Fatal Error: SIGSEGV on Jdbc joins

[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465539#comment-15465539 ] Ruben Hernando commented on SPARK-17403: You're right. Removing cache() errors disappeared >

[jira] [Commented] (SPARK-17403) Fatal Error: SIGSEGV on Jdbc joins

[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465383#comment-15465383 ] Herman van Hovell commented on SPARK-17403: --- [~rhernando] Could you try this without caching,

[jira] [Commented] (SPARK-17396) Threads number keep increasing when query on external CSV partitioned table

[ https://issues.apache.org/jira/browse/SPARK-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465375#comment-15465375 ] Ryan Blue commented on SPARK-17396: --- I'm not sure that the ForkJoinPool is to blame. Each partition in

[jira] [Updated] (SPARK-17403) Fatal Error: SIGSEGV on Jdbc joins

[ https://issues.apache.org/jira/browse/SPARK-17403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-17403: -- Description: The process creates views from JDBC (SQL server) source and combines them

[jira] [Updated] (SPARK-17396) Threads number keep increasing when query on external CSV partitioned table

[ https://issues.apache.org/jira/browse/SPARK-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated SPARK-17396: -- Description: 1. Create a external partitioned table row format CSV 2. Add 16 partitions to the table

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465353#comment-15465353 ] Ruben Hernando commented on SPARK-15822: Created

[jira] [Created] (SPARK-17403) Fatal Error: SIGSEGV on Jdbc joins

Ruben Hernando created SPARK-17403: -- Summary: Fatal Error: SIGSEGV on Jdbc joins Key: SPARK-17403 URL: https://issues.apache.org/jira/browse/SPARK-17403 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465342#comment-15465342 ] Ruben Hernando commented on SPARK-15822: Thank you! I'll do it > segmentation violation in

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465338#comment-15465338 ] Herman van Hovell commented on SPARK-15822: --- Could you open a new ticket for this one? It is

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465335#comment-15465335 ] Herman van Hovell commented on SPARK-15822: --- Thanks! Do you also have this problem when you

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465316#comment-15465316 ] Ruben Hernando commented on SPARK-15822: {quote} == Parsed Logical Plan == 'Project [*] +-

[jira] [Commented] (SPARK-16992) Pep8 code style

[ https://issues.apache.org/jira/browse/SPARK-16992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465314#comment-15465314 ] Apache Spark commented on SPARK-16992: -- User 'Stibbons' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-17072) generate table level stats:stats generation/storing/loading

[ https://issues.apache.org/jira/browse/SPARK-17072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465257#comment-15465257 ] Herman van Hovell edited comment on SPARK-17072 at 9/5/16 3:36 PM: ---

[jira] [Resolved] (SPARK-17072) generate table level stats:stats generation/storing/loading

[ https://issues.apache.org/jira/browse/SPARK-17072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-17072. --- Resolution: Fixed Fix Version/s: 2.1.0 This is resolve by PR

[jira] [Commented] (SPARK-17154) Wrong result can be returned or AnalysisException can be thrown after self-join or similar operations

[ https://issues.apache.org/jira/browse/SPARK-17154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465226#comment-15465226 ] Wenchen Fan commented on SPARK-17154: - can you check if your design satisfies following requirements?

[jira] [Resolved] (SPARK-17399) Update specific data in mySql Table from Spark

[ https://issues.apache.org/jira/browse/SPARK-17399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17399. --- Resolution: Invalid Target Version/s: (was: 2.0.0) Please direction questions to the

[jira] [Updated] (SPARK-17401) Scala IDE not able to connect to Spark Master

[ https://issues.apache.org/jira/browse/SPARK-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17401: -- Target Version/s: (was: 2.0.0) Priority: Major (was: Blocker) See

[jira] [Assigned] (SPARK-17402) separate the management of temp views and metastore tables/views in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-17402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17402: Assignee: Wenchen Fan (was: Apache Spark) > separate the management of temp views and

[jira] [Assigned] (SPARK-17402) separate the management of temp views and metastore tables/views in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-17402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17402: Assignee: Apache Spark (was: Wenchen Fan) > separate the management of temp views and

[jira] [Commented] (SPARK-17402) separate the management of temp views and metastore tables/views in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-17402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465085#comment-15465085 ] Apache Spark commented on SPARK-17402: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-17402) separate the management of temp views and metastore tables/views in SessionCatalog

Wenchen Fan created SPARK-17402: --- Summary: separate the management of temp views and metastore tables/views in SessionCatalog Key: SPARK-17402 URL: https://issues.apache.org/jira/browse/SPARK-17402

[jira] [Updated] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17379: -- Assignee: Adam Roberts > Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible) >

[jira] [Assigned] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17379: Assignee: (was: Apache Spark) > Upgrade netty-all to 4.0.41.Final (4.1.5-Final not

[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464976#comment-15464976 ] Apache Spark commented on SPARK-17379: -- User 'a-roberts' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17379: Assignee: Apache Spark > Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible) >

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464962#comment-15464962 ] Herman van Hovell commented on SPARK-15822: --- Could you share the query plan? > segmentation

[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464925#comment-15464925 ] Adam Roberts commented on SPARK-17379: -- Thanks Artur, useful to know, no new tests fail with

[jira] [Updated] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Roberts updated SPARK-17379: - Affects Version/s: 1.6.2 Component/s: Build > Upgrade netty-all to 4.0.41.Final

[jira] [Updated] (SPARK-16213) Reduce runtime overhead of a program that creates an primitive array in DataFrame

[ https://issues.apache.org/jira/browse/SPARK-16213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-16213: - Affects Version/s: 2.0.0 > Reduce runtime overhead of a program that creates an

[jira] [Commented] (SPARK-17401) Scala IDE not able to connect to Spark Master

[ https://issues.apache.org/jira/browse/SPARK-17401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464899#comment-15464899 ] Sean Owen commented on SPARK-17401: --- 4040 is normally where the Spark UI binds, not master. I think you

[jira] [Created] (SPARK-17401) Scala IDE not able to connect to Spark Master

Sachin Gupta created SPARK-17401: Summary: Scala IDE not able to connect to Spark Master Key: SPARK-17401 URL: https://issues.apache.org/jira/browse/SPARK-17401 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruben Hernando updated SPARK-15822: --- Comment: was deleted (was: I'm doing joins between SQL views. Data source is JDBC to SQL

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464860#comment-15464860 ] Ruben Hernando commented on SPARK-15822: I'm doing joins between SQL views. Data source is JDBC

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464861#comment-15464861 ] Ruben Hernando commented on SPARK-15822: I'm doing joins between SQL views. Data source is JDBC

[jira] [Commented] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464815#comment-15464815 ] Apache Spark commented on SPARK-17339: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17339: Assignee: Apache Spark > Fix SparkR tests on Windows > --- > >

[jira] [Assigned] (SPARK-17339) Fix SparkR tests on Windows

[ https://issues.apache.org/jira/browse/SPARK-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17339: Assignee: (was: Apache Spark) > Fix SparkR tests on Windows >

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464808#comment-15464808 ] Herman van Hovell commented on SPARK-15822: --- [~rhernando] It should not be related to this one.

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464809#comment-15464809 ] Herman van Hovell commented on SPARK-15822: --- [~rhernando] It should not be related to this one.

[jira] [Issue Comment Deleted] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-15822: -- Comment: was deleted (was: [~rhernando] It should not be related to this one. Are you

[jira] [Commented] (SPARK-15822) segmentation violation in o.a.s.unsafe.types.UTF8String

[ https://issues.apache.org/jira/browse/SPARK-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464793#comment-15464793 ] Ruben Hernando commented on SPARK-15822: Encountered a similar error (using 2.0.0): {quote}#

[jira] [Commented] (SPARK-17381) Memory leak org.apache.spark.sql.execution.ui.SQLTaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-17381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464744#comment-15464744 ] Sean Owen commented on SPARK-17381: --- That's it then. It's 'normal' operation, but does mean you need

[jira] [Comment Edited] (SPARK-17381) Memory leak org.apache.spark.sql.execution.ui.SQLTaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-17381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464740#comment-15464740 ] Joao Duarte edited comment on SPARK-17381 at 9/5/16 11:00 AM: -- Thank you for

[jira] [Commented] (SPARK-17381) Memory leak org.apache.spark.sql.execution.ui.SQLTaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-17381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464740#comment-15464740 ] Joao Duarte commented on SPARK-17381: - Hi Sean, Thank you for your suggestion! Setting

[jira] [Updated] (SPARK-17381) Memory leak org.apache.spark.sql.execution.ui.SQLTaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-17381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Duarte updated SPARK-17381: Description: I am running a Spark Streaming application from a Kinesis stream. After some hours

[jira] [Commented] (SPARK-17396) Threads number keep increasing when query on external CSV partitioned table

[ https://issues.apache.org/jira/browse/SPARK-17396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464627#comment-15464627 ] Sean Owen commented on SPARK-17396: --- [~rdblue] what do you think of this -- I think there's a good

[jira] [Commented] (SPARK-17379) Upgrade netty-all to 4.0.41.Final (4.1.5-Final not compatible)

[ https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464604#comment-15464604 ] Artur Sukhenko commented on SPARK-17379: Tried to use spark with 4.1.5, after fixing deprecated

  1   2   >