[jira] [Comment Edited] (SPARK-3033) [Hive] java.math.BigDecimal cannot be cast to org.apache.hadoop.hive.common.type.HiveDecimal

[ https://issues.apache.org/jira/browse/SPARK-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106557#comment-14106557 ] pengyanhong edited comment on SPARK-3033 at 8/22/14 6:58 AM: -

[jira] [Comment Edited] (SPARK-3033) [Hive] java.math.BigDecimal cannot be cast to org.apache.hadoop.hive.common.type.HiveDecimal

[ https://issues.apache.org/jira/browse/SPARK-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106557#comment-14106557 ] pengyanhong edited comment on SPARK-3033 at 8/22/14 6:54 AM: -

[jira] [Commented] (SPARK-3033) [Hive] java.math.BigDecimal cannot be cast to org.apache.hadoop.hive.common.type.HiveDecimal

[ https://issues.apache.org/jira/browse/SPARK-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106557#comment-14106557 ] pengyanhong commented on SPARK-3033: I changed the file {quote} sql/hive/src/main/scal

[jira] [Commented] (SPARK-2871) Missing API in PySpark

[ https://issues.apache.org/jira/browse/SPARK-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106481#comment-14106481 ] Apache Spark commented on SPARK-2871: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-2871) Missing API in PySpark

[ https://issues.apache.org/jira/browse/SPARK-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106462#comment-14106462 ] Apache Spark commented on SPARK-2871: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-2871) Missing API in PySpark

[ https://issues.apache.org/jira/browse/SPARK-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106456#comment-14106456 ] Apache Spark commented on SPARK-2871: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-2871) Missing API in PySpark

[ https://issues.apache.org/jira/browse/SPARK-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106449#comment-14106449 ] Apache Spark commented on SPARK-2871: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-2871) Missing API in PySpark

[ https://issues.apache.org/jira/browse/SPARK-2871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106446#comment-14106446 ] Apache Spark commented on SPARK-2871: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-3175) Branch-1.1 SBT build failed for Yarn-Alpha

[ https://issues.apache.org/jira/browse/SPARK-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106393#comment-14106393 ] Apache Spark commented on SPARK-3175: - User 'chesterxgchen' has created a pull request

[jira] [Commented] (SPARK-2360) CSV import to SchemaRDDs

[ https://issues.apache.org/jira/browse/SPARK-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106200#comment-14106200 ] Evan Chan commented on SPARK-2360: -- +1 for this feature. I just had to write something f

[jira] [Commented] (SPARK-3180) Better control of security groups

[ https://issues.apache.org/jira/browse/SPARK-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106176#comment-14106176 ] Apache Spark commented on SPARK-3180: - User 'douglaz' has created a pull request for t

[jira] [Commented] (SPARK-3180) Better control of security groups

[ https://issues.apache.org/jira/browse/SPARK-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106177#comment-14106177 ] Allan Douglas R. de Oliveira commented on SPARK-3180: - Perhaps it also

[jira] [Commented] (SPARK-3180) Better control of security groups

[ https://issues.apache.org/jira/browse/SPARK-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106171#comment-14106171 ] Allan Douglas R. de Oliveira commented on SPARK-3180: - PR: https://git

[jira] [Created] (SPARK-3180) Better control of security groups

Allan Douglas R. de Oliveira created SPARK-3180: --- Summary: Better control of security groups Key: SPARK-3180 URL: https://issues.apache.org/jira/browse/SPARK-3180 Project: Spark

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106164#comment-14106164 ] Marcelo Vanzin commented on SPARK-1537: --- No concrete timeline at the moment. I'm jus

[jira] [Created] (SPARK-3179) Add task OutputMetrics

Sandy Ryza created SPARK-3179: - Summary: Add task OutputMetrics Key: SPARK-3179 URL: https://issues.apache.org/jira/browse/SPARK-3179 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-2621) Update task InputMetrics incrementally

[ https://issues.apache.org/jira/browse/SPARK-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106118#comment-14106118 ] Apache Spark commented on SPARK-2621: - User 'sryza' has created a pull request for thi

[jira] [Closed] (SPARK-3111) Implement the LAST analytic function for sql

[ https://issues.apache.org/jira/browse/SPARK-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyun Huang closed SPARK-3111. --- Resolution: Later > Implement the LAST analytic function for sql > --

[jira] [Commented] (SPARK-3111) Implement the LAST analytic function for sql

[ https://issues.apache.org/jira/browse/SPARK-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106023#comment-14106023 ] Xinyun Huang commented on SPARK-3111: - Combined with 3176 > Implement the LAST analyt

[jira] [Updated] (SPARK-3176) Implement 'POWER', 'ABS and 'LAST' for sql

[ https://issues.apache.org/jira/browse/SPARK-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyun Huang updated SPARK-3176: Description: Add support for the mathematical function "POWER" and "ABS" and the analytic function

[jira] [Created] (SPARK-3178) setting SPARK_WORKER_MEMORY to a value without a label (m or g) sets the worker memory limit to zero

Jon Haddad created SPARK-3178: - Summary: setting SPARK_WORKER_MEMORY to a value without a label (m or g) sets the worker memory limit to zero Key: SPARK-3178 URL: https://issues.apache.org/jira/browse/SPARK-3178

[jira] [Commented] (SPARK-3177) Yarn-alpha ClientBaseSuite Unit test failed

[ https://issues.apache.org/jira/browse/SPARK-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105984#comment-14105984 ] Chester commented on SPARK-3177: This issue should exists on master branch as well. It has

[jira] [Created] (SPARK-3177) Yarn-alpha ClientBaseSuite Unit test failed

Chester created SPARK-3177: -- Summary: Yarn-alpha ClientBaseSuite Unit test failed Key: SPARK-3177 URL: https://issues.apache.org/jira/browse/SPARK-3177 Project: Spark Issue Type: Bug Compo

[jira] [Created] (SPARK-3176) Implement math function 'POWER' and 'ABS' for sql

Xinyun Huang created SPARK-3176: --- Summary: Implement math function 'POWER' and 'ABS' for sql Key: SPARK-3176 URL: https://issues.apache.org/jira/browse/SPARK-3176 Project: Spark Issue Type: Imp

[jira] [Commented] (SPARK-3129) Prevent data loss in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105928#comment-14105928 ] Hari Shreedharan commented on SPARK-3129: - [~tgraves] - Thanks for the pointers. Y

[jira] [Created] (SPARK-3175) Branch-1.1 SBT build failed for Yarn-Alpha

Chester created SPARK-3175: -- Summary: Branch-1.1 SBT build failed for Yarn-Alpha Key: SPARK-3175 URL: https://issues.apache.org/jira/browse/SPARK-3175 Project: Spark Issue Type: Bug Compon

[jira] [Created] (SPARK-3174) Under YARN, add and remove executors based on load

Sandy Ryza created SPARK-3174: - Summary: Under YARN, add and remove executors based on load Key: SPARK-3174 URL: https://issues.apache.org/jira/browse/SPARK-3174 Project: Spark Issue Type: Improv

[jira] [Commented] (SPARK-3065) Add Locale setting to HiveCompatibilitySuite

[ https://issues.apache.org/jira/browse/SPARK-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105628#comment-14105628 ] Apache Spark commented on SPARK-3065: - User 'byF' has created a pull request for this

[jira] [Created] (SPARK-3173) Timestamp support in the parser

Zdenek Farana created SPARK-3173: Summary: Timestamp support in the parser Key: SPARK-3173 URL: https://issues.apache.org/jira/browse/SPARK-3173 Project: Spark Issue Type: Bug Compo

[jira] [Commented] (SPARK-2863) Emulate Hive type coercion in native reimplementations of Hive functions

[ https://issues.apache.org/jira/browse/SPARK-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105537#comment-14105537 ] William Benton commented on SPARK-2863: --- I wrote up how Hive handles type coercions

[jira] [Commented] (SPARK-3070) Kryo deserialization without using the custom registrator

[ https://issues.apache.org/jira/browse/SPARK-3070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105536#comment-14105536 ] Daniel Darabos commented on SPARK-3070: --- I think this is almost certainly a duplicat

[jira] [Created] (SPARK-3172) Distinguish between shuffle spill on the map and reduce side

Sandy Ryza created SPARK-3172: - Summary: Distinguish between shuffle spill on the map and reduce side Key: SPARK-3172 URL: https://issues.apache.org/jira/browse/SPARK-3172 Project: Spark Issue T

[jira] [Commented] (SPARK-3098) In some cases, operation zipWithIndex get a wrong results

[ https://issues.apache.org/jira/browse/SPARK-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105469#comment-14105469 ] Apache Spark commented on SPARK-3098: - User 'witgo' has created a pull request for thi

[jira] [Updated] (SPARK-3106) Fix the race condition issue about Connection and ConnectionManager

[ https://issues.apache.org/jira/browse/SPARK-3106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-3106: -- Summary: Fix the race condition issue about Connection and ConnectionManager (was: *Race Condi

[jira] [Updated] (SPARK-3150) NullPointerException in Spark recovery after simultaneous fall of master and driver

[ https://issues.apache.org/jira/browse/SPARK-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tatiana Borisova updated SPARK-3150: Description: The issue happens when Spark is run standalone on a cluster. When master and

[jira] [Commented] (SPARK-2096) Correctly parse dot notations for accessing an array of structs

[ https://issues.apache.org/jira/browse/SPARK-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105353#comment-14105353 ] Apache Spark commented on SPARK-2096: - User 'chuxi' has created a pull request for thi

[jira] [Commented] (SPARK-2291) Update EC2 scripts to use instance storage on m3 instance types

[ https://issues.apache.org/jira/browse/SPARK-2291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105342#comment-14105342 ] Daniel Darabos commented on SPARK-2291: --- I don't know if something has changed on Am

[jira] [Commented] (SPARK-2096) Correctly parse dot notations for accessing an array of structs

[ https://issues.apache.org/jira/browse/SPARK-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105329#comment-14105329 ] Hanwei Jin commented on SPARK-2096: --- I checked the problem " where arrayOfStruct.field1=

[jira] [Commented] (SPARK-1449) Please delete old releases from mirroring system

[ https://issues.apache.org/jira/browse/SPARK-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105303#comment-14105303 ] Sean Owen commented on SPARK-1449: -- [~pwendell] can you or someone else on the PMC zap th

[jira] [Commented] (SPARK-3169) make-distribution.sh failed

[ https://issues.apache.org/jira/browse/SPARK-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105277#comment-14105277 ] Sean Owen commented on SPARK-3169: -- Same as https://issues.apache.org/jira/browse/SPARK-2

[jira] [Commented] (SPARK-2963) The description about how to build for using CLI and Thrift JDBC server is absent in proper document

[ https://issues.apache.org/jira/browse/SPARK-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105273#comment-14105273 ] Apache Spark commented on SPARK-2963: - User 'sarutak' has created a pull request for t

[jira] [Commented] (SPARK-2963) The description about how to build for using CLI and Thrift JDBC server is absent in proper document

[ https://issues.apache.org/jira/browse/SPARK-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105260#comment-14105260 ] Kousuke Saruta commented on SPARK-2963: --- I reopend this issue because of regression.

[jira] [Updated] (SPARK-2963) The description about how to build for using CLI and Thrift JDBC server is absent in proper document

[ https://issues.apache.org/jira/browse/SPARK-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-2963: -- Summary: The description about how to build for using CLI and Thrift JDBC server is absent in p

[jira] [Reopened] (SPARK-2963) The description about building to use HiveServer and CLI is incomplete

[ https://issues.apache.org/jira/browse/SPARK-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reopened SPARK-2963: --- > The description about building to use HiveServer and CLI is incomplete > --

[jira] [Commented] (SPARK-3037) Add ArrayType containing null value support to Parquet.

[ https://issues.apache.org/jira/browse/SPARK-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105243#comment-14105243 ] Takuya Ueshin commented on SPARK-3037: -- I agree with it. It was completely the same a

[jira] [Commented] (SPARK-2988) Port repl to scala 2.11.

[ https://issues.apache.org/jira/browse/SPARK-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105238#comment-14105238 ] Apache Spark commented on SPARK-2988: - User 'ScrapCodes' has created a pull request fo

[jira] [Commented] (SPARK-2096) Correctly parse dot notations for accessing an array of structs

[ https://issues.apache.org/jira/browse/SPARK-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105221#comment-14105221 ] Hanwei Jin commented on SPARK-2096: --- I think i almost have solved the issue. I have pa

[jira] [Commented] (SPARK-2978) Provide an MR-style shuffle transformation

[ https://issues.apache.org/jira/browse/SPARK-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105128#comment-14105128 ] Sandy Ryza commented on SPARK-2978: --- [~jerryshao], if I understand correctly, ShuffleRDD

[jira] [Commented] (SPARK-2978) Provide an MR-style shuffle transformation

[ https://issues.apache.org/jira/browse/SPARK-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105126#comment-14105126 ] Sandy Ryza commented on SPARK-2978: --- So I started looking into this a little more and wa