[jira] [Commented] (SPARK-8342) Decimal Math beyond ~2^112 is broken

[ https://issues.apache.org/jira/browse/SPARK-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584961#comment-14584961 ] Rene Treffer commented on SPARK-8342: - [~rxin] [~viirya] yes, I've tested with the pat

[jira] [Created] (SPARK-8359) Spark SQL Decimal type precision loss on multiplication

Rene Treffer created SPARK-8359: --- Summary: Spark SQL Decimal type precision loss on multiplication Key: SPARK-8359 URL: https://issues.apache.org/jira/browse/SPARK-8359 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-8342) Decimal Math beyond ~2^112 is broken

[ https://issues.apache.org/jira/browse/SPARK-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8342. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Liang-Chi Hsieh > Decimal Math beyo

[jira] [Commented] (SPARK-8342) Decimal Math beyond ~2^112 is broken

[ https://issues.apache.org/jira/browse/SPARK-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584943#comment-14584943 ] Reynold Xin commented on SPARK-8342: [~rtreffer] if this patch doesn't fix it, can you

[jira] [Updated] (SPARK-7727) Avoid inner classes in RuleExecutor

[ https://issues.apache.org/jira/browse/SPARK-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7727: Shepherd: Michael Armbrust > Avoid inner classes in RuleExecutor > -

[jira] [Updated] (SPARK-6126) Support UDTs in JSON

[ https://issues.apache.org/jira/browse/SPARK-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6126: Shepherd: Yin Huai > Support UDTs in JSON > > > Key: SP

[jira] [Updated] (SPARK-8301) Improve UTF8String substring/startsWith/endsWith/contains performance

[ https://issues.apache.org/jira/browse/SPARK-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8301: Shepherd: Reynold Xin > Improve UTF8String substring/startsWith/endsWith/contains performanc

[jira] [Updated] (SPARK-7199) Add date and timestamp support to UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7199: Shepherd: Josh Rosen > Add date and timestamp support to UnsafeRow > ---

[jira] [Updated] (SPARK-6489) Optimize lateral view with explode to not read unnecessary columns

[ https://issues.apache.org/jira/browse/SPARK-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6489: Shepherd: Michael Armbrust > Optimize lateral view with explode to not read unnecessary colu

[jira] [Updated] (SPARK-8356) Reconcile callUDF and callUdf

[ https://issues.apache.org/jira/browse/SPARK-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8356: --- Labels: starter (was: ) > Reconcile callUDF and callUdf > - > >

[jira] [Commented] (SPARK-8356) Reconcile callUDF and callUdf

[ https://issues.apache.org/jira/browse/SPARK-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584939#comment-14584939 ] Reynold Xin commented on SPARK-8356: We should just deprecate callUdf, and add a callU

[jira] [Assigned] (SPARK-8358) DataFrame explode with alias and * fails

[ https://issues.apache.org/jira/browse/SPARK-8358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8358: --- Assignee: Michael Armbrust (was: Apache Spark) > DataFrame explode with alias and * fails >

[jira] [Commented] (SPARK-8358) DataFrame explode with alias and * fails

[ https://issues.apache.org/jira/browse/SPARK-8358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584936#comment-14584936 ] Apache Spark commented on SPARK-8358: - User 'marmbrus' has created a pull request for

[jira] [Assigned] (SPARK-8358) DataFrame explode with alias and * fails

[ https://issues.apache.org/jira/browse/SPARK-8358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8358: --- Assignee: Apache Spark (was: Michael Armbrust) > DataFrame explode with alias and * fails >

[jira] [Created] (SPARK-8358) DataFrame explode with alias and * fails

Michael Armbrust created SPARK-8358: --- Summary: DataFrame explode with alias and * fails Key: SPARK-8358 URL: https://issues.apache.org/jira/browse/SPARK-8358 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-6259) Python API for LDA

[ https://issues.apache.org/jira/browse/SPARK-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584934#comment-14584934 ] Yu Ishikawa edited comment on SPARK-6259 at 6/14/15 4:52 AM: -

[jira] [Comment Edited] (SPARK-6259) Python API for LDA

[ https://issues.apache.org/jira/browse/SPARK-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584934#comment-14584934 ] Yu Ishikawa edited comment on SPARK-6259 at 6/14/15 4:50 AM: -

[jira] [Commented] (SPARK-6259) Python API for LDA

[ https://issues.apache.org/jira/browse/SPARK-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584934#comment-14584934 ] Yu Ishikawa commented on SPARK-6259: [~josephkb] and [~mengxr], I'm having a trouble w

[jira] [Resolved] (SPARK-8343) Improve the Spark Streaming Guides

[ https://issues.apache.org/jira/browse/SPARK-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8343. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Assignee: Mike Dusenb

[jira] [Commented] (SPARK-8357) Memory leakage on unsafe aggregation path with empty input

[ https://issues.apache.org/jira/browse/SPARK-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584924#comment-14584924 ] Apache Spark commented on SPARK-8357: - User 'navis' has created a pull request for thi

[jira] [Assigned] (SPARK-8357) Memory leakage on unsafe aggregation path with empty input

[ https://issues.apache.org/jira/browse/SPARK-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8357: --- Assignee: Apache Spark > Memory leakage on unsafe aggregation path with empty input > ---

[jira] [Assigned] (SPARK-8357) Memory leakage on unsafe aggregation path with empty input

[ https://issues.apache.org/jira/browse/SPARK-8357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8357: --- Assignee: (was: Apache Spark) > Memory leakage on unsafe aggregation path with empty inpu

[jira] [Created] (SPARK-8357) Memory leakage on unsafe aggregation path with empty input

Navis created SPARK-8357: Summary: Memory leakage on unsafe aggregation path with empty input Key: SPARK-8357 URL: https://issues.apache.org/jira/browse/SPARK-8357 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-8356) Reconcile callUDF and callUdf

Michael Armbrust created SPARK-8356: --- Summary: Reconcile callUDF and callUdf Key: SPARK-8356 URL: https://issues.apache.org/jira/browse/SPARK-8356 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-8355) Python DataFrameReader/Writer should mirror scala

Michael Armbrust created SPARK-8355: --- Summary: Python DataFrameReader/Writer should mirror scala Key: SPARK-8355 URL: https://issues.apache.org/jira/browse/SPARK-8355 Project: Spark Issue T

[jira] [Updated] (SPARK-6116) DataFrame API improvement umbrella ticket

[ https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6116: --- Summary: DataFrame API improvement umbrella ticket (was: Making DataFrame API non-experimental) > Da

[jira] [Assigned] (SPARK-8354) Fix off-by-factor-of-8 error when allocating scratch space in UnsafeFixedWidthAggregationMap

[ https://issues.apache.org/jira/browse/SPARK-8354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8354: --- Assignee: Josh Rosen (was: Apache Spark) > Fix off-by-factor-of-8 error when allocating scra

[jira] [Commented] (SPARK-8354) Fix off-by-factor-of-8 error when allocating scratch space in UnsafeFixedWidthAggregationMap

[ https://issues.apache.org/jira/browse/SPARK-8354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584908#comment-14584908 ] Apache Spark commented on SPARK-8354: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-8354) Fix off-by-factor-of-8 error when allocating scratch space in UnsafeFixedWidthAggregationMap

[ https://issues.apache.org/jira/browse/SPARK-8354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8354: --- Assignee: Apache Spark (was: Josh Rosen) > Fix off-by-factor-of-8 error when allocating scra

[jira] [Created] (SPARK-8354) Fix off-by-factor-of-8 error when allocating scratch space in UnsafeFixedWidthAggregationMap

Josh Rosen created SPARK-8354: - Summary: Fix off-by-factor-of-8 error when allocating scratch space in UnsafeFixedWidthAggregationMap Key: SPARK-8354 URL: https://issues.apache.org/jira/browse/SPARK-8354

[jira] [Resolved] (SPARK-8349) Use expression constructors (rather than apply) in FunctionRegistry

[ https://issues.apache.org/jira/browse/SPARK-8349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8349. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6806 [https:/

[jira] [Closed] (SPARK-2315) drop, dropRight and dropWhile which take RDD input and return RDD

[ https://issues.apache.org/jira/browse/SPARK-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Erlandson closed SPARK-2315. - Resolution: Won't Fix There is now an implementation on the silex project: http://silex.freevariab

[jira] [Updated] (SPARK-8348) Add in operator to DataFrame Column

[ https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-8348: -- Component/s: SparkR > Add in operator to DataFrame Column > --- > >

[jira] [Resolved] (SPARK-8340) Error creating sparkR dataframe: Error in writeJobj(ocn, object): invalid jobj 2

[ https://issues.apache.org/jira/browse/SPARK-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8340. -- Resolution: Not A Problem > Error creating sparkR dataframe: Error in writeJobj(

[jira] [Commented] (SPARK-8340) Error creating sparkR dataframe: Error in writeJobj(ocn, object): invalid jobj 2

[ https://issues.apache.org/jira/browse/SPARK-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584897#comment-14584897 ] Shivaram Venkataraman commented on SPARK-8340: -- Thanks [~nevi_me] for the upd

[jira] [Commented] (SPARK-8353) Show anchor links when hovering over documentation headers

[ https://issues.apache.org/jira/browse/SPARK-8353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584893#comment-14584893 ] Apache Spark commented on SPARK-8353: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-8340) Error creating sparkR dataframe: Error in writeJobj(ocn, object): invalid jobj 2

[ https://issues.apache.org/jira/browse/SPARK-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584894#comment-14584894 ] nevi_me commented on SPARK-8340: Finally found the issue. 1. Documentation on Spark not s

[jira] [Assigned] (SPARK-8353) Show anchor links when hovering over documentation headers

[ https://issues.apache.org/jira/browse/SPARK-8353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8353: --- Assignee: Josh Rosen (was: Apache Spark) > Show anchor links when hovering over documentatio

[jira] [Assigned] (SPARK-8353) Show anchor links when hovering over documentation headers

[ https://issues.apache.org/jira/browse/SPARK-8353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8353: --- Assignee: Apache Spark (was: Josh Rosen) > Show anchor links when hovering over documentatio

[jira] [Resolved] (SPARK-8347) Add unit tests for abs

[ https://issues.apache.org/jira/browse/SPARK-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8347. Resolution: Fixed Fix Version/s: 1.5.0 > Add unit tests for abs > -- > >

[jira] [Updated] (SPARK-359) Updates to docs

[ https://issues.apache.org/jira/browse/SPARK-359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-359: - Component/s: Documentation > Updates to docs > --- > > Key: SPARK-359 >

[jira] [Updated] (SPARK-8352) Affixed table of contents, similar to Bootstrap 3 docs

[ https://issues.apache.org/jira/browse/SPARK-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8352: -- Description: Some of our documentation pages are getting kind of long and hard to navigate. Bootstrap

[jira] [Updated] (SPARK-4176) Support decimals with precision > 18 in Parquet

[ https://issues.apache.org/jira/browse/SPARK-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-4176: --- Shepherd: Michael Armbrust > Support decimals with precision > 18 in Parquet > ---

[jira] [Updated] (SPARK-8352) Affixed table of contents, similar to Bootstrap 3 docs

[ https://issues.apache.org/jira/browse/SPARK-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8352: -- Attachment: screenshot-1.png > Affixed table of contents, similar to Bootstrap 3 docs >

[jira] [Created] (SPARK-8352) Affixed table of contents, similar to Bootstrap 3 docs

Josh Rosen created SPARK-8352: - Summary: Affixed table of contents, similar to Bootstrap 3 docs Key: SPARK-8352 URL: https://issues.apache.org/jira/browse/SPARK-8352 Project: Spark Issue Type: Su

[jira] [Updated] (SPARK-8352) Affixed table of contents, similar to Bootstrap 3 docs

[ https://issues.apache.org/jira/browse/SPARK-8352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8352: -- Description: Some of our documentation pages are getting kind of long and hard to navigate. Bootstrap

[jira] [Updated] (SPARK-8351) Umbella for improving Spark documentation CSS + JS

[ https://issues.apache.org/jira/browse/SPARK-8351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8351: -- Assignee: (was: Josh Rosen) > Umbella for improving Spark documentation CSS + JS > -

[jira] [Created] (SPARK-8353) Show anchor links when hovering over documentation headers

Josh Rosen created SPARK-8353: - Summary: Show anchor links when hovering over documentation headers Key: SPARK-8353 URL: https://issues.apache.org/jira/browse/SPARK-8353 Project: Spark Issue Type

[jira] [Updated] (SPARK-8351) Umbella for improving Spark documentation CSS + JS

[ https://issues.apache.org/jira/browse/SPARK-8351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8351: -- Issue Type: Umbrella (was: New Feature) > Umbella for improving Spark documentation CSS + JS >

[jira] [Updated] (SPARK-8351) Umbella for improving Spark documentation CSS + JS

[ https://issues.apache.org/jira/browse/SPARK-8351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8351: -- Description: This is an umbrella ticket for tracking non-content changes to the Spark documentation, suc

[jira] [Updated] (SPARK-8351) Umbella for improving Spark documentation CSS + JS

[ https://issues.apache.org/jira/browse/SPARK-8351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8351: -- Summary: Umbella for improving Spark documentation CSS + JS (was: Use Javascript to improve navigation

[jira] [Updated] (SPARK-8093) Spark 1.4 branch's new JSON schema inference has changed the behavior of handling inner empty JSON object.

[ https://issues.apache.org/jira/browse/SPARK-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8093: Shepherd: Yin Huai > Spark 1.4 branch's new JSON schema inference has changed the behavior of > handling in

[jira] [Created] (SPARK-8351) Use Javascript to improve navigation in Spark docs

Josh Rosen created SPARK-8351: - Summary: Use Javascript to improve navigation in Spark docs Key: SPARK-8351 URL: https://issues.apache.org/jira/browse/SPARK-8351 Project: Spark Issue Type: New Fe

[jira] [Resolved] (SPARK-8052) Hive on Spark: CAST string AS BIGINT produces wrong value

[ https://issues.apache.org/jira/browse/SPARK-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8052. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6645 [https:/

[jira] [Assigned] (SPARK-8350) R unit tests output should be logged to "unit-tests.log"

[ https://issues.apache.org/jira/browse/SPARK-8350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8350: --- Assignee: Apache Spark (was: Andrew Or) > R unit tests output should be logged to "unit-test

[jira] [Commented] (SPARK-8350) R unit tests output should be logged to "unit-tests.log"

[ https://issues.apache.org/jira/browse/SPARK-8350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584879#comment-14584879 ] Apache Spark commented on SPARK-8350: - User 'andrewor14' has created a pull request fo

[jira] [Assigned] (SPARK-8350) R unit tests output should be logged to "unit-tests.log"

[ https://issues.apache.org/jira/browse/SPARK-8350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8350: --- Assignee: Andrew Or (was: Apache Spark) > R unit tests output should be logged to "unit-test

[jira] [Created] (SPARK-8350) R unit tests output should be logged to "unit-tests.log"

Andrew Or created SPARK-8350: Summary: R unit tests output should be logged to "unit-tests.log" Key: SPARK-8350 URL: https://issues.apache.org/jira/browse/SPARK-8350 Project: Spark Issue Type: Bu

[jira] [Updated] (SPARK-8052) Hive on Spark: CAST string AS BIGINT produces wrong value

[ https://issues.apache.org/jira/browse/SPARK-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8052: Target Version/s: 1.5.0 > Hive on Spark: CAST string AS BIGINT produces wrong value > --

[jira] [Updated] (SPARK-8052) Hive on Spark: CAST string AS BIGINT produces wrong value

[ https://issues.apache.org/jira/browse/SPARK-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8052: Assignee: Liang-Chi Hsieh > Hive on Spark: CAST string AS BIGINT produces wrong value >

[jira] [Updated] (SPARK-8052) Hive on Spark: CAST string AS BIGINT produces wrong value

[ https://issues.apache.org/jira/browse/SPARK-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8052: Shepherd: Michael Armbrust > Hive on Spark: CAST string AS BIGINT produces wrong value > ---

[jira] [Assigned] (SPARK-8349) Use expression constructors (rather than apply) in FunctionRegistry

[ https://issues.apache.org/jira/browse/SPARK-8349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8349: --- Assignee: Apache Spark (was: Reynold Xin) > Use expression constructors (rather than apply)

[jira] [Assigned] (SPARK-8349) Use expression constructors (rather than apply) in FunctionRegistry

[ https://issues.apache.org/jira/browse/SPARK-8349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8349: --- Assignee: Reynold Xin (was: Apache Spark) > Use expression constructors (rather than apply)

[jira] [Commented] (SPARK-8349) Use expression constructors (rather than apply) in FunctionRegistry

[ https://issues.apache.org/jira/browse/SPARK-8349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584873#comment-14584873 ] Apache Spark commented on SPARK-8349: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-8349) Use expression constructors (rather than apply) in FunctionRegistry

[ https://issues.apache.org/jira/browse/SPARK-8349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8349: --- Summary: Use expression constructors (rather than apply) in FunctionRegistry (was: Use expression con

[jira] [Resolved] (SPARK-8319) Update logic related to key ordering in shuffle dependencies

[ https://issues.apache.org/jira/browse/SPARK-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8319. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6773 [https://github.com/

[jira] [Created] (SPARK-8349) Use expression constructors in FunctionRegistry

Reynold Xin created SPARK-8349: -- Summary: Use expression constructors in FunctionRegistry Key: SPARK-8349 URL: https://issues.apache.org/jira/browse/SPARK-8349 Project: Spark Issue Type: Improve

[jira] [Resolved] (SPARK-8346) Use InternalRow instread of catalyst.InternalRow

[ https://issues.apache.org/jira/browse/SPARK-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8346. Resolution: Fixed Fix Version/s: 1.5.0 > Use InternalRow instread of catalyst.InternalRow > -

[jira] [Commented] (SPARK-8348) Add in operator to DataFrame Column

[ https://issues.apache.org/jira/browse/SPARK-8348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584862#comment-14584862 ] Xiangrui Meng commented on SPARK-8348: -- cc [~falaki] > Add in operator to DataFrame

[jira] [Created] (SPARK-8348) Add in operator to DataFrame Column

Xiangrui Meng created SPARK-8348: Summary: Add in operator to DataFrame Column Key: SPARK-8348 URL: https://issues.apache.org/jira/browse/SPARK-8348 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-8126) Use temp directory under build dir for unit tests

[ https://issues.apache.org/jira/browse/SPARK-8126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584857#comment-14584857 ] Apache Spark commented on SPARK-8126: - User 'vanzin' has created a pull request for th

[jira] [Assigned] (SPARK-8301) Improve UTF8String substring/startsWith/endsWith/contains performance

[ https://issues.apache.org/jira/browse/SPARK-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8301: --- Assignee: Apache Spark > Improve UTF8String substring/startsWith/endsWith/contains performanc

[jira] [Commented] (SPARK-8301) Improve UTF8String substring/startsWith/endsWith/contains performance

[ https://issues.apache.org/jira/browse/SPARK-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584851#comment-14584851 ] Apache Spark commented on SPARK-8301: - User 'tarekauel' has created a pull request for

[jira] [Assigned] (SPARK-8301) Improve UTF8String substring/startsWith/endsWith/contains performance

[ https://issues.apache.org/jira/browse/SPARK-8301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8301: --- Assignee: (was: Apache Spark) > Improve UTF8String substring/startsWith/endsWith/contains

[jira] [Assigned] (SPARK-8347) Add unit tests for abs

[ https://issues.apache.org/jira/browse/SPARK-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8347: --- Assignee: Apache Spark (was: Reynold Xin) > Add unit tests for abs > --

[jira] [Assigned] (SPARK-8347) Add unit tests for abs

[ https://issues.apache.org/jira/browse/SPARK-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8347: --- Assignee: Reynold Xin (was: Apache Spark) > Add unit tests for abs > --

[jira] [Commented] (SPARK-8347) Add unit tests for abs

[ https://issues.apache.org/jira/browse/SPARK-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584843#comment-14584843 ] Apache Spark commented on SPARK-8347: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-8347) Add unit tests for abs

Reynold Xin created SPARK-8347: -- Summary: Add unit tests for abs Key: SPARK-8347 URL: https://issues.apache.org/jira/browse/SPARK-8347 Project: Spark Issue Type: Sub-task Components: S

[jira] [Assigned] (SPARK-8346) Use InternalRow instread of catalyst.InternalRow

[ https://issues.apache.org/jira/browse/SPARK-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8346: --- Assignee: Davies Liu (was: Apache Spark) > Use InternalRow instread of catalyst.InternalRow

[jira] [Assigned] (SPARK-8346) Use InternalRow instread of catalyst.InternalRow

[ https://issues.apache.org/jira/browse/SPARK-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8346: --- Assignee: Apache Spark (was: Davies Liu) > Use InternalRow instread of catalyst.InternalRow

[jira] [Commented] (SPARK-8346) Use InternalRow instread of catalyst.InternalRow

[ https://issues.apache.org/jira/browse/SPARK-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584819#comment-14584819 ] Apache Spark commented on SPARK-8346: - User 'davies' has created a pull request for th

[jira] [Updated] (SPARK-8346) Use InternalRow instread of catalyst.InternalRow

[ https://issues.apache.org/jira/browse/SPARK-8346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-8346: -- Summary: Use InternalRow instread of catalyst.InternalRow (was: User InternalRow instread of catalyst.I

[jira] [Commented] (SPARK-8340) Error creating sparkR dataframe: Error in writeJobj(ocn, object): invalid jobj 2

[ https://issues.apache.org/jira/browse/SPARK-8340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584815#comment-14584815 ] nevi_me commented on SPARK-8340: I'm able to initialise SparkR, as after I create the Spar

[jira] [Created] (SPARK-8346) User InternalRow instread of catalyst.InternalRow

Davies Liu created SPARK-8346: - Summary: User InternalRow instread of catalyst.InternalRow Key: SPARK-8346 URL: https://issues.apache.org/jira/browse/SPARK-8346 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-8343) Improve the Spark Streaming Guides

[ https://issues.apache.org/jira/browse/SPARK-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584792#comment-14584792 ] Apache Spark commented on SPARK-8343: - User 'dusenberrymw' has created a pull request

[jira] [Commented] (SPARK-8342) Decimal Math beyond ~2^112 is broken

[ https://issues.apache.org/jira/browse/SPARK-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584784#comment-14584784 ] Rene Treffer commented on SPARK-8342: - Oh no, I managed to create a completely unrelat

[jira] [Created] (SPARK-8345) Add an SQL node as a feature tranformer

Xiangrui Meng created SPARK-8345: Summary: Add an SQL node as a feature tranformer Key: SPARK-8345 URL: https://issues.apache.org/jira/browse/SPARK-8345 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-8008) JDBC data source can overload the external database system due to high concurrency

[ https://issues.apache.org/jira/browse/SPARK-8008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584777#comment-14584777 ] Rene Treffer commented on SPARK-8008: - Well, turns out I was wrong, union does not wor

[jira] [Created] (SPARK-8344) Add internal metrics / logging for DAGScheduler to detect long pauses / blocking

Josh Rosen created SPARK-8344: - Summary: Add internal metrics / logging for DAGScheduler to detect long pauses / blocking Key: SPARK-8344 URL: https://issues.apache.org/jira/browse/SPARK-8344 Project: Spa

[jira] [Commented] (SPARK-5581) When writing sorted map output file, avoid open / close between each partition

[ https://issues.apache.org/jira/browse/SPARK-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584774#comment-14584774 ] Josh Rosen commented on SPARK-5581: --- Now that I've thought about this a bit more, we mig

[jira] [Assigned] (SPARK-8343) Improve the Spark Streaming Guides

[ https://issues.apache.org/jira/browse/SPARK-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8343: --- Assignee: Apache Spark > Improve the Spark Streaming Guides > ---

[jira] [Assigned] (SPARK-8343) Improve the Spark Streaming Guides

[ https://issues.apache.org/jira/browse/SPARK-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8343: --- Assignee: (was: Apache Spark) > Improve the Spark Streaming Guides >

[jira] [Commented] (SPARK-8343) Improve the Spark Streaming Guides

[ https://issues.apache.org/jira/browse/SPARK-8343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584754#comment-14584754 ] Apache Spark commented on SPARK-8343: - User 'dusenberrymw' has created a pull request

[jira] [Created] (SPARK-8343) Improve the Spark Streaming Guides

Mike Dusenberry created SPARK-8343: -- Summary: Improve the Spark Streaming Guides Key: SPARK-8343 URL: https://issues.apache.org/jira/browse/SPARK-8343 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-8093) Spark 1.4 branch's new JSON schema inference has changed the behavior of handling inner empty JSON object.

[ https://issues.apache.org/jira/browse/SPARK-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8093: --- Assignee: Apache Spark > Spark 1.4 branch's new JSON schema inference has changed the behavio

[jira] [Assigned] (SPARK-8093) Spark 1.4 branch's new JSON schema inference has changed the behavior of handling inner empty JSON object.

[ https://issues.apache.org/jira/browse/SPARK-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8093: --- Assignee: (was: Apache Spark) > Spark 1.4 branch's new JSON schema inference has changed

[jira] [Commented] (SPARK-8093) Spark 1.4 branch's new JSON schema inference has changed the behavior of handling inner empty JSON object.

[ https://issues.apache.org/jira/browse/SPARK-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584739#comment-14584739 ] Apache Spark commented on SPARK-8093: - User 'NathanHowell' has created a pull request

[jira] [Commented] (SPARK-8342) Decimal Math beyond ~2^112 is broken

[ https://issues.apache.org/jira/browse/SPARK-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584682#comment-14584682 ] Apache Spark commented on SPARK-8342: - User 'viirya' has created a pull request for th

[jira] [Assigned] (SPARK-8342) Decimal Math beyond ~2^112 is broken

[ https://issues.apache.org/jira/browse/SPARK-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8342: --- Assignee: (was: Apache Spark) > Decimal Math beyond ~2^112 is broken > --

[jira] [Assigned] (SPARK-8342) Decimal Math beyond ~2^112 is broken

[ https://issues.apache.org/jira/browse/SPARK-8342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8342: --- Assignee: Apache Spark > Decimal Math beyond ~2^112 is broken > -

  1   2   >