Re: [eigen] Is Eigen/SparseCholesky license LGPL or MPL2?

in October, so all that > is needed is to rerun the doxygen generator. > > Frederik > > > > On Mon, Dec 20, 2021 at 09:57 Sameer Agarwal > wrote: > >> It is MPL. The documentation needs to be updated. >> Sameer >> >> >> On Sat, Dec 18, 202

Re: [eigen] Is Eigen/SparseCholesky license LGPL or MPL2?

It is MPL. The documentation needs to be updated. Sameer On Sat, Dec 18, 2021 at 3:15 PM Frederik Schaffalitzky < frede...@schaffalitzky.org> wrote: > Basic license question: > > According to the following page, it sounds like Eigen/SparseCholesky is > MPL2 in version 3.1.1 and later: > > >

Re: [eigen] Using Eigen decompositions with ceres autodiff Jet data type.

al. > Vol. 10. Num. 2.1973. > 2). O Leary. Rust. Variable Projection for Nonlinear Least Squares > Problems. > > Again thank you very much. I will think of your advice. > > Oleg > > > On Mon, Jun 1, 2020 at 4:57 PM Sameer Agarwal > wrote: > >> Oleg, >

Re: [eigen] Using Eigen decompositions with ceres autodiff Jet data type.

Tobias, I have looked into this and added some details to the issue. As I understand it, these matrix algorithms require instantiating std::complex, that leads to problems in the STL. Sameer On Thu, Jun 18, 2020 at 9:35 AM Sameer Agarwal wrote: > sorry folks I have been missing in action

Re: [eigen] Using Eigen decompositions with ceres autodiff Jet data type.

w only need .pow(), but this does not work with Jets either. > I think the problem with .pow() looks easier to fix? > > > > Thanks, > > Toby > > > > *From: *Rasmus Munk Larsen > *Reply to: *"eigen@lists.tuxfamily.org" > *Date: *Thursday, 4 June 2020 at

Re: [eigen] Using Eigen decompositions with ceres autodiff Jet data type.

Oleg, Two ideas: 1. You may have an easier time using QR factorization instead of SVD to solve your least squares problem. 2. But you can do better, instead of trying to solve linear least squares problem involving a matrix of Jets, you are better off, solving the linear least squares problem on

[jira] [Updated] (SPARK-21804) json_tuple returns null values within repeated columns except the first one

[ https://issues.apache.org/jira/browse/SPARK-21804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-21804: --- Affects Version/s: (was: 2.2.0) 2.0.0 > json_tuple returns n

Re: [eigen] Not able to solve the system of equation having vector as coefficient of the matrix

Since the two linear systems share nothing but the size, beyond some sort of function call overhead, you should not expect there to be any savings in actually solving the linear system. On Tue, Jun 4, 2019 at 10:54 PM Rohit Aggarwal wrote: > Dear Adrien, > > Thanks for your quick reply. > > As

Re: V2.3 Scala API to Github Links Incorrect

[+Hyukjin] Thanks for flagging this Jayesh. https://github.com/apache/spar k-website/pull/111 is tracking a short term fix to the API docs and https://issues.apache.org/jira/browse/SPARK-23732 tracks the fix to the release scripts. Regards, Sameer On 15 April 2018 at 18:50, Thakrar, Jayesh

Re: Welcome Zhenhua Wang as a Spark committer

ss several areas of Spark for a while, focusing especially >>> on analyzer, optimizer in Spark SQL. Please join me in welcoming Zhenhua! >>> > >>> > Wenchen >>> >>> >>> - >>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >>> >>> -- Sameer Agarwal Computer Science | UC Berkeley http://cs.berkeley.edu/~sameerag

Re: Welcoming some new committers

Congratulations!! On 3 March 2018 at 13:12, Mridul Muralidharan wrote: > Congratulations ! > > > Regards, > Mridul > > > On Fri, Mar 2, 2018 at 2:41 PM, Matei Zaharia > wrote: > > Hi everyone, > > > > The Spark PMC has recently voted to add several

[ANNOUNCE] Announcing Apache Spark 2.3.0

Hi all, Apache Spark 2.3.0 is the fourth major release in the 2.x line. This release adds support for continuous processing in structured streaming along with a brand new Kubernetes scheduler backend. Other major updates include the new data source and structured streaming v2 APIs, a standard

Re: [VOTE] Spark 2.3.0 (RC5)

;>>>>>> >>>>>>>>>> Note: given the state of Jenkins I'd love to see Bryan Cutler or >>>>>>>>>> someone with Arrow experience sign off on this release. >>>>>>>>>> >>>>>>>>>>

[VOTE] Spark 2.3.0 (RC5)

Please vote on releasing the following candidate as Apache Spark version 2.3.0. The vote is open until Tuesday February 27, 2018 at 8:00:00 am UTC and passes if a majority of at least 3 PMC +1 votes are cast. [ ] +1 Release this package as Apache Spark 2.3.0 [ ] -1 Do not release this package

Re: [VOTE] Spark 2.3.0 (RC4)

lder shuffle services, but it's pretty safe. > > On Tue, Feb 20, 2018 at 5:58 PM, Sameer Agarwal <samee...@apache.org> > wrote: > > This RC has failed due to https://issues.apache.org/ > jira/browse/SPARK-23470. > > Now that the fix has been merged in 2.3 (thanks Marcelo!),

Re: [VOTE] Spark 2.3.0 (RC4)

t;> >>>>> +1 >>>>> >>>>> >>>>> On Tue, Feb 20, 2018 at 2:14 PM, Xingbo Jiang <jiangxb1...@gmail.com> >>>>> wrote: >>>>> >>>>>> +1 >>>>>> >>>>>> >&

[jira] [Resolved] (SPARK-23470) org.apache.spark.ui.jobs.ApiHelper.lastStageNameAndDescription is too slow

[ https://issues.apache.org/jira/browse/SPARK-23470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal resolved SPARK-23470. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.3.0 Issue

Re: [VOTE] Spark 2.3.0 (RC4)

> > this file shouldn't be included? https://dist.apache.org/repos/ > dist/dev/spark/v2.3.0-rc4-bin/spark-parent_2.11.iml > I've now deleted this file *From:* Sameer Agarwal <sameer.a...@gmail.com> > *Sent:* Saturday, February 17, 2018 1:43:39 PM > *To:* Sameer Agarwa

Re: [VOTE] Spark 2.3.0 (RC4)

I'll start with a +1 once again. All blockers reported against RC3 have been resolved and the builds are healthy. On 17 February 2018 at 13:41, Sameer Agarwal <samee...@apache.org> wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.3.0. The vote i

[VOTE] Spark 2.3.0 (RC4)

Please vote on releasing the following candidate as Apache Spark version 2.3.0. The vote is open until Thursday February 22, 2018 at 8:00:00 am UTC and passes if a majority of at least 3 PMC +1 votes are cast. [ ] +1 Release this package as Apache Spark 2.3.0 [ ] -1 Do not release this package

Re: [VOTE] Spark 2.3.0 (RC3)

In addition to the issues mentioned above, Wenchen and Xiao have flagged two other regressions (https://issues.apache.org/jira/browse/SPARK-23316 and https://issues.apache.org/jira/browse/SPARK-23388) that were merged after RC3 was cut. Due to these, this vote fails. I'll follow-up with an RC4 in

[jira] [Commented] (SPARK-23410) Unable to read jsons in charset different from UTF-8

[ https://issues.apache.org/jira/browse/SPARK-23410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366537#comment-16366537 ] Sameer Agarwal commented on SPARK-23410: [~maxgekk] [~smilegator] any ETA

Re: [VOTE] Spark 2.3.0 (RC3)

park 2.2 > SPARK-23316 AnalysisException after max iteration reached for IN query > > ... though the pandas tests issue is "Critical". > > (SPARK-23083 is an update to the main site that should happen as the > artifacts are released, so it's OK.) > > On Tue, Feb 13,

[jira] [Updated] (SPARK-23292) python tests related to pandas are skipped with python 2

[ https://issues.apache.org/jira/browse/SPARK-23292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23292: --- Summary: python tests related to pandas are skipped with python 2 (was: python tests

[jira] [Commented] (SPARK-23388) Support for Parquet Binary DecimalType in VectorizedColumnReader

[ https://issues.apache.org/jira/browse/SPARK-23388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362730#comment-16362730 ] Sameer Agarwal commented on SPARK-23388: yes, I agree > Support for Parquet Binary DecimalT

Re: [VOTE] Spark 2.3.0 (RC3)

I'll start the vote with a +1. As of today, all known release blockers and QA tasks have been resolved, and the jenkins builds are healthy: https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/ On 12 February 2018 at 22:30, Sameer Agarwal <samee...@apache.org>

[VOTE] Spark 2.3.0 (RC3)

Now that all known blockers have once again been resolved, please vote on releasing the following candidate as Apache Spark version 2.3.0. The vote is open until Friday February 16, 2018 at 8:00:00 am UTC and passes if a majority of at least 3 PMC +1 votes are cast. [ ] +1 Release this package

[jira] [Comment Edited] (SPARK-23390) Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360225#comment-16360225 ] Sameer Agarwal edited comment on SPARK-23390 at 2/12/18 2:41 AM: - I ran

[jira] [Commented] (SPARK-23390) Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

[ https://issues.apache.org/jira/browse/SPARK-23390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360225#comment-16360225 ] Sameer Agarwal commented on SPARK-23390: I ran this test locally 50 times and it passed every

[jira] [Created] (SPARK-23390) Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7

Sameer Agarwal created SPARK-23390: -- Summary: Flaky Test Suite: FileBasedDataSourceSuite in Spark 2.3/hadoop 2.7 Key: SPARK-23390 URL: https://issues.apache.org/jira/browse/SPARK-23390 Project

[jira] [Commented] (SPARK-23309) Spark 2.3 cached query performance 20-30% worse then spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-23309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357363#comment-16357363 ] Sameer Agarwal commented on SPARK-23309: Thanks, I'll then go ahead and downgrade the priority

[jira] [Updated] (SPARK-23309) Spark 2.3 cached query performance 20-30% worse then spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-23309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23309: --- Priority: Major (was: Blocker) > Spark 2.3 cached query performance 20-30% worse then sp

[jira] [Commented] (SPARK-23309) Spark 2.3 cached query performance 20-30% worse then spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-23309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357344#comment-16357344 ] Sameer Agarwal commented on SPARK-23309: [~tgraves] [~smilegator] [~cloud_fan] – any advice here

[jira] [Commented] (SPARK-23348) append data using saveAsTable should adjust the data types

[ https://issues.apache.org/jira/browse/SPARK-23348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356176#comment-16356176 ] Sameer Agarwal commented on SPARK-23348: yes, +1 > append data using saveAsTable should adj

Re: [VOTE] Spark 2.3.0 (RC2)

st hive not >> working - ASF JIRA <https://issues.apache.org/jira/browse/SPARK-23304> for >> the coalesce issue. >> >> [SPARK-23304] Spark SQL coalesce() against hive not working - ASF JIRA >> >> <https://issues.apache.org/jira/browse/SPARK-23304>

[jira] [Updated] (SPARK-23334) Fix pandas_udf with return type StringType() to handle str type properly in Python 2.

[ https://issues.apache.org/jira/browse/SPARK-23334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23334: --- Priority: Blocker (was: Major) > Fix pandas_udf with return type StringType() to handle

[jira] [Resolved] (SPARK-23310) Perf regression introduced by SPARK-21113

[ https://issues.apache.org/jira/browse/SPARK-23310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal resolved SPARK-23310. Resolution: Done Assignee: Sital Kedia Fix Version/s: 2.3.0 Issue resolved

[jira] [Updated] (SPARK-23330) Spark UI SQL executions page throws NPE

[ https://issues.apache.org/jira/browse/SPARK-23330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23330: --- Description: Spark UI SQL executions page throws the following error and the page crashes

[jira] [Commented] (SPARK-23324) Announce new Kubernetes back-end for 2.3 release notes

[ https://issues.apache.org/jira/browse/SPARK-23324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351060#comment-16351060 ] Sameer Agarwal commented on SPARK-23324:   Thanks [~eje], this is definitely going to be a major

[jira] [Commented] (SPARK-23310) Perf regression introduced by SPARK-21113

[ https://issues.apache.org/jira/browse/SPARK-23310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351048#comment-16351048 ] Sameer Agarwal commented on SPARK-23310: [~sitalke...@gmail.com] it'd be great if you can create

[jira] [Commented] (SPARK-23290) inadvertent change in handling of DateType when converting to pandas dataframe

[ https://issues.apache.org/jira/browse/SPARK-23290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350860#comment-16350860 ] Sameer Agarwal commented on SPARK-23290: [~amenck] [~aash] any updates here? > inadvert

[jira] [Resolved] (SPARK-23293) data source v2 self join fails

[ https://issues.apache.org/jira/browse/SPARK-23293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal resolved SPARK-23293. Resolution: Fixed Fix Version/s: 2.3.0 > data source v2 self join fa

[jira] [Updated] (SPARK-23309) Spark 2.3 cached query performance 20-30% worse then spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-23309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23309: --- Target Version/s: 2.3.0 > Spark 2.3 cached query performance 20-30% worse then spark

[jira] [Commented] (SPARK-23284) Document several get API of ColumnVector's behavior when accessing null slot

[ https://issues.apache.org/jira/browse/SPARK-23284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349353#comment-16349353 ] Sameer Agarwal commented on SPARK-23284: Thanks, given the other open blockers, we should have

[jira] [Commented] (SPARK-23304) Spark SQL coalesce() against hive not working

[ https://issues.apache.org/jira/browse/SPARK-23304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349346#comment-16349346 ] Sameer Agarwal commented on SPARK-23304: Also, is there a JIRA/repro for the caching issue you

[jira] [Commented] (SPARK-23307) Spark UI should sort jobs/stages with the completed timestamp before cleaning up them

[ https://issues.apache.org/jira/browse/SPARK-23307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349323#comment-16349323 ] Sameer Agarwal commented on SPARK-23307: Bumping this to a blocker for 2.3 > Spark UI sho

[jira] [Updated] (SPARK-23307) Spark UI should sort jobs/stages with the completed timestamp before cleaning up them

[ https://issues.apache.org/jira/browse/SPARK-23307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23307: --- Priority: Blocker (was: Major) > Spark UI should sort jobs/stages with the comple

[jira] [Updated] (SPARK-23307) Spark UI should sort jobs/stages with the completed timestamp before cleaning up them

[ https://issues.apache.org/jira/browse/SPARK-23307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23307: --- Target Version/s: 2.3.0 > Spark UI should sort jobs/stages with the completed timest

[jira] [Commented] (SPARK-23304) Spark SQL coalesce() against hive not working

[ https://issues.apache.org/jira/browse/SPARK-23304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349147#comment-16349147 ] Sameer Agarwal commented on SPARK-23304: [~tgraves] just to rule out the obvious

[jira] [Commented] (SPARK-23107) ML, Graph 2.3 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-23107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16349090#comment-16349090 ] Sameer Agarwal commented on SPARK-23107: Thanks [~yanboliang], I'll cut the next RC as soon

Re: [VOTE] Spark 2.3.0 (RC2)

e ML side >> that should be everything outstanding. >> >> >> On Thu, 1 Feb 2018 at 06:21 Yin Huai <yh...@databricks.com> wrote: >> >> seems we are not running tests related to pandas in pyspark tests (see my >> email "python tests related to

[jira] [Commented] (SPARK-23107) ML, Graph 2.3 QA: API: New Scala APIs, docs

[ https://issues.apache.org/jira/browse/SPARK-23107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347576#comment-16347576 ] Sameer Agarwal commented on SPARK-23107: [~yanboliang] other than adding docs, are you

Re: [VOTE] Spark 2.3.0 (RC2)

ion from > 2.2.0. The ticket has a simple repro included, showing a query that works > in prior releases but now fails with an exception in the catalyst optimizer. > > On Fri, Jan 26, 2018 at 10:41 AM, Sameer Agarwal <sameer.a...@gmail.com> > wrote: > >> This v

[jira] [Updated] (SPARK-23202) Break down DataSourceV2Writer.commit into two phase

[ https://issues.apache.org/jira/browse/SPARK-23202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23202: --- Target Version/s: 2.3.0 > Break down DataSourceV2Writer.commit into two ph

[jira] [Updated] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23020: --- Fix Version/s: (was: 2.3.0) > Re-enable Flaky T

[jira] [Updated] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23020: --- Affects Version/s: (was: 2.3.0) 2.4.0 > Re-enable Flaky T

[jira] [Updated] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23020: --- Target Version/s: 2.4.0 (was: 2.3.0) > Re-enable Flaky T

[jira] [Reopened] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal reopened SPARK-23020: > Re-enable Flaky Test: > org.apache.spark.launcher.SparkLauncherSuite.testInProcessLa

[jira] [Commented] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16342985#comment-16342985 ] Sameer Agarwal commented on SPARK-23020: I'm sorry but the flakiness in the test still refuses

[jira] [Reopened] (SPARK-22797) Add multiple column support to PySpark Bucketizer

[ https://issues.apache.org/jira/browse/SPARK-22797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal reopened SPARK-22797: > Add multiple column support to PySpark Bucketi

[jira] [Updated] (SPARK-22797) Add multiple column support to PySpark Bucketizer

[ https://issues.apache.org/jira/browse/SPARK-22797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-22797: --- Fix Version/s: (was: 2.3.0) > Add multiple column support to PySpark Bucketi

[jira] [Resolved] (SPARK-23207) Shuffle+Repartition on an DataFrame could lead to incorrect answers

[ https://issues.apache.org/jira/browse/SPARK-23207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal resolved SPARK-23207. Resolution: Fixed Fix Version/s: 2.4.0 2.3.0 Issue resolved

Re: [VOTE] Spark 2.3.0 (RC2)

This vote has failed due to a number of aforementioned blockers. I'll follow up with RC3 as soon as the 2 remaining (non-QA) blockers are resolved: https://s.apache.org/oXKi On 25 January 2018 at 12:59, Sameer Agarwal <sameer.a...@gmail.com> wrote: > > Most tests pass on RC2, exce

Re: [VOTE] Spark 2.3.0 (RC2)

ones). It is not long, but it seems some of those need >>> to be looked at. It would be nice for the committers who are involved >>> in those bugs to take a look. >>> >>> [1] https://superuser.com/questions/318809/linux-os-x- >>> tar-i

Re: [VOTE] Spark 2.3.0 (RC2)

an our internal tests and they seem happy. >> >> >> >> My concern is the list of open bugs targeted at 2.3.0 (ignoring the >> >> documentation ones). It is not long, but it seems some of those need >> >> to be looked at. It would be nice for the committers w

[jira] [Updated] (SPARK-21717) Decouple the generated codes of consuming rows in operators under whole-stage codegen

[ https://issues.apache.org/jira/browse/SPARK-21717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-21717: --- Target Version/s: 2.3.0 Priority: Critical (was: Major) > Decou

[jira] [Assigned] (SPARK-23207) Shuffle+Repartition on an RDD/DataFrame could lead to Data Loss

[ https://issues.apache.org/jira/browse/SPARK-23207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal reassigned SPARK-23207: -- Assignee: Jiang Xingbo > Shuffle+Repartition on an RDD/DataFrame could lead to D

[jira] [Updated] (SPARK-23207) Shuffle+Repartition on an RDD/DataFrame could lead to Data Loss

[ https://issues.apache.org/jira/browse/SPARK-23207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23207: --- Priority: Blocker (was: Major) > Shuffle+Repartition on an RDD/DataFrame could lead to D

[jira] [Commented] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338016#comment-16338016 ] Sameer Agarwal commented on SPARK-23020: FYI The {{SparkLauncherSuite}} test is still failing

[jira] [Updated] (SPARK-22739) Additional Expression Support for Objects

[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-22739: --- Target Version/s: 2.4.0 (was: 2.3.0) > Additional Expression Support for Obje

[jira] [Commented] (SPARK-22739) Additional Expression Support for Objects

[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336565#comment-16336565 ] Sameer Agarwal commented on SPARK-22739: Agree, I'll re-target this for 2.4.0 for now

[jira] [Issue Comment Deleted] (SPARK-21646) Add new type coercion rules to compatible with Hive

[ https://issues.apache.org/jira/browse/SPARK-21646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-21646: --- Comment: was deleted (was: Marking it as a duplicate of SPARK-22722) > Add new t

[VOTE] Spark 2.3.0 (RC2)

Please vote on releasing the following candidate as Apache Spark version 2.3.0. The vote is open until Friday January 26, 2018 at 8:00:00 am UTC and passes if a majority of at least 3 PMC +1 votes are cast. [ ] +1 Release this package as Apache Spark 2.3.0 [ ] -1 Do not release this package

[jira] [Resolved] (SPARK-23000) Flaky test suite DataSourceWithHiveMetastoreCatalogSuite in Spark 2.3

[ https://issues.apache.org/jira/browse/SPARK-23000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal resolved SPARK-23000. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by [https://github.com/apache

[jira] [Resolved] (SPARK-23135) Accumulators don't show up properly in the Stages page anymore

[ https://issues.apache.org/jira/browse/SPARK-23135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal resolved SPARK-23135. Resolution: Fixed > Accumulators don't show up properly in the Stages page anym

[jira] [Assigned] (SPARK-23135) Accumulators don't show up properly in the Stages page anymore

[ https://issues.apache.org/jira/browse/SPARK-23135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal reassigned SPARK-23135: -- Assignee: Marcelo Vanzin Fix Version/s: 2.3.0 Issue resolved by pull request

Re: [VOTE] Spark 2.3.0 (RC1)

This vote has failed in favor of a new RC. I'll follow up with a new RC2 as soon as the 3 remaining test/UI blockers <https://s.apache.org/oXKi> are resolved. On 17 January 2018 at 16:38, Sameer Agarwal <sameer.a...@gmail.com> wrote: > Thanks, will do! > > On 16 January

Re: Build timed out for `branch-2.3 (hadoop-2.7)`

mit. > > [SPARK-23028] Bump master branch version to 2.4.0-SNAPSHOT > <https://github.com/apache/spark/commit/651f76153f5e9b185aaf593161d40cabe7994fea> > > 2. Marco Gaido reports a flaky test suite and it turns out that the test > suite hangs in SPARK-23055 > <https:/

Re: [VOTE] Spark 2.3.0 (RC1)

we publish it's important to get > the key in the Apache web of trust. > > On Tue, Jan 16, 2018 at 3:00 PM, Sameer Agarwal <sameer.a...@gmail.com> > wrote: > >> Yes, I'll cut an RC2 as soon as the remaining blockers are resolved. In >> the meantime, please continue to re

[jira] [Updated] (SPARK-23135) Accumulators don't show up properly in the Stages page anymore

[ https://issues.apache.org/jira/browse/SPARK-23135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23135: --- Target Version/s: 2.3.0 > Accumulators don't show up properly in the Stages page anym

[jira] [Assigned] (SPARK-23104) Document that kubernetes is still "experimental"

[ https://issues.apache.org/jira/browse/SPARK-23104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal reassigned SPARK-23104: -- Assignee: Anirudh Ramanathan > Document that kubernetes is still "expe

[jira] [Commented] (SPARK-23104) Document that kubernetes is still "experimental"

[ https://issues.apache.org/jira/browse/SPARK-23104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16329644#comment-16329644 ] Sameer Agarwal commented on SPARK-23104: Sounds great, thanks! > Document that kuberne

[jira] [Updated] (SPARK-23020) Re-enable Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23020: --- Summary: Re-enable Flaky Test

[jira] [Commented] (SPARK-23020) Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328325#comment-16328325 ] Sameer Agarwal commented on SPARK-23020: I had to revert this patch as it broke

[jira] [Reopened] (SPARK-23020) Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal reopened SPARK-23020: > Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLaunc

[jira] [Updated] (SPARK-23020) Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23020: --- Fix Version/s: (was: 2.3.0) > Flaky T

Re: [VOTE] Spark 2.3.0 (RC1)

tion in Spark UI is broken >> >> Critical: >> SPARK-22739 Additional Expression Support for Objects >> >> I actually don't think any of those Blockers should be Blockers; not sure >> if the last one is really critical either. >> >> I think this release

[jira] [Updated] (SPARK-22739) Additional Expression Support for Objects

[ https://issues.apache.org/jira/browse/SPARK-22739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-22739: --- Priority: Major (was: Critical) > Additional Expression Support for Obje

[jira] [Resolved] (SPARK-23020) Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal resolved SPARK-23020. Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 20223 [https

[jira] [Assigned] (SPARK-23020) Flaky Test: org.apache.spark.launcher.SparkLauncherSuite.testInProcessLauncher

[ https://issues.apache.org/jira/browse/SPARK-23020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal reassigned SPARK-23020: -- Assignee: Marcelo Vanzin > Flaky T

[jira] [Commented] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325396#comment-16325396 ] Sameer Agarwal commented on SPARK-23065: No, the jekyll error didn't fail the doc build. We

[jira] [Updated] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23065: --- Attachment: Screen Shot 2018-01-13 at 3.15.48 PM.png Screen Shot 2018-01-13

[jira] [Commented] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325068#comment-16325068 ] Sameer Agarwal commented on SPARK-23065: Thanks for verifying this [~felixcheung]! While

[jira] [Assigned] (SPARK-23065) R API doc empty in Spark 2.3.0 RC1

[ https://issues.apache.org/jira/browse/SPARK-23065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal reassigned SPARK-23065: -- Assignee: Sameer Agarwal > R API doc empty in Spark 2.3.0

[jira] [Updated] (SPARK-23063) Changes to publish the spark-kubernetes package

[ https://issues.apache.org/jira/browse/SPARK-23063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-23063: --- Target Version/s: 2.3.0 Priority: Blocker (was: Major) > Changes to publ

[jira] [Resolved] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal resolved SPARK-23055. Resolution: Fixed Assignee: Sameer Agarwal Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-23055) KafkaContinuousSourceSuite Kafka column types test failing

[ https://issues.apache.org/jira/browse/SPARK-23055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324718#comment-16324718 ] Sameer Agarwal commented on SPARK-23055: I've reverted https://github.com/apache/spark/pull/20096

[jira] [Updated] (SPARK-22908) add basic continuous kafka source

[ https://issues.apache.org/jira/browse/SPARK-22908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-22908: --- Target Version/s: 2.3.0 > add basic continuous kafka sou

[jira] [Reopened] (SPARK-22908) add basic continuous kafka source

[ https://issues.apache.org/jira/browse/SPARK-22908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal reopened SPARK-22908: Re-opening this ticket as we've temporarily reverted https://github.com/apache/spark/pull

[VOTE] Spark 2.3.0 (RC1)

Please vote on releasing the following candidate as Apache Spark version 2.3.0. The vote is open until Thursday January 18, 2018 at 8:00:00 am UTC and passes if a majority of at least 3 PMC +1 votes are cast. [ ] +1 Release this package as Apache Spark 2.3.0 [ ] -1 Do not release this package

  1   2   3   4   >