[jira] [Updated] (SPARK-28264) Revisiting Python / pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-28264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28264: - Labels: release-notes (was: ) > Revisiting Python / pandas UDF >

[jira] [Commented] (SPARK-31948) expose mapSideCombine in aggByKey/reduceByKey/foldByKey

[ https://issues.apache.org/jira/browse/SPARK-31948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132930#comment-17132930 ] zhengruifeng commented on SPARK-31948: -- [~viirya] [~srowen]   I will test whether there is

[jira] [Resolved] (SPARK-31966) Flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction

[ https://issues.apache.org/jira/browse/SPARK-31966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31966. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28798

[jira] [Updated] (SPARK-31964) Avoid Pandas import for CategoricalDtype with Arrow conversion

[ https://issues.apache.org/jira/browse/SPARK-31964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31964: -- Issue Type: Improvement (was: Bug) > Avoid Pandas import for CategoricalDtype with Arrow

[jira] [Assigned] (SPARK-31965) Run the tests in registerJavaFunction and registerJavaUDAF only when test classes are complied

[ https://issues.apache.org/jira/browse/SPARK-31965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31965: - Assignee: Hyukjin Kwon > Run the tests in registerJavaFunction and registerJavaUDAF

[jira] [Resolved] (SPARK-31965) Run the tests in registerJavaFunction and registerJavaUDAF only when test classes are complied

[ https://issues.apache.org/jira/browse/SPARK-31965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31965. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28795

[jira] [Commented] (SPARK-31966) Flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction

[ https://issues.apache.org/jira/browse/SPARK-31966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132900#comment-17132900 ] Apache Spark commented on SPARK-31966: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-31966) Flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction

[ https://issues.apache.org/jira/browse/SPARK-31966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132898#comment-17132898 ] Apache Spark commented on SPARK-31966: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-31966) Flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction

[ https://issues.apache.org/jira/browse/SPARK-31966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31966: Assignee: Hyukjin Kwon (was: Apache Spark) > Flaky test:

[jira] [Assigned] (SPARK-31966) Flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction

[ https://issues.apache.org/jira/browse/SPARK-31966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31966: Assignee: Apache Spark (was: Hyukjin Kwon) > Flaky test:

[jira] [Updated] (SPARK-31966) Flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction

[ https://issues.apache.org/jira/browse/SPARK-31966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31966: - Fix Version/s: (was: 3.0.0) > Flaky test: pyspark.mllib.tests.test_streaming_algorithms >

[jira] [Updated] (SPARK-31966) Flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction

[ https://issues.apache.org/jira/browse/SPARK-31966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31966: - Description:

[jira] [Created] (SPARK-31966) Flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction

Hyukjin Kwon created SPARK-31966: Summary: Flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction Key: SPARK-31966 URL:

[jira] [Updated] (SPARK-31915) Resolve the grouping column properly per the case sensitivity in grouped and cogrouped pandas UDFs

[ https://issues.apache.org/jira/browse/SPARK-31915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31915: - Fix Version/s: 3.0.1 > Resolve the grouping column properly per the case sensitivity in grouped

[jira] [Commented] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132890#comment-17132890 ] Apache Spark commented on SPARK-31926: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31942) Revert SPARK-31864 Adjust AQE skew join trigger condition

[ https://issues.apache.org/jira/browse/SPARK-31942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31942: --- Assignee: Manu Zhang > Revert SPARK-31864 Adjust AQE skew join trigger condition >

[jira] [Resolved] (SPARK-31942) Revert SPARK-31864 Adjust AQE skew join trigger condition

[ https://issues.apache.org/jira/browse/SPARK-31942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31942. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28770

[jira] [Assigned] (SPARK-31939) Fix Parsing day of year when year field pattern is missing

[ https://issues.apache.org/jira/browse/SPARK-31939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31939: --- Assignee: Kent Yao > Fix Parsing day of year when year field pattern is missing >

[jira] [Resolved] (SPARK-31939) Fix Parsing day of year when year field pattern is missing

[ https://issues.apache.org/jira/browse/SPARK-31939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31939. - Fix Version/s: 3.1.0 3.0.1 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-31935) Hadoop file system config should be effective in data source options

[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132882#comment-17132882 ] Apache Spark commented on SPARK-31935: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-31965) Run the tests in registerJavaFunction and registerJavaUDAF only when test classes are complied

[ https://issues.apache.org/jira/browse/SPARK-31965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132878#comment-17132878 ] Apache Spark commented on SPARK-31965: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-31965) Run the tests in registerJavaFunction and registerJavaUDAF only when test classes are complied

[ https://issues.apache.org/jira/browse/SPARK-31965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132877#comment-17132877 ] Apache Spark commented on SPARK-31965: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-31965) Run the tests in registerJavaFunction and registerJavaUDAF only when test classes are complied

[ https://issues.apache.org/jira/browse/SPARK-31965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31965: Assignee: (was: Apache Spark) > Run the tests in registerJavaFunction and

[jira] [Assigned] (SPARK-31965) Run the tests in registerJavaFunction and registerJavaUDAF only when test classes are complied

[ https://issues.apache.org/jira/browse/SPARK-31965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31965: Assignee: Apache Spark > Run the tests in registerJavaFunction and registerJavaUDAF only

[jira] [Updated] (SPARK-31965) Run the tests in registerJavaFunction and registerJavaUDAF only when test classes are complied

[ https://issues.apache.org/jira/browse/SPARK-31965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31965: - Summary: Run the tests in registerJavaFunction and registerJavaUDAF only when test classes are

[jira] [Updated] (SPARK-31965) Run the tests in registerJavaFunction and registerJavaUDAF if test classes are not complied

[ https://issues.apache.org/jira/browse/SPARK-31965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31965: - Summary: Run the tests in registerJavaFunction and registerJavaUDAF if test classes are not

[jira] [Created] (SPARK-31965) Skip tests in registerJavaFunction and registerJavaUDAF if test classes are not complied

Hyukjin Kwon created SPARK-31965: Summary: Skip tests in registerJavaFunction and registerJavaUDAF if test classes are not complied Key: SPARK-31965 URL: https://issues.apache.org/jira/browse/SPARK-31965

[jira] [Updated] (SPARK-31955) Beeline discard the last line of the sql file when submited to thriftserver via beeline

[ https://issues.apache.org/jira/browse/SPARK-31955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-31955: Priority: Major (was: Blocker) > Beeline discard the last line of the sql file when submited to

[jira] [Commented] (SPARK-31956) Do not fail if there is no ambiguous self join

[ https://issues.apache.org/jira/browse/SPARK-31956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132845#comment-17132845 ] Dongjoon Hyun commented on SPARK-31956: --- Thanks, [~kabhwan]. > Do not fail if there is no

[jira] [Updated] (SPARK-31956) Do not fail if there is no ambiguous self join

[ https://issues.apache.org/jira/browse/SPARK-31956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31956: -- Fix Version/s: (was: 3.0.0) 3.0.1 > Do not fail if there is no

[jira] [Assigned] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31926: Assignee: (was: Apache Spark) > Fix concurrency issue for ThriftCLIService to

[jira] [Assigned] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31926: Assignee: Apache Spark > Fix concurrency issue for ThriftCLIService to getPortNumber >

[jira] [Assigned] (SPARK-31964) Avoid Pandas import for CategoricalDtype with Arrow conversion

[ https://issues.apache.org/jira/browse/SPARK-31964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31964: Assignee: Bryan Cutler > Avoid Pandas import for CategoricalDtype with Arrow conversion

[jira] [Resolved] (SPARK-31964) Avoid Pandas import for CategoricalDtype with Arrow conversion

[ https://issues.apache.org/jira/browse/SPARK-31964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31964. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28793

[jira] [Commented] (SPARK-31955) Beeline discard the last line of the sql file when submited to thriftserver via beeline

[ https://issues.apache.org/jira/browse/SPARK-31955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132812#comment-17132812 ] Lin Gang Deng commented on SPARK-31955: --- [~younggyuchun] No results.   {code:java} // code

[jira] [Commented] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132807#comment-17132807 ] Dongjoon Hyun commented on SPARK-31926: --- This is reverted because Maven test fails consistently.

[jira] [Commented] (SPARK-26905) Revisit reserved/non-reserved keywords based on the ANSI SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132806#comment-17132806 ] Takeshi Yamamuro commented on SPARK-26905: -- okay, I'll check if we can do so. > Revisit

[jira] [Assigned] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31926: - Assignee: (was: Kent Yao) > Fix concurrency issue for ThriftCLIService to

[jira] [Updated] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31926: -- Fix Version/s: (was: 3.0.1) (was: 3.1.0) > Fix concurrency issue

[jira] [Reopened] (SPARK-31926) Fix concurrency issue for ThriftCLIService to getPortNumber

[ https://issues.apache.org/jira/browse/SPARK-31926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-31926: --- > Fix concurrency issue for ThriftCLIService to getPortNumber >

[jira] [Assigned] (SPARK-31964) Avoid Pandas import for CategoricalDtype with Arrow conversion

[ https://issues.apache.org/jira/browse/SPARK-31964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31964: Assignee: (was: Apache Spark) > Avoid Pandas import for CategoricalDtype with Arrow

[jira] [Commented] (SPARK-31964) Avoid Pandas import for CategoricalDtype with Arrow conversion

[ https://issues.apache.org/jira/browse/SPARK-31964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132803#comment-17132803 ] Apache Spark commented on SPARK-31964: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-31964) Avoid Pandas import for CategoricalDtype with Arrow conversion

[ https://issues.apache.org/jira/browse/SPARK-31964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31964: Assignee: Apache Spark > Avoid Pandas import for CategoricalDtype with Arrow conversion

[jira] [Created] (SPARK-31964) Avoid Pandas import for CategoricalDtype with Arrow conversion

Bryan Cutler created SPARK-31964: Summary: Avoid Pandas import for CategoricalDtype with Arrow conversion Key: SPARK-31964 URL: https://issues.apache.org/jira/browse/SPARK-31964 Project: Spark

[jira] [Commented] (SPARK-31935) Hadoop file system config should be effective in data source options

[ https://issues.apache.org/jira/browse/SPARK-31935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132788#comment-17132788 ] Apache Spark commented on SPARK-31935: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Comment Edited] (SPARK-25186) Stabilize Data Source V2 API

[ https://issues.apache.org/jira/browse/SPARK-25186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132780#comment-17132780 ] Jeremy Bloom edited comment on SPARK-25186 at 6/10/20, 11:18 PM: - I'm

[jira] [Commented] (SPARK-25186) Stabilize Data Source V2 API

[ https://issues.apache.org/jira/browse/SPARK-25186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132780#comment-17132780 ] Jeremy Bloom commented on SPARK-25186: -- I'm not sure whether I'm in the right place, but I want to

[jira] [Resolved] (SPARK-31915) Resolve the grouping column properly per the case sensitivity in grouped and cogrouped pandas UDFs

[ https://issues.apache.org/jira/browse/SPARK-31915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler resolved SPARK-31915. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28777

[jira] [Assigned] (SPARK-31915) Resolve the grouping column properly per the case sensitivity in grouped and cogrouped pandas UDFs

[ https://issues.apache.org/jira/browse/SPARK-31915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler reassigned SPARK-31915: Assignee: Hyukjin Kwon > Resolve the grouping column properly per the case sensitivity

[jira] [Commented] (SPARK-28199) Move Trigger implementations to Triggers.scala and avoid exposing these to the end users

[ https://issues.apache.org/jira/browse/SPARK-28199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132756#comment-17132756 ] Apache Spark commented on SPARK-28199: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Comment Edited] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132743#comment-17132743 ] Everett Rush edited comment on SPARK-27249 at 6/10/20, 9:52 PM: I

[jira] [Commented] (SPARK-27249) Developers API for Transformers beyond UnaryTransformer

[ https://issues.apache.org/jira/browse/SPARK-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132743#comment-17132743 ] Everett Rush commented on SPARK-27249: -- I checked out the code and the design. Thanks for the great

[jira] [Commented] (SPARK-31961) Add a class in spark with all Kafka configuration key available as string

[ https://issues.apache.org/jira/browse/SPARK-31961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132742#comment-17132742 ] Jungtaek Lim commented on SPARK-31961: -- Great. Then just construct the config you want use like

[jira] [Assigned] (SPARK-31963) Support both pandas 0.23 and 1.0

[ https://issues.apache.org/jira/browse/SPARK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31963: - Assignee: William Hyun > Support both pandas 0.23 and 1.0 >

[jira] [Resolved] (SPARK-31963) Support both pandas 0.23 and 1.0

[ https://issues.apache.org/jira/browse/SPARK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31963. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28789

[jira] [Commented] (SPARK-31961) Add a class in spark with all Kafka configuration key available as string

[ https://issues.apache.org/jira/browse/SPARK-31961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132739#comment-17132739 ] Gunjan Kumar commented on SPARK-31961: -- no,kafka users dont write down config like that there are

[jira] [Comment Edited] (SPARK-31961) Add a class in spark with all Kafka configuration key available as string

[ https://issues.apache.org/jira/browse/SPARK-31961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132736#comment-17132736 ] Jungtaek Lim edited comment on SPARK-31961 at 6/10/20, 9:37 PM: My point

[jira] [Commented] (SPARK-31961) Add a class in spark with all Kafka configuration key available as string

[ https://issues.apache.org/jira/browse/SPARK-31961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132736#comment-17132736 ] Jungtaek Lim commented on SPARK-31961: -- My point is that given they're Kafka config why you're

[jira] [Commented] (SPARK-31961) Add a class in spark with all Kafka configuration key available as string

[ https://issues.apache.org/jira/browse/SPARK-31961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132725#comment-17132725 ] Gunjan Kumar commented on SPARK-31961: -- spark will not be tied to kafka version as these property

[jira] [Updated] (SPARK-31963) Support both pandas 0.23 and 1.0

[ https://issues.apache.org/jira/browse/SPARK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31963: -- Component/s: SQL > Support both pandas 0.23 and 1.0 > > >

[jira] [Commented] (SPARK-31963) Support both pandas 0.23 and 1.0

[ https://issues.apache.org/jira/browse/SPARK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132714#comment-17132714 ] Apache Spark commented on SPARK-31963: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-31963) Support both pandas 0.23 and 1.0

[ https://issues.apache.org/jira/browse/SPARK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31963: Assignee: Apache Spark > Support both pandas 0.23 and 1.0 >

[jira] [Assigned] (SPARK-31963) Support both pandas 0.23 and 1.0

[ https://issues.apache.org/jira/browse/SPARK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31963: Assignee: (was: Apache Spark) > Support both pandas 0.23 and 1.0 >

[jira] [Commented] (SPARK-31963) Support both pandas 0.23 and 1.0

[ https://issues.apache.org/jira/browse/SPARK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132713#comment-17132713 ] Apache Spark commented on SPARK-31963: -- User 'williamhyun' has created a pull request for this

[jira] [Created] (SPARK-31963) Support both pandas 0.23 and 1.0

William Hyun created SPARK-31963: Summary: Support both pandas 0.23 and 1.0 Key: SPARK-31963 URL: https://issues.apache.org/jira/browse/SPARK-31963 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-31962) Provide option to load files after a specified date when reading from a folder path

[ https://issues.apache.org/jira/browse/SPARK-31962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Highman updated SPARK-31962: Description: When using structured streaming with a FileDataSource, I've

[jira] [Commented] (SPARK-31962) Provide option to load files after a specified date when reading from a folder path

[ https://issues.apache.org/jira/browse/SPARK-31962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132708#comment-17132708 ] Christopher Highman commented on SPARK-31962: - I have a good, working version of this for

[jira] [Created] (SPARK-31962) Provide option to load files after a specified date when reading from a folder path

Christopher Highman created SPARK-31962: --- Summary: Provide option to load files after a specified date when reading from a folder path Key: SPARK-31962 URL: https://issues.apache.org/jira/browse/SPARK-31962

[jira] [Updated] (SPARK-31962) Provide option to load files after a specified date when reading from a folder path

[ https://issues.apache.org/jira/browse/SPARK-31962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christopher Highman updated SPARK-31962: Description: When using structured streaming with a FileDataSource, I've

[jira] [Commented] (SPARK-31961) Add a class in spark with all Kafka configuration key available as string

[ https://issues.apache.org/jira/browse/SPARK-31961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132707#comment-17132707 ] Jungtaek Lim commented on SPARK-31961: -- Don't you think the constant should be available in Kafka

[jira] [Updated] (SPARK-31961) Add a class in spark with all Kafka configuration key available as string

[ https://issues.apache.org/jira/browse/SPARK-31961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-31961: - Fix Version/s: (was: 2.4.7) > Add a class in spark with all Kafka configuration key

[jira] [Created] (SPARK-31961) Add a class in spark with all Kafka configuration key available as string

Gunjan Kumar created SPARK-31961: Summary: Add a class in spark with all Kafka configuration key available as string Key: SPARK-31961 URL: https://issues.apache.org/jira/browse/SPARK-31961 Project:

[jira] [Commented] (SPARK-7101) Spark SQL should support java.sql.Time

[ https://issues.apache.org/jira/browse/SPARK-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132694#comment-17132694 ] YoungGyu Chun commented on SPARK-7101: -- I will try to get this done but there are a ton of work ;)

[jira] [Commented] (SPARK-31956) Do not fail if there is no ambiguous self join

[ https://issues.apache.org/jira/browse/SPARK-31956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132687#comment-17132687 ] Jungtaek Lim commented on SPARK-31956: -- Probably the correct fix version would be 3.0.1, as 3.0.0

[jira] [Resolved] (SPARK-31956) Do not fail if there is no ambiguous self join

[ https://issues.apache.org/jira/browse/SPARK-31956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31956. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28783

[jira] [Assigned] (SPARK-31960) Only populate Hadoop classpath for no-hadoop build

[ https://issues.apache.org/jira/browse/SPARK-31960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31960: Assignee: Apache Spark > Only populate Hadoop classpath for no-hadoop build >

[jira] [Assigned] (SPARK-31960) Only populate Hadoop classpath for no-hadoop build

[ https://issues.apache.org/jira/browse/SPARK-31960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31960: Assignee: (was: Apache Spark) > Only populate Hadoop classpath for no-hadoop build >

[jira] [Assigned] (SPARK-31960) Only populate Hadoop classpath for no-hadoop build

[ https://issues.apache.org/jira/browse/SPARK-31960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31960: Assignee: Apache Spark > Only populate Hadoop classpath for no-hadoop build >

[jira] [Commented] (SPARK-31960) Only populate Hadoop classpath for no-hadoop build

[ https://issues.apache.org/jira/browse/SPARK-31960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132682#comment-17132682 ] Apache Spark commented on SPARK-31960: -- User 'dbtsai' has created a pull request for this issue:

[jira] [Updated] (SPARK-31960) Only populate Hadoop classpath for no-hadoop build

[ https://issues.apache.org/jira/browse/SPARK-31960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-31960: Summary: Only populate Hadoop classpath for no-hadoop build (was: Only populate Hadoop classpath when

[jira] [Created] (SPARK-31960) Only populate Hadoop classpath when hadoop is provided

DB Tsai created SPARK-31960: --- Summary: Only populate Hadoop classpath when hadoop is provided Key: SPARK-31960 URL: https://issues.apache.org/jira/browse/SPARK-31960 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-31959) Test failure "RebaseDateTimeSuite.optimization of micros rebasing - Gregorian to Julian"

[ https://issues.apache.org/jira/browse/SPARK-31959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132593#comment-17132593 ] Apache Spark commented on SPARK-31959: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31959) Test failure "RebaseDateTimeSuite.optimization of micros rebasing - Gregorian to Julian"

[ https://issues.apache.org/jira/browse/SPARK-31959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31959: Assignee: Apache Spark > Test failure "RebaseDateTimeSuite.optimization of micros

[jira] [Assigned] (SPARK-31959) Test failure "RebaseDateTimeSuite.optimization of micros rebasing - Gregorian to Julian"

[ https://issues.apache.org/jira/browse/SPARK-31959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31959: Assignee: (was: Apache Spark) > Test failure "RebaseDateTimeSuite.optimization of

[jira] [Assigned] (SPARK-31925) Summary.totalIterations greater than maxIters

[ https://issues.apache.org/jira/browse/SPARK-31925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31925: Assignee: (was: Apache Spark) > Summary.totalIterations greater than maxIters >

[jira] [Assigned] (SPARK-31925) Summary.totalIterations greater than maxIters

[ https://issues.apache.org/jira/browse/SPARK-31925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31925: Assignee: Apache Spark > Summary.totalIterations greater than maxIters >

[jira] [Commented] (SPARK-31925) Summary.totalIterations greater than maxIters

[ https://issues.apache.org/jira/browse/SPARK-31925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132582#comment-17132582 ] Apache Spark commented on SPARK-31925: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-31948) expose mapSideCombine in aggByKey/reduceByKey/foldByKey

[ https://issues.apache.org/jira/browse/SPARK-31948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132569#comment-17132569 ] L. C. Hsieh commented on SPARK-31948: - I guess I have similar question. When the reduction factor

[jira] [Issue Comment Deleted] (SPARK-31955) Beeline discard the last line of the sql file when submited to thriftserver via beeline

[ https://issues.apache.org/jira/browse/SPARK-31955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YoungGyu Chun updated SPARK-31955: -- Comment: was deleted (was: Thanks, I will work on this) > Beeline discard the last line of

[jira] [Created] (SPARK-31959) Test failure "RebaseDateTimeSuite.optimization of micros rebasing - Gregorian to Julian"

Maxim Gekk created SPARK-31959: -- Summary: Test failure "RebaseDateTimeSuite.optimization of micros rebasing - Gregorian to Julian" Key: SPARK-31959 URL: https://issues.apache.org/jira/browse/SPARK-31959

[jira] [Commented] (SPARK-31955) Beeline discard the last line of the sql file when submited to thriftserver via beeline

[ https://issues.apache.org/jira/browse/SPARK-31955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132566#comment-17132566 ] YoungGyu Chun commented on SPARK-31955: --- Try this rather than add a space between select statement

[jira] [Commented] (SPARK-31955) Beeline discard the last line of the sql file when submited to thriftserver via beeline

[ https://issues.apache.org/jira/browse/SPARK-31955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132549#comment-17132549 ] YoungGyu Chun commented on SPARK-31955: --- Thanks, I will work on this > Beeline discard the last

[jira] [Resolved] (SPARK-31890) Decommissioning Test Does not wait long enough for executors to launch

[ https://issues.apache.org/jira/browse/SPARK-31890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31890. -- Fix Version/s: 3.1.0 Resolution: Fixed Fixed in one of the decom PRs >

[jira] [Comment Edited] (SPARK-31955) Beeline discard the last line of the sql file when submited to thriftserver via beeline

[ https://issues.apache.org/jira/browse/SPARK-31955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130795#comment-17130795 ] Lin Gang Deng edited comment on SPARK-31955 at 6/10/20, 3:29 PM: -

[jira] [Commented] (SPARK-31955) Beeline discard the last line of the sql file when submited to thriftserver via beeline

[ https://issues.apache.org/jira/browse/SPARK-31955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130795#comment-17130795 ] Lin Gang Deng commented on SPARK-31955: --- {code:java} // code placeholder 0:

[jira] [Commented] (SPARK-31958) normalize special floating numbers in subquery

[ https://issues.apache.org/jira/browse/SPARK-31958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130789#comment-17130789 ] Apache Spark commented on SPARK-31958: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31958) normalize special floating numbers in subquery

[ https://issues.apache.org/jira/browse/SPARK-31958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31958: Assignee: Apache Spark (was: Wenchen Fan) > normalize special floating numbers in

[jira] [Assigned] (SPARK-31958) normalize special floating numbers in subquery

[ https://issues.apache.org/jira/browse/SPARK-31958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31958: Assignee: Wenchen Fan (was: Apache Spark) > normalize special floating numbers in

[jira] [Created] (SPARK-31958) normalize special floating numbers in subquery

Wenchen Fan created SPARK-31958: --- Summary: normalize special floating numbers in subquery Key: SPARK-31958 URL: https://issues.apache.org/jira/browse/SPARK-31958 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-31955) Beeline discard the last line of the sql file when submited to thriftserver via beeline

[ https://issues.apache.org/jira/browse/SPARK-31955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17130750#comment-17130750 ] YoungGyu Chun edited comment on SPARK-31955 at 6/10/20, 2:45 PM: -

  1   2   >