[jira] [Updated] (SPARK-48222) Sync Ruby Bundler to 2.4.22 and refresh Gem lock file

[ https://issues.apache.org/jira/browse/SPARK-48222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-48222: - Component/s: Documentation > Sync Ruby Bundler to 2.4.22 and refresh Gem lock f

[jira] [Created] (SPARK-48222) Sync Ruby Bundler to 2.4.22 and refresh Gem lock file

Nicholas Chammas created SPARK-48222: Summary: Sync Ruby Bundler to 2.4.22 and refresh Gem lock file Key: SPARK-48222 URL: https://issues.apache.org/jira/browse/SPARK-48222 Project: Spark

[jira] [Created] (SPARK-48176) Fix name of FIELD_ALREADY_EXISTS error condition

Nicholas Chammas created SPARK-48176: Summary: Fix name of FIELD_ALREADY_EXISTS error condition Key: SPARK-48176 URL: https://issues.apache.org/jira/browse/SPARK-48176 Project: Spark

[jira] [Created] (SPARK-48107) Exclude tests from Python distribution

Nicholas Chammas created SPARK-48107: Summary: Exclude tests from Python distribution Key: SPARK-48107 URL: https://issues.apache.org/jira/browse/SPARK-48107 Project: Spark Issue Type

[jira] [Commented] (SPARK-47429) Rename errorClass to errorCondition and subClass to subCondition

[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842694#comment-17842694 ] Nicholas Chammas commented on SPARK-47429: -- I think one intermediate step we can take here

[jira] [Updated] (SPARK-47429) Rename errorClass to errorCondition and subClass to subCondition

[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-47429: - Summary: Rename errorClass to errorCondition and subClass to subCondition (was: Rename

[jira] [Updated] (SPARK-47429) Rename errorClass to errorCondition

[ https://issues.apache.org/jira/browse/SPARK-47429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-47429: - Description: We've agreed on the parent task to rename {{errorClass}} to align it more

[jira] [Commented] (SPARK-28024) Incorrect numeric values when out of range

[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837292#comment-17837292 ] Nicholas Chammas commented on SPARK-28024: -- [~cloud_fan] - Given the updated descriptions

Re: [DISCUSS] SPARK-44444: Use ANSI SQL mode by default

This is a side issue, but I’d like to bring people’s attention to SPARK-28024. Cases 2, 3, and 4 described in that ticket are still problems today on master (I just rechecked) even with ANSI mode enabled. Well, maybe not problems, but I’m flagging this since Spark’s behavior differs in these

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-28024: - Description: Spark on {{master}} at commit {{de00ac8a05aedb3a150c8c10f76d1fe5496b1df3

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-28024: - Description: Spark on {{master}} at commit {{de00ac8a05aedb3a150c8c10f76d1fe5496b1df3

[jira] [Commented] (SPARK-28024) Incorrect numeric values when out of range

[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836706#comment-17836706 ] Nicholas Chammas commented on SPARK-28024: -- I've just retried cases 2-4 on master with ANSI

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-28024: - Description: As compared to PostgreSQL 16. Case 1: {code:sql} select tinyint(128

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-28024: - Description: As compared to PostgreSQL 16. Case 1: {code:sql} select tinyint(128

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-28024: - Description: As compared to PostgreSQL 16. Case 1: {code:sql} select tinyint(128

[jira] [Updated] (SPARK-28024) Incorrect numeric values when out of range

[ https://issues.apache.org/jira/browse/SPARK-28024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-28024: - Description: As compared to PostgreSQL 16. Case 1: {code:sql} select tinyint(128

[jira] [Created] (SPARK-47429) Rename errorClass to errorCondition

Nicholas Chammas created SPARK-47429: Summary: Rename errorClass to errorCondition Key: SPARK-47429 URL: https://issues.apache.org/jira/browse/SPARK-47429 Project: Spark Issue Type: Sub

[jira] [Commented] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17823713#comment-17823713 ] Nicholas Chammas commented on SPARK-46810: -- [~cloud_fan], [~LuciferYang], [~beliefer

[jira] [Created] (SPARK-47271) Explain importance of statistics on SQL performance tuning page

Nicholas Chammas created SPARK-47271: Summary: Explain importance of statistics on SQL performance tuning page Key: SPARK-47271 URL: https://issues.apache.org/jira/browse/SPARK-47271 Project

[jira] [Created] (SPARK-47252) Clarify that pivot may trigger an eager computation

Nicholas Chammas created SPARK-47252: Summary: Clarify that pivot may trigger an eager computation Key: SPARK-47252 URL: https://issues.apache.org/jira/browse/SPARK-47252 Project: Spark

[jira] [Created] (SPARK-47216) Refine layout of SQL performance tuning page

Nicholas Chammas created SPARK-47216: Summary: Refine layout of SQL performance tuning page Key: SPARK-47216 URL: https://issues.apache.org/jira/browse/SPARK-47216 Project: Spark Issue

[jira] [Commented] (SPARK-47190) Add support for checkpointing to Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-47190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17821286#comment-17821286 ] Nicholas Chammas commented on SPARK-47190: -- [~gurwls223] - Is there some design reason we do

[jira] [Created] (SPARK-47190) Add support for checkpointing to Spark Connect

Nicholas Chammas created SPARK-47190: Summary: Add support for checkpointing to Spark Connect Key: SPARK-47190 URL: https://issues.apache.org/jira/browse/SPARK-47190 Project: Spark Issue

[jira] [Created] (SPARK-47189) Tweak column error names and text

Nicholas Chammas created SPARK-47189: Summary: Tweak column error names and text Key: SPARK-47189 URL: https://issues.apache.org/jira/browse/SPARK-47189 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-47180) Migrate CSV parsing off of Univocity

Nicholas Chammas created SPARK-47180: Summary: Migrate CSV parsing off of Univocity Key: SPARK-47180 URL: https://issues.apache.org/jira/browse/SPARK-47180 Project: Spark Issue Type

Re: Generating config docs automatically

dea); but that’s just my > opinion. I'd be happy to help with reviews though. > > On Wed, Feb 21, 2024 at 6:37 AM Nicholas Chammas <mailto:nicholas.cham...@gmail.com>> wrote: >> I know config documentation is not the most exciting thing. If there is >> anything I can d

Re: Generating config docs automatically

I know config documentation is not the most exciting thing. If there is anything I can do to make this as easy as possible for a committer to shepherd, I’m all ears! > On Feb 14, 2024, at 8:53 PM, Nicholas Chammas > wrote: > > I’m interested in automating our config documentat

[jira] [Updated] (SPARK-47082) Out of bounds error message is incorrect

[ https://issues.apache.org/jira/browse/SPARK-47082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-47082: - Summary: Out of bounds error message is incorrect (was: Out of bounds error message

[jira] [Created] (SPARK-47082) Out of bounds error message flips the bounds

Nicholas Chammas created SPARK-47082: Summary: Out of bounds error message flips the bounds Key: SPARK-47082 URL: https://issues.apache.org/jira/browse/SPARK-47082 Project: Spark Issue

Generating config docs automatically

I’m interested in automating our config documentation and need input from a committer who is interested in shepherding this work. We have around 60 tables of configs across our documentation. Here’s a typical example.

Re: How do you debug a code-generated aggregate?

aFrame. That helped me to find similar issues in > most cases. > > HTH > > On Sun, Feb 11, 2024 at 11:26 PM Nicholas Chammas <mailto:nicholas.cham...@gmail.com>> wrote: >> Consider this example: >> >>> from pyspark.sql.functions import sum >> &

[jira] [Resolved] (SPARK-47024) Sum of floats/doubles may be incorrect depending on partitioning

[ https://issues.apache.org/jira/browse/SPARK-47024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-47024. -- Resolution: Not A Problem Resolving this as "Not A Problem". I mea

[jira] [Updated] (SPARK-47024) Sum of floats/doubles may be incorrect depending on partitioning

[ https://issues.apache.org/jira/browse/SPARK-47024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-47024: - Description: I found this problem using [Hypothesis|https://hypothesis.readthedocs.io

[jira] [Created] (SPARK-47024) Sum is incorrect (exact cause currently unknown)

Nicholas Chammas created SPARK-47024: Summary: Sum is incorrect (exact cause currently unknown) Key: SPARK-47024 URL: https://issues.apache.org/jira/browse/SPARK-47024 Project: Spark

How do you debug a code-generated aggregate?

Consider this example: >>> from pyspark.sql.functions import sum >>> spark.range(4).repartition(2).select(sum("id")).show() +---+ |sum(id)| +---+ | 6| +---+ I’m trying to understand how this works because I’m investigating a bug in this kind of aggregate. I see that

[jira] [Updated] (SPARK-46992) Inconsistent results with 'sort', 'cache', and AQE.

[ https://issues.apache.org/jira/browse/SPARK-46992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46992: - Labels: correctness (was: ) > Inconsistent results with 'sort', 'cache', and

[jira] [Commented] (SPARK-46992) Inconsistent results with 'sort', 'cache', and AQE.

[ https://issues.apache.org/jira/browse/SPARK-46992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814913#comment-17814913 ] Nicholas Chammas commented on SPARK-46992: -- I can confirm the behavior described above is still

[jira] [Commented] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17814406#comment-17814406 ] Nicholas Chammas commented on SPARK-46810: -- [~cloud_fan], [~LuciferYang], [~beliefer

[jira] [Commented] (SPARK-40549) PYSPARK: Observation computes the wrong results when using `corr` function

[ https://issues.apache.org/jira/browse/SPARK-40549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813780#comment-17813780 ] Nicholas Chammas commented on SPARK-40549: -- I think this is just a consequence of floating

[jira] [Commented] (SPARK-45786) Inaccurate Decimal multiplication and division results

[ https://issues.apache.org/jira/browse/SPARK-45786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813766#comment-17813766 ] Nicholas Chammas commented on SPARK-45786: -- [~kazuyukitanimura] - I'm just curious: How did you

[jira] [Commented] (SPARK-38167) CSV parsing error when using escape='"'

[ https://issues.apache.org/jira/browse/SPARK-38167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813741#comment-17813741 ] Nicholas Chammas commented on SPARK-38167: -- [~marnixvandenbroek] - Could you link to the bug

[jira] [Updated] (SPARK-42399) CONV() silently overflows returning wrong results

[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-42399: - Affects Version/s: (was: 3.5.0) > CONV() silently overflows returning wrong resu

[jira] [Commented] (SPARK-42399) CONV() silently overflows returning wrong results

[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17813733#comment-17813733 ] Nicholas Chammas commented on SPARK-42399: -- This issue does indeed appear to be resolved

[jira] [Updated] (SPARK-42399) CONV() silently overflows returning wrong results

[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-42399: - Affects Version/s: 3.5.0 > CONV() silently overflows returning wrong resu

[jira] [Updated] (SPARK-42399) CONV() silently overflows returning wrong results

[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-42399: - Labels: correctness pull-request-available (was: pull-request-available) > C

[jira] [Updated] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Created] (SPARK-46935) Consolidate error documentation

Nicholas Chammas created SPARK-46935: Summary: Consolidate error documentation Key: SPARK-46935 URL: https://issues.apache.org/jira/browse/SPARK-46935 Project: Spark Issue Type

[jira] [Updated] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Updated] (SPARK-46923) Limit width of config tables in documentation and style them consistently

[ https://issues.apache.org/jira/browse/SPARK-46923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46923: - Summary: Limit width of config tables in documentation and style them consistently

[jira] [Created] (SPARK-46923) Style config tables in documentation consistently

Nicholas Chammas created SPARK-46923: Summary: Style config tables in documentation consistently Key: SPARK-46923 URL: https://issues.apache.org/jira/browse/SPARK-46923 Project: Spark

[jira] [Commented] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811923#comment-17811923 ] Nicholas Chammas commented on SPARK-46810: -- I think Option 3 is a good compromise that lets us

[jira] [Created] (SPARK-46894) Move PySpark error conditions into standalone JSON file

Nicholas Chammas created SPARK-46894: Summary: Move PySpark error conditions into standalone JSON file Key: SPARK-46894 URL: https://issues.apache.org/jira/browse/SPARK-46894 Project: Spark

[jira] [Commented] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811627#comment-17811627 ] Nicholas Chammas commented on SPARK-46810: -- Thanks for sharing the relevant quote, [~srielau

[jira] [Comment Edited] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811470#comment-17811470 ] Nicholas Chammas edited comment on SPARK-46810 at 1/27/24 5:00 AM

[jira] [Updated] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Commented] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811470#comment-17811470 ] Nicholas Chammas commented on SPARK-46810: -- [~srielau] - What do you think of the problem

[jira] [Updated] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Updated] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Created] (SPARK-46863) Clean up custom.css

Nicholas Chammas created SPARK-46863: Summary: Clean up custom.css Key: SPARK-46863 URL: https://issues.apache.org/jira/browse/SPARK-46863 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46825) Build Spark only once when building docs

Nicholas Chammas created SPARK-46825: Summary: Build Spark only once when building docs Key: SPARK-46825 URL: https://issues.apache.org/jira/browse/SPARK-46825 Project: Spark Issue Type

[jira] [Created] (SPARK-46819) Port error class data to automation-friendly format

Nicholas Chammas created SPARK-46819: Summary: Port error class data to automation-friendly format Key: SPARK-46819 URL: https://issues.apache.org/jira/browse/SPARK-46819 Project: Spark

[jira] [Updated] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

Re: End-user troubleshooting of bad c-ares interaction with router

s family AF_UNSPEC and let c-ares > do the right thing. > > > > On 1/23/24 11:25 AM, Nicholas Chammas wrote: >> Thank you for all the troubleshooting help, Brad. >> >> I am using gRPC via Apache Spark Connect (a Python library), so I am two >> levels

Re: End-user troubleshooting of bad c-ares interaction with router

cently enhanced with logic to assist in the exact scenario you are > seeing, basically it will stop retrying when at least one address family is > returned. > > You might need to escalate this to the gRPC folks. > > On 1/22/24 12:10 PM, Nicholas Chammas wro

[jira] [Updated] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46810: - Description: We use inconsistent terminology when talking about error classes. I'd like

[jira] [Commented] (SPARK-46810) Clarify error class terminology

[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809804#comment-17809804 ] Nicholas Chammas commented on SPARK-46810: -- [~itholic] [~gurwls223] - What do you think? cc

[jira] [Created] (SPARK-46810) Clarify error class terminology

Nicholas Chammas created SPARK-46810: Summary: Clarify error class terminology Key: SPARK-46810 URL: https://issues.apache.org/jira/browse/SPARK-46810 Project: Spark Issue Type

[jira] [Created] (SPARK-46807) Include automation notice in SQL error class documents

Nicholas Chammas created SPARK-46807: Summary: Include automation notice in SQL error class documents Key: SPARK-46807 URL: https://issues.apache.org/jira/browse/SPARK-46807 Project: Spark

[grpc-io] Re: What version of c-ares is gRPC running?

Looks like the information I'm looking for may be here: https://github.com/grpc/grpc/tree/v1.60.0/third_party/cares If I'm understanding this correctly, gRPC 1.60.0 should be running c-ares 1.19.1. On Thursday, January 18, 2024 at 8:13:34 PM UTC-5 Nicholas Chammas wrote: > How can I tell w

Re: End-user troubleshooting of bad c-ares interaction with router

> Can you try using those to do the same lookup so we can see the results? > > On 1/19/24 11:01 AM, Nicholas Chammas wrote: >> >>> On Jan 17, 2024, at 3:38 PM, Brad House >>> <mailto:b...@brad-house.com> wrote: >>> What version of c-ares

[jira] [Commented] (AVRO-3923) Add Avro 1.11.3 release blog

[ https://issues.apache.org/jira/browse/AVRO-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809199#comment-17809199 ] Nicholas Chammas commented on AVRO-3923: Silly question but: Is this URL supposed to 404? [https

Re: Removing Kinesis in Spark 4

etch to > leave it lying around until Spark 5. > It's not exactly unused though. > > I would not object to removing it unless there is some voice of support here. > > On Sat, Jan 20, 2024 at 10:38 AM Nicholas Chammas <mailto:nicholas.cham...@gmail.com>> wrote:

Removing Kinesis in Spark 4

From the dev thread: What else could be removed in Spark 4? > On Aug 17, 2023, at 1:44 AM, Yang Jie wrote: > > I would like to know how we should handle the two Kinesis-related modules in > Spark 4.0. They have a very low

[jira] [Created] (SPARK-46775) Fix formatting of Kinesis docs

Nicholas Chammas created SPARK-46775: Summary: Fix formatting of Kinesis docs Key: SPARK-46775 URL: https://issues.apache.org/jira/browse/SPARK-46775 Project: Spark Issue Type

Re: End-user troubleshooting of bad c-ares interaction with router

> On Jan 17, 2024, at 3:38 PM, Brad House wrote: > What version of c-ares is installed? > Sorry about the delay in responding. Answering this question is more difficult than I expected. I know that Spark Connect is running gRPC 1.160.0. Looking through the gRPC repo, I see mention of c-ares

[jira] [Created] (SPARK-46764) Reorganize Ruby script to build API docs

Nicholas Chammas created SPARK-46764: Summary: Reorganize Ruby script to build API docs Key: SPARK-46764 URL: https://issues.apache.org/jira/browse/SPARK-46764 Project: Spark Issue Type

[grpc-io] What version of c-ares is gRPC running?

How can I tell what version of c-ares gRPC is running? I am running a Spark Connect program which uses gRPC under the hood. I tried enabling some gRPC debug information as follows: GRPC_TRACE=cares_resolver,cares_address_sorting,dns_resolver GRPC_VERBOSITY=DEBUG python my-script.py But even

End-user troubleshooting of bad c-ares interaction with router

Hello, I am trying to troubleshoot a problem as an end-user of c-ares. I use a library (Apache Spark Connect ) that uses gRPC, which in turn uses c-ares. I am two levels removed from c-ares itself and am a little out of my

[jira] [Commented] (RAT-352) Enable use of wildcard expressions in exclude file

[ https://issues.apache.org/jira/browse/RAT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807311#comment-17807311 ] Nicholas Chammas commented on RAT-352: -- > would it make sense to provide a CLI option that re

[jira] [Commented] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806954#comment-17806954 ] Nicholas Chammas commented on SPARK-45599: -- Using [Hypothesis|https://github.com

[jira] [Created] (RAT-352) Enable use of wildcard expressions in exclude file

Nicholas Chammas created RAT-352: Summary: Enable use of wildcard expressions in exclude file Key: RAT-352 URL: https://issues.apache.org/jira/browse/RAT-352 Project: Apache Rat Issue Type

[jira] [Commented] (RAT-323) Harmonize UIs

[ https://issues.apache.org/jira/browse/RAT-323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806930#comment-17806930 ] Nicholas Chammas commented on RAT-323: -- Big +1 for enabling the CLI to use SCM ignores as excludes

[jira] [Commented] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806150#comment-17806150 ] Nicholas Chammas commented on SPARK-45599: -- cc [~dongjoon] - This is an old correctness bug

[jira] [Updated] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-45599: - Labels: correctness (was: data-corruption) > Percentile can produce a wrong ans

[jira] [Commented] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset

[ https://issues.apache.org/jira/browse/SPARK-45599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806148#comment-17806148 ] Nicholas Chammas commented on SPARK-45599: -- I can confirm that this bug is still present

[jira] [Updated] (SPARK-46395) Assign Spark configs to groups for use in documentation

[ https://issues.apache.org/jira/browse/SPARK-46395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46395: - Summary: Assign Spark configs to groups for use in documentation (was: Automatically

[jira] [Created] (SPARK-46668) Parallelize Sphinx build of Python API docs

Nicholas Chammas created SPARK-46668: Summary: Parallelize Sphinx build of Python API docs Key: SPARK-46668 URL: https://issues.apache.org/jira/browse/SPARK-46668 Project: Spark Issue

Install Ruby 3 to build the docs

Just a quick heads up that, while Ruby 2.7 will continue to work, you should plan to install Ruby 3 in the near future in order to build the docs. (I recommend using rbenv to manage multiple Ruby versions.) Ruby 2 reached EOL in March 2023

[jira] [Created] (SPARK-46658) Loosen Ruby dependency specs for doc build

Nicholas Chammas created SPARK-46658: Summary: Loosen Ruby dependency specs for doc build Key: SPARK-46658 URL: https://issues.apache.org/jira/browse/SPARK-46658 Project: Spark Issue

[jira] [Updated] (SPARK-46437) Enable conditional includes in Jekyll documentation

[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46437: - Component/s: (was: SQL) > Enable conditional includes in Jekyll documentat

[jira] [Updated] (SPARK-46437) Enable conditional includes in Jekyll documentation

[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46437: - Summary: Enable conditional includes in Jekyll documentation (was: Remove unnecessary

[jira] [Created] (SPARK-46626) Bump jekyll version to support Ruby 3.3

Nicholas Chammas created SPARK-46626: Summary: Bump jekyll version to support Ruby 3.3 Key: SPARK-46626 URL: https://issues.apache.org/jira/browse/SPARK-46626 Project: Spark Issue Type

[grpc-io] Re: QUEUE_TIMEOUT on one network but not another

The formatting came out weird on my original post (especially for the code blocks), so here it is again as a GitHub gist: https://gist.github.com/nchammas/5eb46cbbcc8f5fc197cefbc2b0add819 -- You received this message because you are subscribed to the Google Groups "grpc.io" group. To

[grpc-io] QUEUE_TIMEOUT on one network but not another

I have a very simple Spark Connect Python script that is showing very strange behavior that I am having trouble debugging. Spark Connect uses gRPC under the hood to communicate with a remote Apache Spark cluster. The cluster

[jira] [Updated] (SPARK-46449) Add ability to create databases/schemas via Catalog API

[ https://issues.apache.org/jira/browse/SPARK-46449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46449: - Summary: Add ability to create databases/schemas via Catalog API (was: Add ability

[jira] [Updated] (SPARK-46449) Add ability to create databases via Catalog API

[ https://issues.apache.org/jira/browse/SPARK-46449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-46449: - Description: As of Spark 3.5, the only way to create a database is via SQL. The Catalog

Re: Validate spark sql

This is a user-list question, not a dev-list question. Moving this conversation to the user list and BCC-ing the dev list. Also, this statement > We are not validating against table or column existence. is not correct. When you call spark.sql(…), Spark will lookup the table references and

Re: Validate spark sql

This is a user-list question, not a dev-list question. Moving this conversation to the user list and BCC-ing the dev list. Also, this statement > We are not validating against table or column existence. is not correct. When you call spark.sql(…), Spark will lookup the table references and

[jira] [Created] (SPARK-46449) Add ability to create databases via Catalog API

Nicholas Chammas created SPARK-46449: Summary: Add ability to create databases via Catalog API Key: SPARK-46449 URL: https://issues.apache.org/jira/browse/SPARK-46449 Project: Spark

[jira] [Created] (SPARK-46437) Remove unnecessary cruft from SQL built-in functions docs

Nicholas Chammas created SPARK-46437: Summary: Remove unnecessary cruft from SQL built-in functions docs Key: SPARK-46437 URL: https://issues.apache.org/jira/browse/SPARK-46437 Project: Spark

  1   2   3   4   5   6   7   8   9   10   >