Re: LLM script for error message improvement

+1 from my side, I'm fine to have it as a helper script On Thu, Aug 3, 2023 at 10:53 AM Hyukjin Kwon wrote: > I think adding that dev tool script to improve the error message is fine. > > On Thu, 3 Aug 2023 at 10:24, Haejoon Lee > wrote: > >> Dear contributors, I hope you are doing well! >> >>

Re: Spark writing API

Hello Spark Devs Could anyone help me with this? Thanks, Andrew On Wed, May 31, 2023 at 20:57 Andrew Melo wrote: > Hi all > > I've been developing for some time a Spark DSv2 plugin "Laurelin" ( > https://github.com/spark-root/laurelin > ) to read the ROOT (https://root.cern) file format

Re: LLM script for error message improvement

I think adding that dev tool script to improve the error message is fine. On Thu, 3 Aug 2023 at 10:24, Haejoon Lee wrote: > Dear contributors, I hope you are doing well! > > I see there are contributors who are interested in working on error > message improvements and persistent contribution,

LLM script for error message improvement

Dear contributors, I hope you are doing well! I see there are contributors who are interested in working on error message improvements and persistent contribution, so I want to share an llm-based error message improvement script for helping your contribution. You can find a detail for the script

Query hints visible to DSV2 connectors?

Hey folks, I'm adding an optional feature to my DSV2 connector where it can choose between a row-based or columnar PartitionReader dynamically depending on a query's schema. I'd like to be able to supply a hint at query time that's visible to the connector, but at the moment I can't see any way

[VOTE][RESULT] XML data source support

The vote passes with 7 +1s (4 binding +1s). Thank you all for your comments and votes! (* = binding) Adrian Pop-Tifrea Hyukjin Kwon * Jia Fan Mich Talebzadeh Maciej Szymkiewicz * Sean Owen * Xiao Li * SPIP link:

Re: [Reminder] Spark 3.5 RC Cut

@Dongjoon Hyun FYI [image: image.png] We better ask common-...@hadoop.apache.org. ons. 2. aug. 2023 kl. 18:03 skrev Dongjoon Hyun : > Oh, I got it, Emil and Bjorn. > > Dongjoon. > > On Wed, Aug 2, 2023 at 12:32 AM Bjørn Jørgensen > wrote: > >> "*As far as I can tell this makes both 3.3.5 and

Re: [Reminder] Spark 3.5 RC Cut

Oh, I got it, Emil and Bjorn. Dongjoon. On Wed, Aug 2, 2023 at 12:32 AM Bjørn Jørgensen wrote: > "*As far as I can tell this makes both 3.3.5 and 3.3.6 unusable with s3 > without providing an alternative committer code.*" > > https://github.com/apache/hadoop/pull/5706#issuecomment-1619927992 >

Re: [Reminder] Spark 3.5 RC Cut

"*As far as I can tell this makes both 3.3.5 and 3.3.6 unusable with s3 without providing an alternative committer code.*" https://github.com/apache/hadoop/pull/5706#issuecomment-1619927992 ons. 2. aug. 2023 kl. 08:05 skrev Emil Ejbyfeldt : > > Apache Spark is not affected by HADOOP-18757

Re: [Reminder] Spark 3.5 RC Cut

> Apache Spark is not affected by HADOOP-18757 because it is not a part of > both Apache Hadoop 3.3.5 and 3.3.6. I am not sure I am following what you are trying to say here. Is that the jira is saying that only 3.3.5 is affected? Here I think the Jira is just incorrect. The jira was created