Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread Ruifeng Zheng
+1 On Wed, Mar 13, 2024 at 4:32 AM John Zhuge wrote: > +1 (non-binding) > > On Tue, Mar 12, 2024 at 8:45 AM L. C. Hsieh wrote: > >> +1 >> >> >> On Tue, Mar 12, 2024 at 8:20 AM Chao Sun wrote: >> >>> +1 >>> >>> On Tue, Mar 12, 2024 at 8:03 AM Xiao Li >>> wrote: >>> +1 On Tue,

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread John Zhuge
+1 (non-binding) On Tue, Mar 12, 2024 at 8:45 AM L. C. Hsieh wrote: > +1 > > > On Tue, Mar 12, 2024 at 8:20 AM Chao Sun wrote: > >> +1 >> >> On Tue, Mar 12, 2024 at 8:03 AM Xiao Li >> wrote: >> >>> +1 >>> >>> On Tue, Mar 12, 2024 at 6:09 AM Holden Karau >>> wrote: >>> +1

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread Robyn Nameth
+ 1 On Mon, Mar 11, 2024 at 3:46 AM Gengliang Wang wrote: > Hi all, > > I'd like to start the vote for SPIP: Structured Logging Framework for > Apache Spark > > References: > >- JIRA ticket >- SPIP doc > >

Re: Enhanced Console Sink for Structured Streaming

2024-03-12 Thread Neil Ramaswamy
For advanced users, it's certainly an option to look at the streaming query progress and use the state store reader to look at your state. However, the goal of this Enhanced Console Sink is to improve the experience for *new *users, i.e. it should work mostly out of the box. Let's move discussion

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread L. C. Hsieh
+1 On Tue, Mar 12, 2024 at 8:20 AM Chao Sun wrote: > +1 > > On Tue, Mar 12, 2024 at 8:03 AM Xiao Li > wrote: > >> +1 >> >> On Tue, Mar 12, 2024 at 6:09 AM Holden Karau >> wrote: >> >>> +1 >>> >>> Twitter: https://twitter.com/holdenkarau >>> Books (Learning Spark, High Performance Spark,

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread Chao Sun
+1 On Tue, Mar 12, 2024 at 8:03 AM Xiao Li wrote: > +1 > > On Tue, Mar 12, 2024 at 6:09 AM Holden Karau > wrote: > >> +1 >> >> Twitter: https://twitter.com/holdenkarau >> Books (Learning Spark, High Performance Spark, etc.): >> https://amzn.to/2MaRAG9 >> YouTube Live

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread Xiao Li
+1 On Tue, Mar 12, 2024 at 6:09 AM Holden Karau wrote: > +1 > > Twitter: https://twitter.com/holdenkarau > Books (Learning Spark, High Performance Spark, etc.): > https://amzn.to/2MaRAG9 > YouTube Live Streams: https://www.youtube.com/user/holdenkarau > > > On Mon,

Re: Enhanced Console Sink for Structured Streaming

2024-03-12 Thread Mich Talebzadeh
OK I have just been working on a Databricks engineering question raised by a user Monitoring structure streaming in external sink In practice there is an option to use

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

2024-03-12 Thread Holden Karau
+1 Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 YouTube Live Streams: https://www.youtube.com/user/holdenkarau On Mon, Mar 11, 2024 at 7:44 PM Reynold Xin wrote: > +1 > > > On Mon, Mar 11 2024