unsubscribe

2023-03-06 Thread Shiv Prashant Sood
On Sun, 5 Mar 2023 at 18:27, zhangliyun wrote: > Hi all > > > i have a spark sql , before in spark 2.4.2 it runs correctly, when i > upgrade to spark 3.1.3, it has some problem. > > the sql > > ``` > > select * from eds_rds.cdh_prpc63cgudba_pp_index_disputecasedetails_hourly > where dt >=

Re: DataSourceV2 : Transactional Write support

2019-08-05 Thread Shiv Prashant Sood
ted records to the final table >> in driver (must be atomic). >> >> Thanks, >> Jungtaek Lim (HeartSaVioR) >> >> On Sat, Aug 3, 2019 at 4:56 AM Shiv Prashant Sood >> wrote: >> >>> All, >>> >>> I understood that DataSourceV2 suppo

DataSourceV2 : Transactional Write support

2019-08-02 Thread Shiv Prashant Sood
All, I understood that DataSourceV2 supports Transactional write and wanted to implement that in JDBC DataSource V2 connector ( PR#25211 ). Don't see how this is feasible for JDBC based connector. The FW suggest that EXECUTOR send a commit message

Re: JDBC connector for DataSourceV2

2019-07-15 Thread Shiv Prashant Sood
;, SPARK-25547 >> <https://issues.apache.org/jira/browse/SPARK-25547>, and SPARK-28380 >> <https://issues.apache.org/jira/browse/SPARK-28380> and finalize a plan. >> >> >> >> Xianyin >> >> >> >> *From: *Shiv Prashant Sood

Re: JDBC connector for DataSourceV2

2019-07-13 Thread Shiv Prashant Sood
Hi Guys, > > Don't know what's the intention exactly here but there is such a PR: > https://github.com/apache/spark/pull/22560 > If that's what we need maybe we can resurrect it. BTW, I'm also interested > in... > > BR, > G > > > On Sat, Jul 13, 2019 at 4:09 AM Shiv

Re: JDBC connector for DataSourceV2

2019-07-12 Thread Shiv Prashant Sood
n Blue > Reply-To: > Date: Saturday, July 13, 2019 at 6:54 AM > To: Shiv Prashant Sood > Cc: Spark Dev List > Subject: Re: JDBC connector for DataSourceV2 > > I'm not aware of a JDBC connector effort. It would be great to have someone > build one! > > On Fri, Ju

JDBC connector for DataSourceV2

2019-07-12 Thread Shiv Prashant Sood
Can someone please help understand the current Status of DataSource V2 based JDBC connector? I see connectors for various file formats in Master, but can't find a JDBC implementation or related JIRA. DatasourceV2 APIs to me look in good shape to attempt a JDBC connector for READ/WRITE path.