Re: I would like to add JDBCDialect to support Vertica database

2019-12-11 Thread Jungtaek Lim
n install master > branch and latest binary and apply patches since I have root on all my test > boxes, but customers may not be able to. Still, this provides another > route to support new JDBC dialects. > > > > BryanH > > > > *From:* Wenchen Fan [mailto:cloud0...

Re: I would like to add JDBCDialect to support Vertica database

2019-12-11 Thread Takeshi Yamamuro
e.spark.sql.jdbc.VerticaDialect) >> >> >> >> If it would be preferable to write documentation describing the above, I >> can do that instead. The hard part is checking out the matching >> apache/spark tree then copying to the Spark cluster – I can install master >>

Re: I would like to add JDBCDialect to support Vertica database

2019-12-11 Thread Hyukjin Kwon
xes, but customers may not be able to. Still, this provides another > route to support new JDBC dialects. > > > > BryanH > > > > *From:* Wenchen Fan [mailto:cloud0...@gmail.com] > *Sent:* Wednesday, December 11, 2019 10:48 AM > *To:* Xiao Li > *Cc:* Bryan Herger

RE: I would like to add JDBCDialect to support Vertica database

2019-12-11 Thread Bryan Herger
I have root on all my test boxes, but customers may not be able to. Still, this provides another route to support new JDBC dialects. BryanH From: Wenchen Fan [mailto:cloud0...@gmail.com] Sent: Wednesday, December 11, 2019 10:48 AM To: Xiao Li Cc: Bryan Herger ; Sean Owen ; dev@spark.apache.o

Re: I would like to add JDBCDialect to support Vertica database

2019-12-11 Thread Wenchen Fan
but not sure where in the repo that would go. >> If automated testing is required, I can ask our engineers whether there >> exists something like a mockito that could be included. >> >> >> >> Thanks, Bryan H >> >> >> >> *From:* Xiao Li [mailto:

Re: I would like to add JDBCDialect to support Vertica database

2019-12-11 Thread Xiao Li
sday, December 11, 2019 10:13 AM > *To:* Sean Owen > *Cc:* Bryan Herger ; dev@spark.apache.org > *Subject:* Re: I would like to add JDBCDialect to support Vertica database > > > > How can the dev community test it? > > > > Xiao > > > > On Wed, Dec 11, 2019

RE: I would like to add JDBCDialect to support Vertica database

2019-12-11 Thread Bryan Herger
like to add JDBCDialect to support Vertica database How can the dev community test it? Xiao On Wed, Dec 11, 2019 at 6:52 AM Sean Owen mailto:sro...@gmail.com>> wrote: It's probably OK, IMHO. The overhead of another dialect is small. Are there differences that require a new dialect? I ass

Re: I would like to add JDBCDialect to support Vertica database

2019-12-11 Thread Xiao Li
How can the dev community test it? Xiao On Wed, Dec 11, 2019 at 6:52 AM Sean Owen wrote: > It's probably OK, IMHO. The overhead of another dialect is small. Are > there differences that require a new dialect? I assume so and might > just be useful to summarize them if you open a PR. > > On

Re: I would like to add JDBCDialect to support Vertica database

2019-12-11 Thread Sean Owen
It's probably OK, IMHO. The overhead of another dialect is small. Are there differences that require a new dialect? I assume so and might just be useful to summarize them if you open a PR. On Tue, Dec 10, 2019 at 7:14 AM Bryan Herger wrote: > > Hi, I am a Vertica support engineer, and we have

I would like to add JDBCDialect to support Vertica database

2019-12-10 Thread Bryan Herger
Hi, I am a Vertica support engineer, and we have open support requests around NULL values and SQL type conversion with DataFrame read/write over JDBC when connecting to a Vertica database. The stack traces point to issues with the generic JDBCDialect in Spark-SQL. I saw that other vendors