Re: spark jdbc

2021-12-17 Thread Sean Owen
I'm not sure we want to do that. If you "SELECT foo AS bar", then the column name is foo but the column label is bar. We probably want to return the latter. On Fri, Dec 17, 2021 at 9:07 AM Gary Liu wrote: > In spark sql jdbc module, it's using getColumnLabel to get column names > from the

spark jdbc

2021-12-17 Thread Gary Liu
In spark sql jdbc module, it's using getColumnLabel to get column names from the remote database, but in some databases, like SAS, it returns column description instead. Should getColumnName be used? This is from the SAS technical support: In the documentation,

Lift the limitation of Spark JDBC handling of individual rows with DML

2021-06-25 Thread Mich Talebzadeh
*Challenge* Insert data from Spark dataframe when one or more columns in theOracle table rely on some derived_colums dependent on data in one or more dataframe columns. Standard JDBC from Spark to Oracle does batch insert of dataframe into Oracle *so it cannot handle these derived columns*.

Re: Spark jdbc update SaveMode

2019-04-22 Thread NuthanReddy
Hi Maciej Bryński, Did you happen to finish that or is there a way to do it? -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: Spark jdbc update SaveMode

2016-07-22 Thread Maciej Bryński
2016-07-22 23:05 GMT+02:00 Ramon Rosa da Silva : > Hi Folks, > > > > What do you think about allow update SaveMode from > DataFrame.write.mode(“update”)? > > Now Spark just has jdbc insert. I'm working on patch that creates new mode - 'upsert'. In Mysql it will use

Spark jdbc update SaveMode

2016-07-22 Thread Ramon Rosa da Silva
Hi Folks, What do you think about allow update SaveMode from DataFrame.write.mode("update")? Now Spark just has jdbc insert. This e-mail message, including any attachments, is for the sole use of the person to whom it has been sent and may contain information that is confidential or legally