Re: SSH Tunneling issue with Apache Spark

2023-12-06 Thread Venkatesan Muniappan
ySQL/blob/f13f054abcc18b39855a760a84be0a517f0da658/pymysql/protocol.py> > of > the MySQL client-server protocol. It does not use JDBC. > > > On Dec 6, 2023, at 10:43 PM, Venkatesan Muniappan < > venkatesa...@noonacademy.com> wrote: > > Thanks for the advice Nicholas. > >

Re: SSH Tunneling issue with Apache Spark

2023-12-06 Thread Venkatesan Muniappan
the dev list. Moving dev to bcc. > > One thing I would try is to connect to this database using JDBC + SSH > tunnel, but without Spark. That way you can focus on getting the JDBC > connection to work without Spark complicating the picture for you. > > > On Dec 5, 2023, at 8:12 

SSH Tunneling issue with Apache Spark

2023-12-05 Thread Venkatesan Muniappan
Hi Team, I am facing an issue with SSH Tunneling in Apache Spark. The behavior is same as the one in this Stackoverflow question but there are no answers there. This is what I am trying:

How Spark establishes connectivity to Hive

2022-03-14 Thread Venkatesan Muniappan
hi Team, I wanted to understand how spark connects to Hive. Does it connect to Hive metastore directly bypassing hive server?. Lets say when we are inserting data into a hive table with its I/O format as Parquet. Does Spark creates the parquet file from the Dataframe/RDD/DataSet and put it in its

Re: Show create table on a Hive Table in Spark SQL - Treats CHAR, VARCHAR as STRING

2022-03-12 Thread Venkatesan Muniappan
hi, Does anybody else have a better suggestion for my problem?. Thanks, Venkat 2016173438 On Fri, Mar 11, 2022 at 4:43 PM Venkatesan Muniappan < m.venkatbe...@gmail.com> wrote: > ok. I work for an org where such upgrades take a few months. Not an > immediate task. > >

Re: Show create table on a Hive Table in Spark SQL - Treats CHAR, VARCHAR as STRING

2022-03-11 Thread Venkatesan Muniappan
ing on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Fri, 11 Mar 2022 at 21:35, Venkatesan Muniappan < > m.venkatbe...@gmail.com> wro

Re: Show create table on a Hive Table in Spark SQL - Treats CHAR, VARCHAR as STRING

2022-03-11 Thread Venkatesan Muniappan
wiki.apache.org/confluence/display/hive/languagemanual+types > > > HTH > > > > view my Linkedin profile > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > > https://en.everybodywiki.com/Mich_Talebzadeh > > > > *Disclaimer:* Use it a

Re: Show create table on a Hive Table in Spark SQL - Treats CHAR, VARCHAR as STRING

2022-03-11 Thread Venkatesan Muniappan
on' = '2', > > 'transient_lastDdlTime' = '1647024660') > > | > > > +

Show create table on a Hive Table in Spark SQL - Treats CHAR, VARCHAR as STRING

2022-03-11 Thread Venkatesan Muniappan
hi Spark Team, I have raised a question on Spark through Stackoverflow. When you get a chance, can you please take a look and help me ?. https://stackoverflow.com/q/71431757/5927843 Thanks, Venkat 2016173438