Re: welcome a new batch of committers

2018-10-05 Thread Suresh Thalamati
Congratulations to all! -suresh On Wed, Oct 3, 2018 at 1:59 AM Reynold Xin wrote: > Hi all, > > The Apache Spark PMC has recently voted to add several new committers to > the project, for their contributions: > > - Shane Knapp (contributor to infra) > - Dongjoon Hyun (contributor to ORC

Re: Welcoming Tejas Patil as a Spark committer

2017-10-03 Thread Suresh Thalamati
Congratulations , Tejas! -suresh > On Sep 29, 2017, at 12:58 PM, Matei Zaharia wrote: > > Hi all, > > The Spark PMC recently added Tejas Patil as a committer on the > project. Tejas has been contributing across several areas of Spark for > a while, focusing especially

Re: Continue reading dataframe from file despite errors

2017-09-12 Thread Suresh Thalamati
Try the CSV Option(“mode”, "dropmalformed”), that might skip the error records. > On Sep 12, 2017, at 2:33 PM, jeff saremi wrote: > > should have added some of the exception to be clear: > > 17/09/12 14:14:17 ERROR TaskSetManager: Task 0 in stage 15.0 failed 1

Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2 read path

2017-09-06 Thread Suresh Thalamati
+1 (non-binding) > On Sep 6, 2017, at 7:29 PM, Wenchen Fan wrote: > > Hi all, > > In the previous discussion, we decided to split the read and write path of > data source v2 into 2 SPIPs, and I'm sending this email to call a vote for > Data Source V2 read path only. >

Re: Welcoming Saisai (Jerry) Shao as a committer

2017-08-28 Thread Suresh Thalamati
Congratulations, Jerry > On Aug 28, 2017, at 6:28 PM, Matei Zaharia wrote: > > Hi everyone, > > The PMC recently voted to add Saisai (Jerry) Shao as a committer. Saisai has > been contributing to many areas of the project for a long time, so it’s great > to see him

[jira] [Created] (SPARK-21824) DROP TABLE should automatically drop any dependent referential constraints or raise error.

2017-08-24 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-21824: Summary: DROP TABLE should automatically drop any dependent referential constraints or raise error. Key: SPARK-21824 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Created] (SPARK-21823) ALTER TABLE table statements such as RENAME and CHANGE columns should raise error if there are any dependent constraints.

2017-08-24 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-21823: Summary: ALTER TABLE table statements such as RENAME and CHANGE columns should raise error if there are any dependent constraints. Key: SPARK-21823 URL: https

[jira] [Commented] (SPARK-21784) Add ALTER TABLE ADD CONSTRANT DDL to support defining primary key and foreign keys

2017-08-18 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131900#comment-16131900 ] Suresh Thalamati commented on SPARK-21784: -- I am working on implementation of this task. >

[jira] [Created] (SPARK-21784) Add ALTER TABLE ADD CONSTRANT DDL to support defining primary key and foreign keys

2017-08-18 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-21784: Summary: Add ALTER TABLE ADD CONSTRANT DDL to support defining primary key and foreign keys Key: SPARK-21784 URL: https://issues.apache.org/jira/browse/SPARK-21784

Re: Dataset count on database or parquet

2017-02-09 Thread Suresh Thalamati
If you have to get the data into parquet format for other reasons then I think count() on the parquet should be better. If it just the count you need using database sending dbTable = (select count(*) from ) might be quicker, t will avoid unnecessary data transfer from the database to

Re: Dataframe fails to save to MySQL table in spark app, but succeeds in spark shell

2017-01-26 Thread Suresh Thalamati
I notice columns are quoted wit double quotes in the error message ('"user","age","state”)) . By chance did you override the MySQL JDBC dialect, default MySQL identifiers are quoted with ` override def quoteIdentifier(colName: String): String = { s"`$colName`" } Just wondering if the error

Re: welcoming Burak and Holden as committers

2017-01-24 Thread Suresh Thalamati
Congratulations Burak and Holden! -suresh > On Jan 24, 2017, at 10:13 AM, Reynold Xin wrote: > > Hi all, > > Burak and Holden have recently been elected as Apache Spark committers. > > Burak has been very active in a large number of areas in Spark, including > linear

[jira] [Commented] (SPARK-19318) Docker test case failure: `SPARK-16625: General data types to be mapped to Oracle`

2017-01-20 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832659#comment-15832659 ] Suresh Thalamati commented on SPARK-19318: -- I am looking into this test failure. > Docker t

[jira] [Commented] (SPARK-17916) CSV data source treats empty string as null no matter what nullValue option is

2016-11-09 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15651172#comment-15651172 ] Suresh Thalamati commented on SPARK-17916: -- @Eric Liang If it is possible , can you please

[jira] [Created] (SPARK-18141) jdbc datasource read fails when quoted columns (eg:mixed case, reserved words) in source table are used in the filter.

2016-10-27 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-18141: Summary: jdbc datasource read fails when quoted columns (eg:mixed case, reserved words) in source table are used in the filter. Key: SPARK-18141 URL: https

[jira] [Commented] (SPARK-17916) CSV data source treats empty string as null no matter what nullValue option is

2016-10-20 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593119#comment-15593119 ] Suresh Thalamati commented on SPARK-17916: -- Thank you for trying out the different scenarios. I

Re: welcoming Xiao Li as a committer

2016-10-04 Thread Suresh Thalamati
Congratulations, Xiao! > On Oct 3, 2016, at 10:46 PM, Reynold Xin wrote: > > Hi all, > > Xiao Li, aka gatorsmile, has recently been elected as an Apache Spark > committer. Xiao has been a super active contributor to Spark SQL. Congrats > and welcome, Xiao! > > -

Re: Deep learning libraries for scala

2016-09-30 Thread Suresh Thalamati
Tensor frames https://spark-packages.org/package/databricks/tensorframes Hope that helps -suresh > On Sep 30, 2016, at 8:00 PM, janardhan shetty wrote: > > Looking for scala dataframes in particular ? > >

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-27 Thread Suresh Thalamati
+1 (non-binding) -suresh > On Sep 26, 2016, at 11:11 PM, Jagadeesan As wrote: > > +1 (non binding) > > Cheers, > Jagadeesan A S > > > > > From:Jean-Baptiste Onofré > To:dev@spark.apache.org > Date:27-09-16 11:27 AM > Subject:

[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

2016-09-22 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514246#comment-15514246 ] Suresh Thalamati commented on SPARK-14536: -- Yes. SPARK-10186 already added array support

[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

2016-09-22 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514129#comment-15514129 ] Suresh Thalamati commented on SPARK-14536: -- [~sowen] I am not sure why this issue got closed

[jira] [Reopened] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

2016-09-21 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Thalamati reopened SPARK-14536: -- SPARK-10186 added array data type support for postgres in 1.6. NPE issues still exists

Re: Spark_JDBC_Partitions

2016-09-13 Thread Suresh Thalamati
There is also another jdbc method in data frame reader api o specify your own predicates for each partition. Using this you can control what is included in each partition. val jdbcPartitionWhereClause = Array[String]("id < 100" , "id >=100 and id < 200") val df = spark.read.jdbc(

[jira] [Commented] (SPARK-17473) jdbc docker tests are failing with java.lang.AbstractMethodError:

2016-09-09 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477624#comment-15477624 ] Suresh Thalamati commented on SPARK-17473: -- E-mail exchange on dev : http://apache-spark

Re: Unable to run docker jdbc integrations test ?

2016-09-09 Thread Suresh Thalamati
n focus on bringing them up and I can go push my > previous experiments as a WIP PR. Otherwise we should just get rid of these > tests. > > Thoughts ? > > > On Tue, Sep 6, 2016 at 4:05 PM, Suresh Thalamati <suresh.thalam...@gmail.com > <mailto:suresh.thalam...@gma

[jira] [Created] (SPARK-17473) jdbc docker tests are failing with java.lang.AbstractMethodError:

2016-09-09 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-17473: Summary: jdbc docker tests are failing with java.lang.AbstractMethodError: Key: SPARK-17473 URL: https://issues.apache.org/jira/browse/SPARK-17473 Project

Unable to run docker jdbc integrations test ?

2016-09-06 Thread Suresh Thalamati
Hi, I am getting the following error , when I am trying to run jdbc docker integration tests on my laptop. Any ideas , what I might be be doing wrong ? build/mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=2.6.0 -Phive-thriftserver -Phive -DskipTests clean install build/mvn

[jira] [Commented] (SPARK-17385) Update Data in mySql using spark

2016-09-02 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459827#comment-15459827 ] Suresh Thalamati commented on SPARK-17385: -- Update is not supported from spark. Only option

Re: Welcoming Felix Cheung as a committer

2016-08-08 Thread Suresh Thalamati
Congratulations , Felix! > On Aug 8, 2016, at 11:15 AM, Ted Yu wrote: > > Congratulations, Felix. > > On Mon, Aug 8, 2016 at 11:15 AM, Matei Zaharia > wrote: > Hi all, > > The PMC recently voted to add Felix

Re: [VOTE] Release Apache Spark 2.0.0 (RC5)

2016-07-22 Thread Suresh Thalamati
+1 (non-binding) Tested data source api , and jdbc data sources. > On Jul 19, 2016, at 7:35 PM, Reynold Xin wrote: > > Please vote on releasing the following candidate as Apache Spark version > 2.0.0. The vote is open until Friday, July 22, 2016 at 20:00 PDT and passes

[jira] [Resolved] (SPARK-14218) dataset show() does not display column names in the correct order if underlying data frame schema order is different from the encoder schema order.

2016-07-19 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Thalamati resolved SPARK-14218. -- Resolution: Duplicate verified on 2.0 , and trunk. This issue is resolved. > data

Re: Welcoming Yanbo Liang as a committer

2016-06-04 Thread Suresh Thalamati
Congratulations, Yanbo > On Jun 3, 2016, at 7:48 PM, Matei Zaharia wrote: > > Hi all, > > The PMC recently voted to add Yanbo Liang as a committer. Yanbo has been a > super active contributor in many areas of MLlib. Please join me in welcoming > Yanbo! > > Matei >

[jira] [Commented] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

2016-05-25 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301392#comment-15301392 ] Suresh Thalamati commented on SPARK-12504: -- [~srowen] I worked on resolving this issue

[jira] [Created] (SPARK-15538) Truncate table does not work on data source table , and does not raise error either.

2016-05-25 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-15538: Summary: Truncate table does not work on data source table , and does not raise error either. Key: SPARK-15538 URL: https://issues.apache.org/jira/browse/SPARK-15538

[jira] [Commented] (SPARK-15538) Truncate table does not work on data source table , and does not raise error either.

2016-05-25 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300867#comment-15300867 ] Suresh Thalamati commented on SPARK-15538: -- Working on PR for this issue. > Truncate ta

Re: JDBC SQL Server RDD

2016-05-17 Thread Suresh Thalamati
What is the error you are getting ? At least on the main code line I see JDBCRDD is marked as private[sql]. Simple alternative might be to call sql server using data frame api , and get rdd from data frame. eg: val df =

[jira] [Commented] (SPARK-15315) CSV datasource writes garbage for complex types instead of rasing error.

2016-05-13 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283042#comment-15283042 ] Suresh Thalamati commented on SPARK-15315: -- I am working on submitting PR for this issue

[jira] [Created] (SPARK-15315) CSV datasource writes garbage for complex types instead of rasing error.

2016-05-13 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-15315: Summary: CSV datasource writes garbage for complex types instead of rasing error. Key: SPARK-15315 URL: https://issues.apache.org/jira/browse/SPARK-15315

[jira] [Commented] (SPARK-15112) Dataset filter returns garbage

2016-05-04 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271576#comment-15271576 ] Suresh Thalamati commented on SPARK-15112: -- I ran into similar issue SPARK-14218 > Data

[jira] [Created] (SPARK-15125) CSV data source recognizes empty quoted strings in the input as null.

2016-05-04 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-15125: Summary: CSV data source recognizes empty quoted strings in the input as null. Key: SPARK-15125 URL: https://issues.apache.org/jira/browse/SPARK-15125

[jira] [Commented] (SPARK-14840) Cannot drop a table which has the name starting with 'or'

2016-04-29 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264616#comment-15264616 ] Suresh Thalamati commented on SPARK-14840: -- On master(2.0) , this issue is fixed recently

[jira] [Commented] (SPARK-14343) Dataframe operations on a partitioned dataset (using partition discovery) return invalid results

2016-04-18 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246195#comment-15246195 ] Suresh Thalamati commented on SPARK-14343: -- This issue may be related to SPARK-14463

[jira] [Commented] (SPARK-14586) SparkSQL doesn't parse decimal like Hive

2016-04-15 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15243702#comment-15243702 ] Suresh Thalamati commented on SPARK-14586: -- Thanks for reporting this issue , Stephane. which

[jira] [Commented] (SPARK-14218) dataset show() does not display column names in the correct order if underlying data frame schema order is different from the encoder schema order.

2016-03-28 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215098#comment-15215098 ] Suresh Thalamati commented on SPARK-14218: -- I am giving a shot at submitting PR for this issue

[jira] [Created] (SPARK-14218) dataset show() does not display column names in the correct order if underlying data frame schema order is different from the encoder schema order.

2016-03-28 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-14218: Summary: dataset show() does not display column names in the correct order if underlying data frame schema order is different from the encoder schema order. Key: SPARK-14218

[jira] [Commented] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

2016-03-19 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200330#comment-15200330 ] Suresh Thalamati commented on SPARK-13860: -- I looked into this issue and found out NULL values

[jira] [Commented] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

2016-03-19 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200805#comment-15200805 ] Suresh Thalamati commented on SPARK-13860: -- [~yhuai] [~mengxr] I noticed there is discussion

[jira] [Commented] (SPARK-13820) TPC-DS Query 10 fails to compile

2016-03-15 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196419#comment-15196419 ] Suresh Thalamati commented on SPARK-13820: -- This query contains correlated subquery

Re: Microsoft SQL dialect issues

2016-03-15 Thread Suresh Thalamati
You should be able to register your own dialect if the default mappings are not working for your scenario. import org.apache.spark.sql.jdbc JdbcDialects.registerDialect(MyDialect) Please refer to the JdbcDialects to find example of existing default dialect for your database or another

[jira] [Commented] (SPARK-13699) Spark SQL drops the table in "overwrite" mode while writing into table

2016-03-07 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183996#comment-15183996 ] Suresh Thalamati commented on SPARK-13699: -- Thank you for providing the reproduction

Re: Error reading a CSV

2016-02-24 Thread Suresh Thalamati
Try creating /user/hive/warehouse/ directory if it does not exists , and check it has write permission for the user. Note the lower case ‘user’ in the path. > On Feb 24, 2016, at 2:42 PM, skunkwerk wrote: > > I have downloaded the Spark binary with Hadoop 2.6. > When

Re: Welcoming two new committers

2016-02-08 Thread Suresh Thalamati
Congratulations Herman and Wenchen! On Mon, Feb 8, 2016 at 10:59 AM, Andrew Or wrote: > Welcome! > > 2016-02-08 10:55 GMT-08:00 Bhupendra Mishra : > >> Congratulations to both. and welcome to group. >> >> On Mon, Feb 8, 2016 at 10:45 PM, Matei

[jira] [Created] (SPARK-13167) JDBC data source does not include null value partition columns rows in the result.

2016-02-03 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-13167: Summary: JDBC data source does not include null value partition columns rows in the result. Key: SPARK-13167 URL: https://issues.apache.org/jira/browse/SPARK-13167

[jira] [Commented] (SPARK-13167) JDBC data source does not include null value partition columns rows in the result.

2016-02-03 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131258#comment-15131258 ] Suresh Thalamati commented on SPARK-13167: -- I am working on fix for this issue. > JDBC d

[no subject]

2016-01-08 Thread Suresh Thalamati

subscribe

2016-01-04 Thread Suresh Thalamati

[jira] [Created] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

2015-12-23 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-12504: Summary: JDBC data source credentials are not masked in the data frame explain output. Key: SPARK-12504 URL: https://issues.apache.org/jira/browse/SPARK-12504

[jira] [Commented] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

2015-12-23 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070002#comment-15070002 ] Suresh Thalamati commented on SPARK-12504: -- I am testing the fix for this issue , will post

[jira] [Commented] (SPARK-12504) JDBC data source credentials are not masked in the data frame explain output.

2015-12-23 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070054#comment-15070054 ] Suresh Thalamati commented on SPARK-12504: -- Pull Request: https://github.com/apache/spark/pull

[jira] [Commented] (SPARK-11454) DB2 dialect - map DB2 ROWID and TIMESTAMP with TIMEZONE types into valid Spark types

2015-11-13 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15004488#comment-15004488 ] Suresh Thalamati commented on SPARK-11454: -- I am looking into fixing this Jira along with SPARK

[jira] [Commented] (SPARK-10521) Utilize Docker to test DB2 JDBC Dialect support

2015-11-10 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999799#comment-14999799 ] Suresh Thalamati commented on SPARK-10521: -- @Luciano, Jdbc data sources docker tests are re

[jira] [Comment Edited] (SPARK-11300) Support for string length when writing to JDBC

2015-10-30 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983631#comment-14983631 ] Suresh Thalamati edited comment on SPARK-11300 at 10/30/15 11:59 PM

[jira] [Commented] (SPARK-11300) Support for string length when writing to JDBC

2015-10-30 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983631#comment-14983631 ] Suresh Thalamati commented on SPARK-11300: -- Another related issue is Spark-10849, Fix

[jira] [Commented] (SPARK-10857) SQL injection bug in JdbcDialect.getTableExistsQuery()

2015-09-30 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14937732#comment-14937732 ] Suresh Thalamati commented on SPARK-10857: -- One issue I ran into with getSchema() call was even

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-27 Thread Suresh Thalamati
+1 (non-binding.) Tested jdbc data source, and some of the tpc-ds queries.

[jira] [Created] (SPARK-10849) Allow user to specify database column type for data frame fields when writing data to jdbc data sources.

2015-09-27 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-10849: Summary: Allow user to specify database column type for data frame fields when writing data to jdbc data sources. Key: SPARK-10849 URL: https://issues.apache.org/jira

[jira] [Commented] (SPARK-10849) Allow user to specify database column type for data frame fields when writing data to jdbc data sources.

2015-09-27 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909972#comment-14909972 ] Suresh Thalamati commented on SPARK-10849: -- I am working on creating pull request for this issue

[jira] [Commented] (SPARK-10756) DataFrame write to teradata using jdbc not working, tries to create table each time irrespective of table existence

2015-09-22 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903100#comment-14903100 ] Suresh Thalamati commented on SPARK-10756: -- This issue is similar to https://issues.apache.org

[jira] [Commented] (SPARK-10664) JDBC DataFrameWriter does not save data to Oracle 11 Database

2015-09-17 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14803331#comment-14803331 ] Suresh Thalamati commented on SPARK-10664: -- Table exists case should be fixed as part of SPARK

[jira] [Created] (SPARK-10655) Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT

2015-09-16 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-10655: Summary: Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT Key: SPARK-10655 URL: https://issues.apache.org/jira/browse/SPARK-10655 Project: Spark

[jira] [Commented] (SPARK-10655) Enhance DB2 dialect to handle XML, and DECIMAL , and DECFLOAT

2015-09-16 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791440#comment-14791440 ] Suresh Thalamati commented on SPARK-10655: -- I am working on pull request for this issue

[jira] [Commented] (SPARK-9078) Use of non-standard LIMIT keyword in JDBC tableExists code

2015-08-28 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720747#comment-14720747 ] Suresh Thalamati commented on SPARK-9078: - @Bob, Reynold I ran into the same

[jira] [Created] (SPARK-10170) Writing from data frame into db2 database using jdbc data source api fails with error for string, and boolean column types.

2015-08-22 Thread Suresh Thalamati (JIRA)
Suresh Thalamati created SPARK-10170: Summary: Writing from data frame into db2 database using jdbc data source api fails with error for string, and boolean column types. Key: SPARK-10170 URL: https

[jira] [Commented] (SPARK-10170) Writing from data frame into db2 database using jdbc data source api fails with error for string, and boolean column types.

2015-08-22 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14708124#comment-14708124 ] Suresh Thalamati commented on SPARK-10170: -- Scanning through the code I found

Re: [VOTE] Ole Solberg as a committer

2009-06-04 Thread Suresh Thalamati
+1 On Thu, May 28, 2009 at 7:13 AM, Rick Hillegas richard.hille...@sun.comwrote: Please vote on whether we should make Ole Solberg a committer. The vote closes at 5:00 pm San Francisco time on Thursday June 4. For 4+ years Ole has been a significant contributor to Derby. We all rely heavily

Re: [VOTE] John H Embretsen as a Derby committer

2008-04-01 Thread Suresh Thalamati
+1 On Wed, Mar 26, 2008 at 9:13 AM, Daniel John Debrunner [EMAIL PROTECTED] wrote: John is actively involved on both the derby-dev and derby-user lists and fully engages in open development. He has had a number of patches committed, most recently taking the stalled JMX work and getting it

[jira] Created: (DERBY-3367) Sort is not avoided even when the has an index on a the column being ordered, for a query with id != -1 predicate.

2008-01-30 Thread Suresh Thalamati (JIRA)
://issues.apache.org/jira/browse/DERBY-3367 Project: Derby Issue Type: Improvement Components: SQL Affects Versions: 10.3.2.1 Reporter: Suresh Thalamati Attachments: derby.log Sort is not avoided even when the has an index on a the column being

[jira] Updated: (DERBY-3367) Sort is not avoided even when the has an index on a the column being ordered, for a query with id != -1 predicate.

2008-01-30 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Thalamati updated DERBY-3367: Attachment: derby.log Derby log with the query plans. Sort is not avoided even when

[jira] Commented: (DERBY-3367) Sort is not avoided even when the has an index on a the column being ordered, for a query with id != -1 predicate.

2008-01-30 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12564205#action_12564205 ] Suresh Thalamati commented on DERBY-3367: - Thanks for your comments, Mike. I am

[jira] Commented: (DERBY-700) Derby does not prevent dual boot of database from different classloaders on Linux

2007-06-14 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12504943 ] Suresh Thalamati commented on DERBY-700: I agree with Dan, getLockedFile() is confusing and should

Re: 10.3 release coming up...fast!

2007-05-24 Thread Suresh Thalamati
Myrna van Lunteren wrote: Hi! We have now about 7 days before the code complete date of 6/1/07! Thanks for volunteering to be release manager, Myrna. 6/1 sounds good to me. I am not planning do any more checkins, for the 10.3 release. Thanks -suresh

[jira] Updated: (DERBY-378) support for import/export of tables with clob/blob and the other binary data types will be good addition to derby,

2007-05-23 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Thalamati updated DERBY-378: --- Fix Version/s: 10.3.0.0 support for import/export of tables with clob/blob and the other

[jira] Resolved: (DERBY-378) support for import/export of tables with clob/blob and the other binary data types will be good addition to derby,

2007-05-23 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Thalamati resolved DERBY-378. Resolution: Fixed support for import/export of tables with clob/blob and the other

[jira] Commented: (DERBY-700) Derby does not prevent dual boot of database from different classloaders on Linux

2007-05-22 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12498050 ] Suresh Thalamati commented on DERBY-700: [ Show » ] Kathey Marsden [22/May/07 03:22 PM] Thanks Suresh

[jira] Commented: (DERBY-2527) Add documentation for import/export of LOBS and other binary data types.

2007-05-18 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12497107 ] Suresh Thalamati commented on DERBY-2527: - Thanks for addressing my comments, Laura. I read through your

[jira] Commented: (DERBY-2527) Add documentation for import/export of LOBS and other binary data types.

2007-05-18 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12497112 ] Suresh Thalamati commented on DERBY-2527: - Thanks Laura, I reviewed the import/export related sections

[jira] Updated: (DERBY-700) Derby does not prevent dual boot of database from different classloaders on Linux

2007-05-17 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Thalamati updated DERBY-700: --- Attachment: derby700_singleproperty_v1.stat derby700_singleproperty_v1.diff

[jira] Created: (DERBY-2649) An unsuccessful boot attempt of an booted database can potentially delete files in the temp directory that are in use.

2007-05-15 Thread Suresh Thalamati (JIRA)
: https://issues.apache.org/jira/browse/DERBY-2649 Project: Derby Issue Type: Bug Components: Store Affects Versions: 10.2.2.0 Reporter: Suresh Thalamati Lock to prevent multi-jvm boot is acquired after the temp directory is cleaned up

[jira] Commented: (DERBY-2020) Change file option for syncing log file to disk from rws to rwd

2007-04-23 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12491013 ] Suresh Thalamati commented on DERBY-2020: - Thanks for addressing my comments , Olav. The latest patch looks

[jira] Commented: (DERBY-2527) Add documentation for import/export of LOBS and other binary data types.

2007-04-12 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12488505 ] Suresh Thalamati commented on DERBY-2527: - Thanks Laura. My comments are below for the questions you posted

[jira] Commented: (DERBY-2527) Add documentation for import/export of LOBS and other binary data types.

2007-04-12 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12488527 ] Suresh Thalamati commented on DERBY-2527: - #2 : I agree with you. Changging the sentence to Passing a NULL

[jira] Commented: (DERBY-2527) Add documentation for import/export of LOBS and other binary data types.

2007-04-10 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12487958 ] Suresh Thalamati commented on DERBY-2527: - Thanks for volunteering to write the documentation , Laura. My

[jira] Updated: (DERBY-378) support for import/export of tables with clob/blob and the other binary data types will be good addition to derby,

2007-04-05 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Thalamati updated DERBY-378: --- Attachment: iexlobs_v1.txt updated the spec and added some notes for dcoumnentation

[jira] Created: (DERBY-2527) Add documentation for import/export of LOBS and other binary data types.

2007-04-05 Thread Suresh Thalamati (JIRA)
Issue Type: Improvement Components: Documentation Affects Versions: 10.3.0.0 Reporter: Suresh Thalamati Attachments: iexlobs_v1.txt -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Updated: (DERBY-2527) Add documentation for import/export of LOBS and other binary data types.

2007-04-05 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Thalamati updated DERBY-2527: Attachment: iexlobs_v1.txt updated version of spec and some notes for the documentation

[jira] Commented: (DERBY-2020) Change file option for syncing log file to disk from rws to rwd

2007-04-03 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486434 ] Suresh Thalamati commented on DERBY-2020: - Thanks for working on this issue Olav. your latest patch

Re: some comments on collation wiki page

2007-04-03 Thread Suresh Thalamati
Mike Matrigali wrote: Mike Matrigali wrote: snip Ok, didn't realize this broke the model. As long as the info gets down to store I don't really care how. So if you can't get the info from the template we pass down, then we should just add another array argument to createConglomerate and

[jira] Commented: (DERBY-700) Derby does not prevent dual boot of database from different classloaders on Linux

2007-03-28 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484998 ] Suresh Thalamati commented on DERBY-700: Thanks a lot for summarizing the problems and possible solutions

[jira] Commented: (DERBY-700) Derby does not prevent dual boot of database from different classloaders on Linux

2007-03-27 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484550 ] Suresh Thalamati commented on DERBY-700: While reading comments for this issue yet again, noticed Rick

[jira] Commented: (DERBY-700) Derby does not prevent dual boot of database from different classloaders on Linux

2007-03-27 Thread Suresh Thalamati (JIRA)
[ https://issues.apache.org/jira/browse/DERBY-700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484586 ] Suresh Thalamati commented on DERBY-700: Thanks for confirming , Dan. I was referring to the commnet you

  1   2   3   4   5   6   >