[jira] [Created] (HIVE-17598) HS2/HPL Integration: Output wrapper class

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-17598:
-

 Summary: HS2/HPL Integration: Output wrapper class
 Key: HIVE-17598
 URL: https://issues.apache.org/jira/browse/HIVE-17598
 Project: Hive
  Issue Type: Sub-task
  Components: hpl/sql
Reporter: Dmitry Tolpeko


When running in CLI mode, HPL/SQL outputs the final results to stdout, and now 
when running in embedded mode it has to put them into a result set to be 
further consumed by HiveServer2 clients. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (HIVE-17597) HS2/HPL Integration: Avoid direct JDBC calls in HPL/SQL

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-17597:
-

 Summary: HS2/HPL Integration: Avoid direct JDBC calls in HPL/SQL
 Key: HIVE-17597
 URL: https://issues.apache.org/jira/browse/HIVE-17597
 Project: Hive
  Issue Type: Sub-task
  Components: hpl/sql
Reporter: Dmitry Tolpeko
Assignee: Dmitry Tolpeko


HPL/SQL currently uses JDBC to interact with Hive through HiveServer2. This 
option will remain for standalone mode (CLI mode), but when HPL/SQL is used 
within HiveServer2 it will use internal Hive API for database access. This task 
is to refactor JDBC API calls used in HP/SQL classes and move them to wrapper 
classes.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (HIVE-17596) HiveServer2 and HPL/SQL Integration

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-17596:
-

 Summary: HiveServer2 and HPL/SQL Integration
 Key: HIVE-17596
 URL: https://issues.apache.org/jira/browse/HIVE-17596
 Project: Hive
  Issue Type: New Feature
  Components: hpl/sql
Reporter: Dmitry Tolpeko
Assignee: Dmitry Tolpeko


The main task for HiveServer2 and HPL/SQL integration.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (HIVE-17452) HPL/SQL function variable block is not initialized

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-17452:
-

 Summary: HPL/SQL function variable block is not initialized
 Key: HIVE-17452
 URL: https://issues.apache.org/jira/browse/HIVE-17452
 Project: Hive
  Issue Type: Bug
Reporter: Dmitry Tolpeko
Assignee: Dmitry Tolpeko
Priority: Critical


Variable inside declaration block are not initialized:

{code}
CREATE FUNCTION test1()
  RETURNS STRING
AS
  ret string DEFAULT 'Initial value';
BEGIN
  print(ret);
  ret := 'VALUE IS SET';
  print(ret);
END;

test1();
{code}

Output:

{code}
ret  
VALUE IS SET
{code}

Should be:

{code}
Initial value 
VALUE IS SET
{code}





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (HIVE-17253) Adding SUMMARY statement to HPL/SQL

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-17253:
-

 Summary: Adding SUMMARY statement to HPL/SQL
 Key: HIVE-17253
 URL: https://issues.apache.org/jira/browse/HIVE-17253
 Project: Hive
  Issue Type: Improvement
  Components: hpl/sql
Reporter: Dmitry Tolpeko
Assignee: Dmitry Tolpeko


Adding SUMMARY statement to HPL/SQL to describe a data set (table, query 
result) similar to Python and R.

For each column output the data type, number of distinct values, non-NULL rows, 
mean, std, percentiles, min, max. Output additional stats for categorical 
columns. This helps perform quick and easy explanatory data analysis for SQL 
devs and business users.   



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Re: Cannot connect Precommit Jenkins job

[Dmitry Tolpeko]

Also should we re-submit patches?

Thanks,
Dmitry

On Fri, Apr 22, 2016 at 6:47 AM, Li, Rui  wrote:

> Shall we hold on the commits before Jenkins is back?
>
> Cheers,
> Rui Li
>
> -Original Message-
> From: Sergio Pena [mailto:sergio.p...@cloudera.com]
> Sent: Friday, April 22, 2016 12:48 AM
> To: Thejas Nair
> Cc: dev; sze...@apache.org
> Subject: Re: Cannot connect Precommit Jenkins job
>
> Hey Thejas,
>
> The Jenkins server stopped working for other reasons unrelated to the
> patches committed, and the Jenkins jobs were lost.
> I'm still working on it, and I almost have it ready to continue testing
> the master branch. Just a couple of tests more, and I'll release it to the
> public. I expect to have it ready by tomorrow.
>
> On Wed, Apr 20, 2016 at 6:56 PM, Thejas Nair 
> wrote:
>
> > Hi Sergio,
> > I saw that once of the recent commits I reviewed was causing issues,
> > sorry about that.
> > Are there other issues to be resolved to get it working ? Any estimate
> > of how much time it might take to get it running again ?
> > Thanks again for your help!
> >
> > -Thejas
> >
> >
> > On Tue, Apr 19, 2016 at 2:09 PM, Sergio Pena
> > 
> > wrote:
> > > Hey Thejas,
> > >
> > > We have some internal issues with the Jenkins server.
> > > I'm working on the configuration.
> > >
> > > On Tue, Apr 19, 2016 at 3:35 PM, Thejas Nair 
> > wrote:
> > >>
> > >> Hi Szehon, Sergio,
> > >> Do you know what is going on with it ? Does it need a restart ?
> > >> Thanks for your help!
> > >> Thejas
> > >>
> > >>
> > >> On Mon, Apr 18, 2016 at 1:58 PM, Wei Zheng 
> > wrote:
> > >> > Which one is down? AWS or our job?
> > >> >
> > >> >
> > http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommi
> > t-HIVE-TRUNK-Build/
> > >> >
> > >> > Thanks,
> > >> > Wei
> > >
> > >
> >
>

[jira] [Created] (HIVE-13516) Adding BTEQ .IF, .QUIT, ERRORCODE to HPL/SQL

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-13516:
-

 Summary: Adding BTEQ .IF, .QUIT, ERRORCODE to HPL/SQL
 Key: HIVE-13516
 URL: https://issues.apache.org/jira/browse/HIVE-13516
 Project: Hive
  Issue Type: Improvement
Reporter: Dmitry Tolpeko
Assignee: Dmitry Tolpeko


Adding Teradata BTEQ features to HPL/SQL such as .IF, .QUIT, ERRORCODE.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-13367) Extending HPLSQL parser

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-13367:
-

 Summary: Extending HPLSQL parser
 Key: HIVE-13367
 URL: https://issues.apache.org/jira/browse/HIVE-13367
 Project: Hive
  Issue Type: Improvement
  Components: hpl/sql
Affects Versions: 2.1.0
Reporter: Dmitry Tolpeko
Assignee: Dmitry Tolpeko


Extending HPL/SQL parser to support more procedural constructs. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [Discuss] MariaDB support

[Dmitry Tolpeko]

+1 great idea

On Wed, Mar 16, 2016 at 10:00 PM, Thejas Nair  wrote:

> + Sergio, Szehon, Ashutosh, Sushanth, Sergey,
>
> Any thoughts on this ?
>
>
> On Tue, Mar 15, 2016 at 7:08 PM, Thejas Nair 
> wrote:
> > There seems to be increasing interest in supporting MariaDB as an
> > option for storing metastore metadata. Supporting it as a database
> > option is also easy as it is compatible with mysql. I thought it would
> > be useful to discuss supporting it in the dev list before creating any
> > jiras.
> >
> > There are two aspects I would like to discuss -
> >
> > 1. Changes in hive to support MariaDB
> >
> > The existing mysql schema creation/upgrade scripts in hive should just
> > work for mariadb as well.
> > However, MariaDB has some additional optimizations that we might want
> > to use in future to optimize queries for it. That would mean creating
> > specific scripts for mariadb.
> >
> > However, until we introduce such MariaDB specific tuning, I think it
> > is better to avoid duplicating the mysql scripts.
> >
> > To make the transition to possibly using MariaDB optimized scripts
> > easier, one option is to have schematool consider it as an alias for
> > mysql until that happens.
> >
> >
> > 2. Testing with MariaDB
> > It would be useful to have tests for mariadb as well on the lines of
> > what is available for mysql in
> > https://issues.apache.org/jira/browse/HIVE-9800, to ensure that
> > mariadb support is not broken.
> >
> > Thanks,
> > Thejas
>

Re: SELECT without FROM

[Dmitry Tolpeko]

Thank you, Shannon!

On Fri, Mar 11, 2016 at 4:47 AM, Shannon Ladymon <slady...@gmail.com> wrote:

> It looks like FROM was made optional in Hive 0.13.0 with HIVE-4144
> <https://issues.apache.org/jira/browse/HIVE-4144> (thanks Alan Gates to
> pointing us to the grammar file and Sushanth Sowyman for helping track this
> down). A note has been added to the wiki
> <https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Select#LanguageManualSelect-SelectSyntax>
> about this.
>
> Dmitry, you said it didn't work in your Hive 0.13 version, but it seems
> like the patch was applied to 0.13.0. You might want to take a look at
> HIVE-4144 and see if that patch was applied to your version.
>
> -Shannon Ladymon
>
> On Wed, Mar 9, 2016 at 2:13 AM, Mich Talebzadeh <mich.talebza...@gmail.com
> > wrote:
>
>> hm. Certainly it worked if I recall correctly on 0.14, 1.2.1 and now on 2
>>
>> Dr Mich Talebzadeh
>>
>>
>>
>> LinkedIn * 
>> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>
>>
>>
>> http://talebzadehmich.wordpress.com
>>
>>
>>
>> On 9 March 2016 at 10:08, Dmitry Tolpeko <dmtolp...@gmail.com> wrote:
>>
>>> Not sure. It does not work in my Hive 0.13 version.
>>>
>>> On Wed, Mar 9, 2016 at 1:06 PM, Mich Talebzadeh <
>>> mich.talebza...@gmail.com> wrote:
>>>
>>>> I believe it has always been there
>>>>
>>>> Dr Mich Talebzadeh
>>>>
>>>>
>>>>
>>>> LinkedIn * 
>>>> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>>> <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>>
>>>>
>>>>
>>>> http://talebzadehmich.wordpress.com
>>>>
>>>>
>>>>
>>>> On 9 March 2016 at 09:58, Dmitry Tolpeko <dmtolp...@gmail.com> wrote:
>>>>
>>>>> Mich,
>>>>>
>>>>> I now that. I just want to trace when it was added to Hive.
>>>>>
>>>>> Dmitry
>>>>>
>>>>> On Wed, Mar 9, 2016 at 12:56 PM, Mich Talebzadeh <
>>>>> mich.talebza...@gmail.com> wrote:
>>>>>
>>>>>> ASAIK any database does that!
>>>>>>
>>>>>> 1> set nocount on
>>>>>> 2> select @@version
>>>>>> 3> select 1 + 1
>>>>>> 4> go
>>>>>>
>>>>>>
>>>>>>
>>>>>>  
>>>>>> -------
>>>>>>  Adaptive Server Enterprise/15.7/EBF 21708 SMP SP110
>>>>>> /P/x86_64/Enterprise Linux/ase157sp11x/3546/64-bit/FBO/Fri Nov  8 
>>>>>> 05:39:38
>>>>>> 2013
>>>>>>
>>>>>>  ---
>>>>>>2
>>>>>>
>>>>>>
>>>>>> Dr Mich Talebzadeh
>>>>>>
>>>>>>
>>>>>>
>>>>>> LinkedIn * 
>>>>>> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>>>>> <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>>>>
>>>>>>
>>>>>>
>>>>>> http://talebzadehmich.wordpress.com
>>>>>>
>>>>>>
>>>>>>
>>>>>> On 9 March 2016 at 09:50, Dmitry Tolpeko <dmtolp...@gmail.com> wrote:
>>>>>>
>>>>>>> I noticed that Hive allows you to execute SELECT without FROM clause
>>>>>>> (tested in Hive 0.14, Hive 1.2.1):
>>>>>>>
>>>>>>> SELECT 1+1;
>>>>>>>
>>>>>>> In which version was it added (is there a Jira)? I see that it is
>>>>>>> not mentioned in docs
>>>>>>> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Select
>>>>>>>
>>>>>>> So the question whether it is official and will not be removed in
>>>>>>> future.
>>>>>>>
>>>>>>> Thanks,
>>>>>>>
>>>>>>> Dmitry
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

[Dmitry Tolpeko]

Congratulations, Wei!

On Thu, Mar 10, 2016 at 5:48 AM, Chao Sun  wrote:

> Congratulations!
>
> On Wed, Mar 9, 2016 at 6:44 PM, Prasanth Jayachandran <
> pjayachand...@hortonworks.com> wrote:
>
>> Congratulations Wei!
>>
>> On Mar 9, 2016, at 8:43 PM, Sergey Shelukhin > > wrote:
>>
>> Congrats!
>>
>> From: Szehon Ho >
>> Reply-To: "u...@hive.apache.org" <
>> u...@hive.apache.org>
>> Date: Wednesday, March 9, 2016 at 17:40
>> To: "u...@hive.apache.org" <
>> u...@hive.apache.org>
>> Cc: "dev@hive.apache.org" <
>> dev@hive.apache.org>, "w...@apache.org
>> " >
>> Subject: Re: [ANNOUNCE] New Hive Committer - Wei Zheng
>>
>> Congratulations Wei!
>>
>> On Wed, Mar 9, 2016 at 5:26 PM, Vikram Dixit K  vik...@apache.org>> wrote:
>> The Apache Hive PMC has voted to make Wei Zheng a committer on the Apache
>> Hive Project. Please join me in congratulating Wei.
>>
>> Thanks
>> Vikram.
>>
>>
>>
>

Re: SELECT without FROM

[Dmitry Tolpeko]

Thanks, Alan. We should document this as well, now the syntax at
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Select states
that FROM is mandatory.

Dmitry

On Wed, Mar 9, 2016 at 6:46 PM, Alan Gates <alanfga...@gmail.com> wrote:

> I’m not aware of any JIRA on it.  The easiest way to find out will be to
> look at the git history of Hive’s grammar file and see when it changed.
>
> As for taking out, we shouldn’t since it’s valid SQL and we’re pushing
> towards more ANSI compliance.
>
> Alan.
>
> > On Mar 9, 2016, at 01:50, Dmitry Tolpeko <dmtolp...@gmail.com> wrote:
> >
> > I noticed that Hive allows you to execute SELECT without FROM clause
> (tested in Hive 0.14, Hive 1.2.1):
> >
> > SELECT 1+1;
> >
> > In which version was it added (is there a Jira)? I see that it is not
> mentioned in docs
> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Select
> >
> > So the question whether it is official and will not be removed in future.
> >
> > Thanks,
> >
> > Dmitry
>
>

Re: SELECT without FROM

[Dmitry Tolpeko]

Not sure. It does not work in my Hive 0.13 version.

On Wed, Mar 9, 2016 at 1:06 PM, Mich Talebzadeh <mich.talebza...@gmail.com>
wrote:

> I believe it has always been there
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn * 
> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
>
> On 9 March 2016 at 09:58, Dmitry Tolpeko <dmtolp...@gmail.com> wrote:
>
>> Mich,
>>
>> I now that. I just want to trace when it was added to Hive.
>>
>> Dmitry
>>
>> On Wed, Mar 9, 2016 at 12:56 PM, Mich Talebzadeh <
>> mich.talebza...@gmail.com> wrote:
>>
>>> ASAIK any database does that!
>>>
>>> 1> set nocount on
>>> 2> select @@version
>>> 3> select 1 + 1
>>> 4> go
>>>
>>>
>>>
>>>  
>>> ---
>>>  Adaptive Server Enterprise/15.7/EBF 21708 SMP SP110
>>> /P/x86_64/Enterprise Linux/ase157sp11x/3546/64-bit/FBO/Fri Nov  8 05:39:38
>>> 2013
>>>
>>>  ---
>>>2
>>>
>>>
>>> Dr Mich Talebzadeh
>>>
>>>
>>>
>>> LinkedIn * 
>>> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>>> <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>>>
>>>
>>>
>>> http://talebzadehmich.wordpress.com
>>>
>>>
>>>
>>> On 9 March 2016 at 09:50, Dmitry Tolpeko <dmtolp...@gmail.com> wrote:
>>>
>>>> I noticed that Hive allows you to execute SELECT without FROM clause
>>>> (tested in Hive 0.14, Hive 1.2.1):
>>>>
>>>> SELECT 1+1;
>>>>
>>>> In which version was it added (is there a Jira)? I see that it is not
>>>> mentioned in docs
>>>> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Select
>>>>
>>>> So the question whether it is official and will not be removed in
>>>> future.
>>>>
>>>> Thanks,
>>>>
>>>> Dmitry
>>>>
>>>
>>>
>>
>

Re: SELECT without FROM

[Dmitry Tolpeko]

Mich,

I now that. I just want to trace when it was added to Hive.

Dmitry

On Wed, Mar 9, 2016 at 12:56 PM, Mich Talebzadeh <mich.talebza...@gmail.com>
wrote:

> ASAIK any database does that!
>
> 1> set nocount on
> 2> select @@version
> 3> select 1 + 1
> 4> go
>
>
>
>  
> ---
>  Adaptive Server Enterprise/15.7/EBF 21708 SMP SP110 /P/x86_64/Enterprise
> Linux/ase157sp11x/3546/64-bit/FBO/Fri Nov  8 05:39:38
> 2013
>
>  ---
>2
>
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn * 
> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
>
> On 9 March 2016 at 09:50, Dmitry Tolpeko <dmtolp...@gmail.com> wrote:
>
>> I noticed that Hive allows you to execute SELECT without FROM clause
>> (tested in Hive 0.14, Hive 1.2.1):
>>
>> SELECT 1+1;
>>
>> In which version was it added (is there a Jira)? I see that it is not
>> mentioned in docs
>> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Select
>>
>> So the question whether it is official and will not be removed in future.
>>
>> Thanks,
>>
>> Dmitry
>>
>
>

SELECT without FROM

[Dmitry Tolpeko]

I noticed that Hive allows you to execute SELECT without FROM clause
(tested in Hive 0.14, Hive 1.2.1):

SELECT 1+1;

In which version was it added (is there a Jira)? I see that it is not
mentioned in docs
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Select

So the question whether it is official and will not be removed in future.

Thanks,

Dmitry

Re: Hive-2.0.1 Release date

[Dmitry Tolpeko]

Mich,

To avoid confusion: HPLSQL is shipped with Hive 2.0 (and will be shipped
with all further versions). So you can use it with Hive on Tez, Hive on MR,
and Hive on Spark. But now it is a separate tool: hplsql (like hive CLI,
beeline CLI). What Alan meant is that it is not integrated to Hive
*parser*, so there are 2 parsers now: Hive SQL and HPLSQL.

HPLSQL acts as a SQL-skin, supports many SQL and PL/SQL dialects in order
to avoid code conversions (there are a lot of legacy code to be ported to
Hive), so it is verbose. I am not sure if it makes sense to merge it with
Hive SQL parser, but definitely integration with Hive/beeline CLI,
metastore (persistent store of procedures/functions), JDBC/ODBC will be
helpful.

Alan, I am ready to work on this, but we need to define the direction first
so we have good and consistent design.

Thanks,

Dmitry

On Tue, Mar 1, 2016 at 3:08 AM, Mich Talebzadeh 
wrote:

> Thanks. I believe Alan Gate mentioned that HPLSQL is not yet integrated
> into Hive 2.0.May be later?
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn * 
> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> *
>
>
>
> http://talebzadehmich.wordpress.com
>
>
>
> On 1 March 2016 at 00:05, Sergey Shelukhin  wrote:
>
>> HPLSQL is available as part of Hive 2.0. I am not sure to which extent
>> the integration goes as I wasn’t involved in that work.
>> As far as I understand HPLSQL and Hive on Spark are kind of orthogonal…
>>
>> Hive 2.0.1 is purely a bug fix release for Hive 2.0; Hive 2.1 will be the
>> next feature release if some major feature is missing.
>>
>> From: Mich Talebzadeh 
>> Reply-To: "u...@hive.apache.org" 
>> Date: Monday, February 29, 2016 at 15:53
>> To: "u...@hive.apache.org" 
>> Subject: Re: Hive-2.0.1 Release date
>>
>> Hi Sergey,
>>
>> Will HPLSQL be part of 2.0.1.release?
>>
>> I am using 2.0 and found Hive on Spark to be much more stable.
>>
>> Thanks
>>
>> Dr Mich Talebzadeh
>>
>>
>>
>> LinkedIn * 
>> https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
>> *
>>
>>
>>
>> http://talebzadehmich.wordpress.com
>>
>>
>>
>> On 29 February 2016 at 23:46, Sergey Shelukhin 
>> wrote:
>>
>>> Hi. It will be released when some critical mass of bugfixes is
>>> accumulated. We already found some issues that would be nice to fix, so it
>>> may be some time in March. Is there a particular fix that interests you?
>>>
>>> From: Oleksiy MapR 
>>> Reply-To: "u...@hive.apache.org" 
>>> Date: Monday, February 29, 2016 at 00:43
>>> To: "u...@hive.apache.org" 
>>> Subject: Hive-2.0.1 Release date
>>>
>>> Hi all!
>>>
>>> Are you planing to release Hive-2.0.1? If yes, when it probably may be?
>>>
>>> Thanks,
>>> Oleksiy.
>>>
>>
>>
>

Re: [ANNOUNCE] Apache Hive 2.0.0 Released

[Dmitry Tolpeko]

Great! Thank you, Sergey!

On Tue, Feb 16, 2016 at 10:44 PM, Sergey Shelukhin 
wrote:

> The Apache Hive team is proud to announce the the release of Apache Hive
> version 2.0.0.
>
> The Apache Hive (TM) data warehouse software facilitates querying and
> managing large datasets residing in distributed storage. Built on top of
> Apache Hadoop (TM), it provides:
>
> * Tools to enable easy data extract/transform/load (ETL)
>
> * A mechanism to impose structure on a variety of data formats
>
> * Access to files stored either directly in Apache HDFS (TM) or in other
> data storage systems such as Apache HBase (TM)
>
> * Query execution via Apache Hadoop MapReduce and Apache Tez frameworks.
>
> For Hive release details and downloads, please visit:
> https://hive.apache.org/downloads.html
>
> Hive 2.0.0 Release Notes are available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12332641
> jectId=12310843
>
> We would like to thank the many contributors who made this release
> possible.
>
> Regards,
>
> The Apache Hive Team
>
>
>

Re: [VOTE] Apache Hive 2.0.0 Release Candidate 0

[Dmitry Tolpeko]

Antlr3 and Antlr4 are like different products (think of Hadoop 1 and 2), I
believe it is impossible to migrate Hive without significant rewrite. When
Hplsql starts it loads 4.5 version, while Hive loads version 3.

On Tue, Feb 2, 2016 at 11:51 PM, Sergey Shelukhin <ser...@hortonworks.com>
wrote:

> That sounds like a recipe for class loading disaster… I think Hive would
> need to be upgraded to use the new version unless it can be isolated in
> the distribution somehow.
>
> On 16/2/2, 12:46, "Dmitry Tolpeko" <dmtolp...@gmail.com> wrote:
>
> >Sergey,
> >
> >3) It is a different version 4.5 that is not compatible with 3 used in
> >Hive, so both jars should be supplied.
> >
> >Thanks,
> >
> >Dmitry
> >
> >On Tue, Feb 2, 2016 at 11:27 PM, Sergey Shelukhin <ser...@hortonworks.com
> >
> >wrote:
> >
> >> 1) I’ll add the scripts.
> >> 2) We currently do not appear to be packaging the config files in the
> >> binary distribution; even hive-site.xml is absent.
> >> 3) lib/ already includes an earlier version of Antlr runtime. Should
> >>Hive
> >> be upgraded to a newer version overall for HPLSQL to work?
> >>
> >> On 16/2/1, 22:55, "Dmitry Tolpeko" <dmtolp...@gmail.com> wrote:
> >>
> >> >Hi Sergey,
> >> >
> >> >Can you please include /bin/hplsql (and \bin\hplsql.cmd for Windows)
> >>for
> >> >launch HPLSQL tool (you can find them at
> >> >https://github.com/apache/hive/tree/master/bin). Also this tool
> depends
> >> >on antlr-runtime-4.5.jar. Can you please add it to /lib as well? One
> >>more
> >> >thing is the configuration file hplsql-site.xml from
> >> >https://github.com/apache/hive/tree/master/hplsql/src/main/resources
> >> >
> >> >Let me know if you have any questions.
> >> >
> >> >Thank you,
> >> >
> >> >Dmitry
> >> >
> >> >On Tue, Feb 2, 2016 at 12:45 AM, Sergey Shelukhin <ser...@apache.org>
> >> >wrote:
> >> >
> >> >> Apache Hive 2.0.0 Release Candidate 0 is available here:
> >> >>
> >> >> http://people.apache.org/~sershe/hive-2.0.0-RC0/
> >> >>
> >> >>
> >> >> Maven artifacts are available here:
> >> >>
> >> >>
> >>https://repository.apache.org/content/repositories/orgapachehive-1041/
> >> >>
> >> >>
> >> >> Source tag for RC0 (github mirror) is:
> >> >> https://github.com/apache/hive/releases/tag/release-2.0.0-rc0
> >> >> (
> >> >>
> >> >>
> >>
> >>
> https://github.com/apache/hive/commit/b45f4c69f0c8853d9faea2dac8523517d28
> >> >>3
> >> >> 91d3)
> >> >>
> >> >> Voting will conclude in 72 hours.
> >> >>
> >> >> Hive PMC Members: Please test and vote.
> >> >> Note that this is the first Apache release that I’m making; I hope
> >> >> everything is correct...
> >> >>
> >> >> Thanks.
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >>
> >>
>
>

Re: [VOTE] Apache Hive 2.0.0 Release Candidate 0

[Dmitry Tolpeko]

Sergey,

3) It is a different version 4.5 that is not compatible with 3 used in
Hive, so both jars should be supplied.

Thanks,

Dmitry

On Tue, Feb 2, 2016 at 11:27 PM, Sergey Shelukhin <ser...@hortonworks.com>
wrote:

> 1) I’ll add the scripts.
> 2) We currently do not appear to be packaging the config files in the
> binary distribution; even hive-site.xml is absent.
> 3) lib/ already includes an earlier version of Antlr runtime. Should Hive
> be upgraded to a newer version overall for HPLSQL to work?
>
> On 16/2/1, 22:55, "Dmitry Tolpeko" <dmtolp...@gmail.com> wrote:
>
> >Hi Sergey,
> >
> >Can you please include /bin/hplsql (and \bin\hplsql.cmd for Windows) for
> >launch HPLSQL tool (you can find them at
> >https://github.com/apache/hive/tree/master/bin). Also this tool depends
> >on antlr-runtime-4.5.jar. Can you please add it to /lib as well? One more
> >thing is the configuration file hplsql-site.xml from
> >https://github.com/apache/hive/tree/master/hplsql/src/main/resources
> >
> >Let me know if you have any questions.
> >
> >Thank you,
> >
> >Dmitry
> >
> >On Tue, Feb 2, 2016 at 12:45 AM, Sergey Shelukhin <ser...@apache.org>
> >wrote:
> >
> >> Apache Hive 2.0.0 Release Candidate 0 is available here:
> >>
> >> http://people.apache.org/~sershe/hive-2.0.0-RC0/
> >>
> >>
> >> Maven artifacts are available here:
> >>
> >> https://repository.apache.org/content/repositories/orgapachehive-1041/
> >>
> >>
> >> Source tag for RC0 (github mirror) is:
> >> https://github.com/apache/hive/releases/tag/release-2.0.0-rc0
> >> (
> >>
> >>
> https://github.com/apache/hive/commit/b45f4c69f0c8853d9faea2dac8523517d28
> >>3
> >> 91d3)
> >>
> >> Voting will conclude in 72 hours.
> >>
> >> Hive PMC Members: Please test and vote.
> >> Note that this is the first Apache release that I’m making; I hope
> >> everything is correct...
> >>
> >> Thanks.
> >>
> >>
> >>
> >>
> >>
> >>
> >>
>
>

Re: [VOTE] Apache Hive 2.0.0 Release Candidate 0

[Dmitry Tolpeko]

Hi Sergey,

Can you please include /bin/hplsql (and \bin\hplsql.cmd for Windows) for
launch HPLSQL tool (you can find them at
https://github.com/apache/hive/tree/master/bin). Also this tool depends
on antlr-runtime-4.5.jar. Can you please add it to /lib as well? One more
thing is the configuration file hplsql-site.xml from
https://github.com/apache/hive/tree/master/hplsql/src/main/resources

Let me know if you have any questions.

Thank you,

Dmitry

On Tue, Feb 2, 2016 at 12:45 AM, Sergey Shelukhin  wrote:

> Apache Hive 2.0.0 Release Candidate 0 is available here:
>
> http://people.apache.org/~sershe/hive-2.0.0-RC0/
>
>
> Maven artifacts are available here:
>
> https://repository.apache.org/content/repositories/orgapachehive-1041/
>
>
> Source tag for RC0 (github mirror) is:
> https://github.com/apache/hive/releases/tag/release-2.0.0-rc0
> (
> https://github.com/apache/hive/commit/b45f4c69f0c8853d9faea2dac8523517d283
> 91d3)
>
> Voting will conclude in 72 hours.
>
> Hive PMC Members: Please test and vote.
> Note that this is the first Apache release that I’m making; I hope
> everything is correct...
>
> Thanks.
>
>
>
>
>
>
>

Re: January Hive User Group Meeting

[Dmitry Tolpeko]

If possible please share the slides after the meeting.

Thank you!

Dmitry

On Wed, Jan 20, 2016 at 8:45 PM, Xuefu Zhang  wrote:

> Hi all,
>
> As a reminder, the meeting will be held tomorrow as scheduled. Please
> refer to the meetup page[1] for details. Looking forward to meeting you all!
>
> Thanks,
> Xuefu
>
> [1] http://www.meetup.com/Hive-User-Group-Meeting/events/227463783/
>
> On Wed, Dec 16, 2015 at 3:38 PM, Xuefu Zhang  wrote:
>
>> Dear Hive users and developers,
>>
>> Hive community is considering a user group meeting[1] January 21, 2016
>> at Cloudera facility in Palo Alto, CA. This will be a great opportunity
>> for vast users and developers to find out what's happening in the
>> community and share each other's experience with Hive. Therefore, I'd urge
>> you to attend the meetup. Please RSVP and the list will be closed a few
>> days ahead of the event.
>>
>> At the same time, I'd like to solicit light talks (15 minutes max) from
>> users and developers. If you have a proposal, please let me or Thejas know.
>> Your participation is greatly appreciated.
>>
>> Sincerely,
>> Xuefu
>>
>> [1] http://www.meetup.com/Hive-User-Group-Meeting/events/227463783/
>>
>
>

Re: HPLSQL Error

[Dmitry Tolpeko]

Pavan,

Hadoop jars are not in the CLASSPATH. You can edit hplsql file (this is a
bash script) and specify proper locations for your Hadoop installation.

Dmitry

On Mon, Dec 14, 2015 at 6:34 AM, Pavan Kumar  wrote:

> ./hplsql -e "select * from txn_ds_platter limit 1";
> Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/hadoop/conf/Configuration
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
> at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
> at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> at org.apache.hive.hplsql.Exec.init(Exec.java:673)
> at org.apache.hive.hplsql.Exec.run(Exec.java:635)
> at org.apache.hive.hplsql.Hplsql.main(Hplsql.java:23)
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.conf.Configuration
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> ... 15 more
>
>
> Please help me..
> Thanking You.
>

Re: Dev meetup Nov 2015

[Dmitry Tolpeko]

Thejas, thank you for sharing the slides!

On Thu, Nov 19, 2015 at 1:00 AM, Thejas Nair  wrote:

> Thanks to all who attended the meetup. There were great talks and
> discussions!
>
> Here are the slides -
>
> https://cwiki.apache.org/confluence/display/Hive/Presentations#Presentations-November2015HiveContributorMeetup
>
>
> On Tue, Nov 10, 2015 at 12:27 PM, Xuefu Zhang  wrote:
> > HI folks,
> >
> > Here is the talks that are scheduled for Monday's meetup. As you can see
> > that we have a full schedule, speakers please constrain your talk within
> > the given slot.
> >
> > 1. Lessons learned from enterprise users (Xuefu, 5m)
> > 2. New Hive metrics and monitoring for HS2/HMS (TBD, 10m)
> > 3. Hardening Hive - Design/Code Reviews (John Pullokkaran, 15m)
> > 4. Correctness issue reporting and tracking guideline (Carl, 5m)
> > 5. Dynamic dependency resolution and classloader issues (Anthony, 10m)
> > 6. A query syntax validation tool for Hive. (Szehon, 15m)
> > 7. Improved integration test for Hive (HIVE-12316) (Alan Gates, 30m)
> > 8. Uber's plan for Hive and our expected feature from the overall dev
> > community (Mohammad Islam,  15m)
> > 9. Update on LLAP (Gopal V Vijayaraghavan, 10m)
> >
> > See you all there!
> >
> > --Xuefu
> >
> > On Fri, Nov 6, 2015 at 2:11 PM, Xuefu Zhang  wrote:
> >
> >> Hi all,
> >>
> >> As an update, here is the link to the meetup:
> >> http://www.meetup.com/Hive-Contributors-Group/events/226495286/. Please
> >> RSVP as soon as possible because the organizers do need a headcount
> before
> >> the event.
> >>
> >> Also, we are finalizing a list of talks. If you plan to give a talk,
> >> please let the organizer know.
> >>
> >> Thanks,
> >> Xuefu
> >>
> >>
> >> On Mon, Nov 2, 2015 at 10:09 AM, Xuefu Zhang 
> wrote:
> >>
> >>> Hi all,
> >>>
> >>> Apache Hive community is considering a developer meetup in the middle
> of
> >>> this month. While we are finalizing the venue, I'd like to invite you
> to
> >>> plan to join, and even better, to give talk in the event.
> >>>
> >>> We consider the center of the meetup would be around the quality aspect
> >>> of the Project, and like to establish a collaborative effort in
> improving
> >>> Hive's quality. In the meantime, any topic will be considered.
> >>>
> >>> Please let me or Thejas know if you'd like to give a talk.
> >>>
> >>> Detailed venue and agenda will be given soon. Look forward to meeting
> you
> >>> in two weeks!
> >>>
> >>> Regards,
> >>>
> >>> Xuefu
> >>>
> >>
> >>
>

Re: [VOTE] Hive 2.0 release plan

[Dmitry Tolpeko]

+1

Dmitry

On Fri, Nov 13, 2015 at 11:38 PM, Sergey Shelukhin 
wrote:

> Hi.
> With no strong objections on DISCUSS thread, some issues raised and
> addressed, and a reminder from Carl about the bylaws for the release
> process, I propose we release the first version of Hive 2 (2.0), and
> nominate myself as release manager.
> The goal is to have the first release of Hive with aggressive set of new
> features, some of which are ready to use and some are at experimental
> stage and will be developed in future Hive 2 releases, in line with the
> Hive-1-Hive-2 split discussion.
> If the vote passes, the timeline to create a branch should be around the
> end of next week (to minimize merging in the wake of the release), and the
> timeline to release would be around the end of November, depending on the
> issues found during the RC cutting process, as usual.
>
> Please vote:
> +1 proceed with the release plan
> +-0 don’t care
> -1 don’t proceed with the release plan, for such and such reasons
>
> The vote will run for 3 days.
>
>

[jira] [Created] (HIVE-11881) Supporting HPL/SQL Packages

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-11881:
-

 Summary: Supporting HPL/SQL Packages
 Key: HIVE-11881
 URL: https://issues.apache.org/jira/browse/HIVE-11881
 Project: Hive
  Issue Type: Improvement
  Components: hpl/sql
Reporter: Dmitry Tolpeko
Assignee: Dmitry Tolpeko


HPL/SQL should support packages similar to Oracle PL/SQL.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11783) Extending HPL/SQL parser

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-11783:
-

 Summary: Extending HPL/SQL parser
 Key: HIVE-11783
 URL: https://issues.apache.org/jira/browse/HIVE-11783
 Project: Hive
  Issue Type: Improvement
  Components: hpl/sql
Reporter: Dmitry Tolpeko
Assignee: Dmitry Tolpeko


Need to extend procedural SQL parser and synchronize code base by adding 
PART_COUNT, PART_COUNT_BY functions as well as CMP ROW_COUNT, CMP SUM and COPY 
TO HDFS statements.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: windows line endings and git

[Dmitry Tolpeko]

I develop in Eclipse on Windows, but finally compile, test and use git on
Linux. If the problem is in Windows line endings, I will make sure they
will not appear anymore, sorry.

Dmitry

On Tue, Sep 1, 2015 at 8:17 PM, Alan Gates  wrote:

> After Dmitry checked in HIVE-11536 and I fetched and merged, I had issues
> in my git repository with line endings.  It insisted on modifying the files
> without me so much as opening the files, and would not let me switch
> branches until I dealt with it.  I think it automatically changed the
> windows ending to the unix ending when I did the merge in from Apache.  I
> solved this by committing the changes and pushing that back upstream.  I
> assumed this would work as when I've checked in patches from Dmitry before
> the right thing seems to happen.  Please let me know if I've messed
> something up for others.
>
> But now to the core question.  Is there something I need to set in my git
> config to be able to handle this?  Or is there something Dmitry needs to
> set in his so that when he checks in it doesn't bork unix based users?  I
> poked around github for information on windows based line endings but it
> wasn't clear to me what I needed to do.
>
> Alan.
>

[jira] [Created] (HIVE-11584) Update committer list

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-11584:
-

 Summary: Update committer list
 Key: HIVE-11584
 URL: https://issues.apache.org/jira/browse/HIVE-11584
 Project: Hive
  Issue Type: Bug
Reporter: Dmitry Tolpeko
Priority: Minor


Please update committer list:

Name: Dmitry Tolpeko
Apache ID: dmtolpeko
Organization: EPAM (www.epam.com)

Thank you,

Dmitry



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11536) %TYPE and %ROWTYPE attributes in data type declaration

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-11536:
-

 Summary: %TYPE and %ROWTYPE attributes in data type declaration
 Key: HIVE-11536
 URL: https://issues.apache.org/jira/browse/HIVE-11536
 Project: Hive
  Issue Type: Improvement
  Components: hpl/sql
Reporter: Dmitry Tolpeko
Assignee: Dmitry Tolpeko


%TYPE and %ROWTYPE attributes allow you to derive the data type from the 
corresponding table column. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [ANNOUNCE] New Hive Committer - Dmitry Tolpeko

[Dmitry Tolpeko]

Thank you to everyone!

Dmitry

On Mon, Aug 3, 2015 at 9:33 PM, Carl Steinbach c...@apache.org wrote:

 The Apache Hive PMC has voted to make Dmitry Tolpeko a committer on the
 Apache Hive Project.

 Please join me in congratulating Dmitry!

 Thanks.

 - Carl

[jira] [Created] (HIVE-11354) HPL/SQL extending compatibility with Transact-SQL

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-11354:
-

 Summary: HPL/SQL extending compatibility with Transact-SQL
 Key: HIVE-11354
 URL: https://issues.apache.org/jira/browse/HIVE-11354
 Project: Hive
  Issue Type: Improvement
  Components: hpl/sql
Reporter: Dmitry Tolpeko
Assignee: Dmitry Tolpeko


Although HPL/SQL already supports some Transact-SQL language elements 
(declarations, flow-of-control stmts, assignments and so on) some other widely 
used constructs are not supported yet.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

HIVE-11254 Review Request (HPL/SQL tool)

[Dmitry Tolpeko]

Can please anyone review https://issues.apache.org/jira/browse/HIVE-11254?
The changes are related to new HPL/SQL component only.

When renaming the tool from plhql to hplsql I introduced a bug so it cannot
find a connection profile.

Thanks,

Dmitry

Hive unit tests with JDBC connection (Submit patch)

[Dmitry Tolpeko]

I added a unit test for Hive HPL/SQL tool that uses a JDBC connection to
access src table.

When I submit my patch, and use URL jdbc:hive2://localhost:1 I got:
java.net.ConnectException: Connection refused
When I use URL jdbc:hive2:// I got java.lang.NoClassDefFoundError:
org/apache/hadoop/mapreduce/TaskAttemptContext

In .pom I use

dependency
  groupIdorg.apache.hive/groupId
  artifactIdhive-jdbc/artifactId
  version1.2.1/version
  scopetest/scope
/dependency

Can someone please suggest what is the proper way to access src table using
JDBC in Hive unit tests when submitting a patch?

Thank you,

Dmitry

[jira] [Created] (HIVE-11290) Cursor attributes %ISOPEN, %FOUND, %NOTFOUND and SYS_REFCURSOR variable

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-11290:
-

 Summary: Cursor attributes %ISOPEN, %FOUND, %NOTFOUND and 
SYS_REFCURSOR variable
 Key: HIVE-11290
 URL: https://issues.apache.org/jira/browse/HIVE-11290
 Project: Hive
  Issue Type: Improvement
  Components: hpl/sql
Reporter: Dmitry Tolpeko
Assignee: Dmitry Tolpeko


Cursor attributes allow you to get information about the current cursor state. 
Cursor variable can be used to pass result sets between routines.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11254) Process result sets returned by a stored procedure

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-11254:
-

 Summary: Process result sets returned by a stored procedure
 Key: HIVE-11254
 URL: https://issues.apache.org/jira/browse/HIVE-11254
 Project: Hive
  Issue Type: Improvement
  Components: hpl/sql
Reporter: Dmitry Tolpeko
Assignee: Dmitry Tolpeko


Stored procedure can return one or more result sets. A caller should be able to 
process them.

 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HIVE-11055) HPL/SQL - Implementing Procedural SQL in Hive (PL/HQL Contribution)

[Dmitry Tolpeko (JIRA)]

Dmitry Tolpeko created HIVE-11055:
-

 Summary: HPL/SQL - Implementing Procedural SQL in Hive (PL/HQL 
Contribution)
 Key: HIVE-11055
 URL: https://issues.apache.org/jira/browse/HIVE-11055
 Project: Hive
  Issue Type: Improvement
Reporter: Dmitry Tolpeko
Assignee: Dmitry Tolpeko


There is PL/HQL tool (www.plhql.org) that implements procedural SQL for Hive 
(actually any SQL-on-Hadoop implementation and any JDBC source).

Alan Gates offered to contribute it to Hive under HPL/SQL name 
(org.apache.hive.hplsql package). This JIRA is to create a patch to contribute  
the PL/HQL code. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: PL/HQL and Hive

[Dmitry Tolpeko]

I modified the package and created jira
https://issues.apache.org/jira/browse/HIVE-11055.

Thanks,

Dmitry

On Thu, Jun 18, 2015 at 4:26 PM, Dmitry Tolpeko dmtolp...@gmail.com wrote:

 Thanks, Alan. I will update the package naming, and try to create Jira and
 patch soon.

 Dmitry

 On Thu, Jun 18, 2015 at 2:37 AM, Alan Gates alanfga...@gmail.com wrote:

 In Apache projects there are contributors and committers.  Contributors
 are anyone who helps with the project via code, docs, tests, bug reports,
 etc.  Committers can commit code, though it must still be reviewed by other
 committers.  On the process of becoming a committer in Hive see
 https://cwiki.apache.org/confluence/display/Hive/BecomingACommitter
 Obviously contributing a large bit of functionality starts you on that road
 nicely.

 If you need help getting the patch together let me know.

 Alan.

   Dmitry Tolpeko dmtolp...@gmail.com
  June 17, 2015 at 13:02
 Alan,

 HPL/SQL is a good name, I am ok with this change. Right now I am the only
 one developer of PL/HQL. Which status will I be given in the Hive project,
 so I can continue developing the tool? I will read docs and try to create a
 patch.

 Thanks,

 Dmitry


   Alan Gates alanfga...@gmail.com
  June 17, 2015 at 11:55
  Here's what we need to do:

 1) You need to file a JIRA proposing to contribute the code.
 2) You can then contribute the code as a patch to that JIRA.  As long as
 you've written all the code yourself this is sufficient to hand legal
 rights to Apache to contribute the code.  If others beyond you have legal
 claim to the code (ie they wrote it or paid you to write it) we'll need to
 work with Apache and those authors to get clearance to include the code.
 3) Before committing the code we need to move it to an org.apache.hive
 packaging structure.  I propose that we put it in a new package
 org.apache.hive.hplsql (see below for why I chose that).  We can take the
 patch you submit and make this change before committing or you can move it
 yourself before you contribute the patch.
 4) One of the current committers can then take the patch and get it
 committed.

 One suggestion that might be controversial:  I propose we change the name
 from PL/HQL to HPL/SQL (hence my packaging name suggestion above).  We want
 to move away from saying Hive has a language called HQL which is SQL like.
 At this point Hive's SQL is most of the way to SQL-92 so talking about HQL
 just confuses people.  Hence Hive PL/SQL (HPL/SQL) seems better.  Or if you
 prefer we could do PL/HSQL.

 Alan.

   Dmitry Tolpeko dmtolp...@gmail.com
  June 15, 2015 at 8:03
 Hi Alan,

 I am back from my vacation. Please let me know what actions, information
 is required for me regarding IP. Can we talk about Jira creation and first
 steps to make PL/HQL conform to Hive standards?

 Thanks,

 Dmitry


   Dmitry Tolpeko dmtolp...@gmail.com
  June 2, 2015 at 12:35
 Alan,

 I am new to the Hive project structure and development process, so I
 would highly appreciate your guidance (if you can initiate Jira or tell me
 how to do that i.e). Also I can grant software to Apache if required
 although I am not sure which IP clearance required. For me uploading of
 the code is sufficient.

 Thank you,

 Dmitry


   Alan Gates alanfga...@gmail.com
  June 1, 2015 at 15:50
  Dmitry,

 I'm thrilled to hear that you're open to integrating PL/HQL into Hive.

 As for how we'd do it, this is obviously something we'll have to discuss
 in the community on the dev list.  But my initial thought is that we start
 by importing it as it, mostly focussing on package name changes, etc.  So
 it starts as a stand alone.  Then over time we work on integrating it
 directly into Hive.  This will have a number of benefits for users as
 they'll be able to create and store procedures, invoke them from JDBC
 connections, grant and revoke access to procedures, etc.

 So I think the next step is to open a JIRA on it and then we can start
 building a patch to contribute the code.

 Given that PL/HQL has already been released as a separate entity I'm not
 sure if we need additional IP clearance (ie you have to sign a grant) or if
 you uploading the code to a JIRA is sufficient.  Do any of the Hive PMC
 know?

 No worries if you can't respond until June 12, there's no a rush.  Enjoy
 your vacation.

 Alan.

Re: PL/HQL and Hive

[Dmitry Tolpeko]

Thanks, Alan. I will update the package naming, and try to create Jira and
patch soon.

Dmitry

On Thu, Jun 18, 2015 at 2:37 AM, Alan Gates alanfga...@gmail.com wrote:

 In Apache projects there are contributors and committers.  Contributors
 are anyone who helps with the project via code, docs, tests, bug reports,
 etc.  Committers can commit code, though it must still be reviewed by other
 committers.  On the process of becoming a committer in Hive see
 https://cwiki.apache.org/confluence/display/Hive/BecomingACommitter
 Obviously contributing a large bit of functionality starts you on that road
 nicely.

 If you need help getting the patch together let me know.

 Alan.

   Dmitry Tolpeko dmtolp...@gmail.com
  June 17, 2015 at 13:02
 Alan,

 HPL/SQL is a good name, I am ok with this change. Right now I am the only
 one developer of PL/HQL. Which status will I be given in the Hive project,
 so I can continue developing the tool? I will read docs and try to create a
 patch.

 Thanks,

 Dmitry


   Alan Gates alanfga...@gmail.com
  June 17, 2015 at 11:55
  Here's what we need to do:

 1) You need to file a JIRA proposing to contribute the code.
 2) You can then contribute the code as a patch to that JIRA.  As long as
 you've written all the code yourself this is sufficient to hand legal
 rights to Apache to contribute the code.  If others beyond you have legal
 claim to the code (ie they wrote it or paid you to write it) we'll need to
 work with Apache and those authors to get clearance to include the code.
 3) Before committing the code we need to move it to an org.apache.hive
 packaging structure.  I propose that we put it in a new package
 org.apache.hive.hplsql (see below for why I chose that).  We can take the
 patch you submit and make this change before committing or you can move it
 yourself before you contribute the patch.
 4) One of the current committers can then take the patch and get it
 committed.

 One suggestion that might be controversial:  I propose we change the name
 from PL/HQL to HPL/SQL (hence my packaging name suggestion above).  We want
 to move away from saying Hive has a language called HQL which is SQL like.
 At this point Hive's SQL is most of the way to SQL-92 so talking about HQL
 just confuses people.  Hence Hive PL/SQL (HPL/SQL) seems better.  Or if you
 prefer we could do PL/HSQL.

 Alan.

   Dmitry Tolpeko dmtolp...@gmail.com
  June 15, 2015 at 8:03
 Hi Alan,

 I am back from my vacation. Please let me know what actions, information
 is required for me regarding IP. Can we talk about Jira creation and first
 steps to make PL/HQL conform to Hive standards?

 Thanks,

 Dmitry


   Dmitry Tolpeko dmtolp...@gmail.com
  June 2, 2015 at 12:35
 Alan,

 I am new to the Hive project structure and development process, so I would
 highly appreciate your guidance (if you can initiate Jira or tell me how to
 do that i.e). Also I can grant software to Apache if required although I am
 not sure which IP clearance required. For me uploading of the code is
 sufficient.

 Thank you,

 Dmitry


   Alan Gates alanfga...@gmail.com
  June 1, 2015 at 15:50
  Dmitry,

 I'm thrilled to hear that you're open to integrating PL/HQL into Hive.

 As for how we'd do it, this is obviously something we'll have to discuss
 in the community on the dev list.  But my initial thought is that we start
 by importing it as it, mostly focussing on package name changes, etc.  So
 it starts as a stand alone.  Then over time we work on integrating it
 directly into Hive.  This will have a number of benefits for users as
 they'll be able to create and store procedures, invoke them from JDBC
 connections, grant and revoke access to procedures, etc.

 So I think the next step is to open a JIRA on it and then we can start
 building a patch to contribute the code.

 Given that PL/HQL has already been released as a separate entity I'm not
 sure if we need additional IP clearance (ie you have to sign a grant) or if
 you uploading the code to a JIRA is sufficient.  Do any of the Hive PMC
 know?

 No worries if you can't respond until June 12, there's no a rush.  Enjoy
 your vacation.

 Alan.

Re: PL/HQL and Hive

[Dmitry Tolpeko]

Alan,

HPL/SQL is a good name, I am ok with this change. Right now I am the only
one developer of PL/HQL. Which status will I be given in the Hive project,
so I can continue developing the tool? I will read docs and try to create a
patch.

Thanks,

Dmitry

On Wed, Jun 17, 2015 at 9:55 PM, Alan Gates alanfga...@gmail.com wrote:

 Here's what we need to do:

 1) You need to file a JIRA proposing to contribute the code.
 2) You can then contribute the code as a patch to that JIRA.  As long as
 you've written all the code yourself this is sufficient to hand legal
 rights to Apache to contribute the code.  If others beyond you have legal
 claim to the code (ie they wrote it or paid you to write it) we'll need to
 work with Apache and those authors to get clearance to include the code.
 3) Before committing the code we need to move it to an org.apache.hive
 packaging structure.  I propose that we put it in a new package
 org.apache.hive.hplsql (see below for why I chose that).  We can take the
 patch you submit and make this change before committing or you can move it
 yourself before you contribute the patch.
 4) One of the current committers can then take the patch and get it
 committed.

 One suggestion that might be controversial:  I propose we change the name
 from PL/HQL to HPL/SQL (hence my packaging name suggestion above).  We want
 to move away from saying Hive has a language called HQL which is SQL like.
 At this point Hive's SQL is most of the way to SQL-92 so talking about HQL
 just confuses people.  Hence Hive PL/SQL (HPL/SQL) seems better.  Or if you
 prefer we could do PL/HSQL.

 Alan.

   Dmitry Tolpeko dmtolp...@gmail.com
  June 15, 2015 at 8:03
 Hi Alan,

 I am back from my vacation. Please let me know what actions, information
 is required for me regarding IP. Can we talk about Jira creation and first
 steps to make PL/HQL conform to Hive standards?

 Thanks,

 Dmitry