Re: [VOTE] Release of Apache Phoenix Query Server 6.0.0 RC5

2021-08-02 Thread Istvan Toth 
The vote has passed with binding votes from Viraj, Rajeshbabu, and me.

Thanks to everyone who tested the release.
I'm going to finish the process and send out the announcement soon.

Istvan

On Tue, Aug 3, 2021 at 7:19 AM Istvan Toth  wrote:

> +1 (binding)
>
> * Signature: ok
> * Checksum : ok
> * Rat check: ok
>  - mvn clean apache-rat:check
> * Built from source with tests: ok
>  - mvn clean verify -DforkCount=6
> * Smoke test on assembly: ok
> - Copied thick client into assembly dir, and started with
> bin/queryserver.py
>
> Istvan
>
> On Mon, Aug 2, 2021 at 10:53 AM rajeshb...@apache.org <
> chrajeshbab...@gmail.com> wrote:
>
>> +1
>>
>> I have downloaded the source and build
>>
>> Signature: Ok
>> Checksum: Ok
>> Build: Ok
>> Unit tests: Ok
>> mvn verify: Ok.
>> rat check: Ok.
>>
>>
>> Thanks,
>> Rajeshbabu.
>>
>> On Fri, Jul 30, 2021 at 4:16 PM &&  wrote:
>>
>> > Resolved. thanks.It should be recorded in the documents.
>> >
>> >
>> >
>> >
>> > --原始邮件--
>> > 发件人:
>> >   "dev"
>> >
>> > > > 发送时间:2021年7月30日(星期五) 下午5:09
>> > 收件人:"dev"> >
>> > 主题:Re: [VOTE] Release of Apache Phoenix Query Server 6.0.0 RC5
>> >
>> >
>> >
>> > Hello luoc,
>> > You need to copy the phoenix-client-hbase-2.3.jar from the phoenix
>> > directory to the PQS directory.
>> >
>> > On Fri, Jul 30, 2021 at 8:56 AM luoc > wrote:
>> >
>> >  Hello guys,
>> >  I have already builded the RC5 on local. but
>> > Inbsp;can'tnbsp;start the
>> >  PQS.
>> > 
>> > 
>> >  The folder structure is that :
>> >  /opt/phoenix-hbase-2.3-5.1.2-bin/
>> >  /opt/phoenix-queryserver-6.0.0/
>> > 
>> > 
>> >  Then, I got the simple error message when run queryserver.py :
>> > 
>> > 
>> >  1.nbsp;./phoenix-queryserver-6.0.0/bin/queryserver.py start
>> >  gt;gt; starting Query Server, logging to
>> >  /tmp/phoenix/phoenix-root-queryserver.log
>> > 
>> > 
>> >  2. The 8765 port is not online.
>> > 
>> > 
>> >  3.nbsp;tail -f /tmp/phoenix/phoenix-root-queryserver.out
>> >  gt;gt; 2021-07-30 14:45:20.682400 launching
>> > /usr/java/default/bin/java
>> >  -cp
>> > 
>> >
>> /opt/phoenix-queryserver-6.0.0/bin/:/etc/hadoop/conf::/opt/phoenix-queryserver-6.0.0/bin/../phoenix-queryserver-6.0.0.jar:
>> >  -Dproc_phoenixserver
>> > 
>> >
>> -Dlog4j.configuration=file:/opt/phoenix-queryserver-6.0.0/bin/log4j.properties
>> >  -Dpsql.root.logger=INFO,DRFA -Dpsql.log.dir=/tmp/phoenix
>> >  -Dpsql.log.file=phoenix-root-queryserver.lognbsp;
>> >  org.apache.phoenix.queryserver.server.QueryServernbsp;
>> >  ERROR : Could not find or load main classnbsp;
>> >  org.apache.phoenix.queryserver.server.QueryServer
>> > 
>> > 
>> > 
>> >  --nbsp;原始邮件nbsp;--
>> >  发件人:
>> >
>> 
>> > "dev"
>> >
>> 
>> > <
>> >  st...@apache.orggt;;
>> >  发送时间:nbsp;2021年7月30日(星期五) 下午2:24
>> >  收件人:nbsp;"dev"> > 
>> >  主题:nbsp;Re: [VOTE] Release of Apache Phoenix Query Server
>> 6.0.0
>> > RC5
>> > 
>> > 
>> > 
>> >  Hi!
>> > 
>> >  We have a single +1 from Viraj - Thanks!
>> >  Can I get at least one more vote ?
>> >  I can add the third vote myself.
>> > 
>> >  Istvan
>> > 
>> >  On Mon, Jul 19, 2021 at 7:43 PM Viraj Jasani > > gt;
>> >  wrote:
>> > 
>> >  gt; +1
>> >  gt;
>> >  gt; * Signature: ok
>> >  gt; * Checksum : ok
>> >  gt; * Rat check (1.8.0_251): ok
>> >  gt;nbsp; - mvn clean apache-rat:check
>> >  gt; * Built from source (1.8.0_251): ok
>> >  gt;nbsp; - mvn clean installnbsp; -DskipTests
>> >  gt; * Unit tests pass (1.8.0_251): failed (a couple of
>> expected
>> >  KerberosAuth
>> >  gt; failures, others look good)
>> >  gt;nbsp; - mvn clean verify
>> >  gt;
>> >  gt;
>> >  gt; On 2021/07/16 16:08:28, Istvan Toth > gt;
>> > wrote:
>> >  gt; gt; Please vote on this Apache phoenix queryserver
>> > release candidate,
>> >  gt; gt; phoenix-queryserver-6.0.0RC5
>> >  gt; gt;
>> >  gt; gt; The VOTE will remain open for at least 72 hours.
>> >  gt; gt;
>> >  gt; gt; [ ] +1 Release this package as Apache phoenix
>> > queryserver 6.0.0
>> >  gt; gt; [ ] -1 Do not release this package because ...
>> >  gt; gt;
>> >  gt; gt; The tag to be voted on is 6.0.0RC5:
>> >  gt; gt;
>> >  gt; gt;nbsp;nbsp;
>> >  https://github.com/apache/phoenix-queryserver/tree/6.0.0RC5
>> >  gt <
>> > https://github.com/apache/phoenix-queryserver/tree/6.0.0RC5gt;;
>> > gt;
>> >  gt; gt; The release files, including signatures, digests,
>> > as well as
>> >  CHANGES.md
>> >  gt; gt; and RELEASENOTES.md included in this RC can be
>> > found at:
>> >  gt; gt;
>> >  gt; gt;
>> >  gt; gt;
>> >  gt;
>> > 
>> >
>> https://dist.apache.org/repos/dist/dev/phoenix/phoenix-queryserver-6.0.0RC5/
>> > 
>> > <
>> https://dist.apache.org/repos/dist/dev/phoenix/phoenix-queryserver-6.0.0RC5/
>> >;
>> > gt
>> >  <
>> >
>> https://dist.apache.org/repos/dist/dev/phoenix/phoenix-queryserver-6.0.0RC5/gt
>> > ;;
>> >  gt;
>> >  gt; gt; Maven artifacts are available in a staging
>> > repository at:
>> >  gt; gt;
>> >  gt; gt;nbsp;nbsp;
>>

Re: [VOTE] Release of Apache Phoenix Query Server 6.0.0 RC5

2021-08-02 Thread Istvan Toth 
+1 (binding)

* Signature: ok
* Checksum : ok
* Rat check: ok
 - mvn clean apache-rat:check
* Built from source with tests: ok
 - mvn clean verify -DforkCount=6
* Smoke test on assembly: ok
- Copied thick client into assembly dir, and started with bin/queryserver.py

Istvan

On Mon, Aug 2, 2021 at 10:53 AM rajeshb...@apache.org <
chrajeshbab...@gmail.com> wrote:

> +1
>
> I have downloaded the source and build
>
> Signature: Ok
> Checksum: Ok
> Build: Ok
> Unit tests: Ok
> mvn verify: Ok.
> rat check: Ok.
>
>
> Thanks,
> Rajeshbabu.
>
> On Fri, Jul 30, 2021 at 4:16 PM &&  wrote:
>
> > Resolved. thanks.It should be recorded in the documents.
> >
> >
> >
> >
> > --原始邮件--
> > 发件人:
> >   "dev"
> >
> >  > 发送时间:2021年7月30日(星期五) 下午5:09
> > 收件人:"dev" >
> > 主题:Re: [VOTE] Release of Apache Phoenix Query Server 6.0.0 RC5
> >
> >
> >
> > Hello luoc,
> > You need to copy the phoenix-client-hbase-2.3.jar from the phoenix
> > directory to the PQS directory.
> >
> > On Fri, Jul 30, 2021 at 8:56 AM luoc  wrote:
> >
> >  Hello guys,
> >  I have already builded the RC5 on local. but
> > Inbsp;can'tnbsp;start the
> >  PQS.
> > 
> > 
> >  The folder structure is that :
> >  /opt/phoenix-hbase-2.3-5.1.2-bin/
> >  /opt/phoenix-queryserver-6.0.0/
> > 
> > 
> >  Then, I got the simple error message when run queryserver.py :
> > 
> > 
> >  1.nbsp;./phoenix-queryserver-6.0.0/bin/queryserver.py start
> >  gt;gt; starting Query Server, logging to
> >  /tmp/phoenix/phoenix-root-queryserver.log
> > 
> > 
> >  2. The 8765 port is not online.
> > 
> > 
> >  3.nbsp;tail -f /tmp/phoenix/phoenix-root-queryserver.out
> >  gt;gt; 2021-07-30 14:45:20.682400 launching
> > /usr/java/default/bin/java
> >  -cp
> > 
> >
> /opt/phoenix-queryserver-6.0.0/bin/:/etc/hadoop/conf::/opt/phoenix-queryserver-6.0.0/bin/../phoenix-queryserver-6.0.0.jar:
> >  -Dproc_phoenixserver
> > 
> >
> -Dlog4j.configuration=file:/opt/phoenix-queryserver-6.0.0/bin/log4j.properties
> >  -Dpsql.root.logger=INFO,DRFA -Dpsql.log.dir=/tmp/phoenix
> >  -Dpsql.log.file=phoenix-root-queryserver.lognbsp;
> >  org.apache.phoenix.queryserver.server.QueryServernbsp;
> >  ERROR : Could not find or load main classnbsp;
> >  org.apache.phoenix.queryserver.server.QueryServer
> > 
> > 
> > 
> >  --nbsp;原始邮件nbsp;--
> >  发件人:
> >
> 
> > "dev"
> >
> 
> > <
> >  st...@apache.orggt;;
> >  发送时间:nbsp;2021年7月30日(星期五) 下午2:24
> >  收件人:nbsp;"dev" > 
> >  主题:nbsp;Re: [VOTE] Release of Apache Phoenix Query Server 6.0.0
> > RC5
> > 
> > 
> > 
> >  Hi!
> > 
> >  We have a single +1 from Viraj - Thanks!
> >  Can I get at least one more vote ?
> >  I can add the third vote myself.
> > 
> >  Istvan
> > 
> >  On Mon, Jul 19, 2021 at 7:43 PM Viraj Jasani  > gt;
> >  wrote:
> > 
> >  gt; +1
> >  gt;
> >  gt; * Signature: ok
> >  gt; * Checksum : ok
> >  gt; * Rat check (1.8.0_251): ok
> >  gt;nbsp; - mvn clean apache-rat:check
> >  gt; * Built from source (1.8.0_251): ok
> >  gt;nbsp; - mvn clean installnbsp; -DskipTests
> >  gt; * Unit tests pass (1.8.0_251): failed (a couple of expected
> >  KerberosAuth
> >  gt; failures, others look good)
> >  gt;nbsp; - mvn clean verify
> >  gt;
> >  gt;
> >  gt; On 2021/07/16 16:08:28, Istvan Toth  gt;
> > wrote:
> >  gt; gt; Please vote on this Apache phoenix queryserver
> > release candidate,
> >  gt; gt; phoenix-queryserver-6.0.0RC5
> >  gt; gt;
> >  gt; gt; The VOTE will remain open for at least 72 hours.
> >  gt; gt;
> >  gt; gt; [ ] +1 Release this package as Apache phoenix
> > queryserver 6.0.0
> >  gt; gt; [ ] -1 Do not release this package because ...
> >  gt; gt;
> >  gt; gt; The tag to be voted on is 6.0.0RC5:
> >  gt; gt;
> >  gt; gt;nbsp;nbsp;
> >  https://github.com/apache/phoenix-queryserver/tree/6.0.0RC5
> >  gt <
> > https://github.com/apache/phoenix-queryserver/tree/6.0.0RC5gt;;
> > gt;
> >  gt; gt; The release files, including signatures, digests,
> > as well as
> >  CHANGES.md
> >  gt; gt; and RELEASENOTES.md included in this RC can be
> > found at:
> >  gt; gt;
> >  gt; gt;
> >  gt; gt;
> >  gt;
> > 
> >
> https://dist.apache.org/repos/dist/dev/phoenix/phoenix-queryserver-6.0.0RC5/
> > 
> > <
> https://dist.apache.org/repos/dist/dev/phoenix/phoenix-queryserver-6.0.0RC5/
> >;
> > gt
> >  <
> >
> https://dist.apache.org/repos/dist/dev/phoenix/phoenix-queryserver-6.0.0RC5/gt
> > ;;
> >  gt;
> >  gt; gt; Maven artifacts are available in a staging
> > repository at:
> >  gt; gt;
> >  gt; gt;nbsp;nbsp;
> > https://repository.apache.org/#stagingRepositories
> >  ; gt <
> > https://repository.apache.org/#stagingRepositoriesgt;;
> >  (orgapachephoenix-1242)
> >  gt; gt;
> >  gt; gt; Artifacts were signed with the 0x794433C7 key
> which
> > can be found
> >  in:
> >  gt; gt;
> >  gt; gt;nbsp;nbsp;
> >  https://dist.apache.org/repos/dist/release/phoenix/KEYS
> >  gt <
> >

Next Tech Talk Meeting in September 02

2021-08-02 Thread Kadir Ozdemir 
Hi All,

The next tech talk meeting will be on September 02. We have not received
any proposal for the August meeting yet and so we will skip it. I will
update https://phoenix.apache.org/tech_talks.html accordingly. If you are
thinking about being a host for the next meeting, please let us know soon.

Thanks,
Kadir

Re: IndexToolForNonTxGlobalIndexIT.testIndexToolFailedMapperNotRecordToResultTable[mutable=true, singleCellIndex=true] almost failed on matser

2021-08-02 Thread Geoffrey Jacoby 
Tests which do incremental index rebuilds should start with
"Assume.assumeTrue(HbaseCompatCapabilities.isRawFilterSupported());" so
they no-op when run against versions of HBase between 2.0 and 2.2.4 (since
the raw skip scan fix was in 2.2.5). When this test was added in
PHOENIX-6462 this must have been an oversight.

This test failure was while running against an older HBase 2 build, right?
(Otherwise we may have two problems, if HbaseCompatCapabilities is
returning a wrong answer.)

Geoffrey

On Sun, Aug 1, 2021 at 3:55 AM cheng...@apache.org 
wrote:

> It seems that
> IndexToolForNonTxGlobalIndexIT.testIndexToolFailedMapperNotRecordToResultTable[mutable=true,
> singleCellIndex=true] almost failed on matser.
> The stack is:
> org.apache.phoenix.SystemExitRule$SystemExitInTestException
> at
> org.apache.phoenix.TestSecurityManager.checkExit(TestSecurityManager.java:31)
> at java.lang.Runtime.exit(Runtime.java:108)
> at java.lang.System.exit(System.java:973)
> at
> org.apache.phoenix.mapreduce.index.IndexTool.printHelpAndExit(IndexTool.java:454)
> at
> org.apache.phoenix.mapreduce.index.IndexTool.printHelpAndExit(IndexTool.java:448)
> at
> org.apache.phoenix.mapreduce.index.IndexTool.run(IndexTool.java:797)
> at
> org.apache.phoenix.end2end.IndexToolIT.runIndexTool(IndexToolIT.java:975)
> at
> org.apache.phoenix.end2end.IndexToolIT.runIndexTool(IndexToolIT.java:958)
> at
> org.apache.phoenix.end2end.IndexToolForNonTxGlobalIndexIT.testIndexToolFailedMapperNotRecordToResultTable(IndexToolForNonTxGlobalIndexIT.java:655)
> The error message is :
> [main] org.apache.phoenix.end2end.IndexToolIT(974): Running IndexTool with
> [--schema=N17, --data-table=N18, --index-table=N19, -direct,
> -v, BEFORE, -runfg, -dl, NONE, -op,
> /tmp/93dd3660-6fc8-45f6-89c9-a704da477e18, -rv, 1627707654873]
> Can't do incremental index verification on this version of HBase because
> raw skip scan filters are not supported.
>
>
>
>
>
>

[jira] [Resolved] (PHOENIX-6480) SchemaExtractionProcessor doesn't add IMMUTABLE_STORAGE_SCHEME and COLUMN_ENCODED_BYTES to the generated sql

2021-08-02 Thread Jira 


 [ 
https://issues.apache.org/jira/browse/PHOENIX-6480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Richárd Antal resolved PHOENIX-6480.

Fix Version/s: 5.1.3
   4.16.2
   5.2.0
   4.17.0
   Resolution: Fixed

> SchemaExtractionProcessor doesn't add IMMUTABLE_STORAGE_SCHEME and 
> COLUMN_ENCODED_BYTES to the generated sql
> 
>
> Key: PHOENIX-6480
> URL: https://issues.apache.org/jira/browse/PHOENIX-6480
> Project: Phoenix
>  Issue Type: Bug
>Reporter: Gokcen Iskender
>Assignee: Gokcen Iskender
>Priority: Major
> Fix For: 4.17.0, 5.2.0, 4.16.2, 5.1.3
>
>
> convertPropertiesToString function has a check
> if(value!=null && defaultProps.get(key) != null && 
> !value.equals(defaultProps.get(key)))
> Since the value is not in defaultProps, it doesn't add it to the generated 
> ddl.
> Also, is it possible to do IF NOT EXISTS to CREATE statement and ASYNC 
> perhaps?
> Also move the phoenix-tools util into phoenix-core to avoid circular 
> dependency



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: [VOTE] Release of Apache Phoenix Query Server 6.0.0 RC5

2021-08-02 Thread rajeshb...@apache.org 
+1

I have downloaded the source and build

Signature: Ok
Checksum: Ok
Build: Ok
Unit tests: Ok
mvn verify: Ok.
rat check: Ok.


Thanks,
Rajeshbabu.

On Fri, Jul 30, 2021 at 4:16 PM &&  wrote:

> Resolved. thanks.It should be recorded in the documents.
>
>
>
>
> --原始邮件--
> 发件人:
>   "dev"
>
>  发送时间:2021年7月30日(星期五) 下午5:09
> 收件人:"dev"
> 主题:Re: [VOTE] Release of Apache Phoenix Query Server 6.0.0 RC5
>
>
>
> Hello luoc,
> You need to copy the phoenix-client-hbase-2.3.jar from the phoenix
> directory to the PQS directory.
>
> On Fri, Jul 30, 2021 at 8:56 AM luoc 
>  Hello guys,
>  I have already builded the RC5 on local. but
> Inbsp;can'tnbsp;start the
>  PQS.
> 
> 
>  The folder structure is that :
>  /opt/phoenix-hbase-2.3-5.1.2-bin/
>  /opt/phoenix-queryserver-6.0.0/
> 
> 
>  Then, I got the simple error message when run queryserver.py :
> 
> 
>  1.nbsp;./phoenix-queryserver-6.0.0/bin/queryserver.py start
>  gt;gt; starting Query Server, logging to
>  /tmp/phoenix/phoenix-root-queryserver.log
> 
> 
>  2. The 8765 port is not online.
> 
> 
>  3.nbsp;tail -f /tmp/phoenix/phoenix-root-queryserver.out
>  gt;gt; 2021-07-30 14:45:20.682400 launching
> /usr/java/default/bin/java
>  -cp
> 
> /opt/phoenix-queryserver-6.0.0/bin/:/etc/hadoop/conf::/opt/phoenix-queryserver-6.0.0/bin/../phoenix-queryserver-6.0.0.jar:
>  -Dproc_phoenixserver
> 
> -Dlog4j.configuration=file:/opt/phoenix-queryserver-6.0.0/bin/log4j.properties
>  -Dpsql.root.logger=INFO,DRFA -Dpsql.log.dir=/tmp/phoenix
>  -Dpsql.log.file=phoenix-root-queryserver.lognbsp;
>  org.apache.phoenix.queryserver.server.QueryServernbsp;
>  ERROR : Could not find or load main classnbsp;
>  org.apache.phoenix.queryserver.server.QueryServer
> 
> 
> 
>  --nbsp;原始邮件nbsp;--
>  发件人:
> 
> "dev"
> 
> <
>  st...@apache.orggt;;
>  发送时间:nbsp;2021年7月30日(星期五) 下午2:24
>  收件人:nbsp;"dev" 
>  主题:nbsp;Re: [VOTE] Release of Apache Phoenix Query Server 6.0.0
> RC5
> 
> 
> 
>  Hi!
> 
>  We have a single +1 from Viraj - Thanks!
>  Can I get at least one more vote ?
>  I can add the third vote myself.
> 
>  Istvan
> 
>  On Mon, Jul 19, 2021 at 7:43 PM Viraj Jasani  gt;
>  wrote:
> 
>  gt; +1
>  gt;
>  gt; * Signature: ok
>  gt; * Checksum : ok
>  gt; * Rat check (1.8.0_251): ok
>  gt;nbsp; - mvn clean apache-rat:check
>  gt; * Built from source (1.8.0_251): ok
>  gt;nbsp; - mvn clean installnbsp; -DskipTests
>  gt; * Unit tests pass (1.8.0_251): failed (a couple of expected
>  KerberosAuth
>  gt; failures, others look good)
>  gt;nbsp; - mvn clean verify
>  gt;
>  gt;
>  gt; On 2021/07/16 16:08:28, Istvan Toth  wrote:
>  gt; gt; Please vote on this Apache phoenix queryserver
> release candidate,
>  gt; gt; phoenix-queryserver-6.0.0RC5
>  gt; gt;
>  gt; gt; The VOTE will remain open for at least 72 hours.
>  gt; gt;
>  gt; gt; [ ] +1 Release this package as Apache phoenix
> queryserver 6.0.0
>  gt; gt; [ ] -1 Do not release this package because ...
>  gt; gt;
>  gt; gt; The tag to be voted on is 6.0.0RC5:
>  gt; gt;
>  gt; gt;nbsp;nbsp;
>  https://github.com/apache/phoenix-queryserver/tree/6.0.0RC5
>  gt <
> https://github.com/apache/phoenix-queryserver/tree/6.0.0RC5gt;;
> gt;
>  gt; gt; The release files, including signatures, digests,
> as well as
>  CHANGES.md
>  gt; gt; and RELEASENOTES.md included in this RC can be
> found at:
>  gt; gt;
>  gt; gt;
>  gt; gt;
>  gt;
> 
> https://dist.apache.org/repos/dist/dev/phoenix/phoenix-queryserver-6.0.0RC5/
> 
> ;
> gt
>  <
> https://dist.apache.org/repos/dist/dev/phoenix/phoenix-queryserver-6.0.0RC5/gt
> ;;
>  gt;
>  gt; gt; Maven artifacts are available in a staging
> repository at:
>  gt; gt;
>  gt; gt;nbsp;nbsp;
> https://repository.apache.org/#stagingRepositories
>  ; gt <
> https://repository.apache.org/#stagingRepositoriesgt;;
>  (orgapachephoenix-1242)
>  gt; gt;
>  gt; gt; Artifacts were signed with the 0x794433C7 key which
> can be found
>  in:
>  gt; gt;
>  gt; gt;nbsp;nbsp;
>  https://dist.apache.org/repos/dist/release/phoenix/KEYS
>  gt <
> https://dist.apache.org/repos/dist/release/phoenix/KEYSgt;;
> gt;
>  gt; gt; To learn more about Apache phoenix queryserver,
> please see
>  gt; gt;
>  gt; gt;nbsp;nbsp; https://phoenix.apache.org/
>  ; gt; gt;
>  gt; gt; Thanks,
>  gt; gt; Istvan
>  gt; gt;
>  gt;
>
>
>
> --
> *István Tóth* | Staff Software Engineer
> st...@cloudera.com  [image: Cloudera]  [image: Cloudera on Twitter]  Cloudera on Facebook]  Cloudera
> on LinkedIn]   --

[jira] [Updated] (PHOENIX-5543) Implement show schemas / show tables SQL commands

2021-08-02 Thread Jira 


 [ 
https://issues.apache.org/jira/browse/PHOENIX-5543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Richárd Antal updated PHOENIX-5543:
---
Fix Version/s: (was: 4.16.1)
   4.16.2

> Implement show schemas / show tables SQL commands
> -
>
> Key: PHOENIX-5543
> URL: https://issues.apache.org/jira/browse/PHOENIX-5543
> Project: Phoenix
>  Issue Type: Improvement
>Affects Versions: 4.15.0, 5.1.0
>Reporter: Bharath Vissapragada
>Assignee: Bharath Vissapragada
>Priority: Minor
> Fix For: 5.1.0, 4.17.0, 4.16.2
>
> Attachments: PHOENIX-5543-4.x.v1.patch, PHOENIX-5543.master.v1.patch, 
> PHOENIX-5543.master.v2.patch, PHOENIX-5543.master.v3.patch
>
>  Time Spent: 3h 40m
>  Remaining Estimate: 0h
>
> Currently users rely on {{!tables}} and {{!schemas}} commands provided by 
> sqlline which pulls the information using the standard JDBC metadata calls 
> like {{getTables()}} and {{getSchemas()}}.
> Most other databases (like mysql[1,2]) implement these as first class SQL 
> commands that gives the user more flexibility in querying by adding necessary 
> filters and looking up for table information in specific schemas. The ask 
> here is to implement the following SQL commands.
> {noformat}
> SHOW SCHEMAS [LIKE '']
> SHOW TABLES [IN ] [LIKE '']
> {noformat}
> [1] https://dev.mysql.com/doc/refman/8.0/en/show-tables.html
> [2] https://dev.mysql.com/doc/refman/8.0/en/show-databases.html



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (PHOENIX-6519) Make SchemaTool work with lower case table and column names

2021-08-02 Thread Jira 


 [ 
https://issues.apache.org/jira/browse/PHOENIX-6519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Richárd Antal updated PHOENIX-6519:
---
Fix Version/s: 4.16.2

> Make SchemaTool work with lower case table and column names
> ---
>
> Key: PHOENIX-6519
> URL: https://issues.apache.org/jira/browse/PHOENIX-6519
> Project: Phoenix
>  Issue Type: Task
>  Components: core
>Reporter: Richárd Antal
>Assignee: Richárd Antal
>Priority: Major
> Fix For: 4.17.0, 5.2.0, 4.16.2, 5.1.3
>
>
> I wrote this test as part of a PR for PHOENIX-6518 and it fails.
> {code:java}
> @Test
> public void testCreateTableStatementLowerCase() throws Exception {
> String tableName = "lowecasetbl1";
> String schemaName = "lowecaseschemaname1";
> String pTableFullName = SchemaUtil.getEscapedTableName(schemaName, 
> tableName);
> String createTableStmt = "CREATE TABLE "+ pTableFullName + 
> "(\"smallK\" VARCHAR NOT NULL PRIMARY KEY, "
> + "V1 VARCHAR, V2 VARCHAR) TTL=2592000, IMMUTABLE_ROWS=TRUE, 
> DISABLE_WAL=TRUE";
> List queries = new ArrayList(){};
> queries.add(createTableStmt);
> String result = runSchemaExtractionTool("\"" + schemaName + "\"", 
> "\"" + tableName + "\"", null, queries);
> Assert.assertEquals(createTableStmt, result.toUpperCase());
> }{code}
> Expected:
> {code:java}
> CREATE TABLE "lowecaseschemaname1"."lowecasetbl1"("smallK" VARCHAR NOT NULL 
> PRIMARY KEY, V1 VARCHAR, V2 VARCHAR) TTL=2592000, IMMUTABLE_ROWS=TRUE, 
> DISABLE_WAL=TRUE{code}
> Actual result:
> {code:java}
> CREATE TABLE LOWECASESCHEMANAME1.LOWECASETBL1(SMALLK VARCHAR NOT NULL PRIMARY 
> KEY, V1 VARCHAR, V2 VARCHAR) TTL=2592000, IMMUTABLE_ROWS=TRUE, 
> DISABLE_WAL=TRUE{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Updated] (PHOENIX-6518) Implement SHOW CREATE TABLE SQL command

2021-08-02 Thread Jira 


 [ 
https://issues.apache.org/jira/browse/PHOENIX-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Richárd Antal updated PHOENIX-6518:
---
Fix Version/s: 4.16.2

> Implement SHOW CREATE TABLE SQL command
> ---
>
> Key: PHOENIX-6518
> URL: https://issues.apache.org/jira/browse/PHOENIX-6518
> Project: Phoenix
>  Issue Type: Task
>  Components: core
>Reporter: Richárd Antal
>Assignee: Richárd Antal
>Priority: Major
> Fix For: 4.17.0, 5.2.0, 4.16.2, 5.1.3
>
>
> With PHOENIX-5946 and PHOENIX-6454 it is possible to generate effective DDL 
> for a table/view/index using the SchemaTool and an hbase command.
>  Implement SHOW CREATE TABLE sql command to further utilize this 
> functionality.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: Apache spark plugin - Optional SELECT columns in push down predicates

2021-08-02 Thread Istvan Toth 
These kinds of questions are better asked on the u...@phoenix.apache.org
list.

You can check the tests in

https://github.com/apache/phoenix-connectors/blob/master/phoenix-spark-base/src/it/scala/org/apache/phoenix/spark/PhoenixSparkIT.scala

to get an idea of how to use push down support. (It is automatic for the
supported cases)

I don't know of any specific issue with using the Phoenix connector from
pySpark (as opposed to Scala or Java)

Istvan

On Mon, Jul 26, 2021 at 4:19 PM Karthigeyan r 
wrote:

> Hello Team,
>
>
>
> We are working on Apache Phoenix table with Spark Integration. There is a
> table which has millions of records and we wanted to apply pushdown
> predicates for efficient filtering Before we pull all records from
> underlying apache phoenix table.
>
>
>
> When I looked into the document , I couldn’t see the example related to
> that under Apache Spark Plugin documentation. Can you please update the
> documentation with the example for pushdown predicates for Pyspark
> especially ?
>
>
>
> Regards,
>
> Karthigeyan
>


-- 
*István Tóth* | Staff Software Engineer
st...@cloudera.com 
[image: Cloudera] 
[image: Cloudera on Twitter]  [image:
Cloudera on Facebook]  [image: Cloudera
on LinkedIn] 

--