svn commit: r45842 [2/3] - /dev/phoenix/phoenix-5.1.0RC4/
Added: dev/phoenix/phoenix-5.1.0RC4/CHANGES.md == --- dev/phoenix/phoenix-5.1.0RC4/CHANGES.md (added) +++ dev/phoenix/phoenix-5.1.0RC4/CHANGES.md Fri Feb 5 09:15:40 2021 @@ -0,0 +1,748 @@ + + +# PHOENIX Changelog + +## Release 5.1.0 - Unreleased (as of 2021-02-05) + + + +### IMPORTANT ISSUES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-5265](https://issues.apache.org/jira/browse/PHOENIX-5265) | [UMBRELLA] Phoenix Test should use object based Plan for result comparison instead of using hard-corded comparison | Major | . | +| [PHOENIX-4412](https://issues.apache.org/jira/browse/PHOENIX-4412) | Tephra transaction context visibility level returns null instead of SNAPSHOT\_ALL | Critical | . | +| [PHOENIX-5446](https://issues.apache.org/jira/browse/PHOENIX-5446) | Support Protobuf shaded clients (thin + thick) | Major | . | +| [PHOENIX-4866](https://issues.apache.org/jira/browse/PHOENIX-4866) | UDFs get error: org.apache.phoenix.schema.FunctionNotFoundException: ERROR 6001 (42F01): Function undefined | Blocker | . | +| [PHOENIX-3655](https://issues.apache.org/jira/browse/PHOENIX-3655) | Global Phoenix Client Metrics for PQS | Major | . | + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6213](https://issues.apache.org/jira/browse/PHOENIX-6213) | Extend Cell Tags to Delete object. | Major | . | +| [PHOENIX-6280](https://issues.apache.org/jira/browse/PHOENIX-6280) | Support HBase 2.4 | Major | core | +| [PHOENIX-6186](https://issues.apache.org/jira/browse/PHOENIX-6186) | Store table metadata last modified timestamp in PTable / System.Catalog | Major | . | +| [PHOENIX-5628](https://issues.apache.org/jira/browse/PHOENIX-5628) | Phoenix Function to Return HBase Row Key of Column Cell | Major | . | +| [PHOENIX-3547](https://issues.apache.org/jira/browse/PHOENIX-3547) | Promote CATALOG.VIEW\_INDEX\_ID to an int | Blocker | . | +| [PHOENIX-5426](https://issues.apache.org/jira/browse/PHOENIX-5426) | IndexUpgradeTestTool lacks an Apache License | Blocker | . | +| [PHOENIX-5252](https://issues.apache.org/jira/browse/PHOENIX-5252) | Add job priority option to UpdateStatisticsTool | Major | . | +| [PHOENIX-5180](https://issues.apache.org/jira/browse/PHOENIX-5180) | Add API to PhoenixRunTime to get ptable of a tenant using a global connection | Major | . | +| [PHOENIX-5062](https://issues.apache.org/jira/browse/PHOENIX-5062) | Create a new repo for the phoenix connectors | Major | . | +| [PHOENIX-5063](https://issues.apache.org/jira/browse/PHOENIX-5063) | Create a new repo for the phoenix query server | Major | . | +| [PHOENIX-5124](https://issues.apache.org/jira/browse/PHOENIX-5124) | Add config to enable PropertyPolicyProvider | Major | . | +| [PHOENIX-374](https://issues.apache.org/jira/browse/PHOENIX-374) | Enable access to dynamic columns in \* or cf.\* selection | Critical | . | +| [PHOENIX-3623](https://issues.apache.org/jira/browse/PHOENIX-3623) | Integrate Omid with Phoenix | Major | . | +| [PHOENIX-5128](https://issues.apache.org/jira/browse/PHOENIX-5128) | Provide option to skip header with CsvBulkLoadTool | Major | . | +| [PHOENIX-5025](https://issues.apache.org/jira/browse/PHOENIX-5025) | Tool to clean up orphan views | Major | . | +| [PHOENIX-4983](https://issues.apache.org/jira/browse/PHOENIX-4983) | Allow using a connection with a SCN set to write data to tables EXCEPT transactional tables or mutable tables with indexes or tables with a ROW\_TIMESTAMP column | Major | . | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6114](https://issues.apache.org/jira/browse/PHOENIX-6114) | Create shaded phoenix-pherf and remove lib dir from assembly | Major | core | +| [PHOENIX-6182](https://issues.apache.org/jira/browse/PHOENIX-6182) | IndexTool to verify and repair every index row | Major | . | +| [PHOENIX-5543](https://issues.apache.org/jira/browse/PHOENIX-5543) | Implement show schemas / show tables SQL commands | Minor | . | +| [PHOENIX-6349](https://issues.apache.org/jira/browse/PHOENIX-6349) | Add and use commons-cli to phoenix-thirdparty | Major | . | +| [PHOENIX-6337](https://issues.apache.org/jira/browse/PHOENIX-6337) | Bump default HBase versions to 2.3.4 | Minor | . | +| [PHOENIX-6250](https://issues.apache.org/jira/browse/PHOENIX-6250) | Fix ViewMetadataIT test flapper | Major | . | +| [PHOENIX-6327](https://issues.apache.org/jira/browse/PHOENIX-6327) | Consolidate Junit test categories | Minor | core | +| [PHOENIX-6276](https://issues.apache.org/jira/browse/PHOENIX-6276) | Log when hconnection is getting closed in ConnectionQueryServicesImpl | Major | core | +| [PHOENIX-5841](https://issues.apache.org/jira/browse/PHOENIX-5841) | When data columns get TTLed, we need inline index validation to publish
svn commit: r45842 [3/3] - /dev/phoenix/phoenix-5.1.0RC4/
Added: dev/phoenix/phoenix-5.1.0RC4/RELEASENOTES.md == --- dev/phoenix/phoenix-5.1.0RC4/RELEASENOTES.md (added) +++ dev/phoenix/phoenix-5.1.0RC4/RELEASENOTES.md Fri Feb 5 09:15:40 2021 @@ -0,0 +1,183 @@ + + +# PHOENIX 5.1.0 Release Notes + +These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements. + + +--- + +* [PHOENIX-6349](https://issues.apache.org/jira/browse/PHOENIX-6349) | *Major* | **Add and use commons-cli to phoenix-thirdparty** + +Added phoenix-shaded-commons-cli to phoenix-thirdparty. +This helps avoid classpath conflicts and includes a patch on top of commons-cli 1.4.0 that fixes CLI-254. + + +--- + +* [PHOENIX-6273](https://issues.apache.org/jira/browse/PHOENIX-6273) | *Major* | **Add support to handle MR Snapshot restore externally** + +Adds mapreduce configuration param "phoenix.mapreduce.external.snapshot.restore" which when set to true indicates that snapshot-based MapReduce jobs shouldn't try to restore the snapshot themselves, but assume an external application has already done so. + + +--- + +* [PHOENIX-6323](https://issues.apache.org/jira/browse/PHOENIX-6323) | *Blocker* | **isRawFilterSupported() returns true for HBase 2.2 compat module** + +When used with HBase 2.2, Phoenix now only support HBase 2.2.5 and later versions. (i.e HBase 2.2.0-2.2.4 are not supported) + + +--- + +* [PHOENIX-6326](https://issues.apache.org/jira/browse/PHOENIX-6326) | *Critical* | **Phoenix doesn't work with Java version 11.0.9.1 , due to Jetty problem** + +There is bug in the Jetty version used by HBase 2.3 and earlier, that causes incompatilbity with Java releases that have a four number version string like "11.0.9.1" +As Phoenix builds on top of HBase, Phoenix is also incompatible with these releases, when built with an hbase.profile older than 2.4. + + +--- + +* [PHOENIX-6307](https://issues.apache.org/jira/browse/PHOENIX-6307) | *Major* | **Build and release official binary distributions with each HBase profile** + +The phoenix-client and phoenix-server JARs have been renamed to include the supported HBase version. + +Instead of phoenix-client-\.jar, the client is now phoenix-client-hbase-\-\.jar +I.e. The Phoenix 4.16 client for Hbase 1.5 is now called phoenix-client-hbase-1.5-5.1.0.jar + +The maven coordinates also have also changed to "org.apache.phoenix:phoenix-client-hbase-\:\". +I.e the Phoenix 4.15.0 client for Hbase 1.5 is "org.apache.phoenix:phoenix-client:4.15.0-HBase-1.5", but the phoenix client for Phoenix 4.16 is "org.apache.phoenix:phoenix-client-hbase-1.5:4.16.0" + + +--- + +* [PHOENIX-5265](https://issues.apache.org/jira/browse/PHOENIX-5265) | *Major* | **[UMBRELLA] Phoenix Test should use object based Plan for result comparison instead of using hard-corded comparison** + +New API for Explain plan queries that can be used for comparison of individual plan attributes. + + +--- + +* [PHOENIX-6280](https://issues.apache.org/jira/browse/PHOENIX-6280) | *Major* | **Support HBase 2.4** + +HBase 2.4 is now supported. (Tested with HBase 2.4.0) + + +--- + +* [PHOENIX-6282](https://issues.apache.org/jira/browse/PHOENIX-6282) | *Major* | **Generate PB files inline with build and remove checked in files** + +We no longer have generated protobuf Java files available in source code. These files are expected to be generated inline with mvn build. We have also used an optimization with the plugin to ensure protoc is not invoked with mvn build if no .proto file is updated between two consecutive builds. + + +--- + +* [PHOENIX-6086](https://issues.apache.org/jira/browse/PHOENIX-6086) | *Critical* | **Take a snapshot of all SYSTEM tables before attempting to upgrade them** + +While upgrading System tables, all system tables where we perform some significant DDL operations, we start taking snapshots of them: + +1. SYSTEM.CATALOG (was already covered before this Jira) +2. SYSTEM.CHILD\_LINK +3. SYSTEM.SEQUENCE +4. SYSTEM.STATS +5. SYSTEM.TASK + +If the upgrade doesn't complete successfully, we should get warning log providing all snapshots taken so far, which can be used to restore some snapshots if required. + + +A sample Warning log: + +Failed upgrading System tables. Snapshots for system tables created so far: {SYSTEM:STATS=SNAPSHOT\_SYSTEM.STATS\_4.15.x\_TO\_4.16.0\_20201202114411, SYSTEM:CATALOG=SNAPSHOT\_SYSTEM.CATALOG\_4.15.x\_TO\_4.16.0\_20201202114258, SYSTEM:CHILD\_LINK=SNAPSHOT\_SYSTEM.CHILD\_LINK\_4.15.x\_TO\_4.16.0\_20201202114405, SYSTEM:SEQUENCE=SNAPSHOT\_SYSTEM.SEQUENCE\_4.15.x\_TO\_4.16.0\_20201202114407, SYSTEM:TASK=SNAPSHOT\_SYSTEM.TASK\_4.15.x\_TO\_4.16.0\_20201202114413} + + +--- + +* [PHOENIX-4412](https://issues.apache.org/jira/browse/PHOENIX-4412) | *Critical* | **Tephra transaction context visibility level returns null instead of SNAPSHOT\_ALL** + +**WARNING: No release note provided for this ch
[phoenix] 01/01: Preparing phoenix release 5.1.0RC4; tagging and updates to CHANGES.md and RELEASENOTES.md
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to tag 5.1.0RC4 in repository https://gitbox.apache.org/repos/asf/phoenix.git commit cfed94c1a534e793326b763e0ad40749d75ef061 Author: Istvan Toth AuthorDate: Fri Feb 5 08:27:28 2021 + Preparing phoenix release 5.1.0RC4; tagging and updates to CHANGES.md and RELEASENOTES.md
[phoenix] branch 5.1 updated (611196f -> cfed94c)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git. from 611196f PHOENIX-6114 Create shaded phoenix-pherf and remove lib dir from assembly (addendum: fix apache-rat check) add cfed94c Preparing phoenix release 5.1.0RC4; tagging and updates to CHANGES.md and RELEASENOTES.md No new revisions were added by this update. Summary of changes:
[phoenix] tag 5.1.0RC4 created (now cfed94c)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to tag 5.1.0RC4 in repository https://gitbox.apache.org/repos/asf/phoenix.git. at cfed94c (commit) This tag includes the following new commits: new cfed94c Preparing phoenix release 5.1.0RC4; tagging and updates to CHANGES.md and RELEASENOTES.md The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[phoenix] branch 4.x updated: PHOENIX-6114 Create shaded phoenix-pherf and remove lib dir from assembly (addendum: sync shade-plugin config to master)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/4.x by this push: new 0d5bb3e PHOENIX-6114 Create shaded phoenix-pherf and remove lib dir from assembly (addendum: sync shade-plugin config to master) 0d5bb3e is described below commit 0d5bb3e8a10b27e3812d386721103f901dd422c1 Author: Istvan Toth AuthorDate: Fri Feb 5 21:53:41 2021 +0100 PHOENIX-6114 Create shaded phoenix-pherf and remove lib dir from assembly (addendum: sync shade-plugin config to master) --- phoenix-pherf/pom.xml | 1 + 1 file changed, 1 insertion(+) diff --git a/phoenix-pherf/pom.xml b/phoenix-pherf/pom.xml index 632b1c2..1c80b75 100644 --- a/phoenix-pherf/pom.xml +++ b/phoenix-pherf/pom.xml @@ -191,6 +191,7 @@ false false + ${basedir}/target/pom.xml
[phoenix-queryserver] branch master updated: PHOENIX-6177 Queryserver Avatica and Jetty versions are incompatible
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-queryserver.git The following commit(s) were added to refs/heads/master by this push: new e25c941 PHOENIX-6177 Queryserver Avatica and Jetty versions are incompatible e25c941 is described below commit e25c9419e9303ec7022e65a4e978dd11b50d4907 Author: Istvan Toth AuthorDate: Wed Feb 3 09:22:44 2021 +0100 PHOENIX-6177 Queryserver Avatica and Jetty versions are incompatible sync jetty version to avatica 1.17.0 --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index dce82dc..98727cd 100644 --- a/pom.xml +++ b/pom.xml @@ -80,7 +80,7 @@ 2.12.0 2.2.4 -9.4.31.v20200723 +9.4.15.v20190215 2.5 3.2.2 1.9.0
svn commit: r45953 - /dev/phoenix/phoenix-5.1.0RC4/ /release/phoenix/phoenix-5.1.0/
Author: stoty Date: Wed Feb 10 07:24:07 2021 New Revision: 45953 Log: release Phoenix 5.1.0 Added: release/phoenix/phoenix-5.1.0/ - copied from r45952, dev/phoenix/phoenix-5.1.0RC4/ Removed: dev/phoenix/phoenix-5.1.0RC4/
[phoenix] annotated tag 5.1.0 created (now 26930e7)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to annotated tag 5.1.0 in repository https://gitbox.apache.org/repos/asf/phoenix.git. at 26930e7 (tag) tagging cfed94c1a534e793326b763e0ad40749d75ef061 (commit) replaces v5.0.0-HBase-2.0 by Istvan Toth on Wed Feb 10 08:26:01 2021 +0100 - Log - Phoenix 5.1.0 release --- No new revisions were added by this update.
[phoenix] branch master updated: Update version to 5.2.0-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new 9e90779 Update version to 5.2.0-SNAPSHOT 9e90779 is described below commit 9e907796908d694522d9dfe1c4c3f27d12248a1d Author: Istvan Toth AuthorDate: Wed Feb 10 08:47:07 2021 +0100 Update version to 5.2.0-SNAPSHOT --- phoenix-assembly/pom.xml | 2 +- phoenix-client-parent/phoenix-client-embedded/pom.xml | 2 +- phoenix-client-parent/phoenix-client/pom.xml | 2 +- phoenix-client-parent/pom.xml | 2 +- phoenix-core/pom.xml | 2 +- phoenix-hbase-compat-2.1.6/pom.xml| 2 +- phoenix-hbase-compat-2.2.5/pom.xml| 2 +- phoenix-hbase-compat-2.3.0/pom.xml| 2 +- phoenix-hbase-compat-2.4.0/pom.xml| 2 +- phoenix-pherf/pom.xml | 2 +- phoenix-server/pom.xml| 2 +- phoenix-tools/pom.xml | 2 +- phoenix-tracing-webapp/pom.xml| 2 +- pom.xml | 2 +- 14 files changed, 14 insertions(+), 14 deletions(-) diff --git a/phoenix-assembly/pom.xml b/phoenix-assembly/pom.xml index 2bb8222..9ee6dda 100644 --- a/phoenix-assembly/pom.xml +++ b/phoenix-assembly/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix -5.1.0-SNAPSHOT +5.2.0-SNAPSHOT phoenix-assembly Phoenix Assembly diff --git a/phoenix-client-parent/phoenix-client-embedded/pom.xml b/phoenix-client-parent/phoenix-client-embedded/pom.xml index 921cbc7..215f4e3 100644 --- a/phoenix-client-parent/phoenix-client-embedded/pom.xml +++ b/phoenix-client-parent/phoenix-client-embedded/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix-client-parent -5.1.0-SNAPSHOT +5.2.0-SNAPSHOT phoenix-client-embedded-${hbase.suffix} diff --git a/phoenix-client-parent/phoenix-client/pom.xml b/phoenix-client-parent/phoenix-client/pom.xml index 330a067..db4ba8c 100644 --- a/phoenix-client-parent/phoenix-client/pom.xml +++ b/phoenix-client-parent/phoenix-client/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix-client-parent -5.1.0-SNAPSHOT +5.2.0-SNAPSHOT phoenix-client-${hbase.suffix} diff --git a/phoenix-client-parent/pom.xml b/phoenix-client-parent/pom.xml index ae4ef1c..308c3b4 100644 --- a/phoenix-client-parent/pom.xml +++ b/phoenix-client-parent/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix -5.1.0-SNAPSHOT +5.2.0-SNAPSHOT phoenix-client-parent Phoenix Client Parent diff --git a/phoenix-core/pom.xml b/phoenix-core/pom.xml index a47bef1..a21bdca 100644 --- a/phoenix-core/pom.xml +++ b/phoenix-core/pom.xml @@ -21,7 +21,7 @@ org.apache.phoenix phoenix -5.1.0-SNAPSHOT +5.2.0-SNAPSHOT phoenix-core Phoenix Core diff --git a/phoenix-hbase-compat-2.1.6/pom.xml b/phoenix-hbase-compat-2.1.6/pom.xml index 6e64195..a3da830 100644 --- a/phoenix-hbase-compat-2.1.6/pom.xml +++ b/phoenix-hbase-compat-2.1.6/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.1.0-SNAPSHOT +5.2.0-SNAPSHOT phoenix-hbase-compat-2.1.6 diff --git a/phoenix-hbase-compat-2.2.5/pom.xml b/phoenix-hbase-compat-2.2.5/pom.xml index 7d07b14..6bd35da 100644 --- a/phoenix-hbase-compat-2.2.5/pom.xml +++ b/phoenix-hbase-compat-2.2.5/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.1.0-SNAPSHOT +5.2.0-SNAPSHOT phoenix-hbase-compat-2.2.5 diff --git a/phoenix-hbase-compat-2.3.0/pom.xml b/phoenix-hbase-compat-2.3.0/pom.xml index 48c04a9..cca6199 100644 --- a/phoenix-hbase-compat-2.3.0/pom.xml +++ b/phoenix-hbase-compat-2.3.0/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.1.0-SNAPSHOT +5.2.0-SNAPSHOT phoenix-hbase-compat-2.3.0 diff --git a/phoenix-hbase-compat-2.4.0/pom.xml b/phoenix-hbase-compat-2.4.0/pom.xml index 18085b4..fded6c7 100644 --- a/phoenix-hbase-compat-2.4.0/pom.xml +++ b/phoenix-hbase-compat-2.4.0/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.1.0-SNAPSHOT +5.2.0-SNAPSHOT phoenix-hbase-compat-2.4.0 diff --git a/phoenix-pherf/pom.xml b/phoenix-pherf/pom.xml index 86f6366..eca063c 100644 --- a/phoenix-pherf/pom.xml +++ b/phoenix-pherf/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix -5.1.0-SNAPSHOT +5.2.0-SNAPSHOT phoenix-pherf diff --git a/phoenix-server/pom.xml b/phoenix-server/pom.xml index 63d53e0..e86ee87 100644 --- a/phoenix-server/pom.xml +++ b/phoenix-server/pom.xml @@ -24,7 +24,7 @@ org.apache.phoenix phoenix -5.1.0-SNAPSHOT +5.2.0-SNAPSHOT phoenix-server
svn commit: r1886380 - in /phoenix/site: publish/download.html publish/js/download.js publish/language/datatypes.html publish/language/functions.html publish/language/index.html source/src/site/markdo
Author: stoty Date: Wed Feb 10 09:12:16 2021 New Revision: 1886380 URL: http://svn.apache.org/viewvc?rev=1886380&view=rev Log: Add 5.1 release to downloads Modified: phoenix/site/publish/download.html phoenix/site/publish/js/download.js phoenix/site/publish/language/datatypes.html phoenix/site/publish/language/functions.html phoenix/site/publish/language/index.html phoenix/site/source/src/site/markdown/download.md phoenix/site/source/src/site/resources/js/download.js Modified: phoenix/site/publish/download.html URL: http://svn.apache.org/viewvc/phoenix/site/publish/download.html?rev=1886380&r1=1886379&r2=1886380&view=diff == --- phoenix/site/publish/download.html (original) +++ phoenix/site/publish/download.html Wed Feb 10 09:12:16 2021 @@ -1,7 +1,7 @@ @@ -169,7 +169,8 @@ Phoenix Downloads The below table lists mirrored release artifacts and their associated hashes and signatures available ONLY at apache.org. The keys used to sign releases can be found in our published https://www.apache.org/dist/phoenix/KEYS";>KEYS file. See our installation instructions here, our release notes here, and a list of fixes and new features https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12334393&projectId=12315120";>here. Follow https://www.apache.org/dyn/closer.cgi#verify";>Verify the Integrity of the Files for how to verify your mirrored downloads. -Current release 4.15.0 can run on Apache HBase 1.3, 1.4 and 1.5. CDH HBase 5.11, 5.12, 5.13 and 5.14 is supported by 4.14.0. Apache HBase 2.0 is supported by 5.0.0. Please follow the appropriate link depending on your HBase version. +Current release 4.15.0 can run on Apache HBase 1.3, 1.4 and 1.5.CDH HBase 5.11, 5.12, 5.13 and 5.14 is supported by 4.14.0.Apache HBase 2.0 is supported by 5.0.0.Apache HBase 2.1, 2.2, 2.3, 2.4 is supported by 5.1.0. +Please follow the appropriate link depending on your HBase version. @@ -229,6 +230,7 @@ //<![CDATA[ +addRelease2('5.1.0','10/feb/2021','2.1','2.2','2.3','2.4' ); addRelease('5.0.0-HBase-2.0','04/jul/2018'); addRelease('4.15.0-HBase-1.5','20/dec/2019'); addRelease('4.15.0-HBase-1.4','20/dec/2019'); Modified: phoenix/site/publish/js/download.js URL: <a rel="nofollow" href="http://svn.apache.org/viewvc/phoenix/site/publish/js/download.js?rev=1886380&r1=1886379&r2=1886380&view=diff">http://svn.apache.org/viewvc/phoenix/site/publish/js/download.js?rev=1886380&r1=1886379&r2=1886380&view=diff</a> == --- phoenix/site/publish/js/download.js (original) +++ phoenix/site/publish/js/download.js Wed Feb 10 09:12:16 2021 @@ -29,6 +29,36 @@ function addRelease(version, date) { document.getElementById('core-releases').appendChild(tr); } +function addRelease2(version, date) { +var tr = document.createElement('tr'); +var parcelsHtml = version.includes('-cdh') ? parcelFolderHtml(version) : '' +var phoenixBinariesHtml = ''; +for (var i=2; i < arguments.length; i++) { +phoenixBinariesHtml += phoenixBinaryHtml(version, arguments[i]); +} +tr.innerHTML = +'<td>' + version + '</td>' + +'<td>' + date + '</td>' + +'<td><ul><li>' + + '<a href="' + dynUrl + 'phoenix-' + version + '/phoenix-' + version + '-src.tar.gz">src</a> ' + + ' ' + + '[ <a href="' + apacheUrlHttps + 'phoenix-' + version + '/phoenix-' + version + '-src.tar.gz.sha512">sha512</a>' + + ' | <a href="' + apacheUrlHttps + 'phoenix-' + version + '/phoenix-' + version + '-src.tar.gz.asc">asc</a> ]' + +'</li>' + phoenixBinariesHtml + +'</ul></td>'; +document.getElementById('core-releases').appendChild(tr); +} + +function phoenixBinaryHtml(version, hbaseVersion) { + return '<li>' + + '<a href="' + dynUrl + 'phoenix-' + version + '/phoenix-hbase-'+hbaseVersion + '-' + version + '-bin.tar.gz">hbase-'+hbaseVersion+'-bin</a> ' + + ' ' + + '[ <a href="' + apacheUrlHttps + '/phoenix-hbase-'+hbaseVersion + '-' + version + &
[phoenix] branch master updated: PHOENIX-6377 phoenix-client has erronous maven dependecies
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new b684dc3 PHOENIX-6377 phoenix-client has erronous maven dependecies b684dc3 is described below commit b684dc30fa6388aa45b1419e179b3ac02223a169 Author: Istvan Toth AuthorDate: Wed Feb 10 20:46:20 2021 +0100 PHOENIX-6377 phoenix-client has erronous maven dependecies --- .../phoenix-client-embedded/pom.xml| 18 + phoenix-client-parent/phoenix-client/pom.xml | 28 ++ phoenix-client-parent/pom.xml | 492 ++--- 3 files changed, 279 insertions(+), 259 deletions(-) diff --git a/phoenix-client-parent/phoenix-client-embedded/pom.xml b/phoenix-client-parent/phoenix-client-embedded/pom.xml index 215f4e3..a2c6169 100644 --- a/phoenix-client-parent/phoenix-client-embedded/pom.xml +++ b/phoenix-client-parent/phoenix-client-embedded/pom.xml @@ -64,4 +64,22 @@ + + + + + org.apache.phoenix + phoenix-core + + + org.apache.phoenix + phoenix-hbase-compat-${hbase.compat.version} + false + + + sqlline + sqlline + runtime + + diff --git a/phoenix-client-parent/phoenix-client/pom.xml b/phoenix-client-parent/phoenix-client/pom.xml index db4ba8c..6c06731 100644 --- a/phoenix-client-parent/phoenix-client/pom.xml +++ b/phoenix-client-parent/phoenix-client/pom.xml @@ -63,4 +63,32 @@ + + + + + org.apache.phoenix + phoenix-core + + + org.apache.phoenix + phoenix-hbase-compat-${hbase.compat.version} + false + + + org.slf4j + slf4j-log4j12 + runtime + + + log4j + log4j + runtime + + + sqlline + sqlline + runtime + + diff --git a/phoenix-client-parent/pom.xml b/phoenix-client-parent/pom.xml index 308c3b4..5d5a3e1 100644 --- a/phoenix-client-parent/pom.xml +++ b/phoenix-client-parent/pom.xml @@ -40,264 +40,238 @@ - - -org.apache.maven.plugins -maven-site-plugin - - true - - - - -org.apache.rat -apache-rat-plugin - - true - - - -org.apache.maven.plugins -maven-jar-plugin - - -org.apache.maven.plugins -maven-dependency-plugin - - -* - - - - -org.apache.maven.plugins -maven-shade-plugin - - - - *:* - -META-INF/*.SF -META-INF/*.DSA -META-INF/*.RSA -META-INF/license/* -META-INF/NOTICE -LICENSE.* -NOTICE.* -NOTICE -README* - - - - org.apache.hadoop:hadoop-yarn-common - - org/apache/hadoop/yarn/factories/package-info.class - org/apache/hadoop/yarn/util/package-info.class - org/apache/hadoop/yarn/factory/providers/package-info.class - org/apache/hadoop/yarn/client/api/impl/package-info.class - org/apache/hadoop/yarn/client/api/package-info.class -webapps/** - - - - - org.apache.commons:commons-math3 - -assets/** - - - - org.apache.hbase:hbase-server - -hbase-webapps/** - - - - - - - - csv-bulk-load-config.properties - -${project.basedir}/../config/csv-bulk-load-config.properties - - - - README.md - ${project.basedir}/../README.md - - - LICENSE.txt - ${project.basedir}/../LICENSE - - - NOTICE - ${project.basedir}/../NOTICE - - - - - org/ - ${shaded.package}.org. - -org/apache/hadoop/** - -org/apache/htrace/** -org/slf4j/** -org/apache/commons/logging/** -org/apache/log4j/** - -org/ietf/jgss/** -org/omg/** -org/w3c/dom/** -org/xml/sax/** - - - -org/apache/hbase/** - -org/apache/phoenix/** -org/apache/omid
[phoenix] branch 4.x updated: PHOENIX-6377 phoenix-client has erronous maven dependecies
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/4.x by this push: new b626e35 PHOENIX-6377 phoenix-client has erronous maven dependecies b626e35 is described below commit b626e35877fb5350bae02b1b34ca7f0d43022bfe Author: Istvan Toth AuthorDate: Wed Feb 10 21:48:10 2021 +0100 PHOENIX-6377 phoenix-client has erronous maven dependecies --- .../phoenix-client-embedded/pom.xml| 18 + phoenix-client-parent/phoenix-client/pom.xml | 23 + phoenix-client-parent/pom.xml | 478 ++--- 3 files changed, 270 insertions(+), 249 deletions(-) diff --git a/phoenix-client-parent/phoenix-client-embedded/pom.xml b/phoenix-client-parent/phoenix-client-embedded/pom.xml index d175704..a99c3ef 100644 --- a/phoenix-client-parent/phoenix-client-embedded/pom.xml +++ b/phoenix-client-parent/phoenix-client-embedded/pom.xml @@ -65,4 +65,22 @@ + + + + + org.apache.phoenix + phoenix-core + + + org.apache.phoenix + phoenix-hbase-compat-${hbase.compat.version} + false + + + sqlline + sqlline + + + diff --git a/phoenix-client-parent/phoenix-client/pom.xml b/phoenix-client-parent/phoenix-client/pom.xml index a5ed9bb..08b9128 100644 --- a/phoenix-client-parent/phoenix-client/pom.xml +++ b/phoenix-client-parent/phoenix-client/pom.xml @@ -64,4 +64,27 @@ + + + + + org.apache.phoenix + phoenix-core + + + org.apache.phoenix + phoenix-hbase-compat-${hbase.compat.version} + false + + + sqlline + sqlline + + + org.slf4j + slf4j-log4j12 + 1.7.7 + + + diff --git a/phoenix-client-parent/pom.xml b/phoenix-client-parent/pom.xml index 7fe031a..d9ea146 100644 --- a/phoenix-client-parent/pom.xml +++ b/phoenix-client-parent/pom.xml @@ -40,254 +40,234 @@ - - -org.apache.maven.plugins -maven-site-plugin - - true - - - - -org.apache.rat -apache-rat-plugin - - true - - - -org.apache.maven.plugins -maven-jar-plugin - - -org.apache.maven.plugins -maven-shade-plugin - - - - *:* - -META-INF/*.SF -META-INF/*.DSA -META-INF/*.RSA -META-INF/license/* -META-INF/NOTICE -LICENSE.* -NOTICE.* -NOTICE -README* - - - - org.apache.hadoop:hadoop-yarn-common - - org/apache/hadoop/yarn/factories/package-info.class - org/apache/hadoop/yarn/util/package-info.class - org/apache/hadoop/yarn/factory/providers/package-info.class - org/apache/hadoop/yarn/client/api/impl/package-info.class - org/apache/hadoop/yarn/client/api/package-info.class -webapps/** - - - - - org.apache.commons:commons-math3 - -assets/** - - - - org.apache.hbase:hbase-server - -hbase-webapps/** - - - - - - - - csv-bulk-load-config.properties - -${project.basedir}/../config/csv-bulk-load-config.properties - - - - README.md - ${project.basedir}/../README.md - - - LICENSE.txt - ${project.basedir}/../LICENSE - - - NOTICE - ${project.basedir}/../NOTICE - - - - - org/ - ${shaded.package}.org. - -org/apache/hadoop/** - -org/apache/htrace/** -org/slf4j/** -org/apache/commons/logging/** -org/apache/log4j/** - -org/ietf/jgss/** -org/omg/** -org/w3c/dom/** -org/xml/sax/** - - - -org/apache/hbase/** - -org/apache/phoenix/** -org/apache/omid/** - - - - - com/ - ${shaded.package}.com. - - -com/sun/tools/** -com/sun/javadoc
[phoenix] branch 5.1 updated: PHOENIX-6377 phoenix-client has erronous maven dependecies
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new 0162fb8 PHOENIX-6377 phoenix-client has erronous maven dependecies 0162fb8 is described below commit 0162fb8c62d23d9a118fea835392c9c0c72b1a42 Author: Istvan Toth AuthorDate: Wed Feb 10 20:46:20 2021 +0100 PHOENIX-6377 phoenix-client has erronous maven dependecies --- .../phoenix-client-embedded/pom.xml| 18 + phoenix-client-parent/phoenix-client/pom.xml | 28 ++ phoenix-client-parent/pom.xml | 492 ++--- 3 files changed, 279 insertions(+), 259 deletions(-) diff --git a/phoenix-client-parent/phoenix-client-embedded/pom.xml b/phoenix-client-parent/phoenix-client-embedded/pom.xml index e5e6b61..fbc3b44 100644 --- a/phoenix-client-parent/phoenix-client-embedded/pom.xml +++ b/phoenix-client-parent/phoenix-client-embedded/pom.xml @@ -64,4 +64,22 @@ + + + + + org.apache.phoenix + phoenix-core + + + org.apache.phoenix + phoenix-hbase-compat-${hbase.compat.version} + false + + + sqlline + sqlline + runtime + + diff --git a/phoenix-client-parent/phoenix-client/pom.xml b/phoenix-client-parent/phoenix-client/pom.xml index 55a018c..def10d3 100644 --- a/phoenix-client-parent/phoenix-client/pom.xml +++ b/phoenix-client-parent/phoenix-client/pom.xml @@ -63,4 +63,32 @@ + + + + + org.apache.phoenix + phoenix-core + + + org.apache.phoenix + phoenix-hbase-compat-${hbase.compat.version} + false + + + org.slf4j + slf4j-log4j12 + runtime + + + log4j + log4j + runtime + + + sqlline + sqlline + runtime + + diff --git a/phoenix-client-parent/pom.xml b/phoenix-client-parent/pom.xml index 0071dc6..3f0415c 100644 --- a/phoenix-client-parent/pom.xml +++ b/phoenix-client-parent/pom.xml @@ -40,264 +40,238 @@ - - -org.apache.maven.plugins -maven-site-plugin - - true - - - - -org.apache.rat -apache-rat-plugin - - true - - - -org.apache.maven.plugins -maven-jar-plugin - - -org.apache.maven.plugins -maven-dependency-plugin - - -* - - - - -org.apache.maven.plugins -maven-shade-plugin - - - - *:* - -META-INF/*.SF -META-INF/*.DSA -META-INF/*.RSA -META-INF/license/* -META-INF/NOTICE -LICENSE.* -NOTICE.* -NOTICE -README* - - - - org.apache.hadoop:hadoop-yarn-common - - org/apache/hadoop/yarn/factories/package-info.class - org/apache/hadoop/yarn/util/package-info.class - org/apache/hadoop/yarn/factory/providers/package-info.class - org/apache/hadoop/yarn/client/api/impl/package-info.class - org/apache/hadoop/yarn/client/api/package-info.class -webapps/** - - - - - org.apache.commons:commons-math3 - -assets/** - - - - org.apache.hbase:hbase-server - -hbase-webapps/** - - - - - - - - csv-bulk-load-config.properties - -${project.basedir}/../config/csv-bulk-load-config.properties - - - - README.md - ${project.basedir}/../README.md - - - LICENSE.txt - ${project.basedir}/../LICENSE - - - NOTICE - ${project.basedir}/../NOTICE - - - - - org/ - ${shaded.package}.org. - -org/apache/hadoop/** - -org/apache/htrace/** -org/slf4j/** -org/apache/commons/logging/** -org/apache/log4j/** - -org/ietf/jgss/** -org/omg/** -org/w3c/dom/** -org/xml/sax/** - - - -org/apache/hbase/** - -org/apache/phoenix/** -org/apache/omid
[phoenix] branch 5.1 updated: update version to 5.1.1-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new ec82cbb update version to 5.1.1-SNAPSHOT ec82cbb is described below commit ec82cbbdf4d66577aafe8409878ae88fe9290ac7 Author: Istvan Toth AuthorDate: Fri Feb 12 17:07:02 2021 +0100 update version to 5.1.1-SNAPSHOT --- phoenix-assembly/pom.xml | 2 +- phoenix-client-parent/phoenix-client-embedded/pom.xml | 2 +- phoenix-client-parent/phoenix-client/pom.xml | 2 +- phoenix-client-parent/pom.xml | 2 +- phoenix-core/pom.xml | 2 +- phoenix-hbase-compat-2.1.6/pom.xml| 2 +- phoenix-hbase-compat-2.2.5/pom.xml| 2 +- phoenix-hbase-compat-2.3.0/pom.xml| 2 +- phoenix-hbase-compat-2.4.0/pom.xml| 2 +- phoenix-pherf/pom.xml | 2 +- phoenix-server/pom.xml| 2 +- phoenix-tools/pom.xml | 2 +- phoenix-tracing-webapp/pom.xml| 2 +- pom.xml | 2 +- 14 files changed, 14 insertions(+), 14 deletions(-) diff --git a/phoenix-assembly/pom.xml b/phoenix-assembly/pom.xml index 64b8130..3ee0283 100644 --- a/phoenix-assembly/pom.xml +++ b/phoenix-assembly/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix -5.1.0 +5.1.1-SNAPSHOT phoenix-assembly Phoenix Assembly diff --git a/phoenix-client-parent/phoenix-client-embedded/pom.xml b/phoenix-client-parent/phoenix-client-embedded/pom.xml index fbc3b44..65e2703 100644 --- a/phoenix-client-parent/phoenix-client-embedded/pom.xml +++ b/phoenix-client-parent/phoenix-client-embedded/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix-client-parent -5.1.0 +5.1.1-SNAPSHOT phoenix-client-embedded-${hbase.suffix} diff --git a/phoenix-client-parent/phoenix-client/pom.xml b/phoenix-client-parent/phoenix-client/pom.xml index def10d3..2752181 100644 --- a/phoenix-client-parent/phoenix-client/pom.xml +++ b/phoenix-client-parent/phoenix-client/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix-client-parent -5.1.0 +5.1.1-SNAPSHOT phoenix-client-${hbase.suffix} diff --git a/phoenix-client-parent/pom.xml b/phoenix-client-parent/pom.xml index 3f0415c..cd92e61 100644 --- a/phoenix-client-parent/pom.xml +++ b/phoenix-client-parent/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix -5.1.0 +5.1.1-SNAPSHOT phoenix-client-parent Phoenix Client Parent diff --git a/phoenix-core/pom.xml b/phoenix-core/pom.xml index 7395219..bced9b6 100644 --- a/phoenix-core/pom.xml +++ b/phoenix-core/pom.xml @@ -21,7 +21,7 @@ org.apache.phoenix phoenix -5.1.0 +5.1.1-SNAPSHOT phoenix-core Phoenix Core diff --git a/phoenix-hbase-compat-2.1.6/pom.xml b/phoenix-hbase-compat-2.1.6/pom.xml index abf12f0..7ec0d92 100644 --- a/phoenix-hbase-compat-2.1.6/pom.xml +++ b/phoenix-hbase-compat-2.1.6/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.1.0 +5.1.1-SNAPSHOT phoenix-hbase-compat-2.1.6 diff --git a/phoenix-hbase-compat-2.2.5/pom.xml b/phoenix-hbase-compat-2.2.5/pom.xml index f9d9c9d..b7605d7 100644 --- a/phoenix-hbase-compat-2.2.5/pom.xml +++ b/phoenix-hbase-compat-2.2.5/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.1.0 +5.1.1-SNAPSHOT phoenix-hbase-compat-2.2.5 diff --git a/phoenix-hbase-compat-2.3.0/pom.xml b/phoenix-hbase-compat-2.3.0/pom.xml index 1d00847..3a069b4 100644 --- a/phoenix-hbase-compat-2.3.0/pom.xml +++ b/phoenix-hbase-compat-2.3.0/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.1.0 +5.1.1-SNAPSHOT phoenix-hbase-compat-2.3.0 diff --git a/phoenix-hbase-compat-2.4.0/pom.xml b/phoenix-hbase-compat-2.4.0/pom.xml index 7016973..95e4178 100644 --- a/phoenix-hbase-compat-2.4.0/pom.xml +++ b/phoenix-hbase-compat-2.4.0/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.1.0 +5.1.1-SNAPSHOT phoenix-hbase-compat-2.4.0 diff --git a/phoenix-pherf/pom.xml b/phoenix-pherf/pom.xml index a1454e3..feebafc 100644 --- a/phoenix-pherf/pom.xml +++ b/phoenix-pherf/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix -5.1.0 +5.1.1-SNAPSHOT phoenix-pherf diff --git a/phoenix-server/pom.xml b/phoenix-server/pom.xml index 9c15eca..6514c2b 100644 --- a/phoenix-server/pom.xml +++ b/phoenix-server/pom.xml @@ -24,7 +24,7 @@ org.apache.phoenix phoenix -5.1.0 +5.1.1-SNAPSHOT phoenix-server-${hbase.suffix} Phoenix Server JAR for HBase ${hbase.profile} diff --git a/phoenix-tools/pom.xml b
[phoenix] branch master updated: PHOENIX-6382 Shaded artifact names and descriptions have undersolved ${hbase.profile} strings
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new 56ece66 PHOENIX-6382 Shaded artifact names and descriptions have undersolved ${hbase.profile} strings 56ece66 is described below commit 56ece664bae5f9a4d877bca866504bcdbc19d682 Author: Istvan Toth AuthorDate: Fri Feb 12 09:38:36 2021 +0100 PHOENIX-6382 Shaded artifact names and descriptions have undersolved ${hbase.profile} strings --- phoenix-client-parent/phoenix-client-embedded/pom.xml | 4 ++-- phoenix-client-parent/phoenix-client/pom.xml | 4 ++-- phoenix-server/pom.xml| 4 ++-- 3 files changed, 6 insertions(+), 6 deletions(-) diff --git a/phoenix-client-parent/phoenix-client-embedded/pom.xml b/phoenix-client-parent/phoenix-client-embedded/pom.xml index a2c6169..6c27974 100644 --- a/phoenix-client-parent/phoenix-client-embedded/pom.xml +++ b/phoenix-client-parent/phoenix-client-embedded/pom.xml @@ -26,8 +26,8 @@ phoenix-client-embedded-${hbase.suffix} - Phoenix Client Embedded for HBase ${hbase.profile} - Phoenix Client without logging implementation for for HBase ${hbase.profile} + Phoenix Client Embedded + Phoenix Client without logging implementation jar diff --git a/phoenix-client-parent/phoenix-client/pom.xml b/phoenix-client-parent/phoenix-client/pom.xml index 6c06731..d70c1e7 100644 --- a/phoenix-client-parent/phoenix-client/pom.xml +++ b/phoenix-client-parent/phoenix-client/pom.xml @@ -26,8 +26,8 @@ phoenix-client-${hbase.suffix} - Phoenix Client for HBase ${hbase.profile} - Phoenix Client for HBase ${hbase.profile} + Phoenix Client + Phoenix Client jar diff --git a/phoenix-server/pom.xml b/phoenix-server/pom.xml index e86ee87..bfdd701 100644 --- a/phoenix-server/pom.xml +++ b/phoenix-server/pom.xml @@ -27,8 +27,8 @@ 5.2.0-SNAPSHOT phoenix-server-${hbase.suffix} - Phoenix Server JAR for HBase ${hbase.profile} - Phoenix HBase Server Side JAR for HBase ${hbase.profile} + Phoenix Server JAR + Phoenix HBase Server Side JAR jar
[phoenix] branch 4.x updated: PHOENIX-6382 Shaded artifact names and descriptions have undersolved ${hbase.profile} strings
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/4.x by this push: new e319550 PHOENIX-6382 Shaded artifact names and descriptions have undersolved ${hbase.profile} strings e319550 is described below commit e319550830b73245e45e784e518aca7629d3e327 Author: Istvan Toth AuthorDate: Fri Feb 12 17:27:21 2021 +0100 PHOENIX-6382 Shaded artifact names and descriptions have undersolved ${hbase.profile} strings --- phoenix-client-parent/phoenix-client-embedded/pom.xml | 4 ++-- phoenix-client-parent/phoenix-client/pom.xml | 4 ++-- phoenix-server/pom.xml| 4 ++-- 3 files changed, 6 insertions(+), 6 deletions(-) diff --git a/phoenix-client-parent/phoenix-client-embedded/pom.xml b/phoenix-client-parent/phoenix-client-embedded/pom.xml index a99c3ef..bfcc0ec 100644 --- a/phoenix-client-parent/phoenix-client-embedded/pom.xml +++ b/phoenix-client-parent/phoenix-client-embedded/pom.xml @@ -26,8 +26,8 @@ phoenix-client-embedded-${hbase.suffix} - Phoenix Client Embedded for HBase ${hbase.profile} - Phoenix Client without logging implementation for for HBase ${hbase.profile} + Phoenix Client Embedded + Phoenix Client without logging implementation jar diff --git a/phoenix-client-parent/phoenix-client/pom.xml b/phoenix-client-parent/phoenix-client/pom.xml index 08b9128..71af6ed 100644 --- a/phoenix-client-parent/phoenix-client/pom.xml +++ b/phoenix-client-parent/phoenix-client/pom.xml @@ -26,8 +26,8 @@ phoenix-client-${hbase.suffix} - Phoenix Client for HBase ${hbase.profile} - Phoenix Client for HBase ${hbase.profile} + Phoenix Client + Phoenix Client jar diff --git a/phoenix-server/pom.xml b/phoenix-server/pom.xml index 7296fef..275004e 100644 --- a/phoenix-server/pom.xml +++ b/phoenix-server/pom.xml @@ -28,8 +28,8 @@ phoenix-server-${hbase.suffix} - Phoenix Server JAR for HBase ${hbase.profile} - Phoenix HBase Server Side JAR for HBase ${hbase.profile} + Phoenix Server JAR + Phoenix HBase Server Side JAR jar
[phoenix] branch 5.1 updated: PHOENIX-6382 Shaded artifact names and descriptions have undersolved ${hbase.profile} strings
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new d0d2378 PHOENIX-6382 Shaded artifact names and descriptions have undersolved ${hbase.profile} strings d0d2378 is described below commit d0d23782246253fe5e4615ed51adf92321802ed3 Author: Istvan Toth AuthorDate: Fri Feb 12 09:38:36 2021 +0100 PHOENIX-6382 Shaded artifact names and descriptions have undersolved ${hbase.profile} strings --- phoenix-client-parent/phoenix-client-embedded/pom.xml | 4 ++-- phoenix-client-parent/phoenix-client/pom.xml | 4 ++-- phoenix-server/pom.xml| 4 ++-- 3 files changed, 6 insertions(+), 6 deletions(-) diff --git a/phoenix-client-parent/phoenix-client-embedded/pom.xml b/phoenix-client-parent/phoenix-client-embedded/pom.xml index 65e2703..5f82a4c 100644 --- a/phoenix-client-parent/phoenix-client-embedded/pom.xml +++ b/phoenix-client-parent/phoenix-client-embedded/pom.xml @@ -26,8 +26,8 @@ phoenix-client-embedded-${hbase.suffix} - Phoenix Client Embedded for HBase ${hbase.profile} - Phoenix Client without logging implementation for for HBase ${hbase.profile} + Phoenix Client Embedded + Phoenix Client without logging implementation jar diff --git a/phoenix-client-parent/phoenix-client/pom.xml b/phoenix-client-parent/phoenix-client/pom.xml index 2752181..d0f63ba 100644 --- a/phoenix-client-parent/phoenix-client/pom.xml +++ b/phoenix-client-parent/phoenix-client/pom.xml @@ -26,8 +26,8 @@ phoenix-client-${hbase.suffix} - Phoenix Client for HBase ${hbase.profile} - Phoenix Client for HBase ${hbase.profile} + Phoenix Client + Phoenix Client jar diff --git a/phoenix-server/pom.xml b/phoenix-server/pom.xml index 6514c2b..a1a07a6 100644 --- a/phoenix-server/pom.xml +++ b/phoenix-server/pom.xml @@ -27,8 +27,8 @@ 5.1.1-SNAPSHOT phoenix-server-${hbase.suffix} - Phoenix Server JAR for HBase ${hbase.profile} - Phoenix HBase Server Side JAR for HBase ${hbase.profile} + Phoenix Server JAR + Phoenix HBase Server Side JAR jar
[phoenix] branch master updated: PHOENIX-6380 phoenix-client-embedded depends on logging classes
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new f0bc827 PHOENIX-6380 phoenix-client-embedded depends on logging classes f0bc827 is described below commit f0bc827a0e4daa2520f749fe7e90757de9dec0a0 Author: Istvan Toth AuthorDate: Fri Feb 12 08:54:37 2021 +0100 PHOENIX-6380 phoenix-client-embedded depends on logging classes --- phoenix-client-parent/phoenix-client-embedded/pom.xml | 7 ++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/phoenix-client-parent/phoenix-client-embedded/pom.xml b/phoenix-client-parent/phoenix-client-embedded/pom.xml index 6c27974..e832704 100644 --- a/phoenix-client-parent/phoenix-client-embedded/pom.xml +++ b/phoenix-client-parent/phoenix-client-embedded/pom.xml @@ -54,7 +54,6 @@ org.apache.phoenix:phoenix-client xom:xom - org.slf4j:slf4j-log4j12 @@ -70,6 +69,12 @@ org.apache.phoenix phoenix-core + + + org.slf4j + slf4j-log4j12 + + org.apache.phoenix
[phoenix] branch 4.x updated: PHOENIX-6380 phoenix-client-embedded depends on logging classes
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/4.x by this push: new 3b6fc05 PHOENIX-6380 phoenix-client-embedded depends on logging classes 3b6fc05 is described below commit 3b6fc055a4c8112fc3b46c3bb0d02cbf513a555d Author: Istvan Toth AuthorDate: Fri Feb 12 08:54:37 2021 +0100 PHOENIX-6380 phoenix-client-embedded depends on logging classes --- phoenix-client-parent/phoenix-client-embedded/pom.xml | 7 ++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/phoenix-client-parent/phoenix-client-embedded/pom.xml b/phoenix-client-parent/phoenix-client-embedded/pom.xml index bfcc0ec..b4dab10 100644 --- a/phoenix-client-parent/phoenix-client-embedded/pom.xml +++ b/phoenix-client-parent/phoenix-client-embedded/pom.xml @@ -55,7 +55,6 @@ org.apache.phoenix:phoenix-client xom:xom - org.slf4j:slf4j-log4j12 @@ -71,6 +70,12 @@ org.apache.phoenix phoenix-core + + + org.slf4j + slf4j-log4j12 + + org.apache.phoenix
[phoenix] branch 5.1 updated: PHOENIX-6380 phoenix-client-embedded depends on logging classes
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new 9dd545c PHOENIX-6380 phoenix-client-embedded depends on logging classes 9dd545c is described below commit 9dd545c9d224ac2c8e615fa91eb7862bdac10188 Author: Istvan Toth AuthorDate: Fri Feb 12 08:54:37 2021 +0100 PHOENIX-6380 phoenix-client-embedded depends on logging classes --- phoenix-client-parent/phoenix-client-embedded/pom.xml | 7 ++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/phoenix-client-parent/phoenix-client-embedded/pom.xml b/phoenix-client-parent/phoenix-client-embedded/pom.xml index 5f82a4c..5fa4dc7 100644 --- a/phoenix-client-parent/phoenix-client-embedded/pom.xml +++ b/phoenix-client-parent/phoenix-client-embedded/pom.xml @@ -54,7 +54,6 @@ org.apache.phoenix:phoenix-client xom:xom - org.slf4j:slf4j-log4j12 @@ -70,6 +69,12 @@ org.apache.phoenix phoenix-core + + + org.slf4j + slf4j-log4j12 + + org.apache.phoenix
[phoenix] branch master updated: PHOENIX-6386 Bulkload generates unverified index rows
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new 5743e16 PHOENIX-6386 Bulkload generates unverified index rows 5743e16 is described below commit 5743e16d5c1556498a7d86cbbb037de6847fdb5b Author: Istvan Toth AuthorDate: Thu Feb 18 11:36:31 2021 +0100 PHOENIX-6386 Bulkload generates unverified index rows --- .../apache/phoenix/end2end/CsvBulkLoadToolIT.java | 41 ++- .../mapreduce/FormatToBytesWritableMapper.java | 61 +++--- .../ImportPreUpsertKeyValueProcessor.java | 4 +- 3 files changed, 95 insertions(+), 11 deletions(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java index 81c2255..5e0200b 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java @@ -21,31 +21,43 @@ import static org.apache.phoenix.query.QueryServices.DATE_FORMAT_ATTRIB; import static org.junit.Assert.assertArrayEquals; import static org.junit.Assert.assertEquals; import static org.junit.Assert.assertFalse; +import static org.junit.Assert.assertNull; import static org.junit.Assert.assertTrue; import static org.junit.Assert.fail; +import java.io.IOException; import java.io.PrintWriter; import java.sql.Connection; import java.sql.DriverManager; import java.sql.ResultSet; +import java.sql.SQLException; import java.sql.Statement; import java.util.Map; -import org.apache.phoenix.thirdparty.com.google.common.collect.Maps; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.FSDataOutputStream; import org.apache.hadoop.fs.FileSystem; import org.apache.hadoop.fs.Path; -import org.apache.hadoop.hbase.HConstants; +import org.apache.hadoop.hbase.CompareOperator; +import org.apache.hadoop.hbase.client.ResultScanner; +import org.apache.hadoop.hbase.client.Scan; +import org.apache.hadoop.hbase.client.Table; +import org.apache.hadoop.hbase.filter.SingleColumnValueFilter; +import org.apache.hadoop.hbase.util.Bytes; import org.apache.hadoop.mapred.FileAlreadyExistsException; +import org.apache.phoenix.hbase.index.IndexRegionObserver; import org.apache.phoenix.jdbc.PhoenixConnection; import org.apache.phoenix.mapreduce.CsvBulkLoadTool; +import org.apache.phoenix.query.ConnectionQueryServices; import org.apache.phoenix.query.QueryServices; import org.apache.phoenix.schema.PTable; import org.apache.phoenix.schema.PTableKey; +import org.apache.phoenix.thirdparty.com.google.common.collect.Maps; import org.apache.phoenix.util.DateUtil; +import org.apache.phoenix.util.EncodedColumnsUtil; import org.apache.phoenix.util.PhoenixRuntime; import org.apache.phoenix.util.ReadOnlyProps; +import org.apache.phoenix.util.SchemaUtil; import org.apache.phoenix.util.TestUtil; import org.junit.BeforeClass; import org.junit.Test; @@ -318,6 +330,27 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { rs.close(); stmt.close(); + +checkIndexTableIsVerified("TABLE3_IDX"); +} + +private void checkIndexTableIsVerified(String indexTableName) throws SQLException, IOException { +ConnectionQueryServices cqs = conn.unwrap(PhoenixConnection.class).getQueryServices(); +Table hTable = cqs.getTable(Bytes.toBytes(indexTableName)); +PTable pTable = PhoenixRuntime.getTable(conn, indexTableName); + +byte[] emptyKeyValueCF = SchemaUtil.getEmptyColumnFamily(pTable); +byte[] emptyKeyValueQualifier = EncodedColumnsUtil.getEmptyKeyValueInfo(pTable).getFirst(); + +Scan scan = new Scan(); +scan.setFilter(new SingleColumnValueFilter( +emptyKeyValueCF, +emptyKeyValueQualifier, +CompareOperator.NOT_EQUAL, +new org.apache.hadoop.hbase.filter.BinaryComparator(IndexRegionObserver.VERIFIED_BYTES))); +try (ResultScanner scanner = hTable.getScanner(scan)) { +assertNull("There are non VERIFIED rows in index", scanner.next()); +} } @Test @@ -405,6 +438,10 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { rs.close(); stmt.close(); + +if (!localIndex) { +checkIndexTableIsVerified(indexTableName); +} } @Test diff --git a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/FormatToBytesWritableMapper.java b/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/FormatToBytesWritableMapper.java index 40d0fb2..31ab60b 100644 --- a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/FormatToBytesWritableMapper.java +++ b/phoenix-core/src/main/java/org/apac
[phoenix] branch 5.1 updated: PHOENIX-6386 Bulkload generates unverified index rows
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new d85ac5d PHOENIX-6386 Bulkload generates unverified index rows d85ac5d is described below commit d85ac5d9a71ce67720125ce49b59e68922125989 Author: Istvan Toth AuthorDate: Thu Feb 18 11:36:31 2021 +0100 PHOENIX-6386 Bulkload generates unverified index rows --- .../apache/phoenix/end2end/CsvBulkLoadToolIT.java | 41 ++- .../mapreduce/FormatToBytesWritableMapper.java | 61 +++--- .../ImportPreUpsertKeyValueProcessor.java | 4 +- 3 files changed, 95 insertions(+), 11 deletions(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java index 81c2255..5e0200b 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java @@ -21,31 +21,43 @@ import static org.apache.phoenix.query.QueryServices.DATE_FORMAT_ATTRIB; import static org.junit.Assert.assertArrayEquals; import static org.junit.Assert.assertEquals; import static org.junit.Assert.assertFalse; +import static org.junit.Assert.assertNull; import static org.junit.Assert.assertTrue; import static org.junit.Assert.fail; +import java.io.IOException; import java.io.PrintWriter; import java.sql.Connection; import java.sql.DriverManager; import java.sql.ResultSet; +import java.sql.SQLException; import java.sql.Statement; import java.util.Map; -import org.apache.phoenix.thirdparty.com.google.common.collect.Maps; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.FSDataOutputStream; import org.apache.hadoop.fs.FileSystem; import org.apache.hadoop.fs.Path; -import org.apache.hadoop.hbase.HConstants; +import org.apache.hadoop.hbase.CompareOperator; +import org.apache.hadoop.hbase.client.ResultScanner; +import org.apache.hadoop.hbase.client.Scan; +import org.apache.hadoop.hbase.client.Table; +import org.apache.hadoop.hbase.filter.SingleColumnValueFilter; +import org.apache.hadoop.hbase.util.Bytes; import org.apache.hadoop.mapred.FileAlreadyExistsException; +import org.apache.phoenix.hbase.index.IndexRegionObserver; import org.apache.phoenix.jdbc.PhoenixConnection; import org.apache.phoenix.mapreduce.CsvBulkLoadTool; +import org.apache.phoenix.query.ConnectionQueryServices; import org.apache.phoenix.query.QueryServices; import org.apache.phoenix.schema.PTable; import org.apache.phoenix.schema.PTableKey; +import org.apache.phoenix.thirdparty.com.google.common.collect.Maps; import org.apache.phoenix.util.DateUtil; +import org.apache.phoenix.util.EncodedColumnsUtil; import org.apache.phoenix.util.PhoenixRuntime; import org.apache.phoenix.util.ReadOnlyProps; +import org.apache.phoenix.util.SchemaUtil; import org.apache.phoenix.util.TestUtil; import org.junit.BeforeClass; import org.junit.Test; @@ -318,6 +330,27 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { rs.close(); stmt.close(); + +checkIndexTableIsVerified("TABLE3_IDX"); +} + +private void checkIndexTableIsVerified(String indexTableName) throws SQLException, IOException { +ConnectionQueryServices cqs = conn.unwrap(PhoenixConnection.class).getQueryServices(); +Table hTable = cqs.getTable(Bytes.toBytes(indexTableName)); +PTable pTable = PhoenixRuntime.getTable(conn, indexTableName); + +byte[] emptyKeyValueCF = SchemaUtil.getEmptyColumnFamily(pTable); +byte[] emptyKeyValueQualifier = EncodedColumnsUtil.getEmptyKeyValueInfo(pTable).getFirst(); + +Scan scan = new Scan(); +scan.setFilter(new SingleColumnValueFilter( +emptyKeyValueCF, +emptyKeyValueQualifier, +CompareOperator.NOT_EQUAL, +new org.apache.hadoop.hbase.filter.BinaryComparator(IndexRegionObserver.VERIFIED_BYTES))); +try (ResultScanner scanner = hTable.getScanner(scan)) { +assertNull("There are non VERIFIED rows in index", scanner.next()); +} } @Test @@ -405,6 +438,10 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { rs.close(); stmt.close(); + +if (!localIndex) { +checkIndexTableIsVerified(indexTableName); +} } @Test diff --git a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/FormatToBytesWritableMapper.java b/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/FormatToBytesWritableMapper.java index 40d0fb2..31ab60b 100644 --- a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/FormatToBytesWritableMapper.java +++ b/phoenix-core/src/main/java/org/apac
[phoenix] branch 4.x updated: PHOENIX-6386 Bulkload generates unverified index rows
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/4.x by this push: new 358ace8 PHOENIX-6386 Bulkload generates unverified index rows 358ace8 is described below commit 358ace857a378ce84f3552f7a64fff58c74be662 Author: Istvan Toth AuthorDate: Thu Feb 18 11:36:31 2021 +0100 PHOENIX-6386 Bulkload generates unverified index rows --- .../apache/phoenix/end2end/CsvBulkLoadToolIT.java | 39 +- .../mapreduce/FormatToBytesWritableMapper.java | 61 +++--- .../ImportPreUpsertKeyValueProcessor.java | 4 +- 3 files changed, 94 insertions(+), 10 deletions(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java index 2de2c82..762d613 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java @@ -21,13 +21,16 @@ import static org.apache.phoenix.query.QueryServices.DATE_FORMAT_ATTRIB; import static org.junit.Assert.assertArrayEquals; import static org.junit.Assert.assertEquals; import static org.junit.Assert.assertFalse; +import static org.junit.Assert.assertNull; import static org.junit.Assert.assertTrue; import static org.junit.Assert.fail; +import java.io.IOException; import java.io.PrintWriter; import java.sql.Connection; import java.sql.DriverManager; import java.sql.ResultSet; +import java.sql.SQLException; import java.sql.Statement; import java.util.Map; @@ -36,16 +39,25 @@ import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.FSDataOutputStream; import org.apache.hadoop.fs.FileSystem; import org.apache.hadoop.fs.Path; -import org.apache.hadoop.hbase.HConstants; +import org.apache.hadoop.hbase.client.ResultScanner; +import org.apache.hadoop.hbase.client.Scan; +import org.apache.hadoop.hbase.client.Table; +import org.apache.hadoop.hbase.filter.CompareFilter.CompareOp; +import org.apache.hadoop.hbase.filter.SingleColumnValueFilter; +import org.apache.hadoop.hbase.util.Bytes; import org.apache.hadoop.mapred.FileAlreadyExistsException; +import org.apache.phoenix.hbase.index.IndexRegionObserver; import org.apache.phoenix.jdbc.PhoenixConnection; import org.apache.phoenix.mapreduce.CsvBulkLoadTool; +import org.apache.phoenix.query.ConnectionQueryServices; import org.apache.phoenix.query.QueryServices; import org.apache.phoenix.schema.PTable; import org.apache.phoenix.schema.PTableKey; import org.apache.phoenix.util.DateUtil; +import org.apache.phoenix.util.EncodedColumnsUtil; import org.apache.phoenix.util.PhoenixRuntime; import org.apache.phoenix.util.ReadOnlyProps; +import org.apache.phoenix.util.SchemaUtil; import org.apache.phoenix.util.TestUtil; import org.junit.BeforeClass; import org.junit.Test; @@ -318,6 +330,27 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { rs.close(); stmt.close(); + +checkIndexTableIsVerified("TABLE3_IDX"); +} + +private void checkIndexTableIsVerified(String indexTableName) throws SQLException, IOException { +ConnectionQueryServices cqs = conn.unwrap(PhoenixConnection.class).getQueryServices(); +Table hTable = cqs.getTable(Bytes.toBytes(indexTableName)); +PTable pTable = PhoenixRuntime.getTable(conn, indexTableName); + +byte[] emptyKeyValueCF = SchemaUtil.getEmptyColumnFamily(pTable); +byte[] emptyKeyValueQualifier = EncodedColumnsUtil.getEmptyKeyValueInfo(pTable).getFirst(); + +Scan scan = new Scan(); +scan.setFilter(new SingleColumnValueFilter( +emptyKeyValueCF, +emptyKeyValueQualifier, +CompareOp.NOT_EQUAL, +IndexRegionObserver.VERIFIED_BYTES)); +try (ResultScanner scanner = hTable.getScanner(scan)) { +assertNull("There are non VERIFIED rows in index", scanner.next()); +} } @Test @@ -405,6 +438,10 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { rs.close(); stmt.close(); + +if (!localIndex) { +checkIndexTableIsVerified(indexTableName); +} } @Test diff --git a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/FormatToBytesWritableMapper.java b/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/FormatToBytesWritableMapper.java index 63840e7..ecd6110 100644 --- a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/FormatToBytesWritableMapper.java +++ b/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/FormatToBytesWritableMapper.java @@ -34,6 +34,7 @@ import javax.annotation.Nullable; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop
[phoenix] branch master updated: PHOENIX-6394 PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new 446f84b PHOENIX-6394 PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 446f84b is described below commit 446f84b98604020251554969e8ec9d73459e3322 Author: Istvan Toth AuthorDate: Mon Feb 22 09:31:32 2021 +0100 PHOENIX-6394 PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 --- Jenkinsfile| 2 +- phoenix-core/pom.xml | 12 phoenix-server/pom.xml | 39 --- pom.xml| 6 +++--- 4 files changed, 40 insertions(+), 19 deletions(-) diff --git a/Jenkinsfile b/Jenkinsfile index 5e0a142..5ac2c3f 100644 --- a/Jenkinsfile +++ b/Jenkinsfile @@ -54,7 +54,7 @@ pipeline { timeout(time: 30, unit: 'MINUTES') } environment { -HBASE_VERSION = sh(returnStdout: true, script: "mvn help:evaluate -Dhbase.profile=${HBASE_PROFILE} -Dartifact=org.apache.phoenix:phoenix-core -Dexpression=hbase.version -q -DforceStdout").trim() +HBASE_VERSION = sh(returnStdout: true, script: "mvn help:evaluate -Dexpression=hbase-{HBASE_PROFILE}.runtime.version -q -DforceStdout").trim() } steps { sh "dev/rebuild_hbase.sh ${HBASE_VERSION}" diff --git a/phoenix-core/pom.xml b/phoenix-core/pom.xml index c784dfd..6afaba6 100644 --- a/phoenix-core/pom.xml +++ b/phoenix-core/pom.xml @@ -594,6 +594,9 @@ 2.3 + + 2.3 + org.apache.zookeeper @@ -610,6 +613,9 @@ 2.4.0 + + 2.4.0 + org.apache.zookeeper @@ -626,6 +632,9 @@ 2.4 + + 2.4 + org.apache.zookeeper @@ -641,6 +650,9 @@ !hbase.profile + + 2.4 + org.apache.zookeeper diff --git a/phoenix-server/pom.xml b/phoenix-server/pom.xml index 7fe03a8..483bd19 100644 --- a/phoenix-server/pom.xml +++ b/phoenix-server/pom.xml @@ -422,6 +422,9 @@ 2.3 + +2.3 + org.apache.zookeeper @@ -439,6 +442,9 @@ 2.4.0 + +2.4.0 + org.apache.zookeeper @@ -448,21 +454,24 @@ - phoenix-hbase-compat-2.4.1 - - - - hbase.profile - 2.4 - - - - - org.apache.zookeeper - zookeeper-jute - provided - - +phoenix-hbase-compat-2.4.1 + + + +hbase.profile +2.4 + + + + 2.4.0 + + + +org.apache.zookeeper +zookeeper-jute +provided + + phoenix-hbase-compat-2.4.1-default diff --git a/pom.xml b/pom.xml index 9f7e2ff..4aa48ab 100644 --- a/pom.xml +++ b/pom.xml @@ -93,7 +93,7 @@ 2.2.6 2.3.4 2.4.0 -2.4.1 +2.4.1 src/main/antlr3 @@ -1539,7 +1539,7 @@ 2.4 2.4.1 -${hbase-2.4.1.runtime.version} +${hbase-2.4.runtime.version} 3.4.1 3.5.7 @@ -1625,7 +1625,7 @@ 2.4 2.4.1 -${hbase-2.4.1.runtime.version} +${hbase-2.4.runtime.version} 3.4.1 3.5.7
[phoenix] branch 5.1 updated: PHOENIX-6394 PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new 3ea1dc2 PHOENIX-6394 PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 3ea1dc2 is described below commit 3ea1dc2ac18095ed11688dee6c30691965222b30 Author: Istvan Toth AuthorDate: Mon Feb 22 09:31:32 2021 +0100 PHOENIX-6394 PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 --- Jenkinsfile| 2 +- phoenix-core/pom.xml | 12 phoenix-server/pom.xml | 39 --- pom.xml| 6 +++--- 4 files changed, 40 insertions(+), 19 deletions(-) diff --git a/Jenkinsfile b/Jenkinsfile index 5e0a142..5ac2c3f 100644 --- a/Jenkinsfile +++ b/Jenkinsfile @@ -54,7 +54,7 @@ pipeline { timeout(time: 30, unit: 'MINUTES') } environment { -HBASE_VERSION = sh(returnStdout: true, script: "mvn help:evaluate -Dhbase.profile=${HBASE_PROFILE} -Dartifact=org.apache.phoenix:phoenix-core -Dexpression=hbase.version -q -DforceStdout").trim() +HBASE_VERSION = sh(returnStdout: true, script: "mvn help:evaluate -Dexpression=hbase-{HBASE_PROFILE}.runtime.version -q -DforceStdout").trim() } steps { sh "dev/rebuild_hbase.sh ${HBASE_VERSION}" diff --git a/phoenix-core/pom.xml b/phoenix-core/pom.xml index 28a7db6..54d7d2a 100644 --- a/phoenix-core/pom.xml +++ b/phoenix-core/pom.xml @@ -594,6 +594,9 @@ 2.3 + + 2.3 + org.apache.zookeeper @@ -610,6 +613,9 @@ 2.4.0 + + 2.4.0 + org.apache.zookeeper @@ -626,6 +632,9 @@ 2.4 + + 2.4 + org.apache.zookeeper @@ -641,6 +650,9 @@ !hbase.profile + + 2.4 + org.apache.zookeeper diff --git a/phoenix-server/pom.xml b/phoenix-server/pom.xml index 8fba46e..077490b 100644 --- a/phoenix-server/pom.xml +++ b/phoenix-server/pom.xml @@ -422,6 +422,9 @@ 2.3 + +2.3 + org.apache.zookeeper @@ -439,6 +442,9 @@ 2.4.0 + +2.4.0 + org.apache.zookeeper @@ -448,21 +454,24 @@ - phoenix-hbase-compat-2.4.1 - - - - hbase.profile - 2.4 - - - - - org.apache.zookeeper - zookeeper-jute - provided - - +phoenix-hbase-compat-2.4.1 + + + +hbase.profile +2.4 + + + + 2.4.0 + + + +org.apache.zookeeper +zookeeper-jute +provided + + phoenix-hbase-compat-2.4.1-default diff --git a/pom.xml b/pom.xml index c9f914a..e1fd8c9 100644 --- a/pom.xml +++ b/pom.xml @@ -93,7 +93,7 @@ 2.2.6 2.3.4 2.4.0 -2.4.1 +2.4.1 src/main/antlr3 @@ -1539,7 +1539,7 @@ 2.4 2.4.1 -${hbase-2.4.1.runtime.version} +${hbase-2.4.runtime.version} 3.4.1 3.5.7 @@ -1625,7 +1625,7 @@ 2.4 2.4.1 -${hbase-2.4.1.runtime.version} +${hbase-2.4.runtime.version} 3.4.1 3.5.7
[phoenix] branch master updated: PHOENIX-6394 PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 (addendum: fix typo in Jenkinsfile)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new 8668bfa PHOENIX-6394 PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 (addendum: fix typo in Jenkinsfile) 8668bfa is described below commit 8668bfa568e37ffe54485c56b40344ef5d49777b Author: Istvan Toth AuthorDate: Mon Feb 22 14:53:37 2021 +0100 PHOENIX-6394 PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 (addendum: fix typo in Jenkinsfile) --- Jenkinsfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/Jenkinsfile b/Jenkinsfile index 5ac2c3f..c268209 100644 --- a/Jenkinsfile +++ b/Jenkinsfile @@ -54,7 +54,7 @@ pipeline { timeout(time: 30, unit: 'MINUTES') } environment { -HBASE_VERSION = sh(returnStdout: true, script: "mvn help:evaluate -Dexpression=hbase-{HBASE_PROFILE}.runtime.version -q -DforceStdout").trim() +HBASE_VERSION = sh(returnStdout: true, script: "mvn help:evaluate -Dexpression=hbase-${HBASE_PROFILE}.runtime.version -q -DforceStdout").trim() } steps { sh "dev/rebuild_hbase.sh ${HBASE_VERSION}"
[phoenix] branch 5.1 updated: PHOENIX-6394 PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 (addendum: fix typo in Jenkinsfile)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new 5d1f7ba PHOENIX-6394 PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 (addendum: fix typo in Jenkinsfile) 5d1f7ba is described below commit 5d1f7ba9bdf5557360cf10f931a624a5fd5d31a1 Author: Istvan Toth AuthorDate: Mon Feb 22 14:53:37 2021 +0100 PHOENIX-6394 PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 (addendum: fix typo in Jenkinsfile) --- Jenkinsfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/Jenkinsfile b/Jenkinsfile index 5ac2c3f..c268209 100644 --- a/Jenkinsfile +++ b/Jenkinsfile @@ -54,7 +54,7 @@ pipeline { timeout(time: 30, unit: 'MINUTES') } environment { -HBASE_VERSION = sh(returnStdout: true, script: "mvn help:evaluate -Dexpression=hbase-{HBASE_PROFILE}.runtime.version -q -DforceStdout").trim() +HBASE_VERSION = sh(returnStdout: true, script: "mvn help:evaluate -Dexpression=hbase-${HBASE_PROFILE}.runtime.version -q -DforceStdout").trim() } steps { sh "dev/rebuild_hbase.sh ${HBASE_VERSION}"
[phoenix] branch 5.1 updated: PHOENIX-6396 PChar illegal data exception should not contain value
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new e6878a2 PHOENIX-6396 PChar illegal data exception should not contain value e6878a2 is described below commit e6878a2f5b6c7f4e1e27ea896ac55bcc1226f4e9 Author: Xinyi Yan AuthorDate: Mon Feb 22 17:02:53 2021 -0800 PHOENIX-6396 PChar illegal data exception should not contain value --- .../src/main/java/org/apache/phoenix/schema/types/PChar.java | 10 +- .../java/org/apache/phoenix/compile/QueryCompilerTest.java | 4 +++- 2 files changed, 8 insertions(+), 6 deletions(-) diff --git a/phoenix-core/src/main/java/org/apache/phoenix/schema/types/PChar.java b/phoenix-core/src/main/java/org/apache/phoenix/schema/types/PChar.java index 560d8f8..4f63003 100644 --- a/phoenix-core/src/main/java/org/apache/phoenix/schema/types/PChar.java +++ b/phoenix-core/src/main/java/org/apache/phoenix/schema/types/PChar.java @@ -85,7 +85,7 @@ public class PChar extends PDataType { } byte[] b = PVarchar.INSTANCE.toBytes(object); if (b.length != ((String) object).length()) { -throw newIllegalDataException("CHAR types may only contain single byte characters (" + object + ")"); +throw newIllegalDataException("CHAR types may only contain single byte characters."); } return b; } @@ -97,7 +97,7 @@ public class PChar extends PDataType { } int len = PVarchar.INSTANCE.toBytes(object, bytes, offset); if (len != ((String) object).length()) { -throw newIllegalDataException("CHAR types may only contain single byte characters (" + object + ")"); +throw newIllegalDataException("CHAR types may only contain single byte characters."); } return len; } @@ -118,7 +118,7 @@ public class PChar extends PDataType { // TODO: UTF-8 decoder that will invert as it decodes String s = Bytes.toString(bytes, offset, length); if (length != s.length()) { -throw newIllegalDataException("CHAR types may only contain single byte characters (" + s + ")"); +throw newIllegalDataException("CHAR types may only contain single byte characters."); } return s; } @@ -142,7 +142,7 @@ public class PChar extends PDataType { Integer actualMaxLength, Integer actualScale, SortOrder actualModifier, Integer desiredMaxLength, Integer desiredScale, SortOrder expectedModifier) { if (o != null && actualType.equals(PVarchar.INSTANCE) && ((String)o).length() != ptr.getLength()) { -throw newIllegalDataException("CHAR types may only contain single byte characters (" + o + ")"); +throw newIllegalDataException("CHAR types may only contain single byte characters."); } super.coerceBytes(ptr, o, actualType, actualMaxLength, actualScale, actualModifier, desiredMaxLength, desiredScale, expectedModifier); if (ptr.getLength() > 0 && desiredMaxLength != null && @@ -201,7 +201,7 @@ public class PChar extends PDataType { @Override public Object toObject(String value) { if (StringUtil.hasMultiByteChars(value)) { -throw newIllegalDataException("CHAR types may only contain single byte characters (" + value + ")"); +throw newIllegalDataException("CHAR types may only contain single byte characters."); } return value; } diff --git a/phoenix-core/src/test/java/org/apache/phoenix/compile/QueryCompilerTest.java b/phoenix-core/src/test/java/org/apache/phoenix/compile/QueryCompilerTest.java index 5f0f546..16f9489 100644 --- a/phoenix-core/src/test/java/org/apache/phoenix/compile/QueryCompilerTest.java +++ b/phoenix-core/src/test/java/org/apache/phoenix/compile/QueryCompilerTest.java @@ -631,6 +631,7 @@ public class QueryCompilerTest extends BaseConnectionlessQueryTest { @Test public void testUpsertMultiByteIntoChar() throws Exception { +String value = "繰り返し曜日マスク"; try { // Select non agg column in aggregate query String query = "upsert into ATABLE VALUES (?, ?, ?)"; @@ -639,7 +640,7 @@ public class QueryCompilerTest extends BaseConnectionlessQueryTest { try { PreparedStatement statement = conn.prepareStatement(query); statement.setString(1, "00D3XHP"); -statement.setString(2, "繰り返し曜日マスク"); +statement.setString(2, value); statement.setInt(3, 1); statement.executeUpdate(); fail(); @@ -649,6 +650,7 @@ public class QueryCompilerTest extends BaseCon
[phoenix] branch 4.x updated: PHOENIX-6370 4.x branch still includes the phoenix-pig example files
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/4.x by this push: new 49cad04 PHOENIX-6370 4.x branch still includes the phoenix-pig example files 49cad04 is described below commit 49cad04c17310d6b0a38a1333f058eab52339423 Author: Istvan Toth AuthorDate: Tue Feb 23 06:45:45 2021 +0100 PHOENIX-6370 4.x branch still includes the phoenix-pig example files --- examples/pig/test.pig | 19 --- examples/pig/testdata | 18 -- 2 files changed, 37 deletions(-) diff --git a/examples/pig/test.pig b/examples/pig/test.pig deleted file mode 100644 index 6835d00..000 --- a/examples/pig/test.pig +++ /dev/null @@ -1,19 +0,0 @@ -/* - * Licensed to the Apache Software Foundation (ASF) under one or more - * contributor license agreements. See the NOTICE file distributed with - * this work for additional information regarding copyright ownership. - * The ASF licenses this file to You under the Apache License, Version 2.0 - * (the "License"); you may not use this file except in compliance with - * the License. You may obtain a copy of the License at - * - * http://www.apache.org/licenses/LICENSE-2.0 - * - * Unless required by applicable law or agreed to in writing, software - * distributed under the License is distributed on an "AS IS" BASIS, - * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - * See the License for the specific language governing permissions and - * limitations under the License. - */ - -A = load 'examples/pig/testdata' as (a:chararray, b:chararray, c:int, d:chararray, e: datetime) ; -STORE A into 'hbase://TESTPHX' using org.apache.phoenix.pig.PhoenixHBaseStorage('localhost','-batchSize 1000'); diff --git a/examples/pig/testdata b/examples/pig/testdata deleted file mode 100644 index 15f3f0b..000 --- a/examples/pig/testdata +++ /dev/null @@ -1,18 +0,0 @@ -00D3XHP124 123456 weq 2012-12-12 -00D3XHP111 123456 nab 2012-01-21 -00D3UIH101 123456 ben 2014-01-01 -00D3XHP124 123456 weq 2012-12-12 -00D3XHP111 123456 nab 2012-01-21 -00D3UIH101 123456 ben 2014-01-01 -00D3XHP124 123456 weq 2012-12-12 -00D3XHP111 123456 nab 2012-01-21 -00D3UIH101 123456 ben 2014-01-01 -00D3XHP124 123456 weq 2012-12-12 -00D3XHP111 123456 nab 2012-01-21 -00D3UIH101 123456 ben 2014-01-01 -00D3XHP124 123456 weq 2012-12-12 -00D3XHP111 123456 nab 2012-01-21 -00D3UIH101 123456 ben 2014-01-01 -00D3XHP124 123456 weq 2012-12-12 -00D3XHP111 123456 nab 2012-01-21 -00D3UIH101 123456 ben 2014-01-01
[phoenix-omid] branch master updated: OMID-199 Omid client cannot use pre-authenticated UserGroupInformation.getCurrentUser()
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-omid.git The following commit(s) were added to refs/heads/master by this push: new 70f3ca6 OMID-199 Omid client cannot use pre-authenticated UserGroupInformation.getCurrentUser() 70f3ca6 is described below commit 70f3ca6a8d00a87105f13d263498adf30379908a Author: Istvan Toth AuthorDate: Tue Feb 23 21:29:06 2021 +0100 OMID-199 Omid client cannot use pre-authenticated UserGroupInformation.getCurrentUser() --- .../java/org/apache/omid/tools/hbase/HBaseLogin.java | 16 ++-- .../org/apache/omid/tools/hbase/SecureHBaseConfig.java | 4 ++-- 2 files changed, 12 insertions(+), 8 deletions(-) diff --git a/hbase-common/src/main/java/org/apache/omid/tools/hbase/HBaseLogin.java b/hbase-common/src/main/java/org/apache/omid/tools/hbase/HBaseLogin.java index 0241fc0..3e5d197 100644 --- a/hbase-common/src/main/java/org/apache/omid/tools/hbase/HBaseLogin.java +++ b/hbase-common/src/main/java/org/apache/omid/tools/hbase/HBaseLogin.java @@ -43,10 +43,12 @@ public final class HBaseLogin { @Nullable public static UserGroupInformation loginIfNeeded(SecureHBaseConfig config, Configuration hbaseConf) throws IOException { boolean credsProvided = null != config.getPrincipal() && null != config.getKeytab(); -if (UserGroupInformation.isSecurityEnabled() && credsProvided) { +if (UserGroupInformation.isSecurityEnabled()) { // Check if we need to authenticate with kerberos so that we cache the correct ConnectionInfo UserGroupInformation currentUser = UserGroupInformation.getCurrentUser(); -if (!currentUser.hasKerberosCredentials() || !isSameName(currentUser.getUserName(), config.getPrincipal())) { +if (credsProvided +&& (!currentUser.hasKerberosCredentials() +|| !isSameName(currentUser.getUserName(), config.getPrincipal( { synchronized (KERBEROS_LOGIN_LOCK) { // Double check the current user, might have changed since we checked last. Don't want // to re-login if it's the same user. @@ -63,11 +65,13 @@ public final class HBaseLogin { } } } else { -// The user already has Kerberos creds, so there isn't anything to change in the ConnectionInfo. -LOG.debug("Already logged in as {}", currentUser); +if (currentUser.hasKerberosCredentials()) { +// The user already has Kerberos creds, so there isn't anything to change in the ConnectionInfo. +LOG.debug("Already logged in as {}", currentUser); +} else { +LOG.warn("Security enabled but not logged in, and did not provide credentials. NULL UGI returned"); +} } -} else { -LOG.warn("Security NOT enabled when connecting to HBase. Act at your own risk. NULL UGI returned"); } return ugi; } diff --git a/hbase-common/src/main/java/org/apache/omid/tools/hbase/SecureHBaseConfig.java b/hbase-common/src/main/java/org/apache/omid/tools/hbase/SecureHBaseConfig.java index 3d14e0f..c43260a 100644 --- a/hbase-common/src/main/java/org/apache/omid/tools/hbase/SecureHBaseConfig.java +++ b/hbase-common/src/main/java/org/apache/omid/tools/hbase/SecureHBaseConfig.java @@ -25,8 +25,8 @@ public class SecureHBaseConfig { public static final String HBASE_CLIENT_PRINCIPAL_KEY = "hbase.client.principal"; public static final String HBASE_CLIENT_KEYTAB_KEY = "hbase.client.keytab"; -private String principal = "not set"; -private String keytab = "not set"; +private String principal; +private String keytab; // // WARNING: Do not remove getters/setters, needed by snake_yaml!
[phoenix] branch 5.1 updated: PHOENIX-6388 Add sampled logging for read repairs
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new fdbbea7 PHOENIX-6388 Add sampled logging for read repairs fdbbea7 is described below commit fdbbea705ce2f9014bff6b6641744a6a6d8fbfa3 Author: Xinyi Yan AuthorDate: Tue Feb 23 15:51:46 2021 -0800 PHOENIX-6388 Add sampled logging for read repairs --- .../apache/phoenix/index/GlobalIndexChecker.java | 28 +- 1 file changed, 27 insertions(+), 1 deletion(-) diff --git a/phoenix-core/src/main/java/org/apache/phoenix/index/GlobalIndexChecker.java b/phoenix-core/src/main/java/org/apache/phoenix/index/GlobalIndexChecker.java index 9b2bd37..75775fa 100644 --- a/phoenix-core/src/main/java/org/apache/phoenix/index/GlobalIndexChecker.java +++ b/phoenix-core/src/main/java/org/apache/phoenix/index/GlobalIndexChecker.java @@ -28,6 +28,7 @@ import java.io.IOException; import java.sql.SQLException; import java.util.Iterator; import java.util.List; +import java.util.Random; import java.util.Optional; import org.apache.hadoop.hbase.Cell; @@ -96,6 +97,9 @@ import org.slf4j.LoggerFactory; public class GlobalIndexChecker extends BaseScannerRegionObserver implements RegionCoprocessor{ private static final Logger LOG = LoggerFactory.getLogger(GlobalIndexChecker.class); +private static final String REPAIR_LOGGING_PERCENT_ATTRIB = "phoenix.index.repair.logging.percent"; +private static final double DEFAULT_REPAIR_LOGGING_PERCENT = 1; + private GlobalIndexCheckerSource metricsSource; private CoprocessorEnvironment env; @@ -140,6 +144,8 @@ public class GlobalIndexChecker extends BaseScannerRegionObserver implements Reg private long pageSize = Long.MAX_VALUE; private boolean restartScanDueToPageFilterRemoval = false; private boolean hasMore; +private double loggingPercent; +private Random random; private String indexName; private long pageSizeMs; @@ -171,6 +177,9 @@ public class GlobalIndexChecker extends BaseScannerRegionObserver implements Reg "repairIndexRows: IndexMaintainer is not included in scan attributes for " + region.getRegionInfo().getTable().getNameAsString()); } +loggingPercent = env.getConfiguration().getDouble(REPAIR_LOGGING_PERCENT_ATTRIB, +DEFAULT_REPAIR_LOGGING_PERCENT); +random = new Random(EnvironmentEdgeManager.currentTimeMillis()); pageSizeMs = getPageSizeMsForRegionScanner(scan); } @@ -586,18 +595,28 @@ public class GlobalIndexChecker extends BaseScannerRegionObserver implements Reg byte[] rowKey = CellUtil.cloneRow(cell); long ts = cellList.get(0).getTimestamp(); cellList.clear(); - +long repairTime; try { repairIndexRows(rowKey, ts, cellList); +repairTime = EnvironmentEdgeManager.currentTimeMillis() - repairStart; metricsSource.incrementIndexRepairs(indexName); metricsSource.updateUnverifiedIndexRowAge(indexName, EnvironmentEdgeManager.currentTimeMillis() - ts); metricsSource.updateIndexRepairTime(indexName, EnvironmentEdgeManager.currentTimeMillis() - repairStart); +if (shouldLog()) { +LOG.info(String.format("Index row repair on region {} took {} ms.", +env.getRegionInfo().getRegionNameAsString(), repairTime)); +} } catch (IOException e) { +repairTime = EnvironmentEdgeManager.currentTimeMillis() - repairStart; metricsSource.incrementIndexRepairFailures(indexName); metricsSource.updateIndexRepairFailureTime(indexName, EnvironmentEdgeManager.currentTimeMillis() - repairStart); +if (shouldLog()) { +LOG.warn("Index row repair failure on region {} took {} ms.", +env.getRegionInfo().getRegionNameAsString(), repairTime); +} throw e; } @@ -608,6 +627,13 @@ public class GlobalIndexChecker extends BaseScannerRegionObserver implements Reg return true; } } + +private boolean shouldLog() { +if (loggingPercent == 0) { +return false; +} +return (random.nextDouble() <= (loggingPercent / 100.0d)); +} } @Override
svn commit: r1886876 [1/2] - in /phoenix/site: publish/ publish/language/ source/src/site/ source/src/site/markdown/
Author: stoty Date: Wed Feb 24 08:43:00 2021 New Revision: 1886876 URL: http://svn.apache.org/viewvc?rev=1886876&view=rev Log: Remove search-hadoop.com references Modified: phoenix/site/publish/Phoenix-in-15-minutes-or-less.html phoenix/site/publish/array_type.html phoenix/site/publish/atomic_upsert.html phoenix/site/publish/building.html phoenix/site/publish/building_website.html phoenix/site/publish/bulk_dataload.html phoenix/site/publish/columnencoding.html phoenix/site/publish/contributing.html phoenix/site/publish/cursors.html phoenix/site/publish/develop.html phoenix/site/publish/download.html phoenix/site/publish/dynamic_columns.html phoenix/site/publish/explainplan.html phoenix/site/publish/faq.html phoenix/site/publish/flume.html phoenix/site/publish/hive_storage_handler.html phoenix/site/publish/index.html phoenix/site/publish/installation.html phoenix/site/publish/issues.html phoenix/site/publish/joins.html phoenix/site/publish/kafka.html phoenix/site/publish/language/datatypes.html phoenix/site/publish/language/functions.html phoenix/site/publish/language/index.html phoenix/site/publish/mailing_list.html phoenix/site/publish/metrics.html phoenix/site/publish/multi-tenancy.html phoenix/site/publish/namspace_mapping.html phoenix/site/publish/news.html phoenix/site/publish/omid.html phoenix/site/publish/paged.html phoenix/site/publish/performance.html phoenix/site/publish/pherf.html phoenix/site/publish/phoenix_mr.html phoenix/site/publish/phoenix_on_emr.html phoenix/site/publish/phoenix_orm.html phoenix/site/publish/phoenix_python.html phoenix/site/publish/phoenix_spark.html phoenix/site/publish/phoenixcon.html phoenix/site/publish/pig_integration.html phoenix/site/publish/python.html phoenix/site/publish/recent.html phoenix/site/publish/release.html phoenix/site/publish/release_notes.html phoenix/site/publish/resources.html phoenix/site/publish/roadmap.html phoenix/site/publish/rowtimestamp.html phoenix/site/publish/salted.html phoenix/site/publish/secondary_indexing.html phoenix/site/publish/sequences.html phoenix/site/publish/server.html phoenix/site/publish/skip_scan.html phoenix/site/publish/source.html phoenix/site/publish/subqueries.html phoenix/site/publish/tablesample.html phoenix/site/publish/team.html phoenix/site/publish/tephra.html phoenix/site/publish/tracing.html phoenix/site/publish/transactions.html phoenix/site/publish/tuning.html phoenix/site/publish/tuning_guide.html phoenix/site/publish/udf.html phoenix/site/publish/update_statistics.html phoenix/site/publish/upgrading.html phoenix/site/publish/views.html phoenix/site/publish/who_is_using.html phoenix/site/source/src/site/markdown/index.md phoenix/site/source/src/site/site.xml Modified: phoenix/site/publish/Phoenix-in-15-minutes-or-less.html URL: http://svn.apache.org/viewvc/phoenix/site/publish/Phoenix-in-15-minutes-or-less.html?rev=1886876&r1=1886875&r2=1886876&view=diff == --- phoenix/site/publish/Phoenix-in-15-minutes-or-less.html (original) +++ phoenix/site/publish/Phoenix-in-15-minutes-or-less.html Wed Feb 24 08:43:00 2021 @@ -1,7 +1,7 @@ @@ -487,9 +487,6 @@ ORDER BY sum(population) DESC; - - http://search-hadoop.com/?"; method="get"> - @@ -498,7 +495,7 @@ ORDER BY sum(population) DESC; Back to top - Copyright ©2020 http://www.apache.org";>Apache Software Foundation. All Rights Reserved. + Copyright ©2021 http://www.apache.org";>Apache Software Foundation. All Rights Reserved. Modified: phoenix/site/publish/array_type.html URL: http://svn.apache.org/viewvc/phoenix/site/publish/array_type.html?rev=1886876&r1=1886875&r2=1886876&view=diff == --- phoenix/site/publish/array_type.html (original) +++ phoenix/site/publish/array_type.html Wed Feb 24 08:43:00 2021 @@ -1,7 +1,7 @@ @@ -486,9 +486,6 @@ SELECT region_name FROM regions WHERE '9 - -
svn commit: r1886876 [2/2] - in /phoenix/site: publish/ publish/language/ source/src/site/ source/src/site/markdown/
Modified: phoenix/site/publish/tracing.html URL: http://svn.apache.org/viewvc/phoenix/site/publish/tracing.html?rev=1886876&r1=1886875&r2=1886876&view=diff == --- phoenix/site/publish/tracing.html (original) +++ phoenix/site/publish/tracing.html Wed Feb 24 08:43:00 2021 @@ -1,7 +1,7 @@ @@ -602,9 +602,6 @@ Connection conn = DriverManager.getConne - - http://search-hadoop.com/?"; method="get"> - @@ -613,7 +610,7 @@ Connection conn = DriverManager.getConne Back to top - Copyright ©2020 http://www.apache.org";>Apache Software Foundation. All Rights Reserved. + Copyright ©2021 http://www.apache.org";>Apache Software Foundation. All Rights Reserved. Modified: phoenix/site/publish/transactions.html URL: http://svn.apache.org/viewvc/phoenix/site/publish/transactions.html?rev=1886876&r1=1886875&r2=1886876&view=diff == --- phoenix/site/publish/transactions.html (original) +++ phoenix/site/publish/transactions.html Wed Feb 24 08:43:00 2021 @@ -1,7 +1,7 @@ @@ -499,9 +499,6 @@ DELETE FROM my_other_table WHERE k=2; - - http://search-hadoop.com/?"; method="get"> - @@ -510,7 +507,7 @@ DELETE FROM my_other_table WHERE k=2; Back to top - Copyright ©2020 http://www.apache.org";>Apache Software Foundation. All Rights Reserved. + Copyright ©2021 http://www.apache.org";>Apache Software Foundation. All Rights Reserved. Modified: phoenix/site/publish/tuning.html URL: http://svn.apache.org/viewvc/phoenix/site/publish/tuning.html?rev=1886876&r1=1886875&r2=1886876&view=diff == --- phoenix/site/publish/tuning.html (original) +++ phoenix/site/publish/tuning.html Wed Feb 24 08:43:00 2021 @@ -1,7 +1,7 @@ @@ -717,9 +717,6 @@ - - http://search-hadoop.com/?"; method="get"> - @@ -728,7 +725,7 @@ Back to top - Copyright ©2020 http://www.apache.org";>Apache Software Foundation. All Rights Reserved. + Copyright ©2021 http://www.apache.org";>Apache Software Foundation. All Rights Reserved. Modified: phoenix/site/publish/tuning_guide.html URL: http://svn.apache.org/viewvc/phoenix/site/publish/tuning_guide.html?rev=1886876&r1=1886875&r2=1886876&view=diff == --- phoenix/site/publish/tuning_guide.html (original) +++ phoenix/site/publish/tuning_guide.html Wed Feb 24 08:43:00 2021 @@ -1,7 +1,7 @@ @@ -630,9 +630,6 @@ - - http://search-hadoop.com/?"; method="get"> - @@ -641,7 +638,7 @@ Back to top - Copyright ©2020 http://www.apache.org";>Apache Software Foundation. All Rights Reserved. + Copyright ©2021 http://www.apache.org";>Apache Software Foundation. All Rights Reserved. Modified: phoenix/site/publish/udf.html URL: http://svn.apache.org/viewvc/phoenix/site/publish/udf.html?rev=1886876&r1=1886875&r2=1886876&view=diff == --- phoenix/site/publish/udf.html (original) +++ phoenix/site/publish/udf.html Wed Feb 24 08:43:00 2021 @
[phoenix-omid] branch master updated: OMID-200 Omid client cannot use kerberos cache when using proxyUser
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-omid.git The following commit(s) were added to refs/heads/master by this push: new f634467 OMID-200 Omid client cannot use kerberos cache when using proxyUser f634467 is described below commit f6344671f488b85f18d71e4c6592e1bd08a9fa99 Author: Istvan Toth AuthorDate: Thu Feb 25 09:18:42 2021 +0100 OMID-200 Omid client cannot use kerberos cache when using proxyUser --- .../main/java/org/apache/omid/tools/hbase/HBaseLogin.java | 15 --- 1 file changed, 8 insertions(+), 7 deletions(-) diff --git a/hbase-common/src/main/java/org/apache/omid/tools/hbase/HBaseLogin.java b/hbase-common/src/main/java/org/apache/omid/tools/hbase/HBaseLogin.java index 3e5d197..8f3e695 100644 --- a/hbase-common/src/main/java/org/apache/omid/tools/hbase/HBaseLogin.java +++ b/hbase-common/src/main/java/org/apache/omid/tools/hbase/HBaseLogin.java @@ -46,17 +46,18 @@ public final class HBaseLogin { if (UserGroupInformation.isSecurityEnabled()) { // Check if we need to authenticate with kerberos so that we cache the correct ConnectionInfo UserGroupInformation currentUser = UserGroupInformation.getCurrentUser(); -if (credsProvided -&& (!currentUser.hasKerberosCredentials() -|| !isSameName(currentUser.getUserName(), config.getPrincipal( { +boolean hasKerberosCreds = currentUser.hasKerberosCredentials() +|| (currentUser.getRealUser() != null +&& currentUser.getRealUser().hasKerberosCredentials()); +if (credsProvided && (!hasKerberosCreds +|| !isSameName(currentUser.getUserName(), config.getPrincipal( { synchronized (KERBEROS_LOGIN_LOCK) { // Double check the current user, might have changed since we checked last. Don't want // to re-login if it's the same user. currentUser = UserGroupInformation.getCurrentUser(); -if (!currentUser.hasKerberosCredentials() || !isSameName(currentUser.getUserName(), config.getPrincipal())) { +if (!hasKerberosCreds || !isSameName(currentUser.getUserName(), config.getPrincipal())) { final Configuration hbaseConfig = getConfiguration(hbaseConf, config.getPrincipal(), config.getKeytab()); -LOG.info("Trying to connect to a secure cluster as {} " + -"with keytab {}", +LOG.info("Trying to connect to a secure cluster as {} with keytab {}", hbaseConfig.get(SecureHBaseConfig.HBASE_CLIENT_PRINCIPAL_KEY), hbaseConfig.get(SecureHBaseConfig.HBASE_CLIENT_KEYTAB_KEY)); UserGroupInformation.setConfiguration(hbaseConfig); @@ -65,7 +66,7 @@ public final class HBaseLogin { } } } else { -if (currentUser.hasKerberosCredentials()) { +if (hasKerberosCreds) { // The user already has Kerberos creds, so there isn't anything to change in the ConnectionInfo. LOG.debug("Already logged in as {}", currentUser); } else {
[phoenix] branch 5.1 updated: PHOENIX-6359 : New module to support HBase 2.4.1+ releases (#1143) (addendum: update phoenix version for backport)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new 7325b8a PHOENIX-6359 : New module to support HBase 2.4.1+ releases (#1143) (addendum: update phoenix version for backport) 7325b8a is described below commit 7325b8a221ef9f2d716cc19a807835b8a50fd98f Author: Istvan Toth AuthorDate: Fri Feb 26 08:54:53 2021 +0100 PHOENIX-6359 : New module to support HBase 2.4.1+ releases (#1143) (addendum: update phoenix version for backport) --- phoenix-hbase-compat-2.4.1/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/phoenix-hbase-compat-2.4.1/pom.xml b/phoenix-hbase-compat-2.4.1/pom.xml index cdc475a..032caba 100644 --- a/phoenix-hbase-compat-2.4.1/pom.xml +++ b/phoenix-hbase-compat-2.4.1/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.2.0-SNAPSHOT +5.1.1-SNAPSHOT phoenix-hbase-compat-2.4.1
[phoenix] tag 5.1.1RC0 created (now 0a3f52a)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to tag 5.1.1RC0 in repository https://gitbox.apache.org/repos/asf/phoenix.git. at 0a3f52a (commit) This tag includes the following new commits: new 0a3f52a Preparing phoenix release 5.1.1RC0; tagging and updates to CHANGES.md and RELEASENOTES.md The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[phoenix] 01/01: Preparing phoenix release 5.1.1RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to tag 5.1.1RC0 in repository https://gitbox.apache.org/repos/asf/phoenix.git commit 0a3f52a2867f13433307b71a57a532d13ff34fb0 Author: Istvan Toth AuthorDate: Fri Feb 26 10:03:21 2021 + Preparing phoenix release 5.1.1RC0; tagging and updates to CHANGES.md and RELEASENOTES.md --- CHANGES.md | 34 ++ RELEASENOTES.md| 29 ++ phoenix-assembly/pom.xml | 2 +- .../phoenix-client-embedded/pom.xml| 2 +- phoenix-client-parent/phoenix-client/pom.xml | 2 +- phoenix-client-parent/pom.xml | 2 +- phoenix-core/pom.xml | 2 +- phoenix-hbase-compat-2.1.6/pom.xml | 2 +- phoenix-hbase-compat-2.2.5/pom.xml | 2 +- phoenix-hbase-compat-2.3.0/pom.xml | 2 +- phoenix-hbase-compat-2.4.0/pom.xml | 2 +- phoenix-hbase-compat-2.4.1/pom.xml | 2 +- phoenix-pherf/pom.xml | 2 +- phoenix-server/pom.xml | 2 +- phoenix-tools/pom.xml | 2 +- phoenix-tracing-webapp/pom.xml | 2 +- pom.xml| 2 +- 17 files changed, 78 insertions(+), 15 deletions(-) diff --git a/CHANGES.md b/CHANGES.md index 942b9e8..ffaeb20 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -18,6 +18,40 @@ --> # PHOENIX Changelog +## Release 5.1.1 - Unreleased (as of 2021-02-26) + + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6388](https://issues.apache.org/jira/browse/PHOENIX-6388) | Add sampled logging for read repairs | Minor | . | +| [PHOENIX-6396](https://issues.apache.org/jira/browse/PHOENIX-6396) | PChar illegal data exception should not contain value | Major | . | +| [PHOENIX-6380](https://issues.apache.org/jira/browse/PHOENIX-6380) | phoenix-client-embedded depends on logging classes | Major | core | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6386](https://issues.apache.org/jira/browse/PHOENIX-6386) | Bulkload generates unverified index rows | Major | core | +| [PHOENIX-6343](https://issues.apache.org/jira/browse/PHOENIX-6343) | Phoenix allows duplicate column names when one of them is a primary key | Major | core | +| [PHOENIX-5250](https://issues.apache.org/jira/browse/PHOENIX-5250) | The accumulated wal files can't be cleaned | Blocker | . | +| [PHOENIX-6382](https://issues.apache.org/jira/browse/PHOENIX-6382) | Shaded artifact names and descriptions have unresolved ${hbase.profile} strings | Major | core | +| [PHOENIX-6377](https://issues.apache.org/jira/browse/PHOENIX-6377) | phoenix-client has erronous maven dependecies | Critical | core | +| [PHOENIX-5440](https://issues.apache.org/jira/browse/PHOENIX-5440) | multiple warnings when building phoenix | Minor | . | + + +### OTHER: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6394](https://issues.apache.org/jira/browse/PHOENIX-6394) | PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 | Major | . | +| [PHOENIX-6359](https://issues.apache.org/jira/browse/PHOENIX-6359) | New module to support HBase 2.4.1+ releases | Major | . | + + + ## Release 5.1.0 - Unreleased (as of 2021-02-05) diff --git a/RELEASENOTES.md b/RELEASENOTES.md index 085dc05..1d085df 100644 --- a/RELEASENOTES.md +++ b/RELEASENOTES.md @@ -16,6 +16,35 @@ # See the License for the specific language governing permissions and # limitations under the License. --> +# PHOENIX 5.1.1 Release Notes + +These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements. + + +--- + +* [PHOENIX-6359](https://issues.apache.org/jira/browse/PHOENIX-6359) | *Major* | **New module to support HBase 2.4.1+ releases** + +Added phoenix-hbase-compat-2.4.1 to support latest patch versions of HBase 2.4 release line. + + +--- + +* [PHOENIX-6343](https://issues.apache.org/jira/browse/PHOENIX-6343) | *Major* | **Phoenix allows duplicate column names when one of them is a primary key** + +Although user provided CF can have same column name as one of primary keys, default CF is no longer supported to have same column name as primary key columns. + + +--- + +* [PHOENIX-5250](https://issues.apache.org/jira/browse/PHOENIX-5250) | *Blocker* | **The accumulated wal files can't be cleaned** + +When updating from an earlier version, and using HBase 2.1.x, HBase 2.2.6 or earlier, HBase 2.3.3 or earlier, or HBase 2.4.0, HBase is unable to clean up WAL files that include data for global indexed tables with the old
[phoenix] branch 5.1 updated (7325b8a -> 0a3f52a)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git. from 7325b8a PHOENIX-6359 : New module to support HBase 2.4.1+ releases (#1143) (addendum: update phoenix version for backport) add 0a3f52a Preparing phoenix release 5.1.1RC0; tagging and updates to CHANGES.md and RELEASENOTES.md No new revisions were added by this update. Summary of changes: CHANGES.md | 34 ++ RELEASENOTES.md| 29 ++ phoenix-assembly/pom.xml | 2 +- .../phoenix-client-embedded/pom.xml| 2 +- phoenix-client-parent/phoenix-client/pom.xml | 2 +- phoenix-client-parent/pom.xml | 2 +- phoenix-core/pom.xml | 2 +- phoenix-hbase-compat-2.1.6/pom.xml | 2 +- phoenix-hbase-compat-2.2.5/pom.xml | 2 +- phoenix-hbase-compat-2.3.0/pom.xml | 2 +- phoenix-hbase-compat-2.4.0/pom.xml | 2 +- phoenix-hbase-compat-2.4.1/pom.xml | 2 +- phoenix-pherf/pom.xml | 2 +- phoenix-server/pom.xml | 2 +- phoenix-tools/pom.xml | 2 +- phoenix-tracing-webapp/pom.xml | 2 +- pom.xml| 2 +- 17 files changed, 78 insertions(+), 15 deletions(-)
svn commit: r46346 [3/3] - /dev/phoenix/phoenix-5.1.1RC0/
Added: dev/phoenix/phoenix-5.1.1RC0/RELEASENOTES.md == --- dev/phoenix/phoenix-5.1.1RC0/RELEASENOTES.md (added) +++ dev/phoenix/phoenix-5.1.1RC0/RELEASENOTES.md Fri Feb 26 11:00:35 2021 @@ -0,0 +1,212 @@ + + +# PHOENIX 5.1.1 Release Notes + +These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements. + + +--- + +* [PHOENIX-6359](https://issues.apache.org/jira/browse/PHOENIX-6359) | *Major* | **New module to support HBase 2.4.1+ releases** + +Added phoenix-hbase-compat-2.4.1 to support latest patch versions of HBase 2.4 release line. + + +--- + +* [PHOENIX-6343](https://issues.apache.org/jira/browse/PHOENIX-6343) | *Major* | **Phoenix allows duplicate column names when one of them is a primary key** + +Although user provided CF can have same column name as one of primary keys, default CF is no longer supported to have same column name as primary key columns. + + +--- + +* [PHOENIX-5250](https://issues.apache.org/jira/browse/PHOENIX-5250) | *Blocker* | **The accumulated wal files can't be cleaned** + +When updating from an earlier version, and using HBase 2.1.x, HBase 2.2.6 or earlier, HBase 2.3.3 or earlier, or HBase 2.4.0, HBase is unable to clean up WAL files that include data for global indexed tables with the old implementation. + +To avoid running out of disk space, use IndexUpgradeTool to upgrade all tables with global indexes, and then restart all region servers as soon as possible. + + + +# PHOENIX 5.1.0 Release Notes + +These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements. + + +--- + +* [PHOENIX-6349](https://issues.apache.org/jira/browse/PHOENIX-6349) | *Major* | **Add and use commons-cli to phoenix-thirdparty** + +Added phoenix-shaded-commons-cli to phoenix-thirdparty. +This helps avoid classpath conflicts and includes a patch on top of commons-cli 1.4.0 that fixes CLI-254. + + +--- + +* [PHOENIX-6273](https://issues.apache.org/jira/browse/PHOENIX-6273) | *Major* | **Add support to handle MR Snapshot restore externally** + +Adds mapreduce configuration param "phoenix.mapreduce.external.snapshot.restore" which when set to true indicates that snapshot-based MapReduce jobs shouldn't try to restore the snapshot themselves, but assume an external application has already done so. + + +--- + +* [PHOENIX-6323](https://issues.apache.org/jira/browse/PHOENIX-6323) | *Blocker* | **isRawFilterSupported() returns true for HBase 2.2 compat module** + +When used with HBase 2.2, Phoenix now only support HBase 2.2.5 and later versions. (i.e HBase 2.2.0-2.2.4 are not supported) + + +--- + +* [PHOENIX-6326](https://issues.apache.org/jira/browse/PHOENIX-6326) | *Critical* | **Phoenix doesn't work with Java version 11.0.9.1 , due to Jetty problem** + +There is bug in the Jetty version used by HBase 2.3 and earlier, that causes incompatilbity with Java releases that have a four number version string like "11.0.9.1" +As Phoenix builds on top of HBase, Phoenix is also incompatible with these releases, when built with an hbase.profile older than 2.4. + + +--- + +* [PHOENIX-6307](https://issues.apache.org/jira/browse/PHOENIX-6307) | *Major* | **Build and release official binary distributions with each HBase profile** + +The phoenix-client and phoenix-server JARs have been renamed to include the supported HBase version. + +Instead of phoenix-client-\.jar, the client is now phoenix-client-hbase-\-\.jar +I.e. The Phoenix 4.16 client for Hbase 1.5 is now called phoenix-client-hbase-1.5-5.1.0.jar + +The maven coordinates also have also changed to "org.apache.phoenix:phoenix-client-hbase-\:\". +I.e the Phoenix 4.15.0 client for Hbase 1.5 is "org.apache.phoenix:phoenix-client:4.15.0-HBase-1.5", but the phoenix client for Phoenix 4.16 is "org.apache.phoenix:phoenix-client-hbase-1.5:4.16.0" + + +--- + +* [PHOENIX-5265](https://issues.apache.org/jira/browse/PHOENIX-5265) | *Major* | **[UMBRELLA] Phoenix Test should use object based Plan for result comparison instead of using hard-corded comparison** + +New API for Explain plan queries that can be used for comparison of individual plan attributes. + + +--- + +* [PHOENIX-6280](https://issues.apache.org/jira/browse/PHOENIX-6280) | *Major* | **Support HBase 2.4** + +HBase 2.4 is now supported. (Tested with HBase 2.4.0) + + +--- + +* [PHOENIX-6282](https://issues.apache.org/jira/browse/PHOENIX-6282) | *Major* | **Generate PB files inline with build and remove checked in files** + +We no longer have generated protobuf Java files available in source code. These files are expected to be generated inline with mvn build. We have also used an optimization with the plugin to ensure protoc is not invoked with mvn build if no .proto file is updated between two consecutive builds. + + +--- + +* [PHOENIX-6086](https://issues.apache.org/jira/b
svn commit: r46346 [2/3] - /dev/phoenix/phoenix-5.1.1RC0/
Added: dev/phoenix/phoenix-5.1.1RC0/CHANGES.md == --- dev/phoenix/phoenix-5.1.1RC0/CHANGES.md (added) +++ dev/phoenix/phoenix-5.1.1RC0/CHANGES.md Fri Feb 26 11:00:35 2021 @@ -0,0 +1,782 @@ + + +# PHOENIX Changelog + +## Release 5.1.1 - Unreleased (as of 2021-02-26) + + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6388](https://issues.apache.org/jira/browse/PHOENIX-6388) | Add sampled logging for read repairs | Minor | . | +| [PHOENIX-6396](https://issues.apache.org/jira/browse/PHOENIX-6396) | PChar illegal data exception should not contain value | Major | . | +| [PHOENIX-6380](https://issues.apache.org/jira/browse/PHOENIX-6380) | phoenix-client-embedded depends on logging classes | Major | core | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6386](https://issues.apache.org/jira/browse/PHOENIX-6386) | Bulkload generates unverified index rows | Major | core | +| [PHOENIX-6343](https://issues.apache.org/jira/browse/PHOENIX-6343) | Phoenix allows duplicate column names when one of them is a primary key | Major | core | +| [PHOENIX-5250](https://issues.apache.org/jira/browse/PHOENIX-5250) | The accumulated wal files can't be cleaned | Blocker | . | +| [PHOENIX-6382](https://issues.apache.org/jira/browse/PHOENIX-6382) | Shaded artifact names and descriptions have unresolved ${hbase.profile} strings | Major | core | +| [PHOENIX-6377](https://issues.apache.org/jira/browse/PHOENIX-6377) | phoenix-client has erronous maven dependecies | Critical | core | +| [PHOENIX-5440](https://issues.apache.org/jira/browse/PHOENIX-5440) | multiple warnings when building phoenix | Minor | . | + + +### OTHER: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6394](https://issues.apache.org/jira/browse/PHOENIX-6394) | PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 | Major | . | +| [PHOENIX-6359](https://issues.apache.org/jira/browse/PHOENIX-6359) | New module to support HBase 2.4.1+ releases | Major | . | + + + +## Release 5.1.0 - Unreleased (as of 2021-02-05) + + + +### IMPORTANT ISSUES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-5265](https://issues.apache.org/jira/browse/PHOENIX-5265) | [UMBRELLA] Phoenix Test should use object based Plan for result comparison instead of using hard-corded comparison | Major | . | +| [PHOENIX-4412](https://issues.apache.org/jira/browse/PHOENIX-4412) | Tephra transaction context visibility level returns null instead of SNAPSHOT\_ALL | Critical | . | +| [PHOENIX-5446](https://issues.apache.org/jira/browse/PHOENIX-5446) | Support Protobuf shaded clients (thin + thick) | Major | . | +| [PHOENIX-4866](https://issues.apache.org/jira/browse/PHOENIX-4866) | UDFs get error: org.apache.phoenix.schema.FunctionNotFoundException: ERROR 6001 (42F01): Function undefined | Blocker | . | +| [PHOENIX-3655](https://issues.apache.org/jira/browse/PHOENIX-3655) | Global Phoenix Client Metrics for PQS | Major | . | + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6213](https://issues.apache.org/jira/browse/PHOENIX-6213) | Extend Cell Tags to Delete object. | Major | . | +| [PHOENIX-6280](https://issues.apache.org/jira/browse/PHOENIX-6280) | Support HBase 2.4 | Major | core | +| [PHOENIX-6186](https://issues.apache.org/jira/browse/PHOENIX-6186) | Store table metadata last modified timestamp in PTable / System.Catalog | Major | . | +| [PHOENIX-5628](https://issues.apache.org/jira/browse/PHOENIX-5628) | Phoenix Function to Return HBase Row Key of Column Cell | Major | . | +| [PHOENIX-3547](https://issues.apache.org/jira/browse/PHOENIX-3547) | Promote CATALOG.VIEW\_INDEX\_ID to an int | Blocker | . | +| [PHOENIX-5426](https://issues.apache.org/jira/browse/PHOENIX-5426) | IndexUpgradeTestTool lacks an Apache License | Blocker | . | +| [PHOENIX-5252](https://issues.apache.org/jira/browse/PHOENIX-5252) | Add job priority option to UpdateStatisticsTool | Major | . | +| [PHOENIX-5180](https://issues.apache.org/jira/browse/PHOENIX-5180) | Add API to PhoenixRunTime to get ptable of a tenant using a global connection | Major | . | +| [PHOENIX-5062](https://issues.apache.org/jira/browse/PHOENIX-5062) | Create a new repo for the phoenix connectors | Major | . | +| [PHOENIX-5063](https://issues.apache.org/jira/browse/PHOENIX-5063) | Create a new repo for the phoenix query server | Major | . | +| [PHOENIX-5124](https://issues.apache.org/jira/browse/PHOENIX-5124) | Add config to enable PropertyPolicyProvider | Major | . | +| [PHOENIX-374](https://issues.apache.org/jira/browse/PHOENIX-374) | Enable access to dynamic columns in \* or cf.\* selection | Critical | . | +| [PHOENIX-3623](https://issues.
svn commit: r46346 [1/3] - /dev/phoenix/phoenix-5.1.1RC0/
Author: stoty Date: Fri Feb 26 11:00:35 2021 New Revision: 46346 Log: Apache phoenix 5.1.1RC0 Added: dev/phoenix/phoenix-5.1.1RC0/ dev/phoenix/phoenix-5.1.1RC0/CHANGES.md dev/phoenix/phoenix-5.1.1RC0/RELEASENOTES.md dev/phoenix/phoenix-5.1.1RC0/phoenix-5.1.1-src.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC0/phoenix-5.1.1-src.tar.gz.asc dev/phoenix/phoenix-5.1.1RC0/phoenix-5.1.1-src.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.1-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.1-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.1-5.1.1-bin.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.2-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.2-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.2-5.1.1-bin.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.3-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.3-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.3-5.1.1-bin.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.4-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.4-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.4-5.1.1-bin.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.4.0-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.4.0-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC0/phoenix-hbase-2.4.0-5.1.1-bin.tar.gz.sha512
[phoenix] branch master updated: PHOENIX-6376 Update MetaDataProtocol.java for Phoenix 5.2
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new b6b41ce PHOENIX-6376 Update MetaDataProtocol.java for Phoenix 5.2 b6b41ce is described below commit b6b41ce954926e1c11c96c26bbfab2a31e9936fc Author: Xinyi Yan AuthorDate: Mon Mar 1 13:20:06 2021 -0800 PHOENIX-6376 Update MetaDataProtocol.java for Phoenix 5.2 includes PHOENIX-6399 Updating BackwardCompatibilityIT supported versions Co-authored-by: Istvan Toth --- ...BackwardCompatibilityForSplittableSyscatIT.java | 7 +-- .../phoenix/end2end/BackwardCompatibilityIT.java | 31 ++-- .../end2end/BackwardCompatibilityTestUtil.java | 56 +++--- .../it/resources/compatible_client_versions.json | 15 +++--- .../src/it/resources/scripts/execute_query.sh | 18 +++ .../phoenix/coprocessor/MetaDataProtocol.java | 10 ++-- 6 files changed, 95 insertions(+), 42 deletions(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityForSplittableSyscatIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityForSplittableSyscatIT.java index 92f4471..e7ee8f6 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityForSplittableSyscatIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityForSplittableSyscatIT.java @@ -18,6 +18,7 @@ package org.apache.phoenix.end2end; import org.apache.phoenix.util.PhoenixRuntime; +import org.apache.phoenix.end2end.BackwardCompatibilityTestUtil.MavenCoordinates; import org.apache.phoenix.thirdparty.com.google.common.collect.Maps; import org.junit.Before; import org.junit.Test; @@ -45,16 +46,16 @@ import static org.apache.phoenix.end2end.BackwardCompatibilityTestUtil.UpgradePr @RunWith(Parameterized.class) @Category(NeedsOwnMiniClusterTest.class) public class BackwardCompatibilityForSplittableSyscatIT extends SplitSystemCatalogIT { -private final String compatibleClientVersion; +private final MavenCoordinates compatibleClientVersion; private String zkQuorum; private String url; @Parameterized.Parameters(name = "BackwardCompatibilityForSplitableSyscatIT_compatibleClientVersion={0}") -public static synchronized Collection data() throws Exception { +public static synchronized Collection data() throws Exception { return computeClientVersions(); } -public BackwardCompatibilityForSplittableSyscatIT(String compatibleClientVersion) { +public BackwardCompatibilityForSplittableSyscatIT(MavenCoordinates compatibleClientVersion) { this.compatibleClientVersion = compatibleClientVersion; } diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java index a1b2d0e..17a7b9d 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java @@ -57,14 +57,17 @@ import org.apache.hadoop.hbase.client.TableDescriptor; import org.apache.phoenix.compat.hbase.CompatUtil; import org.apache.phoenix.coprocessor.SystemCatalogRegionObserver; import org.apache.phoenix.coprocessor.TaskMetaDataEndpoint; +import org.apache.phoenix.end2end.BackwardCompatibilityTestUtil.MavenCoordinates; import org.apache.phoenix.jdbc.PhoenixDatabaseMetaData; import org.apache.phoenix.jdbc.PhoenixDriver; import org.apache.phoenix.query.QueryServices; import org.apache.phoenix.query.QueryServicesOptions; import org.apache.phoenix.schema.SystemTaskSplitPolicy; import org.apache.phoenix.util.PhoenixRuntime; +import org.apache.phoenix.util.ServerUtil.ConnectionFactory; import org.junit.After; import org.junit.Before; +import org.junit.Ignore; import org.junit.Test; import org.junit.experimental.categories.Category; import org.junit.runner.RunWith; @@ -84,21 +87,21 @@ import org.slf4j.LoggerFactory; public class BackwardCompatibilityIT { private static final Logger LOGGER = LoggerFactory.getLogger( -BackwardCompatibilityIT.class); +BackwardCompatibilityIT.class); -private final String compatibleClientVersion; +private final MavenCoordinates compatibleClientVersion; private static Configuration conf; private static HBaseTestingUtility hbaseTestUtil; private static String zkQuorum; private static String url; private String tmpDir; -public BackwardCompatibilityIT(String compatibleClientVersion) { +public BackwardCompatibilityIT(MavenCoordinates compatibleClientVersion) { this.compatibleClientVersion = compatibleClientVersion; } @Param
[phoenix] branch 4.x updated: PHOENIX-6399 Updating BackwardCompatibilityIT supported versions
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/4.x by this push: new a9758f8 PHOENIX-6399 Updating BackwardCompatibilityIT supported versions a9758f8 is described below commit a9758f83804c4c02497cf5f5a7a33cc0a8e254b4 Author: Istvan Toth AuthorDate: Wed Mar 10 09:18:04 2021 +0100 PHOENIX-6399 Updating BackwardCompatibilityIT supported versions --- ...BackwardCompatibilityForSplittableSyscatIT.java | 12 +++-- .../phoenix/end2end/BackwardCompatibilityIT.java | 51 +--- .../end2end/BackwardCompatibilityTestUtil.java | 56 +++--- .../it/resources/compatible_client_versions.json | 8 ++-- .../src/it/resources/scripts/execute_query.sh | 18 +++ 5 files changed, 103 insertions(+), 42 deletions(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityForSplittableSyscatIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityForSplittableSyscatIT.java index 607aa09..07481d5 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityForSplittableSyscatIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityForSplittableSyscatIT.java @@ -19,6 +19,8 @@ package org.apache.phoenix.end2end; import com.google.common.collect.Maps; + +import org.apache.phoenix.end2end.BackwardCompatibilityTestUtil.MavenCoordinates; import org.apache.phoenix.util.PhoenixRuntime; import org.junit.Before; import org.junit.BeforeClass; @@ -49,16 +51,16 @@ import static org.apache.phoenix.end2end.BackwardCompatibilityTestUtil.UpgradePr @RunWith(Parameterized.class) @Category(NeedsOwnMiniClusterTest.class) public class BackwardCompatibilityForSplittableSyscatIT extends SplitSystemCatalogIT { -private final String compatibleClientVersion; -private static String zkQuorum; -private static String url; +private final MavenCoordinates compatibleClientVersion; +private String zkQuorum; +private String url; @Parameterized.Parameters(name = "BackwardCompatibilityForSplitableSyscatIT_compatibleClientVersion={0}") -public static synchronized Collection data() throws Exception { +public static synchronized Collection data() throws Exception { return computeClientVersions(); } -public BackwardCompatibilityForSplittableSyscatIT(String compatibleClientVersion) { +public BackwardCompatibilityForSplittableSyscatIT(MavenCoordinates compatibleClientVersion) { this.compatibleClientVersion = compatibleClientVersion; } diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java index 5a70e2a..bc743e4 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java @@ -52,6 +52,7 @@ import org.apache.hadoop.hbase.HTableDescriptor; import org.apache.hadoop.hbase.TableName; import org.apache.hadoop.hbase.client.Admin; import org.apache.phoenix.coprocessor.TaskMetaDataEndpoint; +import org.apache.phoenix.end2end.BackwardCompatibilityTestUtil.MavenCoordinates; import org.apache.phoenix.coprocessor.SystemCatalogRegionObserver; import org.apache.phoenix.jdbc.PhoenixDatabaseMetaData; import org.apache.phoenix.jdbc.PhoenixDriver; @@ -77,18 +78,18 @@ import org.junit.runners.Parameterized.Parameters; @Category(NeedsOwnMiniClusterTest.class) public class BackwardCompatibilityIT { -private final String compatibleClientVersion; +private final MavenCoordinates compatibleClientVersion; private static Configuration conf; private static HBaseTestingUtility hbaseTestUtil; private static String zkQuorum; private static String url; -public BackwardCompatibilityIT(String compatibleClientVersion) { +public BackwardCompatibilityIT(MavenCoordinates compatibleClientVersion) { this.compatibleClientVersion = compatibleClientVersion; } @Parameters(name = "BackwardCompatibilityIT_compatibleClientVersion={0}") -public static synchronized Collection data() throws Exception { +public static synchronized Collection data() throws Exception { return computeClientVersions(); } @@ -134,7 +135,7 @@ public class BackwardCompatibilityIT { public void testCreateDivergedViewWithOldClientReadFromNewClient() throws Exception { // Create a base table, view and make it diverge from an old client executeQueryWithClientVersion(compatibleClientVersion, CREATE_DIVERGED_VIEW, zkQuorum); -executeQueriesWithCurrentVersion(QUERY_CREATE_DIVERGED_VIEW,url, NONE); +executeQueri
[phoenix] tag 5.1.1RC1 created (now 5403d95)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to tag 5.1.1RC1 in repository https://gitbox.apache.org/repos/asf/phoenix.git. at 5403d95 (commit) This tag includes the following new commits: new 5403d95 Preparing phoenix release 5.1.1RC1; tagging and updates to CHANGES.md and RELEASENOTES.md The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[phoenix] 01/01: Preparing phoenix release 5.1.1RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to tag 5.1.1RC1 in repository https://gitbox.apache.org/repos/asf/phoenix.git commit 5403d9546bf695a4b8e30c7614c5a545d1c13820 Author: Istvan Toth AuthorDate: Thu Mar 11 09:19:58 2021 + Preparing phoenix release 5.1.1RC1; tagging and updates to CHANGES.md and RELEASENOTES.md --- CHANGES.md | 11 ++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/CHANGES.md b/CHANGES.md index ffaeb20..0693a17 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -18,7 +18,7 @@ --> # PHOENIX Changelog -## Release 5.1.1 - Unreleased (as of 2021-02-26) +## Release 5.1.1 - Unreleased (as of 2021-03-11) @@ -26,6 +26,7 @@ | JIRA | Summary | Priority | Component | |: |: | :--- |: | +| [PHOENIX-6402](https://issues.apache.org/jira/browse/PHOENIX-6402) | Allow using local indexes with uncovered columns in the WHERE clause | Blocker | . | | [PHOENIX-6388](https://issues.apache.org/jira/browse/PHOENIX-6388) | Add sampled logging for read repairs | Minor | . | | [PHOENIX-6396](https://issues.apache.org/jira/browse/PHOENIX-6396) | PChar illegal data exception should not contain value | Major | . | | [PHOENIX-6380](https://issues.apache.org/jira/browse/PHOENIX-6380) | phoenix-client-embedded depends on logging classes | Major | core | @@ -35,6 +36,7 @@ | JIRA | Summary | Priority | Component | |: |: | :--- |: | +| [PHOENIX-6400](https://issues.apache.org/jira/browse/PHOENIX-6400) | Do no use local index with uncovered columns in the WHERE clause. | Blocker | . | | [PHOENIX-6386](https://issues.apache.org/jira/browse/PHOENIX-6386) | Bulkload generates unverified index rows | Major | core | | [PHOENIX-6343](https://issues.apache.org/jira/browse/PHOENIX-6343) | Phoenix allows duplicate column names when one of them is a primary key | Major | core | | [PHOENIX-5250](https://issues.apache.org/jira/browse/PHOENIX-5250) | The accumulated wal files can't be cleaned | Blocker | . | @@ -43,6 +45,13 @@ | [PHOENIX-5440](https://issues.apache.org/jira/browse/PHOENIX-5440) | multiple warnings when building phoenix | Minor | . | +### SUB-TASKS: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6408](https://issues.apache.org/jira/browse/PHOENIX-6408) | LIMIT on local index query with uncovered columns in the WHERE returns wrong result. | Major | . | + + ### OTHER: | JIRA | Summary | Priority | Component |
[phoenix] branch 5.1 updated (148800c -> 5403d95)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git. from 148800c PHOENIX-6408 LIMIT on local index query with uncovered columns in the WHERE returns wrong result. add 5403d95 Preparing phoenix release 5.1.1RC1; tagging and updates to CHANGES.md and RELEASENOTES.md No new revisions were added by this update. Summary of changes: CHANGES.md | 11 ++- 1 file changed, 10 insertions(+), 1 deletion(-)
[phoenix] branch master updated: PHOENIX-6376 Update MetaDataProtocol.java for Phoenix 5.2 (addendum: increase timeout for BackwardCompatibilityIT#testSystemTaskCreationWithIndexAsyncRebuild())
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new 8e06ada PHOENIX-6376 Update MetaDataProtocol.java for Phoenix 5.2 (addendum: increase timeout for BackwardCompatibilityIT#testSystemTaskCreationWithIndexAsyncRebuild()) 8e06ada is described below commit 8e06adae43d1db57176f8b1406de01168cebf6ad Author: Istvan Toth AuthorDate: Thu Mar 11 07:32:08 2021 +0100 PHOENIX-6376 Update MetaDataProtocol.java for Phoenix 5.2 (addendum: increase timeout for BackwardCompatibilityIT#testSystemTaskCreationWithIndexAsyncRebuild()) --- .../phoenix/end2end/BackwardCompatibilityIT.java | 20 +++- 1 file changed, 15 insertions(+), 5 deletions(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java index 17a7b9d..809fde4 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BackwardCompatibilityIT.java @@ -326,7 +326,7 @@ public class BackwardCompatibilityIT { assertExpectedOutput(QUERY_CREATE_ADD); // Deletes with the new client -executeQueriesWithCurrentVersion(ADD_DELETE,url, NONE); +executeQueriesWithCurrentVersion(ADD_DELETE, url, NONE); executeQueriesWithCurrentVersion(QUERY_ADD_DELETE, url, NONE); assertExpectedOutput(QUERY_ADD_DELETE); } @@ -389,10 +389,20 @@ public class BackwardCompatibilityIT { if (majorVersion > 4 || (majorVersion == 4 && minorVersion >= 15)) { executeQueryWithClientVersion(compatibleClientVersion, INDEX_REBUILD_ASYNC, zkQuorum); -// wait 5 seconds to finish the rebuild job -Thread.sleep(5000); -executeQueriesWithCurrentVersion(QUERY_INDEX_REBUILD_ASYNC, url, NONE); -assertExpectedOutput(QUERY_INDEX_REBUILD_ASYNC); +// wait to finish the rebuild job (convoluted logic to preserve the AssertionError) +int retryCount=0; +while (true) { +try { +Thread.sleep(5000); + executeQueriesWithCurrentVersion(QUERY_INDEX_REBUILD_ASYNC, url, NONE); +assertExpectedOutput(QUERY_INDEX_REBUILD_ASYNC); +break; +} catch (AssertionError e) { +if (retryCount++ > 10) { +throw e; +} +} +} } }
svn commit: r46579 [3/3] - /dev/phoenix/phoenix-5.1.1RC1/
Added: dev/phoenix/phoenix-5.1.1RC1/RELEASENOTES.md == --- dev/phoenix/phoenix-5.1.1RC1/RELEASENOTES.md (added) +++ dev/phoenix/phoenix-5.1.1RC1/RELEASENOTES.md Thu Mar 11 10:18:38 2021 @@ -0,0 +1,212 @@ + + +# PHOENIX 5.1.1 Release Notes + +These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements. + + +--- + +* [PHOENIX-6359](https://issues.apache.org/jira/browse/PHOENIX-6359) | *Major* | **New module to support HBase 2.4.1+ releases** + +Added phoenix-hbase-compat-2.4.1 to support latest patch versions of HBase 2.4 release line. + + +--- + +* [PHOENIX-6343](https://issues.apache.org/jira/browse/PHOENIX-6343) | *Major* | **Phoenix allows duplicate column names when one of them is a primary key** + +Although user provided CF can have same column name as one of primary keys, default CF is no longer supported to have same column name as primary key columns. + + +--- + +* [PHOENIX-5250](https://issues.apache.org/jira/browse/PHOENIX-5250) | *Blocker* | **The accumulated wal files can't be cleaned** + +When updating from an earlier version, and using HBase 2.1.x, HBase 2.2.6 or earlier, HBase 2.3.3 or earlier, or HBase 2.4.0, HBase is unable to clean up WAL files that include data for global indexed tables with the old implementation. + +To avoid running out of disk space, use IndexUpgradeTool to upgrade all tables with global indexes, and then restart all region servers as soon as possible. + + + +# PHOENIX 5.1.0 Release Notes + +These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements. + + +--- + +* [PHOENIX-6349](https://issues.apache.org/jira/browse/PHOENIX-6349) | *Major* | **Add and use commons-cli to phoenix-thirdparty** + +Added phoenix-shaded-commons-cli to phoenix-thirdparty. +This helps avoid classpath conflicts and includes a patch on top of commons-cli 1.4.0 that fixes CLI-254. + + +--- + +* [PHOENIX-6273](https://issues.apache.org/jira/browse/PHOENIX-6273) | *Major* | **Add support to handle MR Snapshot restore externally** + +Adds mapreduce configuration param "phoenix.mapreduce.external.snapshot.restore" which when set to true indicates that snapshot-based MapReduce jobs shouldn't try to restore the snapshot themselves, but assume an external application has already done so. + + +--- + +* [PHOENIX-6323](https://issues.apache.org/jira/browse/PHOENIX-6323) | *Blocker* | **isRawFilterSupported() returns true for HBase 2.2 compat module** + +When used with HBase 2.2, Phoenix now only support HBase 2.2.5 and later versions. (i.e HBase 2.2.0-2.2.4 are not supported) + + +--- + +* [PHOENIX-6326](https://issues.apache.org/jira/browse/PHOENIX-6326) | *Critical* | **Phoenix doesn't work with Java version 11.0.9.1 , due to Jetty problem** + +There is bug in the Jetty version used by HBase 2.3 and earlier, that causes incompatilbity with Java releases that have a four number version string like "11.0.9.1" +As Phoenix builds on top of HBase, Phoenix is also incompatible with these releases, when built with an hbase.profile older than 2.4. + + +--- + +* [PHOENIX-6307](https://issues.apache.org/jira/browse/PHOENIX-6307) | *Major* | **Build and release official binary distributions with each HBase profile** + +The phoenix-client and phoenix-server JARs have been renamed to include the supported HBase version. + +Instead of phoenix-client-\.jar, the client is now phoenix-client-hbase-\-\.jar +I.e. The Phoenix 4.16 client for Hbase 1.5 is now called phoenix-client-hbase-1.5-5.1.0.jar + +The maven coordinates also have also changed to "org.apache.phoenix:phoenix-client-hbase-\:\". +I.e the Phoenix 4.15.0 client for Hbase 1.5 is "org.apache.phoenix:phoenix-client:4.15.0-HBase-1.5", but the phoenix client for Phoenix 4.16 is "org.apache.phoenix:phoenix-client-hbase-1.5:4.16.0" + + +--- + +* [PHOENIX-5265](https://issues.apache.org/jira/browse/PHOENIX-5265) | *Major* | **[UMBRELLA] Phoenix Test should use object based Plan for result comparison instead of using hard-corded comparison** + +New API for Explain plan queries that can be used for comparison of individual plan attributes. + + +--- + +* [PHOENIX-6280](https://issues.apache.org/jira/browse/PHOENIX-6280) | *Major* | **Support HBase 2.4** + +HBase 2.4 is now supported. (Tested with HBase 2.4.0) + + +--- + +* [PHOENIX-6282](https://issues.apache.org/jira/browse/PHOENIX-6282) | *Major* | **Generate PB files inline with build and remove checked in files** + +We no longer have generated protobuf Java files available in source code. These files are expected to be generated inline with mvn build. We have also used an optimization with the plugin to ensure protoc is not invoked with mvn build if no .proto file is updated between two consecutive builds. + + +--- + +* [PHOENIX-6086](https://issues.apache.org/jira/b
svn commit: r46579 [2/3] - /dev/phoenix/phoenix-5.1.1RC1/
Added: dev/phoenix/phoenix-5.1.1RC1/CHANGES.md == --- dev/phoenix/phoenix-5.1.1RC1/CHANGES.md (added) +++ dev/phoenix/phoenix-5.1.1RC1/CHANGES.md Thu Mar 11 10:18:38 2021 @@ -0,0 +1,791 @@ + + +# PHOENIX Changelog + +## Release 5.1.1 - Unreleased (as of 2021-03-11) + + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6402](https://issues.apache.org/jira/browse/PHOENIX-6402) | Allow using local indexes with uncovered columns in the WHERE clause | Blocker | . | +| [PHOENIX-6388](https://issues.apache.org/jira/browse/PHOENIX-6388) | Add sampled logging for read repairs | Minor | . | +| [PHOENIX-6396](https://issues.apache.org/jira/browse/PHOENIX-6396) | PChar illegal data exception should not contain value | Major | . | +| [PHOENIX-6380](https://issues.apache.org/jira/browse/PHOENIX-6380) | phoenix-client-embedded depends on logging classes | Major | core | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6400](https://issues.apache.org/jira/browse/PHOENIX-6400) | Do no use local index with uncovered columns in the WHERE clause. | Blocker | . | +| [PHOENIX-6386](https://issues.apache.org/jira/browse/PHOENIX-6386) | Bulkload generates unverified index rows | Major | core | +| [PHOENIX-6343](https://issues.apache.org/jira/browse/PHOENIX-6343) | Phoenix allows duplicate column names when one of them is a primary key | Major | core | +| [PHOENIX-5250](https://issues.apache.org/jira/browse/PHOENIX-5250) | The accumulated wal files can't be cleaned | Blocker | . | +| [PHOENIX-6382](https://issues.apache.org/jira/browse/PHOENIX-6382) | Shaded artifact names and descriptions have unresolved ${hbase.profile} strings | Major | core | +| [PHOENIX-6377](https://issues.apache.org/jira/browse/PHOENIX-6377) | phoenix-client has erronous maven dependecies | Critical | core | +| [PHOENIX-5440](https://issues.apache.org/jira/browse/PHOENIX-5440) | multiple warnings when building phoenix | Minor | . | + + +### SUB-TASKS: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6408](https://issues.apache.org/jira/browse/PHOENIX-6408) | LIMIT on local index query with uncovered columns in the WHERE returns wrong result. | Major | . | + + +### OTHER: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6394](https://issues.apache.org/jira/browse/PHOENIX-6394) | PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 | Major | . | +| [PHOENIX-6359](https://issues.apache.org/jira/browse/PHOENIX-6359) | New module to support HBase 2.4.1+ releases | Major | . | + + + +## Release 5.1.0 - Unreleased (as of 2021-02-05) + + + +### IMPORTANT ISSUES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-5265](https://issues.apache.org/jira/browse/PHOENIX-5265) | [UMBRELLA] Phoenix Test should use object based Plan for result comparison instead of using hard-corded comparison | Major | . | +| [PHOENIX-4412](https://issues.apache.org/jira/browse/PHOENIX-4412) | Tephra transaction context visibility level returns null instead of SNAPSHOT\_ALL | Critical | . | +| [PHOENIX-5446](https://issues.apache.org/jira/browse/PHOENIX-5446) | Support Protobuf shaded clients (thin + thick) | Major | . | +| [PHOENIX-4866](https://issues.apache.org/jira/browse/PHOENIX-4866) | UDFs get error: org.apache.phoenix.schema.FunctionNotFoundException: ERROR 6001 (42F01): Function undefined | Blocker | . | +| [PHOENIX-3655](https://issues.apache.org/jira/browse/PHOENIX-3655) | Global Phoenix Client Metrics for PQS | Major | . | + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6213](https://issues.apache.org/jira/browse/PHOENIX-6213) | Extend Cell Tags to Delete object. | Major | . | +| [PHOENIX-6280](https://issues.apache.org/jira/browse/PHOENIX-6280) | Support HBase 2.4 | Major | core | +| [PHOENIX-6186](https://issues.apache.org/jira/browse/PHOENIX-6186) | Store table metadata last modified timestamp in PTable / System.Catalog | Major | . | +| [PHOENIX-5628](https://issues.apache.org/jira/browse/PHOENIX-5628) | Phoenix Function to Return HBase Row Key of Column Cell | Major | . | +| [PHOENIX-3547](https://issues.apache.org/jira/browse/PHOENIX-3547) | Promote CATALOG.VIEW\_INDEX\_ID to an int | Blocker | . | +| [PHOENIX-5426](https://issues.apache.org/jira/browse/PHOENIX-5426) | IndexUpgradeTestTool lacks an Apache License | Blocker | . | +| [PHOENIX-5252](https://issues.apache.org/jira/browse/PHOENIX-5252) | Add job priority option to UpdateStatisticsTool | Major | . | +| [PHOENIX-5180](https://issues.apache.org/jira/browse/PHOENIX-5180) | Add API to PhoenixRunTime to get ptable of a tenant using a global connection | Major |
svn commit: r46579 [1/3] - /dev/phoenix/phoenix-5.1.1RC1/
Author: stoty Date: Thu Mar 11 10:18:38 2021 New Revision: 46579 Log: Apache phoenix 5.1.1RC1 Added: dev/phoenix/phoenix-5.1.1RC1/ dev/phoenix/phoenix-5.1.1RC1/CHANGES.md dev/phoenix/phoenix-5.1.1RC1/RELEASENOTES.md dev/phoenix/phoenix-5.1.1RC1/phoenix-5.1.1-src.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC1/phoenix-5.1.1-src.tar.gz.asc dev/phoenix/phoenix-5.1.1RC1/phoenix-5.1.1-src.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.1-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.1-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.1-5.1.1-bin.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.2-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.2-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.2-5.1.1-bin.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.3-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.3-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.3-5.1.1-bin.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.4-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.4-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.4-5.1.1-bin.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.4.0-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.4.0-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC1/phoenix-hbase-2.4.0-5.1.1-bin.tar.gz.sha512
[phoenix] tag 5.1.1RC2 created (now fca58a7)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to tag 5.1.1RC2 in repository https://gitbox.apache.org/repos/asf/phoenix.git. at fca58a7 (commit) This tag includes the following new commits: new fca58a7 Preparing phoenix release 5.1.1RC2; tagging and updates to CHANGES.md and RELEASENOTES.md The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[phoenix] 01/01: Preparing phoenix release 5.1.1RC2; tagging and updates to CHANGES.md and RELEASENOTES.md
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to tag 5.1.1RC2 in repository https://gitbox.apache.org/repos/asf/phoenix.git commit fca58a7b8879367cafc95af4e9a36e7fd72e8569 Author: Istvan Toth AuthorDate: Tue Mar 16 07:54:29 2021 + Preparing phoenix release 5.1.1RC2; tagging and updates to CHANGES.md and RELEASENOTES.md --- CHANGES.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/CHANGES.md b/CHANGES.md index 0693a17..690cb44 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -18,7 +18,7 @@ --> # PHOENIX Changelog -## Release 5.1.1 - Unreleased (as of 2021-03-11) +## Release 5.1.1 - Unreleased (as of 2021-03-16) @@ -26,6 +26,8 @@ | JIRA | Summary | Priority | Component | |: |: | :--- |: | +| [PHOENIX-6409](https://issues.apache.org/jira/browse/PHOENIX-6409) | Include local index uncovered columns merge in explain plan. | Minor | . | +| [PHOENIX-6385](https://issues.apache.org/jira/browse/PHOENIX-6385) | Not to use Scan#setSmall for HBase 2.x versions | Major | . | | [PHOENIX-6402](https://issues.apache.org/jira/browse/PHOENIX-6402) | Allow using local indexes with uncovered columns in the WHERE clause | Blocker | . | | [PHOENIX-6388](https://issues.apache.org/jira/browse/PHOENIX-6388) | Add sampled logging for read repairs | Minor | . | | [PHOENIX-6396](https://issues.apache.org/jira/browse/PHOENIX-6396) | PChar illegal data exception should not contain value | Major | . |
[phoenix] branch 5.1 updated (512b199 -> fca58a7)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git. from 512b199 PHOENIX-6409 : Test with new Explain API for local index uncovered columns merge (ADDENDUM) add fca58a7 Preparing phoenix release 5.1.1RC2; tagging and updates to CHANGES.md and RELEASENOTES.md No new revisions were added by this update. Summary of changes: CHANGES.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)
svn commit: r46659 [1/3] - /dev/phoenix/phoenix-5.1.1RC2/
Author: stoty Date: Tue Mar 16 11:24:02 2021 New Revision: 46659 Log: Apache phoenix 5.1.1RC2 Added: dev/phoenix/phoenix-5.1.1RC2/ dev/phoenix/phoenix-5.1.1RC2/CHANGES.md dev/phoenix/phoenix-5.1.1RC2/RELEASENOTES.md dev/phoenix/phoenix-5.1.1RC2/phoenix-5.1.1-src.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC2/phoenix-5.1.1-src.tar.gz.asc dev/phoenix/phoenix-5.1.1RC2/phoenix-5.1.1-src.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.1-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.1-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.1-5.1.1-bin.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.2-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.2-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.2-5.1.1-bin.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.3-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.3-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.3-5.1.1-bin.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.4-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.4-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.4-5.1.1-bin.tar.gz.sha512 dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.4.0-5.1.1-bin.tar.gz (with props) dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.4.0-5.1.1-bin.tar.gz.asc dev/phoenix/phoenix-5.1.1RC2/phoenix-hbase-2.4.0-5.1.1-bin.tar.gz.sha512
svn commit: r46659 [3/3] - /dev/phoenix/phoenix-5.1.1RC2/
Added: dev/phoenix/phoenix-5.1.1RC2/RELEASENOTES.md == --- dev/phoenix/phoenix-5.1.1RC2/RELEASENOTES.md (added) +++ dev/phoenix/phoenix-5.1.1RC2/RELEASENOTES.md Tue Mar 16 11:24:02 2021 @@ -0,0 +1,212 @@ + + +# PHOENIX 5.1.1 Release Notes + +These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements. + + +--- + +* [PHOENIX-6359](https://issues.apache.org/jira/browse/PHOENIX-6359) | *Major* | **New module to support HBase 2.4.1+ releases** + +Added phoenix-hbase-compat-2.4.1 to support latest patch versions of HBase 2.4 release line. + + +--- + +* [PHOENIX-6343](https://issues.apache.org/jira/browse/PHOENIX-6343) | *Major* | **Phoenix allows duplicate column names when one of them is a primary key** + +Although user provided CF can have same column name as one of primary keys, default CF is no longer supported to have same column name as primary key columns. + + +--- + +* [PHOENIX-5250](https://issues.apache.org/jira/browse/PHOENIX-5250) | *Blocker* | **The accumulated wal files can't be cleaned** + +When updating from an earlier version, and using HBase 2.1.x, HBase 2.2.6 or earlier, HBase 2.3.3 or earlier, or HBase 2.4.0, HBase is unable to clean up WAL files that include data for global indexed tables with the old implementation. + +To avoid running out of disk space, use IndexUpgradeTool to upgrade all tables with global indexes, and then restart all region servers as soon as possible. + + + +# PHOENIX 5.1.0 Release Notes + +These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements. + + +--- + +* [PHOENIX-6349](https://issues.apache.org/jira/browse/PHOENIX-6349) | *Major* | **Add and use commons-cli to phoenix-thirdparty** + +Added phoenix-shaded-commons-cli to phoenix-thirdparty. +This helps avoid classpath conflicts and includes a patch on top of commons-cli 1.4.0 that fixes CLI-254. + + +--- + +* [PHOENIX-6273](https://issues.apache.org/jira/browse/PHOENIX-6273) | *Major* | **Add support to handle MR Snapshot restore externally** + +Adds mapreduce configuration param "phoenix.mapreduce.external.snapshot.restore" which when set to true indicates that snapshot-based MapReduce jobs shouldn't try to restore the snapshot themselves, but assume an external application has already done so. + + +--- + +* [PHOENIX-6323](https://issues.apache.org/jira/browse/PHOENIX-6323) | *Blocker* | **isRawFilterSupported() returns true for HBase 2.2 compat module** + +When used with HBase 2.2, Phoenix now only support HBase 2.2.5 and later versions. (i.e HBase 2.2.0-2.2.4 are not supported) + + +--- + +* [PHOENIX-6326](https://issues.apache.org/jira/browse/PHOENIX-6326) | *Critical* | **Phoenix doesn't work with Java version 11.0.9.1 , due to Jetty problem** + +There is bug in the Jetty version used by HBase 2.3 and earlier, that causes incompatilbity with Java releases that have a four number version string like "11.0.9.1" +As Phoenix builds on top of HBase, Phoenix is also incompatible with these releases, when built with an hbase.profile older than 2.4. + + +--- + +* [PHOENIX-6307](https://issues.apache.org/jira/browse/PHOENIX-6307) | *Major* | **Build and release official binary distributions with each HBase profile** + +The phoenix-client and phoenix-server JARs have been renamed to include the supported HBase version. + +Instead of phoenix-client-\.jar, the client is now phoenix-client-hbase-\-\.jar +I.e. The Phoenix 4.16 client for Hbase 1.5 is now called phoenix-client-hbase-1.5-5.1.0.jar + +The maven coordinates also have also changed to "org.apache.phoenix:phoenix-client-hbase-\:\". +I.e the Phoenix 4.15.0 client for Hbase 1.5 is "org.apache.phoenix:phoenix-client:4.15.0-HBase-1.5", but the phoenix client for Phoenix 4.16 is "org.apache.phoenix:phoenix-client-hbase-1.5:4.16.0" + + +--- + +* [PHOENIX-5265](https://issues.apache.org/jira/browse/PHOENIX-5265) | *Major* | **[UMBRELLA] Phoenix Test should use object based Plan for result comparison instead of using hard-corded comparison** + +New API for Explain plan queries that can be used for comparison of individual plan attributes. + + +--- + +* [PHOENIX-6280](https://issues.apache.org/jira/browse/PHOENIX-6280) | *Major* | **Support HBase 2.4** + +HBase 2.4 is now supported. (Tested with HBase 2.4.0) + + +--- + +* [PHOENIX-6282](https://issues.apache.org/jira/browse/PHOENIX-6282) | *Major* | **Generate PB files inline with build and remove checked in files** + +We no longer have generated protobuf Java files available in source code. These files are expected to be generated inline with mvn build. We have also used an optimization with the plugin to ensure protoc is not invoked with mvn build if no .proto file is updated between two consecutive builds. + + +--- + +* [PHOENIX-6086](https://issues.apache.org/jira/b
svn commit: r46659 [2/3] - /dev/phoenix/phoenix-5.1.1RC2/
Added: dev/phoenix/phoenix-5.1.1RC2/CHANGES.md == --- dev/phoenix/phoenix-5.1.1RC2/CHANGES.md (added) +++ dev/phoenix/phoenix-5.1.1RC2/CHANGES.md Tue Mar 16 11:24:02 2021 @@ -0,0 +1,793 @@ + + +# PHOENIX Changelog + +## Release 5.1.1 - Unreleased (as of 2021-03-16) + + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6409](https://issues.apache.org/jira/browse/PHOENIX-6409) | Include local index uncovered columns merge in explain plan. | Minor | . | +| [PHOENIX-6385](https://issues.apache.org/jira/browse/PHOENIX-6385) | Not to use Scan#setSmall for HBase 2.x versions | Major | . | +| [PHOENIX-6402](https://issues.apache.org/jira/browse/PHOENIX-6402) | Allow using local indexes with uncovered columns in the WHERE clause | Blocker | . | +| [PHOENIX-6388](https://issues.apache.org/jira/browse/PHOENIX-6388) | Add sampled logging for read repairs | Minor | . | +| [PHOENIX-6396](https://issues.apache.org/jira/browse/PHOENIX-6396) | PChar illegal data exception should not contain value | Major | . | +| [PHOENIX-6380](https://issues.apache.org/jira/browse/PHOENIX-6380) | phoenix-client-embedded depends on logging classes | Major | core | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6400](https://issues.apache.org/jira/browse/PHOENIX-6400) | Do no use local index with uncovered columns in the WHERE clause. | Blocker | . | +| [PHOENIX-6386](https://issues.apache.org/jira/browse/PHOENIX-6386) | Bulkload generates unverified index rows | Major | core | +| [PHOENIX-6343](https://issues.apache.org/jira/browse/PHOENIX-6343) | Phoenix allows duplicate column names when one of them is a primary key | Major | core | +| [PHOENIX-5250](https://issues.apache.org/jira/browse/PHOENIX-5250) | The accumulated wal files can't be cleaned | Blocker | . | +| [PHOENIX-6382](https://issues.apache.org/jira/browse/PHOENIX-6382) | Shaded artifact names and descriptions have unresolved ${hbase.profile} strings | Major | core | +| [PHOENIX-6377](https://issues.apache.org/jira/browse/PHOENIX-6377) | phoenix-client has erronous maven dependecies | Critical | core | +| [PHOENIX-5440](https://issues.apache.org/jira/browse/PHOENIX-5440) | multiple warnings when building phoenix | Minor | . | + + +### SUB-TASKS: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6408](https://issues.apache.org/jira/browse/PHOENIX-6408) | LIMIT on local index query with uncovered columns in the WHERE returns wrong result. | Major | . | + + +### OTHER: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6394](https://issues.apache.org/jira/browse/PHOENIX-6394) | PostCommit Jenkins job detects incorrect HBase profile to rebuild with 2.3 and 2.4 | Major | . | +| [PHOENIX-6359](https://issues.apache.org/jira/browse/PHOENIX-6359) | New module to support HBase 2.4.1+ releases | Major | . | + + + +## Release 5.1.0 - Unreleased (as of 2021-02-05) + + + +### IMPORTANT ISSUES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-5265](https://issues.apache.org/jira/browse/PHOENIX-5265) | [UMBRELLA] Phoenix Test should use object based Plan for result comparison instead of using hard-corded comparison | Major | . | +| [PHOENIX-4412](https://issues.apache.org/jira/browse/PHOENIX-4412) | Tephra transaction context visibility level returns null instead of SNAPSHOT\_ALL | Critical | . | +| [PHOENIX-5446](https://issues.apache.org/jira/browse/PHOENIX-5446) | Support Protobuf shaded clients (thin + thick) | Major | . | +| [PHOENIX-4866](https://issues.apache.org/jira/browse/PHOENIX-4866) | UDFs get error: org.apache.phoenix.schema.FunctionNotFoundException: ERROR 6001 (42F01): Function undefined | Blocker | . | +| [PHOENIX-3655](https://issues.apache.org/jira/browse/PHOENIX-3655) | Global Phoenix Client Metrics for PQS | Major | . | + + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [PHOENIX-6213](https://issues.apache.org/jira/browse/PHOENIX-6213) | Extend Cell Tags to Delete object. | Major | . | +| [PHOENIX-6280](https://issues.apache.org/jira/browse/PHOENIX-6280) | Support HBase 2.4 | Major | core | +| [PHOENIX-6186](https://issues.apache.org/jira/browse/PHOENIX-6186) | Store table metadata last modified timestamp in PTable / System.Catalog | Major | . | +| [PHOENIX-5628](https://issues.apache.org/jira/browse/PHOENIX-5628) | Phoenix Function to Return HBase Row Key of Column Cell | Major | . | +| [PHOENIX-3547](https://issues.apache.org/jira/browse/PHOENIX-3547) | Promote CATALOG.VIEW\_INDEX\_ID to an int | Blocker | . | +| [PHOENIX-5426](https://issues.apache.org/jira/browse/PHOENIX-5426) | IndexUpgradeTestTool lacks an Apache License | Blocker | . | +| [PHOENIX-5
[phoenix] branch master updated (7bfe5d7 -> e4ea2c5)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git. from 7bfe5d7 PHOENIX-6418 : Bump default HBase version on 2.4 profile to 2.4.2 (#1169) new ff590a9 PHOENIX-6419 Unused getResolverForQuery() in QueryCompiler.verifySCN() new e4ea2c5 PHOENIX-6422 Remove CorrelatePlan The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../org/apache/phoenix/compile/QueryCompiler.java | 2 - .../org/apache/phoenix/execute/CorrelatePlan.java | 265 -- .../execute/visitor/AvgRowWidthVisitor.java| 6 - .../phoenix/execute/visitor/ByteCountVisitor.java | 6 - .../phoenix/execute/visitor/QueryPlanVisitor.java | 1 - .../phoenix/execute/visitor/RowCountVisitor.java | 11 - .../apache/phoenix/compile/QueryCompilerTest.java | 6 - .../apache/phoenix/execute/CorrelatePlanTest.java | 299 - 8 files changed, 596 deletions(-) delete mode 100644 phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java delete mode 100644 phoenix-core/src/test/java/org/apache/phoenix/execute/CorrelatePlanTest.java
[phoenix] 02/02: PHOENIX-6422 Remove CorrelatePlan
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git commit e4ea2c547d3093e7f6538e3cb2f7ea351ce4402a Author: Istvan Toth AuthorDate: Fri Mar 19 09:42:32 2021 +0100 PHOENIX-6422 Remove CorrelatePlan --- .../org/apache/phoenix/execute/CorrelatePlan.java | 265 -- .../execute/visitor/AvgRowWidthVisitor.java| 6 - .../phoenix/execute/visitor/ByteCountVisitor.java | 6 - .../phoenix/execute/visitor/QueryPlanVisitor.java | 1 - .../phoenix/execute/visitor/RowCountVisitor.java | 11 - .../apache/phoenix/compile/QueryCompilerTest.java | 6 - .../apache/phoenix/execute/CorrelatePlanTest.java | 299 - 7 files changed, 594 deletions(-) diff --git a/phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java b/phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java deleted file mode 100644 index 991ac5b..000 --- a/phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java +++ /dev/null @@ -1,265 +0,0 @@ -/* - * Licensed to the Apache Software Foundation (ASF) under one - * or more contributor license agreements. See the NOTICE file - * distributed with this work for additional information - * regarding copyright ownership. The ASF licenses this file - * to you under the Apache License, Version 2.0 (the - * "License"); you may not use this file except in compliance - * with the License. You may obtain a copy of the License at - * - * http://www.apache.org/licenses/LICENSE-2.0 - * - * Unless required by applicable law or agreed to in writing, software - * distributed under the License is distributed on an "AS IS" BASIS, - * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - * See the License for the specific language governing permissions and - * limitations under the License. - */ -package org.apache.phoenix.execute; - -import java.io.IOException; -import java.sql.SQLException; -import java.util.List; - -import org.apache.hadoop.hbase.client.Scan; -import org.apache.hadoop.hbase.io.ImmutableBytesWritable; -import org.apache.phoenix.compile.ExplainPlan; -import org.apache.phoenix.compile.ExplainPlanAttributes; -import org.apache.phoenix.compile.ExplainPlanAttributes -.ExplainPlanAttributesBuilder; -import org.apache.phoenix.compile.QueryPlan; -import org.apache.phoenix.exception.SQLExceptionCode; -import org.apache.phoenix.exception.SQLExceptionInfo; -import org.apache.phoenix.execute.TupleProjector.ProjectedValueTuple; -import org.apache.phoenix.execute.visitor.ByteCountVisitor; -import org.apache.phoenix.execute.visitor.RowCountVisitor; -import org.apache.phoenix.execute.visitor.QueryPlanVisitor; -import org.apache.phoenix.iterate.ParallelScanGrouper; -import org.apache.phoenix.iterate.ResultIterator; -import org.apache.phoenix.optimize.Cost; -import org.apache.phoenix.parse.JoinTableNode.JoinType; -import org.apache.phoenix.schema.KeyValueSchema; -import org.apache.phoenix.schema.PColumn; -import org.apache.phoenix.schema.PTable; -import org.apache.phoenix.schema.ValueBitSet; -import org.apache.phoenix.schema.KeyValueSchema.KeyValueSchemaBuilder; -import org.apache.phoenix.schema.tuple.Tuple; -import org.apache.phoenix.util.SchemaUtil; - -import org.apache.phoenix.thirdparty.com.google.common.collect.Lists; - -public class CorrelatePlan extends DelegateQueryPlan { -private final QueryPlan rhs; -private final String variableId; -private final JoinType joinType; -private final boolean isSingleValueOnly; -private final RuntimeContext runtimeContext; -private final KeyValueSchema joinedSchema; -private final KeyValueSchema lhsSchema; -private final KeyValueSchema rhsSchema; -private final int rhsFieldPosition; - - -public CorrelatePlan(QueryPlan lhs, QueryPlan rhs, String variableId, -JoinType joinType, boolean isSingleValueOnly, -RuntimeContext runtimeContext, PTable joinedTable, -PTable lhsTable, PTable rhsTable, int rhsFieldPosition) { -super(lhs); -if (joinType != JoinType.Inner && joinType != JoinType.Left && joinType != JoinType.Semi && joinType != JoinType.Anti) -throw new IllegalArgumentException("Unsupported join type '" + joinType + "' by CorrelatePlan"); - -this.rhs = rhs; -this.variableId = variableId; -this.joinType = joinType; -this.isSingleValueOnly = isSingleValueOnly; -this.runtimeContext = runtimeContext; -this.joinedSchema = buildSchema(joinedTable); -this.lhsSchema = buildSchema(lhsTable); -this.rhsSchema = buildSchema(rhsTable); -this.rhsFieldPosition = rhsFieldPosition; -} - -private static KeyValueSchema buildSchema(PTable table) { -KeyValueSchema
[phoenix] 01/02: PHOENIX-6419 Unused getResolverForQuery() in QueryCompiler.verifySCN()
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git commit ff590a9781bb589fa74acbe1e04978a50e23051e Author: Istvan Toth AuthorDate: Fri Mar 19 09:59:42 2021 +0100 PHOENIX-6419 Unused getResolverForQuery() in QueryCompiler.verifySCN() --- .../src/main/java/org/apache/phoenix/compile/QueryCompiler.java | 2 -- 1 file changed, 2 deletions(-) diff --git a/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java b/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java index 2338367..67edb6d 100644 --- a/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java +++ b/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java @@ -194,8 +194,6 @@ public class QueryCompiler { if (scn == null) { return; } -ColumnResolver resolver = -FromCompiler.getResolverForQuery(select, conn); long maxLookBackAgeInMillis = CompatBaseScannerRegionObserver.getMaxLookbackInMillis(conn.getQueryServices(). getConfiguration());
[phoenix] 02/02: PHOENIX-6422 Remove CorrelatePlan
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git commit 0586d226d412721076540d13726a1be4d8eb9105 Author: Istvan Toth AuthorDate: Fri Mar 19 09:42:32 2021 +0100 PHOENIX-6422 Remove CorrelatePlan --- .../org/apache/phoenix/execute/CorrelatePlan.java | 265 -- .../execute/visitor/AvgRowWidthVisitor.java| 6 - .../phoenix/execute/visitor/ByteCountVisitor.java | 6 - .../phoenix/execute/visitor/QueryPlanVisitor.java | 1 - .../phoenix/execute/visitor/RowCountVisitor.java | 11 - .../apache/phoenix/compile/QueryCompilerTest.java | 6 - .../apache/phoenix/execute/CorrelatePlanTest.java | 299 - 7 files changed, 594 deletions(-) diff --git a/phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java b/phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java deleted file mode 100644 index 991ac5b..000 --- a/phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java +++ /dev/null @@ -1,265 +0,0 @@ -/* - * Licensed to the Apache Software Foundation (ASF) under one - * or more contributor license agreements. See the NOTICE file - * distributed with this work for additional information - * regarding copyright ownership. The ASF licenses this file - * to you under the Apache License, Version 2.0 (the - * "License"); you may not use this file except in compliance - * with the License. You may obtain a copy of the License at - * - * http://www.apache.org/licenses/LICENSE-2.0 - * - * Unless required by applicable law or agreed to in writing, software - * distributed under the License is distributed on an "AS IS" BASIS, - * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - * See the License for the specific language governing permissions and - * limitations under the License. - */ -package org.apache.phoenix.execute; - -import java.io.IOException; -import java.sql.SQLException; -import java.util.List; - -import org.apache.hadoop.hbase.client.Scan; -import org.apache.hadoop.hbase.io.ImmutableBytesWritable; -import org.apache.phoenix.compile.ExplainPlan; -import org.apache.phoenix.compile.ExplainPlanAttributes; -import org.apache.phoenix.compile.ExplainPlanAttributes -.ExplainPlanAttributesBuilder; -import org.apache.phoenix.compile.QueryPlan; -import org.apache.phoenix.exception.SQLExceptionCode; -import org.apache.phoenix.exception.SQLExceptionInfo; -import org.apache.phoenix.execute.TupleProjector.ProjectedValueTuple; -import org.apache.phoenix.execute.visitor.ByteCountVisitor; -import org.apache.phoenix.execute.visitor.RowCountVisitor; -import org.apache.phoenix.execute.visitor.QueryPlanVisitor; -import org.apache.phoenix.iterate.ParallelScanGrouper; -import org.apache.phoenix.iterate.ResultIterator; -import org.apache.phoenix.optimize.Cost; -import org.apache.phoenix.parse.JoinTableNode.JoinType; -import org.apache.phoenix.schema.KeyValueSchema; -import org.apache.phoenix.schema.PColumn; -import org.apache.phoenix.schema.PTable; -import org.apache.phoenix.schema.ValueBitSet; -import org.apache.phoenix.schema.KeyValueSchema.KeyValueSchemaBuilder; -import org.apache.phoenix.schema.tuple.Tuple; -import org.apache.phoenix.util.SchemaUtil; - -import org.apache.phoenix.thirdparty.com.google.common.collect.Lists; - -public class CorrelatePlan extends DelegateQueryPlan { -private final QueryPlan rhs; -private final String variableId; -private final JoinType joinType; -private final boolean isSingleValueOnly; -private final RuntimeContext runtimeContext; -private final KeyValueSchema joinedSchema; -private final KeyValueSchema lhsSchema; -private final KeyValueSchema rhsSchema; -private final int rhsFieldPosition; - - -public CorrelatePlan(QueryPlan lhs, QueryPlan rhs, String variableId, -JoinType joinType, boolean isSingleValueOnly, -RuntimeContext runtimeContext, PTable joinedTable, -PTable lhsTable, PTable rhsTable, int rhsFieldPosition) { -super(lhs); -if (joinType != JoinType.Inner && joinType != JoinType.Left && joinType != JoinType.Semi && joinType != JoinType.Anti) -throw new IllegalArgumentException("Unsupported join type '" + joinType + "' by CorrelatePlan"); - -this.rhs = rhs; -this.variableId = variableId; -this.joinType = joinType; -this.isSingleValueOnly = isSingleValueOnly; -this.runtimeContext = runtimeContext; -this.joinedSchema = buildSchema(joinedTable); -this.lhsSchema = buildSchema(lhsTable); -this.rhsSchema = buildSchema(rhsTable); -this.rhsFieldPosition = rhsFieldPosition; -} - -private static KeyValueSchema buildSchema(PTable table) { -KeyValueSchema
[phoenix] 01/02: PHOENIX-6419 Unused getResolverForQuery() in QueryCompiler.verifySCN()
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git commit 7e43c311e4b69e86ed75945c87997cb5d12dd09c Author: Istvan Toth AuthorDate: Fri Mar 19 09:59:42 2021 +0100 PHOENIX-6419 Unused getResolverForQuery() in QueryCompiler.verifySCN() --- .../src/main/java/org/apache/phoenix/compile/QueryCompiler.java | 2 -- 1 file changed, 2 deletions(-) diff --git a/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java b/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java index 2338367..67edb6d 100644 --- a/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java +++ b/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java @@ -194,8 +194,6 @@ public class QueryCompiler { if (scn == null) { return; } -ColumnResolver resolver = -FromCompiler.getResolverForQuery(select, conn); long maxLookBackAgeInMillis = CompatBaseScannerRegionObserver.getMaxLookbackInMillis(conn.getQueryServices(). getConfiguration());
[phoenix] branch 5.1 updated (00487ab -> 0586d22)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git. from 00487ab PHOENIX-6418 : Bump default HBase version on 2.4 profile to 2.4.2 (#1169) new 7e43c31 PHOENIX-6419 Unused getResolverForQuery() in QueryCompiler.verifySCN() new 0586d22 PHOENIX-6422 Remove CorrelatePlan The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../org/apache/phoenix/compile/QueryCompiler.java | 2 - .../org/apache/phoenix/execute/CorrelatePlan.java | 265 -- .../execute/visitor/AvgRowWidthVisitor.java| 6 - .../phoenix/execute/visitor/ByteCountVisitor.java | 6 - .../phoenix/execute/visitor/QueryPlanVisitor.java | 1 - .../phoenix/execute/visitor/RowCountVisitor.java | 11 - .../apache/phoenix/compile/QueryCompilerTest.java | 6 - .../apache/phoenix/execute/CorrelatePlanTest.java | 299 - 8 files changed, 596 deletions(-) delete mode 100644 phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java delete mode 100644 phoenix-core/src/test/java/org/apache/phoenix/execute/CorrelatePlanTest.java
[phoenix] branch 4.x updated (e6d7d0b -> c22ec3f)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git. from e6d7d0b PHOENIX-6409 : Test with new Explain API for local index uncovered columns merge (ADDENDUM) new 42b7fda PHOENIX-6419 Unused getResolverForQuery() in QueryCompiler.verifySCN() new c22ec3f PHOENIX-6422 Remove CorrelatePlan The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../org/apache/phoenix/compile/QueryCompiler.java | 2 - .../org/apache/phoenix/execute/CorrelatePlan.java | 265 -- .../execute/visitor/AvgRowWidthVisitor.java| 6 - .../phoenix/execute/visitor/ByteCountVisitor.java | 6 - .../phoenix/execute/visitor/QueryPlanVisitor.java | 1 - .../phoenix/execute/visitor/RowCountVisitor.java | 11 - .../apache/phoenix/compile/QueryCompilerTest.java | 6 - .../apache/phoenix/execute/CorrelatePlanTest.java | 299 - 8 files changed, 596 deletions(-) delete mode 100644 phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java delete mode 100644 phoenix-core/src/test/java/org/apache/phoenix/execute/CorrelatePlanTest.java
[phoenix] 01/02: PHOENIX-6419 Unused getResolverForQuery() in QueryCompiler.verifySCN()
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git commit 42b7fda4448f3e604b6e0693ed715927b5c426bc Author: Istvan Toth AuthorDate: Fri Mar 19 10:06:52 2021 +0100 PHOENIX-6419 Unused getResolverForQuery() in QueryCompiler.verifySCN() --- .../src/main/java/org/apache/phoenix/compile/QueryCompiler.java | 2 -- 1 file changed, 2 deletions(-) diff --git a/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java b/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java index 472b581..4042cc2 100644 --- a/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java +++ b/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java @@ -180,8 +180,6 @@ public class QueryCompiler { if (scn == null) { return; } -ColumnResolver resolver = -FromCompiler.getResolverForQuery(select, conn); int maxLookBackAge = conn.getQueryServices(). getConfiguration().getInt(ScanInfoUtil.PHOENIX_MAX_LOOKBACK_AGE_CONF_KEY, ScanInfoUtil.DEFAULT_PHOENIX_MAX_LOOKBACK_AGE);
[phoenix] 02/02: PHOENIX-6422 Remove CorrelatePlan
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git commit c22ec3f8edbfd1570abfa6e9395dc8bdfcc682ef Author: Istvan Toth AuthorDate: Fri Mar 19 09:54:45 2021 +0100 PHOENIX-6422 Remove CorrelatePlan --- .../org/apache/phoenix/execute/CorrelatePlan.java | 265 -- .../execute/visitor/AvgRowWidthVisitor.java| 6 - .../phoenix/execute/visitor/ByteCountVisitor.java | 6 - .../phoenix/execute/visitor/QueryPlanVisitor.java | 1 - .../phoenix/execute/visitor/RowCountVisitor.java | 11 - .../apache/phoenix/compile/QueryCompilerTest.java | 6 - .../apache/phoenix/execute/CorrelatePlanTest.java | 299 - 7 files changed, 594 deletions(-) diff --git a/phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java b/phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java deleted file mode 100644 index 6d9afd6..000 --- a/phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java +++ /dev/null @@ -1,265 +0,0 @@ -/* - * Licensed to the Apache Software Foundation (ASF) under one - * or more contributor license agreements. See the NOTICE file - * distributed with this work for additional information - * regarding copyright ownership. The ASF licenses this file - * to you under the Apache License, Version 2.0 (the - * "License"); you may not use this file except in compliance - * with the License. You may obtain a copy of the License at - * - * http://www.apache.org/licenses/LICENSE-2.0 - * - * Unless required by applicable law or agreed to in writing, software - * distributed under the License is distributed on an "AS IS" BASIS, - * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - * See the License for the specific language governing permissions and - * limitations under the License. - */ -package org.apache.phoenix.execute; - -import java.io.IOException; -import java.sql.SQLException; -import java.util.List; - -import org.apache.hadoop.hbase.client.Scan; -import org.apache.hadoop.hbase.io.ImmutableBytesWritable; -import org.apache.phoenix.compile.ExplainPlan; -import org.apache.phoenix.compile.ExplainPlanAttributes; -import org.apache.phoenix.compile.ExplainPlanAttributes -.ExplainPlanAttributesBuilder; -import org.apache.phoenix.compile.QueryPlan; -import org.apache.phoenix.exception.SQLExceptionCode; -import org.apache.phoenix.exception.SQLExceptionInfo; -import org.apache.phoenix.execute.TupleProjector.ProjectedValueTuple; -import org.apache.phoenix.execute.visitor.ByteCountVisitor; -import org.apache.phoenix.execute.visitor.RowCountVisitor; -import org.apache.phoenix.execute.visitor.QueryPlanVisitor; -import org.apache.phoenix.iterate.ParallelScanGrouper; -import org.apache.phoenix.iterate.ResultIterator; -import org.apache.phoenix.optimize.Cost; -import org.apache.phoenix.parse.JoinTableNode.JoinType; -import org.apache.phoenix.schema.KeyValueSchema; -import org.apache.phoenix.schema.PColumn; -import org.apache.phoenix.schema.PTable; -import org.apache.phoenix.schema.ValueBitSet; -import org.apache.phoenix.schema.KeyValueSchema.KeyValueSchemaBuilder; -import org.apache.phoenix.schema.tuple.Tuple; -import org.apache.phoenix.util.SchemaUtil; - -import com.google.common.collect.Lists; - -public class CorrelatePlan extends DelegateQueryPlan { -private final QueryPlan rhs; -private final String variableId; -private final JoinType joinType; -private final boolean isSingleValueOnly; -private final RuntimeContext runtimeContext; -private final KeyValueSchema joinedSchema; -private final KeyValueSchema lhsSchema; -private final KeyValueSchema rhsSchema; -private final int rhsFieldPosition; - - -public CorrelatePlan(QueryPlan lhs, QueryPlan rhs, String variableId, -JoinType joinType, boolean isSingleValueOnly, -RuntimeContext runtimeContext, PTable joinedTable, -PTable lhsTable, PTable rhsTable, int rhsFieldPosition) { -super(lhs); -if (joinType != JoinType.Inner && joinType != JoinType.Left && joinType != JoinType.Semi && joinType != JoinType.Anti) -throw new IllegalArgumentException("Unsupported join type '" + joinType + "' by CorrelatePlan"); - -this.rhs = rhs; -this.variableId = variableId; -this.joinType = joinType; -this.isSingleValueOnly = isSingleValueOnly; -this.runtimeContext = runtimeContext; -this.joinedSchema = buildSchema(joinedTable); -this.lhsSchema = buildSchema(lhsTable); -this.rhsSchema = buildSchema(rhsTable); -this.rhsFieldPosition = rhsFieldPosition; -} - -private static KeyValueSchema buildSchema(PTable table) { -KeyValueSchemaBuilder builder = new KeyValueSchema
[phoenix-omid] branch master updated: OMID-202 Refactor Omid to use Netty 4
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-omid.git The following commit(s) were added to refs/heads/master by this push: new 18ef57d OMID-202 Refactor Omid to use Netty 4 18ef57d is described below commit 18ef57d4ec23d96f0ff7dbebec399d838c6c7566 Author: Istvan Toth AuthorDate: Fri Mar 12 11:23:00 2021 +0100 OMID-202 Refactor Omid to use Netty 4 --- pom.xml| 2 +- transaction-client/pom.xml | 4 +- .../java/org/apache/omid/tso/client/TSOClient.java | 143 +++--- tso-server/pom.xml | 4 +- .../apache/omid/tso/AbstractRequestProcessor.java | 2 +- .../src/main/java/org/apache/omid/tso/Batch.java | 2 +- .../java/org/apache/omid/tso/PersistEvent.java | 2 +- .../org/apache/omid/tso/PersistenceProcessor.java | 2 +- .../apache/omid/tso/PersistenceProcessorImpl.java | 2 +- .../omid/tso/PersitenceProcessorNullImpl.java | 2 +- .../java/org/apache/omid/tso/ReplyProcessor.java | 2 +- .../org/apache/omid/tso/ReplyProcessorImpl.java| 10 +- .../java/org/apache/omid/tso/RequestProcessor.java | 2 +- .../apache/omid/tso/RequestProcessorPersistCT.java | 2 +- .../apache/omid/tso/RequestProcessorSkipCT.java| 2 +- .../java/org/apache/omid/tso/RetryProcessor.java | 2 +- .../org/apache/omid/tso/RetryProcessorImpl.java| 2 +- .../org/apache/omid/tso/TSOChannelHandler.java | 211 ++--- .../org/apache/omid/tso/ProgrammableTSOServer.java | 112 ++- .../test/java/org/apache/omid/tso/TestBatch.java | 2 +- .../apache/omid/tso/TestPersistenceProcessor.java | 2 +- .../omid/tso/TestPersistenceProcessorHandler.java | 2 +- .../org/apache/omid/tso/TestReplyProcessor.java| 2 +- .../org/apache/omid/tso/TestRequestProcessor.java | 2 +- .../org/apache/omid/tso/TestRetryProcessor.java| 2 +- .../omid/tso/TestTSOChannelHandlerNetty.java | 157 --- .../org/apache/omid/tso/client/TSOClientRaw.java | 106 ++- 27 files changed, 402 insertions(+), 383 deletions(-) diff --git a/pom.xml b/pom.xml index fea3247..0447d9b 100644 --- a/pom.xml +++ b/pom.xml @@ -175,7 +175,7 @@ 6.10 1.7.7 1.2.17 -3.10.6.Final +4.1.60.Final 2.5.0 0.6.1 1.6.2 diff --git a/transaction-client/pom.xml b/transaction-client/pom.xml index ef79107..43989b2 100644 --- a/transaction-client/pom.xml +++ b/transaction-client/pom.xml @@ -69,8 +69,8 @@ io.netty -netty -${netty.version} +netty-all +${netty4.version} diff --git a/transaction-client/src/main/java/org/apache/omid/tso/client/TSOClient.java b/transaction-client/src/main/java/org/apache/omid/tso/client/TSOClient.java index 43eaaa6..172d5eb 100644 --- a/transaction-client/src/main/java/org/apache/omid/tso/client/TSOClient.java +++ b/transaction-client/src/main/java/org/apache/omid/tso/client/TSOClient.java @@ -30,25 +30,26 @@ import org.apache.curator.framework.CuratorFramework; import org.apache.curator.framework.recipes.cache.ChildData; import org.apache.curator.framework.recipes.cache.NodeCache; import org.apache.curator.framework.recipes.cache.NodeCacheListener; -import org.jboss.netty.bootstrap.ClientBootstrap; -import org.jboss.netty.channel.Channel; -import org.jboss.netty.channel.ChannelFactory; -import org.jboss.netty.channel.ChannelFuture; -import org.jboss.netty.channel.ChannelFutureListener; -import org.jboss.netty.channel.ChannelHandlerContext; -import org.jboss.netty.channel.ChannelPipeline; -import org.jboss.netty.channel.ChannelStateEvent; -import org.jboss.netty.channel.ExceptionEvent; -import org.jboss.netty.channel.MessageEvent; -import org.jboss.netty.channel.SimpleChannelHandler; -import org.jboss.netty.channel.socket.nio.NioClientSocketChannelFactory; -import org.jboss.netty.handler.codec.frame.LengthFieldBasedFrameDecoder; -import org.jboss.netty.handler.codec.frame.LengthFieldPrepender; -import org.jboss.netty.handler.codec.protobuf.ProtobufDecoder; -import org.jboss.netty.handler.codec.protobuf.ProtobufEncoder; -import org.jboss.netty.util.HashedWheelTimer; -import org.jboss.netty.util.Timeout; -import org.jboss.netty.util.TimerTask; +import io.netty.bootstrap.Bootstrap; +import io.netty.channel.Channel; +import io.netty.channel.ChannelFuture; +import io.netty.channel.ChannelFutureListener; +import io.netty.channel.ChannelHandlerContext; +import io.netty.channel.ChannelInboundHandlerAdapter; +import io.netty.channel.ChannelInitializer; +import io.netty.channel.ChannelOption; +import io.netty.channel.ChannelPipeline; +import io.netty.channel.EventLoopGroup; +import io.netty.channel.nio.NioEventLoopGroup; +import
[phoenix] branch master updated: PHOENIX-6427 Create sequence fails in lowercase schema
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new f9532bd PHOENIX-6427 Create sequence fails in lowercase schema f9532bd is described below commit f9532bd4a199bc17af75185d5a7545b745e6c88c Author: Istvan Toth AuthorDate: Wed Mar 24 15:59:28 2021 +0100 PHOENIX-6427 Create sequence fails in lowercase schema --- .../apache/phoenix/end2end/BasePermissionsIT.java | 61 ++ .../org/apache/phoenix/end2end/SequenceIT.java | 29 ++ .../org/apache/phoenix/compile/FromCompiler.java | 2 +- 3 files changed, 91 insertions(+), 1 deletion(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java index 2be1551..5fdb89c 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java @@ -1062,6 +1062,67 @@ public abstract class BasePermissionsIT extends BaseTest { } /** + * Test to verify READ permissions on table, indexes and views + * Tests automatic grant revoke of permissions per user on a table + */ +@Test +public void testReadPermsOnTableIndexAndViewOnLowerCaseSchema() throws Exception { +grantSystemTableAccess(superUser1, regularUser1, regularUser2, unprivilegedUser); + +schemaName = "\"" + schemaName.toLowerCase() + "\""; +fullTableName = schemaName + "." + tableName; + +// Create new schema and grant CREATE permissions to a user +if(isNamespaceMapped) { +verifyAllowed(createSchema(schemaName), superUser1); +verifyAllowed(grantPermissions("C", regularUser1, schemaName, true), superUser1); +} else { +verifyAllowed(grantPermissions("C", regularUser1, surroundWithDoubleQuotes(QueryConstants.HBASE_DEFAULT_SCHEMA_NAME), true), superUser1); +} + +// Create new table. Create indexes, views and view indexes on top of it. Verify the contents by querying it +verifyAllowed(createTable(fullTableName), regularUser1); +verifyAllowed(readTable(fullTableName), regularUser1); +verifyAllowed(createIndex(idx1TableName, fullTableName), regularUser1); +verifyAllowed(createIndex(idx2TableName, fullTableName), regularUser1); +verifyAllowed(createLocalIndex(localIdx1TableName, fullTableName), regularUser1); +verifyAllowed(createView(view1TableName, fullTableName), regularUser1); +verifyAllowed(createIndex(idx3TableName, view1TableName), regularUser1); + +// RegularUser2 doesn't have any permissions. It can get a PhoenixConnection +// However it cannot query table, indexes or views without READ perms +verifyAllowed(getConnectionAction(), regularUser2); +verifyDenied(readTable(fullTableName), AccessDeniedException.class, regularUser2); +verifyDenied(readTable(fullTableName, idx1TableName), AccessDeniedException.class, regularUser2); +verifyDenied(readTable(view1TableName), AccessDeniedException.class, regularUser2); +verifyDenied(readTableWithoutVerification(schemaName + "." + idx1TableName), AccessDeniedException.class, regularUser2); + +// Grant READ permissions to RegularUser2 on the table +// Permissions should propagate automatically to relevant physical tables such as global index and view index. +verifyAllowed(grantPermissions("RX", regularUser2, fullTableName, false), regularUser1); +// Granting permissions directly to index tables should fail +verifyDenied(grantPermissions("W", regularUser2, schemaName + "." + idx1TableName, false), AccessDeniedException.class, regularUser1); +// Granting permissions directly to views should fail. We expect TableNotFoundException since VIEWS are not physical tables +verifyDenied(grantPermissions("W", regularUser2, schemaName + "." + view1TableName, false), TableNotFoundException.class, regularUser1); + +// Verify that all other access are successful now +verifyAllowed(readTable(fullTableName), regularUser2); +verifyAllowed(readTable(fullTableName, idx1TableName), regularUser2); +verifyAllowed(readTable(fullTableName, idx2TableName), regularUser2); +verifyAllowed(readTable(fullTableName, localIdx1TableName), regularUser2); +verifyAllowed(readTableWithoutVerification(schemaName + "." + idx1TableName), regularUser2); +verifyAllowed(readTable(view1TableName), regularUser2); +verifyAllowed(readMultiTenantTableWithIndex(view1TableName), r
[phoenix] branch 5.1 updated: PHOENIX-6427 Create sequence fails in lowercase schema
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new c73257a PHOENIX-6427 Create sequence fails in lowercase schema c73257a is described below commit c73257aa58db56c74e246c02491cb0c8d421c1b3 Author: Istvan Toth AuthorDate: Wed Mar 24 15:59:28 2021 +0100 PHOENIX-6427 Create sequence fails in lowercase schema --- .../apache/phoenix/end2end/BasePermissionsIT.java | 61 ++ .../org/apache/phoenix/end2end/SequenceIT.java | 29 ++ .../org/apache/phoenix/compile/FromCompiler.java | 2 +- 3 files changed, 91 insertions(+), 1 deletion(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java index 2be1551..5fdb89c 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java @@ -1062,6 +1062,67 @@ public abstract class BasePermissionsIT extends BaseTest { } /** + * Test to verify READ permissions on table, indexes and views + * Tests automatic grant revoke of permissions per user on a table + */ +@Test +public void testReadPermsOnTableIndexAndViewOnLowerCaseSchema() throws Exception { +grantSystemTableAccess(superUser1, regularUser1, regularUser2, unprivilegedUser); + +schemaName = "\"" + schemaName.toLowerCase() + "\""; +fullTableName = schemaName + "." + tableName; + +// Create new schema and grant CREATE permissions to a user +if(isNamespaceMapped) { +verifyAllowed(createSchema(schemaName), superUser1); +verifyAllowed(grantPermissions("C", regularUser1, schemaName, true), superUser1); +} else { +verifyAllowed(grantPermissions("C", regularUser1, surroundWithDoubleQuotes(QueryConstants.HBASE_DEFAULT_SCHEMA_NAME), true), superUser1); +} + +// Create new table. Create indexes, views and view indexes on top of it. Verify the contents by querying it +verifyAllowed(createTable(fullTableName), regularUser1); +verifyAllowed(readTable(fullTableName), regularUser1); +verifyAllowed(createIndex(idx1TableName, fullTableName), regularUser1); +verifyAllowed(createIndex(idx2TableName, fullTableName), regularUser1); +verifyAllowed(createLocalIndex(localIdx1TableName, fullTableName), regularUser1); +verifyAllowed(createView(view1TableName, fullTableName), regularUser1); +verifyAllowed(createIndex(idx3TableName, view1TableName), regularUser1); + +// RegularUser2 doesn't have any permissions. It can get a PhoenixConnection +// However it cannot query table, indexes or views without READ perms +verifyAllowed(getConnectionAction(), regularUser2); +verifyDenied(readTable(fullTableName), AccessDeniedException.class, regularUser2); +verifyDenied(readTable(fullTableName, idx1TableName), AccessDeniedException.class, regularUser2); +verifyDenied(readTable(view1TableName), AccessDeniedException.class, regularUser2); +verifyDenied(readTableWithoutVerification(schemaName + "." + idx1TableName), AccessDeniedException.class, regularUser2); + +// Grant READ permissions to RegularUser2 on the table +// Permissions should propagate automatically to relevant physical tables such as global index and view index. +verifyAllowed(grantPermissions("RX", regularUser2, fullTableName, false), regularUser1); +// Granting permissions directly to index tables should fail +verifyDenied(grantPermissions("W", regularUser2, schemaName + "." + idx1TableName, false), AccessDeniedException.class, regularUser1); +// Granting permissions directly to views should fail. We expect TableNotFoundException since VIEWS are not physical tables +verifyDenied(grantPermissions("W", regularUser2, schemaName + "." + view1TableName, false), TableNotFoundException.class, regularUser1); + +// Verify that all other access are successful now +verifyAllowed(readTable(fullTableName), regularUser2); +verifyAllowed(readTable(fullTableName, idx1TableName), regularUser2); +verifyAllowed(readTable(fullTableName, idx2TableName), regularUser2); +verifyAllowed(readTable(fullTableName, localIdx1TableName), regularUser2); +verifyAllowed(readTableWithoutVerification(schemaName + "." + idx1TableName), regularUser2); +verifyAllowed(readTable(view1TableName), regularUser2); +verifyAllowed(readMultiTenantTableWithIndex(view1TableName), regu
[phoenix] branch 4.x updated: PHOENIX-6427 Create sequence fails in lowercase schema
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/4.x by this push: new ee4ce9f PHOENIX-6427 Create sequence fails in lowercase schema ee4ce9f is described below commit ee4ce9fd4479be06634dd119f547508e46f7dd5e Author: Istvan Toth AuthorDate: Wed Mar 24 15:59:28 2021 +0100 PHOENIX-6427 Create sequence fails in lowercase schema --- .../apache/phoenix/end2end/BasePermissionsIT.java | 61 ++ .../org/apache/phoenix/end2end/SequenceIT.java | 29 ++ .../org/apache/phoenix/compile/FromCompiler.java | 2 +- 3 files changed, 91 insertions(+), 1 deletion(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java index 8f42040..2894f5a 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java @@ -1052,6 +1052,67 @@ public abstract class BasePermissionsIT extends BaseTest { } /** + * Test to verify READ permissions on table, indexes and views + * Tests automatic grant revoke of permissions per user on a table + */ +@Test +public void testReadPermsOnTableIndexAndViewOnLowerCaseSchema() throws Exception { +grantSystemTableAccess(superUser1, regularUser1, regularUser2, unprivilegedUser); + +schemaName = "\"" + schemaName.toLowerCase() + "\""; +fullTableName = schemaName + "." + tableName; + +// Create new schema and grant CREATE permissions to a user +if(isNamespaceMapped) { +verifyAllowed(createSchema(schemaName), superUser1); +verifyAllowed(grantPermissions("C", regularUser1, schemaName, true), superUser1); +} else { +verifyAllowed(grantPermissions("C", regularUser1, surroundWithDoubleQuotes(SchemaUtil.SCHEMA_FOR_DEFAULT_NAMESPACE), true), superUser1); +} + +// Create new table. Create indexes, views and view indexes on top of it. Verify the contents by querying it +verifyAllowed(createTable(fullTableName), regularUser1); +verifyAllowed(readTable(fullTableName), regularUser1); +verifyAllowed(createIndex(idx1TableName, fullTableName), regularUser1); +verifyAllowed(createIndex(idx2TableName, fullTableName), regularUser1); +verifyAllowed(createLocalIndex(localIdx1TableName, fullTableName), regularUser1); +verifyAllowed(createView(view1TableName, fullTableName), regularUser1); +verifyAllowed(createIndex(idx3TableName, view1TableName), regularUser1); + +// RegularUser2 doesn't have any permissions. It can get a PhoenixConnection +// However it cannot query table, indexes or views without READ perms +verifyAllowed(getConnectionAction(), regularUser2); +verifyDenied(readTable(fullTableName), AccessDeniedException.class, regularUser2); +verifyDenied(readTable(fullTableName, idx1TableName), AccessDeniedException.class, regularUser2); +verifyDenied(readTable(view1TableName), AccessDeniedException.class, regularUser2); +verifyDenied(readTableWithoutVerification(schemaName + "." + idx1TableName), AccessDeniedException.class, regularUser2); + +// Grant READ permissions to RegularUser2 on the table +// Permissions should propagate automatically to relevant physical tables such as global index and view index. +verifyAllowed(grantPermissions("RX", regularUser2, fullTableName, false), regularUser1); +// Granting permissions directly to index tables should fail +verifyDenied(grantPermissions("W", regularUser2, schemaName + "." + idx1TableName, false), AccessDeniedException.class, regularUser1); +// Granting permissions directly to views should fail. We expect TableNotFoundException since VIEWS are not physical tables +verifyDenied(grantPermissions("W", regularUser2, schemaName + "." + view1TableName, false), TableNotFoundException.class, regularUser1); + +// Verify that all other access are successful now +verifyAllowed(readTable(fullTableName), regularUser2); +verifyAllowed(readTable(fullTableName, idx1TableName), regularUser2); +verifyAllowed(readTable(fullTableName, idx2TableName), regularUser2); +verifyAllowed(readTable(fullTableName, localIdx1TableName), regularUser2); +verifyAllowed(readTableWithoutVerification(schemaName + "." + idx1TableName), regularUser2); +verifyAllowed(readTable(view1TableName), regularUser2); +verifyAllowed(readMultiTenantTableWithIndex(view1TableName), regu
svn commit: r46729 - /dev/phoenix/phoenix-5.1.1RC2/ /release/phoenix/phoenix-5.1.1/
Author: stoty Date: Thu Mar 25 05:38:08 2021 New Revision: 46729 Log: release Apache Phoenix 5.1.1RC2 as 5.1.1 Added: release/phoenix/phoenix-5.1.1/ - copied from r46728, dev/phoenix/phoenix-5.1.1RC2/ Removed: dev/phoenix/phoenix-5.1.1RC2/
[phoenix] annotated tag 5.1.1 created (now 0afe061)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to annotated tag 5.1.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git. at 0afe061 (tag) tagging fca58a7b8879367cafc95af4e9a36e7fd72e8569 (commit) replaces 5.1.0 by Istvan Toth on Thu Mar 25 06:39:34 2021 +0100 - Log - Phoenix 5.1.1 release --- No new revisions were added by this update.
[phoenix] branch 5.1 updated: Bump version to 5.1.2-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new c63569b Bump version to 5.1.2-SNAPSHOT c63569b is described below commit c63569bc0f7747953875b3290ae93f3ae8089b45 Author: Istvan Toth AuthorDate: Thu Mar 25 07:13:37 2021 +0100 Bump version to 5.1.2-SNAPSHOT --- phoenix-assembly/pom.xml | 2 +- phoenix-client-parent/phoenix-client-embedded/pom.xml | 2 +- phoenix-client-parent/phoenix-client/pom.xml | 2 +- phoenix-client-parent/pom.xml | 2 +- phoenix-core/pom.xml | 2 +- phoenix-hbase-compat-2.1.6/pom.xml| 2 +- phoenix-hbase-compat-2.2.5/pom.xml| 2 +- phoenix-hbase-compat-2.3.0/pom.xml| 2 +- phoenix-hbase-compat-2.4.0/pom.xml| 2 +- phoenix-hbase-compat-2.4.1/pom.xml| 2 +- phoenix-pherf/pom.xml | 2 +- phoenix-server/pom.xml| 2 +- phoenix-tools/pom.xml | 2 +- phoenix-tracing-webapp/pom.xml| 2 +- pom.xml | 2 +- 15 files changed, 15 insertions(+), 15 deletions(-) diff --git a/phoenix-assembly/pom.xml b/phoenix-assembly/pom.xml index dafd8ae..cba11bf 100644 --- a/phoenix-assembly/pom.xml +++ b/phoenix-assembly/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix -5.1.1 +5.1.2-SNAPSHOT phoenix-assembly Phoenix Assembly diff --git a/phoenix-client-parent/phoenix-client-embedded/pom.xml b/phoenix-client-parent/phoenix-client-embedded/pom.xml index c49e566..89edf5d 100644 --- a/phoenix-client-parent/phoenix-client-embedded/pom.xml +++ b/phoenix-client-parent/phoenix-client-embedded/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix-client-parent -5.1.1 +5.1.2-SNAPSHOT phoenix-client-embedded-${hbase.suffix} diff --git a/phoenix-client-parent/phoenix-client/pom.xml b/phoenix-client-parent/phoenix-client/pom.xml index f74c167..cbb0da5 100644 --- a/phoenix-client-parent/phoenix-client/pom.xml +++ b/phoenix-client-parent/phoenix-client/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix-client-parent -5.1.1 +5.1.2-SNAPSHOT phoenix-client-${hbase.suffix} diff --git a/phoenix-client-parent/pom.xml b/phoenix-client-parent/pom.xml index 2e9f7da..856ba10 100644 --- a/phoenix-client-parent/pom.xml +++ b/phoenix-client-parent/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix -5.1.1 +5.1.2-SNAPSHOT phoenix-client-parent Phoenix Client Parent diff --git a/phoenix-core/pom.xml b/phoenix-core/pom.xml index b731adb..33ee868 100644 --- a/phoenix-core/pom.xml +++ b/phoenix-core/pom.xml @@ -21,7 +21,7 @@ org.apache.phoenix phoenix -5.1.1 +5.1.2-SNAPSHOT phoenix-core Phoenix Core diff --git a/phoenix-hbase-compat-2.1.6/pom.xml b/phoenix-hbase-compat-2.1.6/pom.xml index cea4ca5..2778545 100644 --- a/phoenix-hbase-compat-2.1.6/pom.xml +++ b/phoenix-hbase-compat-2.1.6/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.1.1 +5.1.2-SNAPSHOT phoenix-hbase-compat-2.1.6 diff --git a/phoenix-hbase-compat-2.2.5/pom.xml b/phoenix-hbase-compat-2.2.5/pom.xml index d0beea7..2516a45 100644 --- a/phoenix-hbase-compat-2.2.5/pom.xml +++ b/phoenix-hbase-compat-2.2.5/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.1.1 +5.1.2-SNAPSHOT phoenix-hbase-compat-2.2.5 diff --git a/phoenix-hbase-compat-2.3.0/pom.xml b/phoenix-hbase-compat-2.3.0/pom.xml index 33d6af3..cc3373a 100644 --- a/phoenix-hbase-compat-2.3.0/pom.xml +++ b/phoenix-hbase-compat-2.3.0/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.1.1 +5.1.2-SNAPSHOT phoenix-hbase-compat-2.3.0 diff --git a/phoenix-hbase-compat-2.4.0/pom.xml b/phoenix-hbase-compat-2.4.0/pom.xml index a2de78d..9f90748 100644 --- a/phoenix-hbase-compat-2.4.0/pom.xml +++ b/phoenix-hbase-compat-2.4.0/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.1.1 +5.1.2-SNAPSHOT phoenix-hbase-compat-2.4.0 diff --git a/phoenix-hbase-compat-2.4.1/pom.xml b/phoenix-hbase-compat-2.4.1/pom.xml index e16d3b2..bd3f07b 100644 --- a/phoenix-hbase-compat-2.4.1/pom.xml +++ b/phoenix-hbase-compat-2.4.1/pom.xml @@ -23,7 +23,7 @@ org.apache.phoenix phoenix -5.1.1 +5.1.2-SNAPSHOT phoenix-hbase-compat-2.4.1 diff --git a/phoenix-pherf/pom.xml b/phoenix-pherf/pom.xml index 697ca52..37b9572 100644 --- a/phoenix-pherf/pom.xml +++ b/phoenix-pherf/pom.xml @@ -22,7 +22,7 @@ org.apache.phoenix phoenix -5.1.1 +5.1.2-SNAPSHOT
svn commit: r1888053 - in /phoenix/site: publish/download.html publish/js/download.js publish/language/datatypes.html publish/language/functions.html publish/language/index.html source/src/site/markdo
Author: stoty Date: Thu Mar 25 06:35:55 2021 New Revision: 1888053 URL: http://svn.apache.org/viewvc?rev=1888053&view=rev Log: Add 5.1.1 release to download page, fix binary siganture file paths Modified: phoenix/site/publish/download.html phoenix/site/publish/js/download.js phoenix/site/publish/language/datatypes.html phoenix/site/publish/language/functions.html phoenix/site/publish/language/index.html phoenix/site/source/src/site/markdown/download.md phoenix/site/source/src/site/resources/js/download.js Modified: phoenix/site/publish/download.html URL: http://svn.apache.org/viewvc/phoenix/site/publish/download.html?rev=1888053&r1=1888052&r2=1888053&view=diff == --- phoenix/site/publish/download.html (original) +++ phoenix/site/publish/download.html Thu Mar 25 06:35:55 2021 @@ -1,7 +1,7 @@ @@ -170,7 +170,7 @@ Phoenix Downloads The below table lists mirrored release artifacts and their associated hashes and signatures available ONLY at apache.org. The keys used to sign releases can be found in our published https://www.apache.org/dist/phoenix/KEYS";>KEYS file. See our installation instructions here, our release notes here, and a list of fixes and new features https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12334393&projectId=12315120";>here. Follow https://www.apache.org/dyn/closer.cgi#verify";>Verify the Integrity of the Files for how to verify your mirrored downloads. -Current release 4.16.0 can run on Apache HBase 1.3, 1.4, 1.5 and 1.6.CDH HBase 5.11, 5.12, 5.13 and 5.14 is supported by 4.14.0.Apache HBase 2.0 is supported by 5.0.0.Apache HBase 2.1, 2.2, 2.3, 2.4 is supported by 5.1.0. +Current release 4.16.0 can run on Apache HBase 1.3, 1.4, 1.5 and 1.6. Current release 5.1.1 can run on Apache HBase 2.1, 2.2, 2.3 and 2.4 CDH HBase 5.11, 5.12, 5.13 and 5.14 is supported by 4.14.0.Apache HBase 2.0 is supported by 5.0.0. Please follow the appropriate link depending on your HBase version. @@ -232,6 +232,7 @@
[phoenix-queryserver] branch master updated: PHOENIX-6398: Returns uniform SQL dialect in calcite for the PQS
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-queryserver.git The following commit(s) were added to refs/heads/master by this push: new 7c3a10c PHOENIX-6398: Returns uniform SQL dialect in calcite for the PQS 7c3a10c is described below commit 7c3a10c54eaa5e3c7a258ebd83766acce3bae866 Author: luocooong AuthorDate: Sun Mar 7 17:46:12 2021 +0800 PHOENIX-6398: Returns uniform SQL dialect in calcite for the PQS --- .../src/main/java/org/apache/phoenix/queryserver/client/Driver.java | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/phoenix-queryserver-client/src/main/java/org/apache/phoenix/queryserver/client/Driver.java b/phoenix-queryserver-client/src/main/java/org/apache/phoenix/queryserver/client/Driver.java index 5c8f119..3e01846 100644 --- a/phoenix-queryserver-client/src/main/java/org/apache/phoenix/queryserver/client/Driver.java +++ b/phoenix-queryserver-client/src/main/java/org/apache/phoenix/queryserver/client/Driver.java @@ -38,7 +38,7 @@ public class Driver extends org.apache.calcite.avatica.remote.Driver { "org-apache-phoenix-remote-jdbc.properties", "Phoenix Remote JDBC Driver", "unknown version", -"Apache Phoenix", +"Phoenix", "unknown version"); }
[phoenix-queryserver] branch master updated: PHOENIX-6414 Explicit creation of auch mech for SPNEGO
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-queryserver.git The following commit(s) were added to refs/heads/master by this push: new fb48285 PHOENIX-6414 Explicit creation of auch mech for SPNEGO fb48285 is described below commit fb48285a69a5678c6c1648ebcbdcb685c3dbf32a Author: Carlos Garcia Montoro AuthorDate: Fri Mar 26 13:17:01 2021 +0100 PHOENIX-6414 Explicit creation of auch mech for SPNEGO --- python-phoenixdb/phoenixdb/__init__.py | 8 +++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/python-phoenixdb/phoenixdb/__init__.py b/python-phoenixdb/phoenixdb/__init__.py index 14e5a8d..93f47eb 100644 --- a/python-phoenixdb/phoenixdb/__init__.py +++ b/python-phoenixdb/phoenixdb/__init__.py @@ -14,6 +14,8 @@ # limitations under the License. import sys +import gssapi + from phoenixdb import errors, types from phoenixdb.avatica import AvaticaClient from phoenixdb.connection import Connection @@ -177,7 +179,11 @@ def _process_args( auth = HTTPSPNEGOAuth(opportunistic_auth=True) elif auth is None and authentication is not None: if authentication == "SPNEGO": -auth = HTTPSPNEGOAuth(opportunistic_auth=True) +try: +spnego = gssapi.mechs.Mechanism.from_sasl_name("SPNEGO") +except AttributeError: +spnego = gssapi.OID.from_int_seq("1.3.6.1.5.5.2") +auth = HTTPSPNEGOAuth(opportunistic_auth=True, mech=spnego) elif authentication == "BASIC" and avatica_user is not None and avatica_password is not None: auth = HTTPBasicAuth(avatica_user, avatica_password) elif authentication == "DIGEST" and avatica_user is not None and avatica_password is not None:
[phoenix-tephra] branch master updated (fb2270a -> 0d19114)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-tephra.git. from fb2270a TEPHRA-315 tephra-example maven setup is broken (addendum: fix apache-rat-plugin config) new a1b5485 TEPHRA-316 Fix missing executable permission because of MASSEMBLY-941 new 0d19114 TEPHRA-317 Add support for HBase 2.4 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .travis.yml| 3 +++ pom.xml| 12 .../org/apache/tephra/util/ConfigurationFactory.java | 5 + .../main/java/org/apache/tephra/util/HBaseVersion.java | 4 .../tephra/util/HBaseVersionSpecificFactory.java | 4 .../{hbase-2.3 => hbase-2.4}/pom.xml | 18 +- tephra-examples/tephra-examples-post-1.3/pom.xml | 1 + .../pom.xml| 6 +++--- .../tephra/hbase/HBase24ConfigurationProvider.java | 2 +- .../org/apache/tephra/hbase/SecondaryIndexTable.java | 0 .../apache/tephra/hbase/TransactionAwareHTable.java| 4 ++-- .../tephra/hbase/coprocessor/CellSkipFilter.java | 0 .../hbase/coprocessor/FilteredInternalScanner.java | 0 .../tephra/hbase/coprocessor/TransactionFilters.java | 0 .../tephra/hbase/coprocessor/TransactionProcessor.java | 0 .../hbase/coprocessor/TransactionVisibilityFilter.java | 0 .../apache/tephra/hbase/txprune/CompactionState.java | 0 .../apache/tephra/hbase/txprune/DataJanitorState.java | 0 .../hbase/txprune/HBaseTransactionPruningPlugin.java | 0 .../hbase/txprune/InvalidListPruningDebugTool.java | 0 .../tephra/hbase/txprune/PruneUpperBoundWriter.java| 0 .../hbase/txprune/PruneUpperBoundWriterSupplier.java | 0 .../org/apache/tephra/hbase/txprune/TimeRegions.java | 0 .../apache/tephra/hbase/AbstractHBaseTableTest.java| 0 .../tephra/hbase/HBase24ConfigurationProviderTest.java | 4 ++-- .../tephra/hbase/TransactionAwareHTableTest.java | 0 .../tephra/hbase/coprocessor/CellSkipFilterTest.java | 0 .../hbase/coprocessor/TransactionProcessorTest.java| 3 ++- .../coprocessor/TransactionVisibilityFilterTest.java | 0 .../tephra/hbase/txprune/DataJanitorStateTest.java | 0 .../tephra/hbase/txprune/InvalidListPruneTest.java | 0 .../hbase/txprune/InvalidListPruningDebugTest.java | 0 .../txprune/PruneUpperBoundWriterSupplierTest.java | 0 .../src/test/resources/logback-test.xml| 0 34 files changed, 48 insertions(+), 18 deletions(-) copy tephra-examples/tephra-examples-post-1.3/{hbase-2.3 => hbase-2.4}/pom.xml (91%) copy {tephra-hbase-compat-2.3 => tephra-hbase-compat-2.4}/pom.xml (97%) copy tephra-hbase-compat-2.3/src/main/java/org/apache/tephra/hbase/HBase23ConfigurationProvider.java => tephra-hbase-compat-2.4/src/main/java/org/apache/tephra/hbase/HBase24ConfigurationProvider.java (95%) copy {tephra-hbase-compat-2.3 => tephra-hbase-compat-2.4}/src/main/java/org/apache/tephra/hbase/SecondaryIndexTable.java (100%) copy {tephra-hbase-compat-2.3 => tephra-hbase-compat-2.4}/src/main/java/org/apache/tephra/hbase/TransactionAwareHTable.java (99%) copy {tephra-hbase-compat-2.3 => tephra-hbase-compat-2.4}/src/main/java/org/apache/tephra/hbase/coprocessor/CellSkipFilter.java (100%) copy {tephra-hbase-compat-2.3 => tephra-hbase-compat-2.4}/src/main/java/org/apache/tephra/hbase/coprocessor/FilteredInternalScanner.java (100%) copy {tephra-hbase-compat-2.3 => tephra-hbase-compat-2.4}/src/main/java/org/apache/tephra/hbase/coprocessor/TransactionFilters.java (100%) copy {tephra-hbase-compat-2.3 => tephra-hbase-compat-2.4}/src/main/java/org/apache/tephra/hbase/coprocessor/TransactionProcessor.java (100%) copy {tephra-hbase-compat-2.3 => tephra-hbase-compat-2.4}/src/main/java/org/apache/tephra/hbase/coprocessor/TransactionVisibilityFilter.java (100%) copy {tephra-hbase-compat-2.3 => tephra-hbase-compat-2.4}/src/main/java/org/apache/tephra/hbase/txprune/CompactionState.java (100%) copy {tephra-hbase-compat-2.3 => tephra-hbase-compat-2.4}/src/main/java/org/apache/tephra/hbase/txprune/DataJanitorState.java (100%) copy {tephra-hbase-compat-2.3 => tephra-hbase-compat-2.4}/src/main/java/org/apache/tephra/hbase/txprune/HBaseTransactionPruningPlugin.java (100%) copy {tephra-hbase-compat-2.3 => tephra-hbase-compat-2.4}/src/main/java/org/apache/tephra/hbase/txprune/InvalidListPruningDebugTool.java (100%) copy {tephra-hbase-compat-2.3 => tephra-hbase-compat-2.4}/src/main/java/org/apache/tephra/hbase/txprune/PruneUpp
[phoenix-tephra] 01/02: TEPHRA-316 Fix missing executable permission because of MASSEMBLY-941
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-tephra.git commit a1b54858135fa410ab2b76191296c83e2c220053 Author: Richard Antal AuthorDate: Wed Dec 2 09:35:12 2020 +0100 TEPHRA-316 Fix missing executable permission because of MASSEMBLY-941 --- pom.xml | 10 ++ 1 file changed, 10 insertions(+) diff --git a/pom.xml b/pom.xml index 15cd7b9..e451ad2 100644 --- a/pom.xml +++ b/pom.xml @@ -230,6 +230,9 @@ 3.1.0 + + +3.1.1 @@ -533,6 +536,13 @@ checksum-maven-plugin 1.3 + + + + org.apache.maven.plugins + maven-assembly-plugin + ${maven-assembly-plugin-version} +
[phoenix-omid] branch master updated: OMID-207 Upgrade to snakeyaml 1.26
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-omid.git The following commit(s) were added to refs/heads/master by this push: new c572898 OMID-207 Upgrade to snakeyaml 1.26 c572898 is described below commit c572898b5e8393fdb4a225e494432b704140ed60 Author: Richard Antal AuthorDate: Mon Apr 19 16:35:34 2021 +0200 OMID-207 Upgrade to snakeyaml 1.26 Change-Id: I59cef742ac05eb596ce42fea06d24b07f7dcaec3 --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index 0447d9b..7f5d431 100644 --- a/pom.xml +++ b/pom.xml @@ -189,7 +189,7 @@ 2.13.0 3.4.9 -1.11 +1.26 1.9.4 2.4 3.0.1
[phoenix-connectors] branch master updated: PHOENIX-6449 Cannot start minicluster in github CI check for connectors
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-connectors.git The following commit(s) were added to refs/heads/master by this push: new 657f85e PHOENIX-6449 Cannot start minicluster in github CI check for connectors 657f85e is described below commit 657f85e9ce4f4b9367c8ea81c29a9b03049acbd2 Author: Istvan Toth AuthorDate: Tue Apr 20 05:20:06 2021 +0200 PHOENIX-6449 Cannot start minicluster in github CI check for connectors --- .github/actions/tune-runner-vm/action.yml | 19 +++ .github/workflows/maven.yml | 1 + 2 files changed, 20 insertions(+) diff --git a/.github/actions/tune-runner-vm/action.yml b/.github/actions/tune-runner-vm/action.yml new file mode 100644 index 000..47861b7 --- /dev/null +++ b/.github/actions/tune-runner-vm/action.yml @@ -0,0 +1,19 @@ +name: Tune Runner VM +description: | + Fine tunes the GitHub Runner VM operation system for builds. + The tuning currently includes a workaround for + "Reverse name lookup is broken for current hostname in ubuntu-latest VMs", + reported as https://github.com/actions/virtual-environments/issues/3185 +runs: + using: composite + steps: +- run: | +if [[ "$OSTYPE" == "linux-gnu"* ]]; then +# Ensure that reverse lookups for current hostname are handled properly +# Add the current IP address, long hostname and short hostname record to /etc/hosts file +eth0_ip_addr=$(ip addr show eth0 | grep "inet\b" | awk '{print $2}' | cut -d/ -f1) +hostname_fqdn=$(hostname -f) +hostname_short=$(hostname -s) +echo -e "${eth0_ip_addr}\t${hostname_fqdn} ${hostname_short}" | sudo tee -a /etc/hosts +fi + shell: bash diff --git a/.github/workflows/maven.yml b/.github/workflows/maven.yml index dc8259e..e5c4ab9 100644 --- a/.github/workflows/maven.yml +++ b/.github/workflows/maven.yml @@ -24,6 +24,7 @@ jobs: runs-on: ubuntu-18.04 steps: - uses: actions/checkout@v1 +- uses: ./.github/actions/tune-runner-vm - name: Set up JDK 1.8 uses: actions/setup-java@v1 with:
[phoenix] branch master updated: PHOENIX-6452 cache-apache-client-artifact.sh stopped working
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new 045ff34 PHOENIX-6452 cache-apache-client-artifact.sh stopped working 045ff34 is described below commit 045ff34b71353ce1be3ed28551c7f7e1ed2ad56b Author: Istvan Toth AuthorDate: Wed Apr 21 17:10:58 2021 +0200 PHOENIX-6452 cache-apache-client-artifact.sh stopped working --- dev/cache-apache-project-artifact.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/dev/cache-apache-project-artifact.sh b/dev/cache-apache-project-artifact.sh index 8539350..1dbd374 100755 --- a/dev/cache-apache-project-artifact.sh +++ b/dev/cache-apache-project-artifact.sh @@ -120,7 +120,7 @@ if [ -n "${keys}" ]; then fi echo "downloading artifact" -if ! curl --dump-header "${working_dir}/artifact_download_headers.txt" -L --fail -o "${working_dir}/artifact" "https://www.apache.org/dyn/closer.lua?filename=${artifact}&action=download"; ; then +if ! curl --dump-header "${working_dir}/artifact_download_headers.txt" -L --fail -o "${working_dir}/artifact" "https://www.apache.org/dyn/closer.lua/${artifact}?action=download"; ; then echo "Artifact wasn't in mirror system. falling back to archive.a.o." curl --dump-header "${working_dir}/artifact_fallback_headers.txt" -L --fail -o "${working_dir}/artifact" "http://archive.apache.org/dist/${artifact}"; fi
[phoenix] branch 5.1 updated: PHOENIX-6452 cache-apache-client-artifact.sh stopped working
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new ba8b023 PHOENIX-6452 cache-apache-client-artifact.sh stopped working ba8b023 is described below commit ba8b0230381dff8b6b0f68135ff47398b14616df Author: Istvan Toth AuthorDate: Wed Apr 21 17:10:58 2021 +0200 PHOENIX-6452 cache-apache-client-artifact.sh stopped working --- dev/cache-apache-project-artifact.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/dev/cache-apache-project-artifact.sh b/dev/cache-apache-project-artifact.sh index 8539350..1dbd374 100755 --- a/dev/cache-apache-project-artifact.sh +++ b/dev/cache-apache-project-artifact.sh @@ -120,7 +120,7 @@ if [ -n "${keys}" ]; then fi echo "downloading artifact" -if ! curl --dump-header "${working_dir}/artifact_download_headers.txt" -L --fail -o "${working_dir}/artifact" "https://www.apache.org/dyn/closer.lua?filename=${artifact}&action=download"; ; then +if ! curl --dump-header "${working_dir}/artifact_download_headers.txt" -L --fail -o "${working_dir}/artifact" "https://www.apache.org/dyn/closer.lua/${artifact}?action=download"; ; then echo "Artifact wasn't in mirror system. falling back to archive.a.o." curl --dump-header "${working_dir}/artifact_fallback_headers.txt" -L --fail -o "${working_dir}/artifact" "http://archive.apache.org/dist/${artifact}"; fi
[phoenix] branch master updated: PHOENIX-6451 Update joni and jcodings versions
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new b3e6466 PHOENIX-6451 Update joni and jcodings versions b3e6466 is described below commit b3e6466c8f2e299e3ffe4d8fdc571267691876fa Author: Richard Antal AuthorDate: Wed Apr 21 14:31:39 2021 +0200 PHOENIX-6451 Update joni and jcodings versions Change-Id: I780f0bc0154aa4be463285029310856acd957ad6 --- pom.xml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/pom.xml b/pom.xml index e3d5045..a257da8 100644 --- a/pom.xml +++ b/pom.xml @@ -121,7 +121,7 @@ 3.1.0-incubating 3.2.2 2.10.5 -2.1.2 +2.1.31 0.16.0 1.0.2 2.9.5 @@ -129,7 +129,7 @@ 4.0 3.4.14 4.0.0 -1.0.18 +1.0.55 0.9.3-1 1.10.19
[phoenix] branch 5.1 updated: PHOENIX-6451 Update joni and jcodings versions
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new 6274385 PHOENIX-6451 Update joni and jcodings versions 6274385 is described below commit 62743855b8536e7bbbe50670a36b06647f5ae54e Author: Richard Antal AuthorDate: Wed Apr 21 14:31:39 2021 +0200 PHOENIX-6451 Update joni and jcodings versions Change-Id: I780f0bc0154aa4be463285029310856acd957ad6 --- pom.xml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/pom.xml b/pom.xml index b7bcd3a..1950e17 100644 --- a/pom.xml +++ b/pom.xml @@ -121,7 +121,7 @@ 3.1.0-incubating 3.2.2 2.10.5 -2.1.2 +2.1.31 0.16.0 1.0.2 2.9.5 @@ -129,7 +129,7 @@ 4.0 3.4.14 4.0.0 -1.0.18 +1.0.55 0.9.3-1 1.10.19
[phoenix] branch 4.x updated: PHOENIX-6451 Update joni and jcodings versions
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/4.x by this push: new c3f166e PHOENIX-6451 Update joni and jcodings versions c3f166e is described below commit c3f166ecc8e1247376f538be5931cb63831c2d2b Author: Richard Antal AuthorDate: Wed Apr 21 14:31:39 2021 +0200 PHOENIX-6451 Update joni and jcodings versions --- phoenix-core/pom.xml | 1 - pom.xml | 13 - 2 files changed, 12 insertions(+), 2 deletions(-) diff --git a/phoenix-core/pom.xml b/phoenix-core/pom.xml index bd96c75..227f416 100644 --- a/phoenix-core/pom.xml +++ b/phoenix-core/pom.xml @@ -490,7 +490,6 @@ org.jruby.joni joni -${joni.version} com.clearspring.analytics diff --git a/pom.xml b/pom.xml index 51021ff..d1896c9 100644 --- a/pom.xml +++ b/pom.xml @@ -124,7 +124,7 @@ 3.2.2 1.6 -2.1.2 +2.1.31 1.12.0 8.1.7.v20120910 0.16.0 @@ -135,6 +135,7 @@ 2.9.5 1.0.4 3.1.0 +1.0.55 1.8.5 4.13 @@ -1119,6 +1120,16 @@ disruptor ${disruptor.version} + +org.jruby.joni +joni +${joni.version} + + +org.jruby.jcodings +jcodings +${jcodings.version} +
[phoenix-connectors] branch master updated: fix phoenix4 assembly spark problem
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-connectors.git The following commit(s) were added to refs/heads/master by this push: new 58fa326 fix phoenix4 assembly spark problem 58fa326 is described below commit 58fa32650cbf5a32e720063a9e8043d87da4b510 Author: Istvan Toth AuthorDate: Tue May 4 06:31:45 2021 +0200 fix phoenix4 assembly spark problem --- phoenix4-connectors-assembly/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/phoenix4-connectors-assembly/pom.xml b/phoenix4-connectors-assembly/pom.xml index bde5ce9..fd05be6 100644 --- a/phoenix4-connectors-assembly/pom.xml +++ b/phoenix4-connectors-assembly/pom.xml @@ -129,7 +129,7 @@ ln - ${project.basedir}/../phoenix-spark-base/phoenix4-spark/target + ${project.basedir}/../phoenix-spark-base/phoenix4-spark-shaded/target -fnsv
[phoenix-connectors] branch master updated: PHOENIX-6443 Update Phoenix dependency to 5.1.1
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-connectors.git The following commit(s) were added to refs/heads/master by this push: new 0583b22 PHOENIX-6443 Update Phoenix dependency to 5.1.1 0583b22 is described below commit 0583b225a78a1f3c585735eb2dc46f62d091b33f Author: Istvan Toth AuthorDate: Thu Apr 15 19:59:48 2021 +0200 PHOENIX-6443 Update Phoenix dependency to 5.1.1 previous commit should have been part of this one --- phoenix-flume-base/phoenix5-flume/pom.xml | 2 +- phoenix-flume-base/pom.xml | 9 +++ .../apache/phoenix/flume/CsvEventSerializerIT.java | 27 - .../phoenix/flume/JsonEventSerializerIT.java | 29 - .../org/apache/phoenix/flume/PhoenixSinkIT.java| 31 -- .../phoenix/flume/RegexEventSerializerIT.java | 30 -- .../phoenix4-hive-shaded}/pom.xml | 47 --- phoenix-hive-base/phoenix4-hive/pom.xml| 20 +-- .../phoenix5-hive-shaded}/pom.xml | 52 ++-- phoenix-hive-base/phoenix5-hive/pom.xml| 18 -- phoenix-hive-base/pom.xml | 7 +-- phoenix-kafka-base/phoenix5-kafka/pom.xml | 1 + phoenix-kafka-base/pom.xml | 21 --- .../apache/phoenix/kafka/PhoenixConsumerIT.java| 25 ++-- .../phoenix4-pig-shaded}/pom.xml | 51 phoenix-pig-base/phoenix4-pig/pom.xml | 4 -- .../phoenix5-pig-shaded}/pom.xml | 51 +--- phoenix-pig-base/phoenix5-pig/pom.xml | 6 +- phoenix-pig-base/pom.xml | 15 - .../it/java/org/apache/phoenix/pig/BasePigIT.java | 13 ++-- .../pom.xml| 39 ++-- phoenix-spark-base/phoenix4-spark/pom.xml | 4 -- .../phoenix5-spark-shaded}/pom.xml | 39 +++- phoenix-spark-base/phoenix5-spark/pom.xml | 39 +--- phoenix-spark-base/pom.xml | 20 +-- .../phoenix/spark/AbstractPhoenixSparkIT.scala | 20 --- phoenix4-connectors-assembly/pom.xml | 22 +-- .../src/build/components/phoenix4-jars.xml | 12 ++-- phoenix5-connectors-assembly/pom.xml | 24 ++-- .../src/build/components/phoenix5-jars.xml | 12 ++-- pom.xml| 69 -- 31 files changed, 484 insertions(+), 275 deletions(-) diff --git a/phoenix-flume-base/phoenix5-flume/pom.xml b/phoenix-flume-base/phoenix5-flume/pom.xml index ffc1aa7..eef8e22 100644 --- a/phoenix-flume-base/phoenix5-flume/pom.xml +++ b/phoenix-flume-base/phoenix5-flume/pom.xml @@ -36,6 +36,7 @@ ${project.basedir}/.. ${phoenix-five.version} ${hbase-two.version} +${hbase-two.compat.version} ${hadoop-three.version} 1.8 5 @@ -65,5 +66,4 @@ - \ No newline at end of file diff --git a/phoenix-flume-base/pom.xml b/phoenix-flume-base/pom.xml index 0dd114c..e3baa66 100644 --- a/phoenix-flume-base/pom.xml +++ b/phoenix-flume-base/pom.xml @@ -46,6 +46,12 @@ org.apache.phoenix phoenix-core + + org.apache.phoenix + phoenix-hbase-compat-${hbase.compat.version} + runtime + true + commons-collections @@ -145,6 +151,9 @@ org.apache.hadoop:hadoop-common + +org.apache.phoenix:phoenix-hbase-compat-${hbase.compat.version} + diff --git a/phoenix-flume-base/src/it/java/org/apache/phoenix/flume/CsvEventSerializerIT.java b/phoenix-flume-base/src/it/java/org/apache/phoenix/flume/CsvEventSerializerIT.java index 1f4fff9..1db9d2f 100644 --- a/phoenix-flume-base/src/it/java/org/apache/phoenix/flume/CsvEventSerializerIT.java +++ b/phoenix-flume-base/src/it/java/org/apache/phoenix/flume/CsvEventSerializerIT.java @@ -41,19 +41,42 @@ import org.apache.flume.channel.MemoryChannel; import org.apache.flume.conf.Configurables; import org.apache.flume.event.EventBuilder; import org.apache.flume.lifecycle.LifecycleState; +import org.apache.hadoop.hbase.HConstants; import org.apache.hadoop.hbase.util.Bytes; -import org.apache.phoenix.end2end.BaseHBaseManagedTimeIT; +import org.apache.phoenix.end2end.NeedsOwnMiniClusterTest; import org.apache.phoenix.flume.serializer.EventSerializers; import org.apache.phoenix.flume.sink.PhoenixSink; import org.apache.phoenix.util.PropertiesUtil; +import org.apache.phoenix.util.ReadOnlyProps; +import org.apache.phoenix.query.BaseTest; +import org.junit.After; +import org.junit.AfterClass; +import org.junit.BeforeClass; import org.junit.Test; +import org.junit.experimental.categories.Category
[phoenix] branch master updated: PHOENIX-6357 Change all command line tools to use the fixed commons-cli constructor
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new 88a0128 PHOENIX-6357 Change all command line tools to use the fixed commons-cli constructor 88a0128 is described below commit 88a0128064ce8be768266f9804e4829ef87af785 Author: Istvan Toth AuthorDate: Thu Mar 25 10:25:57 2021 +0100 PHOENIX-6357 Change all command line tools to use the fixed commons-cli constructor use the new DefaultParser(false, false) constructor introduced in the patched phoenix-thirdparty commons-cli library, to make sure that any quoted identifiers are passed from the command line to the rest of the code correctly. remove the double doublequote partial workaround, as it is no longer needed --- .../apache/phoenix/end2end/CsvBulkLoadToolIT.java | 8 +++--- .../phoenix/mapreduce/AbstractBulkLoadTool.java| 32 ++ .../apache/phoenix/mapreduce/OrphanViewTool.java | 4 +-- .../apache/phoenix/mapreduce/PhoenixTTLTool.java | 4 +-- .../phoenix/mapreduce/index/IndexScrutinyTool.java | 2 +- .../apache/phoenix/mapreduce/index/IndexTool.java | 2 +- .../phoenix/mapreduce/index/IndexUpgradeTool.java | 3 +- .../phoenix/schema/stats/UpdateStatisticsTool.java | 4 +-- .../util/MergeViewIndexIdSequencesTool.java| 4 +-- .../org/apache/phoenix/util/PhoenixRuntime.java| 4 +-- .../main/java/org/apache/phoenix/pherf/Pherf.java | 4 +-- .../phoenix/schema/SchemaExtractionTool.java | 4 +-- 12 files changed, 23 insertions(+), 52 deletions(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java index 0a34ca0..b569d44 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java @@ -206,8 +206,8 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { "--input", "/tmp/input8.csv", "--table", "table8", "--zookeeper", zkQuorum, -"-q", "\"\"", -"-e", "\"\"", +"-q", "", +"-e", "", "--delimiter", "\\t" }); assertEquals(0, exitCode); @@ -701,7 +701,7 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { csvBulkLoadTool.getConf().set(DATE_FORMAT_ATTRIB,"/MM/dd"); int exitCode = csvBulkLoadTool.run(new String[] { "--input", "/tmp/input1.csv", -"--table", "\"\"t\"\"", +"--table", "\"t\"", "--schema", "S", "--zookeeper", zkQuorum}); assertEquals(0, exitCode); @@ -736,7 +736,7 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { int exitCode = csvBulkLoadTool.run(new String[] { "--input", "/tmp/input1.csv", "--table", "T", -"--schema", "\"\"s\"\"", +"--schema", "\"s\"", "--zookeeper", zkQuorum}); assertEquals(0, exitCode); ResultSet rs = stmt.executeQuery("SELECT id, name, t FROM \"s\".T ORDER BY id"); diff --git a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java b/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java index 4224e67..b777fbc 100644 --- a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java +++ b/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java @@ -126,7 +126,7 @@ public abstract class AbstractBulkLoadTool extends Configured implements Tool { Options options = getOptions(); -CommandLineParser parser = new DefaultParser(); +CommandLineParser parser = new DefaultParser(false, false); CommandLine cmdLine = null; try { cmdLine = parser.parse(options, args); @@ -181,40 +181,12 @@ public abstract class AbstractBulkLoadTool extends Configured implements Tool { return loadData(conf, cmdLine); } -/** - * Check schema or table name that start with two double quotes i.e ""t"" -> true - */ -private boolean isStartWithTwoDoubleQuotes (String name) { -boolean start
[phoenix] branch 4.x updated: PHOENIX-6357 Change all command line tools to use the fixed commons-cli constructor
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/4.x by this push: new 6ac64c4 PHOENIX-6357 Change all command line tools to use the fixed commons-cli constructor 6ac64c4 is described below commit 6ac64c486c10797cb3ad9ac384ffa64aefba6083 Author: Istvan Toth AuthorDate: Thu Mar 25 10:25:57 2021 +0100 PHOENIX-6357 Change all command line tools to use the fixed commons-cli constructor use the new DefaultParser(false, false) constructor introduced in the patched phoenix-thirdparty commons-cli library, to make sure that any quoted identifiers are passed from the command line to the rest of the code correctly. remove the double doublequote partial workaround, as it is no longer needed --- .../apache/phoenix/end2end/CsvBulkLoadToolIT.java | 8 ++--- .../phoenix/mapreduce/AbstractBulkLoadTool.java| 34 ++ .../apache/phoenix/mapreduce/OrphanViewTool.java | 4 +-- .../apache/phoenix/mapreduce/PhoenixTTLTool.java | 4 +-- .../phoenix/mapreduce/index/IndexScrutinyTool.java | 4 +-- .../apache/phoenix/mapreduce/index/IndexTool.java | 2 +- .../phoenix/mapreduce/index/IndexUpgradeTool.java | 4 +-- .../phoenix/schema/stats/UpdateStatisticsTool.java | 4 +-- .../util/MergeViewIndexIdSequencesTool.java| 4 +-- .../org/apache/phoenix/util/PhoenixRuntime.java| 4 +-- .../main/java/org/apache/phoenix/pherf/Pherf.java | 4 +-- .../phoenix/schema/SchemaExtractionTool.java | 4 +-- 12 files changed, 26 insertions(+), 54 deletions(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java index 54d481f..cef658f 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java @@ -206,8 +206,8 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { "--input", "/tmp/input8.csv", "--table", "table8", "--zookeeper", zkQuorum, -"-q", "\"\"", -"-e", "\"\"", +"-q", "", +"-e", "", "--delimiter", "\\t" }); assertEquals(0, exitCode); @@ -701,7 +701,7 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { csvBulkLoadTool.getConf().set(DATE_FORMAT_ATTRIB,"/MM/dd"); int exitCode = csvBulkLoadTool.run(new String[] { "--input", "/tmp/input1.csv", -"--table", "\"\"t\"\"", +"--table", "\"t\"", "--schema", "S", "--zookeeper", zkQuorum}); assertEquals(0, exitCode); @@ -736,7 +736,7 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { int exitCode = csvBulkLoadTool.run(new String[] { "--input", "/tmp/input1.csv", "--table", "T", -"--schema", "\"\"s\"\"", +"--schema", "\"s\"", "--zookeeper", zkQuorum}); assertEquals(0, exitCode); ResultSet rs = stmt.executeQuery("SELECT id, name, t FROM \"s\".T ORDER BY id"); diff --git a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java b/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java index d4582b6..bb1a343 100644 --- a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java +++ b/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java @@ -29,11 +29,11 @@ import java.util.UUID; import org.apache.phoenix.thirdparty.org.apache.commons.cli.CommandLine; import org.apache.phoenix.thirdparty.org.apache.commons.cli.CommandLineParser; +import org.apache.phoenix.thirdparty.org.apache.commons.cli.DefaultParser; import org.apache.phoenix.thirdparty.org.apache.commons.cli.HelpFormatter; import org.apache.phoenix.thirdparty.org.apache.commons.cli.Option; import org.apache.phoenix.thirdparty.org.apache.commons.cli.Options; import org.apache.phoenix.thirdparty.org.apache.commons.cli.ParseException; -import org.apache.phoenix.thirdparty.org.apache.commons.cli.PosixParser; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.conf.Configured; import org.apache.hadoop.fs.Path
[phoenix] branch 5.1 updated: PHOENIX-6357 Change all command line tools to use the fixed commons-cli constructor
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new 84c21db PHOENIX-6357 Change all command line tools to use the fixed commons-cli constructor 84c21db is described below commit 84c21db414ababe76bf68238e14651be0918ea45 Author: Istvan Toth AuthorDate: Thu Mar 25 10:25:57 2021 +0100 PHOENIX-6357 Change all command line tools to use the fixed commons-cli constructor use the new DefaultParser(false, false) constructor introduced in the patched phoenix-thirdparty commons-cli library, to make sure that any quoted identifiers are passed from the command line to the rest of the code correctly. remove the double doublequote partial workaround, as it is no longer needed --- .../apache/phoenix/end2end/CsvBulkLoadToolIT.java | 8 +++--- .../phoenix/mapreduce/AbstractBulkLoadTool.java| 32 ++ .../apache/phoenix/mapreduce/OrphanViewTool.java | 4 +-- .../apache/phoenix/mapreduce/PhoenixTTLTool.java | 4 +-- .../phoenix/mapreduce/index/IndexScrutinyTool.java | 2 +- .../apache/phoenix/mapreduce/index/IndexTool.java | 2 +- .../phoenix/mapreduce/index/IndexUpgradeTool.java | 3 +- .../phoenix/schema/stats/UpdateStatisticsTool.java | 4 +-- .../util/MergeViewIndexIdSequencesTool.java| 4 +-- .../org/apache/phoenix/util/PhoenixRuntime.java| 4 +-- .../main/java/org/apache/phoenix/pherf/Pherf.java | 4 +-- .../phoenix/schema/SchemaExtractionTool.java | 4 +-- 12 files changed, 23 insertions(+), 52 deletions(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java index 5e0200b..f79e844 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java @@ -203,8 +203,8 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { "--input", "/tmp/input8.csv", "--table", "table8", "--zookeeper", zkQuorum, -"-q", "\"\"", -"-e", "\"\"", +"-q", "", +"-e", "", "--delimiter", "\\t" }); assertEquals(0, exitCode); @@ -625,7 +625,7 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { csvBulkLoadTool.getConf().set(DATE_FORMAT_ATTRIB,"/MM/dd"); int exitCode = csvBulkLoadTool.run(new String[] { "--input", "/tmp/input1.csv", -"--table", "\"\"t\"\"", +"--table", "\"t\"", "--schema", "S", "--zookeeper", zkQuorum}); assertEquals(0, exitCode); @@ -660,7 +660,7 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { int exitCode = csvBulkLoadTool.run(new String[] { "--input", "/tmp/input1.csv", "--table", "T", -"--schema", "\"\"s\"\"", +"--schema", "\"s\"", "--zookeeper", zkQuorum}); assertEquals(0, exitCode); ResultSet rs = stmt.executeQuery("SELECT id, name, t FROM \"s\".T ORDER BY id"); diff --git a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java b/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java index 4224e67..b777fbc 100644 --- a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java +++ b/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java @@ -126,7 +126,7 @@ public abstract class AbstractBulkLoadTool extends Configured implements Tool { Options options = getOptions(); -CommandLineParser parser = new DefaultParser(); +CommandLineParser parser = new DefaultParser(false, false); CommandLine cmdLine = null; try { cmdLine = parser.parse(options, args); @@ -181,40 +181,12 @@ public abstract class AbstractBulkLoadTool extends Configured implements Tool { return loadData(conf, cmdLine); } -/** - * Check schema or table name that start with two double quotes i.e ""t"" -> true - */ -private boolean isStartWithTwoDoubleQuotes (String name) { -boolean start
[phoenix-queryserver] branch master updated: PHOENIX-6463 Include copyPom in maven-repo creation
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-queryserver.git The following commit(s) were added to refs/heads/master by this push: new 5fe9959 PHOENIX-6463 Include copyPom in maven-repo creation 5fe9959 is described below commit 5fe99598fa1c8160092d39991b60fd4241bdc944 Author: Josh Elser AuthorDate: Mon May 10 17:39:53 2021 -0400 PHOENIX-6463 Include copyPom in maven-repo creation --- phoenix-queryserver-assembly/pom.xml | 1 + 1 file changed, 1 insertion(+) diff --git a/phoenix-queryserver-assembly/pom.xml b/phoenix-queryserver-assembly/pom.xml index 3d6baaf..30b9e4c 100644 --- a/phoenix-queryserver-assembly/pom.xml +++ b/phoenix-queryserver-assembly/pom.xml @@ -86,6 +86,7 @@ ${project.build.directory}/maven-repo true true +true
[phoenix-queryserver] branch master updated: PHOENIX-6464 Release python-phoenixdb 1.0.1
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix-queryserver.git The following commit(s) were added to refs/heads/master by this push: new fdd421b PHOENIX-6464 Release python-phoenixdb 1.0.1 fdd421b is described below commit fdd421b3d954e6032893bdbade5adc6d61cad9b9 Author: Istvan Toth AuthorDate: Tue May 11 15:34:48 2021 +0200 PHOENIX-6464 Release python-phoenixdb 1.0.1 update version and changelog --- python-phoenixdb/NEWS.rst | 6 ++ python-phoenixdb/setup.py | 2 +- 2 files changed, 7 insertions(+), 1 deletion(-) diff --git a/python-phoenixdb/NEWS.rst b/python-phoenixdb/NEWS.rst index 9346caa..22fa1ce 100644 --- a/python-phoenixdb/NEWS.rst +++ b/python-phoenixdb/NEWS.rst @@ -1,6 +1,12 @@ Changelog = +Version 1.0.1 +- + +- Use HTTP sessions to enable sticky load balancers (PHOENIX-6459) +- Revert default GSSAPI OID to SPNEGO to improve compatibility (PHOENIX-6414) + Version 1.0.0 - diff --git a/python-phoenixdb/setup.py b/python-phoenixdb/setup.py index 01ad2a3..df0be7b 100644 --- a/python-phoenixdb/setup.py +++ b/python-phoenixdb/setup.py @@ -59,7 +59,7 @@ else: 'Sphinx;python_version>="3.6"', ], -version = "1.0.1.dev0" +version = "1.0.1" setup( name="phoenixdb",
[phoenix] branch master updated: PHOENIX-6442 Phoenix should depend on the appropriate tephra-hbase-compat-x.y module
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/master by this push: new 318a32f PHOENIX-6442 Phoenix should depend on the appropriate tephra-hbase-compat-x.y module 318a32f is described below commit 318a32f28ca4ff36fdcd00a2fbe44eb9ac622cf5 Author: Istvan Toth AuthorDate: Mon Apr 26 08:34:25 2021 +0200 PHOENIX-6442 Phoenix should depend on the appropriate tephra-hbase-compat-x.y module also update tephra dependency version to 0.16.1 --- phoenix-core/pom.xml | 4 ++-- pom.xml | 10 -- 2 files changed, 10 insertions(+), 4 deletions(-) diff --git a/phoenix-core/pom.xml b/phoenix-core/pom.xml index 6afaba6..f9bf1c1 100644 --- a/phoenix-core/pom.xml +++ b/phoenix-core/pom.xml @@ -547,7 +547,7 @@ org.apache.tephra -tephra-hbase-compat-2.0 + tephra-hbase-compat-${tephra.hbase.compat.version} shaded provided @@ -576,7 +576,7 @@ org.apache.tephra -tephra-hbase-compat-2.0 + tephra-hbase-compat-${tephra.hbase.compat.version} shaded diff --git a/pom.xml b/pom.xml index a257da8..605062a 100644 --- a/pom.xml +++ b/pom.xml @@ -122,7 +122,7 @@ 3.2.2 2.10.5 2.1.31 -0.16.0 +0.16.1 1.0.2 2.9.5 1.0.4 @@ -992,7 +992,7 @@ org.apache.tephra -tephra-hbase-compat-2.0 + tephra-hbase-compat-${tephra.hbase.compat.version} shaded ${tephra.version} @@ -1542,6 +1542,7 @@ ${hbase-2.4.runtime.version} 3.4.1 3.5.7 +2.4 @@ -1560,6 +1561,7 @@ 2.1.6 ${hbase-2.1.runtime.version} 3.0.3 +2.1 @@ -1576,6 +1578,7 @@ 2.2.5 ${hbase-2.2.runtime.version} 3.1.3 +2.2 @@ -1594,6 +1597,7 @@ 3.3.0 3.5.7 3.1.3 +2.3 @@ -1611,6 +1615,7 @@ ${hbase-2.4.0.runtime.version} 3.4.1 3.5.7 +2.4 @@ -1628,6 +1633,7 @@ ${hbase-2.4.runtime.version} 3.4.1 3.5.7 +2.4
[phoenix] branch 5.1 updated: PHOENIX-6442 Phoenix should depend on the appropriate tephra-hbase-compat-x.y module
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 5.1 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/5.1 by this push: new d669e83 PHOENIX-6442 Phoenix should depend on the appropriate tephra-hbase-compat-x.y module d669e83 is described below commit d669e83e84c75e47604b656675acf8e48150f0cc Author: Istvan Toth AuthorDate: Mon Apr 26 08:34:25 2021 +0200 PHOENIX-6442 Phoenix should depend on the appropriate tephra-hbase-compat-x.y module also update tephra dependency version to 0.16.1 --- phoenix-core/pom.xml | 4 ++-- pom.xml | 10 -- 2 files changed, 10 insertions(+), 4 deletions(-) diff --git a/phoenix-core/pom.xml b/phoenix-core/pom.xml index 33ee868..848d7d1 100644 --- a/phoenix-core/pom.xml +++ b/phoenix-core/pom.xml @@ -547,7 +547,7 @@ org.apache.tephra -tephra-hbase-compat-2.0 + tephra-hbase-compat-${tephra.hbase.compat.version} shaded provided @@ -576,7 +576,7 @@ org.apache.tephra -tephra-hbase-compat-2.0 + tephra-hbase-compat-${tephra.hbase.compat.version} shaded diff --git a/pom.xml b/pom.xml index 1950e17..602ba82 100644 --- a/pom.xml +++ b/pom.xml @@ -122,7 +122,7 @@ 3.2.2 2.10.5 2.1.31 -0.16.0 +0.16.1 1.0.2 2.9.5 1.0.4 @@ -992,7 +992,7 @@ org.apache.tephra -tephra-hbase-compat-2.0 + tephra-hbase-compat-${tephra.hbase.compat.version} shaded ${tephra.version} @@ -1542,6 +1542,7 @@ ${hbase-2.4.runtime.version} 3.4.1 3.5.7 +2.4 @@ -1560,6 +1561,7 @@ 2.1.6 ${hbase-2.1.runtime.version} 3.0.3 +2.1 @@ -1576,6 +1578,7 @@ 2.2.5 ${hbase-2.2.runtime.version} 3.1.3 +2.2 @@ -1594,6 +1597,7 @@ 3.3.0 3.5.7 3.1.3 +2.3 @@ -1611,6 +1615,7 @@ ${hbase-2.4.0.runtime.version} 3.4.1 3.5.7 +2.4 @@ -1628,6 +1633,7 @@ ${hbase-2.4.runtime.version} 3.4.1 3.5.7 +2.4
[phoenix] branch 4.x updated: PHOENIX-6442 Phoenix should depend on the appropriate tephra-hbase-compat-x.y module
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.x in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/4.x by this push: new 9e91e5c PHOENIX-6442 Phoenix should depend on the appropriate tephra-hbase-compat-x.y module 9e91e5c is described below commit 9e91e5cb21f843c0534ee95d380640ea21554fde Author: Istvan Toth AuthorDate: Mon Apr 26 08:52:04 2021 +0200 PHOENIX-6442 Phoenix should depend on the appropriate tephra-hbase-compat-x.y module --- phoenix-core/pom.xml | 104 ++- pom.xml | 7 +++- 2 files changed, 76 insertions(+), 35 deletions(-) diff --git a/phoenix-core/pom.xml b/phoenix-core/pom.xml index 227f416..62085c7 100644 --- a/phoenix-core/pom.xml +++ b/phoenix-core/pom.xml @@ -303,7 +303,7 @@ org.apache.tephra - tephra-hbase-compat-1.4 + tephra-hbase-compat-${tephra.hbase.compat.version} @@ -513,46 +513,82 @@ - phoenix-hbase-compat-1.5.0-default - - - org.apache.hbase - hbase-metrics-api - - - org.apache.hbase - hbase-metrics - - + phoenix-hbase-compat-1.6.0-default + + + !hbase.profile + + + +1.6 +2.8.5 + +1.5.0 +${hbase-1.6.runtime.version} +1.6 + - phoenix-hbase-compat-1.5.0 - - - org.apache.hbase - hbase-metrics-api - - - org.apache.hbase - hbase-metrics - - + phoenix-hbase-compat-1.3.0 + + + hbase.profile + 1.3 + + + +1.3 +1.3.0 +${hbase-1.3.runtime.version} +1.3 + phoenix-hbase-compat-1.4.0 - - - org.apache.hbase - hbase-metrics-api - - - org.apache.hbase - hbase-metrics - - + + + hbase.profile + 1.4 + + + +1.4 +1.4.0 +${hbase-1.4.runtime.version} +1.4 + - phoenix-hbase-compat-1.3.0 + phoenix-hbase-compat-1.5.0 + + + hbase.profile + 1.5 + + + +1.5 +1.5.0 +${hbase-1.5.runtime.version} +1.5 + + + + phoenix-hbase-compat-1.6.0 + + + hbase.profile + 1.6 + + + +1.6 +2.8.5 + +1.5.0 +${hbase-1.6.runtime.version} +1.6 + diff --git a/pom.xml b/pom.xml index d1896c9..9127734 100644 --- a/pom.xml +++ b/pom.xml @@ -915,7 +915,7 @@ org.apache.tephra -tephra-hbase-compat-1.4 + tephra-hbase-compat-${tephra.hbase.compat.version} ${tephra.version} @@ -1186,6 +1186,7 @@ 1.5.0 ${hbase-1.6.runtime.version} +1.6 @@ -1200,6 +1201,7 @@ 1.3 1.3.0 ${hbase-1.3.runtime.version} +1.3 @@ -1214,6 +1216,7 @@ 1.4 1.4.0 ${hbase-1.4.runtime.version} +1.4 @@ -1228,6 +1231,7 @@ 1.5 1.5.0 ${hbase-1.5.runtime.version} +1.5 @@ -1244,6 +1248,7 @@ 1.5.0 ${hbase-1.6.runtime.version} +1.6
[phoenix] branch 4.16 updated: PHOENIX-6442 Phoenix should depend on the appropriate tephra-hbase-compat-x.y module
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.16 in repository https://gitbox.apache.org/repos/asf/phoenix.git The following commit(s) were added to refs/heads/4.16 by this push: new afbab2b PHOENIX-6442 Phoenix should depend on the appropriate tephra-hbase-compat-x.y module afbab2b is described below commit afbab2b7ab7afe8c56d8380e338b89e3af089437 Author: Istvan Toth AuthorDate: Mon Apr 26 08:52:04 2021 +0200 PHOENIX-6442 Phoenix should depend on the appropriate tephra-hbase-compat-x.y module --- phoenix-core/pom.xml | 104 ++- pom.xml | 7 +++- 2 files changed, 76 insertions(+), 35 deletions(-) diff --git a/phoenix-core/pom.xml b/phoenix-core/pom.xml index 4f65733..a9b7bba 100644 --- a/phoenix-core/pom.xml +++ b/phoenix-core/pom.xml @@ -303,7 +303,7 @@ org.apache.tephra - tephra-hbase-compat-1.4 + tephra-hbase-compat-${tephra.hbase.compat.version} @@ -514,46 +514,82 @@ - phoenix-hbase-compat-1.5.0-default - - - org.apache.hbase - hbase-metrics-api - - - org.apache.hbase - hbase-metrics - - + phoenix-hbase-compat-1.6.0-default + + + !hbase.profile + + + +1.6 +2.8.5 + +1.5.0 +${hbase-1.6.runtime.version} +1.6 + - phoenix-hbase-compat-1.5.0 - - - org.apache.hbase - hbase-metrics-api - - - org.apache.hbase - hbase-metrics - - + phoenix-hbase-compat-1.3.0 + + + hbase.profile + 1.3 + + + +1.3 +1.3.0 +${hbase-1.3.runtime.version} +1.3 + phoenix-hbase-compat-1.4.0 - - - org.apache.hbase - hbase-metrics-api - - - org.apache.hbase - hbase-metrics - - + + + hbase.profile + 1.4 + + + +1.4 +1.4.0 +${hbase-1.4.runtime.version} +1.4 + - phoenix-hbase-compat-1.3.0 + phoenix-hbase-compat-1.5.0 + + + hbase.profile + 1.5 + + + +1.5 +1.5.0 +${hbase-1.5.runtime.version} +1.5 + + + + phoenix-hbase-compat-1.6.0 + + + hbase.profile + 1.6 + + + +1.6 +2.8.5 + +1.5.0 +${hbase-1.6.runtime.version} +1.6 + diff --git a/pom.xml b/pom.xml index ea107b8..28986ff 100644 --- a/pom.xml +++ b/pom.xml @@ -914,7 +914,7 @@ org.apache.tephra -tephra-hbase-compat-1.4 + tephra-hbase-compat-${tephra.hbase.compat.version} ${tephra.version} @@ -1188,6 +1188,7 @@ 1.5.0 ${hbase-1.6.runtime.version} +1.6 @@ -1202,6 +1203,7 @@ 1.3 1.3.0 ${hbase-1.3.runtime.version} +1.3 @@ -1216,6 +1218,7 @@ 1.4 1.4.0 ${hbase-1.4.runtime.version} +1.4 @@ -1230,6 +1233,7 @@ 1.5 1.5.0 ${hbase-1.5.runtime.version} +1.5 @@ -1246,6 +1250,7 @@ 1.5.0 ${hbase-1.6.runtime.version} +1.6
[phoenix] 03/04: PHOENIX-6427 Create sequence fails in lowercase schema
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.16 in repository https://gitbox.apache.org/repos/asf/phoenix.git commit a13cef02b34165f684977e0cdeab10fbd731bfb3 Author: Istvan Toth AuthorDate: Wed Mar 24 15:59:28 2021 +0100 PHOENIX-6427 Create sequence fails in lowercase schema --- .../apache/phoenix/end2end/BasePermissionsIT.java | 61 ++ .../org/apache/phoenix/end2end/SequenceIT.java | 29 ++ .../org/apache/phoenix/compile/FromCompiler.java | 2 +- 3 files changed, 91 insertions(+), 1 deletion(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java index 8f42040..2894f5a 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java @@ -1052,6 +1052,67 @@ public abstract class BasePermissionsIT extends BaseTest { } /** + * Test to verify READ permissions on table, indexes and views + * Tests automatic grant revoke of permissions per user on a table + */ +@Test +public void testReadPermsOnTableIndexAndViewOnLowerCaseSchema() throws Exception { +grantSystemTableAccess(superUser1, regularUser1, regularUser2, unprivilegedUser); + +schemaName = "\"" + schemaName.toLowerCase() + "\""; +fullTableName = schemaName + "." + tableName; + +// Create new schema and grant CREATE permissions to a user +if(isNamespaceMapped) { +verifyAllowed(createSchema(schemaName), superUser1); +verifyAllowed(grantPermissions("C", regularUser1, schemaName, true), superUser1); +} else { +verifyAllowed(grantPermissions("C", regularUser1, surroundWithDoubleQuotes(SchemaUtil.SCHEMA_FOR_DEFAULT_NAMESPACE), true), superUser1); +} + +// Create new table. Create indexes, views and view indexes on top of it. Verify the contents by querying it +verifyAllowed(createTable(fullTableName), regularUser1); +verifyAllowed(readTable(fullTableName), regularUser1); +verifyAllowed(createIndex(idx1TableName, fullTableName), regularUser1); +verifyAllowed(createIndex(idx2TableName, fullTableName), regularUser1); +verifyAllowed(createLocalIndex(localIdx1TableName, fullTableName), regularUser1); +verifyAllowed(createView(view1TableName, fullTableName), regularUser1); +verifyAllowed(createIndex(idx3TableName, view1TableName), regularUser1); + +// RegularUser2 doesn't have any permissions. It can get a PhoenixConnection +// However it cannot query table, indexes or views without READ perms +verifyAllowed(getConnectionAction(), regularUser2); +verifyDenied(readTable(fullTableName), AccessDeniedException.class, regularUser2); +verifyDenied(readTable(fullTableName, idx1TableName), AccessDeniedException.class, regularUser2); +verifyDenied(readTable(view1TableName), AccessDeniedException.class, regularUser2); +verifyDenied(readTableWithoutVerification(schemaName + "." + idx1TableName), AccessDeniedException.class, regularUser2); + +// Grant READ permissions to RegularUser2 on the table +// Permissions should propagate automatically to relevant physical tables such as global index and view index. +verifyAllowed(grantPermissions("RX", regularUser2, fullTableName, false), regularUser1); +// Granting permissions directly to index tables should fail +verifyDenied(grantPermissions("W", regularUser2, schemaName + "." + idx1TableName, false), AccessDeniedException.class, regularUser1); +// Granting permissions directly to views should fail. We expect TableNotFoundException since VIEWS are not physical tables +verifyDenied(grantPermissions("W", regularUser2, schemaName + "." + view1TableName, false), TableNotFoundException.class, regularUser1); + +// Verify that all other access are successful now +verifyAllowed(readTable(fullTableName), regularUser2); +verifyAllowed(readTable(fullTableName, idx1TableName), regularUser2); +verifyAllowed(readTable(fullTableName, idx2TableName), regularUser2); +verifyAllowed(readTable(fullTableName, localIdx1TableName), regularUser2); +verifyAllowed(readTableWithoutVerification(schemaName + "." + idx1TableName), regularUser2); +verifyAllowed(readTable(view1TableName), regularUser2); +verifyAllowed(readMultiTenantTableWithIndex(view1TableName), regularUser2); + +// Revoke READ permissions to RegularUser2 on the table +// Permissions should propagate automatically to relevant physical tables such as glob
[phoenix] 01/04: PHOENIX-6419 Unused getResolverForQuery() in QueryCompiler.verifySCN()
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.16 in repository https://gitbox.apache.org/repos/asf/phoenix.git commit 52755584e251d06c309b59a05e547f3585b7432b Author: Istvan Toth AuthorDate: Fri Mar 19 10:06:52 2021 +0100 PHOENIX-6419 Unused getResolverForQuery() in QueryCompiler.verifySCN() --- .../src/main/java/org/apache/phoenix/compile/QueryCompiler.java | 2 -- 1 file changed, 2 deletions(-) diff --git a/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java b/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java index 472b581..4042cc2 100644 --- a/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java +++ b/phoenix-core/src/main/java/org/apache/phoenix/compile/QueryCompiler.java @@ -180,8 +180,6 @@ public class QueryCompiler { if (scn == null) { return; } -ColumnResolver resolver = -FromCompiler.getResolverForQuery(select, conn); int maxLookBackAge = conn.getQueryServices(). getConfiguration().getInt(ScanInfoUtil.PHOENIX_MAX_LOOKBACK_AGE_CONF_KEY, ScanInfoUtil.DEFAULT_PHOENIX_MAX_LOOKBACK_AGE);
[phoenix] 04/04: PHOENIX-6357 Change all command line tools to use the fixed commons-cli constructor
This is an automated email from the ASF dual-hosted git repository. stoty pushed a commit to branch 4.16 in repository https://gitbox.apache.org/repos/asf/phoenix.git commit 35229a818f5ccd6b0f5d7bed2fc06aefbed2f7fd Author: Istvan Toth AuthorDate: Thu Mar 25 10:25:57 2021 +0100 PHOENIX-6357 Change all command line tools to use the fixed commons-cli constructor use the new DefaultParser(false, false) constructor introduced in the patched phoenix-thirdparty commons-cli library, to make sure that any quoted identifiers are passed from the command line to the rest of the code correctly. remove the double doublequote partial workaround, as it is no longer needed --- .../apache/phoenix/end2end/CsvBulkLoadToolIT.java | 8 ++--- .../phoenix/mapreduce/AbstractBulkLoadTool.java| 34 ++ .../apache/phoenix/mapreduce/OrphanViewTool.java | 4 +-- .../apache/phoenix/mapreduce/PhoenixTTLTool.java | 4 +-- .../phoenix/mapreduce/index/IndexScrutinyTool.java | 4 +-- .../apache/phoenix/mapreduce/index/IndexTool.java | 2 +- .../phoenix/mapreduce/index/IndexUpgradeTool.java | 4 +-- .../phoenix/schema/stats/UpdateStatisticsTool.java | 4 +-- .../util/MergeViewIndexIdSequencesTool.java| 4 +-- .../org/apache/phoenix/util/PhoenixRuntime.java| 4 +-- .../main/java/org/apache/phoenix/pherf/Pherf.java | 4 +-- .../phoenix/schema/SchemaExtractionTool.java | 4 +-- 12 files changed, 26 insertions(+), 54 deletions(-) diff --git a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java index 762d613..168f44b 100644 --- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java +++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/CsvBulkLoadToolIT.java @@ -203,8 +203,8 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { "--input", "/tmp/input8.csv", "--table", "table8", "--zookeeper", zkQuorum, -"-q", "\"\"", -"-e", "\"\"", +"-q", "", +"-e", "", "--delimiter", "\\t" }); assertEquals(0, exitCode); @@ -625,7 +625,7 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { csvBulkLoadTool.getConf().set(DATE_FORMAT_ATTRIB,"/MM/dd"); int exitCode = csvBulkLoadTool.run(new String[] { "--input", "/tmp/input1.csv", -"--table", "\"\"t\"\"", +"--table", "\"t\"", "--schema", "S", "--zookeeper", zkQuorum}); assertEquals(0, exitCode); @@ -660,7 +660,7 @@ public class CsvBulkLoadToolIT extends BaseOwnClusterIT { int exitCode = csvBulkLoadTool.run(new String[] { "--input", "/tmp/input1.csv", "--table", "T", -"--schema", "\"\"s\"\"", +"--schema", "\"s\"", "--zookeeper", zkQuorum}); assertEquals(0, exitCode); ResultSet rs = stmt.executeQuery("SELECT id, name, t FROM \"s\".T ORDER BY id"); diff --git a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java b/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java index d4582b6..bb1a343 100644 --- a/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java +++ b/phoenix-core/src/main/java/org/apache/phoenix/mapreduce/AbstractBulkLoadTool.java @@ -29,11 +29,11 @@ import java.util.UUID; import org.apache.phoenix.thirdparty.org.apache.commons.cli.CommandLine; import org.apache.phoenix.thirdparty.org.apache.commons.cli.CommandLineParser; +import org.apache.phoenix.thirdparty.org.apache.commons.cli.DefaultParser; import org.apache.phoenix.thirdparty.org.apache.commons.cli.HelpFormatter; import org.apache.phoenix.thirdparty.org.apache.commons.cli.Option; import org.apache.phoenix.thirdparty.org.apache.commons.cli.Options; import org.apache.phoenix.thirdparty.org.apache.commons.cli.ParseException; -import org.apache.phoenix.thirdparty.org.apache.commons.cli.PosixParser; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.conf.Configured; import org.apache.hadoop.fs.Path; @@ -123,7 +123,7 @@ public abstract class AbstractBulkLoadTool extends Configured implements Tool { Options options = getOptions(); -CommandLineParser parser = n
[phoenix] branch 4.16 updated (afbab2b -> 35229a8)
This is an automated email from the ASF dual-hosted git repository. stoty pushed a change to branch 4.16 in repository https://gitbox.apache.org/repos/asf/phoenix.git. from afbab2b PHOENIX-6442 Phoenix should depend on the appropriate tephra-hbase-compat-x.y module new 5275558 PHOENIX-6419 Unused getResolverForQuery() in QueryCompiler.verifySCN() new 1fc2bda PHOENIX-6422 Remove CorrelatePlan new a13cef0 PHOENIX-6427 Create sequence fails in lowercase schema new 35229a8 PHOENIX-6357 Change all command line tools to use the fixed commons-cli constructor The 4 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../apache/phoenix/end2end/BasePermissionsIT.java | 61 + .../apache/phoenix/end2end/CsvBulkLoadToolIT.java | 8 +- .../org/apache/phoenix/end2end/SequenceIT.java | 29 ++ .../org/apache/phoenix/compile/FromCompiler.java | 2 +- .../org/apache/phoenix/compile/QueryCompiler.java | 2 - .../org/apache/phoenix/execute/CorrelatePlan.java | 265 -- .../execute/visitor/AvgRowWidthVisitor.java| 6 - .../phoenix/execute/visitor/ByteCountVisitor.java | 6 - .../phoenix/execute/visitor/QueryPlanVisitor.java | 1 - .../phoenix/execute/visitor/RowCountVisitor.java | 11 - .../phoenix/mapreduce/AbstractBulkLoadTool.java| 34 +-- .../apache/phoenix/mapreduce/OrphanViewTool.java | 4 +- .../apache/phoenix/mapreduce/PhoenixTTLTool.java | 4 +- .../phoenix/mapreduce/index/IndexScrutinyTool.java | 4 +- .../apache/phoenix/mapreduce/index/IndexTool.java | 2 +- .../phoenix/mapreduce/index/IndexUpgradeTool.java | 4 +- .../phoenix/schema/stats/UpdateStatisticsTool.java | 4 +- .../util/MergeViewIndexIdSequencesTool.java| 4 +- .../org/apache/phoenix/util/PhoenixRuntime.java| 4 +- .../apache/phoenix/compile/QueryCompilerTest.java | 6 - .../apache/phoenix/execute/CorrelatePlanTest.java | 299 - .../main/java/org/apache/phoenix/pherf/Pherf.java | 4 +- .../phoenix/schema/SchemaExtractionTool.java | 4 +- 23 files changed, 117 insertions(+), 651 deletions(-) delete mode 100644 phoenix-core/src/main/java/org/apache/phoenix/execute/CorrelatePlan.java delete mode 100644 phoenix-core/src/test/java/org/apache/phoenix/execute/CorrelatePlanTest.java