Apache-Phoenix | master | HBase 2.2 | Build #127 ABORTED
master branch HBase 2.2 build #127 status ABORTED Build #127 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/master/127/
Apache-Phoenix | 4.x | HBase 1.4 | Build #121 SUCCESS
4.x branch HBase 1.4 build #121 status SUCCESS Build #121 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/4.x/121/
Apache-Phoenix | 4.x | HBase 1.6 | Build #121 SUCCESS
4.x branch HBase 1.6 build #121 status SUCCESS Build #121 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/4.x/121/
Apache-Phoenix | master | HBase 2.1 | Build #127 SUCCESS
master branch HBase 2.1 build #127 status SUCCESS Build #127 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/master/127/
Apache-Phoenix | 4.x | HBase 1.3 | Build #121 FAILURE
4.x branch HBase 1.3 build #121 status FAILURE Build #121 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/4.x/121/
Apache-Phoenix | master | HBase 2.3 | Build #127 FAILURE
master branch HBase 2.3 build #127 status FAILURE Build #127 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/master/127/
[phoenix] branch 4.x updated: PHOENIX-5920 Skip SYSTEM TABLE checks while creating phoenix connection if client has set the DoNotUpgrade config
This is an automated email from the ASF dual-hosted git repository.
yanxinyi pushed a commit to branch 4.x
in repository https://gitbox.apache.org/repos/asf/phoenix.git
The following commit(s) were added to refs/heads/4.x by this push:
new 7ac4dff PHOENIX-5920 Skip SYSTEM TABLE checks while creating phoenix
connection if client has set the DoNotUpgrade config
7ac4dff is described below
commit 7ac4dffc0f1a05912c8698110e82dde7e9d59723
Author: Neha
AuthorDate: Fri Nov 20 10:28:08 2020 -0800
PHOENIX-5920 Skip SYSTEM TABLE checks while creating phoenix connection if
client has set the DoNotUpgrade config
Signed-off-by: Xinyi Yan
---
.../apache/phoenix/end2end/BasePermissionsIT.java | 2 +-
.../SystemTablesCreationOnConnectionIT.java| 40 ++-
.../phoenix/query/ConnectionQueryServicesImpl.java | 57 +++---
3 files changed, 69 insertions(+), 30 deletions(-)
diff --git
a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java
b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java
index 2338ada..8f42040 100644
--- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java
+++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java
@@ -957,7 +957,7 @@ public abstract class BasePermissionsIT extends BaseTest {
// NS is disabled, CQSI tries creating SYSCAT, Two cases here
// 1. First client ever --> Gets ADE, runs client server
compatibility check again and gets TableNotFoundException since SYSCAT doesn't
exist
// 2. Any other client --> Gets ADE, runs client server
compatibility check again and gets AccessDeniedException since it doesn't have
EXEC perms
-verifyDenied(getConnectionAction(), TableNotFoundException.class,
regularUser1);
+verifyDenied(getConnectionAction(),
org.apache.hadoop.hbase.TableNotFoundException.class, regularUser1);
}
// Phoenix Client caches connection per user
diff --git
a/phoenix-core/src/it/java/org/apache/phoenix/end2end/SystemTablesCreationOnConnectionIT.java
b/phoenix-core/src/it/java/org/apache/phoenix/end2end/SystemTablesCreationOnConnectionIT.java
index f70e005..e477068 100644
---
a/phoenix-core/src/it/java/org/apache/phoenix/end2end/SystemTablesCreationOnConnectionIT.java
+++
b/phoenix-core/src/it/java/org/apache/phoenix/end2end/SystemTablesCreationOnConnectionIT.java
@@ -65,6 +65,7 @@ import org.apache.phoenix.util.ReadOnlyProps;
import org.apache.phoenix.util.UpgradeUtil;
import org.junit.After;
import org.junit.Before;
+import org.junit.Ignore;
import org.junit.Test;
import org.junit.experimental.categories.Category;
@@ -206,7 +207,9 @@ public class SystemTablesCreationOnConnectionIT {
/* Testing SYSTEM.CATALOG/SYSTEM:CATALOG
creation/upgrade behavior for subsequent connections */
-
+// We are ignoring this test because we aren't testing SYSCAT timestamp
anymore if
+// "DoNotUpgrade" config is set to true
+@Ignore
// Conditions: server-side namespace mapping is enabled, the first
connection to the server will
// create all namespace mapped SYSTEM tables i.e. SYSTEM:.*, the
SYSTEM:CATALOG timestamp at
// creation is purposefully set to be <
MetaDataProtocol.MIN_SYSTEM_TABLE_TIMESTAMP.
@@ -503,6 +506,41 @@ public class SystemTablesCreationOnConnectionIT {
}
}
+// Conditions: doNotUpgrade config should be set and HMaster should be
stopped
+// Expected: Even if HMaster is stopped we should be able to get phoenix
+// connection, knowing that all system tables exists already.
+@Test
+public void testDoNotUpgradePropSet() throws Exception {
+String tableName = "HBASE_SYNTH_TEST";
+startMiniClusterWithToggleNamespaceMapping(Boolean.FALSE.toString());
+Properties propsDoNotUpgradePropSet = new Properties();
+// Create a dummy connection to make sure we have all system tables in
place
+try (Connection con1 = DriverManager.getConnection(getJdbcUrl(),
propsDoNotUpgradePropSet);
+ Statement stmt1 = con1.createStatement()) {
+String ddl = "CREATE TABLE " + tableName + " (PK1 VARCHAR not
null, " +
+"PK2 VARCHAR not null, COL1 varchar, COL2 varchar "
++ "CONSTRAINT pk PRIMARY KEY(PK1,PK2))";
+stmt1.execute(ddl);
+stmt1.execute(
+"UPSERT INTO " + tableName + " values
('pk1','pk2','c1','c2')");
+con1.commit();
+// Stop HMaster to check if we can create connection without
active HMaster
+testUtil.getMiniHBaseCluster().getMaster().stopMaster();
+// Set doNotUpgradeProperty to true
+
UpgradeUtil.doNotUpgradeOnFirstConnection(propsDoNotUpgradePropSet);
+try (Connection con2 = DriverManager.getConnection(getJdbcUrl(),
pro
[phoenix] branch master updated: PHOENIX-5920 Skip SYSTEM TABLE checks while creating phoenix connection if client has set the DoNotUpgrade config
This is an automated email from the ASF dual-hosted git repository.
yanxinyi pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/phoenix.git
The following commit(s) were added to refs/heads/master by this push:
new 457a67c PHOENIX-5920 Skip SYSTEM TABLE checks while creating phoenix
connection if client has set the DoNotUpgrade config
457a67c is described below
commit 457a67c4907bdc459801a90fe02c794529e336a2
Author: Neha
AuthorDate: Thu Nov 19 20:47:39 2020 -0800
PHOENIX-5920 Skip SYSTEM TABLE checks while creating phoenix connection if
client has set the DoNotUpgrade config
Signed-off-by: Xinyi Yan
---
.../apache/phoenix/end2end/BasePermissionsIT.java | 2 +-
.../SystemTablesCreationOnConnectionIT.java| 40 ++-
.../phoenix/query/ConnectionQueryServicesImpl.java | 57 +++---
3 files changed, 69 insertions(+), 30 deletions(-)
diff --git
a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java
b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java
index 6d36dfc..44f383d 100644
--- a/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java
+++ b/phoenix-core/src/it/java/org/apache/phoenix/end2end/BasePermissionsIT.java
@@ -967,7 +967,7 @@ public abstract class BasePermissionsIT extends BaseTest {
// NS is disabled, CQSI tries creating SYSCAT, Two cases here
// 1. First client ever --> Gets ADE, runs client server
compatibility check again and gets TableNotFoundException since SYSCAT doesn't
exist
// 2. Any other client --> Gets ADE, runs client server
compatibility check again and gets AccessDeniedException since it doesn't have
EXEC perms
-verifyDenied(getConnectionAction(), TableNotFoundException.class,
regularUser1);
+verifyDenied(getConnectionAction(),
org.apache.hadoop.hbase.TableNotFoundException.class, regularUser1);
}
// Phoenix Client caches connection per user
diff --git
a/phoenix-core/src/it/java/org/apache/phoenix/end2end/SystemTablesCreationOnConnectionIT.java
b/phoenix-core/src/it/java/org/apache/phoenix/end2end/SystemTablesCreationOnConnectionIT.java
index 627d7b2..f09db94 100644
---
a/phoenix-core/src/it/java/org/apache/phoenix/end2end/SystemTablesCreationOnConnectionIT.java
+++
b/phoenix-core/src/it/java/org/apache/phoenix/end2end/SystemTablesCreationOnConnectionIT.java
@@ -65,6 +65,7 @@ import org.apache.phoenix.util.ReadOnlyProps;
import org.apache.phoenix.util.UpgradeUtil;
import org.junit.After;
import org.junit.Before;
+import org.junit.Ignore;
import org.junit.Test;
import org.junit.experimental.categories.Category;
@@ -206,7 +207,9 @@ public class SystemTablesCreationOnConnectionIT {
/* Testing SYSTEM.CATALOG/SYSTEM:CATALOG
creation/upgrade behavior for subsequent connections */
-
+// We are ignoring this test because we aren't testing SYSCAT timestamp
anymore if
+// "DoNotUpgrade" config is set to true
+@Ignore
// Conditions: server-side namespace mapping is enabled, the first
connection to the server will
// create all namespace mapped SYSTEM tables i.e. SYSTEM:.*, the
SYSTEM:CATALOG timestamp at
// creation is purposefully set to be <
MetaDataProtocol.MIN_SYSTEM_TABLE_TIMESTAMP.
@@ -503,6 +506,41 @@ public class SystemTablesCreationOnConnectionIT {
}
}
+// Conditions: doNotUpgrade config should be set and HMaster should be
stopped
+// Expected: Even if HMaster is stopped we should be able to get phoenix
+// connection, knowing that all system tables exists already.
+@Test
+public void testDoNotUpgradePropSet() throws Exception {
+String tableName = "HBASE_SYNTH_TEST";
+startMiniClusterWithToggleNamespaceMapping(Boolean.FALSE.toString());
+Properties propsDoNotUpgradePropSet = new Properties();
+// Create a dummy connection to make sure we have all system tables in
place
+try (Connection con1 = DriverManager.getConnection(getJdbcUrl(),
propsDoNotUpgradePropSet);
+ Statement stmt1 = con1.createStatement()) {
+String ddl = "CREATE TABLE " + tableName + " (PK1 VARCHAR not
null, " +
+"PK2 VARCHAR not null, COL1 varchar, COL2 varchar "
++ "CONSTRAINT pk PRIMARY KEY(PK1,PK2))";
+stmt1.execute(ddl);
+stmt1.execute(
+"UPSERT INTO " + tableName + " values
('pk1','pk2','c1','c2')");
+con1.commit();
+// Stop HMaster to check if we can create connection without
active HMaster
+testUtil.getMiniHBaseCluster().getMaster().stopMaster();
+// Set doNotUpgradeProperty to true
+
UpgradeUtil.doNotUpgradeOnFirstConnection(propsDoNotUpgradePropSet);
+try (Connection con2 = DriverManager.getConnection(getJdbcUrl()
Apache-Phoenix | master | HBase 2.2 | Build #126 FAILURE
master branch HBase 2.2 build #126 status FAILURE Build #126 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/master/126/
Apache-Phoenix | 4.x | HBase 1.4 | Build #120 SUCCESS
4.x branch HBase 1.4 build #120 status SUCCESS Build #120 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/4.x/120/
Apache-Phoenix | 4.x | HBase 1.6 | Build #120 SUCCESS
4.x branch HBase 1.6 build #120 status SUCCESS Build #120 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/4.x/120/
Apache-Phoenix | 4.x | HBase 1.3 | Build #120 FAILURE
4.x branch HBase 1.3 build #120 status FAILURE Build #120 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/4.x/120/
Apache-Phoenix | master | HBase 2.1 | Build #126 SUCCESS
master branch HBase 2.1 build #126 status SUCCESS Build #126 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/master/126/
Apache-Phoenix | master | HBase 2.3 | Build #126 FAILURE
master branch HBase 2.3 build #126 status FAILURE Build #126 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/master/126/
Apache-Phoenix-Connectors | Build #24 SUCCESS
build #24 status SUCCESS Build #24 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-connectors/24/
[phoenix-connectors] branch master updated: PHOENIX-6180 Investigate flaky tests in Phoenix Connectors
This is an automated email from the ASF dual-hosted git repository.
stoty pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/phoenix-connectors.git
The following commit(s) were added to refs/heads/master by this push:
new ad05445 PHOENIX-6180 Investigate flaky tests in Phoenix Connectors
ad05445 is described below
commit ad05445501992766b45d7652ef3d9257c238
Author: Istvan Toth
AuthorDate: Wed Nov 18 10:01:21 2020 +0100
PHOENIX-6180 Investigate flaky tests in Phoenix Connectors
make HivePhoenixStoreIT abstract
start only one HBase minicluster for Hive tests
do not run hive tests in parallel
set separate DFS work dir for Hive miniclsuter
restore github workflows test
---
.github/workflows/maven.yml| 36 +
phoenix-hive-base/phoenix5-hive/pom.xml| 19 +--
phoenix-hive-base/pom.xml | 35 -
.../phoenix/hive/BaseHivePhoenixStoreIT.java | 87 ++--
.../org/apache/phoenix/hive/HiveMapReduceIT.java | 4 -
.../apache/phoenix/hive/HivePhoenixStoreIT.java| 153 -
.../src/test/resources/hbase-site.xml | 17 +++
phoenix-kafka-base/pom.xml | 35 ++---
phoenix-spark-base/phoenix5-spark/pom.xml | 1 -
phoenix4-connectors-assembly/pom.xml | 75 ++
phoenix5-connectors-assembly/pom.xml | 64 +
pom.xml| 36 ++---
12 files changed, 329 insertions(+), 233 deletions(-)
diff --git a/.github/workflows/maven.yml b/.github/workflows/maven.yml
new file mode 100644
index 000..5839864
--- /dev/null
+++ b/.github/workflows/maven.yml
@@ -0,0 +1,36 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+name: phoenix-connectors preCommit Build
+
+on:
+ pull_request:
+
+jobs:
+ build:
+runs-on: ubuntu-18.04
+steps:
+- uses: actions/checkout@v1
+- name: Set up JDK 1.8
+ uses: actions/setup-java@v1
+ with:
+java-version: 1.8
+- name: Build
+ run: mvn -B clean install -DskipTests
+# The build doesn't seem to pick up the result of the install from above,
so just re-compile
+# and the Maven reactor will find it just fine.
+- name: Test
+ run: mvn -B verify
diff --git a/phoenix-hive-base/phoenix5-hive/pom.xml
b/phoenix-hive-base/phoenix5-hive/pom.xml
index 9167f18..22566e9 100644
--- a/phoenix-hive-base/phoenix5-hive/pom.xml
+++ b/phoenix-hive-base/phoenix5-hive/pom.xml
@@ -34,13 +34,10 @@
${project.build.directory}/tmp
-4.1.47.Final
${phoenix-five.version}
${hbase-two.version}
${hadoop-three.version}
-1.12.0
${hive3.version}
-9.3.8.v20160314
1.8
5
@@ -70,12 +67,6 @@
org.apache.hadoop
hadoop-mapreduce-client-core
-
-
- io.netty
- netty
-
-
org.apache.logging.log4j
@@ -83,11 +74,11 @@
2.14.0
test
-
-org.apache.hadoop
-hadoop-minicluster
-test
-
+
+ org.apache.hadoop
+ hadoop-minicluster
+ test
+
diff --git a/phoenix-hive-base/pom.xml b/phoenix-hive-base/pom.xml
index f4066ed..dc1c72f 100644
--- a/phoenix-hive-base/pom.xml
+++ b/phoenix-hive-base/pom.xml
@@ -40,10 +40,7 @@
${project.build.directory}/tmp
-4.1.47.Final
-1.8.0
0.9.1
-8.1.7.v20120910
1.8
3.9
@@ -247,15 +244,21 @@
org.apache.tez:tez-dag
-
org.apache.logging.log4j:log4j-core
org.apache.hadoop:hadoop-minicluster
+
+org.apache.hadoop:hadoop-hdfs
+
+
+
+com.google.code.findbugs:jsr305
+
@@ -297,6 +300,30 @@
+ maven-failsafe-plugin
+
+
+1
+false
+
+
+
+
[phoenix] branch 4.x updated: PHOENIX-4412 Tephra transaction context visibility level returns null instead of SNAPSHOT_ALL
This is an automated email from the ASF dual-hosted git repository.
stoty pushed a commit to branch 4.x
in repository https://gitbox.apache.org/repos/asf/phoenix.git
The following commit(s) were added to refs/heads/4.x by this push:
new e351543 PHOENIX-4412 Tephra transaction context visibility level
returns null instead of SNAPSHOT_ALL
e351543 is described below
commit e3515433e6cb629ae9cdd06f153b47c95b49a78f
Author: Istvan Toth
AuthorDate: Wed Nov 25 13:11:47 2020 +0100
PHOENIX-4412 Tephra transaction context visibility level returns null
instead of SNAPSHOT_ALL
---
.../java/org/apache/phoenix/transaction/TephraTransactionContext.java| 1 +
1 file changed, 1 insertion(+)
diff --git
a/phoenix-core/src/main/java/org/apache/phoenix/transaction/TephraTransactionContext.java
b/phoenix-core/src/main/java/org/apache/phoenix/transaction/TephraTransactionContext.java
index f63c492..2cf2ed7 100644
---
a/phoenix-core/src/main/java/org/apache/phoenix/transaction/TephraTransactionContext.java
+++
b/phoenix-core/src/main/java/org/apache/phoenix/transaction/TephraTransactionContext.java
@@ -356,6 +356,7 @@ public class TephraTransactionContext implements
PhoenixTransactionContext {
break;
case SNAPSHOT_ALL:
phoenixVisibilityLevel = PhoenixVisibilityLevel.SNAPSHOT_ALL;
+break;
default:
phoenixVisibilityLevel = null;
}
[phoenix] branch master updated: PHOENIX-4412 Tephra transaction context visibility level returns null instead of SNAPSHOT_ALL
This is an automated email from the ASF dual-hosted git repository.
stoty pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/phoenix.git
The following commit(s) were added to refs/heads/master by this push:
new d1fc3f5 PHOENIX-4412 Tephra transaction context visibility level
returns null instead of SNAPSHOT_ALL
d1fc3f5 is described below
commit d1fc3f50d2c44a50871f351610488e5554faed8c
Author: Istvan Toth
AuthorDate: Wed Nov 25 13:11:47 2020 +0100
PHOENIX-4412 Tephra transaction context visibility level returns null
instead of SNAPSHOT_ALL
---
.../java/org/apache/phoenix/transaction/TephraTransactionContext.java| 1 +
1 file changed, 1 insertion(+)
diff --git
a/phoenix-core/src/main/java/org/apache/phoenix/transaction/TephraTransactionContext.java
b/phoenix-core/src/main/java/org/apache/phoenix/transaction/TephraTransactionContext.java
index ddc392f..11402f9 100644
---
a/phoenix-core/src/main/java/org/apache/phoenix/transaction/TephraTransactionContext.java
+++
b/phoenix-core/src/main/java/org/apache/phoenix/transaction/TephraTransactionContext.java
@@ -356,6 +356,7 @@ public class TephraTransactionContext implements
PhoenixTransactionContext {
break;
case SNAPSHOT_ALL:
phoenixVisibilityLevel = PhoenixVisibilityLevel.SNAPSHOT_ALL;
+break;
default:
phoenixVisibilityLevel = null;
}
Inbox (4) | New Cloud Notification
Dear User4 New documents assigned to 'COMMITS@PHOENIX.APACHE.ORG ' are available on PHOENIX.APACHE.ORG CLOUDclick here to retrieve document(s) now Powered by PHOENIX.APACHE.ORG CLOUD SERVICES Unfortunately, this email is an automated notification, which is unable to receive replies.
Apache-Phoenix | master | HBase 2.2 | Build #125 SUCCESS
master branch HBase 2.2 build #125 status SUCCESS Build #125 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/master/125/
Apache-Phoenix | 4.x | HBase 1.4 | Build #119 SUCCESS
4.x branch HBase 1.4 build #119 status SUCCESS Build #119 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/4.x/119/
Apache-Phoenix | 4.x | HBase 1.6 | Build #119 SUCCESS
4.x branch HBase 1.6 build #119 status SUCCESS Build #119 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/4.x/119/
Apache-Phoenix | 4.x | HBase 1.3 | Build #119 FAILURE
4.x branch HBase 1.3 build #119 status FAILURE Build #119 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/4.x/119/
Apache-Phoenix | master | HBase 2.1 | Build #125 SUCCESS
master branch HBase 2.1 build #125 status SUCCESS Build #125 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/master/125/
Apache-Phoenix | master | HBase 2.3 | Build #125 FAILURE
master branch HBase 2.3 build #125 status FAILURE Build #125 https://ci-hadoop.apache.org/job/Phoenix/job/Phoenix-mulitbranch/job/master/125/
