Apache-Phoenix | 4.x-HBase-0.98 | Build Successful

2017-01-30 Thread Apache Jenkins Server 
4.x-HBase-0.98 branch build status Successful

Source repository https://git-wip-us.apache.org/repos/asf?p=phoenix.git;a=shortlog;h=refs/heads/4.x-HBase-0.98

Compiled Artifacts https://builds.apache.org/job/Phoenix-4.x-HBase-0.98/lastSuccessfulBuild/artifact/

Test Report https://builds.apache.org/job/Phoenix-4.x-HBase-0.98/lastCompletedBuild/testReport/

Changes
[ankitsinghal59] PHOENIX-3271 Distribute UPSERT SELECT across cluster



Build times for last couple of runsLatest build time is the right most | Legend blue: normal, red: test failure, gray: timeout

Build failed in Jenkins: Phoenix | Master #1543

2017-01-30 Thread Apache Jenkins Server 
See 

Changes:

[ankitsinghal59] PHOENIX-3271 Distribute UPSERT SELECT across cluster

--
[...truncated 941 lines...]
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.695 sec - in 
org.apache.phoenix.execute.PartialCommitIT
Running org.apache.phoenix.hbase.index.covered.example.FailWithoutRetriesIT
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.214 sec - in 
org.apache.phoenix.hbase.index.covered.EndToEndCoveredColumnsIndexBuilderIT
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.019 sec - in 
org.apache.phoenix.hbase.index.covered.example.FailWithoutRetriesIT
Running org.apache.phoenix.hbase.index.covered.example.EndToEndCoveredIndexingIT
Running 
org.apache.phoenix.hbase.index.covered.example.EndtoEndIndexingWithCompressionIT
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 60.004 sec - in 
org.apache.phoenix.end2end.index.txn.TxWriteFailureIT
Running org.apache.phoenix.iterate.RoundRobinResultIteratorWithStatsIT
Running org.apache.phoenix.iterate.ScannerLeaseRenewalIT
Tests run: 26, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 214.582 sec - 
in org.apache.phoenix.end2end.index.LocalIndexIT
Running org.apache.phoenix.monitoring.PhoenixMetricsIT
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.607 sec - in 
org.apache.phoenix.iterate.RoundRobinResultIteratorWithStatsIT
Running org.apache.phoenix.rpc.PhoenixClientRpcIT
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.424 sec - in 
org.apache.phoenix.rpc.PhoenixClientRpcIT
Running org.apache.phoenix.rpc.PhoenixServerRpcIT
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.395 sec - in 
org.apache.phoenix.rpc.PhoenixServerRpcIT
Tests run: 8, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 262.206 sec <<< 
FAILURE! - in org.apache.phoenix.end2end.index.MutableIndexFailureIT
testWriteFailureDisablesIndex[MutableIndexFailureIT_transactional=false,localIndex=true,isNamespaceMapped=true](org.apache.phoenix.end2end.index.MutableIndexFailureIT)
  Time elapsed: 16.045 sec  <<< ERROR!
org.apache.phoenix.execute.CommitException: 
org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 1 
action: org.apache.hadoop.hbase.DoNotRetryIOException: Failed 2 actions: 
org.apache.hadoop.hbase.DoNotRetryIOException
at 
org.apache.phoenix.end2end.index.MutableIndexFailureIT$FailingRegionObserver.preBatchMutate(MutableIndexFailureIT.java:407)
at 
org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$35.call(RegionCoprocessorHost.java:1007)
at 
org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$RegionOperation.call(RegionCoprocessorHost.java:1673)
at 
org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperation(RegionCoprocessorHost.java:1749)
at 
org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.execOperation(RegionCoprocessorHost.java:1705)
at 
org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.preBatchMutate(RegionCoprocessorHost.java:1003)
at 
org.apache.hadoop.hbase.regionserver.HRegion.doMiniBatchMutation(HRegion.java:3080)
at 
org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2867)
at 
org.apache.hadoop.hbase.regionserver.HRegion.batchMutate(HRegion.java:2809)
at 
org.apache.hadoop.hbase.regionserver.RSRpcServices.doBatchOp(RSRpcServices.java:751)
at 
org.apache.hadoop.hbase.regionserver.RSRpcServices.doNonAtomicRegionMutation(RSRpcServices.java:713)
at 
org.apache.hadoop.hbase.regionserver.RSRpcServices.multi(RSRpcServices.java:2148)
at 
org.apache.hadoop.hbase.client.MultiServerCallable.call(MultiServerCallable.java:128)
at 
org.apache.hadoop.hbase.client.MultiServerCallable.call(MultiServerCallable.java:53)
at 
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200)
at 
org.apache.hadoop.hbase.client.AsyncProcess$AsyncRequestFutureImpl$SingleServerRequestRunnable.run(AsyncProcess.java:733)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
: 2 times, 
at 
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:73)
at 
org.apache.phoenix.index.PhoenixIndexFailurePolicy.handleFailure(PhoenixIndexFailurePolicy.java:105)
at 
org.apache.phoenix.hbase.index.write.IndexWriter.writeAndKillYourselfOnFailure(IndexWriter.java:151)
at 
org.apache.phoenix.hbase.index.write.IndexWriter.writeAndKillYourselfOnFailure(IndexWriter.java:135)

phoenix git commit: PHOENIX-3271 Distribute UPSERT SELECT across cluster

2017-01-30 Thread ankit 
Repository: phoenix
Updated Branches:
  refs/heads/4.x-HBase-0.98 198ad6fcb -> accd4a276


PHOENIX-3271 Distribute UPSERT SELECT across cluster


Project: http://git-wip-us.apache.org/repos/asf/phoenix/repo
Commit: http://git-wip-us.apache.org/repos/asf/phoenix/commit/accd4a27
Tree: http://git-wip-us.apache.org/repos/asf/phoenix/tree/accd4a27
Diff: http://git-wip-us.apache.org/repos/asf/phoenix/diff/accd4a27

Branch: refs/heads/4.x-HBase-0.98
Commit: accd4a276d1085e5d1069caf93798d8f301e4ed6
Parents: 198ad6f
Author: Ankit Singhal 
Authored: Tue Jan 31 11:53:42 2017 +0530
Committer: Ankit Singhal 
Committed: Tue Jan 31 11:53:42 2017 +0530

--
 .../phoenix/monitoring/PhoenixMetricsIT.java| 56 ---
 .../apache/phoenix/rpc/PhoenixServerRpcIT.java  |  6 ++
 .../apache/phoenix/compile/UpsertCompiler.java  | 38 
 .../UngroupedAggregateRegionObserver.java   | 97 ++--
 .../org/apache/phoenix/schema/PTableImpl.java   | 10 ++
 5 files changed, 138 insertions(+), 69 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/phoenix/blob/accd4a27/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
--
diff --git 
a/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java 
b/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
index 16a66df..4d075ab 100644
--- 
a/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
+++ 
b/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
@@ -439,18 +439,31 @@ public class PhoenixMetricsIT extends 
BaseUniqueNamesOwnClusterIT {
 public void testMetricsForUpsertSelectWithAutoCommit() throws Exception {
 String tableName1 = generateUniqueName();
 long table1SaltBuckets = 6;
-String ddl = "CREATE TABLE " + tableName1 + " (K VARCHAR NOT NULL 
PRIMARY KEY, V VARCHAR)" + " SALT_BUCKETS = "
-+ table1SaltBuckets;
+String ddl = "CREATE TABLE " + tableName1 + " (K BIGINT NOT NULL 
PRIMARY KEY ROW_TIMESTAMP, V VARCHAR)"
++ " SALT_BUCKETS = " + table1SaltBuckets + ", IMMUTABLE_ROWS = 
true";
 Connection ddlConn = DriverManager.getConnection(getUrl());
 ddlConn.createStatement().execute(ddl);
 ddlConn.close();
 int numRows = 10;
-insertRowsInTable(tableName1, numRows);
+String dml = "UPSERT INTO " + tableName1 + " VALUES (?, ?)";
+try (Connection conn = DriverManager.getConnection(getUrl())) {
+PreparedStatement stmt = conn.prepareStatement(dml);
+for (int i = 1; i <= numRows; i++) {
+stmt.setLong(1, i);
+stmt.setString(2, "value" + i);
+stmt.executeUpdate();
+}
+conn.commit();
+}
 
 String tableName2 = generateUniqueName();
-ddl = "CREATE TABLE " + tableName2 + " (K VARCHAR NOT NULL PRIMARY 
KEY, V VARCHAR)" + " SALT_BUCKETS = 10";
+ddl = "CREATE TABLE " + tableName2 + " (K BIGINT NOT NULL PRIMARY KEY 
ROW_TIMESTAMP, V VARCHAR)"
++ " SALT_BUCKETS = 10" + ", IMMUTABLE_ROWS = true";
 ddlConn = DriverManager.getConnection(getUrl());
 ddlConn.createStatement().execute(ddl);
+String indexName = generateUniqueName();
+ddl = "CREATE INDEX " + indexName + " ON " + tableName2 + " (V)";
+ddlConn.createStatement().execute(ddl);
 ddlConn.close();
 
 String upsertSelect = "UPSERT INTO " + tableName2 + " SELECT * FROM " 
+ tableName1;
@@ -602,41 +615,6 @@ public class PhoenixMetricsIT extends 
BaseUniqueNamesOwnClusterIT {
 }
 
 @Test
-public void testMetricsForUpsertSelectSameTable() throws Exception {
-String tableName = generateUniqueName();
-long table1SaltBuckets = 6;
-String ddl = "CREATE TABLE " + tableName + " (K VARCHAR NOT NULL 
PRIMARY KEY, V VARCHAR)" + " SALT_BUCKETS = "
-+ table1SaltBuckets;
-Connection ddlConn = DriverManager.getConnection(getUrl());
-ddlConn.createStatement().execute(ddl);
-ddlConn.close();
-int numRows = 10;
-insertRowsInTable(tableName, numRows);
-
-Connection conn = DriverManager.getConnection(getUrl());
-conn.setAutoCommit(false);
-String upsertSelect = "UPSERT INTO " + tableName + " SELECT * FROM " + 
tableName;
-conn.createStatement().executeUpdate(upsertSelect);
-conn.commit();
-PhoenixConnection pConn = conn.unwrap(PhoenixConnection.class);
-
-Map> mutationMetrics = 
PhoenixRuntime.getWriteMetricsForMutationsSinceLastReset(pConn);
-// Because auto-commit is off, upsert select into the same table will 
run on the client.
-// So we

phoenix git commit: PHOENIX-3271 Distribute UPSERT SELECT across cluster

2017-01-30 Thread ankit 
Repository: phoenix
Updated Branches:
  refs/heads/master 069c371ae -> 39460bc47


PHOENIX-3271 Distribute UPSERT SELECT across cluster


Project: http://git-wip-us.apache.org/repos/asf/phoenix/repo
Commit: http://git-wip-us.apache.org/repos/asf/phoenix/commit/39460bc4
Tree: http://git-wip-us.apache.org/repos/asf/phoenix/tree/39460bc4
Diff: http://git-wip-us.apache.org/repos/asf/phoenix/diff/39460bc4

Branch: refs/heads/master
Commit: 39460bc470d77f173d40b17f87a82c259bff5027
Parents: 069c371
Author: Ankit Singhal 
Authored: Tue Jan 31 11:46:53 2017 +0530
Committer: Ankit Singhal 
Committed: Tue Jan 31 11:46:53 2017 +0530

--
 .../phoenix/monitoring/PhoenixMetricsIT.java| 56 ---
 .../apache/phoenix/rpc/PhoenixServerRpcIT.java  |  6 ++
 .../apache/phoenix/compile/UpsertCompiler.java  | 38 
 .../UngroupedAggregateRegionObserver.java   | 97 ++--
 .../org/apache/phoenix/schema/PTableImpl.java   | 10 ++
 5 files changed, 138 insertions(+), 69 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/phoenix/blob/39460bc4/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
--
diff --git 
a/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java 
b/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
index 16a66df..4d075ab 100644
--- 
a/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
+++ 
b/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
@@ -439,18 +439,31 @@ public class PhoenixMetricsIT extends 
BaseUniqueNamesOwnClusterIT {
 public void testMetricsForUpsertSelectWithAutoCommit() throws Exception {
 String tableName1 = generateUniqueName();
 long table1SaltBuckets = 6;
-String ddl = "CREATE TABLE " + tableName1 + " (K VARCHAR NOT NULL 
PRIMARY KEY, V VARCHAR)" + " SALT_BUCKETS = "
-+ table1SaltBuckets;
+String ddl = "CREATE TABLE " + tableName1 + " (K BIGINT NOT NULL 
PRIMARY KEY ROW_TIMESTAMP, V VARCHAR)"
++ " SALT_BUCKETS = " + table1SaltBuckets + ", IMMUTABLE_ROWS = 
true";
 Connection ddlConn = DriverManager.getConnection(getUrl());
 ddlConn.createStatement().execute(ddl);
 ddlConn.close();
 int numRows = 10;
-insertRowsInTable(tableName1, numRows);
+String dml = "UPSERT INTO " + tableName1 + " VALUES (?, ?)";
+try (Connection conn = DriverManager.getConnection(getUrl())) {
+PreparedStatement stmt = conn.prepareStatement(dml);
+for (int i = 1; i <= numRows; i++) {
+stmt.setLong(1, i);
+stmt.setString(2, "value" + i);
+stmt.executeUpdate();
+}
+conn.commit();
+}
 
 String tableName2 = generateUniqueName();
-ddl = "CREATE TABLE " + tableName2 + " (K VARCHAR NOT NULL PRIMARY 
KEY, V VARCHAR)" + " SALT_BUCKETS = 10";
+ddl = "CREATE TABLE " + tableName2 + " (K BIGINT NOT NULL PRIMARY KEY 
ROW_TIMESTAMP, V VARCHAR)"
++ " SALT_BUCKETS = 10" + ", IMMUTABLE_ROWS = true";
 ddlConn = DriverManager.getConnection(getUrl());
 ddlConn.createStatement().execute(ddl);
+String indexName = generateUniqueName();
+ddl = "CREATE INDEX " + indexName + " ON " + tableName2 + " (V)";
+ddlConn.createStatement().execute(ddl);
 ddlConn.close();
 
 String upsertSelect = "UPSERT INTO " + tableName2 + " SELECT * FROM " 
+ tableName1;
@@ -602,41 +615,6 @@ public class PhoenixMetricsIT extends 
BaseUniqueNamesOwnClusterIT {
 }
 
 @Test
-public void testMetricsForUpsertSelectSameTable() throws Exception {
-String tableName = generateUniqueName();
-long table1SaltBuckets = 6;
-String ddl = "CREATE TABLE " + tableName + " (K VARCHAR NOT NULL 
PRIMARY KEY, V VARCHAR)" + " SALT_BUCKETS = "
-+ table1SaltBuckets;
-Connection ddlConn = DriverManager.getConnection(getUrl());
-ddlConn.createStatement().execute(ddl);
-ddlConn.close();
-int numRows = 10;
-insertRowsInTable(tableName, numRows);
-
-Connection conn = DriverManager.getConnection(getUrl());
-conn.setAutoCommit(false);
-String upsertSelect = "UPSERT INTO " + tableName + " SELECT * FROM " + 
tableName;
-conn.createStatement().executeUpdate(upsertSelect);
-conn.commit();
-PhoenixConnection pConn = conn.unwrap(PhoenixConnection.class);
-
-Map> mutationMetrics = 
PhoenixRuntime.getWriteMetricsForMutationsSinceLastReset(pConn);
-// Because auto-commit is off, upsert select into the same table will 
run on the client.
-// So we should have clie

phoenix git commit: PHOENIX-3271 Distribute UPSERT SELECT across cluster

2017-01-30 Thread ankit 
Repository: phoenix
Updated Branches:
  refs/heads/4.x-HBase-1.1 29bed889d -> 496f376d2


PHOENIX-3271 Distribute UPSERT SELECT across cluster


Project: http://git-wip-us.apache.org/repos/asf/phoenix/repo
Commit: http://git-wip-us.apache.org/repos/asf/phoenix/commit/496f376d
Tree: http://git-wip-us.apache.org/repos/asf/phoenix/tree/496f376d
Diff: http://git-wip-us.apache.org/repos/asf/phoenix/diff/496f376d

Branch: refs/heads/4.x-HBase-1.1
Commit: 496f376d23e91c01c1d98286b451a4acf765173c
Parents: 29bed88
Author: Ankit Singhal 
Authored: Tue Jan 31 11:48:24 2017 +0530
Committer: Ankit Singhal 
Committed: Tue Jan 31 11:48:24 2017 +0530

--
 .../phoenix/monitoring/PhoenixMetricsIT.java| 56 ---
 .../apache/phoenix/rpc/PhoenixServerRpcIT.java  |  6 ++
 .../apache/phoenix/compile/UpsertCompiler.java  | 38 
 .../UngroupedAggregateRegionObserver.java   | 97 ++--
 .../org/apache/phoenix/schema/PTableImpl.java   | 10 ++
 5 files changed, 138 insertions(+), 69 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/phoenix/blob/496f376d/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
--
diff --git 
a/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java 
b/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
index 16a66df..4d075ab 100644
--- 
a/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
+++ 
b/phoenix-core/src/it/java/org/apache/phoenix/monitoring/PhoenixMetricsIT.java
@@ -439,18 +439,31 @@ public class PhoenixMetricsIT extends 
BaseUniqueNamesOwnClusterIT {
 public void testMetricsForUpsertSelectWithAutoCommit() throws Exception {
 String tableName1 = generateUniqueName();
 long table1SaltBuckets = 6;
-String ddl = "CREATE TABLE " + tableName1 + " (K VARCHAR NOT NULL 
PRIMARY KEY, V VARCHAR)" + " SALT_BUCKETS = "
-+ table1SaltBuckets;
+String ddl = "CREATE TABLE " + tableName1 + " (K BIGINT NOT NULL 
PRIMARY KEY ROW_TIMESTAMP, V VARCHAR)"
++ " SALT_BUCKETS = " + table1SaltBuckets + ", IMMUTABLE_ROWS = 
true";
 Connection ddlConn = DriverManager.getConnection(getUrl());
 ddlConn.createStatement().execute(ddl);
 ddlConn.close();
 int numRows = 10;
-insertRowsInTable(tableName1, numRows);
+String dml = "UPSERT INTO " + tableName1 + " VALUES (?, ?)";
+try (Connection conn = DriverManager.getConnection(getUrl())) {
+PreparedStatement stmt = conn.prepareStatement(dml);
+for (int i = 1; i <= numRows; i++) {
+stmt.setLong(1, i);
+stmt.setString(2, "value" + i);
+stmt.executeUpdate();
+}
+conn.commit();
+}
 
 String tableName2 = generateUniqueName();
-ddl = "CREATE TABLE " + tableName2 + " (K VARCHAR NOT NULL PRIMARY 
KEY, V VARCHAR)" + " SALT_BUCKETS = 10";
+ddl = "CREATE TABLE " + tableName2 + " (K BIGINT NOT NULL PRIMARY KEY 
ROW_TIMESTAMP, V VARCHAR)"
++ " SALT_BUCKETS = 10" + ", IMMUTABLE_ROWS = true";
 ddlConn = DriverManager.getConnection(getUrl());
 ddlConn.createStatement().execute(ddl);
+String indexName = generateUniqueName();
+ddl = "CREATE INDEX " + indexName + " ON " + tableName2 + " (V)";
+ddlConn.createStatement().execute(ddl);
 ddlConn.close();
 
 String upsertSelect = "UPSERT INTO " + tableName2 + " SELECT * FROM " 
+ tableName1;
@@ -602,41 +615,6 @@ public class PhoenixMetricsIT extends 
BaseUniqueNamesOwnClusterIT {
 }
 
 @Test
-public void testMetricsForUpsertSelectSameTable() throws Exception {
-String tableName = generateUniqueName();
-long table1SaltBuckets = 6;
-String ddl = "CREATE TABLE " + tableName + " (K VARCHAR NOT NULL 
PRIMARY KEY, V VARCHAR)" + " SALT_BUCKETS = "
-+ table1SaltBuckets;
-Connection ddlConn = DriverManager.getConnection(getUrl());
-ddlConn.createStatement().execute(ddl);
-ddlConn.close();
-int numRows = 10;
-insertRowsInTable(tableName, numRows);
-
-Connection conn = DriverManager.getConnection(getUrl());
-conn.setAutoCommit(false);
-String upsertSelect = "UPSERT INTO " + tableName + " SELECT * FROM " + 
tableName;
-conn.createStatement().executeUpdate(upsertSelect);
-conn.commit();
-PhoenixConnection pConn = conn.unwrap(PhoenixConnection.class);
-
-Map> mutationMetrics = 
PhoenixRuntime.getWriteMetricsForMutationsSinceLastReset(pConn);
-// Because auto-commit is off, upsert select into the same table will 
run on the client.
-// So we sh