[jira] [Created] (PHOENIX-5691) Make use of shared access controller APIs in PhoenixAccessController

2020-01-21 Thread Rajeshbabu Chintaguntla (Jira) 
Rajeshbabu Chintaguntla created PHOENIX-5691:


 Summary: Make use of shared access controller APIs in 
PhoenixAccessController
 Key: PHOENIX-5691
 URL: https://issues.apache.org/jira/browse/PHOENIX-5691
 Project: Phoenix
  Issue Type: Bug
Reporter: Rajeshbabu Chintaguntla
Assignee: Rajeshbabu Chintaguntla
 Fix For: 5.1.0


create index failing with following exception when phoenix ACLs enabled.
{noformat}
  
phoenix.acls.enabled
true
  
{noformat}
{noformat}
Caused by: org.apache.hadoop.hbase.DoNotRetryIOException: 
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.ClassCastException: 
org.apache.hadoop.hbase.ipc.HBaseRpcControllerImpl cannot be cast to 
com.google.protobuf.RpcController
at 
org.apache.phoenix.util.ServerUtil.createIOException(ServerUtil.java:103)
at 
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.getTable(MetaDataEndpointImpl.java:603)
at 
org.apache.phoenix.coprocessor.generated.MetaDataProtos$MetaDataService.callMethod(MetaDataProtos.java:16537)
at 
org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:8305)
at 
org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:2497)
at 
org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:2479)
at 
org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42286)
at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:413)
at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:133)
at 
org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:338)
at 
org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:318)
Caused by: java.lang.ClassCastException: 
org.apache.hadoop.hbase.ipc.HBaseRpcControllerImpl cannot be cast to 
com.google.protobuf.RpcController
at 
org.apache.phoenix.coprocessor.PhoenixAccessController$3.getUserPermsFromUserDefinedAccessController(PhoenixAccessController.java:448)
at 
org.apache.phoenix.coprocessor.PhoenixAccessController$3.run(PhoenixAccessController.java:431)
at 
org.apache.phoenix.coprocessor.PhoenixAccessController$3.run(PhoenixAccessController.java:418)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
at 
org.apache.hadoop.security.SecurityUtil.doAsUser(SecurityUtil.java:515)
at 
org.apache.hadoop.security.SecurityUtil.doAsLoginUser(SecurityUtil.java:496)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hbase.util.Methods.call(Methods.java:40)
at org.apache.hadoop.hbase.security.User.runAsLoginUser(User.java:192)
at 
org.apache.phoenix.coprocessor.PhoenixAccessController.getUserPermissions(PhoenixAccessController.java:418)
at 
org.apache.phoenix.coprocessor.PhoenixAccessController.requireAccess(PhoenixAccessController.java:498)
at 
org.apache.phoenix.coprocessor.PhoenixAccessController.preGetTable(PhoenixAccessController.java:116)
at 
org.apache.phoenix.coprocessor.PhoenixMetaDataCoprocessorHost$1.call(PhoenixMetaDataCoprocessorHost.java:157)
at 
org.apache.phoenix.coprocessor.PhoenixMetaDataCoprocessorHost$1.call(PhoenixMetaDataCoprocessorHost.java:154)
at 
org.apache.phoenix.coprocessor.PhoenixMetaDataCoprocessorHost$PhoenixObserverOperation.callObserver(PhoenixMetaDataCoprocessorHost.java:87)
at 
org.apache.phoenix.coprocessor.PhoenixMetaDataCoprocessorHost.execOperation(PhoenixMetaDataCoprocessorHost.java:107)
at 
org.apache.phoenix.coprocessor.PhoenixMetaDataCoprocessorHost.preGetTable(PhoenixMetaDataCoprocessorHost.java:154)
at 
org.apache.phoenix.coprocessor.MetaDataEndpointImpl.getTable(MetaDataEndpointImpl.java:568)
... 9 more

at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at 
org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:99)
at 
org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemot

Call for presentations for ApacheCon North America 2020 now open

2020-01-21 Thread Rich Bowen 

Dear Apache enthusiast,

(You’re receiving this message because you are subscribed to one or more 
project mailing lists at the Apache Software Foundation.)


The call for presentations for ApacheCon North America 2020 is now open 
at https://apachecon.com/acna2020/cfp


ApacheCon will be held at the Sheraton, New Orleans, September 28th 
through October 2nd, 2020.


As in past years, ApacheCon will feature tracks focusing on the various 
technologies within the Apache ecosystem, and so the call for 
presentations will ask you to select one of those tracks, or “General” 
if the content falls outside of one of our already-organized tracks. 
These tracks are:


Karaf
Internet of Things
Fineract
Community
Content Delivery
Solr/Lucene (Search)
Gobblin/Big Data Integration
Ignite
Observability
Cloudstack
Geospatial
Graph
Camel/Integration
Flagon
Tomcat
Cassandra
Groovy
Web/httpd
General/Other

The CFP will close Friday, May 1, 2020 8:00 AM (America/New_York time).

Submit early, submit often, at https://apachecon.com/acna2020/cfp

Rich, for the ApacheCon Planners

[jira] [Created] (PHOENIX-5692) SCN verification breaks with non-default column families

2020-01-21 Thread Geoffrey Jacoby (Jira) 
Geoffrey Jacoby created PHOENIX-5692:


 Summary: SCN verification breaks with non-default column families
 Key: PHOENIX-5692
 URL: https://issues.apache.org/jira/browse/PHOENIX-5692
 Project: Phoenix
  Issue Type: Bug
Affects Versions: 4.16.0
Reporter: Geoffrey Jacoby
Assignee: Geoffrey Jacoby


PHOENIX-5645 introduced a verification step when using SCN to prevent going 
back farther than TTL or max lookback age. The implementation committed to 4.16 
had a bug where the verification step caused an exception when the default 
column family wasn't present. I fixed this in the 4.14 backport of 5645, but 
the same fix needs to go in 4.16 as well. Rather than do another addendum to 
5645, I'm opening a separate JIRA here. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

phoenix-4.15.0: Could not load/instantiate class org.apache.phoenix.query.DefaultGuidePostsCacheFactory

2020-01-21 Thread Alexander Batyrshin 
Looks like I hit issue https://issues.apache.org/jira/browse/PHOENIX-5231 

My scala application builds without any problem agains phoenix 4.13.x and 
4.14.x.
But got run-time problem with 4.15.0:

Caused by: org.apache.phoenix.exception.PhoenixNonRetryableRuntimeException: 
Could not load/instantiate class 
org.apache.phoenix.query.DefaultGuidePostsCacheFactory
at 
org.apache.phoenix.query.GuidePostsCacheProvider.loadAndGetGuidePostsCacheFactory(GuidePostsCacheProvider.java:57)
at 
org.apache.phoenix.query.GuidePostsCacheProvider.getGuidePostsCache(GuidePostsCacheProvider.java:73)
at 
org.apache.phoenix.query.ConnectionQueryServicesImpl.(ConnectionQueryServicesImpl.java:433)
at org.apache.phoenix.jdbc.PhoenixDriver$3.call(PhoenixDriver.java:248)
at org.apache.phoenix.jdbc.PhoenixDriver$3.call(PhoenixDriver.java:241)
at 
com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4796)
at 
com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3589)
at 
com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2374)
at 
com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2337)
at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2252)
at com.google.common.cache.LocalCache.get(LocalCache.java:3990)
at 
com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4793)
at 
org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:241)
at 
org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.createConnection(PhoenixEmbeddedDriver.java:142)
at org.apache.phoenix.jdbc.PhoenixDriver.connect(PhoenixDriver.java:221)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:208)
at PhoenixWriter.(PhoenixWriter.scala:29)

Any ideas how to build scala application with phoenix-4.15.0?

My build dependency for Scala application is:

libraryDependencies ++= Seq(
  "org.apache.logging.log4j"%% "log4j-api-scala"% "11.0",
  "org.apache.logging.log4j"% "log4j-api"   % "2.8.2",
  "org.apache.logging.log4j"% "log4j-core"  % "2.8.2" % Runtime,
  "org.apache.hadoop"   % "hadoop-common"   % "2.9.0",
  "org.apache.hadoop"   % "hadoop-client"   % "2.9.0",
  "org.apache.hbase"% "hbase"   % "1.4.12",
  "org.apache.hbase"% "hbase-client"% "1.4.12",
  "org.apache.hbase"% "hbase-common"% "1.4.12",
  "org.apache.hbase"% "hbase-server"% "1.4.12",

  "org.apache.phoenix"  % "phoenix" % 
"4.15.0-HBase-1.4",
  "org.apache.phoenix"  % "phoenix-core"% 
"4.15.0-HBase-1.4",
)

assemblyMergeStrategy in assembly := {
  case PathList("META-INF", xs @ _*) => MergeStrategy.discard
  case x => MergeStrategy.first
}

Re: phoenix-4.15.0: Could not load/instantiate class org.apache.phoenix.query.DefaultGuidePostsCacheFactory

2020-01-21 Thread Daniel Wong 
Hi this uses the java Services framework in order to load a defined class
at runtime based on the users configuration.  I'm not too familiar with
Scala but the java documentation for ServiceLoader is here:
https://docs.oracle.com/javase/9/docs/api/java/util/ServiceLoader.html.
Depending on your security or other settings there is a possibility for
issues finding the class. For example in Presto Phoenix Connector I believe
the following change had to be made in order to get the presto connector
run.
https://github.com/prestosql/presto/commit/30539e200ad0c4809afd2a9b178998829b548e2e

On Tue, Jan 21, 2020 at 12:08 PM Alexander Batyrshin <0x62...@gmail.com>
wrote:

> Looks like I hit issue https://issues.apache.org/jira/browse/PHOENIX-5231
> 
> My scala application builds without any problem agains phoenix 4.13.x and
> 4.14.x.
> But got run-time problem with 4.15.0:
>
> Caused by:
> org.apache.phoenix.exception.PhoenixNonRetryableRuntimeException: Could not
> load/instantiate class
> org.apache.phoenix.query.DefaultGuidePostsCacheFactory
> at
> org.apache.phoenix.query.GuidePostsCacheProvider.loadAndGetGuidePostsCacheFactory(GuidePostsCacheProvider.java:57)
> at
> org.apache.phoenix.query.GuidePostsCacheProvider.getGuidePostsCache(GuidePostsCacheProvider.java:73)
> at
> org.apache.phoenix.query.ConnectionQueryServicesImpl.(ConnectionQueryServicesImpl.java:433)
> at
> org.apache.phoenix.jdbc.PhoenixDriver$3.call(PhoenixDriver.java:248)
> at
> org.apache.phoenix.jdbc.PhoenixDriver$3.call(PhoenixDriver.java:241)
> at
> com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4796)
> at
> com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3589)
> at
> com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2374)
> at
> com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2337)
> at
> com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2252)
> at com.google.common.cache.LocalCache.get(LocalCache.java:3990)
> at
> com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4793)
> at
> org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:241)
> at
> org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.createConnection(PhoenixEmbeddedDriver.java:142)
> at
> org.apache.phoenix.jdbc.PhoenixDriver.connect(PhoenixDriver.java:221)
> at java.sql.DriverManager.getConnection(DriverManager.java:664)
> at java.sql.DriverManager.getConnection(DriverManager.java:208)
> at PhoenixWriter.(PhoenixWriter.scala:29)
>
> Any ideas how to build scala application with phoenix-4.15.0?
>
> My build dependency for Scala application is:
>
> libraryDependencies ++= Seq(
>   "org.apache.logging.log4j"%% "log4j-api-scala"% "11.0",
>   "org.apache.logging.log4j"% "log4j-api"   % "2.8.2",
>   "org.apache.logging.log4j"% "log4j-core"  % "2.8.2" %
> Runtime,
>   "org.apache.hadoop"   % "hadoop-common"   % "2.9.0",
>   "org.apache.hadoop"   % "hadoop-client"   % "2.9.0",
>   "org.apache.hbase"% "hbase"   % "1.4.12",
>   "org.apache.hbase"% "hbase-client"% "1.4.12",
>   "org.apache.hbase"% "hbase-common"% "1.4.12",
>   "org.apache.hbase"% "hbase-server"% "1.4.12",
>
>   "org.apache.phoenix"  % "phoenix" %
> "4.15.0-HBase-1.4",
>   "org.apache.phoenix"  % "phoenix-core"%
> "4.15.0-HBase-1.4",
> )
>
> assemblyMergeStrategy in assembly := {
>   case PathList("META-INF", xs @ _*) => MergeStrategy.discard
>   case x => MergeStrategy.first
> }



-- 
Daniel Wong
Salesforce
Mobile: 628.217.1808

Re: phoenix-4.15.0: Could not load/instantiate class org.apache.phoenix.query.DefaultGuidePostsCacheFactory

2020-01-21 Thread Alexander Batyrshin 
Thank you for response. I will take a look at information about ServiceLoader

> 21 янв. 2020 г., в 23:32, Daniel Wong  
> написал(а):
> 
> Hi this uses the java Services framework in order to load a defined class
> at runtime based on the users configuration.  I'm not too familiar with
> Scala but the java documentation for ServiceLoader is here:
> https://docs.oracle.com/javase/9/docs/api/java/util/ServiceLoader.html.
> Depending on your security or other settings there is a possibility for
> issues finding the class. For example in Presto Phoenix Connector I believe
> the following change had to be made in order to get the presto connector
> run.
> https://github.com/prestosql/presto/commit/30539e200ad0c4809afd2a9b178998829b548e2e
> 
>> On Tue, Jan 21, 2020 at 12:08 PM Alexander Batyrshin <0x62...@gmail.com>
>> wrote:
>> 
>> Looks like I hit issue https://issues.apache.org/jira/browse/PHOENIX-5231
>> 
>> My scala application builds without any problem agains phoenix 4.13.x and
>> 4.14.x.
>> But got run-time problem with 4.15.0:
>> 
>> Caused by:
>> org.apache.phoenix.exception.PhoenixNonRetryableRuntimeException: Could not
>> load/instantiate class
>> org.apache.phoenix.query.DefaultGuidePostsCacheFactory
>>at
>> org.apache.phoenix.query.GuidePostsCacheProvider.loadAndGetGuidePostsCacheFactory(GuidePostsCacheProvider.java:57)
>>at
>> org.apache.phoenix.query.GuidePostsCacheProvider.getGuidePostsCache(GuidePostsCacheProvider.java:73)
>>at
>> org.apache.phoenix.query.ConnectionQueryServicesImpl.(ConnectionQueryServicesImpl.java:433)
>>at
>> org.apache.phoenix.jdbc.PhoenixDriver$3.call(PhoenixDriver.java:248)
>>at
>> org.apache.phoenix.jdbc.PhoenixDriver$3.call(PhoenixDriver.java:241)
>>at
>> com.google.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4796)
>>at
>> com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3589)
>>at
>> com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2374)
>>at
>> com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2337)
>>at
>> com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2252)
>>at com.google.common.cache.LocalCache.get(LocalCache.java:3990)
>>at
>> com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4793)
>>at
>> org.apache.phoenix.jdbc.PhoenixDriver.getConnectionQueryServices(PhoenixDriver.java:241)
>>at
>> org.apache.phoenix.jdbc.PhoenixEmbeddedDriver.createConnection(PhoenixEmbeddedDriver.java:142)
>>at
>> org.apache.phoenix.jdbc.PhoenixDriver.connect(PhoenixDriver.java:221)
>>at java.sql.DriverManager.getConnection(DriverManager.java:664)
>>at java.sql.DriverManager.getConnection(DriverManager.java:208)
>>at PhoenixWriter.(PhoenixWriter.scala:29)
>> 
>> Any ideas how to build scala application with phoenix-4.15.0?
>> 
>> My build dependency for Scala application is:
>> 
>> libraryDependencies ++= Seq(
>>  "org.apache.logging.log4j"%% "log4j-api-scala"% "11.0",
>>  "org.apache.logging.log4j"% "log4j-api"   % "2.8.2",
>>  "org.apache.logging.log4j"% "log4j-core"  % "2.8.2" %
>> Runtime,
>>  "org.apache.hadoop"   % "hadoop-common"   % "2.9.0",
>>  "org.apache.hadoop"   % "hadoop-client"   % "2.9.0",
>>  "org.apache.hbase"% "hbase"   % "1.4.12",
>>  "org.apache.hbase"% "hbase-client"% "1.4.12",
>>  "org.apache.hbase"% "hbase-common"% "1.4.12",
>>  "org.apache.hbase"% "hbase-server"% "1.4.12",
>> 
>>  "org.apache.phoenix"  % "phoenix" %
>> "4.15.0-HBase-1.4",
>>  "org.apache.phoenix"  % "phoenix-core"%
>> "4.15.0-HBase-1.4",
>> )
>> 
>> assemblyMergeStrategy in assembly := {
>>  case PathList("META-INF", xs @ _*) => MergeStrategy.discard
>>  case x => MergeStrategy.first
>> }
> 
> 
> 
> -- 
> Daniel Wong
> Salesforce
> Mobile: 628.217.1808

[jira] [Updated] (PHOENIX-5692) SCN verification breaks with non-default column families

2020-01-21 Thread Geoffrey Jacoby (Jira) 


 [ 
https://issues.apache.org/jira/browse/PHOENIX-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Geoffrey Jacoby updated PHOENIX-5692:
-
Attachment: PHOENIX-5692-4.x-HBase-1.5.patch

> SCN verification breaks with non-default column families
> 
>
> Key: PHOENIX-5692
> URL: https://issues.apache.org/jira/browse/PHOENIX-5692
> Project: Phoenix
>  Issue Type: Bug
>Affects Versions: 4.16.0
>Reporter: Geoffrey Jacoby
>Assignee: Geoffrey Jacoby
>Priority: Major
> Attachments: PHOENIX-5692-4.x-HBase-1.5.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> PHOENIX-5645 introduced a verification step when using SCN to prevent going 
> back farther than TTL or max lookback age. The implementation committed to 
> 4.16 had a bug where the verification step caused an exception when the 
> default column family wasn't present. I fixed this in the 4.14 backport of 
> 5645, but the same fix needs to go in 4.16 as well. Rather than do another 
> addendum to 5645, I'm opening a separate JIRA here. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)