[ https://issues.apache.org/jira/browse/CASSANDRA-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Henning Kropp updated CASSANDRA-7083: ------------------------------------- Description: The {{CqlRecordWriter}} seems not to support authentication. When the keyspace in Cassandra is to set to use authentication our Pig job fails with, when credentials are provided using the URI ('cql://username:password...): {code} java.lang.RuntimeException: InvalidRequestException(why:You have not logged in) at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:123) at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:90) at org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:76) at org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:57) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:84) at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408) at org.apache.hadoop.mapred.Child.main(Child.java:170) Caused by: InvalidRequestException(why:You have not logged in) at org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result.read(Cassandra.java:38677) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78) at org.apache.cassandra.thrift.Cassandra$Client.recv_execute_cql3_query(Cassandra.java:1597) at org.apache.cassandra.thrift.Cassandra$Client.execute_cql3_query(Cassandra.java:1582) at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.retrievePartitionKeyValidator(CqlRecordWriter.java:332) at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:108) ... 7 more {code} If not supplied in the URI but as only in the {{JobConf}} the exception is: {code} Output Location Validation Failed for: 'cql://...' More info to follow: InvalidRequestException(why:You have not logged in) at org.apache.pig.newplan.logical.rules.InputOutputFileValidator$ {code} Which let to the finding, that authentication is correctly supplied for {{CqlStorage}} but not for the {{CqlRecordWriter}}. May be it would make sense to put the authentication part into {{ConfigHelper.getClientFromAddressList()}}? Then in {{CqlStorage} the username and password in the conf would need to be set from the URI. If so the {{ConfigHelper}} has all the information to authenticate and already returns the client. was: The {{CqlRecordWriter}} seems not to support authentication. When the keyspace in Cassandra is to set to use authentication our Pig job fails with, when credentials are provided using the URI ('cql://username:password...): {code} java.lang.RuntimeException: InvalidRequestException(why:You have not logged in) at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:123) at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:90) at org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:76) at org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:57) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:84) at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408) at org.apache.hadoop.mapred.Child.main(Child.java:170) Caused by: InvalidRequestException(why:You have not logged in) at org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result.read(Cassandra.java:38677) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78) at org.apache.cassandra.thrift.Cassandra$Client.recv_execute_cql3_query(Cassandra.java:1597) at org.apache.cassandra.thrift.Cassandra$Client.execute_cql3_query(Cassandra.java:1582) at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.retrievePartitionKeyValidator(CqlRecordWriter.java:332) at org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:108) ... 7 more {code} If not supplied in the URI but as a {{JobConf}} the exception: {code} Output Location Validation Failed for: 'cql://...' More info to follow: InvalidRequestException(why:You have not logged in) at org.apache.pig.newplan.logical.rules.InputOutputFileValidator$ {code} Which let to the finding, that authentication is correctly supplied for {{CqlStorage}} but not for the {{CqlRecordWriter}}. May be it would make sense to put the authentication part into {{ConfigHelper.getClientFromAddressList()}}? Then in {{CqlStorage} the username and password in the conf would need to be set from the URI. If so the {{ConfigHelper}} has all the information to authenticate and already returns the client. > Authentication Support for CqlRecordWriter > ------------------------------------------ > > Key: CASSANDRA-7083 > URL: https://issues.apache.org/jira/browse/CASSANDRA-7083 > Project: Cassandra > Issue Type: Bug > Components: Hadoop > Reporter: Henning Kropp > Labels: authentication, pig > Attachments: auth_cql.patch > > > The {{CqlRecordWriter}} seems not to support authentication. When the > keyspace in Cassandra is to set to use authentication our Pig job fails with, > when credentials are provided using the URI ('cql://username:password...): > {code} > java.lang.RuntimeException: InvalidRequestException(why:You have not logged > in) > at > org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:123) > at > org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:90) > at > org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:76) > at > org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:57) > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:84) > at > org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408) > at org.apache.hadoop.mapred.Child.main(Child.java:170) > Caused by: InvalidRequestException(why:You have not logged in) > at > org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result.read(Cassandra.java:38677) > at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78) > at > org.apache.cassandra.thrift.Cassandra$Client.recv_execute_cql3_query(Cassandra.java:1597) > at > org.apache.cassandra.thrift.Cassandra$Client.execute_cql3_query(Cassandra.java:1582) > at > org.apache.cassandra.hadoop.cql3.CqlRecordWriter.retrievePartitionKeyValidator(CqlRecordWriter.java:332) > at > org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:108) > ... 7 more > {code} > If not supplied in the URI but as only in the {{JobConf}} the exception is: > {code} > Output Location Validation Failed for: 'cql://...' More info to follow: > InvalidRequestException(why:You have not logged in) > at org.apache.pig.newplan.logical.rules.InputOutputFileValidator$ > {code} > Which let to the finding, that authentication is correctly supplied for > {{CqlStorage}} but not for the {{CqlRecordWriter}}. > May be it would make sense to put the authentication part into > {{ConfigHelper.getClientFromAddressList()}}? Then in {{CqlStorage} the > username and password in the conf would need to be set from the URI. If so > the {{ConfigHelper}} has all the information to authenticate and already > returns the client. -- This message was sent by Atlassian JIRA (v6.2#6252)