[
https://issues.apache.org/jira/browse/WHIRR-686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13536982#comment-13536982
]
Guido Serra aka Zeph commented on WHIRR-686:
--------------------------------------------
k, got an update from AWS, if we can manage to get the public dns being used by
the nodes, we are good to go... as we do not impact internal cluster
intercommunications, as the dns resolution, internally, of public AWS
addresses, will fallback to the internal IPs ... there is no risk the HDFS data
handling goes over the internet between the nodes
> hbase cluster answers (to a client connecting from the internet) with
> internal AWS addresses
> --------------------------------------------------------------------------------------------
>
> Key: WHIRR-686
> URL: https://issues.apache.org/jira/browse/WHIRR-686
> Project: Whirr
> Issue Type: Bug
> Environment: Pentaho's pdi-ce-4.4.0
> CDH4 on AWS's infrastructure
> Reporter: Guido Serra aka Zeph
> Attachments: debug_dump.log
>
>
> I created a cluster with the default settings from
> https://svn.apache.org/repos/asf/whirr/trunk/recipes/hbase-cdh.properties
> Then, opened the Data-Integration client from Pentaho,
> and created a New Transformation > Big Data > Hbase Output
> - http://wiki.pentaho.com/display/BAD/Loading+Data+into+HBase
> (I had started the client via command line, to obtain the logs below)
> bq. INFO 13-12 15:34:08,408 - Session establishment complete on server
> ec2-XX-XX-XX-XX.eu-west-1.compute.amazonaws.com/XXX.XXX.XXX.XXX:2181,
> sessionid = 0x13b947912cf003b, negotiated timeout = 40000
> bq. java.net.UnknownHostException: unknown host:
> ip-XX-XX-XX-XX.eu-west-1.compute.internal
> ...the full stacktrace:
> {code}
> INFO 13-12 15:34:08,284 - Initiating client connection,
> connectString=ec2-XX-XX-XX-XX.eu-west-1.compute.amazonaws.com:2181
> sessionTimeout=180000 watcher=hconnection
> INFO 13-12 15:34:08,285 - Opening socket connection to server
> /176.34.212.37:2181
> INFO 13-12 15:34:08,285 - The identifier of this process is [email protected]
> WARN 13-12 15:34:08,321 - SecurityException: java.lang.SecurityException:
> Unable to locate a login configuration occurred when trying to find JAAS
> configuration.
> INFO 13-12 15:34:08,321 - Client will not SASL-authenticate because the
> default JAAS configuration section 'Client' could not be found. If you are
> not using SASL, you may ignore this. On the other hand, if you expected SASL
> to work, please fix your JAAS configuration.
> INFO 13-12 15:34:08,363 - Socket connection established to
> ec2-XX-XX-XX-XX.eu-west-1.compute.amazonaws.com/XXX.XXX.XXX.XXX:2181,
> initiating session
> INFO 13-12 15:34:08,408 - Session establishment complete on server
> ec2-XX-XX-XX-XX.eu-west-1.compute.amazonaws.com/XXX.XXX.XXX.XXX:2181,
> sessionid = 0x13b947912cf003b, negotiated timeout = 40000
> INFO 13-12 15:34:24,670 - getMaster attempt 0 of 10 failed; retrying after
> sleep of 1000
> java.net.UnknownHostException: unknown host:
> ip-XX-XX-XX-XX.eu-west-1.compute.internal
> at
> org.apache.hadoop.hbase.ipc.HBaseClient$Connection.<init>(HBaseClient.java:227)
> at
> org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:1035)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:897)
> at
> org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
> at $Proxy20.getProtocolVersion(Unknown Source)
> at
> org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:183)
> at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:303)
> at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:280)
> at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:332)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:642)
> at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:106)
> at
> org.pentaho.hbase.shim.common.CommonHBaseConnection.configureConnection(CommonHBaseConnection.java:135)
> at
> org.pentaho.di.trans.steps.hbaseoutput.HBaseOutputData.getHBaseConnection(HBaseOutputData.java:102)
> at
> org.pentaho.di.trans.steps.hbaseoutput.HBaseOutputDialog.getHBaseConnection(HBaseOutputDialog.java:784)
> at
> org.pentaho.di.trans.steps.hbaseoutput.HBaseOutputDialog.setupMappedTableNames(HBaseOutputDialog.java:796)
> at
> org.pentaho.di.trans.steps.hbaseoutput.HBaseOutputDialog.access$1300(HBaseOutputDialog.java:77)
> at
> org.pentaho.di.trans.steps.hbaseoutput.HBaseOutputDialog$9.widgetSelected(HBaseOutputDialog.java:436)
> at
> org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:240)
> at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
> at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4128)
> at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1457)
> at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1480)
> at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1465)
> at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:1270)
> at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3974)
> at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3613)
> at
> org.pentaho.di.trans.steps.hbaseoutput.HBaseOutputDialog.open(HBaseOutputDialog.java:628)
> at
> org.pentaho.di.ui.spoon.delegates.SpoonStepsDelegate.editStep(SpoonStepsDelegate.java:136)
> at org.pentaho.di.ui.spoon.Spoon.editStep(Spoon.java:7835)
> at
> org.pentaho.di.ui.spoon.trans.TransGraph.editStep(TransGraph.java:2749)
> at
> org.pentaho.di.ui.spoon.trans.TransGraph.mouseDoubleClick(TransGraph.java:705)
> at
> org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:195)
> at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
> at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4128)
> at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1457)
> at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1480)
> at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1465)
> at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:1270)
> at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3974)
> at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3613)
> at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1221)
> at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7044)
> at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:8304)
> at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:580)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.pentaho.commons.launcher.Launcher.main(Launcher.java:134)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at apple.launcher.LaunchRunner.run(LaunchRunner.java:116)
> at apple.launcher.LaunchRunner.callMain(LaunchRunner.java:51)
> at
> apple.launcher.JavaApplicationLauncher.launch(JavaApplicationLauncher.java:52)
> {code}
> is it a configuration issue? (of the configuration created by WHIRR?)
> p.s. "zkCli -server public-ip:2181" works like a charme... but not the hbase
> shell
> bq. ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7 times
> {code}
> v1:Desktop zeph$ export HBASE_CONF_DIR=$(pwd)
> v1:Desktop zeph$ hbase shell
> HBase Shell; enter 'help<RETURN>' for list of supported commands.
> Type "exit<RETURN>" to leave the HBase Shell
> Version 0.94.2, r1395367, Sun Oct 7 19:11:01 UTC 2012
> 1.9.3-p194 :001 > status
> 2012-12-13 17:55:01.952 java[98520:1903] Unable to load realm info from
> SCDynamicStore
> ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7 times
> Here is some help for this command:
> Show cluster status. Can be 'summary', 'simple', or 'detailed'. The
> default is 'summary'. Examples:
> hbase> status
> hbase> status 'simple'
> hbase> status 'summary'
> hbase> status 'detailed'
> 1.9.3-p194 :002 >
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
