[
https://issues.apache.org/jira/browse/HADOOP-14609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16066735#comment-16066735
]
Steve Loughran commented on HADOOP-14609:
-----------------------------------------
{code}
esystem: org.apache.hadoop.fs.azure.AzureException:
java.lang.NullPointerException
- DataFrames *** FAILED ***
java.io.IOException: Failed to delete
wasb://contr...@contender.blob.core.windows.net/cloud-integration/DELAY_LISTING_ME/AzureDataFrameSuite/dataframes/generated
on org.apache.hadoop.fs.azure.NativeAzureFileSystem@177ede17
org.apache.hadoop.fs.azure.AzureException: java.lang.NullPointerException
at
com.hortonworks.spark.cloud.ObjectStoreOperations$class.rm(ObjectStoreOperations.scala:415)
at
com.hortonworks.spark.cloud.operations.CloudDataFrames.rm(CloudDataFrames.scala:36)
at
com.hortonworks.spark.cloud.operations.CloudDataFrames.action(CloudDataFrames.scala:82)
at
com.hortonworks.spark.cloud.ObjectStoreExample$class.action(ObjectStoreExample.scala:70)
at
com.hortonworks.spark.cloud.operations.CloudDataFrames.action(CloudDataFrames.scala:36)
at
com.hortonworks.spark.cloud.common.DataFrameTests$$anonfun$3.apply$mcV$sp(DataFrameTests.scala:45)
at
com.hortonworks.spark.cloud.CloudSuiteTrait$$anonfun$ctest$1.apply$mcV$sp(CloudSuiteTrait.scala:69)
at
com.hortonworks.spark.cloud.CloudSuiteTrait$$anonfun$ctest$1.apply(CloudSuiteTrait.scala:67)
at
com.hortonworks.spark.cloud.CloudSuiteTrait$$anonfun$ctest$1.apply(CloudSuiteTrait.scala:67)
at
org.scalatest.Transformer$$anonfun$apply$1.apply$mcV$sp(Transformer.scala:22)
...
Cause: org.apache.hadoop.fs.azure.AzureException:
java.lang.NullPointerException
at
org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.retrieveMetadata(AzureNativeFileSystemStore.java:2023)
at
org.apache.hadoop.fs.azure.NativeAzureFileSystem.delete(NativeAzureFileSystem.java:1846)
at
org.apache.hadoop.fs.azure.NativeAzureFileSystem.delete(NativeAzureFileSystem.java:1810)
at
com.hortonworks.spark.cloud.ObjectStoreOperations$class.rm(ObjectStoreOperations.scala:410)
at
com.hortonworks.spark.cloud.operations.CloudDataFrames.rm(CloudDataFrames.scala:36)
at
com.hortonworks.spark.cloud.operations.CloudDataFrames.action(CloudDataFrames.scala:82)
at
com.hortonworks.spark.cloud.ObjectStoreExample$class.action(ObjectStoreExample.scala:70)
at
com.hortonworks.spark.cloud.operations.CloudDataFrames.action(CloudDataFrames.scala:36)
at
com.hortonworks.spark.cloud.common.DataFrameTests$$anonfun$3.apply$mcV$sp(DataFrameTests.scala:45)
at
com.hortonworks.spark.cloud.CloudSuiteTrait$$anonfun$ctest$1.apply$mcV$sp(CloudSuiteTrait.scala:69)
...
Cause: java.lang.NullPointerException:
at
org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.checkContainer(AzureNativeFileSystemStore.java:1198)
at
org.apache.hadoop.fs.azure.AzureNativeFileSystemStore.retrieveMetadata(AzureNativeFileSystemStore.java:1945)
at
org.apache.hadoop.fs.azure.NativeAzureFileSystem.delete(NativeAzureFileSystem.java:1846)
at
org.apache.hadoop.fs.azure.NativeAzureFileSystem.delete(NativeAzureFileSystem.java:1810)
at
com.hortonworks.spark.cloud.ObjectStoreOperations$class.rm(ObjectStoreOperations.scala:410)
at
com.hortonworks.spark.cloud.operations.CloudDataFrames.rm(CloudDataFrames.scala:36)
at
com.hortonworks.spark.cloud.operations.CloudDataFrames.action(CloudDataFrames.scala:82)
at
com.hortonworks.spark.cloud.ObjectStoreExample$class.action(ObjectStoreExample.scala:70)
at
com.hortonworks.spark.cloud.operations.CloudDataFrames.action(CloudDataFrames.scala:36)
at
com.hortonworks.spark.cloud.common.DataFrameTests$$anonfun$3.apply$mcV$sp(DataFrameTests.scala:45)
...
{code}
> NPE in AzureNativeFileSystemStore.checkContainer() if StorageException lacks
> an error code
> ------------------------------------------------------------------------------------------
>
> Key: HADOOP-14609
> URL: https://issues.apache.org/jira/browse/HADOOP-14609
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Affects Versions: 2.9.0
> Reporter: Steve Loughran
>
> if something goes wrong in {{AzureNativeFileSystemStore.checkContainer() }}
> the {{StorageException}} error code is checked.
> {code}
> if (ex.getErrorCode().equals(StorageErrorCode.RESOURCE_NOT_FOUND.toString()))
> {
> ...
> }
> But if there's no error code: NPE.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
