Re: [MarkLogic Dev General] Error while creating MarkLogic Forest with HDFS as data directory

2015-03-23 Thread Sudheer Yalaverthi 
The unknown error was due to Java I had. I had the JAVA_HOME pointing to IBM 
version of java and while trying to connect with HDFS, MarkLogic keeps giving 
errors in the logs about missing .io files in the ibm java installation 
directory. We found those missing io files and placed them in the appropriate 
directory which finally resulted to an unknown error.
After we installed the oracle Java 7 and made the JAVA_HOME to point to that 
location, MarkLogic worked with CDH 4.3.1 version which is the certified 
version of Hadoop by MarkLogic.
When I tried with CDH5.3.1 version of hadoop with latest jars, MarkLogic keeps 
giving below error though I had the jar containing this file in the HDFS client.
2015-03-19 15:53:44.516 Alert: XDMP-FORESTERR: Error in initialization of 
forest Foresthadoop2: SVC-NOJCLASS: java.lang.NoClassDefFoundError: Could not 
initialize class org.apache.hadoop.util.VersionInfo
When I approached MarkLogic support team, they confirmed that CDH5.3.1 version 
of Hadoop is not yet certified by MarkLogic and they have it as part of their 
product map.
The conclusion for now is CDH 5.3.1 HDFS will not work with MarkLogic.

-Sudheer

From: general-boun...@developer.marklogic.com 
[mailto:general-boun...@developer.marklogic.com] On Behalf Of Sudheer Yalaverthi
Sent: Friday, March 13, 2015 11:20 AM
To: MarkLogic Developer Discussion
Subject: Re: [MarkLogic Dev General] Error while creating MarkLogic Forest with 
HDFS as data directory

I am using MarkLogic 7.0-4.3 version and Cloudera Hadoop Distrbution 5.3.1 for 
HDFS.


Thanks,
Sudheer

From: 
general-boun...@developer.marklogic.com<mailto:general-boun...@developer.marklogic.com>
 [mailto:general-boun...@developer.marklogic.com] On Behalf Of Justin Makeig
Sent: Friday, March 13, 2015 11:16 AM
To: MarkLogic Developer Discussion
Subject: Re: [MarkLogic Dev General] Error while creating MarkLogic Forest with 
HDFS as data directory

Which version of MarkLogic and which vendor and version of Hadoop are you using?

Justin


--
Justin Makeig
Director, Product Management
MarkLogic

On Mar 13, 2015, at 7:48 AM, Sudheer Yalaverthi 
mailto:sudheer.yalaver...@db.com>> wrote:


Hi,

I have been trying a MarkLogic tiered storage POC with HDFS as storage layer 
for one of the tier. I have been trying to create a forest with data directory 
as hadoop file system directory.
I have one hadoop cluster and one Marklogic cluster. I downloaded the 
configuration files from Hadoop and copied them to /usr/hadoop directory on the 
MarkLogic machine and I have also downloaded the required jar files based on 
the documentation here. 
https://docs.marklogic.com/guide/performance/disk-storage#id_27091
I have placed these as well in the /usr/hadoop directory with proper lib 
structure.
I am getting the below error when I try creating the forest.
2015-03-12 19:17:20.087 Error: Automount Foresthadoop: SVC-HDFSNOT: HDFS not 
available for 'hdfs://{namdenode_hostname}:8020/tmp': unknown error
I tried changing the log level to finest in the group configurations and I have 
also added trace events for forest. But I am not able to get any additional 
details that could point me to what the error is about.
Any help in this regard would be appreciated. Please let me know if there are 
any other ways to connect to HDFS as a forest directory.



Thanks,
Sudheer


---
This communication may contain confidential and/or privileged information. If 
you are not the intended recipient (or have received this communication in 
error) please notify the sender immediately and destroy this communication. Any 
unauthorized copying, disclosure or distribution of the material in this 
communication is strictly forbidden.

Deutsche Bank does not render legal or tax advice, and the information 
contained in this communication should not be regarded as such.
___
General mailing list
General@developer.marklogic.com<mailto:General@developer.marklogic.com>
http://developer.marklogic.com/mailman/listinfo/general



---
This communication may contain confidential and/or privileged information. If 
you are not the intended recipient (or have received this communication in 
error) please notify the sender immediately and destroy this communication. Any 
unauthorized copying, disclosure or distribution of the material in this 
communication is strictly forbidden.

Deutsche Bank does not render legal or tax advice, and the information 
contained in this communication should not be regarded as such.


---
This communication may contain confidential and/or privileged information. If 
you are not the intended recipient (or have received this communication in 
error) please notify the sender immediately and destroy this communication. Any 
unauthorized copying, disclosure or distribution of the material in this 
communication is strictly forbidden.

Deutsche Bank does not render legal or tax advice, and the information 
contained in this

Re: [MarkLogic Dev General] Error while creating MarkLogic Forest with HDFS as data directory

2015-03-13 Thread Michael Blakeley 
Are those curly braces in hdfs://{namdenode-hostname}:8020/tmp literal, or did 
you sanitize the log message?

Is the spelling of "namdenode-hostname" correct?

-- Mike

> On 13 Mar 2015, at 07:48 , Sudheer Yalaverthi  
> wrote:
> 
> 2015-03-12 19:17:20.087 Error: Automount Foresthadoop: SVC-HDFSNOT: HDFS not 
> available for 'hdfs://{namdenode_hostname}:8020/tmp': unknown error
> 
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Re: [MarkLogic Dev General] Error while creating MarkLogic Forest with HDFS as data directory [I]

2015-03-13 Thread Sudheer Yalaverthi 
Classification: For internal use only

I just replaced the actual host name with the literal to give you an idea what 
was actually there. Sorry about the typo error. There won't be any curly braces.



-Original Message-
From: general-boun...@developer.marklogic.com 
[mailto:general-boun...@developer.marklogic.com] On Behalf Of Michael Blakeley
Sent: Friday, March 13, 2015 11:29 AM
To: MarkLogic Developer Discussion
Subject: Re: [MarkLogic Dev General] Error while creating MarkLogic Forest with 
HDFS as data directory

Are those curly braces in hdfs://{namdenode-hostname}:8020/tmp literal, or did 
you sanitize the log message?

Is the spelling of "namdenode-hostname" correct?

-- Mike

> On 13 Mar 2015, at 07:48 , Sudheer Yalaverthi  
> wrote:
>
> 2015-03-12 19:17:20.087 Error: Automount Foresthadoop: SVC-HDFSNOT:
> HDFS not available for 'hdfs://{namdenode_hostname}:8020/tmp': unknown
> error
>
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general


---
This communication may contain confidential and/or privileged information. If 
you are not the intended recipient (or have received this communication in 
error) please notify the sender immediately and destroy this communication. Any 
unauthorized copying, disclosure or distribution of the material in this 
communication is strictly forbidden.

Deutsche Bank does not render legal or tax advice, and the information 
contained in this communication should not be regarded as such.
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Re: [MarkLogic Dev General] Error while creating MarkLogic Forest with HDFS as data directory

2015-03-13 Thread Sudheer Yalaverthi 
I am using MarkLogic 7.0-4.3 version and Cloudera Hadoop Distrbution 5.3.1 for 
HDFS.


Thanks,
Sudheer

From: general-boun...@developer.marklogic.com 
[mailto:general-boun...@developer.marklogic.com] On Behalf Of Justin Makeig
Sent: Friday, March 13, 2015 11:16 AM
To: MarkLogic Developer Discussion
Subject: Re: [MarkLogic Dev General] Error while creating MarkLogic Forest with 
HDFS as data directory

Which version of MarkLogic and which vendor and version of Hadoop are you using?

Justin


--
Justin Makeig
Director, Product Management
MarkLogic

On Mar 13, 2015, at 7:48 AM, Sudheer Yalaverthi 
mailto:sudheer.yalaver...@db.com>> wrote:


Hi,

I have been trying a MarkLogic tiered storage POC with HDFS as storage layer 
for one of the tier. I have been trying to create a forest with data directory 
as hadoop file system directory.
I have one hadoop cluster and one Marklogic cluster. I downloaded the 
configuration files from Hadoop and copied them to /usr/hadoop directory on the 
MarkLogic machine and I have also downloaded the required jar files based on 
the documentation here. 
https://docs.marklogic.com/guide/performance/disk-storage#id_27091
I have placed these as well in the /usr/hadoop directory with proper lib 
structure.
I am getting the below error when I try creating the forest.
2015-03-12 19:17:20.087 Error: Automount Foresthadoop: SVC-HDFSNOT: HDFS not 
available for 'hdfs://{namdenode_hostname}:8020/tmp': unknown error
I tried changing the log level to finest in the group configurations and I have 
also added trace events for forest. But I am not able to get any additional 
details that could point me to what the error is about.
Any help in this regard would be appreciated. Please let me know if there are 
any other ways to connect to HDFS as a forest directory.



Thanks,
Sudheer


---
This communication may contain confidential and/or privileged information. If 
you are not the intended recipient (or have received this communication in 
error) please notify the sender immediately and destroy this communication. Any 
unauthorized copying, disclosure or distribution of the material in this 
communication is strictly forbidden.

Deutsche Bank does not render legal or tax advice, and the information 
contained in this communication should not be regarded as such.
___
General mailing list
General@developer.marklogic.com<mailto:General@developer.marklogic.com>
http://developer.marklogic.com/mailman/listinfo/general



---
This communication may contain confidential and/or privileged information. If 
you are not the intended recipient (or have received this communication in 
error) please notify the sender immediately and destroy this communication. Any 
unauthorized copying, disclosure or distribution of the material in this 
communication is strictly forbidden.

Deutsche Bank does not render legal or tax advice, and the information 
contained in this communication should not be regarded as such.
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

Re: [MarkLogic Dev General] Error while creating MarkLogic Forest with HDFS as data directory

2015-03-13 Thread Justin Makeig 
Which version of MarkLogic and which vendor and version of Hadoop are you using?

Justin


--
Justin Makeig
Director, Product Management
MarkLogic

> On Mar 13, 2015, at 7:48 AM, Sudheer Yalaverthi  
> wrote:
> 
>  
> Hi,
>  
> I have been trying a MarkLogic tiered storage POC with HDFS as storage layer 
> for one of the tier. I have been trying to create a forest with data 
> directory as hadoop file system directory.
> 
> I have one hadoop cluster and one Marklogic cluster. I downloaded the 
> configuration files from Hadoop and copied them to /usr/hadoop directory on 
> the MarkLogic machine and I have also downloaded the required jar files based 
> on the documentation here. 
> https://docs.marklogic.com/guide/performance/disk-storage#id_27091 
> 
> I have placed these as well in the /usr/hadoop directory with proper lib 
> structure.
> 
> I am getting the below error when I try creating the forest.
> 
> 2015-03-12 19:17:20.087 Error: Automount Foresthadoop: SVC-HDFSNOT: HDFS not 
> available for 'hdfs://{namdenode_hostname}:8020/tmp': unknown error
> 
> I tried changing the log level to finest in the group configurations and I 
> have also added trace events for forest. But I am not able to get any 
> additional details that could point me to what the error is about.
> 
> Any help in this regard would be appreciated. Please let me know if there are 
> any other ways to connect to HDFS as a forest directory.
> 
>  
>  
>  
> Thanks,
> Sudheer
> 
> 
> ---
> This communication may contain confidential and/or privileged information. If 
> you are not the intended recipient (or have received this communication in 
> error) please notify the sender immediately and destroy this communication. 
> Any unauthorized copying, disclosure or distribution of the material in this 
> communication is strictly forbidden.
> 
> Deutsche Bank does not render legal or tax advice, and the information 
> contained in this communication should not be regarded as such.
> ___
> General mailing list
> General@developer.marklogic.com
> http://developer.marklogic.com/mailman/listinfo/general



smime.p7s
Description: S/MIME cryptographic signature
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general

[MarkLogic Dev General] Error while creating MarkLogic Forest with HDFS as data directory

2015-03-13 Thread Sudheer Yalaverthi 

Hi,


I have been trying a MarkLogic tiered storage POC with HDFS as storage layer 
for one of the tier. I have been trying to create a forest with data directory 
as hadoop file system directory.

I have one hadoop cluster and one Marklogic cluster. I downloaded the 
configuration files from Hadoop and copied them to /usr/hadoop directory on the 
MarkLogic machine and I have also downloaded the required jar files based on 
the documentation here. 
https://docs.marklogic.com/guide/performance/disk-storage#id_27091

I have placed these as well in the /usr/hadoop directory with proper lib 
structure.

I am getting the below error when I try creating the forest.

2015-03-12 19:17:20.087 Error: Automount Foresthadoop: SVC-HDFSNOT: HDFS not 
available for 'hdfs://{namdenode_hostname}:8020/tmp': unknown error

I tried changing the log level to finest in the group configurations and I have 
also added trace events for forest. But I am not able to get any additional 
details that could point me to what the error is about.

Any help in this regard would be appreciated. Please let me know if there are 
any other ways to connect to HDFS as a forest directory.



Thanks,
Sudheer


---
This communication may contain confidential and/or privileged information. If 
you are not the intended recipient (or have received this communication in 
error) please notify the sender immediately and destroy this communication. Any 
unauthorized copying, disclosure or distribution of the material in this 
communication is strictly forbidden.

Deutsche Bank does not render legal or tax advice, and the information 
contained in this communication should not be regarded as such.
___
General mailing list
General@developer.marklogic.com
http://developer.marklogic.com/mailman/listinfo/general