Hi Soufiani,
Can you try changing your configuration to have region server listen on
0.0.0.0:16020 and master listen on 0.0.0.0:16000 ?
127.0.0.1 being local loopback will not be accessible from outside.
Regards,
Sreeram
On Fri, Apr 22, 2016 at 9:00 PM, SOUFIANI Mustapha | السفياني مصطفى <
s.m
The example in the HBase-Downstreamer project handles its own Kerberos
authentication for talking to HBase; it should not be impacted by
implementation issues in Spark (unless they are severely messing with
the Classloader, which I don't think they are).
That said, I have not tested it with Spark
Hi folks!
Just a quick heads-up that the ASF JIRA is currently locked down to
counter a spam attack. Unfortunately, this lock down prevents our
normal open-policy that allows anyone with a JIRA account to create,
assign, and comment on issues.
If you are caught up in this, please drop me a note e
It is well worth the read. It goes deep so is a bit long and I had to cut
it up to do Apache Blog sized bits. Start reading here:
https://blogs.apache.org/hbase/entry/hdfs_hsm_and_hbase_part
St.Ack
Connecting to kerborised hbase from spark is fixed in spark 1.4 , don't
think 1.3 works because kerberos issues.
https://issues.apache.org/jira/plugins/servlet/mobile#issue/SPARK-6918
On Apr 23, 2016 5:35 AM, "Sean Busbey" wrote:
> The HBase-Downstreamer project has an example that uses the Java
The HBase-Downstreamer project has an example that uses the Java API
for Spark Streaming on a secure cluster:
https://github.com/saintstack/hbase-downstreamer#spark-streaming-test-application
https://s.apache.org/apvQ
We'd greatly like a Scala version.
On Fri, Apr 22, 2016 at 4:16 PM, Nkechi Ac
scala API, although Java should be easy to alter Also, the cluster is
kerberized 😣
On 22 April 2016 at 22:34, Sean Busbey wrote:
> Are you attempting to use Spark's Java API or its Scala API? (or python,
> etc?)
>
> On Fri, Apr 22, 2016 at 2:24 PM, Nkechi Achara
> wrote:
> > Hi,
> >
> > I a
Are you attempting to use Spark's Java API or its Scala API? (or python, etc?)
On Fri, Apr 22, 2016 at 2:24 PM, Nkechi Achara wrote:
> Hi,
>
> I am attempting to use both SpakOnHbase and Hbase-Spark, but I keep
> receiving dependency isues, and I am not sure if any of these connectors
> are avail
Hi,
I am attempting to use both SpakOnHbase and Hbase-Spark, but I keep
receiving dependency isues, and I am not sure if any of these connectors
are available for Spark 1.3 / Hadoop 2.6 / Hbase 1.0.
Has anyone got a new library I can use, or a concrete example to use?
Thanks,
Keech
I have two questions:
>>1. Why JVM pause while NO GCs?
>>2016-04-22 14:32:54,330 WARN [JvmPauseMonitor] util.JvmPauseMonitor:
Detected pause in JVM or host machine (eg GC): pause of approximately
>>37360ms
>>No GCs detected
Your system probably swaps
>> 2. We have mapreduce jobs running on the c
Sure, here you go.
Note that a number of them are from "optimal settings" available in a number of
presentations.
-XX:+UseConcMarkSweepGC -XX:+CMSParallelRemarkEnabled
-XX:+ParallelRefProcEnabled -XX:+CMSClassUnloadingEnabled
-XX:CMSInitiatingOccupancyFraction=80 -XX:+UseCMSInitiatingOccupancyO
Hi Guys,
I need your kind help. Region servers in my cluster crashed several
times in a week. I have been tracking this problem for a long time, but
do not root the cause.
From the region server log, we can see DFSOutputStream
ResponseProcessor exception for block
BP-454889425-192.168.68.150-
Thanks Sachine for your help, I already checked this issue on the officiel
pentaho users form and it seems to be OK for them too
I really don't know what could be the problem for this
but any way, thanks again for your help
Regards.
2016-04-22 16:17 GMT+01:00 Sachin Mittal :
> you ports are open.
you ports are open. Your settings are fine. Issue seems to be elsewhere bu
I am not sure where.
check with Pentaho maybe.
On Fri, Apr 22, 2016 at 8:44 PM, SOUFIANI Mustapha | السفياني مصطفى <
s.mustaph...@gmail.com> wrote:
> Maybe those ports are not open:
> hduser@big-services:~$ telnet localhos
Hi Sachin,
Yes this is exactly what is happening,
* Region server is listening to 127.0.0.1:16020
* Master is listening to 127.0.0.1:16000
* Zookeeper is litening to :::2181
Is this configuration OK or not ? if its OK, how could a remote client
connect with this version of HBASE?
M
Jayesh:
Is it possible for you to share the JVM parameters ?
Thanks
On Fri, Apr 22, 2016 at 7:48 AM, Thakrar, Jayesh <
jthak...@conversantmedia.com> wrote:
> Karthik,
>
> Yes, tuning can help - but the biggest help is to give "sufficient" memory
> to the regionserver.
> And "sufficient" is relat
Karthik,
Yes, tuning can help - but the biggest help is to give "sufficient" memory to
the regionserver.
And "sufficient" is relative - e.g. we have a 75GB heap (our increases were
like this - 8, 12, 16, 24, 32, 45, 60 and 75 GB)
Note that we had started off with 45 GB RAM and are now running on
Ma,
A number of things come up.
First you say that your application is read-only - not sure how that translates
to "sequential read or scan".
Second, you said that you have the following setup
- 8 AWS m1.xlarge instance, with 4 CPU cores and 16G RAM. Each region server is
configured 10G heap si
Hi Karthik,
As Ding said, eventually you need to watch your heap objects to understand what
produces so many objects in the first place.
CMS occupancy % defaults to 70%. Default values of block cache and in-memory
memstore sizes add up to around 75-80%. Which means you could get CMS to start
wal
Hi Ding,
I have increased the Heap to 2G , still getting out of memory exception .
Actually i had write the data to HBase at 40K writes/sec .
Is there any parameter to tune up , as my knowledge "-
XX:CMSInitiatingOccupancyFraction=N " i tuned like this in HBase.
Is there any other parameter requi
Hi,
Thanks for replying.
1. I'm using Hbase 1.1.4
2. hbase is running on localhost not on master-sigma as shown in the hbase
UI administration
3. Yes I can run hbase shell without any problem
4. when I check the master log, I see that the hbase:meta can not be found
2016-04-21 18:18:21,179 IN
21 matches
Mail list logo
