connects and disconnects with read count -1 .
Can anybody help me finding the root cause of this issue ? I've tried
to restart Hbase and so on but with no effect. Hive is also working
fine, just not my coding :(
Thanks a lot,
Marco
no effect :(
2014-12-16 15:19 GMT+01:00 Marco :
> Hi,
>
> Hbase is installed correctly and working (hbase shell works fine).
>
> But I'm not able to use the Java API to connect to an existing Hbase Table:
>
> <<<
> val conf = HBaseConfiguration.
Cheers
>
> On Tue, Dec 16, 2014 at 7:57 AM, Marco wrote:
>>
>> no effect :(
>>
>> 2014-12-16 15:19 GMT+01:00 Marco :
>> > Hi,
>> >
>> > Hbase is installed correctly and working (hbase shell works fine).
>> >
>> > But I&#x
Hi Wilm,
I've attached the logs. The region server logs only contain debug
messages and mostly like the pattern, which I've pasted.
I'm using the HortonWorksStack and have a single machine, on which
runs the complete stack (no cluster).
Hbase shell, Hive and Apache Phoenix works
the same issue.
Could it be a credential issue or sth in that direction? I also guess
I've no chance to debug it?
Anyways, thanks for your time,
Marco
2014-12-17 14:10 GMT+01:00 Wilm Schumacher :
> Hi,
>
> I didn't found the content of the conf/regionservers files attached.
>
>Tonight I will take a closer look at the sandbox (never
>used it before). Perhaps I'll find something. But there are some GB to
>download ;).
That would be cool :) Thx.
2014-12-17 14:56 GMT+01:00 Wilm Schumacher :
> Am 17.12.2014 um 14:29 schrieb Marco:
>> Hi Wilm,
>&
Ok, btw I've used "HDP 2.2 on Sandbox"
2014-12-18 4:19 GMT+01:00 Wilm Schumacher :
> Am 17.12.2014 um 15:27 schrieb Marco:
>>> Tonight I will take a closer look at the sandbox (never
>>> used it before). Perhaps I'll find something. But there are some GB
would start there before using the api.
> On Dec 18, 2014 2:08 AM, "Marco" wrote:
>
>> Ok, btw I've used "HDP 2.2 on Sandbox"
>>
>> 2014-12-18 4:19 GMT+01:00 Wilm Schumacher :
>> > Am 17.12.2014 um 15:27 schrieb Marco:
>> >>> To
Hi Wilm,
I also think, I'll try it with a hbase standalone install. Also via
the logging of Apache Phoenix, I see that this framework can without
any issues use the region server and it's the same hbase-site.xml.,.
Nevertheless, thank you very much for your efforts!!!
Best wishes,
M
to me and I find an info that the protocol client<->server
has changed...then I've realized what the problem might be
Maybe such incompatibilities could be better expressed in the log , don't know.
Anyways, all is running fine now :)
BR Marco
2014-12-18 20:36 GMT+01:00 Marco :
nderstanding is you can't deploy this to a yarn-cluster. Is this
correct or what are my options here ? My major concern is scaleability
(e.g. having a lot of SQL requests, which may also not be trivial)
Thanks,
Marco
In the meantime I've played with Spark 'standalone' cluster. There it works.
Is my assumption correct that the Thriftserver only works with the Spark
standalone cluster ? Or would Mesos be an alternative?
BR Marco
2015-02-16 16:36 GMT+01:00 Marco :
> Hi,
>
> I'
:393)
at
org.apache.zookeeper.server.quorum.FastLeaderElection$Messenger$WorkerSender.run(FastLeaderElection.java:365)
at java.lang.Thread.run(Thread.java:679)
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta
On Sunday 30 December 2012 at 1:07 AM, Stack wrote:
> On Sat, Dec 29, 2012 at 9:22 AM, Marco Gallotta (mailto:ma...@gallotta.co.za)>wrote:
>
> > I also see a number of these warnings in the zookeeper logs, which look
> > quite telling. Zookeeper is running on the slaves
or in the config.
Appreciate any help.
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1 (650) 417-3313
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On Friday 08 February 2013 at 7:23 AM, Marcos Ortiz wrote:
> On 02/08/2013 03:16 PM, Marco Gallotta wrote:
> > Hey guys I'm running hbase on Ubuntu, and I'm experiencing problems with
> > "too many open files". I've got the following in limits.conf: * -
On Friday 08 February 2013 at 12:27 PM, Marco Gallotta wrote:
> On Friday 08 February 2013 at 7:23 AM, Marcos Ortiz wrote:
> > On 02/08/2013 03:16 PM, Marco Gallotta wrote:
> > > Hey guys I'm running hbase on Ubuntu, and I'm experiencing problems with
> > >
I have this particular use case:
1) HBase not started.
2) A server application that will use HBase stores a configuration a
field, such as:
Configuration configuration = HBaseConfiguration.create();
configuration.set("hbase.zookeeper.quorum", "localhost");
2) The server application is asked to p
I have not found any documentation on how hbase would work across
multiple data-centers.
In fact, I am concerned about how a centralized zookeeper would make
multi-data center support impossible.
How is this handled? What if somebody needs to read and write from
multiple data-centers?
Any advic
t work across datacenters, maybe that's
> why you haven't found any documentation.
>
> HBase does have replication between clusters, see
> http://hbase.apache.org/replication.html
>
> J-D
>
> On Thu, May 3, 2012 at 11:10 AM, Marco Villalobos
> wrote:
>> I
is to shard your counters, on read you just sum them up.
>
> J-D
>
> On Thu, May 3, 2012 at 1:14 PM, Marco Villalobos
> wrote:
>> I'm fine with replication.
>>
>> But does that mean I can only write from one data-center?
>>
>> Ideally I would w
y planning on having thousands
> of data centers.
>
> J-D
>
> On Thu, May 3, 2012 at 2:39 PM, Marco Villalobos
> wrote:
>> Hence a counter should be local to a data-center, and perhaps a map
>> reduce job can aggregate them later, then replicate?
>>
>&g
ling increment() a couple times consecutively
for the same row.
Marco
public static void increment(String tableName, String key, String family,
String qualifier, int value, boolean useShort,
Configuration config)
throws IOException{
this operation partially completed", which could cause
problems.
Marco
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1 (650) 417-3313
Sent with Sparrow (http://www.sparrowma
I acquire the lock before the get. I only setup the get before acquiring the
lock.
I'm also looking into using checkAndPut.
Marco
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za
Oh, oops, I misread increments documentation. I'm fine with that. The only
problem now then is that it only operates on longs, but I'm storing ints and
shorts to save space. Perhaps the space saving isn't worth the cost of not
using this though.
Marco
--
Marco Gallotta
f.
>
>
I have thousands of columns of per row, so I doubt that's still true?
Marco
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1 (650) 417-3313
trying to OPEN.
Any ideas how to find and remove any references to these non-existent tables?
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1 (650) 417-3313
Sen
creation when I was trying to get
lzo compression working and table creation was hanging.
Is there any way to repair this? I see hbck has repair options, but I want to
proceed with caution.
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.m
It's not a distributed cluster. I'm not processing enough data yet. So the
reference to localhost is correct.
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1 (650) 417-
;list' | ./hbase shell | tail -n52 | head -n50 | while read t; do echo
"major_compact '$t'"; done | ./hbase shell
And still get the 6 inconsistencies.
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.ga
k.java:1059)
at
org.apache.hadoop.hbase.util.HBaseFsck.restoreHdfsIntegrity(HBaseFsck.java:504)
at
org.apache.hadoop.hbase.util.HBaseFsck.offlineHdfsIntegrityRepair(HBaseFsck.java:304)
at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:377)
at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:3139)
--
Marco Gallotta
It's in /var which is persistent across reboots.
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1 (650) 417-3313
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On F
In core-site.xml:
hadoop.tmp.dir
/var/hadoop/${user.name}
In hdfs-site.xml:
dfs.name.dir
/var/hdfs-data-name
dfs.data.dir
/var/hdfs-data
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me
fs.default.name
hdfs://localhost:9000
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1 (650) 417-3313
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On
How do you check that?
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1 (650) 417-3313
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On Friday 10 August 2012 at 4:44 PM
(39.23 GB)
DFS Remaining: 162401554432(151.25 GB)
DFS Used%: 3.29%
DFS Remaining%: 76.79%
Last contact: Fri Aug 10 16:59:26 PDT 2012
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1
I never did that, but I mentioned above that all these come from when I ^C'ed
(i.e. killed) table creation when I was trying to get lzo compression working
and table creation was hanging. Where would I check for references to these
tables in ZK?
--
Marco Gallotta | Mountain View, Calif
Same exception on repair after reboot. :/
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1 (650) 417-3313
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On Friday 10
was seeing.
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1 (650) 417-3313
Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
On Friday 10 August 2012 at 5:20 PM, Marco Gall
Any idea what I might have misconfigured? Let me know what config files/etc.
might be helpful to diagnose.
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1 (650) 417-3313
Sent wit
netstat:
netstat -nlpt | grep 6
tcp6 0 0 127.0.0.1:6 :::*LISTEN
-
Hmm…how would I get master to listen on 0.0.0.0?
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me
Is it possible to run the hbase processes in the foreground so that they can be
run and monitored by supervisord?
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1 (650) 417-3313
Is it possible to run the hbase processes in the foreground so that they can be
run and monitored by supervisord?
--
Marco Gallotta | Mountain View, California
Software Engineer, Infrastructure | Loki Studios
fb.me/marco.gallotta | twitter.com/marcog
ma...@gallotta.co.za | +1 (650) 417-3313
44 matches
Mail list logo
