I was trying to install HICC in Chukwa, but hicc.sh does not exist in the
repository.
Any idea?
-bikash
On Fri, Apr 1, 2011 at 5:57 PM, bikash sharma wrote:
> Thanks Bill.
> I am able to connect via web now, actually had put wrong http port in
> config file.
> One following questio
Thanks Bill.
I am able to connect via web now, actually had put wrong http port in config
file.
One following question - if i run a mapreduce program say terasort, how can
we link chukwa to collect job metrics via web.
On Fri, Apr 1, 2011 at 5:37 PM, Bill Graham wrote:
> Unfortunately c
Unfortunately conf/collectors is used in two different ways in Chukwa,
each with a different syntax. This should really be fixed.
1. The script that starts the collectors looks at it for a list of
hostnames (no ports) to start collectors on. To start it just on one
host, set it to localhost.
2
Hi,
I am trying to setup Chukwa for a 16-node Hadoop cluster.
I followed the admin guide -
http://incubator.apache.org/chukwa/docs/r0.4.0/admin.html#Agents
However, I ran two the following issues:
1. What should be the collector port that needs to be specified in
conf/collectors file
2. Am unable
Chukwa is good for general purpose log aggregation, and it has specific
knowledge of analyze hadoop logs for monitoring/reporting hadoop performance.
Log aggregation component is a completed system in Chukwa 0.4 for streaming
logs into hadoop. Trunk also provides a completed reference
Is Chukwa primarily used for analytics or log aggregation. I thought it
was the latter but it seems more and more its like the former.
On 3/21/11 8:27 AM, Eric Yang wrote:
Chukwa is waiting on a official release of Hadoop and HBase which
works together. In Chukwa trunk, Chukwa is using HBase
Chukwa is waiting on a official release of Hadoop and HBase which
works together. In Chukwa trunk, Chukwa is using HBase as data
storage, and using pig+hbase for data analytics. Unfortunately,
Hadoop security release branch and Hadoop trunk are both broken for
HBase. Hence, Chukwa is in
Mailing lists should be alive. Fairly low traffic, but alive.
On Sun, Mar 20, 2011 at 9:38 AM, Mark wrote:
> Whats the deal with Chukwa? Mailing list doesn't look like its alive as well
> as any of the download options???
> http://www.apache.org/dyn/closer.cgi/incubator/chukw
Chukwa hasn't had a release since moving from Hadoop to incubator so
there are no releases in the /incubator repos. Follow the link on the
Chukwa homepage to the downloads repos:
http://incubator.apache.org/chukwa/
http://www.apache.org/dyn/closer.cgi/hadoop/chukwa/chukwa-0.4.0
On Sun, M
Yes, we run light weight Chukwa agents and collectors only, using
Chukwa just as you describe. We've been doing so for over a year or so
without many issues. The code is fairly easy to extend when needed. We
rolled our own collector, agent and demux RPMs.
The monitoring peice of chuk
On 3/20/11 10:03 AM, Ted Dunning wrote:
>
> OpenTSDB is purely a monitoring solution which is the primary mission of
> chukwa.
>
> If you are looking for data import, what about Flume?
>
> On Sun, Mar 20, 2011 at 9:59 AM, Mark wrote:
>
>> Thanks but we need Chukwa to ag
primary mission
of chukwa.
If you are looking for data import, what about Flume?
On Sun, Mar 20, 2011 at 9:59 AM, Mark <mailto:static.void@gmail.com>> wrote:
Thanks but we need Chukwa to aggregate and store files from across
our app servers into Hadoop. Doesn't really look
OpenTSDB is purely a monitoring solution which is the primary mission of
chukwa.
If you are looking for data import, what about Flume?
On Sun, Mar 20, 2011 at 9:59 AM, Mark wrote:
> Thanks but we need Chukwa to aggregate and store files from across our app
> servers into Hadoop. D
Thanks but we need Chukwa to aggregate and store files from across our
app servers into Hadoop. Doesn't really look like opentsdb is meant for
that. I could be wrong though?
On 3/20/11 9:49 AM, Ted Dunning wrote:
Take a look at openTsDb at http://opentsdb.net/
It provides lots o
Take a look at openTsDb at http://opentsdb.net/
It provides lots of the capability in a MUCH simpler package.
On Sun, Mar 20, 2011 at 8:43 AM, Mark wrote:
> Sorry but it doesn't look like Chukwa mailing list exists anymore?
>
> Is there an easy way to set up lightweight agents
Whats the deal with Chukwa? Mailing list doesn't look like its alive as
well as any of the download options???
http://www.apache.org/dyn/closer.cgi/incubator/chukwa/
Is this project dead?
Sorry but it doesn't look like Chukwa mailing list exists anymore?
Is there an easy way to set up lightweight agents on cluster of machines
instead of downloading the full Chukwa source (+50mb)?
Has anyone build separate RPM's for the agents/collectors?
Thanks
Your understanding of how Chukwa works is correct.
"Hadoop by itself" is a system that contains both the HDFS and the MapReduce
systems. The other projects you lists are all projects built upon Hadoop,
but you don't need them to run or to get value out of Hadoop by itself.
To
I am looking into to Chukwa to collect/aggregate our search logs from across
multiple hosts. As I understand it I need to have a agent/adaptor running on
each host which then in turn forward this to a collector (across the
network) which will then write out to HDFS. Correct?
Does Hadoop need to
On Sep 10, 2009, at 10:44 AM, Ted Yu wrote:
I found Chukwa to be an interesting project.
Can someone give a little detail on how freshly generated log files
are
handled ?
I have downloaded the source code. So a few filenames would help me
better
understand.
Please redirect your
I found Chukwa to be an interesting project.
Can someone give a little detail on how freshly generated log files are
handled ?
I have downloaded the source code. So a few filenames would help me better
understand.
Thanks
May i post question, this forum?
My cluster consisted hadoop-0.18.3, chukwa-0.1.2 and java-6-sun-1.6.0.14.
I don't know this chukwa start error message.
CMD : chukwa/bin/start-all.sh
All agent occur this message.
/home/pccs/hadoop/chukwa/bin/../bin/agent.sh: 24: function: not found
P
22 matches
Mail list logo
