Hi 良人,
The first error indicates there is a problem with database table creation.
Check if mysql contains this table:
create table if not exists mapreduce_fsm_template (
job_id VARCHAR(80),
unique_id VARCHAR(80),
friendly_id VARCHAR(80),
state_name VARCHAR(80),
hostname VARCHAR(80),
other_host VARCHAR(80),
start_time timestamp default 0,
finish_time timestamp default 0,
start_time_millis bigint default 0,
finish_time_millis bigint default 0,
status varchar(10) default 0,
file_bytes_read bigint default 0,
file_bytes_written bigint default 0,
combine_input_records bigint default 0,
combine_output_records bigint default 0,
input_records bigint default 0,
output_records bigint default 0,
input_bytes bigint default 0,
output_bytes bigint default 0,
input_groups bigint default 0,
spilled_records bigint default 0,
primary key(unique_id),
index(start_time, finish_time, job_id)
) ENGINE=InnoDB;
This may be caused by lacking of dbAdmin.sh running. I removed dbAdmin.sh
in Chukwa 0.4, but if you want to use mysql with Chukwa, then you need to
copy dbAdmin.sh from Chukwa 0.3 and put in chukwa-0.4.0/bin directory.
The second problem is that view in hdfs://host/chukwa/hicc/view may be
corrupted, or not populated correctly. Please move existing /chukwa/hicc to
another directory, and restart hicc to let hicc populate the directory
again. Please make sure hicc has read/write access in /chukwa.
Regards,
Eric
On 9/3/10 8:26 AM, "良人" <[email protected]> wrote:
> hi:
> i configure the chuwa one month, but some quesiton disturbed me,the hicc
> stil can not work and the log can go into mysql database.
> could you give me some adivce ,thank you .
> the postprocess error information:
> 010-09-02 08:02:51,652 ERROR pool-2-thread-1 MetricDataLoader -
> java.sql.BatchUpdateException: Table 'chukwa.mapreduce_fsm_2122_week' doesn't
> exist
> java.sql.BatchUpdateException: Table 'chukwa.mapreduce_fsm_2122_week' doesn't
> exist
> at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007)
> at
> org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java
> :494)
> at
> org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.jav
> a:571)
> at
> org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.jav
> a:50)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java
> :886)
> at
>
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908>
)
> .2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.contextname does
> not contain valid MDL structure.
> 2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.queuesize does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.chukwa_timestamp
> does not contain valid MDL structure.
> 2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.fullqueue does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.hostname does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.period does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,535 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.recordname does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,536 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.addedchunk does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,536 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.datasize does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,536 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.removedchunk does
> not contain valid MDL structure.
> 2010-09-02 08:00:29,536 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.contextname does
> not contain valid MDL structure.
> 2010-09-02 08:00:29,536 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.queuesize does not
> contain valid MDL structure.
> 2010-09-02 08:00:29,536 ERROR pool-1-thread-1 MetricDataLoader -
> dbKey:report.db.name.chunkqueue fieldKey:metric.chunkqueue.chukwa_timestamp
> does not contain valid MDL structure.
>
>
>
> the hicc log information following:
> 2010-09-03 07:29:07,122 ERROR btpool0-3 ViewStore - org.json.JSONException: A
> JSONObject text must begin with '{' at character 1 of [{"description":"Default
> view","owner":"","permission":{"all":{"modify":1,"read":1}},"key":"default"}]
> at org.json.JSONTokener.syntaxError(JSONTokener.java:448)
> at org.json.JSONObject.<init>(JSONObject.java:174)
> at org.json.JSONObject.<init>(JSONObject.java:242)
> at org.apache.hadoop.chukwa.datastore.ViewStore.list(ViewStore.java:217)
> at
> org.apache.hadoop.chukwa.rest.resource.ViewResource.getUserViewList(ViewResour
> ce.java:159)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.j
> ava:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatc
> hProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java
> :156)
> at
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.
> dispatch(ResourceJavaMethodDispatcher.java:67)
> at
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java
> :166)
> at
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRul
> e.java:114)
> at
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRul
> e.java:74)
> at
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRul
> e.java:114)
> at
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResour
> ceClassesRule.java:66)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebAp
> plicationImpl.java:658)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApp
> licationImpl.java:616)
> at
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApp
> licationImpl.java:607
>
>
> 网易邮箱，没有垃圾邮件的邮箱。 <http://mail.163.com/?from=fe1>
