Hi, Do you have dbAdmin.sh running in the background? From the stack trace, it looks like the ddatabase schema has not been created. It is probably cause by not having dbAdmin.sh running in the background to create partition table periodically. Long time ago, it was decided that we were moving data to HBase, hence dbAdmin.sh does not exist in Chukwa 0.4. You might need to copy dbAdmin.sh from Chukwa 0.3 tarball to schedule table creation in the background. Hope this helps.
regards, Eric On Oct 23, 2011, at 8:26 PM, wzz wrote: > hi, > I followed http://incubator.apache.org/chukwa/docs/r0.4.0/admin.html to > install the chukwa. But chukwa could not save data into mysql. Whats the > problem? Here is the postprocess.log: > > 2011-10-20 20:28:00,255 ERROR pool-1-thread-2 MetricDataLoader - > java.sql.BatchUpdateException: Table 'chukwa.system_metrics_2181_week' > doesn't exist > java.sql.BatchUpdateException: Table 'chukwa.system_metrics_2181_week' > doesn't exist > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.Executors > $RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.ThreadPoolExecutor > $Worker.runTask(ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor > $Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > 2011-10-20 20:28:00,255 ERROR pool-1-thread-2 MetricDataLoader - > SQLException: Table 'chukwa.system_metrics_2181_week' doesn't exist > 2011-10-20 20:28:00,255 ERROR pool-1-thread-2 MetricDataLoader - > SQLState: 42S02 > 2011-10-20 20:28:00,255 ERROR pool-1-thread-2 MetricDataLoader - > VendorError: 1146 > 2011-10-20 20:28:00,255 INFO pool-1-thread-2 MetricDataLoader - > batchMode commit done > 2011-10-20 20:28:00,255 INFO pool-1-thread-2 MetricDataLoader - Error > occurred in saving (systemmetrics,chukwa) 0 sec. numOfRecords: 3 > 2011-10-20 20:28:00,257 INFO pool-1-thread-2 MetricDataLoader - > StreamName: Top_20111020_20_20.R.evt > 2011-10-20 20:28:00,296 ERROR pool-1-thread-3 MetricDataLoader - > java.sql.BatchUpdateException: Table 'chukwa.system_metrics_2181_week' > doesn't exist > java.sql.BatchUpdateException: Table 'chukwa.system_metrics_2181_week' > doesn't exist > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.Executors > $RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.ThreadPoolExecutor > $Worker.runTask(ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor > $Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > 2011-10-20 20:28:00,296 ERROR pool-1-thread-3 MetricDataLoader - > SQLException: Table 'chukwa.system_metrics_2181_week' doesn't exist > 2011-10-20 20:28:00,296 ERROR pool-1-thread-3 MetricDataLoader - > SQLState: 42S02 > 2011-10-20 20:28:00,296 ERROR pool-1-thread-3 MetricDataLoader - > VendorError: 1146 > 2011-10-20 20:28:00,296 INFO pool-1-thread-3 MetricDataLoader - > batchMode commit done > 2011-10-20 20:28:00,297 INFO pool-1-thread-3 MetricDataLoader - Error > occurred in saving (systemmetrics,chukwa) 0 sec. numOfRecords: 9 > 2011-10-20 20:28:00,297 INFO pool-1-thread-3 MetricDataLoader - > StreamName: Top_20111020_20_25.R.evt > 2011-10-20 20:28:01,549 INFO pool-1-thread-3 MetricDataLoader - Batch > mode inserted=0records. > 2011-10-20 20:28:01,549 INFO pool-1-thread-3 MetricDataLoader - > batchMode commit done > 2011-10-20 20:28:01,549 INFO pool-1-thread-3 MetricDataLoader - Saved > (top,chukwa) 1 sec. numOfRecords: 317 > 2011-10-20 20:28:01,552 INFO pool-1-thread-3 MetricDataLoader - > StreamName: chukwaAgent_20111020_20_20.R.evt > 2011-10-20 20:28:01,756 INFO pool-1-thread-2 MetricDataLoader - Batch > mode inserted=0records. > 2011-10-20 20:28:01,756 INFO pool-1-thread-2 MetricDataLoader - > batchMode commit done > 2011-10-20 20:28:01,756 INFO pool-1-thread-2 MetricDataLoader - Saved > (top,chukwa) 1 sec. numOfRecords: 810 > 2011-10-20 20:28:01,757 INFO pool-1-thread-2 MetricDataLoader - > StreamName: chukwaAgent_20111020_20_25.R.evt > 2011-10-20 20:28:01,875 ERROR pool-1-thread-3 MetricDataLoader - > java.sql.BatchUpdateException: Table 'chukwa.chukwaagent_2181_week' > doesn't exist > java.sql.BatchUpdateException: Table 'chukwa.chukwaagent_2181_week' > doesn't exist > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.Executors > $RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.ThreadPoolExecutor > $Worker.runTask(ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor > $Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > 2011-10-20 20:28:01,876 ERROR pool-1-thread-3 MetricDataLoader - > SQLException: Table 'chukwa.chukwaagent_2181_week' doesn't exist > 2011-10-20 20:28:01,876 ERROR pool-1-thread-3 MetricDataLoader - > SQLState: 42S02 > 2011-10-20 20:28:01,876 ERROR pool-1-thread-3 MetricDataLoader - > VendorError: 1146 > 2011-10-20 20:28:01,876 INFO pool-1-thread-3 MetricDataLoader - > batchMode commit done > 2011-10-20 20:28:01,876 INFO pool-1-thread-3 MetricDataLoader - Error > occurred in saving (chukwaagent,chukwa) 0 sec. numOfRecords: 9 > 2011-10-20 20:28:01,877 INFO pool-1-thread-3 MetricDataLoader - > StreamName: chukwaHttpSender_20111020_20_20.R.evt > 2011-10-20 20:28:01,995 ERROR pool-1-thread-2 MetricDataLoader - > java.sql.BatchUpdateException: Table 'chukwa.chukwaagent_2181_week' > doesn't exist > java.sql.BatchUpdateException: Table 'chukwa.chukwaagent_2181_week' > doesn't exist > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.Executors > $RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.ThreadPoolExecutor > $Worker.runTask(ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor > $Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > 2011-10-20 20:28:01,995 ERROR pool-1-thread-2 MetricDataLoader - > SQLException: Table 'chukwa.chukwaagent_2181_week' doesn't exist > 2011-10-20 20:28:01,995 ERROR pool-1-thread-2 MetricDataLoader - > SQLState: 42S02 > 2011-10-20 20:28:01,995 ERROR pool-1-thread-2 MetricDataLoader - > VendorError: 1146 > 2011-10-20 20:28:01,995 INFO pool-1-thread-2 MetricDataLoader - > batchMode commit done > 2011-10-20 20:28:01,995 INFO pool-1-thread-2 MetricDataLoader - Error > occurred in saving (chukwaagent,chukwa) 0 sec. numOfRecords: 1 > 2011-10-20 20:28:01,996 INFO pool-1-thread-2 MetricDataLoader - > StreamName: chukwaHttpSender_20111020_20_25.R.evt > 2011-10-20 20:28:02,193 ERROR pool-1-thread-3 MetricDataLoader - > java.sql.BatchUpdateException: Table 'chukwa.chukwahttpsender_2181_week' > doesn't exist > java.sql.BatchUpdateException: Table 'chukwa.chukwahttpsender_2181_week' > doesn't exist > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.Executors > $RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.ThreadPoolExecutor > $Worker.runTask(ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor > $Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > 2011-10-20 20:28:02,194 ERROR pool-1-thread-3 MetricDataLoader - > SQLException: Table 'chukwa.chukwahttpsender_2181_week' doesn't exist > 2011-10-20 20:28:02,194 ERROR pool-1-thread-3 MetricDataLoader - > SQLState: 42S02 > 2011-10-20 20:28:02,194 ERROR pool-1-thread-3 MetricDataLoader - > VendorError: 1146 > 2011-10-20 20:28:02,194 INFO pool-1-thread-3 MetricDataLoader - > batchMode commit done > 2011-10-20 20:28:02,194 INFO pool-1-thread-3 MetricDataLoader - Error > occurred in saving (chukwahttpsender,chukwa) 0 sec. numOfRecords: 9 > 2011-10-20 20:28:02,206 INFO pool-1-thread-3 MetricDataLoader - > StreamName: chunkQueue_20111020_20_20.R.evt > 2011-10-20 20:28:02,218 ERROR pool-1-thread-2 MetricDataLoader - > java.sql.BatchUpdateException: Table 'chukwa.chukwahttpsender_2181_week' > doesn't exist > java.sql.BatchUpdateException: Table 'chukwa.chukwahttpsender_2181_week' > doesn't exist > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.Executors > $RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.ThreadPoolExecutor > $Worker.runTask(ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor > $Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > 2011-10-20 20:28:02,218 ERROR pool-1-thread-2 MetricDataLoader - > SQLException: Table 'chukwa.chukwahttpsender_2181_week' doesn't exist > 2011-10-20 20:28:02,218 ERROR pool-1-thread-2 MetricDataLoader - > SQLState: 42S02 > 2011-10-20 20:28:02,218 ERROR pool-1-thread-2 MetricDataLoader - > VendorError: 1146 > 2011-10-20 20:28:02,219 INFO pool-1-thread-2 MetricDataLoader - > batchMode commit done > 2011-10-20 20:28:02,219 INFO pool-1-thread-2 MetricDataLoader - Error > occurred in saving (chukwahttpsender,chukwa) 0 sec. numOfRecords: 1 > 2011-10-20 20:28:02,219 INFO pool-1-thread-1 MetricDataLoader - Batch > mode inserted=0records. > 2011-10-20 20:28:02,219 INFO pool-1-thread-1 MetricDataLoader - > batchMode commit done > 2011-10-20 20:28:02,219 INFO pool-1-thread-1 MetricDataLoader - Saved > (dfinerror,chukwa) 2 sec. numOfRecords: 9937 > 2011-10-20 20:28:02,220 INFO pool-1-thread-2 MetricDataLoader - > StreamName: chunkQueue_20111020_20_25.R.evt > 2011-10-20 20:28:02,328 ERROR pool-1-thread-2 MetricDataLoader - > java.sql.BatchUpdateException: Table 'chukwa.chunkqueue_2181_week' > doesn't exist > java.sql.BatchUpdateException: Table 'chukwa.chunkqueue_2181_week' > doesn't exist > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.Executors > $RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.ThreadPoolExecutor > $Worker.runTask(ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor > $Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > 2011-10-20 20:28:02,329 ERROR pool-1-thread-2 MetricDataLoader - > SQLException: Table 'chukwa.chunkqueue_2181_week' doesn't exist > 2011-10-20 20:28:02,329 ERROR pool-1-thread-2 MetricDataLoader - > SQLState: 42S02 > 2011-10-20 20:28:02,329 ERROR pool-1-thread-2 MetricDataLoader - > VendorError: 1146 > 2011-10-20 20:28:02,329 INFO pool-1-thread-2 MetricDataLoader - > batchMode commit done > 2011-10-20 20:28:02,329 INFO pool-1-thread-2 MetricDataLoader - Error > occurred in saving (chunkqueue,chukwa) 0 sec. numOfRecords: 1 > 2011-10-20 20:28:02,397 ERROR pool-1-thread-3 MetricDataLoader - > java.sql.BatchUpdateException: Table 'chukwa.chunkqueue_2181_week' > doesn't exist > java.sql.BatchUpdateException: Table 'chukwa.chunkqueue_2181_week' > doesn't exist > at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:494) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:571) > at > org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.Executors > $RunnableAdapter.call(Executors.java:441) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.ThreadPoolExecutor > $Worker.runTask(ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor > $Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > 2011-10-20 20:28:02,405 ERROR pool-1-thread-3 MetricDataLoader - > SQLException: Table 'chukwa.chunkqueue_2181_week' doesn't exist > 2011-10-20 20:28:02,405 ERROR pool-1-thread-3 MetricDataLoader - > SQLState: 42S02 > 2011-10-20 20:28:02,406 ERROR pool-1-thread-3 MetricDataLoader - > VendorError: 1146 >
