各位大神:
我是一位刚接触kylin的小白,目前碰到以下问题,期待各位大佬的回复!
报错日志:
2021-11-04 23:50:44,454 INFO [main]
org.apache.kafka.clients.consumer.KafkaConsumer: [Consumer
clientId=consumer-cube_xzl_feesserial_streaming-1,
groupId=cube_xzl_feesserial_streaming] Seeking to offset 419176 for
partition erp1853serial.dbo.Tb_HSPR_FeesSerial-0
2021-11-04 23:50:44,463 INFO [main]
org.apache.kylin.source.kafka.hadoop.KafkaInputRecordReader:
erp1853serial.dbo.Tb_HSPR_FeesSerial:10.91.247.125:9092,10.91.247.124:9092,1
0.91.247.126:9092:0 fetching offset 419268
2021-11-04 23:50:44,463 INFO [main]
org.apache.kafka.clients.consumer.KafkaConsumer: [Consumer
clientId=consumer-cube_xzl_feesserial_streaming-1,
groupId=cube_xzl_feesserial_streaming] Seeking to offset 419268 for
partition erp1853serial.dbo.Tb_HSPR_FeesSerial-0
2021-11-04 23:50:44,503 INFO [main]
org.apache.kylin.source.kafka.hadoop.KafkaInputRecordReader:
erp1853serial.dbo.Tb_HSPR_FeesSerial:10.91.247.125:9092,10.91.247.124:9092,1
0.91.247.126:9092:0 fetching offset 419670
2021-11-04 23:50:44,503 INFO [main]
org.apache.kafka.clients.consumer.KafkaConsumer: [Consumer
clientId=consumer-cube_xzl_feesserial_streaming-1,
groupId=cube_xzl_feesserial_streaming] Seeking to offset 419670 for
partition erp1853serial.dbo.Tb_HSPR_FeesSerial-0
2021-11-04 23:50:44,522 WARN [main]
org.apache.kylin.source.kafka.TimedJsonStreamParser: Property 'after' value
is not embedded JSON format.
2021-11-04 23:50:44,523 INFO [main] org.apache.kylin.engine.mr.KylinMapper:
Do cleanup, available memory: 3423m
2021-11-04 23:50:44,523 INFO [main] org.apache.kylin.engine.mr.KylinMapper:
Total rows: 419790
2021-11-04 23:50:44,523 INFO [main]
org.apache.kylin.source.kafka.hadoop.KafkaInputRecordReader:
erp1853serial.dbo.Tb_HSPR_FeesSerial:10.91.247.125:9092,10.91.247.124:9092,1
0.91.247.126:9092:0 num. processed messages 419790
2021-11-04 23:50:44,558 WARN [main] org.apache.hadoop.mapred.YarnChild:
Exception running child : java.lang.NullPointerException
at org.apache.kylin.common.util.Bytes.toBytes(Bytes.java:354)
at
org.apache.kylin.source.kafka.hadoop.KafkaInputRecordReader.nextKeyValue(Kaf
kaInputRecordReader.java:135)
at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTas
k.java:568)
at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.
java:80)
at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(Wrapp
edMapper.java:91)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
va:1732)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
2021-11-04 23:50:44,561 INFO [main] org.apache.hadoop.mapred.Task: Running
cleanup for the task
我的环境信息:hadoop-3.2.1,kafka_2.11-2.4.1,hbase-2.3.4
问题急需解决,期待大神的解答回复
祝:
安好!