各位大神:

       我是一位刚接触kylin的小白,目前碰到以下问题,期待各位大佬的回复!

 

报错日志:

       


2021-11-04 23:50:44,454 INFO [main]
org.apache.kafka.clients.consumer.KafkaConsumer: [Consumer
clientId=consumer-cube_xzl_feesserial_streaming-1,
groupId=cube_xzl_feesserial_streaming] Seeking to offset 419176 for
partition erp1853serial.dbo.Tb_HSPR_FeesSerial-0

2021-11-04 23:50:44,463 INFO [main]
org.apache.kylin.source.kafka.hadoop.KafkaInputRecordReader:
erp1853serial.dbo.Tb_HSPR_FeesSerial:10.91.247.125:9092,10.91.247.124:9092,1
0.91.247.126:9092:0 fetching offset 419268 

2021-11-04 23:50:44,463 INFO [main]
org.apache.kafka.clients.consumer.KafkaConsumer: [Consumer
clientId=consumer-cube_xzl_feesserial_streaming-1,
groupId=cube_xzl_feesserial_streaming] Seeking to offset 419268 for
partition erp1853serial.dbo.Tb_HSPR_FeesSerial-0

2021-11-04 23:50:44,503 INFO [main]
org.apache.kylin.source.kafka.hadoop.KafkaInputRecordReader:
erp1853serial.dbo.Tb_HSPR_FeesSerial:10.91.247.125:9092,10.91.247.124:9092,1
0.91.247.126:9092:0 fetching offset 419670 

2021-11-04 23:50:44,503 INFO [main]
org.apache.kafka.clients.consumer.KafkaConsumer: [Consumer
clientId=consumer-cube_xzl_feesserial_streaming-1,
groupId=cube_xzl_feesserial_streaming] Seeking to offset 419670 for
partition erp1853serial.dbo.Tb_HSPR_FeesSerial-0

2021-11-04 23:50:44,522 WARN [main]
org.apache.kylin.source.kafka.TimedJsonStreamParser: Property 'after' value
is not embedded JSON format. 

2021-11-04 23:50:44,523 INFO [main] org.apache.kylin.engine.mr.KylinMapper:
Do cleanup, available memory: 3423m

2021-11-04 23:50:44,523 INFO [main] org.apache.kylin.engine.mr.KylinMapper:
Total rows: 419790

2021-11-04 23:50:44,523 INFO [main]
org.apache.kylin.source.kafka.hadoop.KafkaInputRecordReader:
erp1853serial.dbo.Tb_HSPR_FeesSerial:10.91.247.125:9092,10.91.247.124:9092,1
0.91.247.126:9092:0 num. processed messages 419790 

2021-11-04 23:50:44,558 WARN [main] org.apache.hadoop.mapred.YarnChild:
Exception running child : java.lang.NullPointerException

        at org.apache.kylin.common.util.Bytes.toBytes(Bytes.java:354)

        at
org.apache.kylin.source.kafka.hadoop.KafkaInputRecordReader.nextKeyValue(Kaf
kaInputRecordReader.java:135)

        at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTas
k.java:568)

        at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.
java:80)

        at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(Wrapp
edMapper.java:91)

        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)

        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:799)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)

        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:422)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
va:1732)

        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)

 

2021-11-04 23:50:44,561 INFO [main] org.apache.hadoop.mapred.Task: Running
cleanup for the task

 

我的环境信息:hadoop-3.2.1,kafka_2.11-2.4.1,hbase-2.3.4

 

问题急需解决,期待大神的解答回复

 

祝:

       安好!

Reply via email to