Hi all,
I am trying to ingest data to Solr 6.3 using flume 1.5 on Hortonworks 2.5
platform
Facing below issue while sinking the data
19 Apr 2017 19:54:26,943 ERROR [lifecycleSupervisor-1-3]
(org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run:253) -
Unable to start SinkRunner: {
policy:org.apache.flume.sink.DefaultSinkProcessor@130344d7 counterGroup:{
name:null counters:{} } } - Exception follows.
org.kitesdk.morphline.api.MorphlineCompilationException: No command builder
registered for name: detectMimeType near: {
# /etc/flume/conf/morphline.conf: 48
"detectMimeType" : {
# /etc/flume/conf/morphline.conf: 50
"includeDefaultMimeTypes" : true
}
}
The morphline config file is as below
id : morphline1
importCommands : ["org.kitesdk.**", "org.apache.solr.**"]
# importCommands : ["com.cloudera.**", "org.kitesdk.**"]
commands :
[
{ detectMimeType { includeDefaultMimeTypes : true } }
{
solrCell {
solrLocator : ${solrLocator}
captureAttr : true
lowernames : true
capture : [_attachment_body, _attachment_mimetype, basename, content,
content_encoding, content_type, file, meta,text]
parsers : [ # { parser : org.apache.tika.parser.txt.TXTParser }
# { parser : org.apache.tika.parser.AutoDetectParser }
#{ parser : org.apache.tika.parser.asm.ClassParser }
#{ parser : org.gagravarr.tika.FlacParser }
#{ parser :
org.apache.tika.parser.executable.ExecutableParser }
#{ parser : org.apache.tika.parser.font.TrueTypeParser }
#{ parser : org.apache.tika.parser.xml.XMLParser }
#{ parser : org.apache.tika.parser.html.HtmlParser }
#{ parser : org.apache.tika.parser.image.TiffParser }
# { parser : org.apache.tika.parser.mail.RFC822Parser }
#{ parser : org.apache.tika.parser.mbox.MboxParser,
additionalSupportedMimeTypes : [message/x-emlx] }
#{ parser : org.apache.tika.parser.microsoft.OfficeParser
}
#{ parser : org.apache.tika.parser.hdf.HDFParser }
#{ parser : org.apache.tika.parser.odf.OpenDocumentParser
}
#{ parser : org.apache.tika.parser.pdf.PDFParser }
#{ parser : org.apache.tika.parser.rtf.RTFParser }
{ parser : org.apache.tika.parser.txt.TXTParser }
#{ parser : org.apache.tika.parser.chm.ChmParser }
]
fmap : { content : text }
}
}
{ generateUUID { field : id } }
{ sanitizeUnknownSolrFields { solrLocator : ${solrLocator} } }
{ logDebug { format : "output record: {}", args : ["@{}"] } }
{ loadSolr: { solrLocator : ${solrLocator} } }
]
}
]
I have copied all required jars files to Flume Classpath
Kindly let me know the solution for this issue
Regards,
~Sri