I assume you are getting the initial lines as metadata because Tika is identifying the file as email.
If you include details on your code (how you are calling the parser) and version, I’m confident someone can suggest reasonable work-arounds. Regards, — Ken > On Jan 18, 2024, at 8:44 PM, Gerardo Hernandez <g.hernan...@aparavi.com> > wrote: > > This is the input file; I think it was not uploaded correctly. > > Best regards, > Gerardo > From: Gerardo Hernandez > Sent: Thursday, January 18, 2024 10:39 PM > To: user@tika.apache.org <mailto:user@tika.apache.org> <user@tika.apache.org > <mailto:user@tika.apache.org>> > Cc: Mikhail Gushinets <mikhail.gushin...@aparavi.com > <mailto:mikhail.gushin...@aparavi.com>> > Subject: Parser removes file content and treats it as Metadata > > Hi, > > We are using Tika parser to obtain files' contents and then we do some post > processing on them, unfortunately we recently got some unexpected results > from the AutoDectectParser using the attached text file SampleFile_M_001.txt > <https://aparavi-my.sharepoint.com/:t:/p/g_hernandez/EUPjfGMN1k1Pii3e4h6tzNoBuVrxR7pAsRugZf-Y59Cmjg>. > Basically, what we expect as result is the whole text in the file, but we > only get (received by Handler): > > SUBJECT: XYZ EMPL. OPPORUNITY > > Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod > tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim > veniam... (Till the end of the file). > > and the initial text of the file (FROM, TO, DATE, LOCATION) is not included > but registered as metadata: > > <image.png> > > I would like to know if there is any way to prevent this from happening using > AutoDectectParser so that all the text is included in the data sent to the > Handler. > <SampleFile_M_001.txt> -------------------------- Ken Krugler http://www.scaleunlimited.com Custom big data solutions Flink & Pinot
