Re: exclude folder in dataimport handler.
I used this to exclude files from folders of templatedata. But it still couldnt remove these files from indexing field column=$skipDoc regex=.*\\avon-br\\templatedata\\.* replaceWith=true sourceColName=fileAbsolutePath/ When I save the value of this expression in temp variable, all files in templatedata have value true but still they are not skipped to index. -- View this message in context: http://lucene.472066.n3.nabble.com/exclude-folder-in-dataimport-handler-tp4224267p4224920.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: exclude folder in dataimport handler.
Can you give me a brief description on how to use a transformer to excludes docs from a folder? -- View this message in context: http://lucene.472066.n3.nabble.com/exclude-folder-in-dataimport-handler-tp4224267p4224489.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: exclude folder in dataimport handler.
A transformer on the outer entity will run before the inner entity is invoked. So, you might be able to remove the list of files to ignore before the inner entity starts extracting from them. You could also pre-generate a list of files by doing ls/find with your requirements and then just read that file directly with DIH. Regards, Alex. Solr Analyzers, Tokenizers, Filters, URPs and even a newsletter: http://www.solr-start.com/ On 21 August 2015 at 12:23, coolmals coolm...@gmail.com wrote: Can you give me a brief description on how to use a transformer to excludes docs from a folder? -- View this message in context: http://lucene.472066.n3.nabble.com/exclude-folder-in-dataimport-handler-tp4224267p4224489.html Sent from the Solr - User mailing list archive at Nabble.com.
exclude folder in dataimport handler.
I am importing files from my file system and want to exclude import of files from folder called templatedata. How do i configure that in entity. excludes=templatedata doesnt seem to work. entity name=files dataSource=null rootEntity=false processor=FileListEntityProcessor baseDir=E:\Malathy\ fileName=.*\.* excludes=templatedata pk=id onError=skip recursive=true -- View this message in context: http://lucene.472066.n3.nabble.com/exclude-folder-in-dataimport-handler-tp4224267.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: exclude folder in dataimport handler.
I took a quick look at FileListEntityProcessor#init, and it looks like it applies the excludes regex to the filename element of the path only, and not to the directories. If your filenames do not have a naming convention that would let you use it this way, you might be able to write a transformer to get what you want. James Dyer Ingram Content Group -Original Message- From: coolmals [mailto:coolm...@gmail.com] Sent: Thursday, August 20, 2015 12:57 PM To: solr-user@lucene.apache.org Subject: exclude folder in dataimport handler. I am importing files from my file system and want to exclude import of files from folder called templatedata. How do i configure that in entity. excludes=templatedata doesnt seem to work. entity name=files dataSource=null rootEntity=false processor=FileListEntityProcessor baseDir=E:\Malathy\ fileName=.*\.* excludes=templatedata pk=id onError=skip recursive=true -- View this message in context: http://lucene.472066.n3.nabble.com/exclude-folder-in-dataimport-handler-tp4224267.html Sent from the Solr - User mailing list archive at Nabble.com.
