On Wed, Oct 14, 2009 at 10:28 PM, mcarson <mcar...@amsa.com> wrote: > > In order to get the scanner solution to work, I would still need some way to > start polling on the directory at the beginning of my camel route, correct? > Is there a way to use the "file" component (or any components) as a "from" > to detect that a file has arrived in a directory, but NOT actually read the > file? It would be nice if I could simply detect a large file, and passing > along only the fileName to the next step in the route. This would then make > it possible for next step in the route (which could be a "scanner" bean) > that could scan through and split the received file effectively. >
Yeah the file component does NOT read the content. It holds just a java.io.File object (in facts its a GenericFile as it also works for FTP files). Anyway you just grab the java.io.File using File file = exchange.getIn().getBody(File.class); > > > Claus Ibsen-2 wrote: >> >> Hi >> >> This is as far I got with the xpath expression for splitting >> http://svn.apache.org/viewvc?rev=825156&view=rev >> >> >> >> On Wed, Oct 14, 2009 at 4:40 PM, Claus Ibsen <claus.ib...@gmail.com> >> wrote: >>> On Wed, Oct 14, 2009 at 4:21 PM, Claus Ibsen <claus.ib...@gmail.com> >>> wrote: >>>> Hi >>>> >>>> On Wed, Oct 14, 2009 at 4:16 PM, mcarson <mcar...@amsa.com> wrote: >>>>> >>>>> It looks like the scanner might provide me with the capabilities I was >>>>> looking for regarding reading in a file in delimited chunks. I'm >>>>> assuming I >>>>> would implement this as a bean... can the bean component be used as a >>>>> "from" >>>>> in a camel route? I'm new to Camel, and I have never seen that done. >>>>> Is >>>>> there an example bean (that is a consumer of some sort) that I could >>>>> use to >>>>> model my code after? >>>>> >>>> >>>> Since you use xpath then I took at dive into looking how to split big >>>> files. >>>> Using InputSource seems to do the trick as it allow xpath to use SAX >>>> events which fits with streaming. >>>> >>>> I will work a bit to get it supported nice out of the box. And provide >>>> details how to do it in 2.0. >>>> >>> >>> Ah yeah the xpath will still at least hold all the result into memory. >>> >>> As you can only get a result of these types listed here: >>> http://java.sun.com/j2se/1.5.0/docs/api/javax/xml/xpath/XPathConstants.html >>> >>> And none of them is stream based. >>> >>> So even with SAX to parse the big xml file the xpath expression >>> evaluation will result into all data being loaded into memory, or at >>> least the NodeList which contains all the splitted entries. >>> >>> So maybe that Scanner is better if you can do some custom clipping. I >>> believe its regexp based so you may be able to find a good regexp that >>> can split on </person> or something. >>> >>> >>> >>> >>> >>> >>> >>>> >>>> >>>>> >>>>> >>>>> Claus Ibsen-2 wrote: >>>>>> >>>>>> Hi >>>>>> >>>>>> How do you want to split the file? >>>>>> Is there a special character that denotes a new "record" >>>>>> >>>>>> Using java.util.Scanner is great as it can do streaming. And also what >>>>>> Camel can do if you for example want to split by new line etc. >>>>>> >>>>>> -- >>>>>> Claus Ibsen >>>>>> Apache Camel Committer >>>>>> >>>>>> Open Source Integration: http://fusesource.com >>>>>> Blog: http://davsclaus.blogspot.com/ >>>>>> Twitter: http://twitter.com/davsclaus >>>>>> >>>>>> >>>>> >>>>> -- >>>>> View this message in context: >>>>> http://www.nabble.com/handling-large-files-tp25826380p25891924.html >>>>> Sent from the Camel - Users mailing list archive at Nabble.com. >>>>> >>>>> >>>> >>>> >>>> >>>> -- >>>> Claus Ibsen >>>> Apache Camel Committer >>>> >>>> Open Source Integration: http://fusesource.com >>>> Blog: http://davsclaus.blogspot.com/ >>>> Twitter: http://twitter.com/davsclaus >>>> >>> >>> >>> >>> -- >>> Claus Ibsen >>> Apache Camel Committer >>> >>> Open Source Integration: http://fusesource.com >>> Blog: http://davsclaus.blogspot.com/ >>> Twitter: http://twitter.com/davsclaus >>> >> >> >> >> -- >> Claus Ibsen >> Apache Camel Committer >> >> Open Source Integration: http://fusesource.com >> Blog: http://davsclaus.blogspot.com/ >> Twitter: http://twitter.com/davsclaus >> >> > > -- > View this message in context: > http://www.nabble.com/handling-large-files-tp25826380p25898450.html > Sent from the Camel - Users mailing list archive at Nabble.com. > > -- Claus Ibsen Apache Camel Committer Open Source Integration: http://fusesource.com Blog: http://davsclaus.blogspot.com/ Twitter: http://twitter.com/davsclaus
