Great, thanks Matt! Looking at this code now and feel this will really help me a lot. Anything you think would break using this logic for Hive 2.3.5?
On Wed, Jul 15, 2020 at 5:04 PM Matt Burgess <mattyb...@apache.org> wrote: > Ryan, > > In Apache NiFi we have a ConvertAvroToOrc processor [1], you may find > code there that you can use in your Java program (take a look at line > 212 and down). We had to create our own OrcFileWriter because the one > in Apache ORC writes to a FileSystem where we needed to write to our > own FlowFile component. But all the relevant code should be there (you > can replace the createWriter() call with the normal ORC one); one > caveat is that it's for Apache Hive 1.2, you may need to make changes > if you're using Hive 3 libraries for example. > > Regards, > Matt > > [1] > https://github.com/apache/nifi/blob/main/nifi-nar-bundles/nifi-hive-bundle/nifi-hive-processors/src/main/java/org/apache/nifi/processors/hive/ConvertAvroToORC.java > > On Wed, Jul 15, 2020 at 4:51 PM Ryan Schachte > <coderyanschac...@gmail.com> wrote: > > > > I'm writing a standalone Java process and interested in converting the > > consumed Avro messages to ORC. I've seen a plethora of examples of > writing > > to ORC, but the conversion to ORC from Avro is what I can't seem to find > a > > lot of examples of. > > > > This is just a standard Java process running inside of a container. >
