Hey Ananth, We have semantic version control. For public library/Api, they should stay no change in major release, so most operator in 3.3.x should be able to work with 3.3.0 engine. The only exception is Api that marked @evolving(nonstable). Kafka 0.9 is one of them. But I don't see any feature of that operator couldn't work with 3.3.0 engine. And we will try best to not change the public interface for Kafka 0.9 operator, unless there is a big demand for some new feature from the community
Regards, Siyuan On Saturday, April 16, 2016, Ananth Gundabattula <agundabatt...@gmail.com> wrote: > Hello Siyuan/Ram, > > Thanks for the inputs. > > I was able to resolve the problem by excluding the dependencies of > malhar-library and malhar-contrib from the dependency sections of the > apex-engine , apex-api . > > This made the 3.3.1-incubating version of the malhar kick into the > classpath and subsequently the malhar-kafka library with 3.3.1-incubating > version) . > > Thanks for your time. > > This brings in one more question : Is it an acceptable practice that I > package malhar-operator library in the lib path of my "apa" package ? In my > case I had version 3.3.1 in my packaging structure which I want in my > runtime as well ( due to 0.9 kafka operator ) but the apex engine itself is > a version behind ( 3.3.0 ) .. I believe malhar-versions and apex-version > will be on different pace with respect to evolution and versioning ? > > > > Regards, > Ananth > > On Sun, Apr 17, 2016 at 1:43 PM, hsy...@gmail.com > <javascript:_e(%7B%7D,'cvml','hsy...@gmail.com');> <hsy...@gmail.com > <javascript:_e(%7B%7D,'cvml','hsy...@gmail.com');>> wrote: > >> Hi Ananth, >> >> Could you please try to add malhar-library in test scope? Thanks! >> >> Regards, >> Siyuan >> >> >> On Saturday, April 16, 2016, Ananth Gundabattula <agundabatt...@gmail.com >> <javascript:_e(%7B%7D,'cvml','agundabatt...@gmail.com');>> wrote: >> >>> Hello all, >>> >>> I would like to run a unit test code using the new Kafka Operator that >>> supports the 0.9 version protocol. >>> >>> In this process, I included the malhar-kafka library version ( >>> 3.3.1-incubating ) and am using the apex-engine ( version 3.3.0 ) with >>> <scope> as test/provided. >>> >>> The compilation works fine but my unit tests fail to run properly with " >>> java.lang.ClassNotFoundException: com.datatorrent.lib.util.KryoCloneUtils" >>> exception. >>> >>> >>> What is the recommended way to run a unit test which uses Kafka 0.9 >>> operator integrated with the Apex engine ? I am assuming that the >>> malhar-contrib library kafka operator is not 0.9 compliant .. >>> >>> The unit test code is like this : >>> >>> The class CassandraEventDetailsStreamingApp extends the >>> AbstractKafkaInputOperator in the below snippet of code. >>> >>> The exception arises in the method lma.getController(); >>> >>> @Test >>> public void testApplication() throws IOException, Exception { >>> try { >>> LocalMode lma = LocalMode.newInstance(); >>> Configuration conf = new Configuration(false); >>> >>> conf.addResource(this.getClass().getResourceAsStream("/dag-test-props.xml")); >>> lma.prepareDAG(new CassandraEventDetailsStreamingApp(), conf); >>> LocalMode.Controller lc = lma.getController(); >>> lc.run(); >>> } catch (ConstraintViolationException e) { >>> Assert.fail("constraint violations: " + >>> e.getConstraintViolations()); >>> } >>> } >>> >>> >>> >>> Regards, >>> Ananth >>> >> >