Hi Bertty, I am currently having a problem with the map Operator using Java for the DataQuanta. I checked your Scala Code and tried to implement it in Java to experiment. I tried to map the DataQuanta<T> to DataQuanta<HackItTuple<Long,T> and vice versa, however I keep having problems with the map. I tried both using map and mapJava and I am pretty sure I input the parameters correctly. However, I keep getting the same error. 'mapJava(org.apache.wayang.core.function.FunctionDescriptor.SerializableFunction ,T>, org.apache.wayang.core.optimizer.costs.LoadProfileEstimator, scala.reflect.ClassTag )' in 'org.apache.wayang.api.dataquanta.DataQuanta' cannot be applied to '(org.apache.wayang.core.function.FunctionDescriptor.SerializableFunction ,T>)' or '()'
I assume the problem is because I directly call the map function using the DataQuanta Class and not using the DataQuantaBuilder or in a sense, I can not just map directly unlinke in Scala or something else. I would be grateful if you could maybe clear some confusions for me. Best regards, Matthew On Fri, 22 Jul 2022 at 07:09, MatthewJ Sanyoto <[email protected]> wrote: > Hi Bertty, > > Sorry for the late reply. > > I understand now. Thank you for your advice. > > Best regards, > Matthew > > On Sat, 16 Jul 2022 at 19:46, bertty contreras <[email protected]> > wrote: > >> Hi Matthew, >> >> Sorry for the late replay. >> >> But it just spark; the idea is to use the DataQuanta for have the >> functionality of wayang, because that is the API of Wayang >> >> Best regards, >> Bertty >> >> El jue, 14 jul 2022 a las 12:23, MatthewJ Sanyoto (< >> [email protected]>) escribió: >> >> > Hi Bertty, >> > >> > Thanks for the helpful advice and links. For curiosity's sake, is the >> > HackItExperiment (the HackitSparkRDD) is for the spark side of HackIT >> > Plugin? Or is it from the wayang side but executed using Spark? >> > >> > Best regards, >> > Matthew >> > >> > On Thu, 14 Jul 2022 at 10:40, Bertty Contreras <[email protected]> >> > wrote: >> > >> > > Hi Matthew, >> > > >> > > In the case of wayang, you need to create a class like Hackit [2] ( >> this >> > is >> > > similar to hackitSparkRDD), and you can test your changes using the >> test >> > > [1]. >> > > >> > > Does that respond to your question? >> > > >> > > Best regards, >> > > Bertty >> > > >> > > [1] >> > > >> > > >> > >> https://github.com/apache/incubator-wayang/blob/WAYANG-28/wayang-plugins/wayang-hackit/wayang-hackit-api/src/test/scala/org/apache/wayang/plugin/hackit/api/ApiExtensionTest.scala >> > > [2] >> > > >> > > >> > >> https://github.com/apache/incubator-wayang/blob/WAYANG-28/wayang-plugins/wayang-hackit/wayang-hackit-api/src/main/scala/org/apache/wayang/plugin/hackit/api/Hackit.scala >> > > >> > > On Wed, Jul 13, 2022 at 6:12 PM MatthewJ Sanyoto < >> > > [email protected]> >> > > wrote: >> > > >> > > > Hi, >> > > > >> > > > If I remember correctly there was an abstract HackIT Experiment >> Class >> > > where >> > > > you could test / check if the wayang debugger worked as intended >> > (tagging >> > > > and sniffing) using HackItSparkRdd, if I am not mistaken. Was this >> > class >> > > > removed from this branch? Since Apache Wayang is not an execution >> > > engine, a >> > > > suggestion for how to test HackIT Plugin would be very helpful and >> > > > appreciated. >> > > > >> > > > Best regards, >> > > > Matthew >> > > > >> > > >> > > >> > > -- >> > > Best, >> > > Bertty >> > > >> > >> >
