Re: DataTorrent with SBT: .apa file not created

2016-07-11 Thread Ankit Sarraf
I am using the sbt assembly plugin. I've added screenshot for reference: [image: Inline image 1] To give better view of the things: The java directory inside the src is DT Application The Scala directory is the Random Kafka Generator. And on doing the sbt assembly, only

Re: DataTorrent with SBT: .apa file not created

2016-07-11 Thread hsy...@gmail.com
I've never used SBT to build Apex application. But I guess you can try 2 things here Use the sbt maven plugin https://github.com/shivawu/sbt-maven-plugin or use sbt assembly plugin https://github.com/sbt/sbt-assembly In the 2nd way, you need to translate the plugin configuration part in pom.xml

RE: Inputs needed on File Writer

2016-07-11 Thread Mukkamula, Suryavamshivardhan (CWM-NR)
Thank you Priyanka. One suggestion needed from data torrent team, In our use case we need to read around 120 directories in parallel, we would like to keep operator memory(with container local) as lower as possible to reduce the burden on the cluster. As long as cluster resources are