I am using the sbt assembly plugin. I've added screenshot for reference:
[image: Inline image 1]
To give better view of the things:
The java directory inside the src is DT Application
The Scala directory is the Random Kafka Generator.
And on doing the sbt assembly, only
I've never used SBT to build Apex application. But I guess you can try 2
things here
Use the sbt maven plugin
https://github.com/shivawu/sbt-maven-plugin
or use sbt assembly plugin
https://github.com/sbt/sbt-assembly
In the 2nd way, you need to translate the plugin configuration part in
pom.xml
Thank you Priyanka.
One suggestion needed from data torrent team, In our use case we need to read
around 120 directories in parallel, we would like to keep operator memory(with
container local) as lower as possible to reduce the burden on the cluster. As
long as cluster resources are