Re: REST api: how to upload jar?

2017-01-24 Thread Sachin Goel
Hey Cliff You can upload a jar file using http post with the file data sent under a form field 'jarfile'. Can you also please open a jira for fixing the documentation? - Sachin On Jan 25, 2017 06:55, "Cliff Resnick" wrote: > The 1.2 release documentation

Running into memory issues while running on Yarn

2017-01-05 Thread Sachin Goel
Hey! I'm running locally under this configuration(copied from nodemanager logs): physical-memory=8192 virtual-memory=17204 virtual-cores=8 Before starting a flink deployment, memory usage stats show 3.7 GB used on system, indicating lots of free memory for flink containers. However, after I

Re: Running continuously on yarn with kerberos

2015-11-07 Thread Sachin Goel
Usually, if all the dependencies are being downloaded, i.e., on the first build, it'll likely take 30-40 minutes. Subsequent builds might take 10 minutes approx. [I have the same PC configuration.] -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sun, Nov 8, 2015 at 2:05 AM, Niels

Re: Bug in Hybrid Hash Join

2015-10-13 Thread Sachin Goel
Okay. Great! Please re-open the jira in case the issue hasn't been resolved. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Tue, Oct 13, 2015 at 4:00 PM, Flavio Pompermaier <pomperma...@okkam.it> wrote: > I ensured that I was using the latest vers

Re: Bug in Hybrid Hash Join

2015-10-12 Thread Sachin Goel
Hi Flavio This was addressed in Flink-2763. Can you check if you're using the latest version? Cheers! Sachin On Oct 13, 2015 5:04 AM, "Flavio Pompermaier" wrote: > Hi guys, > my job fails on Flink 0.10-snapshot with the following message: Bug in > Hybrid Hash Join: Request

Re: "Not enough free slots available to run the job" for word count example

2015-09-13 Thread Sachin Goel
Hi Daniel Your problem did get solved, I assume. As for the -p flag, it determines the default parallelism of operators at runtime. If you end up specifying a value more than the slots available, that's an issue. Hope that helped. Cheers Sachin On Sep 13, 2015 9:13 PM, "Daniel Blazevski"

Re: Distribute DataSet to subset of nodes

2015-09-13 Thread Sachin Goel
Of course, someone else might have better ideas in re the partitioner. :) On Sep 14, 2015 1:12 AM, "Sachin Goel" <sachingoel0...@gmail.com> wrote: > Hi Stefan > Just a clarification : The output corresponding to an element based on the > whole data will be a union of the

Re: Convergence Criterion in IterativeDataSet

2015-09-04 Thread Sachin Goel
Hi Andres Does something like this solve what you're trying to achieve? https://github.com/apache/flink/pull/918/files Regards Sachin On Sep 4, 2015 6:24 PM, "Stephan Ewen" wrote: > I think you can do this with the current interface. The convergence > criterion object stays

Travis updates on Github

2015-09-02 Thread Sachin Goel
Hi all Is there some issue with travis integration? The last three pull requests do not have their build status on Github page. The builds are getting triggered though. Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Re: Multiple restarts of Local Cluster

2015-09-02 Thread Sachin Goel
If I'm right, all Tests use either the MultipleProgramTestBase or JavaProgramTestBase​. Those shut down the cluster explicitly anyway. I will make sure if this is the case. Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Sep 2, 2015 at 9:40 PM, Till Rohrmann

Re: Multiple restarts of Local Cluster

2015-09-02 Thread Sachin Goel
the user to terminate the cluster after execution, while in local mode. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Sep 2, 2015 at 9:19 PM, Till Rohrmann <trohrm...@apache.org> wrote: > Why is it not possible to shut down the local cluster? Can’t you shut

Re: Multiple restarts of Local Cluster

2015-09-02 Thread Sachin Goel
the cluster only once. Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Sep 2, 2015 at 9:33 PM, Till Rohrmann <trohrm...@apache.org> wrote: > Oh sorry, then I got the wrong context. I somehow thought it was about > test cases because I read `MultipleProgramT

Re: Multiple restarts of Local Cluster

2015-09-02 Thread Sachin Goel
I'm not sure what you mean by "Crucial cleanup is in shutdown hooks". Could you elaborate? -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Sep 2, 2015 at 10:25 PM, Stephan Ewen <se...@apache.org> wrote: > You can always shut down a cluster man

Re: Multiple restarts of Local Cluster

2015-09-02 Thread Sachin Goel
Yes. That will work too. However, then it isn't possible to shut down the local cluster. [Is it necessary to do so or does it shut down automatically when the program exists? I'm not entirely sure.] -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Sep 2, 2015 at 7:59 PM

Multiple restarts of Local Cluster

2015-09-02 Thread Sachin Goel
on persisted results. One potential solution could be to follow the methodology in `MultipleProgramsTestBase`. The user code then would have to reside in a fixed function name, instead of the main method. Or is that too cumbersome? Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Re: loop break operation

2015-07-20 Thread Sachin Goel
/pull/918. Take a look. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Mon, Jul 20, 2015 at 2:55 PM, Pa Rö paul.roewer1...@googlemail.com wrote: hello community, i have write a k-means app in flink, now i want change my terminate condition from max iteration to checking

Re: Run Time Exception

2015-07-19 Thread Sachin Goel
and then call env.execute. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sun, Jul 19, 2015 at 8:06 PM, Madabhattula Rajesh Kumar mrajaf...@gmail.com wrote: Hi, I have written simple wordcount program in scala. When I execute the program, I'm getting below exception

Re: Choosing random element

2015-06-16 Thread Sachin Goel
/KMeansRandomInit.scala Note that numCluster is the number of points you need in the sample. Regards Sachin Goel On Tue, Jun 16, 2015 at 2:45 PM, Maximilian Alber alber.maximil...@gmail.com wrote: Thanks! Cheers, Max On Tue, Jun 16, 2015 at 11:01 AM, Till Rohrmann trohrm...@apache.org wrote