[jira] [Created] (FLINK-5410) Running out of memory on Yarn

2017-01-05 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-5410: -- Summary: Running out of memory on Yarn Key: FLINK-5410 URL: https://issues.apache.org/jira/browse/FLINK-5410 Project: Flink Issue Type: Bug Components

Lack of review on PRs

2015-12-05 Thread Sachin Goel
s for bearing with me. :) Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

[jira] [Created] (FLINK-3124) Introduce a TaskInfo object to better represent task name, index, attempt number etc.

2015-12-05 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-3124: -- Summary: Introduce a TaskInfo object to better represent task name, index, attempt number etc. Key: FLINK-3124 URL: https://issues.apache.org/jira/browse/FLINK-3124

Re: Connection reset by peer

2015-11-15 Thread Sachin Goel
a exception handler at the end of pipeline. https://github.com/apache/flink/pull/1338 -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sun, Nov 15, 2015 at 5:48 PM, Ufuk Celebi wrote: > This Exception was not thrown by the data exchange component. This is > confirmed

[jira] [Created] (FLINK-2989) Job Cancel button doesn't work on Yarn

2015-11-09 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2989: -- Summary: Job Cancel button doesn't work on Yarn Key: FLINK-2989 URL: https://issues.apache.org/jira/browse/FLINK-2989 Project: Flink Issue Type

Re: Web interface to submit jobs

2015-11-09 Thread Sachin Goel
@Max: Added all three things and opened a PR yesterday. :) -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Mon, Nov 9, 2015 at 3:10 PM, Maximilian Michels wrote: > Hi Sachin, > > Thank you for your work. From the screenshots it looks like you replicated > the beh

Re: Web interface to submit jobs

2015-11-08 Thread Sachin Goel
erged yet. Also, managing required parameters, and their types etc. is somewhat frustrating in JavaScript. Everything has to be rechecked at the Server again anyways. I opened a PR just now: https://github.com/apache/flink/pull/1338. Let me know what you guys think. :) Cheers! Sachin -- Sachin G

Re: Web interface to submit jobs

2015-11-06 Thread Sachin Goel
try class. I think this is reasonable because we do not need anything related to yarn here. Web monitor already has the gateway to job manager. Any comments or review is welcome. :) I'll likely be able to finish up by the end of this week. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi

[jira] [Created] (FLINK-2982) CLI info option throws ClassCastException for streaming jobs

2015-11-05 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2982: -- Summary: CLI info option throws ClassCastException for streaming jobs Key: FLINK-2982 URL: https://issues.apache.org/jira/browse/FLINK-2982 Project: Flink

[jira] [Created] (FLINK-2978) Integrate web submission interface into the new dashboard

2015-11-05 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2978: -- Summary: Integrate web submission interface into the new dashboard Key: FLINK-2978 URL: https://issues.apache.org/jira/browse/FLINK-2978 Project: Flink Issue

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
I plan to implement all features of the existing web client. :) I think multiple programs will be best displayed as a list in the Entry Class column. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Thu, Nov 5, 2015 at 5:36 PM, Matthias J. Sax wrote: > Looks good. How would

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
od of program's entry class. Will that be a major issue, that one thread is performing this work [although the server is capable to handling several requests in parallel]? -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Thu, Nov 5, 2015 at 4:28 PM, Maximilian Michels wrote:

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
Hi Stephan I agree. However, as and when we secure the Dashboard, everything should get secured in one go. Or is a secure dashboard not much desired? [By secure, I mean some form of authentication for accessing.] -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Thu, Nov 5, 2015 at

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
Ah. Sharing the links then: https://drive.google.com/file/d/0B0Xlv1qTgpjDT0ZCd0pSU3VYMUU/view?usp=sharing https://drive.google.com/file/d/0B0Xlv1qTgpjDeG51azRRc0FJYjQ/view?usp=sharing https://drive.google.com/file/d/0B0Xlv1qTgpjDSHZXQ0h5S0FBS3c/view?usp=sharing -- Sachin Goel Computer Science

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
Okay. I think that does it. I've already designed the basic interface, although the major part for uploading jars and actually running the job are left. :') Here are some screenshots: [image: Inline image 2][image: Inline image 1][image: Inline image 3] -- Sachin Goel Computer Science,

Re: Web interface to submit jobs

2015-11-05 Thread Sachin Goel
The current authentication mechanism is via htaccess, in the webclient. The dashboard however isn't secured at all. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Thu, Nov 5, 2015 at 2:33 PM, Aljoscha Krettek wrote: > The reason why we didn’t want to have it in the Jo

Web interface to submit jobs

2015-11-04 Thread Sachin Goel
Hi all Are there any plans to upgrade the webclient interface? It could certainly use an upgrade compared to the much better dashboard . If so, is integrating them into one the best way to go? We can have a tab under Job Manager on the dashboard. I can share screenshots of the UI I designed last n

[jira] [Created] (FLINK-2966) Improve the way job duration is reported on web frontend.

2015-11-04 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2966: -- Summary: Improve the way job duration is reported on web frontend. Key: FLINK-2966 URL: https://issues.apache.org/jira/browse/FLINK-2966 Project: Flink Issue

Re: errors after updating master branch

2015-11-02 Thread Sachin Goel
I've observed this sometimes too. Command line build succeeds, however IntelliJ build fails. The method suggested by Stephan doesn't work for me usually. However, recreating the project from scratch takes at most 30-40 seconds, so I do just that. :) -- Sachin Goel Computer Science, I

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc2)

2015-10-28 Thread Sachin Goel
Yes. I just made it work in firefox. It was already working in Chrome this way. Maybe Piotr will have a better fix later on. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Oct 28, 2015 at 9:42 PM, Maximilian Michels wrote: > @Sachin: I've tried it out. It has the

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc2)

2015-10-28 Thread Sachin Goel
Sorry. Wrong commit. In case you've pulled already. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Oct 28, 2015 at 9:09 PM, Sachin Goel wrote: > @Max: Here's a fix for the wrapping issue: > https://github.com/sachingoel0101/flink/tree/long-vertex-name.

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc2)

2015-10-28 Thread Sachin Goel
and it seems to work. [You might wanna rebuild flink-runtime-web followed by flink-dist first. :)] -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Oct 28, 2015 at 8:22 PM, Vasiliki Kalavri wrote: > Ah I see. Thanks Sachin, Max. I think a label would be nice there, yes. &g

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc2)

2015-10-28 Thread Sachin Goel
I think the squares on top of the job page are showing the status of vertices, not tasks. The squares on overview pages however show the number of tasks. Should we make it vertices or tasks everywhere, for consistency? -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Oct 28

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc2)

2015-10-28 Thread Sachin Goel
-counts is being used. Looking into it now. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Oct 28, 2015 at 7:26 PM, Vasiliki Kalavri wrote: > The numbers I see in the overview are different. > > See > > https://drive.google.com/file/d/0BzQJrI2eGlyYMHZZUGs2Z

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc2)

2015-10-28 Thread Sachin Goel
The name of the vertex is very long and isn't getting wrapped around to accommodate all the columns. There's a TODO at the relevant place in app/scripts/common/filters.coffee which was probably meant to handle this. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On W

[jira] [Created] (FLINK-2934) Remove placehoder pages in Web dashboard

2015-10-28 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2934: -- Summary: Remove placehoder pages in Web dashboard Key: FLINK-2934 URL: https://issues.apache.org/jira/browse/FLINK-2934 Project: Flink Issue Type: Bug

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc2)

2015-10-28 Thread Sachin Goel
:) > > On 28 October 2015 at 13:06, Sachin Goel wrote: > > > Those are hard coded values. > > What exactly should be there, I'm not sure either. > > On Oct 28, 2015 5:25 PM, "Vasiliki Kalavri" > > wrote: > > > > > I have a question re

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc2)

2015-10-28 Thread Sachin Goel
Those are hard coded values. What exactly should be there, I'm not sure either. On Oct 28, 2015 5:25 PM, "Vasiliki Kalavri" wrote: > I have a question regarding the web interface :) > What is the "Job Accumulator/Statistics" tab supposed to show? No matter > what job I run, the values are the sam

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc0)

2015-10-22 Thread Sachin Goel
h detached programs is that the client submits the first Flink > >> job > >> > (call to execute/count/collect/print) to the cluster and then returns an > >> > empty ExecutionResult. This leads to error if the user program tries to > >> > access the Ex

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc0)

2015-10-22 Thread Sachin Goel
Not sure if it's a blocker, but the yarn detached mode is faulty for interactive programs with eager execution calls. The most basic starting point for yarn, i.e. *bin/flink run -m yarn-cluster -yd -n <> examples/Wordcount.jar* fails in a bad way. -- Sachin Goel Computer Science,

Re: Flaky ScalaShellLocalStartupITCase

2015-10-13 Thread Sachin Goel
ion for contributors. > > Thanks, > > > - Henry > > On Tue, Oct 13, 2015 at 7:14 AM, Sachin Goel > wrote: > > Hi all > > Over the past few days, I've observed multiple failures of this test > case. > > There is no single reason. > > 1. T

Flaky ScalaShellLocalStartupITCase

2015-10-13 Thread Sachin Goel
y]. 3. Just recently, observed a loss of the task manager. https://travis-ci.org/apache/flink/jobs/85108827 Has someone else observed any such issues? It seems a simple enough test to display such flaky behavior. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Re: Apache flink with Elastic Search

2015-10-13 Thread Sachin Goel
Hi Santosh There is an Elastic search connector under streaming connectors. Can you check if that satisfies your needs? Aljoscha will be able to provide more details in case you need them. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Tue, Oct 13, 2015 at 6:38

[jira] [Created] (FLINK-2850) Limit the types of jobs which can run in detached mode

2015-10-13 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2850: -- Summary: Limit the types of jobs which can run in detached mode Key: FLINK-2850 URL: https://issues.apache.org/jira/browse/FLINK-2850 Project: Flink Issue Type

[jira] [Created] (FLINK-2849) AggregatingAlignedProcessingTimeWindowOperatorTest failure

2015-10-13 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2849: -- Summary: AggregatingAlignedProcessingTimeWindowOperatorTest failure Key: FLINK-2849 URL: https://issues.apache.org/jira/browse/FLINK-2849 Project: Flink Issue

[jira] [Created] (FLINK-2791) ParallelMergeITCase failure

2015-09-30 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2791: -- Summary: ParallelMergeITCase failure Key: FLINK-2791 URL: https://issues.apache.org/jira/browse/FLINK-2791 Project: Flink Issue Type: Bug Components

[jira] [Created] (FLINK-2711) TaskManagerTest failure

2015-09-19 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2711: -- Summary: TaskManagerTest failure Key: FLINK-2711 URL: https://issues.apache.org/jira/browse/FLINK-2711 Project: Flink Issue Type: Bug Reporter

[jira] [Created] (FLINK-2710) SocketTextStreamFunctionTest failure

2015-09-19 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2710: -- Summary: SocketTextStreamFunctionTest failure Key: FLINK-2710 URL: https://issues.apache.org/jira/browse/FLINK-2710 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2700) YarnSessionFIFOITCase.testJavaApi failure

2015-09-18 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2700: -- Summary: YarnSessionFIFOITCase.testJavaApi failure Key: FLINK-2700 URL: https://issues.apache.org/jira/browse/FLINK-2700 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2648) CombineTaskTest.testCancelCombineTaskSorting

2015-09-09 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2648: -- Summary: CombineTaskTest.testCancelCombineTaskSorting Key: FLINK-2648 URL: https://issues.apache.org/jira/browse/FLINK-2648 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2627) Make Scala Data Set utils easier to access

2015-09-07 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2627: -- Summary: Make Scala Data Set utils easier to access Key: FLINK-2627 URL: https://issues.apache.org/jira/browse/FLINK-2627 Project: Flink Issue Type: Bug

Re: Scala Utils

2015-09-07 Thread Sachin Goel
Olrite. I will file a JIRA for this. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sat, Sep 5, 2015 at 10:14 PM, Aljoscha Krettek wrote: > I think the utils are a perfect case of for this pattern so I would suggest > to go ahead with this change. It i

Scala Utils

2015-09-05 Thread Sachin Goel
importing utils like import org.apache.flink.api.scala.utils._ Since this will likely break existing code, I'm seeking opinion whether this should be done or not. If yes, I will file a JIRA and submit a patch. Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

[jira] [Created] (FLINK-2618) ExternalSortITCase failure

2015-09-03 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2618: -- Summary: ExternalSortITCase failure Key: FLINK-2618 URL: https://issues.apache.org/jira/browse/FLINK-2618 Project: Flink Issue Type: Bug Reporter

[jira] [Created] (FLINK-2615) Multiple restarts of Local Cluster for a single program

2015-09-03 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2615: -- Summary: Multiple restarts of Local Cluster for a single program Key: FLINK-2615 URL: https://issues.apache.org/jira/browse/FLINK-2615 Project: Flink Issue Type

[jira] [Created] (FLINK-2612) ZooKeeperLeaderElectionITCase failure

2015-09-03 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2612: -- Summary: ZooKeeperLeaderElectionITCase failure Key: FLINK-2612 URL: https://issues.apache.org/jira/browse/FLINK-2612 Project: Flink Issue Type: Bug

Re: Driver Test Base issue

2015-08-24 Thread Sachin Goel
find them since I've triggered quite a few builds since my email. ​Cheers! Sachin​ -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Mon, Aug 24, 2015 at 3:38 PM, Maximilian Michels wrote: > Hi Sachin, > > Thanks for reporting. Which of the test cases failed in the Ma

Re: Graph.fromDataSet function calls: flink-gelly

2015-08-22 Thread Sachin Goel
on every call. However, in general, this wouldn't be the case. I'll push a patch along with the fix I'm working on. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sat, Aug 22, 2015 at 11:21 PM, Vasiliki Kalavri < vasilikikala...@gmail.com>

Graph.fromDataSet function calls: flink-gelly

2015-08-21 Thread Sachin Goel
sharing of job results across Execution Environments, and these two lines are the only thing which cause trouble with that. :') Thanks in advance Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Driver Test Base issue

2015-08-18 Thread Sachin Goel
hread.java:68) Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Re: [NOTICE] Reporting and fixing minor issues

2015-08-16 Thread Sachin Goel
main README links to http://flink.apache.org/how-to-contribute.html. We should perhaps merge the cwiki page content here. Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sun, Aug 16, 2015 at 9:21 PM, Stephan Ewen wrote: > Hi all! > > Henry raised the po

Re: Code style guideline for Scala

2015-08-16 Thread Sachin Goel
continuation etc. can be hard to get exactly right [At least that was my experience]. All in all, big plus one to this. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Sun, Aug 16, 2015 at 7:36 PM, Stephan Ewen wrote: > Hi! > > I very much support that. A bit stricter rules in

[jira] [Created] (FLINK-2528) MatchTaskTest failure

2015-08-15 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2528: -- Summary: MatchTaskTest failure Key: FLINK-2528 URL: https://issues.apache.org/jira/browse/FLINK-2528 Project: Flink Issue Type: Bug Reporter: Sachin

Re: Multiple control flows in a program

2015-08-12 Thread Sachin Goel
Since the random splits need to be done on any data set a user provides, I think making a persistent source would be the best solution then. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Aug 12, 2015 at 1:37 PM, Till Rohrmann wrote: > One branch does not occupy a sin

Re: Multiple control flows in a program

2015-08-12 Thread Sachin Goel
iterator, namely the NumberSequenceIterator seems deterministic in its operation, at least as far as how the elements are grouped together. But surprisingly, I observed different splits now and then. Regards Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Wed, Aug 12, 2015 at 12

Multiple control flows in a program

2015-08-11 Thread Sachin Goel
ually exclusive, we need to generate the exact same sequence of random numbers, but also to ensure that the elements arrive in a filter job in exactly the same order. How do I achieve this? Here's the code I've written: https://github.com/apache/flink/pull/921/files Regards Sachin -- Sachi

[jira] [Created] (FLINK-2505) HDFSTest failure: VM crash

2015-08-10 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2505: -- Summary: HDFSTest failure: VM crash Key: FLINK-2505 URL: https://issues.apache.org/jira/browse/FLINK-2505 Project: Flink Issue Type: Bug Reporter

Re: Parameter Server for Flink

2015-08-10 Thread Sachin Goel
file whether they need it turned on or not, however. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Mon, Aug 10, 2015 at 11:12 PM, Stephan Ewen wrote: > Very interesting addition, Sachin! > > I cc-ed Nam-Luc Tran, who recently opened a pull request with a d

Parameter Server for Flink

2015-08-07 Thread Sachin Goel
s everything easy. :') What do you guys think? Cheers! Sachin PS. Sorry about the long email on a weekend. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

[jira] [Created] (FLINK-2498) GroupReduceITCase failure

2015-08-07 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2498: -- Summary: GroupReduceITCase failure Key: FLINK-2498 URL: https://issues.apache.org/jira/browse/FLINK-2498 Project: Flink Issue Type: Bug Reporter

[jira] [Created] (FLINK-2496) Expose Task Manager configuration to Runtime Context

2015-08-07 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2496: -- Summary: Expose Task Manager configuration to Runtime Context Key: FLINK-2496 URL: https://issues.apache.org/jira/browse/FLINK-2496 Project: Flink Issue Type

Re: FYI: Blog Post on Flink's Streaming Performance and Fault Tolerance

2015-08-05 Thread Sachin Goel
This makes me want to dig into the streaming API. About time perhaps. :') Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Aug 6, 2015 2:39 AM, "Theodore Vasiloudis" < theodoros.vasilou...@gmail.com> wrote: > Great post Stephan! A small n

[jira] [Created] (FLINK-2468) StreamCheckpointingITCase failure

2015-08-03 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2468: -- Summary: StreamCheckpointingITCase failure Key: FLINK-2468 URL: https://issues.apache.org/jira/browse/FLINK-2468 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2466) Travis build failure

2015-08-03 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2466: -- Summary: Travis build failure Key: FLINK-2466 URL: https://issues.apache.org/jira/browse/FLINK-2466 Project: Flink Issue Type: Bug Reporter: Sachin

[jira] [Created] (FLINK-2460) ReduceOnNeighborsWithExceptionITCase failure

2015-08-01 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2460: -- Summary: ReduceOnNeighborsWithExceptionITCase failure Key: FLINK-2460 URL: https://issues.apache.org/jira/browse/FLINK-2460 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2459) Failure on recently added Client side logging test

2015-08-01 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2459: -- Summary: Failure on recently added Client side logging test Key: FLINK-2459 URL: https://issues.apache.org/jira/browse/FLINK-2459 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2458) Distributed Cache doesn't work with iterations.

2015-08-01 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2458: -- Summary: Distributed Cache doesn't work with iterations. Key: FLINK-2458 URL: https://issues.apache.org/jira/browse/FLINK-2458 Project: Flink Issue Type

[jira] [Created] (FLINK-2433) Jekyll on windows for building local documentation

2015-07-29 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2433: -- Summary: Jekyll on windows for building local documentation Key: FLINK-2433 URL: https://issues.apache.org/jira/browse/FLINK-2433 Project: Flink Issue Type

[jira] [Created] (FLINK-2417) Travis build failure on flink-tachyon

2015-07-28 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2417: -- Summary: Travis build failure on flink-tachyon Key: FLINK-2417 URL: https://issues.apache.org/jira/browse/FLINK-2417 Project: Flink Issue Type: Bug

Re: Travis build failure

2015-07-28 Thread Sachin Goel
Should I open a JIRA for this? -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Tue, Jul 28, 2015 at 2:16 PM, Stephan Ewen wrote: > I have seen that issue before. > > Since Flink only tests using Tachyon via the Hadoop connector, this is > either a bug in the Hadoop

Re: Travis build failure

2015-07-28 Thread Sachin Goel
Yes. I've never encountered this type of build failure. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Jul 28, 2015 1:41 PM, "Till Rohrmann" wrote: > This might be a Travis hick-up. Was it the first time this happened? > > Cheers, > Till > >

Travis build failure

2015-07-27 Thread Sachin Goel
goodbye. VM crash or System.exit called? Here's the log file: https://s3.amazonaws.com/archive.travis-ci.org/jobs/72878976/log.txt. The failed build passes on travis on my PR's build. -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Re: New Flink Runtime Monitor Dashboard

2015-07-24 Thread Sachin Goel
According to GitHub, 26.1% code is now in JavaScript. :| -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Thu, Jul 23, 2015 at 3:12 AM, Matthias J. Sax < mj...@informatik.hu-berlin.de> wrote: > Haha! > > On 07/22/2015 07:02 PM, Kostas Tzoumas wrote: > >

Re: Communicating between nodes at runtime

2015-07-21 Thread Sachin Goel
@Stephan, why would there be a problem with the reliability of updates? Also, what would be the best way to achieve this functionality? Preferably using the current API. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Tue, Jul 21, 2015 at 4:17 PM, Stephan Ewen

Re: Communicating between nodes at runtime

2015-07-20 Thread Sachin Goel
sharing of data which is *only *evaluated at runtime. Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Mon, Jul 20, 2015 at 3:34 PM, Stephan Ewen wrote: > You are probably looking for a parameter server tool. > > How about setting up one of these memory g

[jira] [Created] (FLINK-2379) Add methods to evaluate field wise statistics over DataSet of vectors.

2015-07-19 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2379: -- Summary: Add methods to evaluate field wise statistics over DataSet of vectors. Key: FLINK-2379 URL: https://issues.apache.org/jira/browse/FLINK-2379 Project: Flink

Communicating between nodes at runtime

2015-07-17 Thread Sachin Goel
RuntimeContext, broadcast(key,value) and receive(key). If such a thing doesn't exist now, how should I approach implementing it? Cheers! Sachin -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685

Re: Failing tests on Windows

2015-07-17 Thread Sachin Goel
explicitly filed for these. If you wish, file JIRAs for these too, in case these still persist. Further, since the build stops at flink-runtime, I can't be sure if any further tests wouldn't fail. I can try verify commands again 0nce there are fixes for these. Cheers! Sachin -- S

[jira] [Created] (FLINK-2368) Add a convergence criteria

2015-07-16 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2368: -- Summary: Add a convergence criteria Key: FLINK-2368 URL: https://issues.apache.org/jira/browse/FLINK-2368 Project: Flink Issue Type: Bug Components

Re: [ml] Convergence Criterias

2015-07-07 Thread Sachin Goel
nk of any possible convergence criteria as such that would be required. The solutions are almost always closed-form in such cases. I may be wrong in saying that though. Regards ​Sachin Goel​ -- Sachin Goel Computer Science, IIT Delhi m. +91-9871457685 On Tue, Jul 7, 2015 at 2:23 PM, Sachin Goel

Re: [ml] Convergence Criterias

2015-07-07 Thread Sachin Goel
way in a separate common convergenc criteria module. This is exactly similar to the Scorer and several widely used Score functions you're working on in the Evaluation Framework PR. Regards Sachin Goel On Mon, Jul 6, 2015 at 9:47 PM, Theodore Vasiloudis < theodoros.vasilou...@gmail.com> wrote

Re: [ml] Convergence Criterias

2015-07-06 Thread Sachin Goel
d you provide an example where having this function makes development > easier? My concern is that this is a hard problem to generalize properly, > given the dependence on the specific algorithm, model, and data. > > Regards, > Theodore > > On Wed, Jul 1, 2015 at 9:23 PM, Sachin

[ml] Convergence Criterias

2015-07-01 Thread Sachin Goel
user would implement the Convergence class and override these methods with their own implementation. Any feedback and design suggestions are welcome. Regards ​​ Sachin Goel

Re: Documentation not reachable

2015-06-29 Thread Sachin Goel
I've been experiencing the same problem. Regards Sachin Goel On Mon, Jun 29, 2015 at 3:09 PM, Felix Neutatz wrote: > Hi, > > when I want to access the documentation on the website I get the following > error: > > http://ci.apache.org/projects/flink/flink-docs-

[jira] [Created] (FLINK-2276) Travis build error

2015-06-25 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2276: -- Summary: Travis build error Key: FLINK-2276 URL: https://issues.apache.org/jira/browse/FLINK-2276 Project: Flink Issue Type: Bug Reporter: Sachin

Re: Testing Apache Flink 0.9.0-rc1

2015-06-10 Thread Sachin Goel
I have run "mvn clean verify" five times now and every time I'm getting these failed tests: BlobUtilsTest.before:45 null BlobUtilsTest.before:45 null BlobServerDeleteTest.testDeleteFails:291 null BlobLibraryCacheManagerTest.testRegisterAndDownload:196 Could not remove write permissions from

Re: Testing Apache Flink 0.9.0-rc1

2015-06-09 Thread Sachin Goel
with maximum 8 threads. Regards Sachin Goel On Tue, Jun 9, 2015 at 5:34 PM, Ufuk Celebi wrote: > > On 09 Jun 2015, at 13:58, Sachin Goel wrote: > > > On my local machine, several flink runtime tests are failing on "mvn > clean > > verify". Here is the log out

Re: Testing Apache Flink 0.9.0-rc1

2015-06-09 Thread Sachin Goel
On my local machine, several flink runtime tests are failing on "mvn clean verify". Here is the log output: http://pastebin.com/raw.php?i=VWbx2ppf -- ​ Sachin​ On Tue, Jun 9, 2015 at 4:04 PM, Aljoscha Krettek wrote: > I also saw the same error on my third "mvn clean verify" run. Before it > alw

[jira] [Created] (FLINK-2187) KMeans clustering is not present in release-0.9-rc1

2015-06-08 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2187: -- Summary: KMeans clustering is not present in release-0.9-rc1 Key: FLINK-2187 URL: https://issues.apache.org/jira/browse/FLINK-2187 Project: Flink Issue Type

[jira] [Created] (FLINK-2183) TaskManagerFailsWithSlotSharingITCase fails.

2015-06-08 Thread Sachin Goel (JIRA)
Sachin Goel created FLINK-2183: -- Summary: TaskManagerFailsWithSlotSharingITCase fails. Key: FLINK-2183 URL: https://issues.apache.org/jira/browse/FLINK-2183 Project: Flink Issue Type: Bug

Re: Problem with ML pipeline

2015-06-08 Thread Sachin Goel
i-kit approach this. Regards Sachin Goel On Mon, Jun 8, 2015 at 4:26 PM, Felix Neutatz wrote: > I am in favor of efficiency. Therefore I would be prefer to introduce new > methods, in order to save memory and network traffic. This would also solve > the problem of "how to come up

Re: Problem with ML pipeline

2015-06-08 Thread Sachin Goel
input: DataSet[T]) : DataSet[LabeledVector] = { predict(ParameterMap,input) } } } Regards Sachin Goel On Mon, Jun 8, 2015 at 4:11 PM, Till Rohrmann wrote: > My gut feeling is also that a `Transformer` would be a good place to > implement feature selection.

Re: Problem with ML pipeline

2015-06-08 Thread Sachin Goel
Yes. I agree too. It makes no sense for the learning algorithm to have extra payload. Only relevant data makes sense. Further, adding ID to the predict operation type definition seems a legitimate choice. +1 from my side. Regards Sachin Goel On Mon, Jun 8, 2015 at 4:06 PM, Theodore Vasiloudis

Re: Problem with ML pipeline

2015-06-07 Thread Sachin Goel
A more general approach would be to take as input which indices of the vector to consider as features. After that, the vector can be returned as such and user can do what they wish with the non-feature values. This wouldn't need extending the predict operation, instead this can be specified in the

Travis build issue

2015-06-05 Thread Sachin Goel
Travis build is failing on SimpleRecoveryITCase. Randomly again, I think. Also, the KafkaITCase. Are these also known issues? Regards Sachin Goel

GSoC work

2015-06-03 Thread Sachin Goel
link-2131 <https://issues.apache.org/jira/browse/FLINK-2131>. Cheers! Sachin Goel

Re: [2/2] flink git commit: [ml] Replaces RichMapFunctions with mapWithBcVariable in FlinkML

2015-06-02 Thread Sachin Goel
Should I go ahead and add this method then? The mapWithBcSet I mean. Regards Sachin Goel On Tue, Jun 2, 2015 at 10:43 PM, Till Rohrmann wrote: > Yes you’re right Sachin. The mapWithBcVariable is only syntactic sugar if > you have a broadcast DataSet which contains only one element. If yo

Re: [2/2] flink git commit: [ml] Replaces RichMapFunctions with mapWithBcVariable in FlinkML

2015-06-02 Thread Sachin Goel
the kmeans algorithm. Regards Sachin Goel On Tue, Jun 2, 2015 at 9:03 PM, Sachin Goel wrote: > Hi Till > This works only when there is only one variable to be broadcasted, doesn't > it? What about the case when we need to broadcast two? Is it advisable to > create a BroadcastDoubleEle

Writing test suites

2015-06-02 Thread Sachin Goel
Hi What's the convention with using an "ITSuite" in the name instead of just "Suite"? Regards Sachin Goel

Re: Travis build failing

2015-06-02 Thread Sachin Goel
Ah. This is a known issue then. Regards Sachin Goel On Tue, Jun 2, 2015 at 9:14 PM, Aljoscha Krettek wrote: > The last one is actually SuccessAfterNetworkBuffersFailureITCase which > uses ConnectedComponents. > > On Tue, Jun 2, 2015 at 5:42 PM, Robert Metzger > wrote: >

  1   2   >