Re: [DISCUSS] GitBox

2018-05-16 Thread Suneel Marthi
+1 On Wed, May 16, 2018 at 2:09 PM, Thomas Weise wrote: > +1 > > > On Wed, May 16, 2018 at 8:31 AM, Stefan Richter < > s.rich...@data-artisans.com > > wrote: > > > +1 > > > > > Am 16.05.2018 um 12:40 schrieb Chesnay Schepler : > > > > > > Hello, > > > > > > during the discussion about how to bet

Re: request for contributor permission

2018-04-26 Thread Suneel Marthi
Not necessary -- one of the PMC members shuld be able to ya as a contributor anytime. On Thu, Apr 26, 2018 at 4:40 PM, TechnoMage wrote: > Contributor permission is only granted after siginificant contributions. > The route to contributing is to use pull requests and have the commits > reviewe

Re: Using Slack for online discussions

2018-04-03 Thread Suneel Marthi
*As one of the admins for ASF slack*, let me clarify a few things: 1. ASF slack is open to everyone regardless of apache,org or not - u need to make a request on dev@ to be added to ASF slack if you don't have an apache.org 2. There is an archive bot in place on ASF slack for archiving older mess

Re: [DISCUSS] GitBox

2017-07-18 Thread Suneel Marthi
FWIW, the Apache OpenNLP project recently moved to gitbox and even had a release following that - if anything it makes a committers' PR merge workflow lot easier when having to rebase, squash and merge PRs. See the section about 'Merging a PR via Github' here - http://opennlp.apache.org/using-git

Re: Flink Scala - data load from CSV to postgress database.

2016-09-22 Thread Suneel Marthi
Couldn't u use SQLLoader or something for doing that? http://stackoverflow.com/questions/2987433/how-to-import-csv-file-data-into-a-postgresql-table On Thu, Sep 22, 2016 at 3:01 PM, Jagan wrote: > Hi Guys, > > We have a requirement like – loading data from local CSV file to Postgress > databa

Re: Question about Apache Flink Use Case

2016-07-23 Thread Suneel Marthi
>From the Use Case description, it seems like u r looking to aggregate files based on either a threshold size or threshold time and ship them to S3. Correct? Flink might be an overkill here and u could look at frameworks like Apache NiFi that have pre-built (and configurable) processors to do just

Re: Flink Table & SQL doesn't work in very simple example

2016-07-20 Thread Suneel Marthi
I am not seeing an issue with this code Radu, this is from present 1.1-Snapshot. This is what I have and it works (running from within IntelliJ and not cli) : List> input = new ArrayList<>(); input.add(new Tuple3<>(3L,"test",1)); input.add(new Tuple3<>(5L,"test2",2)); StreamExecutionEnvironment

[jira] [Created] (FLINK-4103) Modify CsvTableSource to implement StreamTableSource

2016-06-22 Thread Suneel Marthi (JIRA)
Suneel Marthi created FLINK-4103: Summary: Modify CsvTableSource to implement StreamTableSource Key: FLINK-4103 URL: https://issues.apache.org/jira/browse/FLINK-4103 Project: Flink Issue

Re: Iteration Intermediate Output

2016-05-30 Thread Suneel Marthi
This is a feature that was requested by the Mahout project few months before for the very same reasons as mentioned in previous emails on this thread, but we were snubbed by the flink folks as this being '*WAY too specific*' request for flink to deal with and 'its got to be done the way Flink has i

Re: [DISCUSS] Release 1.0.1 Bugfix release

2016-03-29 Thread Suneel Marthi
what about PR# 1829? We need it real bad for an upcoming release. On Tue, Mar 29, 2016 at 1:17 PM, Ufuk Celebi wrote: > I just merged #1830 and will create a RC after cherry picking > '[FLINK-3636] Add ThrottledIterator to WindowJoin jar' to the > release-1.0 branch. > > Thanks for kicking off t

[jira] [Created] (FLINK-3657) Change access of DataSetUtils.countElements() to 'public'

2016-03-22 Thread Suneel Marthi (JIRA)
Suneel Marthi created FLINK-3657: Summary: Change access of DataSetUtils.countElements() to 'public' Key: FLINK-3657 URL: https://issues.apache.org/jira/browse/FLINK-3657 Proj

Re: Apache Big Data

2016-03-01 Thread Suneel Marthi
Same here, will be presenting Distributed ML using Mahout on Flink at ApacheCon. Some big shout outs to Flink coming in Vancouver. On Tue, Mar 1, 2016 at 2:35 PM, Trevor Grant wrote: > Any one who is attending Apache: Big Data in Vancouver May 9-12 stop by and > check out my talk: *Everyone Pla

Re: Opening a discussion on FlinkML

2016-02-12 Thread Suneel Marthi
imilar DSLs out there, need to dig up my old emails. (Not sure if its ASLv2 License, need verification here) > > 5) Agree on this one too. To my knowledge it would be the best option > together with SAMOA (for the streaming part). > There's already Flink - Samoa integration in p

Re: Opening a discussion on FlinkML

2016-02-12 Thread Suneel Marthi
My 2 cents as someone who's done ML over the years - having worked on Oryx 2.0 and Mahout and having used Spark MlLib (read as "had no choice due to strict workplace enforcement") and understands well their limitations. 1. FlinkML in its present form seems like "do it like how Spark did it". 2. T

Re: FlinkML NeuralNetworks

2016-02-12 Thread Suneel Marthi
On Fri, Feb 12, 2016 at 8:45 AM, Trevor Grant wrote: > Hey all, > > I had a post a while ago about needing neural networks. We specifically > need a very special type that are good for time series/sensors called > LSTM. We had a talk about pros/cons of using deeplearning4j for this use > case a

Re: Connector Documentation missing

2016-02-03 Thread Suneel Marthi
Most of the flume code is commented out IIRC? Sent from my iPhone > On Feb 3, 2016, at 8:24 AM, Matthias J. Sax wrote: > > Hi, > > I just observed that there are 7 flink-streaming-connectors available > but only 5 are documented on the web page. > > Flume and Nifi are not documented. Did we m

Re: Deep Learning on Flink

2016-01-21 Thread Suneel Marthi
Hi Trevor, There's been an initiative that's just started out on to add Flink as another execution engine on Deeplearning4J (http://deeplearning4j.org). We could move this conversation there. On Thu, Jan 21, 2016 at 9:40 AM, Trevor Grant wrote: > Hey all, > > Does anyone know of any specific

Re: withParameters() for Streaming API

2015-11-24 Thread Suneel Marthi
Agree with @till +1 to change this now On Tue, Nov 24, 2015 at 9:15 AM, Till Rohrmann wrote: > If not API breaking before 1.0, then probably never? > > On Tue, Nov 24, 2015 at 3:06 PM, Stephan Ewen wrote: > > > I was also thinking of deprecating that. With that, RichFunctions should > > change

Re: how to write dataset in a file?

2015-11-20 Thread Suneel Marthi
You can write to a single output file by setting parallelism == 1 So final ExecutionEnvironment env = ExecutionEnvironment. createLocalEnvironment().setParallelism(1); The reason u see multiple output files is because, each worker is writing to a different file. On Fri, Nov 20, 2015 at 10:06 PM

Re: [DISCUSS] Release Flink 0.10.1 soon

2015-11-19 Thread Suneel Marthi
o 0.10-release as well. > > On Thu, Nov 19, 2015 at 10:01 AM, Suneel Marthi > wrote: > > > @Till Should the recent updates to docs/apis/streaming-guide.md be also > > merged to 'release 0.10'? There are other related PRs pending. > > > > On Th

Re: [DISCUSS] Release Flink 0.10.1 soon

2015-11-19 Thread Suneel Marthi
#x27;t work on YARN > > > > > > > > On Wed, Nov 18, 2015 at 2:35 PM, Ufuk Celebi wrote: > > > > > @Suneel: I think that's OK for the next major release :) > > > > > > On Wed, Nov 18, 2015 at 2:17 PM, Suneel Marthi &l

[jira] [Created] (FLINK-3041) Twitter Streaming Description section of Streaming Programming guide refers to an incorrect example 'TwitterLocal'

2015-11-18 Thread Suneel Marthi (JIRA)
Suneel Marthi created FLINK-3041: Summary: Twitter Streaming Description section of Streaming Programming guide refers to an incorrect example 'TwitterLocal' Key: FLINK-3041 URL: https://issues.apach

Re: [DISCUSS] Release Flink 0.10.1 soon

2015-11-18 Thread Suneel Marthi
Would be nice to have Flink-2949 in the mix, but I won't be able to get to it until early next week. On Wed, Nov 18, 2015 at 7:49 AM, Till Rohrmann wrote: > @Vasia, do you mean FLINK-3013 or FLINK-3012? > > Will merge PRs for FLINK-3036 and FLINK-3013 this afternoon. > > On Wed, Nov 18, 2015 at

[jira] [Created] (FLINK-3022) Broken link 'Working With State' in Fault Tolerance Section of Stream Programming Guide

2015-11-17 Thread Suneel Marthi (JIRA)
Suneel Marthi created FLINK-3022: Summary: Broken link 'Working With State' in Fault Tolerance Section of Stream Programming Guide Key: FLINK-3022 URL: https://issues.apache.org/jira/browse/

[jira] [Created] (FLINK-3017) Broken link 'Slots' on Streaming Programming Guide

2015-11-15 Thread Suneel Marthi (JIRA)
Suneel Marthi created FLINK-3017: Summary: Broken link 'Slots' on Streaming Programming Guide Key: FLINK-3017 URL: https://issues.apache.org/jira/browse/FLINK-3017 Project: Flink

[jira] [Created] (FLINK-3013) Incorrect package declaration in GellyScalaAPICompletenessTest.scala

2015-11-15 Thread Suneel Marthi (JIRA)
Suneel Marthi created FLINK-3013: Summary: Incorrect package declaration in GellyScalaAPICompletenessTest.scala Key: FLINK-3013 URL: https://issues.apache.org/jira/browse/FLINK-3013 Project: Flink

[jira] [Created] (FLINK-2949) Add method 'writeSequencefile' to DataSet

2015-10-30 Thread Suneel Marthi (JIRA)
Suneel Marthi created FLINK-2949: Summary: Add method 'writeSequencefile' to DataSet Key: FLINK-2949 URL: https://issues.apache.org/jira/browse/FLINK-2949 Project: Flink

Re: Broken link for master Javadocs

2015-10-28 Thread Suneel Marthi
ue process is not a member of > >>> > org.apache.flink.api.scala.FlinkILoop > >>> > [ERROR] repl.foreach(_.process(settings)) > >>> > [ERROR] ^ > >>> > [ERROR] > >>> > > >>> > /home/buildslave2/slave2/flink-docs-master/build/flink-staging/flink-scala-shell/src/main/scala/org/apache/flink/api/scala/FlinkShell.scala:153: > >>> > error: value closeInterpreter is not a member of > >>> > org.apache.flink.api.scala.FlinkILoop > >>> > [ERROR] repl.foreach(_.closeInterpreter()) > >>> > [ERROR] ^ > >>> > [ERROR] 8 errors found > >>> > > >>> > > >>> > Not sure what the issue is. I'll try to look into later. > >>> > > >>> > Thanks, > >>> > Max > >>> > > >>> > On Mon, Oct 26, 2015 at 7:12 AM, Henry Saputra < > henry.sapu...@gmail.com > >>> > > > >>> > wrote: > >>> > > >>> > > Thanks for the heads up, Suneel. > >>> > > > >>> > > Seemed like master Java api (api/java/index.html) is not being > built: > >>> > > https://ci.apache.org/projects/ > >>> > > > >>> > > I have filed ticket with infra to help figure out why. > >>> > > > >>> > > - Henry > >>> > > > >>> > > On Sat, Oct 24, 2015 at 5:45 PM, Suneel Marthi >>> > > wrote: > >>> > > > https://ci.apache.org/projects/flink/flink-docs-master/api/java > >>> > > > > >>> > > > needs to be fixed. > >>> > > > >>> > > >>> >

Re: [DISCUSS] Java code style

2015-10-26 Thread Suneel Marthi
2 spaces is the convention that's followed on Mahout and Oryx. On Mon, Oct 26, 2015 at 1:42 PM, Till Rohrmann wrote: > Concerning question 2 Tabs vs. Spaces, in case of spaces we would have to > decide on the number of spaces, too. The Google Java style says to use a 2 > space indentation, which

[jira] [Created] (FLINK-2918) Add a method to be able to read SequenceFileInputFormat

2015-10-25 Thread Suneel Marthi (JIRA)
Suneel Marthi created FLINK-2918: Summary: Add a method to be able to read SequenceFileInputFormat Key: FLINK-2918 URL: https://issues.apache.org/jira/browse/FLINK-2918 Project: Flink Issue

Broken link for master Javadocs

2015-10-24 Thread Suneel Marthi
https://ci.apache.org/projects/flink/flink-docs-master/api/java needs to be fixed.

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc0)

2015-10-22 Thread Suneel Marthi
We r actually targeting Flink 0.10, since 0.10 would be out by the time we have Flink-Mahout integration in place. On Thu, Oct 22, 2015 at 9:02 AM, Till Rohrmann wrote: > Forget my last mail. Just found out that the Mahout guys are still running > on 0.9-SNAPSHOT. > ​ > > On Thu, Oct 22, 2015 at

Re: [VOTE] Release Apache Flink 0.10.0 (release-0.10.0-rc0)

2015-10-22 Thread Suneel Marthi
Thanks Till for bringing this up. This is one of the blockers we r facing now for Flink-Mahout integration. It would be great to have this in 0.10. On Thu, Oct 22, 2015 at 8:53 AM, Till Rohrmann wrote: > I found another issue (FLINK-2894 > ) whi

Re: Powered by Flink

2015-10-19 Thread Suneel Marthi
+1 to this. On Mon, Oct 19, 2015 at 3:00 PM, Fabian Hueske wrote: > Sounds good +1 > > 2015-10-19 14:57 GMT+02:00 Márton Balassi : > > > Thanks for starting and big +1 for making it more prominent. > > > > On Mon, Oct 19, 2015 at 2:53 PM, Fabian Hueske > wrote: > > > >> Thanks for starting this

[ANNOUNCE] Apache Mahout 0.10.2 Release

2015-08-06 Thread Suneel Marthi
The Apache Mahout PMC is pleased to announce the release of Mahout 0.10.2. Mahout's goal is to create an environment for quickly creating machine learning applications that scale and run on the highest performance parallel computation engines available. Mahout comprises an interactive environment a

[ANNOUNCE] Apache Mahout 0.10.1 Released

2015-05-31 Thread Suneel Marthi
The Apache Mahout PMC is pleased to announce the release of Mahout 0.10.1. Mahout's goal is to create an environment for quickly creating machine learning applications that scale and run on the highest performance parallel computation engines available. Mahout comprises an interactive environment a

Apache Mahout 0.10.0 Released

2015-04-12 Thread Suneel Marthi
The Apache Mahout PMC is pleased to announce the release of Mahout 0.10.0. Mahout's goal is to create an environment for quickly creating machine learning applications that scale and run on the highest performance parallel computation engines available. Mahout comprises an interactive environment a