Unable to compile both trunk and 0.5.1 code
Hi Just clone the code from incubator flink, I tried both trunk code and 0.5.1 release, and encounter the same problem. # mvn --version Apache Maven 3.0.4 Maven home: /usr/share/maven Java version: 1.6.0_30, vendor: Sun Microsystems Inc. Java home: /usr/java/jdk1.6.0_30/jre Default locale: en_US, platform encoding: UTF-8 OS name: linux, version: 3.8.0-29-generic, arch: amd64, family: unix # mvn -DskipTests clean package [INFO] Scanning for projects... [INFO] [INFO] Reactor Build Order: [INFO] [INFO] stratosphere [INFO] stratosphere-core [INFO] stratosphere-java [INFO] stratosphere-runtime [INFO] stratosphere-compiler [INFO] stratosphere-scala [INFO] stratosphere-clients [INFO] stratosphere-examples [INFO] stratosphere-java-examples [INFO] stratosphere-scala-examples [INFO] stratosphere-test-utils [INFO] stratosphere-tests [INFO] stratosphere-addons [INFO] avro [INFO] jdbc [INFO] spargel [INFO] hadoop-compatibility [INFO] stratosphere-quickstart [INFO] quickstart-java [INFO] quickstart-scala [INFO] stratosphere-dist [INFO] [INFO] [INFO] Building stratosphere 0.5.1 [INFO] [INFO] [INFO] --- maven-clean-plugin:2.3:clean (default-clean) @ stratosphere --- [INFO] Deleting file set: /root/git/incubator-flink/target (included: [**], excluded: []) [INFO] [INFO] --- maven-checkstyle-plugin:2.12.1:check (validate) @ stratosphere --- [INFO] [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @ stratosphere --- [INFO] [INFO] --- maven-javadoc-plugin:2.9.1:jar (attach-javadocs) @ stratosphere --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] maven-source-plugin:2.2.1:jar (attach-sources) @ stratosphere [INFO] [INFO] --- maven-checkstyle-plugin:2.12.1:check (validate) @ stratosphere --- [INFO] [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @ stratosphere --- [INFO] [INFO] maven-source-plugin:2.2.1:jar (attach-sources) @ stratosphere [INFO] [INFO] --- maven-source-plugin:2.2.1:jar (attach-sources) @ stratosphere --- [INFO] [INFO] [INFO] Building stratosphere-core 0.5.1 [INFO] [INFO] [INFO] --- maven-clean-plugin:2.3:clean (default-clean) @ stratosphere-core --- [INFO] Deleting file set: /root/git/incubator-flink/stratosphere-core/target (included: [**], excluded: []) [INFO] [INFO] --- maven-checkstyle-plugin:2.12.1:check (validate) @ stratosphere-core --- [INFO] [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @ stratosphere-core --- [INFO] [INFO] --- maven-resources-plugin:2.3:resources (default-resources) @ stratosphere-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /root/git/incubator-flink/stratosphere-core/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ stratosphere-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 225 source files to /root/git/incubator-flink/stratosphere-core/target/classes [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/core/memory/MemoryUtils.java:[27,37] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/core/memory/MemoryUtils.java:[36,32] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/core/memory/MemorySegment.java:[963,38] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/types/Record.java:[1733,46] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/core/memory/MemoryUtils.java:[38,53] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/core/memory/MemoryUtils.java:[40,41] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] Note: /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/api/common/Plan.java uses unchecked or unsafe operations. [WARNING] Note: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- maven-resources-plugin:2.3:testResources (default-testResources) @ stratosphere-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources.
RE: Unable to compile both trunk and 0.5.1 code
Actually, tried jdk 1.7.0. It works. While the project readme said that Java 6, 7 or 8 both works... Best Regards, Raymond Liu -Original Message- From: Liu, Raymond [mailto:raymond@intel.com] Sent: Monday, June 30, 2014 4:13 PM To: dev@flink.incubator.apache.org Subject: Unable to compile both trunk and 0.5.1 code Hi Just clone the code from incubator flink, I tried both trunk code and 0.5.1 release, and encounter the same problem. # mvn --version Apache Maven 3.0.4 Maven home: /usr/share/maven Java version: 1.6.0_30, vendor: Sun Microsystems Inc. Java home: /usr/java/jdk1.6.0_30/jre Default locale: en_US, platform encoding: UTF-8 OS name: linux, version: 3.8.0-29-generic, arch: amd64, family: unix # mvn -DskipTests clean package [INFO] Scanning for projects... [INFO] [INFO] Reactor Build Order: [INFO] [INFO] stratosphere [INFO] stratosphere-core [INFO] stratosphere-java [INFO] stratosphere-runtime [INFO] stratosphere-compiler [INFO] stratosphere-scala [INFO] stratosphere-clients [INFO] stratosphere-examples [INFO] stratosphere-java-examples [INFO] stratosphere-scala-examples [INFO] stratosphere-test-utils [INFO] stratosphere-tests [INFO] stratosphere-addons [INFO] avro [INFO] jdbc [INFO] spargel [INFO] hadoop-compatibility [INFO] stratosphere-quickstart [INFO] quickstart-java [INFO] quickstart-scala [INFO] stratosphere-dist [INFO] [INFO] [INFO] Building stratosphere 0.5.1 [INFO] [INFO] [INFO] --- maven-clean-plugin:2.3:clean (default-clean) @ stratosphere --- [INFO] Deleting file set: /root/git/incubator-flink/target (included: [**], excluded: []) [INFO] [INFO] --- maven-checkstyle-plugin:2.12.1:check (validate) @ stratosphere --- [INFO] [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @ stratosphere --- [INFO] [INFO] --- maven-javadoc-plugin:2.9.1:jar (attach-javadocs) @ stratosphere --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] maven-source-plugin:2.2.1:jar (attach-sources) @ stratosphere [INFO] [INFO] --- maven-checkstyle-plugin:2.12.1:check (validate) @ stratosphere --- [INFO] [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @ stratosphere --- [INFO] [INFO] maven-source-plugin:2.2.1:jar (attach-sources) @ stratosphere [INFO] [INFO] --- maven-source-plugin:2.2.1:jar (attach-sources) @ stratosphere --- [INFO] [INFO] [INFO] Building stratosphere-core 0.5.1 [INFO] [INFO] [INFO] --- maven-clean-plugin:2.3:clean (default-clean) @ stratosphere-core --- [INFO] Deleting file set: /root/git/incubator-flink/stratosphere-core/target (included: [**], excluded: []) [INFO] [INFO] --- maven-checkstyle-plugin:2.12.1:check (validate) @ stratosphere-core --- [INFO] [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @ stratosphere-core --- [INFO] [INFO] --- maven-resources-plugin:2.3:resources (default-resources) @ stratosphere-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /root/git/incubator-flink/stratosphere-core/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ stratosphere-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 225 source files to /root/git/incubator-flink/stratosphere-core/target/classes [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/core/memory/MemoryUtils.java:[27,37] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/core/memory/MemoryUtils.java:[36,32] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/core/memory/MemorySegment.java:[963,38] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/types/Record.java:[1733,46] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/core/memory/MemoryUtils.java:[38,53] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/core/memory/MemoryUtils.java:[40,41] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] Note:
Re: Unable to compile both trunk and 0.5.1 code
Hi Raymond, its a known issue of the Oracle JDK 6 compiler. There is a issue filed at Oracle but they don't support JDK6 anymore, so they won't fix it. OpenJDK 6 has a fix, and all newer versions from Oracle also have fixes. Flink/Stratosphere runs on the buggy Oracle JDK 6 version, just the compiler won't work. Regards, Robert On Mon, Jun 30, 2014 at 10:20 AM, Liu, Raymond raymond@intel.com wrote: Actually, tried jdk 1.7.0. It works. While the project readme said that Java 6, 7 or 8 both works... Best Regards, Raymond Liu -Original Message- From: Liu, Raymond [mailto:raymond@intel.com] Sent: Monday, June 30, 2014 4:13 PM To: dev@flink.incubator.apache.org Subject: Unable to compile both trunk and 0.5.1 code Hi Just clone the code from incubator flink, I tried both trunk code and 0.5.1 release, and encounter the same problem. # mvn --version Apache Maven 3.0.4 Maven home: /usr/share/maven Java version: 1.6.0_30, vendor: Sun Microsystems Inc. Java home: /usr/java/jdk1.6.0_30/jre Default locale: en_US, platform encoding: UTF-8 OS name: linux, version: 3.8.0-29-generic, arch: amd64, family: unix # mvn -DskipTests clean package [INFO] Scanning for projects... [INFO] [INFO] Reactor Build Order: [INFO] [INFO] stratosphere [INFO] stratosphere-core [INFO] stratosphere-java [INFO] stratosphere-runtime [INFO] stratosphere-compiler [INFO] stratosphere-scala [INFO] stratosphere-clients [INFO] stratosphere-examples [INFO] stratosphere-java-examples [INFO] stratosphere-scala-examples [INFO] stratosphere-test-utils [INFO] stratosphere-tests [INFO] stratosphere-addons [INFO] avro [INFO] jdbc [INFO] spargel [INFO] hadoop-compatibility [INFO] stratosphere-quickstart [INFO] quickstart-java [INFO] quickstart-scala [INFO] stratosphere-dist [INFO] [INFO] [INFO] Building stratosphere 0.5.1 [INFO] [INFO] [INFO] --- maven-clean-plugin:2.3:clean (default-clean) @ stratosphere --- [INFO] Deleting file set: /root/git/incubator-flink/target (included: [**], excluded: []) [INFO] [INFO] --- maven-checkstyle-plugin:2.12.1:check (validate) @ stratosphere --- [INFO] [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @ stratosphere --- [INFO] [INFO] --- maven-javadoc-plugin:2.9.1:jar (attach-javadocs) @ stratosphere --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] maven-source-plugin:2.2.1:jar (attach-sources) @ stratosphere [INFO] [INFO] --- maven-checkstyle-plugin:2.12.1:check (validate) @ stratosphere --- [INFO] [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @ stratosphere --- [INFO] [INFO] maven-source-plugin:2.2.1:jar (attach-sources) @ stratosphere [INFO] [INFO] --- maven-source-plugin:2.2.1:jar (attach-sources) @ stratosphere --- [INFO] [INFO] [INFO] Building stratosphere-core 0.5.1 [INFO] [INFO] [INFO] --- maven-clean-plugin:2.3:clean (default-clean) @ stratosphere-core --- [INFO] Deleting file set: /root/git/incubator-flink/stratosphere-core/target (included: [**], excluded: []) [INFO] [INFO] --- maven-checkstyle-plugin:2.12.1:check (validate) @ stratosphere-core --- [INFO] [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @ stratosphere-core --- [INFO] [INFO] --- maven-resources-plugin:2.3:resources (default-resources) @ stratosphere-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /root/git/incubator-flink/stratosphere-core/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ stratosphere-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 225 source files to /root/git/incubator-flink/stratosphere-core/target/classes [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/core/memory/MemoryUtils.java:[27,37] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/core/memory/MemoryUtils.java:[36,32] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/core/memory/MemorySegment.java:[963,38] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosphere/types/Record.java:[1733,46] warning: sun.misc.Unsafe is Sun proprietary API and may be
RE: Unable to compile both trunk and 0.5.1 code
Great, Thanks for the reply :) Best Regards, Raymond Liu -Original Message- From: Robert Metzger [mailto:rmetz...@apache.org] Sent: Monday, June 30, 2014 4:26 PM To: dev@flink.incubator.apache.org Subject: Re: Unable to compile both trunk and 0.5.1 code Hi Raymond, its a known issue of the Oracle JDK 6 compiler. There is a issue filed at Oracle but they don't support JDK6 anymore, so they won't fix it. OpenJDK 6 has a fix, and all newer versions from Oracle also have fixes. Flink/Stratosphere runs on the buggy Oracle JDK 6 version, just the compiler won't work. Regards, Robert On Mon, Jun 30, 2014 at 10:20 AM, Liu, Raymond raymond@intel.com wrote: Actually, tried jdk 1.7.0. It works. While the project readme said that Java 6, 7 or 8 both works... Best Regards, Raymond Liu -Original Message- From: Liu, Raymond [mailto:raymond@intel.com] Sent: Monday, June 30, 2014 4:13 PM To: dev@flink.incubator.apache.org Subject: Unable to compile both trunk and 0.5.1 code Hi Just clone the code from incubator flink, I tried both trunk code and 0.5.1 release, and encounter the same problem. # mvn --version Apache Maven 3.0.4 Maven home: /usr/share/maven Java version: 1.6.0_30, vendor: Sun Microsystems Inc. Java home: /usr/java/jdk1.6.0_30/jre Default locale: en_US, platform encoding: UTF-8 OS name: linux, version: 3.8.0-29-generic, arch: amd64, family: unix # mvn -DskipTests clean package [INFO] Scanning for projects... [INFO] -- -- [INFO] Reactor Build Order: [INFO] [INFO] stratosphere [INFO] stratosphere-core [INFO] stratosphere-java [INFO] stratosphere-runtime [INFO] stratosphere-compiler [INFO] stratosphere-scala [INFO] stratosphere-clients [INFO] stratosphere-examples [INFO] stratosphere-java-examples [INFO] stratosphere-scala-examples [INFO] stratosphere-test-utils [INFO] stratosphere-tests [INFO] stratosphere-addons [INFO] avro [INFO] jdbc [INFO] spargel [INFO] hadoop-compatibility [INFO] stratosphere-quickstart [INFO] quickstart-java [INFO] quickstart-scala [INFO] stratosphere-dist [INFO] [INFO] -- -- [INFO] Building stratosphere 0.5.1 [INFO] -- -- [INFO] [INFO] --- maven-clean-plugin:2.3:clean (default-clean) @ stratosphere --- [INFO] Deleting file set: /root/git/incubator-flink/target (included: [**], excluded: []) [INFO] [INFO] --- maven-checkstyle-plugin:2.12.1:check (validate) @ stratosphere --- [INFO] [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @ stratosphere --- [INFO] [INFO] --- maven-javadoc-plugin:2.9.1:jar (attach-javadocs) @ stratosphere --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] maven-source-plugin:2.2.1:jar (attach-sources) @ stratosphere [INFO] [INFO] --- maven-checkstyle-plugin:2.12.1:check (validate) @ stratosphere --- [INFO] [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @ stratosphere --- [INFO] [INFO] maven-source-plugin:2.2.1:jar (attach-sources) @ stratosphere [INFO] [INFO] --- maven-source-plugin:2.2.1:jar (attach-sources) @ stratosphere --- [INFO] [INFO] -- -- [INFO] Building stratosphere-core 0.5.1 [INFO] -- -- [INFO] [INFO] --- maven-clean-plugin:2.3:clean (default-clean) @ stratosphere-core --- [INFO] Deleting file set: /root/git/incubator-flink/stratosphere-core/target (included: [**], excluded: []) [INFO] [INFO] --- maven-checkstyle-plugin:2.12.1:check (validate) @ stratosphere-core --- [INFO] [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce-maven) @ stratosphere-core --- [INFO] [INFO] --- maven-resources-plugin:2.3:resources (default-resources) @ stratosphere-core --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /root/git/incubator-flink/stratosphere-core/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ stratosphere-core --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 225 source files to /root/git/incubator-flink/stratosphere-core/target/classes [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosph ere/core/memory/MemoryUtils.java:[27,37] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING] /root/git/incubator-flink/stratosphere-core/src/main/java/eu/stratosph ere/core/memory/MemoryUtils.java:[36,32] warning: sun.misc.Unsafe is Sun proprietary API and may be removed in a future release [WARNING]
[GitHub] incubator-flink pull request: Mention that Oracle JDK 6 library wi...
GitHub user colorant opened a pull request: https://github.com/apache/incubator-flink/pull/49 Mention that Oracle JDK 6 library will fail to build So people won't encounter and ask the same question as I did just now ;) You can merge this pull request into a Git repository by running: $ git pull https://github.com/colorant/incubator-flink doc Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-flink/pull/49.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #49 commit 90bf20d0d2e06f0a207df5a44a1a43ae8b76 Author: Raymond Liu raymond@intel.com Date: 2014-06-30T08:40:45Z Mention that Oracle JDK 6 library will fail to build --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-flink pull request: Mention that Oracle JDK 6 library wi...
Github user rmetzger commented on the pull request: https://github.com/apache/incubator-flink/pull/49#issuecomment-47508481 Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-flink pull request: [FLINK-938] Automatically configure ...
Github user qmlmoon commented on the pull request: https://github.com/apache/incubator-flink/pull/48#issuecomment-47510044 The newest commit using cli invocation to pass jobmanager's hostname to `JobManager` and `TaskManager`. It still try to rewrite the config file on master node since `CliFrontend` also reads config to get jobmanager address. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-flink pull request: [FLINK-938] Automatically configure ...
Github user rmetzger commented on the pull request: https://github.com/apache/incubator-flink/pull/48#issuecomment-47510600 I agree. Rewriting the config for the `CliFrontend` is good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-flink pull request: Finished Flink-928
Github user rmetzger commented on the pull request: https://github.com/apache/incubator-flink/pull/43#issuecomment-47514021 The TaskManagers page looks good, but the History is not working. (JSON parse error). Can you add a testcase to ensure the correctness of the JSON. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: A wiki for Flink
Would it be okay for Apache if we use the GitHub Wiki? On Fri, Jun 27, 2014 at 8:52 PM, Alan Gates ga...@hortonworks.com wrote: I've used the Confluence wiki that Apache provides for Hive and Pig. It works fine. I can't compare it to the github one as I haven't used that one. Whichever you guys prefer we can file a ticket with infra and get one created. Alan. Stephan Ewen se...@apache.org June 27, 2014 at 5:46 AM Hi everyone! I think we could really use a wiki. It would provide a means to create project/feature suggestions with a low entry hurdle. Right now, I am seeing two immediate issues where we could use the wiki: 1) Maintain a list of projects extending Flink or building on top of Flink (as per Kostas mail earlier) 2) As a place to draft blog posts / news messages (as per Henry's suggestion earlier) I was wondering which kind of Wiki to use. The GitHub mirror under https://github.com/apache/incubator-flink; has a wiki that would need to be enabled by the infra team. Since most people these days have github accounts, that might be the way with the lowest entry barrier. As far as I know, Apache also has its own Wiki infrastructure (confluence based?), which would require an extra account for editors. Does anyone have experiences with that? Greetings, Stephan -- Sent with Postbox http://www.getpostbox.com CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
Re: A wiki for Flink
On 30 Jun 2014, at 11:59, Robert Metzger rmetz...@apache.org wrote: Would it be okay for Apache if we use the GitHub Wiki? +1 for GitHub Wiki. On Fri, Jun 27, 2014 at 8:52 PM, Alan Gates ga...@hortonworks.com wrote: I've used the Confluence wiki that Apache provides for Hive and Pig. It works fine. I can't compare it to the github one as I haven't used that one. Whichever you guys prefer we can file a ticket with infra and get one created. Alan. Stephan Ewen se...@apache.org June 27, 2014 at 5:46 AM Hi everyone! I think we could really use a wiki. It would provide a means to create project/feature suggestions with a low entry hurdle. Right now, I am seeing two immediate issues where we could use the wiki: 1) Maintain a list of projects extending Flink or building on top of Flink (as per Kostas mail earlier) 2) As a place to draft blog posts / news messages (as per Henry's suggestion earlier) I was wondering which kind of Wiki to use. The GitHub mirror under https://github.com/apache/incubator-flink; has a wiki that would need to be enabled by the infra team. Since most people these days have github accounts, that might be the way with the lowest entry barrier. As far as I know, Apache also has its own Wiki infrastructure (confluence based?), which would require an extra account for editors. Does anyone have experiences with that? Greetings, Stephan -- Sent with Postbox http://www.getpostbox.com CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
[GitHub] incubator-flink pull request: FLINK-990 Scala API: Compiler Hints ...
GitHub user tillrohrmann opened a pull request: https://github.com/apache/incubator-flink/pull/51 FLINK-990 Scala API: Compiler Hints are not forwarded Added constant fields and combinable annotations forwarding to Scala API. The problem is that annotations information is not available when the Operators are created. Thus, we need a operator translation similar to the new Java API which triggers an update of the respective semantic information. Furthermore, the Scala generated annotations are appended to the operator class, whereas the udf is checked for annotations. That's why Scala's combinableReduce operation does not generate a combinable operator. You can merge this pull request into a Git repository by running: $ git pull https://github.com/tillrohrmann/incubator-flink FLINK-990 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-flink/pull/51.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #51 commit 735e93cd17df35b7f7340c777d03e57f00562472 Author: Till Rohrmann till.rohrm...@gmail.com Date: 2014-06-30T09:45:49Z Added constant fields and combinable annotations forwarding to Scala API --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-flink pull request: Rework of TypeExtractor for SAM supp...
GitHub user twalthr opened a pull request: https://github.com/apache/incubator-flink/pull/52 Rework of TypeExtractor for SAM support [FLINK-701] In order to support Java 8 Lambdas the TypeExtractor has been adapted to support interface instead of classes as function bases. See also [FLINK-701]. This PR also fixes a bug in the input validation for the new POJO types. I have reordered some methods and introduced some sections to improve code readability. You can merge this pull request into a Git repository by running: $ git pull https://github.com/twalthr/incubator-flink TypeExtractorInterfaceSupport Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-flink/pull/52.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #52 commit da2bdc4f95810ae4187f6fc971245d6496d2eb61 Author: twalthr i...@twalthr.com Date: 2014-06-30T10:02:37Z Rework of TypeExtractor for SAM support --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (FLINK-991) Add documentation for POJO expression keys
Fabian Hueske created FLINK-991: --- Summary: Add documentation for POJO expression keys Key: FLINK-991 URL: https://issues.apache.org/jira/browse/FLINK-991 Project: Flink Issue Type: Bug Components: Documentation, Java API Affects Versions: 0.6-incubating Reporter: Fabian Hueske The Java API documentation needs to be extended to reflect the extensions added by FLINK-908. These are basically expression keys for POJO objects, i.e., selecting public fields of POJOs as keys by their names. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Created] (FLINK-992) Create CollectionDataSets by reading (client) local files.
Fabian Hueske created FLINK-992:
---
Summary: Create CollectionDataSets by reading (client) local files.
Key: FLINK-992
URL: https://issues.apache.org/jira/browse/FLINK-992
Project: Flink
Issue Type: Improvement
Components: Java API, Python API, Scala API
Reporter: Fabian Hueske
Priority: Minor
{{CollectionDataSets}} are a nice way to feed data into programs.
We could add support to read a client-local file at program construction time
using a FileInputFormat, put its data into a CollectionDataSet, and ship its
data together with the program.
This would remove the need to upload small files into DFS which are used
together with some large input (stored in DFS).
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[GitHub] incubator-flink pull request: Rework of TypeExtractor for SAM supp...
Github user atsikiridis commented on the pull request: https://github.com/apache/incubator-flink/pull/52#issuecomment-47521024 Hello, This will make #37 much cleaner in the handling of InputFormats by the hadoop client. This is the proper way to do it. So, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Created] (FLINK-993) Inconsistent package naming of nightly builds and releases
Ufuk Celebi created FLINK-993: - Summary: Inconsistent package naming of nightly builds and releases Key: FLINK-993 URL: https://issues.apache.org/jira/browse/FLINK-993 Project: Flink Issue Type: Improvement Components: Build System Reporter: Ufuk Celebi Priority: Minor stratosphere-bin-0.5.1.tgz stratosphere-bin-0.5.1-hadoop2.tgz stratosphere-bin-0.5.1-yarn.tar.gz vs. stratosphere-0.6-SNAPSHOT.tgz stratosphere-0.6-hadoop2-SNAPSHOT.tgz stratosphere-0.6-SNAPSHOT-yarn.tar.tgz Names and file extensions should be consistent. -- This message was sent by Atlassian JIRA (v6.2#6252)
[GitHub] incubator-flink pull request: Finished Flink-928
Github user JonathanH5 commented on the pull request: https://github.com/apache/incubator-flink/pull/43#issuecomment-47535896 This was an old bug which was fixed before... . I rebased to the current master and it works. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-flink pull request: FIX-FLINK-888-swapValues() for Tuple...
Github user tobwiens commented on the pull request: https://github.com/apache/incubator-flink/pull/44#issuecomment-47549619 Obviously! Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
Re: Draft for Project Website
Nice first draft! A few comments: - I think we can remove the Home link, the link on Apache Flink serves the same purpose - The headline Apache Flink is a platform for efficient, distributed, general-purpose data processing. and What is Apache Flink serve the same purpose. - I don't link the combination of the four boxes in 3 colors arranged 2x2 and the wide horizontal orange box. - I liked the Features section of the Stratosphere website. Why not put all the features also on the frontpage? Fabian Can we place a link for a pre-Apache release on the website? 2014-06-30 16:57 GMT+02:00 Aljoscha Krettek aljos...@apache.org: When I hover over DOWNLOAD 0.5.1 and MAILING LISTS a dash pops up in the white space between the buttons. On Mon, Jun 30, 2014 at 4:16 PM, Stephan Ewen se...@apache.org wrote: Hi everyone! We have created a first draft for the project website for flink.incubator.apache.org. You can have a look at the draft here: http://robertmetzger.de/incubator-flink-website/index.html Big thanks to Ufuk (@uce) for creating the layouts/styles, adjusting the doing the majority of the contents. Please let us know what you think and what we need to change to make it Apache compliant. Stephan
[GitHub] incubator-flink pull request: [FLINK-994] Replaced DataInput and D...
GitHub user tillrohrmann opened a pull request: https://github.com/apache/incubator-flink/pull/53 [FLINK-994] Replaced DataInput and DataOutput with DataInputView and DataOutputView I replaced the DataInput and DataOutput parameters by DataInputView and DataOutputView in the IOReadableWritable interface. Thus, I also added wrappers for DataInputStream, DataOutputStream, ObjectOutputStream and ObjectInputStream to make them compatible with the new read and write methods. You can merge this pull request into a Git repository by running: $ git pull https://github.com/tillrohrmann/incubator-flink FLINK-994 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-flink/pull/53.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #53 commit bf0d7cf252f51fc3e79e2655d91de1781940bd5b Author: Till Rohrmann till.rohrm...@gmail.com Date: 2014-06-29T17:08:31Z Replaced DataInput and DataOutput with DataInputView and DataOutputView --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
