[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2016-04-06 Thread twalthr
Github user twalthr commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-206214656 I will close this issue in favor of the new design `TableDef` design. --- If your project is set up for it, you can reply to this email and have your reply appear on Git

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2016-04-06 Thread twalthr
Github user twalthr closed the pull request at: https://github.com/apache/flink/pull/1237 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2016-04-05 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-205881346 @twalthr is this still valid with the changes in the Table API or can it be closed? --- If your project is set up for it, you can reply to this email and have your rep

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-12-07 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-162654340 You are right of course and I'm sorry I didn't put in the required time earlier. Your are also right about the Calcite thing. If we decide to use calcite and h

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-12-07 Thread twalthr
Github user twalthr commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-162622155 So basically what you want to say is: throw your entire code away. I'm disappointed that you think about the whole concept now, after I have rebased and reworked the

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-12-07 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-162553706 Yes, we should, this has been lying around for a while now. I have been thinking about this for a while now and I'm afraid I cannot recommend to merge this in t

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-12-07 Thread twalthr
Github user twalthr commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-162521847 @aljoscha we should finally reach a consesus for this PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-24 Thread twalthr
Github user twalthr commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-159229093 Most input formats won't use the adaptive sources. Sure performance is not that important in the pre-flight phase, but if we always think so, the pre-flight phase will s

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-24 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-159215435 I think the performance of the pre-flight phase is mostly irrelevant, even if it is slow no-one will notice since it only runs once before the job starts. IMHO, simplic

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-23 Thread twalthr
Github user twalthr commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-158955674 @aljoscha I thought it makes sense to distinguish between `AdaptiveTableSource` and `StaticTableSource`. Calculating the predicates to be pushed down is quite expensive,

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r45602715 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/PredicatePushdown.scala --- @@ -0,0 +1,120 @@ +/*

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r45602446 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/PredicatePushdown.scala --- @@ -0,0 +1,120 @@ +/*

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r45602245 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/PredicatePruner.scala --- @@ -0,0 +1,88 @@ +/*

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r45601201 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/java/table/TableEnvironment.scala --- @@ -45,7 +60,12 @@ class TableEnvironment

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r45601100 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/java/table/TableEnvironment.scala --- @@ -45,7 +60,12 @@ class TableEnvironment

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r45600975 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/java/table/JavaStreamingTranslator.scala --- @@ -113,8 +131,14 @@ class JavaStre

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r45600858 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/java/table/JavaStreamingTranslator.scala --- @@ -53,6 +55,22 @@ class JavaStream

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r45600839 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/java/table/JavaBatchTranslator.scala --- @@ -118,6 +135,12 @@ class JavaBatchTra

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r45600786 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/java/table/JavaBatchTranslator.scala --- @@ -54,6 +55,22 @@ class JavaBatchTrans

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-11 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-155719774 Why is it `AdaptiveTableSource` and `StaticTableSource`? Aren't static sources a subset of adaptive sources that just don't adapt? I don't think we need to have

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-11 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r44515720 --- Diff: flink-scala/src/main/scala/org/apache/flink/api/scala/ExecutionEnvironment.scala --- @@ -64,15 +62,19 @@ import scala.reflect.ClassTag * cr

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-10 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-155500029 Yes, sorry for the delay. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-10 Thread twalthr
Github user twalthr commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-155498508 @aljoscha Do you think you'll find time this week for the PR? All Table API input formats are waiting for it... --- If your project is set up for it, you can reply to t

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-04 Thread tillrohrmann
Github user tillrohrmann commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-153709718 Yeah looks good now :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-04 Thread aljoscha
Github user aljoscha commented on the pull request: https://github.com/apache/flink/pull/1237#issuecomment-153708732 I want to have a final look today. Is the Scala ok from your side now, @tillrohrmann? --- If your project is set up for it, you can reply to this email and have your r

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-04 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r43872771 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/FieldBacktracker.scala --- @@ -0,0 +1,79 @@ +/* +

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-03 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r43742661 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/FieldBacktracker.scala --- @@ -0,0 +1,79 @@ +/* +

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-02 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r43631877 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/FieldBacktracker.scala --- @@ -0,0 +1,79 @@ +/*

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-02 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r43628710 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/FieldBacktracker.scala --- @@ -0,0 +1,75 @@ +/* +

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-11-01 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r43590351 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/FieldBacktracker.scala --- @@ -0,0 +1,75 @@ +/*

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-10-30 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r43542701 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/FieldBacktracker.scala --- @@ -0,0 +1,75 @@ +/* +

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-10-30 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r43541584 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/FieldBacktracker.scala --- @@ -0,0 +1,75 @@ +/* +

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-10-30 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r43541130 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/java/table/JavaBatchTranslator.scala --- @@ -39,7 +40,7 @@ import org.apache.flink.ap

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-10-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r42603373 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/PredicatePruner.scala --- @@ -0,0 +1,88 @@ +/*

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-10-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r42603257 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/FieldBacktracker.scala --- @@ -0,0 +1,75 @@ +/*

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-10-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r42603297 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/FieldBacktracker.scala --- @@ -0,0 +1,75 @@ +/*

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-10-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r42603082 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/table/expressions/analysis/FieldBacktracker.scala --- @@ -0,0 +1,75 @@ +/*

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-10-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r42602668 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/java/table/JavaStreamingTranslator.scala --- @@ -38,7 +40,7 @@ import org.apache

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-10-21 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/1237#discussion_r42602646 --- Diff: flink-staging/flink-table/src/main/scala/org/apache/flink/api/java/table/JavaBatchTranslator.scala --- @@ -39,7 +40,7 @@ import org.apache.fli

[GitHub] flink pull request: [FLINK-2828] [table] Add interfaces for Table ...

2015-10-07 Thread twalthr
GitHub user twalthr opened a pull request: https://github.com/apache/flink/pull/1237 [FLINK-2828] [table] Add interfaces for Table API input formats This PR implements TableSources as described in FLINK-2828. It is an uncoupling of #1127 for FLINK-2167. All feedback I got from @aljo