[jira] [Updated] (BEAM-5384) [SQL] Calcite optimizes away LogicalProject

2018-10-02 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-5384: -- Summary: [SQL] Calcite optimizes away LogicalProject (was: [SQL] Calcite Doesn't optimizes away

[jira] [Commented] (BEAM-5384) [SQL] Calcite Doesn't optimizes away LogicalProject

2018-09-14 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16615043#comment-16615043 ] Anton Kedin commented on BEAM-5384: --- Reproduction: 

[jira] [Updated] (BEAM-5384) [SQL] Calcite Doesn't optimizes away LogicalProject

2018-09-13 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-5384: -- Description: *From

[jira] [Created] (BEAM-5384) [SQL] Calcite Doesn't optimizes away LogicalProject

2018-09-13 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-5384: - Summary: [SQL] Calcite Doesn't optimizes away LogicalProject Key: BEAM-5384 URL: https://issues.apache.org/jira/browse/BEAM-5384 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-5335) [SQL] Output schema is not set incorrectly

2018-09-07 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16607355#comment-16607355 ] Anton Kedin commented on BEAM-5335: --- >From

[jira] [Updated] (BEAM-5335) [SQL] Output schema is not set incorrectly

2018-09-06 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-5335: -- Summary: [SQL] Output schema is not set incorrectly (was: [SQL] Output schema is set incorrectly) >

[jira] [Commented] (BEAM-5335) [SQL] Output schema is set incorrectly

2018-09-06 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16606168#comment-16606168 ] Anton Kedin commented on BEAM-5335: --- And we need a test to chain multiple queries > [SQL] Output schema

[jira] [Commented] (BEAM-5335) [SQL] Output schema is set incorrectly

2018-09-06 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16606167#comment-16606167 ] Anton Kedin commented on BEAM-5335: --- This is potentially scio-specific, as output schema should be set

[jira] [Created] (BEAM-5335) [SQL] Output schema is set incorrectly

2018-09-06 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-5335: - Summary: [SQL] Output schema is set incorrectly Key: BEAM-5335 URL: https://issues.apache.org/jira/browse/BEAM-5335 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-5127) [SQL] Avoid String parsing in BeamTableUtils

2018-08-10 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-5127: - Summary: [SQL] Avoid String parsing in BeamTableUtils Key: BEAM-5127 URL: https://issues.apache.org/jira/browse/BEAM-5127 Project: Beam Issue Type: Bug

[jira] [Closed] (BEAM-5050) [SQL] NULLs are aggregated incorrectly

2018-08-03 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-5050. - Resolution: Fixed Fix Version/s: Not applicable > [SQL] NULLs are aggregated incorrectly >

[jira] [Closed] (BEAM-5056) [SQL] Nullability of aggregation expressions isn't inferred properly

2018-08-03 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-5056. - Resolution: Fixed Fix Version/s: Not applicable > [SQL] Nullability of aggregation expressions

[jira] [Created] (BEAM-5050) [SQL] NULLs are aggregated incorrectly

2018-07-31 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-5050: - Summary: [SQL] NULLs are aggregated incorrectly Key: BEAM-5050 URL: https://issues.apache.org/jira/browse/BEAM-5050 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-5049) [SQL] Batch Join results in two shuffles

2018-07-31 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-5049: -- Description: The query like this: {code} SELECT a.*, b.*, c.* FROM a JOIN b ON a.some_id = b.some_id

[jira] [Created] (BEAM-5049) [SQL] Batch Join results in two shuffles

2018-07-31 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-5049: - Summary: [SQL] Batch Join results in two shuffles Key: BEAM-5049 URL: https://issues.apache.org/jira/browse/BEAM-5049 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-4815) [SQL] Document/fix text table (TextIO) insert behavior

2018-07-18 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4815: - Summary: [SQL] Document/fix text table (TextIO) insert behavior Key: BEAM-4815 URL: https://issues.apache.org/jira/browse/BEAM-4815 Project: Beam Issue Type:

[jira] [Commented] (BEAM-4771) Update BeamSQL Walkthrough documentation to align with latest version

2018-07-17 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16546989#comment-16546989 ] Anton Kedin commented on BEAM-4771: --- updated the doc: 

[jira] [Resolved] (BEAM-4771) Update BeamSQL Walkthrough documentation to align with latest version

2018-07-17 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin resolved BEAM-4771. --- Resolution: Fixed Assignee: Anton Kedin (was: Reuven Lax) > Update BeamSQL Walkthrough

[jira] [Closed] (BEAM-3191) [SQL] Implement Stateful Join

2018-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-3191. - Resolution: Won't Fix Fix Version/s: Not applicable Doesn't seem like stateful join is a good path

[jira] [Closed] (BEAM-3190) [SQL] Join Windowing Semantics

2018-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-3190. - Resolution: Fixed Fix Version/s: Not applicable Joins of unbounded inputs only support non-global

[jira] [Closed] (BEAM-3180) [Nexmark][SQL] Refactor NexmarkLauncher

2018-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-3180. - Resolution: Won't Fix Fix Version/s: Not applicable > [Nexmark][SQL] Refactor NexmarkLauncher >

[jira] [Closed] (BEAM-3176) BeamSqlCli: support DROP clause

2018-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-3176. - Resolution: Fixed Fix Version/s: Not applicable This is done > BeamSqlCli: support DROP clause >

[jira] [Closed] (BEAM-3175) BeamSqlCli: support SELECT CLAUSE

2018-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-3175. - Resolution: Fixed Fix Version/s: Not applicable This is done > BeamSqlCli: support SELECT CLAUSE

[jira] [Closed] (BEAM-2998) add IT test for SQL

2018-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-2998. - Resolution: Fixed Assignee: Anton Kedin Fix Version/s: Not applicable Integration tests

[jira] [Closed] (BEAM-4173) [SQL] Refactor BeamSql, BeamSqlCli, BeamSqlEnv

2018-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-4173. - Resolution: Fixed Assignee: Anton Kedin Fix Version/s: Not applicable Deleted BeamSql

[jira] [Commented] (BEAM-4174) [SQL] Add DDL Support for MockedBoundedTable

2018-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516347#comment-16516347 ] Anton Kedin commented on BEAM-4174: --- There's a TestTableProvider which supports in-memory

[jira] [Closed] (BEAM-4174) [SQL] Add DDL Support for MockedBoundedTable

2018-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-4174. - Resolution: Fixed Assignee: Anton Kedin Fix Version/s: Not applicable > [SQL] Add DDL

[jira] [Closed] (BEAM-3773) [SQL] Investigate JDBC interface for Beam SQL

2018-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-3773. - Resolution: Fixed Fix Version/s: Not applicable JDBC Driver Implemented on top of Avatica > [SQL]

[jira] [Closed] (BEAM-3983) BigQuery writes from pure SQL

2018-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-3983. - Resolution: Fixed Fix Version/s: Not applicable > BigQuery writes from pure SQL >

[jira] [Updated] (BEAM-4580) [SQL] Package self-contained REPL

2018-06-18 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-4580: -- Description: Create a build target to package everything needed to launch a command-line tool. All

[jira] [Created] (BEAM-4580) [SQL] Package self-contained REPL

2018-06-18 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4580: - Summary: [SQL] Package self-contained REPL Key: BEAM-4580 URL: https://issues.apache.org/jira/browse/BEAM-4580 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-4562) [SQL] Fix INSERT VALUES in JdbcDriver

2018-06-14 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4562: - Summary: [SQL] Fix INSERT VALUES in JdbcDriver Key: BEAM-4562 URL: https://issues.apache.org/jira/browse/BEAM-4562 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-4516) [SQL] Allow casting to complex types

2018-06-06 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-4516: -- Description: Currently CAST is parsed in the main Calcite's Parser.jj. When parsing the target type

[jira] [Created] (BEAM-4516) [SQL] Allow casting to complex types

2018-06-06 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4516: - Summary: [SQL] Allow casting to complex types Key: BEAM-4516 URL: https://issues.apache.org/jira/browse/BEAM-4516 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-4515) [SQL] Support Row construction with named fields

2018-06-06 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4515: - Summary: [SQL] Support Row construction with named fields Key: BEAM-4515 URL: https://issues.apache.org/jira/browse/BEAM-4515 Project: Beam Issue Type:

[jira] [Created] (BEAM-4514) [SQL] Enable flattening configuration

2018-06-06 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4514: - Summary: [SQL] Enable flattening configuration Key: BEAM-4514 URL: https://issues.apache.org/jira/browse/BEAM-4514 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-4509) Implement ROW_NUMBER

2018-06-06 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4509: - Summary: Implement ROW_NUMBER Key: BEAM-4509 URL: https://issues.apache.org/jira/browse/BEAM-4509 Project: Beam Issue Type: Improvement Components:

[jira] [Created] (BEAM-4387) [SQL] Implement date types comparisons

2018-05-22 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4387: - Summary: [SQL] Implement date types comparisons Key: BEAM-4387 URL: https://issues.apache.org/jira/browse/BEAM-4387 Project: Beam Issue Type: Improvement

[jira] [Closed] (BEAM-3785) [SQL] Add support for arrays

2018-05-22 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-3785. - Resolution: Fixed Fix Version/s: Not applicable > [SQL] Add support for arrays >

[jira] [Closed] (BEAM-3789) [SQL] Support Nested Rows

2018-05-22 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-3789. - Resolution: Fixed Fix Version/s: Not applicable > [SQL] Support Nested Rows >

[jira] [Closed] (BEAM-4162) Wire up PubsubIO+JSON to Beam SQL

2018-05-22 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-4162. - Resolution: Fixed Fix Version/s: Not applicable > Wire up PubsubIO+JSON to Beam SQL >

[jira] [Closed] (BEAM-4199) [SQL] Add a DLQ support for Pubsub tables

2018-05-22 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-4199. - Resolution: Fixed Fix Version/s: Not applicable > [SQL] Add a DLQ support for Pubsub tables >

[jira] [Closed] (BEAM-4386) [SQL] Implement string LIKE operator

2018-05-22 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-4386. - Resolution: Duplicate Fix Version/s: Not applicable > [SQL] Implement string LIKE operator >

[jira] [Created] (BEAM-4386) [SQL] Implement string LIKE operator

2018-05-22 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4386: - Summary: [SQL] Implement string LIKE operator Key: BEAM-4386 URL: https://issues.apache.org/jira/browse/BEAM-4386 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-4358) Create test artifacts

2018-05-17 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-4358: -- Description: Currently things like TestPipeline and TestPubsub implement TestRule and thus require the

[jira] [Updated] (BEAM-4358) Create test artifacts

2018-05-17 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-4358: -- Description: Currently things like TestPipeline and TestPubsub implement TestRule and thus require the

[jira] [Created] (BEAM-4358) Create test artifacts

2018-05-17 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4358: - Summary: Create test artifacts Key: BEAM-4358 URL: https://issues.apache.org/jira/browse/BEAM-4358 Project: Beam Issue Type: Improvement Components:

[jira] [Closed] (BEAM-4201) Integration Tests for PubsubIO

2018-05-15 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-4201. - Resolution: Fixed Fix Version/s: Not applicable > Integration Tests for PubsubIO >

[jira] [Assigned] (BEAM-4199) [SQL] Add a DLQ support for Pubsub tables

2018-05-15 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin reassigned BEAM-4199: - Assignee: Anton Kedin > [SQL] Add a DLQ support for Pubsub tables >

[jira] [Commented] (BEAM-4294) Join operator translator

2018-05-15 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16476114#comment-16476114 ] Anton Kedin commented on BEAM-4294: --- You're probably aware of the Joins library in Beam, but i'm going to

[jira] [Commented] (BEAM-4162) Wire up PubsubIO+JSON to Beam SQL

2018-05-10 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471491#comment-16471491 ] Anton Kedin commented on BEAM-4162: --- Main PR merged. Remaining work: integration test > Wire up

[jira] [Closed] (BEAM-4200) [SQL] Support Pubsub publish time as event timestamp

2018-05-10 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-4200. - Resolution: Fixed Assignee: Anton Kedin Fix Version/s: Not applicable > [SQL] Support

[jira] [Commented] (BEAM-4200) [SQL] Support Pubsub publish time as event timestamp

2018-05-10 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470894#comment-16470894 ] Anton Kedin commented on BEAM-4200: --- Updated the PR to use ProcessContext.timestamp() to populate the

[jira] [Closed] (BEAM-4196) [SQL] Support Complex Types in DDL

2018-05-10 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-4196. - Resolution: Fixed Fix Version/s: Not applicable > [SQL] Support Complex Types in DDL >

[jira] [Assigned] (BEAM-4201) Integration Tests for PubsubIO

2018-05-03 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin reassigned BEAM-4201: - Assignee: Anton Kedin > Integration Tests for PubsubIO > -- > >

[jira] [Assigned] (BEAM-4196) [SQL] Support Complex Types in DDL

2018-05-03 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin reassigned BEAM-4196: - Assignee: Anton Kedin > [SQL] Support Complex Types in DDL > -- >

[jira] [Created] (BEAM-4201) Integration Tests for PubsubIO

2018-04-30 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4201: - Summary: Integration Tests for PubsubIO Key: BEAM-4201 URL: https://issues.apache.org/jira/browse/BEAM-4201 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-4200) [SQL] Support Pubsub publish time as event timestamp

2018-04-30 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4200: - Summary: [SQL] Support Pubsub publish time as event timestamp Key: BEAM-4200 URL: https://issues.apache.org/jira/browse/BEAM-4200 Project: Beam Issue Type:

[jira] [Created] (BEAM-4199) [SQL] Add a DLQ support for Pubsub tables

2018-04-30 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4199: - Summary: [SQL] Add a DLQ support for Pubsub tables Key: BEAM-4199 URL: https://issues.apache.org/jira/browse/BEAM-4199 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-4198) Automatically infer JSON schema from Pubsub messages

2018-04-30 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-4198: -- Summary: Automatically infer JSON schema from Pubsub messages (was: Dynamically infer JSON schema from

[jira] [Created] (BEAM-4198) Dynamically infer JSON schema from Pubsub messages

2018-04-30 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4198: - Summary: Dynamically infer JSON schema from Pubsub messages Key: BEAM-4198 URL: https://issues.apache.org/jira/browse/BEAM-4198 Project: Beam Issue Type:

[jira] [Created] (BEAM-4197) Add tests for PubsubIO.readXxx() -> Row

2018-04-30 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4197: - Summary: Add tests for PubsubIO.readXxx() -> Row Key: BEAM-4197 URL: https://issues.apache.org/jira/browse/BEAM-4197 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-4196) [SQL] Support Complex Types in DDL

2018-04-30 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4196: - Summary: [SQL] Support Complex Types in DDL Key: BEAM-4196 URL: https://issues.apache.org/jira/browse/BEAM-4196 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-4195) Support Pubsub emulator in Junit

2018-04-30 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4195: - Summary: Support Pubsub emulator in Junit Key: BEAM-4195 URL: https://issues.apache.org/jira/browse/BEAM-4195 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-4194) [SQL] Support LIMIT

2018-04-30 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4194: - Summary: [SQL] Support LIMIT Key: BEAM-4194 URL: https://issues.apache.org/jira/browse/BEAM-4194 Project: Beam Issue Type: New Feature Components:

[jira] [Updated] (BEAM-4193) [SQL] Support trigger definition in CLI

2018-04-30 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-4193: -- Description: We need to be able to define triggers for the sources in SQL CLI. Otherwise it is

[jira] [Created] (BEAM-4193) [SQL] Support trigger definition in CLI

2018-04-30 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4193: - Summary: [SQL] Support trigger definition in CLI Key: BEAM-4193 URL: https://issues.apache.org/jira/browse/BEAM-4193 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-4183) [SQL] Document supported DDL

2018-04-27 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4183: - Summary: [SQL] Document supported DDL Key: BEAM-4183 URL: https://issues.apache.org/jira/browse/BEAM-4183 Project: Beam Issue Type: New Feature

[jira] [Updated] (BEAM-4174) [SQL] Add DDL Support for MockedBoundedTable

2018-04-25 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-4174: -- Description: We have a MockedBoundedTable which is an in-memory implementation of BeamSqlTable. We

[jira] [Created] (BEAM-4174) [SQL] Add DDL Support for MockedBoundedTable

2018-04-25 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4174: - Summary: [SQL] Add DDL Support for MockedBoundedTable Key: BEAM-4174 URL: https://issues.apache.org/jira/browse/BEAM-4174 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-4173) [SQL] Refactor BeamSql, BeamSqlCli, BeamSqlEnv

2018-04-25 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4173: - Summary: [SQL] Refactor BeamSql, BeamSqlCli, BeamSqlEnv Key: BEAM-4173 URL: https://issues.apache.org/jira/browse/BEAM-4173 Project: Beam Issue Type: New Feature

[jira] [Closed] (BEAM-4160) Convert JSON objects to Rows

2018-04-25 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-4160. - Resolution: Fixed Fix Version/s: Not applicable > Convert JSON objects to Rows >

[jira] [Created] (BEAM-4168) [SQL] Create a "WordCount" example

2018-04-24 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4168: - Summary: [SQL] Create a "WordCount" example Key: BEAM-4168 URL: https://issues.apache.org/jira/browse/BEAM-4168 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-4167) Implement UNNEST

2018-04-24 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4167: - Summary: Implement UNNEST Key: BEAM-4167 URL: https://issues.apache.org/jira/browse/BEAM-4167 Project: Beam Issue Type: New Feature Components: dsl-sql

[jira] [Commented] (BEAM-3157) BeamSql transform should support other PCollection types

2018-04-24 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16450456#comment-16450456 ] Anton Kedin commented on BEAM-3157: --- Added example: [https://github.com/apache/beam/pull/5215] Jira for

[jira] [Created] (BEAM-4163) Fix SELECT * for Pojo queries

2018-04-23 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4163: - Summary: Fix SELECT * for Pojo queries Key: BEAM-4163 URL: https://issues.apache.org/jira/browse/BEAM-4163 Project: Beam Issue Type: Bug Components:

[jira] [Updated] (BEAM-4161) Nested Rows flattening doesn't work

2018-04-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-4161: -- Issue Type: Bug (was: New Feature) > Nested Rows flattening doesn't work >

[jira] [Updated] (BEAM-4162) Wire up PubsubIO+JSON to Beam SQL

2018-04-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-4162: -- Description: Read JSON messages from Pubsub, convert them to Rows (BEAM-4160), wire up to Beam SQL.  

[jira] [Created] (BEAM-4162) Wire up PubsubIO+JSON to Beam SQL

2018-04-23 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4162: - Summary: Wire up PubsubIO+JSON to Beam SQL Key: BEAM-4162 URL: https://issues.apache.org/jira/browse/BEAM-4162 Project: Beam Issue Type: New Feature

[jira] [Comment Edited] (BEAM-4160) Convert JSON objects to Rows

2018-04-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449058#comment-16449058 ] Anton Kedin edited comment on BEAM-4160 at 4/23/18 11:58 PM: - PR: 

[jira] [Updated] (BEAM-4161) Nested Rows flattening doesn't work

2018-04-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-4161: -- Description: Calcite flattens nested rows. It updates the field indices of the flattened row so the

[jira] [Commented] (BEAM-4160) Convert JSON objects to Rows

2018-04-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449058#comment-16449058 ] Anton Kedin commented on BEAM-4160: --- PR: [https://github.com/apache/beam/pull/5120 ] Caveat: Calcite has

[jira] [Updated] (BEAM-4160) Convert JSON objects to Rows

2018-04-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-4160: -- Description: Automate conversion of JSON objects to Rows to reduce overhead for querying JSON-based

[jira] [Created] (BEAM-4161) Nested Rows flattening doesn't work

2018-04-23 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4161: - Summary: Nested Rows flattening doesn't work Key: BEAM-4161 URL: https://issues.apache.org/jira/browse/BEAM-4161 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-4160) Convert JSON objects to Rows

2018-04-23 Thread Anton Kedin (JIRA)
Anton Kedin created BEAM-4160: - Summary: Convert JSON objects to Rows Key: BEAM-4160 URL: https://issues.apache.org/jira/browse/BEAM-4160 Project: Beam Issue Type: New Feature

[jira] [Updated] (BEAM-4076) Schema followups

2018-04-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-4076: -- Component/s: dsl-sql > Schema followups > > > Key: BEAM-4076 >

[jira] [Closed] (BEAM-3449) [SQL] Document joins

2018-04-23 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-3449. - Resolution: Fixed Fix Version/s: Not applicable Doc updated:

[jira] [Closed] (BEAM-3157) BeamSql transform should support other PCollection types

2018-04-13 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-3157. - Resolution: Fixed Fix Version/s: Not applicable > BeamSql transform should support other

[jira] [Commented] (BEAM-3157) BeamSql transform should support other PCollection types

2018-04-13 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437561#comment-16437561 ] Anton Kedin commented on BEAM-3157: --- PR is merged which allows Rows generation for POJOS:

[jira] [Closed] (BEAM-3360) [SQL] Do not assign triggers for HOP/TUMBLE

2018-04-13 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-3360. - Resolution: Fixed Fix Version/s: 2.4.0 fixed by https://github.com/apache/beam/pull/4546 > [SQL]

[jira] [Assigned] (BEAM-3773) [SQL] Investigate JDBC interface for Beam SQL

2018-04-13 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin reassigned BEAM-3773: - Assignee: Andrew Pilloud > [SQL] Investigate JDBC interface for Beam SQL >

[jira] [Commented] (BEAM-3773) [SQL] Investigate JDBC interface for Beam SQL

2018-04-13 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437547#comment-16437547 ] Anton Kedin commented on BEAM-3773: --- Raw Beam JDBC Prototype: 

[jira] [Updated] (BEAM-3547) [SQL] Nested Query Generates Incompatible Trigger

2018-04-13 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-3547: -- Fix Version/s: (was: Not applicable) 2.4.0 > [SQL] Nested Query Generates

[jira] [Closed] (BEAM-3547) [SQL] Nested Query Generates Incompatible Trigger

2018-04-13 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin closed BEAM-3547. - Resolution: Fixed Fix Version/s: Not applicable > [SQL] Nested Query Generates Incompatible Trigger

[jira] [Comment Edited] (BEAM-3785) [SQL] Add support for arrays

2018-03-13 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396561#comment-16396561 ] Anton Kedin edited comment on BEAM-3785 at 3/13/18 5:38 PM: to go:  - arrays

[jira] [Comment Edited] (BEAM-3785) [SQL] Add support for arrays

2018-03-12 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396561#comment-16396561 ] Anton Kedin edited comment on BEAM-3785 at 3/13/18 5:28 AM: to go:  - arrays

[jira] [Commented] (BEAM-3785) [SQL] Add support for arrays

2018-03-12 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396561#comment-16396561 ] Anton Kedin commented on BEAM-3785: --- to go:  - arrays of arrays  - test complex indexing  - DOT

[jira] [Commented] (BEAM-3785) [SQL] Add support for arrays

2018-03-12 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396555#comment-16396555 ] Anton Kedin commented on BEAM-3785: --- implemented arrays of rows > [SQL] Add support for arrays >

[jira] [Comment Edited] (BEAM-3417) Fix Calcite assertions

2018-03-12 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390732#comment-16390732 ] Anton Kedin edited comment on BEAM-3417 at 3/12/18 8:10 PM: *What fails?*

[jira] [Comment Edited] (BEAM-3417) Fix Calcite assertions

2018-03-07 Thread Anton Kedin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390732#comment-16390732 ] Anton Kedin edited comment on BEAM-3417 at 3/8/18 4:30 AM: --- *What fails?*

  1   2   3   >