[jira] [Work logged] (BEAM-4771) Update BeamSQL Walkthrough documentation to align with latest version
[ https://issues.apache.org/jira/browse/BEAM-4771?focusedWorklogId=124173=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-124173 ] ASF GitHub Bot logged work on BEAM-4771: Author: ASF GitHub Bot Created on: 17/Jul/18 18:50 Start Date: 17/Jul/18 18:50 Worklog Time Spent: 10m Work Description: asfgit closed pull request #495: [BEAM-4771]Rename RowType to Schema in SQL walkthrough URL: https://github.com/apache/beam-site/pull/495 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull request (from a fork), the diff is supplied below (as it won't show otherwise due to GitHub magic): diff --git a/src/documentation/dsls/sql/walkthrough.md b/src/documentation/dsls/sql/walkthrough.md index c9addefce..26f1ac190 100644 --- a/src/documentation/dsls/sql/walkthrough.md +++ b/src/documentation/dsls/sql/walkthrough.md @@ -27,13 +27,13 @@ This page illustrates the usage of Beam SQL with example code. Before applying a SQL query to a `PCollection`, the data in the collection must be in `Row` format. A `Row` represents a single, immutable record in a Beam SQL `PCollection`. The names and types of the fields/columns in the row are defined -by its associated [RowType]({{ site.baseurl }}/documentation/sdks/javadoc/{{ -site.release_latest }}/index.html?org/apache/beam/sdk/values/RowType.html). -For SQL queries, you should use the [RowSqlType.builder()]({{ site.baseurl +by its associated [Schema]({{ site.baseurl }}/documentation/sdks/javadoc/{{ +site.release_latest }}/index.html?org/apache/beam/sdk/schemas/Schema.html). +You can use the [Schema.builder()]({{ site.baseurl }}/documentation/sdks/javadoc/{{ site.release_latest -}}/index.html?org/apache/beam/sdk/extensions/sql/RowSqlType.html) to create -`RowTypes`, it allows creating schemas with all supported SQL types (see [Data -Types]({{ site.baseurl }}/documentation/dsls/sql/data-types) for more details on supported primitive data types). +}}/index.html?org/apache/beam/sdk/schemas/Schema.html) to create +`Schemas`. See [Data +Types]({{ site.baseurl }}/documentation/dsls/sql/data-types) for more details on supported primitive data types. A `PCollection` can be obtained multiple ways, for example: @@ -44,18 +44,18 @@ A `PCollection` can be obtained multiple ways, for example: ```java // Define the record type (i.e., schema). -RowType appType = -RowSqlType +Schema appSchema = +Schema .builder() - .withIntegerField("appId") - .withVarcharField("description") - .withTimestampField("rowtime") + .addInt32Field("appId") + .addStringField("description") + .addDateTimeField("rowtime") .build(); // Create a concrete row with that type. Row row = Row - .withRowType(appType) + .withSchema(appSchema) .addValues(1, "Some cool app", new Date()) .build(); @@ -65,11 +65,11 @@ A `PCollection` can be obtained multiple ways, for example: .in(p) .apply(Create .of(row) -.withCoder(appType.getRowCoder())); +.withCoder(appSchema.getRowCoder())); ``` - **From a `PCollection` of records of some other type** (i.e. `T` is not already a `Row`), by applying a `ParDo` that converts input records to `Row` format. -**Note:** you have to manually set the coder of the result by calling `setCoder(appType.getRowCoder())`: +**Note:** you have to manually set the coder of the result by calling `setCoder(appSchema.getRowCoder())`: ```java // An example POJO class. class AppPojo { @@ -90,11 +90,11 @@ A `PCollection` can be obtained multiple ways, for example: // Get the current POJO instance AppPojo pojo = c.element(); - // Create a Row with the appType schema + // Create a Row with the appSchema schema // and values from the current POJO Row appRow = Row - .withRowType(appType) + .withSchema(appSchema) .addValues( pojo.appId, pojo.description, @@ -105,7 +105,7 @@ A `PCollection` can be obtained multiple ways, for example: c.output(appRow); } })) - .setCoder(appType.getRowCoder()); + .setCoder(appSchema.getRowCoder()); ``` - **As an output of another `BeamSql` query**. Details in the next section. @@ -132,12 +132,13 @@ to either a single `PCollection` or a `PCollectionTuple` which holds multiple For example, you can join two `PCollections`: ```java // Create
[jira] [Work logged] (BEAM-4771) Update BeamSQL Walkthrough documentation to align with latest version
[ https://issues.apache.org/jira/browse/BEAM-4771?focusedWorklogId=124162=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-124162 ] ASF GitHub Bot logged work on BEAM-4771: Author: ASF GitHub Bot Created on: 17/Jul/18 18:21 Start Date: 17/Jul/18 18:21 Worklog Time Spent: 10m Work Description: melap commented on issue #495: [BEAM-4771]Rename RowType to Schema in SQL walkthrough URL: https://github.com/apache/beam-site/pull/495#issuecomment-405679647 @asfgit merge This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 124162) Time Spent: 1h 10m (was: 1h) > Update BeamSQL Walkthrough documentation to align with latest version > - > > Key: BEAM-4771 > URL: https://issues.apache.org/jira/browse/BEAM-4771 > Project: Beam > Issue Type: Bug > Components: examples-java, website >Affects Versions: 2.5.0 >Reporter: Akanksha Sharma >Assignee: Reuven Lax >Priority: Minor > Fix For: Not applicable > > Time Spent: 1h 10m > Remaining Estimate: 0h > > As I see, in 2.5 BeamSQL had been changed to work with Schema. > The sample code provided in > [https://beam.apache.org/documentation/dsls/sql/walkthrough/] does not > compile with Beam 2.5, and needs to be updated. > > Row.withRowType(appType) > > The above mentioned line needs to be adapted to use schema. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-4771) Update BeamSQL Walkthrough documentation to align with latest version
[ https://issues.apache.org/jira/browse/BEAM-4771?focusedWorklogId=124142=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-124142 ] ASF GitHub Bot logged work on BEAM-4771: Author: ASF GitHub Bot Created on: 17/Jul/18 17:09 Start Date: 17/Jul/18 17:09 Worklog Time Spent: 10m Work Description: asfgit commented on issue #495: [BEAM-4771]Rename RowType to Schema in SQL walkthrough URL: https://github.com/apache/beam-site/pull/495#issuecomment-405656570 Error: MergeBot encountered an unexpected error while processing this PR: 502 Server Error: Proxy Error for url: https://builds.apache.org/job/beam_PreCommit_Website_Merge/277/api/python?depth=1=building. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 124142) Time Spent: 1h (was: 50m) > Update BeamSQL Walkthrough documentation to align with latest version > - > > Key: BEAM-4771 > URL: https://issues.apache.org/jira/browse/BEAM-4771 > Project: Beam > Issue Type: Bug > Components: examples-java, website >Affects Versions: 2.5.0 >Reporter: Akanksha Sharma >Assignee: Reuven Lax >Priority: Minor > Fix For: Not applicable > > Time Spent: 1h > Remaining Estimate: 0h > > As I see, in 2.5 BeamSQL had been changed to work with Schema. > The sample code provided in > [https://beam.apache.org/documentation/dsls/sql/walkthrough/] does not > compile with Beam 2.5, and needs to be updated. > > Row.withRowType(appType) > > The above mentioned line needs to be adapted to use schema. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-4771) Update BeamSQL Walkthrough documentation to align with latest version
[ https://issues.apache.org/jira/browse/BEAM-4771?focusedWorklogId=124141=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-124141 ] ASF GitHub Bot logged work on BEAM-4771: Author: ASF GitHub Bot Created on: 17/Jul/18 17:09 Start Date: 17/Jul/18 17:09 Worklog Time Spent: 10m Work Description: asfgit commented on issue #495: [BEAM-4771]Rename RowType to Schema in SQL walkthrough URL: https://github.com/apache/beam-site/pull/495#issuecomment-405656566 MergeBot: Merge: PR 495 in state error with description Unexpected Error: 502 Server Error: Proxy Error for url: https://builds.apache.org/job/beam_PreCommit_Website_Merge/277/api/python?depth=1=building.. URL: http://mergebot-vm2.apache.org:8080/beam-website/495. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 124141) Time Spent: 50m (was: 40m) > Update BeamSQL Walkthrough documentation to align with latest version > - > > Key: BEAM-4771 > URL: https://issues.apache.org/jira/browse/BEAM-4771 > Project: Beam > Issue Type: Bug > Components: examples-java, website >Affects Versions: 2.5.0 >Reporter: Akanksha Sharma >Assignee: Reuven Lax >Priority: Minor > Fix For: Not applicable > > Time Spent: 50m > Remaining Estimate: 0h > > As I see, in 2.5 BeamSQL had been changed to work with Schema. > The sample code provided in > [https://beam.apache.org/documentation/dsls/sql/walkthrough/] does not > compile with Beam 2.5, and needs to be updated. > > Row.withRowType(appType) > > The above mentioned line needs to be adapted to use schema. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-4771) Update BeamSQL Walkthrough documentation to align with latest version
[ https://issues.apache.org/jira/browse/BEAM-4771?focusedWorklogId=124138=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-124138 ] ASF GitHub Bot logged work on BEAM-4771: Author: ASF GitHub Bot Created on: 17/Jul/18 16:53 Start Date: 17/Jul/18 16:53 Worklog Time Spent: 10m Work Description: melap commented on issue #495: [BEAM-4771]Rename RowType to Schema in SQL walkthrough URL: https://github.com/apache/beam-site/pull/495#issuecomment-405651774 @asfgit merge This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 124138) Time Spent: 40m (was: 0.5h) > Update BeamSQL Walkthrough documentation to align with latest version > - > > Key: BEAM-4771 > URL: https://issues.apache.org/jira/browse/BEAM-4771 > Project: Beam > Issue Type: Bug > Components: examples-java, website >Affects Versions: 2.5.0 >Reporter: Akanksha Sharma >Assignee: Reuven Lax >Priority: Minor > Fix For: Not applicable > > Time Spent: 40m > Remaining Estimate: 0h > > As I see, in 2.5 BeamSQL had been changed to work with Schema. > The sample code provided in > [https://beam.apache.org/documentation/dsls/sql/walkthrough/] does not > compile with Beam 2.5, and needs to be updated. > > Row.withRowType(appType) > > The above mentioned line needs to be adapted to use schema. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-4771) Update BeamSQL Walkthrough documentation to align with latest version
[ https://issues.apache.org/jira/browse/BEAM-4771?focusedWorklogId=124134=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-124134 ] ASF GitHub Bot logged work on BEAM-4771: Author: ASF GitHub Bot Created on: 17/Jul/18 16:47 Start Date: 17/Jul/18 16:47 Worklog Time Spent: 10m Work Description: akedin commented on issue #495: [BEAM-4771]Rename RowType to Schema in SQL walkthrough URL: https://github.com/apache/beam-site/pull/495#issuecomment-405650022 ping This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 124134) Time Spent: 0.5h (was: 20m) > Update BeamSQL Walkthrough documentation to align with latest version > - > > Key: BEAM-4771 > URL: https://issues.apache.org/jira/browse/BEAM-4771 > Project: Beam > Issue Type: Bug > Components: examples-java, website >Affects Versions: 2.5.0 >Reporter: Akanksha Sharma >Assignee: Reuven Lax >Priority: Minor > Fix For: Not applicable > > Time Spent: 0.5h > Remaining Estimate: 0h > > As I see, in 2.5 BeamSQL had been changed to work with Schema. > The sample code provided in > [https://beam.apache.org/documentation/dsls/sql/walkthrough/] does not > compile with Beam 2.5, and needs to be updated. > > Row.withRowType(appType) > > The above mentioned line needs to be adapted to use schema. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-4771) Update BeamSQL Walkthrough documentation to align with latest version
[ https://issues.apache.org/jira/browse/BEAM-4771?focusedWorklogId=123010=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-123010 ] ASF GitHub Bot logged work on BEAM-4771: Author: ASF GitHub Bot Created on: 13/Jul/18 19:31 Start Date: 13/Jul/18 19:31 Worklog Time Spent: 10m Work Description: akedin commented on issue #495: [BEAM-4771]Rename RowType to Schema in SQL walkthrough URL: https://github.com/apache/beam-site/pull/495#issuecomment-404931661 R: @apilloud @melap This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 123010) Time Spent: 20m (was: 10m) > Update BeamSQL Walkthrough documentation to align with latest version > - > > Key: BEAM-4771 > URL: https://issues.apache.org/jira/browse/BEAM-4771 > Project: Beam > Issue Type: Bug > Components: examples-java, website >Affects Versions: 2.5.0 >Reporter: Akanksha Sharma >Assignee: Reuven Lax >Priority: Minor > Fix For: Not applicable > > Time Spent: 20m > Remaining Estimate: 0h > > As I see, in 2.5 BeamSQL had been changed to work with Schema. > The sample code provided in > [https://beam.apache.org/documentation/dsls/sql/walkthrough/] does not > compile with Beam 2.5, and needs to be updated. > > Row.withRowType(appType) > > The above mentioned line needs to be adapted to use schema. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Work logged] (BEAM-4771) Update BeamSQL Walkthrough documentation to align with latest version
[ https://issues.apache.org/jira/browse/BEAM-4771?focusedWorklogId=123009=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-123009 ] ASF GitHub Bot logged work on BEAM-4771: Author: ASF GitHub Bot Created on: 13/Jul/18 19:28 Start Date: 13/Jul/18 19:28 Worklog Time Spent: 10m Work Description: akedin opened a new pull request #495: [BEAM-4771]Rename RowType to Schema in SQL walkthrough URL: https://github.com/apache/beam-site/pull/495 *Please* add a meaningful description for your change here. Once your pull request has been opened and assigned a number, please edit the URL below, replacing `PULL_REQUEST_NUMBER` with the number of your pull request. http://apache-beam-website-pull-requests.storage.googleapis.com/PULL_REQUEST_NUMBER/index.html Finally, it will help us expedite review of your Pull Request if you tag someone (e.g. @username) to look at it. This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking --- Worklog Id: (was: 123009) Time Spent: 10m Remaining Estimate: 0h > Update BeamSQL Walkthrough documentation to align with latest version > - > > Key: BEAM-4771 > URL: https://issues.apache.org/jira/browse/BEAM-4771 > Project: Beam > Issue Type: Bug > Components: examples-java, website >Affects Versions: 2.5.0 >Reporter: Akanksha Sharma >Assignee: Reuven Lax >Priority: Minor > Fix For: Not applicable > > Time Spent: 10m > Remaining Estimate: 0h > > As I see, in 2.5 BeamSQL had been changed to work with Schema. > The sample code provided in > [https://beam.apache.org/documentation/dsls/sql/walkthrough/] does not > compile with Beam 2.5, and needs to be updated. > > Row.withRowType(appType) > > The above mentioned line needs to be adapted to use schema. -- This message was sent by Atlassian JIRA (v7.6.3#76005)