[spark] branch branch-3.0 updated: [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 6ed93c3 [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs 6ed93c3 is described below commit 6ed93c3e86c60323328b44cab45faa9ae3050dab Author: GuoPhilipse AuthorDate: Tue Jul 28 09:41:53 2020 +0900 [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs ### What changes were proposed in this pull request? update sql-ref docs, the following key words will be added in this PR. CASE/ELSE WHEN/THEN MAP KEYS TERMINATED BY NULL DEFINED AS LINES TERMINATED BY ESCAPED BY COLLECTION ITEMS TERMINATED BY PIVOT LATERAL VIEW OUTER? ROW FORMAT SERDE ROW FORMAT DELIMITED FIELDS TERMINATED BY IGNORE NULLS FIRST LAST ### Why are the changes needed? let more users know the sql key words usage ### Does this PR introduce _any_ user-facing change?     ### How was this patch tested? No Closes #29056 from GuoPhilipse/add-missing-keywords. Lead-authored-by: GuoPhilipse Co-authored-by: GuoPhilipse <46367746+guophili...@users.noreply.github.com> Signed-off-by: Takeshi Yamamuro (cherry picked from commit 8de43338be879f0cfeebca328dbbcfd1e5bd70da) Signed-off-by: Takeshi Yamamuro --- docs/_data/menu-sql.yaml | 6 + docs/sql-ref-syntax-ddl-create-table-hiveformat.md | 94 +++- docs/sql-ref-syntax-qry-select-case.md | 109 ++ docs/sql-ref-syntax-qry-select-clusterby.md| 3 + docs/sql-ref-syntax-qry-select-distribute-by.md| 3 + docs/sql-ref-syntax-qry-select-groupby.md | 27 + docs/sql-ref-syntax-qry-select-having.md | 3 + docs/sql-ref-syntax-qry-select-lateral-view.md | 125 + docs/sql-ref-syntax-qry-select-limit.md| 3 + docs/sql-ref-syntax-qry-select-orderby.md | 3 + docs/sql-ref-syntax-qry-select-pivot.md| 101 + docs/sql-ref-syntax-qry-select-sortby.md | 3 + docs/sql-ref-syntax-qry-select-where.md| 3 + docs/sql-ref-syntax-qry-select.md | 56 + docs/sql-ref-syntax-qry.md | 3 + docs/sql-ref-syntax.md | 3 + 16 files changed, 520 insertions(+), 25 deletions(-) diff --git a/docs/_data/menu-sql.yaml b/docs/_data/menu-sql.yaml index eea657e..22fae0c 100644 --- a/docs/_data/menu-sql.yaml +++ b/docs/_data/menu-sql.yaml @@ -187,6 +187,12 @@ url: sql-ref-syntax-qry-select-tvf.html - text: Window Function url: sql-ref-syntax-qry-select-window.html +- text: CASE Clause + url: sql-ref-syntax-qry-select-case.html +- text: LATERAL VIEW Clause + url: sql-ref-syntax-qry-select-lateral-view.html +- text: PIVOT Clause + url: sql-ref-syntax-qry-select-pivot.html - text: EXPLAIN url: sql-ref-syntax-qry-explain.html - text: Auxiliary Statements diff --git a/docs/sql-ref-syntax-ddl-create-table-hiveformat.md b/docs/sql-ref-syntax-ddl-create-table-hiveformat.md index 38f8856..7bf847d 100644 --- a/docs/sql-ref-syntax-ddl-create-table-hiveformat.md +++ b/docs/sql-ref-syntax-ddl-create-table-hiveformat.md @@ -36,6 +36,14 @@ CREATE [ EXTERNAL ] TABLE [ IF NOT EXISTS ] table_identifier [ LOCATION path ] [ TBLPROPERTIES ( key1=val1, key2=val2, ... ) ] [ AS select_statement ] + +row_format: +: SERDE serde_class [ WITH SERDEPROPERTIES (k1=v1, k2=v2, ... ) ] +| DELIMITED [ FIELDS TERMINATED BY fields_termiated_char [ ESCAPED BY escaped_char ] ] +[ COLLECTION ITEMS TERMINATED BY collection_items_termiated_char ] +[ MAP KEYS TERMINATED BY map_key_termiated_char ] +[ LINES TERMINATED BY row_termiated_char ] +[ NULL DEFINED AS null_char ] ``` Note that, the clauses between the columns definition clause and the AS SELECT clause can come in @@ -51,15 +59,55 @@ as any order. For example, you can write COMMENT table_comment after TBLPROPERTI * **EXTERNAL** -Table is defined using the path provided as LOCATION, does not use default loc
[spark] branch branch-3.0 updated: [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 6ed93c3 [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs 6ed93c3 is described below commit 6ed93c3e86c60323328b44cab45faa9ae3050dab Author: GuoPhilipse AuthorDate: Tue Jul 28 09:41:53 2020 +0900 [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs ### What changes were proposed in this pull request? update sql-ref docs, the following key words will be added in this PR. CASE/ELSE WHEN/THEN MAP KEYS TERMINATED BY NULL DEFINED AS LINES TERMINATED BY ESCAPED BY COLLECTION ITEMS TERMINATED BY PIVOT LATERAL VIEW OUTER? ROW FORMAT SERDE ROW FORMAT DELIMITED FIELDS TERMINATED BY IGNORE NULLS FIRST LAST ### Why are the changes needed? let more users know the sql key words usage ### Does this PR introduce _any_ user-facing change?     ### How was this patch tested? No Closes #29056 from GuoPhilipse/add-missing-keywords. Lead-authored-by: GuoPhilipse Co-authored-by: GuoPhilipse <46367746+guophili...@users.noreply.github.com> Signed-off-by: Takeshi Yamamuro (cherry picked from commit 8de43338be879f0cfeebca328dbbcfd1e5bd70da) Signed-off-by: Takeshi Yamamuro --- docs/_data/menu-sql.yaml | 6 + docs/sql-ref-syntax-ddl-create-table-hiveformat.md | 94 +++- docs/sql-ref-syntax-qry-select-case.md | 109 ++ docs/sql-ref-syntax-qry-select-clusterby.md| 3 + docs/sql-ref-syntax-qry-select-distribute-by.md| 3 + docs/sql-ref-syntax-qry-select-groupby.md | 27 + docs/sql-ref-syntax-qry-select-having.md | 3 + docs/sql-ref-syntax-qry-select-lateral-view.md | 125 + docs/sql-ref-syntax-qry-select-limit.md| 3 + docs/sql-ref-syntax-qry-select-orderby.md | 3 + docs/sql-ref-syntax-qry-select-pivot.md| 101 + docs/sql-ref-syntax-qry-select-sortby.md | 3 + docs/sql-ref-syntax-qry-select-where.md| 3 + docs/sql-ref-syntax-qry-select.md | 56 + docs/sql-ref-syntax-qry.md | 3 + docs/sql-ref-syntax.md | 3 + 16 files changed, 520 insertions(+), 25 deletions(-) diff --git a/docs/_data/menu-sql.yaml b/docs/_data/menu-sql.yaml index eea657e..22fae0c 100644 --- a/docs/_data/menu-sql.yaml +++ b/docs/_data/menu-sql.yaml @@ -187,6 +187,12 @@ url: sql-ref-syntax-qry-select-tvf.html - text: Window Function url: sql-ref-syntax-qry-select-window.html +- text: CASE Clause + url: sql-ref-syntax-qry-select-case.html +- text: LATERAL VIEW Clause + url: sql-ref-syntax-qry-select-lateral-view.html +- text: PIVOT Clause + url: sql-ref-syntax-qry-select-pivot.html - text: EXPLAIN url: sql-ref-syntax-qry-explain.html - text: Auxiliary Statements diff --git a/docs/sql-ref-syntax-ddl-create-table-hiveformat.md b/docs/sql-ref-syntax-ddl-create-table-hiveformat.md index 38f8856..7bf847d 100644 --- a/docs/sql-ref-syntax-ddl-create-table-hiveformat.md +++ b/docs/sql-ref-syntax-ddl-create-table-hiveformat.md @@ -36,6 +36,14 @@ CREATE [ EXTERNAL ] TABLE [ IF NOT EXISTS ] table_identifier [ LOCATION path ] [ TBLPROPERTIES ( key1=val1, key2=val2, ... ) ] [ AS select_statement ] + +row_format: +: SERDE serde_class [ WITH SERDEPROPERTIES (k1=v1, k2=v2, ... ) ] +| DELIMITED [ FIELDS TERMINATED BY fields_termiated_char [ ESCAPED BY escaped_char ] ] +[ COLLECTION ITEMS TERMINATED BY collection_items_termiated_char ] +[ MAP KEYS TERMINATED BY map_key_termiated_char ] +[ LINES TERMINATED BY row_termiated_char ] +[ NULL DEFINED AS null_char ] ``` Note that, the clauses between the columns definition clause and the AS SELECT clause can come in @@ -51,15 +59,55 @@ as any order. For example, you can write COMMENT table_comment after TBLPROPERTI * **EXTERNAL** -Table is defined using the path provided as LOCATION, does not use default loc
[spark] branch branch-3.0 updated: [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 6ed93c3 [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs 6ed93c3 is described below commit 6ed93c3e86c60323328b44cab45faa9ae3050dab Author: GuoPhilipse AuthorDate: Tue Jul 28 09:41:53 2020 +0900 [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs ### What changes were proposed in this pull request? update sql-ref docs, the following key words will be added in this PR. CASE/ELSE WHEN/THEN MAP KEYS TERMINATED BY NULL DEFINED AS LINES TERMINATED BY ESCAPED BY COLLECTION ITEMS TERMINATED BY PIVOT LATERAL VIEW OUTER? ROW FORMAT SERDE ROW FORMAT DELIMITED FIELDS TERMINATED BY IGNORE NULLS FIRST LAST ### Why are the changes needed? let more users know the sql key words usage ### Does this PR introduce _any_ user-facing change?     ### How was this patch tested? No Closes #29056 from GuoPhilipse/add-missing-keywords. Lead-authored-by: GuoPhilipse Co-authored-by: GuoPhilipse <46367746+guophili...@users.noreply.github.com> Signed-off-by: Takeshi Yamamuro (cherry picked from commit 8de43338be879f0cfeebca328dbbcfd1e5bd70da) Signed-off-by: Takeshi Yamamuro --- docs/_data/menu-sql.yaml | 6 + docs/sql-ref-syntax-ddl-create-table-hiveformat.md | 94 +++- docs/sql-ref-syntax-qry-select-case.md | 109 ++ docs/sql-ref-syntax-qry-select-clusterby.md| 3 + docs/sql-ref-syntax-qry-select-distribute-by.md| 3 + docs/sql-ref-syntax-qry-select-groupby.md | 27 + docs/sql-ref-syntax-qry-select-having.md | 3 + docs/sql-ref-syntax-qry-select-lateral-view.md | 125 + docs/sql-ref-syntax-qry-select-limit.md| 3 + docs/sql-ref-syntax-qry-select-orderby.md | 3 + docs/sql-ref-syntax-qry-select-pivot.md| 101 + docs/sql-ref-syntax-qry-select-sortby.md | 3 + docs/sql-ref-syntax-qry-select-where.md| 3 + docs/sql-ref-syntax-qry-select.md | 56 + docs/sql-ref-syntax-qry.md | 3 + docs/sql-ref-syntax.md | 3 + 16 files changed, 520 insertions(+), 25 deletions(-) diff --git a/docs/_data/menu-sql.yaml b/docs/_data/menu-sql.yaml index eea657e..22fae0c 100644 --- a/docs/_data/menu-sql.yaml +++ b/docs/_data/menu-sql.yaml @@ -187,6 +187,12 @@ url: sql-ref-syntax-qry-select-tvf.html - text: Window Function url: sql-ref-syntax-qry-select-window.html +- text: CASE Clause + url: sql-ref-syntax-qry-select-case.html +- text: LATERAL VIEW Clause + url: sql-ref-syntax-qry-select-lateral-view.html +- text: PIVOT Clause + url: sql-ref-syntax-qry-select-pivot.html - text: EXPLAIN url: sql-ref-syntax-qry-explain.html - text: Auxiliary Statements diff --git a/docs/sql-ref-syntax-ddl-create-table-hiveformat.md b/docs/sql-ref-syntax-ddl-create-table-hiveformat.md index 38f8856..7bf847d 100644 --- a/docs/sql-ref-syntax-ddl-create-table-hiveformat.md +++ b/docs/sql-ref-syntax-ddl-create-table-hiveformat.md @@ -36,6 +36,14 @@ CREATE [ EXTERNAL ] TABLE [ IF NOT EXISTS ] table_identifier [ LOCATION path ] [ TBLPROPERTIES ( key1=val1, key2=val2, ... ) ] [ AS select_statement ] + +row_format: +: SERDE serde_class [ WITH SERDEPROPERTIES (k1=v1, k2=v2, ... ) ] +| DELIMITED [ FIELDS TERMINATED BY fields_termiated_char [ ESCAPED BY escaped_char ] ] +[ COLLECTION ITEMS TERMINATED BY collection_items_termiated_char ] +[ MAP KEYS TERMINATED BY map_key_termiated_char ] +[ LINES TERMINATED BY row_termiated_char ] +[ NULL DEFINED AS null_char ] ``` Note that, the clauses between the columns definition clause and the AS SELECT clause can come in @@ -51,15 +59,55 @@ as any order. For example, you can write COMMENT table_comment after TBLPROPERTI * **EXTERNAL** -Table is defined using the path provided as LOCATION, does not use default loc
[spark] branch branch-3.0 updated: [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 6ed93c3 [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs 6ed93c3 is described below commit 6ed93c3e86c60323328b44cab45faa9ae3050dab Author: GuoPhilipse AuthorDate: Tue Jul 28 09:41:53 2020 +0900 [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs ### What changes were proposed in this pull request? update sql-ref docs, the following key words will be added in this PR. CASE/ELSE WHEN/THEN MAP KEYS TERMINATED BY NULL DEFINED AS LINES TERMINATED BY ESCAPED BY COLLECTION ITEMS TERMINATED BY PIVOT LATERAL VIEW OUTER? ROW FORMAT SERDE ROW FORMAT DELIMITED FIELDS TERMINATED BY IGNORE NULLS FIRST LAST ### Why are the changes needed? let more users know the sql key words usage ### Does this PR introduce _any_ user-facing change?     ### How was this patch tested? No Closes #29056 from GuoPhilipse/add-missing-keywords. Lead-authored-by: GuoPhilipse Co-authored-by: GuoPhilipse <46367746+guophili...@users.noreply.github.com> Signed-off-by: Takeshi Yamamuro (cherry picked from commit 8de43338be879f0cfeebca328dbbcfd1e5bd70da) Signed-off-by: Takeshi Yamamuro --- docs/_data/menu-sql.yaml | 6 + docs/sql-ref-syntax-ddl-create-table-hiveformat.md | 94 +++- docs/sql-ref-syntax-qry-select-case.md | 109 ++ docs/sql-ref-syntax-qry-select-clusterby.md| 3 + docs/sql-ref-syntax-qry-select-distribute-by.md| 3 + docs/sql-ref-syntax-qry-select-groupby.md | 27 + docs/sql-ref-syntax-qry-select-having.md | 3 + docs/sql-ref-syntax-qry-select-lateral-view.md | 125 + docs/sql-ref-syntax-qry-select-limit.md| 3 + docs/sql-ref-syntax-qry-select-orderby.md | 3 + docs/sql-ref-syntax-qry-select-pivot.md| 101 + docs/sql-ref-syntax-qry-select-sortby.md | 3 + docs/sql-ref-syntax-qry-select-where.md| 3 + docs/sql-ref-syntax-qry-select.md | 56 + docs/sql-ref-syntax-qry.md | 3 + docs/sql-ref-syntax.md | 3 + 16 files changed, 520 insertions(+), 25 deletions(-) diff --git a/docs/_data/menu-sql.yaml b/docs/_data/menu-sql.yaml index eea657e..22fae0c 100644 --- a/docs/_data/menu-sql.yaml +++ b/docs/_data/menu-sql.yaml @@ -187,6 +187,12 @@ url: sql-ref-syntax-qry-select-tvf.html - text: Window Function url: sql-ref-syntax-qry-select-window.html +- text: CASE Clause + url: sql-ref-syntax-qry-select-case.html +- text: LATERAL VIEW Clause + url: sql-ref-syntax-qry-select-lateral-view.html +- text: PIVOT Clause + url: sql-ref-syntax-qry-select-pivot.html - text: EXPLAIN url: sql-ref-syntax-qry-explain.html - text: Auxiliary Statements diff --git a/docs/sql-ref-syntax-ddl-create-table-hiveformat.md b/docs/sql-ref-syntax-ddl-create-table-hiveformat.md index 38f8856..7bf847d 100644 --- a/docs/sql-ref-syntax-ddl-create-table-hiveformat.md +++ b/docs/sql-ref-syntax-ddl-create-table-hiveformat.md @@ -36,6 +36,14 @@ CREATE [ EXTERNAL ] TABLE [ IF NOT EXISTS ] table_identifier [ LOCATION path ] [ TBLPROPERTIES ( key1=val1, key2=val2, ... ) ] [ AS select_statement ] + +row_format: +: SERDE serde_class [ WITH SERDEPROPERTIES (k1=v1, k2=v2, ... ) ] +| DELIMITED [ FIELDS TERMINATED BY fields_termiated_char [ ESCAPED BY escaped_char ] ] +[ COLLECTION ITEMS TERMINATED BY collection_items_termiated_char ] +[ MAP KEYS TERMINATED BY map_key_termiated_char ] +[ LINES TERMINATED BY row_termiated_char ] +[ NULL DEFINED AS null_char ] ``` Note that, the clauses between the columns definition clause and the AS SELECT clause can come in @@ -51,15 +59,55 @@ as any order. For example, you can write COMMENT table_comment after TBLPROPERTI * **EXTERNAL** -Table is defined using the path provided as LOCATION, does not use default loc
[spark] branch branch-3.0 updated: [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 6ed93c3 [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs 6ed93c3 is described below commit 6ed93c3e86c60323328b44cab45faa9ae3050dab Author: GuoPhilipse AuthorDate: Tue Jul 28 09:41:53 2020 +0900 [SPARK-31753][SQL][DOCS] Add missing keywords in the SQL docs ### What changes were proposed in this pull request? update sql-ref docs, the following key words will be added in this PR. CASE/ELSE WHEN/THEN MAP KEYS TERMINATED BY NULL DEFINED AS LINES TERMINATED BY ESCAPED BY COLLECTION ITEMS TERMINATED BY PIVOT LATERAL VIEW OUTER? ROW FORMAT SERDE ROW FORMAT DELIMITED FIELDS TERMINATED BY IGNORE NULLS FIRST LAST ### Why are the changes needed? let more users know the sql key words usage ### Does this PR introduce _any_ user-facing change?     ### How was this patch tested? No Closes #29056 from GuoPhilipse/add-missing-keywords. Lead-authored-by: GuoPhilipse Co-authored-by: GuoPhilipse <46367746+guophili...@users.noreply.github.com> Signed-off-by: Takeshi Yamamuro (cherry picked from commit 8de43338be879f0cfeebca328dbbcfd1e5bd70da) Signed-off-by: Takeshi Yamamuro --- docs/_data/menu-sql.yaml | 6 + docs/sql-ref-syntax-ddl-create-table-hiveformat.md | 94 +++- docs/sql-ref-syntax-qry-select-case.md | 109 ++ docs/sql-ref-syntax-qry-select-clusterby.md| 3 + docs/sql-ref-syntax-qry-select-distribute-by.md| 3 + docs/sql-ref-syntax-qry-select-groupby.md | 27 + docs/sql-ref-syntax-qry-select-having.md | 3 + docs/sql-ref-syntax-qry-select-lateral-view.md | 125 + docs/sql-ref-syntax-qry-select-limit.md| 3 + docs/sql-ref-syntax-qry-select-orderby.md | 3 + docs/sql-ref-syntax-qry-select-pivot.md| 101 + docs/sql-ref-syntax-qry-select-sortby.md | 3 + docs/sql-ref-syntax-qry-select-where.md| 3 + docs/sql-ref-syntax-qry-select.md | 56 + docs/sql-ref-syntax-qry.md | 3 + docs/sql-ref-syntax.md | 3 + 16 files changed, 520 insertions(+), 25 deletions(-) diff --git a/docs/_data/menu-sql.yaml b/docs/_data/menu-sql.yaml index eea657e..22fae0c 100644 --- a/docs/_data/menu-sql.yaml +++ b/docs/_data/menu-sql.yaml @@ -187,6 +187,12 @@ url: sql-ref-syntax-qry-select-tvf.html - text: Window Function url: sql-ref-syntax-qry-select-window.html +- text: CASE Clause + url: sql-ref-syntax-qry-select-case.html +- text: LATERAL VIEW Clause + url: sql-ref-syntax-qry-select-lateral-view.html +- text: PIVOT Clause + url: sql-ref-syntax-qry-select-pivot.html - text: EXPLAIN url: sql-ref-syntax-qry-explain.html - text: Auxiliary Statements diff --git a/docs/sql-ref-syntax-ddl-create-table-hiveformat.md b/docs/sql-ref-syntax-ddl-create-table-hiveformat.md index 38f8856..7bf847d 100644 --- a/docs/sql-ref-syntax-ddl-create-table-hiveformat.md +++ b/docs/sql-ref-syntax-ddl-create-table-hiveformat.md @@ -36,6 +36,14 @@ CREATE [ EXTERNAL ] TABLE [ IF NOT EXISTS ] table_identifier [ LOCATION path ] [ TBLPROPERTIES ( key1=val1, key2=val2, ... ) ] [ AS select_statement ] + +row_format: +: SERDE serde_class [ WITH SERDEPROPERTIES (k1=v1, k2=v2, ... ) ] +| DELIMITED [ FIELDS TERMINATED BY fields_termiated_char [ ESCAPED BY escaped_char ] ] +[ COLLECTION ITEMS TERMINATED BY collection_items_termiated_char ] +[ MAP KEYS TERMINATED BY map_key_termiated_char ] +[ LINES TERMINATED BY row_termiated_char ] +[ NULL DEFINED AS null_char ] ``` Note that, the clauses between the columns definition clause and the AS SELECT clause can come in @@ -51,15 +59,55 @@ as any order. For example, you can write COMMENT table_comment after TBLPROPERTI * **EXTERNAL** -Table is defined using the path provided as LOCATION, does not use default loc
