Re: [PR] [SPARK-48123][Core] Provide a constant table schema for querying structured logs [spark]

2024-05-04 Thread via GitHub
gengliangwang closed pull request #46375: [SPARK-48123][Core] Provide a constant table schema for querying structured logs URL: https://github.com/apache/spark/pull/46375 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] [SPARK-48123][Core] Provide a constant table schema for querying structured logs [spark]

2024-05-04 Thread via GitHub
gengliangwang commented on PR #46375: URL: https://github.com/apache/spark/pull/46375#issuecomment-2094060767 @dongjoon-hyun @ueshin Thanks for the review. Merging to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] [SPARK-48123][Core] Provide a constant table schema for querying structured logs [spark]

2024-05-03 Thread via GitHub
gengliangwang commented on code in PR #46375: URL: https://github.com/apache/spark/pull/46375#discussion_r1589812045 ## common/utils/src/main/scala/org/apache/spark/util/LogUtils.scala: ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] [SPARK-48123][Core] Provide a constant table schema for querying structured logs [spark]

2024-05-03 Thread via GitHub
gengliangwang commented on code in PR #46375: URL: https://github.com/apache/spark/pull/46375#discussion_r1589811109 ## common/utils/src/main/scala/org/apache/spark/util/LogUtils.scala: ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] [SPARK-48123][Core] Provide a constant table schema for querying structured logs [spark]

2024-05-03 Thread via GitHub
ueshin commented on code in PR #46375: URL: https://github.com/apache/spark/pull/46375#discussion_r1589805454 ## common/utils/src/main/scala/org/apache/spark/util/LogUtils.scala: ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

Re: [PR] [SPARK-48123][Core] Provide a constant table schema for querying structured logs [spark]

2024-05-03 Thread via GitHub
dongjoon-hyun commented on code in PR #46375: URL: https://github.com/apache/spark/pull/46375#discussion_r1589807167 ## sql/core/src/test/scala/org/apache/spark/sql/LogQuerySuite.scala: ## @@ -0,0 +1,86 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] [SPARK-48123][Core] Provide a constant table schema for querying structured logs [spark]

2024-05-03 Thread via GitHub
ueshin commented on code in PR #46375: URL: https://github.com/apache/spark/pull/46375#discussion_r1589805454 ## common/utils/src/main/scala/org/apache/spark/util/LogUtils.scala: ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

Re: [PR] [SPARK-48123][Core] Provide a constant table schema for querying structured logs [spark]

2024-05-03 Thread via GitHub
dongjoon-hyun commented on code in PR #46375: URL: https://github.com/apache/spark/pull/46375#discussion_r1589805435 ## common/utils/src/main/scala/org/apache/spark/util/LogUtils.scala: ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] [SPARK-48123][Core] Provide a constant table schema for querying structured logs [spark]

2024-05-03 Thread via GitHub
dongjoon-hyun commented on code in PR #46375: URL: https://github.com/apache/spark/pull/46375#discussion_r1589805250 ## common/utils/src/main/scala/org/apache/spark/util/LogUtils.scala: ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[PR] [SPARK-48123][Core] Provide a constant table schema for querying structured logs [spark]

2024-05-03 Thread via GitHub
gengliangwang opened a new pull request, #46375: URL: https://github.com/apache/spark/pull/46375 ### What changes were proposed in this pull request? Providing a table schema LOG_SCHEMA, so that users can load structured logs with the following code: ``` import