[jira] [Work logged] (HIVE-26757) Add sfs+ofs support
[
https://issues.apache.org/jira/browse/HIVE-26757?focusedWorklogId=843146=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-843146
]
ASF GitHub Bot logged work on HIVE-26757:
-
Author: ASF GitHub Bot
Created on: 02/Feb/23 10:21
Start Date: 02/Feb/23 10:21
Worklog Time Spent: 10m
Work Description: kgyrtkirk merged PR #3779:
URL: https://github.com/apache/hive/pull/3779
Issue Time Tracking
---
Worklog Id: (was: 843146)
Time Spent: 2h (was: 1h 50m)
> Add sfs+ofs support
> ---
>
> Key: HIVE-26757
> URL: https://issues.apache.org/jira/browse/HIVE-26757
> Project: Hive
> Issue Type: Improvement
>Reporter: Michael Smith
>Assignee: Michael Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 2h
> Remaining Estimate: 0h
>
> [https://github.com/apache/hive/blob/ebb1e2fa9914bcccecad261d53338933b699ccb1/ql/src/java/org/apache/hadoop/hive/ql/io/SingleFileSystem.java#L80]
> shows SFS support for Ozone's o3fs protocol, but not the newer ofs protocol.
> Please add support for {{{}sfs+ofs{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-26757) Add sfs+ofs support
[
https://issues.apache.org/jira/browse/HIVE-26757?focusedWorklogId=842386=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-842386
]
ASF GitHub Bot logged work on HIVE-26757:
-
Author: ASF GitHub Bot
Created on: 30/Jan/23 21:40
Start Date: 30/Jan/23 21:40
Worklog Time Spent: 10m
Work Description: sonarcloud[bot] commented on PR #3779:
URL: https://github.com/apache/hive/pull/3779#issuecomment-1409386094
Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/dashboard?id=apache_hive=3779)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=BUG)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=BUG)
[0
Bugs](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=BUG)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=VULNERABILITY)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=VULNERABILITY)
[0
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=VULNERABILITY)
[](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3779=false=SECURITY_HOTSPOT)
[](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3779=false=SECURITY_HOTSPOT)
[0 Security
Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3779=false=SECURITY_HOTSPOT)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=CODE_SMELL)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=CODE_SMELL)
[0 Code
Smells](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=CODE_SMELL)
[](https://sonarcloud.io/component_measures?id=apache_hive=3779=coverage=list)
No Coverage information
[](https://sonarcloud.io/component_measures?id=apache_hive=3779=duplicated_lines_density=list)
No Duplication information
Issue Time Tracking
---
Worklog Id: (was: 842386)
Time Spent: 1h 50m (was: 1h 40m)
> Add sfs+ofs support
> ---
>
> Key: HIVE-26757
> URL: https://issues.apache.org/jira/browse/HIVE-26757
> Project: Hive
> Issue Type: Improvement
>Reporter: Michael Smith
>Assignee: Michael Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> [https://github.com/apache/hive/blob/ebb1e2fa9914bcccecad261d53338933b699ccb1/ql/src/java/org/apache/hadoop/hive/ql/io/SingleFileSystem.java#L80]
> shows SFS support for Ozone's o3fs protocol, but not the newer ofs protocol.
> Please add support for {{{}sfs+ofs{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-26757) Add sfs+ofs support
[
https://issues.apache.org/jira/browse/HIVE-26757?focusedWorklogId=842138=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-842138
]
ASF GitHub Bot logged work on HIVE-26757:
-
Author: ASF GitHub Bot
Created on: 29/Jan/23 16:45
Start Date: 29/Jan/23 16:45
Worklog Time Spent: 10m
Work Description: sonarcloud[bot] commented on PR #3779:
URL: https://github.com/apache/hive/pull/3779#issuecomment-1407712707
Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/dashboard?id=apache_hive=3779)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=BUG)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=BUG)
[0
Bugs](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=BUG)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=VULNERABILITY)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=VULNERABILITY)
[0
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=VULNERABILITY)
[](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3779=false=SECURITY_HOTSPOT)
[](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3779=false=SECURITY_HOTSPOT)
[0 Security
Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3779=false=SECURITY_HOTSPOT)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=CODE_SMELL)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=CODE_SMELL)
[0 Code
Smells](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=CODE_SMELL)
[](https://sonarcloud.io/component_measures?id=apache_hive=3779=coverage=list)
No Coverage information
[](https://sonarcloud.io/component_measures?id=apache_hive=3779=duplicated_lines_density=list)
No Duplication information
Issue Time Tracking
---
Worklog Id: (was: 842138)
Time Spent: 1h 40m (was: 1.5h)
> Add sfs+ofs support
> ---
>
> Key: HIVE-26757
> URL: https://issues.apache.org/jira/browse/HIVE-26757
> Project: Hive
> Issue Type: Improvement
>Reporter: Michael Smith
>Assignee: Michael Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> [https://github.com/apache/hive/blob/ebb1e2fa9914bcccecad261d53338933b699ccb1/ql/src/java/org/apache/hadoop/hive/ql/io/SingleFileSystem.java#L80]
> shows SFS support for Ozone's o3fs protocol, but not the newer ofs protocol.
> Please add support for {{{}sfs+ofs{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-26757) Add sfs+ofs support
[
https://issues.apache.org/jira/browse/HIVE-26757?focusedWorklogId=842135=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-842135
]
ASF GitHub Bot logged work on HIVE-26757:
-
Author: ASF GitHub Bot
Created on: 29/Jan/23 15:50
Start Date: 29/Jan/23 15:50
Worklog Time Spent: 10m
Work Description: abstractdog commented on PR #3779:
URL: https://github.com/apache/hive/pull/3779#issuecomment-1407699051
I don't know the implementation details of the original SingleFileSystem,
but the manner of addition looks convenient, so this patch also looks good to me
we haven't added tests for specific underlying filesystems so far, if manual
tests worked for ofs, this is good to go
Issue Time Tracking
---
Worklog Id: (was: 842135)
Time Spent: 1.5h (was: 1h 20m)
> Add sfs+ofs support
> ---
>
> Key: HIVE-26757
> URL: https://issues.apache.org/jira/browse/HIVE-26757
> Project: Hive
> Issue Type: Improvement
>Reporter: Michael Smith
>Assignee: Michael Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> [https://github.com/apache/hive/blob/ebb1e2fa9914bcccecad261d53338933b699ccb1/ql/src/java/org/apache/hadoop/hive/ql/io/SingleFileSystem.java#L80]
> shows SFS support for Ozone's o3fs protocol, but not the newer ofs protocol.
> Please add support for {{{}sfs+ofs{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-26757) Add sfs+ofs support
[
https://issues.apache.org/jira/browse/HIVE-26757?focusedWorklogId=842134=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-842134
]
ASF GitHub Bot logged work on HIVE-26757:
-
Author: ASF GitHub Bot
Created on: 29/Jan/23 15:44
Start Date: 29/Jan/23 15:44
Worklog Time Spent: 10m
Work Description: MikaelSmith opened a new pull request, #3779:
URL: https://github.com/apache/hive/pull/3779
Adds sfs+ofs support to mirror sfs+o3fs. ofs is a newer protocol by Ozone
that's meant to replace o3fs.
Issue Time Tracking
---
Worklog Id: (was: 842134)
Time Spent: 1h 20m (was: 1h 10m)
> Add sfs+ofs support
> ---
>
> Key: HIVE-26757
> URL: https://issues.apache.org/jira/browse/HIVE-26757
> Project: Hive
> Issue Type: Improvement
>Reporter: Michael Smith
>Assignee: Michael Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> [https://github.com/apache/hive/blob/ebb1e2fa9914bcccecad261d53338933b699ccb1/ql/src/java/org/apache/hadoop/hive/ql/io/SingleFileSystem.java#L80]
> shows SFS support for Ozone's o3fs protocol, but not the newer ofs protocol.
> Please add support for {{{}sfs+ofs{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-26757) Add sfs+ofs support
[
https://issues.apache.org/jira/browse/HIVE-26757?focusedWorklogId=841653=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-841653
]
ASF GitHub Bot logged work on HIVE-26757:
-
Author: ASF GitHub Bot
Created on: 26/Jan/23 00:20
Start Date: 26/Jan/23 00:20
Worklog Time Spent: 10m
Work Description: github-actions[bot] closed pull request #3779:
HIVE-26757: Add sfs+ofs support
URL: https://github.com/apache/hive/pull/3779
Issue Time Tracking
---
Worklog Id: (was: 841653)
Time Spent: 1h 10m (was: 1h)
> Add sfs+ofs support
> ---
>
> Key: HIVE-26757
> URL: https://issues.apache.org/jira/browse/HIVE-26757
> Project: Hive
> Issue Type: Improvement
>Reporter: Michael Smith
>Assignee: Michael Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> [https://github.com/apache/hive/blob/ebb1e2fa9914bcccecad261d53338933b699ccb1/ql/src/java/org/apache/hadoop/hive/ql/io/SingleFileSystem.java#L80]
> shows SFS support for Ozone's o3fs protocol, but not the newer ofs protocol.
> Please add support for {{{}sfs+ofs{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-26757) Add sfs+ofs support
[
https://issues.apache.org/jira/browse/HIVE-26757?focusedWorklogId=839785=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-839785
]
ASF GitHub Bot logged work on HIVE-26757:
-
Author: ASF GitHub Bot
Created on: 18/Jan/23 00:21
Start Date: 18/Jan/23 00:21
Worklog Time Spent: 10m
Work Description: github-actions[bot] commented on PR #3779:
URL: https://github.com/apache/hive/pull/3779#issuecomment-1386276682
This pull request has been automatically marked as stale because it has not
had recent activity. It will be closed if no further activity occurs.
Feel free to reach out on the d...@hive.apache.org list if the patch is in
need of reviews.
Issue Time Tracking
---
Worklog Id: (was: 839785)
Time Spent: 1h (was: 50m)
> Add sfs+ofs support
> ---
>
> Key: HIVE-26757
> URL: https://issues.apache.org/jira/browse/HIVE-26757
> Project: Hive
> Issue Type: Improvement
>Reporter: Michael Smith
>Assignee: Michael Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 1h
> Remaining Estimate: 0h
>
> [https://github.com/apache/hive/blob/ebb1e2fa9914bcccecad261d53338933b699ccb1/ql/src/java/org/apache/hadoop/hive/ql/io/SingleFileSystem.java#L80]
> shows SFS support for Ozone's o3fs protocol, but not the newer ofs protocol.
> Please add support for {{{}sfs+ofs{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-26757) Add sfs+ofs support
[
https://issues.apache.org/jira/browse/HIVE-26757?focusedWorklogId=827227=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-827227
]
ASF GitHub Bot logged work on HIVE-26757:
-
Author: ASF GitHub Bot
Created on: 18/Nov/22 17:16
Start Date: 18/Nov/22 17:16
Worklog Time Spent: 10m
Work Description: MikaelSmith commented on PR #3779:
URL: https://github.com/apache/hive/pull/3779#issuecomment-1320306311
Ok, that test with my jar built from source works with ofs now. Do you have
any suggestions for tests? I didn't really see any covering the other
filesystems.
Issue Time Tracking
---
Worklog Id: (was: 827227)
Time Spent: 50m (was: 40m)
> Add sfs+ofs support
> ---
>
> Key: HIVE-26757
> URL: https://issues.apache.org/jira/browse/HIVE-26757
> Project: Hive
> Issue Type: Improvement
>Reporter: Michael Smith
>Assignee: Michael Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 50m
> Remaining Estimate: 0h
>
> [https://github.com/apache/hive/blob/ebb1e2fa9914bcccecad261d53338933b699ccb1/ql/src/java/org/apache/hadoop/hive/ql/io/SingleFileSystem.java#L80]
> shows SFS support for Ozone's o3fs protocol, but not the newer ofs protocol.
> Please add support for {{{}sfs+ofs{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-26757) Add sfs+ofs support
[
https://issues.apache.org/jira/browse/HIVE-26757?focusedWorklogId=827064=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-827064
]
ASF GitHub Bot logged work on HIVE-26757:
-
Author: ASF GitHub Bot
Created on: 18/Nov/22 07:31
Start Date: 18/Nov/22 07:31
Worklog Time Spent: 10m
Work Description: kgyrtkirk commented on PR #3779:
URL: https://github.com/apache/hive/pull/3779#issuecomment-1319644188
looks enough to me; if it works via cmdline with something like
```
export ??=ql.jar
hadoop dfs -ls sfs+file:///etc/passwd
hadoop dfs -ls sfs+ofs://...
```
if that works then the problem will be on the impala side...
Issue Time Tracking
---
Worklog Id: (was: 827064)
Time Spent: 40m (was: 0.5h)
> Add sfs+ofs support
> ---
>
> Key: HIVE-26757
> URL: https://issues.apache.org/jira/browse/HIVE-26757
> Project: Hive
> Issue Type: Improvement
>Reporter: Michael Smith
>Assignee: Michael Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> [https://github.com/apache/hive/blob/ebb1e2fa9914bcccecad261d53338933b699ccb1/ql/src/java/org/apache/hadoop/hive/ql/io/SingleFileSystem.java#L80]
> shows SFS support for Ozone's o3fs protocol, but not the newer ofs protocol.
> Please add support for {{{}sfs+ofs{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-26757) Add sfs+ofs support
[
https://issues.apache.org/jira/browse/HIVE-26757?focusedWorklogId=827030=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-827030
]
ASF GitHub Bot logged work on HIVE-26757:
-
Author: ASF GitHub Bot
Created on: 18/Nov/22 03:55
Start Date: 18/Nov/22 03:55
Worklog Time Spent: 10m
Work Description: sonarcloud[bot] commented on PR #3779:
URL: https://github.com/apache/hive/pull/3779#issuecomment-1319509687
Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/dashboard?id=apache_hive=3779)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=BUG)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=BUG)
[0
Bugs](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=BUG)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=VULNERABILITY)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=VULNERABILITY)
[0
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=VULNERABILITY)
[](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3779=false=SECURITY_HOTSPOT)
[](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3779=false=SECURITY_HOTSPOT)
[0 Security
Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive=3779=false=SECURITY_HOTSPOT)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=CODE_SMELL)
[](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=CODE_SMELL)
[0 Code
Smells](https://sonarcloud.io/project/issues?id=apache_hive=3779=false=CODE_SMELL)
[](https://sonarcloud.io/component_measures?id=apache_hive=3779=coverage=list)
No Coverage information
[](https://sonarcloud.io/component_measures?id=apache_hive=3779=duplicated_lines_density=list)
No Duplication information
Issue Time Tracking
---
Worklog Id: (was: 827030)
Time Spent: 0.5h (was: 20m)
> Add sfs+ofs support
> ---
>
> Key: HIVE-26757
> URL: https://issues.apache.org/jira/browse/HIVE-26757
> Project: Hive
> Issue Type: Improvement
>Reporter: Michael Smith
>Assignee: Michael Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> [https://github.com/apache/hive/blob/ebb1e2fa9914bcccecad261d53338933b699ccb1/ql/src/java/org/apache/hadoop/hive/ql/io/SingleFileSystem.java#L80]
> shows SFS support for Ozone's o3fs protocol, but not the newer ofs protocol.
> Please add support for {{{}sfs+ofs{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-26757) Add sfs+ofs support
[
https://issues.apache.org/jira/browse/HIVE-26757?focusedWorklogId=826965=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-826965
]
ASF GitHub Bot logged work on HIVE-26757:
-
Author: ASF GitHub Bot
Created on: 17/Nov/22 20:42
Start Date: 17/Nov/22 20:42
Worklog Time Spent: 10m
Work Description: MikaelSmith commented on PR #3779:
URL: https://github.com/apache/hive/pull/3779#issuecomment-1319177589
@kgyrtkirk this looks like all that was done to include o3fs support.
However I haven't been able to get it working, I still run into
`org.apache.hadoop.fs.UnsupportedFileSystemException No FileSystem for scheme
"sfs+ofs"` trying to use it in Impala. Any ideas on things I've missed?
Issue Time Tracking
---
Worklog Id: (was: 826965)
Time Spent: 20m (was: 10m)
> Add sfs+ofs support
> ---
>
> Key: HIVE-26757
> URL: https://issues.apache.org/jira/browse/HIVE-26757
> Project: Hive
> Issue Type: Improvement
>Reporter: Michael Smith
>Assignee: Michael Smith
>Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> [https://github.com/apache/hive/blob/ebb1e2fa9914bcccecad261d53338933b699ccb1/ql/src/java/org/apache/hadoop/hive/ql/io/SingleFileSystem.java#L80]
> shows SFS support for Ozone's o3fs protocol, but not the newer ofs protocol.
> Please add support for {{{}sfs+ofs{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-26757) Add sfs+ofs support
[
https://issues.apache.org/jira/browse/HIVE-26757?focusedWorklogId=826963=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-826963
]
ASF GitHub Bot logged work on HIVE-26757:
-
Author: ASF GitHub Bot
Created on: 17/Nov/22 20:40
Start Date: 17/Nov/22 20:40
Worklog Time Spent: 10m
Work Description: MikaelSmith opened a new pull request, #3779:
URL: https://github.com/apache/hive/pull/3779
Adds sfs+ofs support to mirror sfs+o3fs. ofs is a newer protocol by Ozone
that's meant to replace o3fs.
Issue Time Tracking
---
Worklog Id: (was: 826963)
Remaining Estimate: 0h
Time Spent: 10m
> Add sfs+ofs support
> ---
>
> Key: HIVE-26757
> URL: https://issues.apache.org/jira/browse/HIVE-26757
> Project: Hive
> Issue Type: Improvement
>Reporter: Michael Smith
>Assignee: Michael Smith
>Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> [https://github.com/apache/hive/blob/ebb1e2fa9914bcccecad261d53338933b699ccb1/ql/src/java/org/apache/hadoop/hive/ql/io/SingleFileSystem.java#L80]
> shows SFS support for Ozone's o3fs protocol, but not the newer ofs protocol.
> Please add support for {{{}sfs+ofs{}}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
