commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2024-03-13 22:17:46
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.1770 (New)
Package is "python-gcsfs"
Wed Mar 13 22:17:46 2024 rev:21 rq:1157040 version:2024.2.0
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2023-12-17 21:34:33.198442509 +0100
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.1770/python-gcsfs.changes
2024-03-13 22:18:38.880425058 +0100
@@ -1,0 +2,6 @@
+Fri Mar 8 16:17:17 UTC 2024 - Ben Greiner
+
+- Update to 2024.2.0
+ * doc for passing tokens (#603)
+
+---
Old:
gcsfs-2023.12.2-gh.tar.gz
New:
gcsfs-2024.2.0-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.5k8s6Z/_old 2024-03-13 22:18:39.912463025 +0100
+++ /var/tmp/diff_new_pack.5k8s6Z/_new 2024-03-13 22:18:39.912463025 +0100
@@ -1,7 +1,7 @@
#
# spec file for package python-gcsfs
#
-# Copyright (c) 2023 SUSE LLC
+# Copyright (c) 2024 SUSE LLC
#
# All modifications and additions to the file contributed by third parties
# remain the property of their copyright owners, unless otherwise agreed
@@ -17,7 +17,7 @@
Name: python-gcsfs
-Version:2023.12.2
+Version:2024.2.0
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
++ gcsfs-2023.12.2-gh.tar.gz -> gcsfs-2024.2.0-gh.tar.gz ++
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2023.12.2/docs/source/changelog.rst
new/gcsfs-2024.2.0/docs/source/changelog.rst
--- old/gcsfs-2023.12.2/docs/source/changelog.rst 2023-12-12
22:44:56.0 +0100
+++ new/gcsfs-2024.2.0/docs/source/changelog.rst2024-02-05
16:10:50.0 +0100
@@ -4,6 +4,11 @@
Note: in some releases, there are no changes, because we always guarantee
relasing in step
with fsspec.
+2024.2.0
+
+
+* doc for passing tokens (#603)
+
2023.12.2
-
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2023.12.2/docs/source/index.rst
new/gcsfs-2024.2.0/docs/source/index.rst
--- old/gcsfs-2023.12.2/docs/source/index.rst 2023-12-12 22:44:56.0
+0100
+++ new/gcsfs-2024.2.0/docs/source/index.rst2024-02-05 16:10:50.0
+0100
@@ -99,7 +99,7 @@
or container engine) and fetch the credentials automatically from the
metadata service.
-- you may supply a token generated by the
+- if ``token=dict(...)`` or ``token=``, you may supply a token
generated by the
gcloud_ utility; this is either a python dictionary, or the name of a
file
containing the JSON returned by logging in with the gcloud CLI tool
(e.g.,
``~/.config/gcloud/application_default_credentials.json`` or
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2023.12.2/gcsfs/_version.py
new/gcsfs-2024.2.0/gcsfs/_version.py
--- old/gcsfs-2023.12.2/gcsfs/_version.py 2023-12-12 22:44:56.0
+0100
+++ new/gcsfs-2024.2.0/gcsfs/_version.py2024-02-05 16:10:50.0
+0100
@@ -25,9 +25,9 @@
# setup.py/versioneer.py will grep for the variable names, so they must
# each be defined on a line of their own. _version.py will just call
# get_keywords().
-git_refnames = " (tag: 2023.12.2)"
-git_full = "8f78209ce2aa74b8eb7efb41e84e153aca87a261"
-git_date = "2023-12-12 16:44:56 -0500"
+git_refnames = " (tag: 2024.2.0)"
+git_full = "f526d96860c1422e7b4599b70b267607dae1af8a"
+git_date = "2024-02-05 10:10:50 -0500"
keywords = {"refnames": git_refnames, "full": git_full, "date": git_date}
return keywords
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2023.12.2/requirements.txt
new/gcsfs-2024.2.0/requirements.txt
--- old/gcsfs-2023.12.2/requirements.txt2023-12-12 22:44:56.0
+0100
+++ new/gcsfs-2024.2.0/requirements.txt 2024-02-05 16:10:50.0 +0100
@@ -1,6 +1,6 @@
aiohttp!=4.0.0a0, !=4.0.0a1
decorator>4.1.2
-fsspec==2023.12.1
+fsspec==2024.2.0
google-auth>=1.2
google-auth-oauthlib
google-cloud-storage
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2023-12-17 21:31:59
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.25432 (New)
Package is "python-gcsfs"
Sun Dec 17 21:31:59 2023 rev:20 rq:1133594 version:2023.12.2
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2023-11-15 21:10:06.579622405 +0100
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.25432/python-gcsfs.changes
2023-12-17 21:34:33.198442509 +0100
@@ -1,0 +2,7 @@
+Sat Dec 16 12:36:23 UTC 2023 - Dirk Müller
+
+- update to 2023.12.3post1:
+ * use same version when paginating list (#591)
+ * fix double asterisk glob test (#589)
+
+---
Old:
gcsfs-2023.10.0-gh.tar.gz
New:
gcsfs-2023.12.2-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.HeVaZc/_old 2023-12-17 21:34:33.610457478 +0100
+++ /var/tmp/diff_new_pack.HeVaZc/_new 2023-12-17 21:34:33.614457624 +0100
@@ -17,7 +17,7 @@
Name: python-gcsfs
-Version:2023.10.0
+Version:2023.12.2
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
++ gcsfs-2023.10.0-gh.tar.gz -> gcsfs-2023.12.2-gh.tar.gz ++
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2023.10.0/docs/source/changelog.rst
new/gcsfs-2023.12.2/docs/source/changelog.rst
--- old/gcsfs-2023.10.0/docs/source/changelog.rst 2023-10-23
15:19:45.0 +0200
+++ new/gcsfs-2023.12.2/docs/source/changelog.rst 2023-12-12
22:44:56.0 +0100
@@ -1,6 +1,25 @@
Changelog
=
+Note: in some releases, there are no changes, because we always guarantee
relasing in step
+with fsspec.
+
+2023.12.2
+-
+
+no changes
+
+2023.12.1
+-
+
+no changes
+
+2023.12.0
+-
+
+* use same version when paginating list (#591)
+* fix double asterisk glob test (#589)
+
2023.10.0
-
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2023.10.0/gcsfs/_version.py
new/gcsfs-2023.12.2/gcsfs/_version.py
--- old/gcsfs-2023.10.0/gcsfs/_version.py 2023-10-23 15:19:45.0
+0200
+++ new/gcsfs-2023.12.2/gcsfs/_version.py 2023-12-12 22:44:56.0
+0100
@@ -25,9 +25,9 @@
# setup.py/versioneer.py will grep for the variable names, so they must
# each be defined on a line of their own. _version.py will just call
# get_keywords().
-git_refnames = " (tag: 2023.10.0)"
-git_full = "ad684a5b3f25d46eeb5c3aebdbe647056a5e312b"
-git_date = "2023-10-23 09:19:45 -0400"
+git_refnames = " (tag: 2023.12.2)"
+git_full = "8f78209ce2aa74b8eb7efb41e84e153aca87a261"
+git_date = "2023-12-12 16:44:56 -0500"
keywords = {"refnames": git_refnames, "full": git_full, "date": git_date}
return keywords
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2023.10.0/gcsfs/core.py
new/gcsfs-2023.12.2/gcsfs/core.py
--- old/gcsfs-2023.10.0/gcsfs/core.py 2023-10-23 15:19:45.0 +0200
+++ new/gcsfs-2023.12.2/gcsfs/core.py 2023-12-12 22:44:56.0 +0100
@@ -599,6 +599,7 @@
bucket, _path, generation = self.split_path(path)
_path = "" if not _path else _path.rstrip("/") + "/"
prefix = f"{_path}{prefix}" or None
+versions = bool(versions or generation)
# Page size of 5000 is officially supported across GCS.
default_page_size = 5000
@@ -628,7 +629,6 @@
delimiter=delimiter,
prefix=prefix,
versions=versions,
-generation=generation,
page_size=default_page_size,
)
@@ -642,12 +642,11 @@
end_offset=None,
prefix=prefix,
versions=versions,
-generation=generation,
page_size=default_page_size,
)
async def _concurrent_list_objects_helper(
-self, items, bucket, delimiter, prefix, versions, generation, page_size
+self, items, bucket, delimiter, prefix, versions, page_size
):
"""
Lists objects using coroutines, using the object names from the
inventory
@@ -696,7 +695,6 @@
end_offset=end_offsets[i],
prefix=prefix,
versions=versions,
-generation=generation,
page_size=page_size,
)
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc Hello community, here is the log from the commit of package python-gcsfs for openSUSE:Factory checked in at 2023-10-12 23:44:09 Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old) and /work/SRC/openSUSE:Factory/.python-gcsfs.new.1807 (New) Package is "python-gcsfs" Thu Oct 12 23:44:09 2023 rev:18 rq:1117196 version:2023.9.2 Changes: --- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes 2023-07-07 15:48:47.828723799 +0200 +++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.1807/python-gcsfs.changes 2023-10-12 23:47:20.348258210 +0200 @@ -1,0 +2,13 @@ +Thu Oct 12 10:35:32 UTC 2023 - OndÅej Súkup + +- Update to 2023.9.2 + * bulk operations edge case + * inventory report based file listing (#573) + * pickle HttpError (#571) + * avoid warnings (#569) + * maxdepth in find() (#566) + * invalidate dircache (#564) + * standard metadata field names (#563) + * performance of building cache in find() (#561) + +--- Old: gcsfs-2023.6.0-gh.tar.gz New: gcsfs-2023.9.2-gh.tar.gz Other differences: -- ++ python-gcsfs.spec ++ --- /var/tmp/diff_new_pack.aqP7iC/_old 2023-10-12 23:47:21.336293985 +0200 +++ /var/tmp/diff_new_pack.aqP7iC/_new 2023-10-12 23:47:21.340294130 +0200 @@ -17,7 +17,7 @@ Name: python-gcsfs -Version:2023.6.0 +Version:2023.9.2 Release:0 Summary:Filesystem interface over GCS License:BSD-3-Clause ++ gcsfs-2023.6.0-gh.tar.gz -> gcsfs-2023.9.2-gh.tar.gz ++ 4802 lines of diff (skipped)
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2023-07-07 15:47:32
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.23466 (New)
Package is "python-gcsfs"
Fri Jul 7 15:47:32 2023 rev:17 rq:1097064 version:2023.6.0
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2023-06-07 23:07:03.855218712 +0200
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.23466/python-gcsfs.changes
2023-07-07 15:48:47.828723799 +0200
@@ -1,0 +2,8 @@
+Wed Jul 5 08:50:51 UTC 2023 - Ben Greiner
+
+- Update to 2023.6.0
+ * allow raw/session token for auth (#554)
+ * fix listings_expiry_time kwargs (#551)
+ * allow setting fixed metadata on put/pipe (#550)
+
+---
Old:
gcsfs-2023.5.0-gh.tar.gz
New:
gcsfs-2023.6.0-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.0Wsxnn/_old 2023-07-07 15:48:48.652728708 +0200
+++ /var/tmp/diff_new_pack.0Wsxnn/_new 2023-07-07 15:48:48.664728780 +0200
@@ -17,7 +17,7 @@
Name: python-gcsfs
-Version:2023.5.0
+Version:2023.6.0
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
@@ -25,7 +25,9 @@
# Use the GitHub tarball for test data
Source:
https://github.com/fsspec/gcsfs/archive/refs/tags/%{version}.tar.gz#/gcsfs-%{version}-gh.tar.gz
BuildRequires: %{python_module base >= 3.8}
+BuildRequires: %{python_module pip}
BuildRequires: %{python_module setuptools}
+BuildRequires: %{python_module wheel}
BuildRequires: fdupes
BuildRequires: python-rpm-macros
Requires: python-aiohttp
@@ -76,10 +78,10 @@
sed -i 's/--color=yes//' setup.cfg
%build
-%python_build
+%pyproject_wheel
%install
-%python_install
+%pyproject_install
%python_expand %fdupes %{buildroot}%{$python_sitelib}
%check
@@ -97,12 +99,14 @@
donttest="test_fuse"
# finds an existing path on the non-first multiflavor test runs"
donttest+=" or test_mkdir_with_path"
+# no http error (which is expected) without network
+donttest+=" or test_credentials_from_raw_token"
%pytest -rfEs -k "not ($donttest)"
%files %{python_files}
%doc README.rst
%license LICENSE.txt
-%{python_sitelib}/gcsfs-%{version}*-info
+%{python_sitelib}/gcsfs-%{version}.dist-info
%{python_sitelib}/gcsfs/
%exclude %{python_sitelib}/gcsfs/cli/
++ gcsfs-2023.5.0-gh.tar.gz -> gcsfs-2023.6.0-gh.tar.gz ++
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2023.5.0/docs/source/changelog.rst
new/gcsfs-2023.6.0/docs/source/changelog.rst
--- old/gcsfs-2023.5.0/docs/source/changelog.rst2023-05-07
21:21:05.0 +0200
+++ new/gcsfs-2023.6.0/docs/source/changelog.rst2023-06-12
15:54:07.0 +0200
@@ -1,6 +1,13 @@
Changelog
=
+2023.6.0
+
+
+* allow raw/session token for auth (#554)
+* fix listings_expiry_time kwargs (#551)
+* allow setting fixed metadata on put/pipe (#550)
+
2023.5.0
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2023.5.0/docs/source/index.rst
new/gcsfs-2023.6.0/docs/source/index.rst
--- old/gcsfs-2023.5.0/docs/source/index.rst2023-05-07 21:21:05.0
+0200
+++ new/gcsfs-2023.6.0/docs/source/index.rst2023-06-12 15:54:07.0
+0200
@@ -150,14 +150,11 @@
.. code-block:: python
-loop = ... # however you create your loop
+async def run_program():
+gcs = GCSFileSystem(asynchronous=True)
+print(await gcs._ls(""))
-async def run_program(loop):
-gcs = GCSFileSystem(..., asynchronous=True, loop=loop)
-await gcs.set_session()
-... # perform work
-
-asyncio.run(run_program(loop)) # or call from your async code
+asyncio.run(run_program()) # or call from your async code
Concurrent async operations are also used internally for bulk operations
such as ``pipe/cat``, ``get/put``, ``cp/mv/rm``. The async calls are
@@ -166,6 +163,10 @@
using async-style programming, you do not need to know about how this
works, but you might find the implementation interesting.
+For every synchronous function there is asynchronous one prefixed by ``_``, but
+the ``open`` operation does not support async operation. If you need it to open
+some file in async manner, it's better to asynchronously download it to
+temporary location and working with it from there.
Proxy
-
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore'
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2023-06-07 23:06:34
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.15902 (New)
Package is "python-gcsfs"
Wed Jun 7 23:06:34 2023 rev:16 rq:1091179 version:2023.5.0
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2023-03-27 18:15:38.366903719 +0200
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.15902/python-gcsfs.changes
2023-06-07 23:07:03.855218712 +0200
@@ -1,0 +2,7 @@
+Wed Jun 7 04:27:24 UTC 2023 - Steve Kowalik
+
+- Update to 2023.5.0:
+ * Allow emulator host without protocol (#548)
+ * Prevent upload retry from closing the file being sent (#540)
+
+---
Old:
gcsfs-2023.3.0-gh.tar.gz
New:
gcsfs-2023.5.0-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.a7AcXw/_old 2023-06-07 23:07:04.475222312 +0200
+++ /var/tmp/diff_new_pack.a7AcXw/_new 2023-06-07 23:07:04.479222336 +0200
@@ -17,11 +17,10 @@
Name: python-gcsfs
-Version:2023.3.0
+Version:2023.5.0
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
-Group: Development/Languages/Python
URL:https://github.com/fsspec/gcsfs
# Use the GitHub tarball for test data
Source:
https://github.com/fsspec/gcsfs/archive/refs/tags/%{version}.tar.gz#/gcsfs-%{version}-gh.tar.gz
++ gcsfs-2023.3.0-gh.tar.gz -> gcsfs-2023.5.0-gh.tar.gz ++
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2023.3.0/docs/source/changelog.rst
new/gcsfs-2023.5.0/docs/source/changelog.rst
--- old/gcsfs-2023.3.0/docs/source/changelog.rst2023-03-04
21:33:12.0 +0100
+++ new/gcsfs-2023.5.0/docs/source/changelog.rst2023-05-07
21:21:05.0 +0200
@@ -1,6 +1,17 @@
Changelog
=
+2023.5.0
+
+
+* Allow emulator host without protocol (#548)
+* Prevent upload retry from closing the file being sent (#540)
+
+2023.4.0
+
+
+No changes
+
2023.3.0
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2023.3.0/gcsfs/_version.py
new/gcsfs-2023.5.0/gcsfs/_version.py
--- old/gcsfs-2023.3.0/gcsfs/_version.py2023-03-04 21:33:12.0
+0100
+++ new/gcsfs-2023.5.0/gcsfs/_version.py2023-05-07 21:21:05.0
+0200
@@ -22,9 +22,9 @@
# setup.py/versioneer.py will grep for the variable names, so they must
# each be defined on a line of their own. _version.py will just call
# get_keywords().
-git_refnames = "2023.3.0"
-git_full = "dda390af941b57b6911261e5c76d01cc3ddccb10"
-git_date = "2023-03-04 15:33:12 -0500"
+git_refnames = "2023.5.0"
+git_full = "2354d6b0ae598a9107ca2f63af12ebc98d41de5f"
+git_date = "2023-05-07 15:21:05 -0400"
keywords = {"refnames": git_refnames, "full": git_full, "date": git_date}
return keywords
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2023.3.0/gcsfs/core.py
new/gcsfs-2023.5.0/gcsfs/core.py
--- old/gcsfs-2023.3.0/gcsfs/core.py2023-03-04 21:33:12.0 +0100
+++ new/gcsfs-2023.5.0/gcsfs/core.py2023-05-07 21:21:05.0 +0200
@@ -96,6 +96,14 @@
return (await r.read()).decode()
+class UnclosableBytesIO(io.BytesIO):
+"""Prevent closing BytesIO to avoid errors during retries."""
+
+def close(self):
+"""Reset stream position for next retry."""
+self.seek(0)
+
+
def _location():
"""
Resolves GCS HTTP location as http[s]://host
@@ -107,9 +115,13 @@
valid http location
"""
_emulator_location = os.getenv("STORAGE_EMULATOR_HOST", None)
-return (
-_emulator_location if _emulator_location else
"https://storage.googleapis.com;
-)
+if _emulator_location:
+if not any(
+_emulator_location.startswith(scheme) for scheme in ("http://;,
"https://;)
+):
+_emulator_location = f"http://{_emulator_location};
+return _emulator_location
+return "https://storage.googleapis.com;
def _chunks(lst, n):
@@ -402,7 +414,6 @@
data=data,
timeout=self.requests_timeout,
) as r:
-
status = r.status
headers = r.headers
info = r.request_info # for debug only
@@ -1564,7 +1575,7 @@
shortfall = (self.offset + l - 1) - end
if shortfall > 0:
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2023-03-27 18:15:37
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.31432 (New)
Package is "python-gcsfs"
Mon Mar 27 18:15:37 2023 rev:15 rq:1074479 version:2023.3.0
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2022-11-21 16:19:37.447863553 +0100
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.31432/python-gcsfs.changes
2023-03-27 18:15:38.366903719 +0200
@@ -1,0 +2,17 @@
+Fri Mar 24 15:48:08 UTC 2023 - Ben Greiner
+
+- Update to 2023.3.0
+ * Don't let find() mess up dircache (#531)
+ * Drop py3.7 (#529)
+ * Update docs (#528)
+ * Make times UTC (#527)
+ * Use BytesIO for large bodies (#525)
+ * Fix: Don't append generation when it is absent (#523)
+ * get/put/cp consistency tests (#521)
+- Release 2023.1.0
+ * Support create time (#516, 518)
+ * defer async session creation (#513, 514)
+ * support listing of file versions (#509)
+ * fix sign following versioned split protocol (#513)
+
+---
Old:
gcsfs-2022.11.0-gh.tar.gz
New:
gcsfs-2023.3.0-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.mMb08O/_old 2023-03-27 18:15:38.862906336 +0200
+++ /var/tmp/diff_new_pack.mMb08O/_new 2023-03-27 18:15:38.866906357 +0200
@@ -1,7 +1,7 @@
#
# spec file for package python-gcsfs
#
-# Copyright (c) 2022 SUSE LLC
+# Copyright (c) 2023 SUSE LLC
#
# All modifications and additions to the file contributed by third parties
# remain the property of their copyright owners, unless otherwise agreed
@@ -17,7 +17,7 @@
Name: python-gcsfs
-Version:2022.11.0
+Version:2023.3.0
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
@@ -25,7 +25,7 @@
URL:https://github.com/fsspec/gcsfs
# Use the GitHub tarball for test data
Source:
https://github.com/fsspec/gcsfs/archive/refs/tags/%{version}.tar.gz#/gcsfs-%{version}-gh.tar.gz
-BuildRequires: %{python_module base >= 3.7}
+BuildRequires: %{python_module base >= 3.8}
BuildRequires: %{python_module setuptools}
BuildRequires: fdupes
BuildRequires: python-rpm-macros
++ gcsfs-2022.11.0-gh.tar.gz -> gcsfs-2023.3.0-gh.tar.gz ++
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.11.0/.github/workflows/ci.yml
new/gcsfs-2023.3.0/.github/workflows/ci.yml
--- old/gcsfs-2022.11.0/.github/workflows/ci.yml2022-11-10
03:57:38.0 +0100
+++ new/gcsfs-2023.3.0/.github/workflows/ci.yml 2023-03-04 21:33:12.0
+0100
@@ -2,49 +2,53 @@
on: [push, pull_request, workflow_dispatch]
+defaults:
+ run:
+shell: bash -l -eo pipefail {0}
+
jobs:
test:
name: Python ${{ matrix.python-version }}
runs-on: ubuntu-latest
+timeout-minutes: 10
strategy:
fail-fast: false
matrix:
-python-version: ["3.7", "3.8", "3.9"]
+python-version: ["3.8", "3.9", "3.10", "3.11"]
steps:
- name: Checkout source
-uses: actions/checkout@v2
+uses: actions/checkout@v3
- name: Setup Conda Environment
-uses: conda-incubator/setup-miniconda@v2
+uses: mamba-org/provision-with-micromamba@main
with:
- auto-update-conda: true
- miniconda-version: latest
- activate-environment: test
- python-version: ${{ matrix.python-version }}
+ cache-downloads: true
+ environment-file: environment_gcsfs.yaml
+ environment-name: gcsfs_test
+ extra-specs: |
+python=${{ matrix.python-version }}
- - name: Install dependencies
-shell: bash -l {0}
+ - name: Conda info
run: |
- conda install -c conda-forge pytest ujson requests decorator
google-auth aiohttp google-auth-oauthlib google-cloud-core google-api-core
google-api-python-client -y
- pip install git+https://github.com/fsspec/filesystem_spec --no-deps
conda list
conda --version
- - name: Install
-shell: bash -l {0}
-run: pip install .[crc]
+ - name: Install libfuse
+run: (sudo apt-get install -y fuse || echo "Error installing fuse.")
- - name: Run Tests
-shell: bash -l {0}
+ - name: Run tests
run: |
-export
GOOGLE_APPLICATION_CREDENTIALS=$(pwd)/gcsfs/tests/fake-secret.json
-py.test -vv gcsfs
+ export
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2022-11-21 16:19:36
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.1597 (New)
Package is "python-gcsfs"
Mon Nov 21 16:19:36 2022 rev:14 rq:1036853 version:2022.11.0
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2022-11-01 13:43:36.220226583 +0100
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.1597/python-gcsfs.changes
2022-11-21 16:19:37.447863553 +0100
@@ -1,0 +2,6 @@
+Sat Nov 19 14:45:02 UTC 2022 - Ben Greiner
+
+- Update to 2022.11.0
+ * implement object versioning (#504)
+
+---
Old:
gcsfs-2022.10.0-gh.tar.gz
New:
gcsfs-2022.11.0-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.jrVLp1/_old 2022-11-21 16:19:38.263867744 +0100
+++ /var/tmp/diff_new_pack.jrVLp1/_new 2022-11-21 16:19:38.271867785 +0100
@@ -17,7 +17,7 @@
Name: python-gcsfs
-Version:2022.10.0
+Version:2022.11.0
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
++ gcsfs-2022.10.0-gh.tar.gz -> gcsfs-2022.11.0-gh.tar.gz ++
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.10.0/docs/source/changelog.rst
new/gcsfs-2022.11.0/docs/source/changelog.rst
--- old/gcsfs-2022.10.0/docs/source/changelog.rst 2022-10-19
18:54:45.0 +0200
+++ new/gcsfs-2022.11.0/docs/source/changelog.rst 2022-11-10
03:57:38.0 +0100
@@ -1,6 +1,11 @@
Changelog
=
+2022.11.0
+-
+
+* implement object versioning (#504)
+
2022.10.0
-
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.10.0/gcsfs/_version.py
new/gcsfs-2022.11.0/gcsfs/_version.py
--- old/gcsfs-2022.10.0/gcsfs/_version.py 2022-10-19 18:54:45.0
+0200
+++ new/gcsfs-2022.11.0/gcsfs/_version.py 2022-11-10 03:57:38.0
+0100
@@ -22,9 +22,9 @@
# setup.py/versioneer.py will grep for the variable names, so they must
# each be defined on a line of their own. _version.py will just call
# get_keywords().
-git_refnames = "2022.10.0"
-git_full = "1d34b2ef2305dd4f328e3cac527a437582226e12"
-git_date = "2022-10-19 12:54:45 -0400"
+git_refnames = "2022.11.0"
+git_full = "805d3fd359ba5189964f8804459653ce1eb4d38c"
+git_date = "2022-11-09 21:57:38 -0500"
keywords = {"refnames": git_refnames, "full": git_full, "date": git_date}
return keywords
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.10.0/gcsfs/core.py
new/gcsfs-2022.11.0/gcsfs/core.py
--- old/gcsfs-2022.10.0/gcsfs/core.py 2022-10-19 18:54:45.0 +0200
+++ new/gcsfs-2022.11.0/gcsfs/core.py 2022-11-10 03:57:38.0 +0100
@@ -23,6 +23,7 @@
from .credentials import GoogleCredentials
from . import __version__ as version
from urllib.parse import quote as quote_urllib
+from urllib.parse import parse_qs, urlsplit
logger = logging.getLogger("gcsfs")
@@ -85,7 +86,8 @@
Used by petastorm, do not remove.
"""
-return "/".join(GCSFileSystem.split_path(path))
+bucket, name, _ = GCSFileSystem._split_path(path)
+return "/".join((bucket, name))
async def _req_to_text(r):
@@ -119,6 +121,22 @@
yield lst[i : i + n]
+def _coalesce_generation(*args):
+"""Helper to coalesce a list of object generations down to one."""
+generations = set(args)
+if None in generations:
+generations.remove(None)
+if len(generations) > 1:
+raise ValueError(
+"Cannot coalesce generations where more than one are defined,"
+" {}".format(generations)
+)
+elif len(generations) == 0:
+return None
+else:
+return generations.pop()
+
+
class GCSFileSystem(AsyncFileSystem):
r"""
Connect to Google Cloud Storage.
@@ -221,6 +239,9 @@
Default location where buckets are created, like 'US' or
'EUROPE-WEST3'.
You can find a list of all available locations here:
https://cloud.google.com/storage/docs/locations#available-locations
+version_aware: bool
+Whether to support object versioning. If enabled this will require the
+user to have the necessary permissions for dealing with versioned
objects.
"""
scopes = {"read_only", "read_write", "full_control"}
@@ -247,6 +268,7 @@
timeout=None,
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2022-11-01 13:43:28
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.2275 (New)
Package is "python-gcsfs"
Tue Nov 1 13:43:28 2022 rev:13 rq:1032641 version:2022.10.0
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2022-10-17 14:57:28.806067398 +0200
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.2275/python-gcsfs.changes
2022-11-01 13:43:36.220226583 +0100
@@ -1,0 +2,6 @@
+Mon Oct 31 23:26:44 UTC 2022 - Matej Cepl
+
+- Update to 2022.10.0:
+ - bump fsspec to 2022.10.0
+
+---
Old:
gcsfs-2022.8.2-gh.tar.gz
New:
gcsfs-2022.10.0-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.1FA9NZ/_old 2022-11-01 13:43:36.684229051 +0100
+++ /var/tmp/diff_new_pack.1FA9NZ/_new 2022-11-01 13:43:36.688229073 +0100
@@ -17,7 +17,7 @@
Name: python-gcsfs
-Version:2022.8.2
+Version:2022.10.0
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
++ gcsfs-2022.8.2-gh.tar.gz -> gcsfs-2022.10.0-gh.tar.gz ++
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.8.2/.github/workflows/ci.yml
new/gcsfs-2022.10.0/.github/workflows/ci.yml
--- old/gcsfs-2022.8.2/.github/workflows/ci.yml 2022-09-01 03:12:31.0
+0200
+++ new/gcsfs-2022.10.0/.github/workflows/ci.yml2022-10-19
18:54:45.0 +0200
@@ -1,6 +1,6 @@
name: CI
-on: [push, pull_request]
+on: [push, pull_request, workflow_dispatch]
jobs:
test:
@@ -26,7 +26,7 @@
- name: Install dependencies
shell: bash -l {0}
run: |
- conda install -c conda-forge pytest ujson requests decorator
google-auth aiohttp google-auth-oauthlib flake8 black google-cloud-core
google-api-core google-api-python-client -y
+ conda install -c conda-forge pytest ujson requests decorator
google-auth aiohttp google-auth-oauthlib google-cloud-core google-api-core
google-api-python-client -y
pip install git+https://github.com/fsspec/filesystem_spec --no-deps
conda list
conda --version
@@ -41,8 +41,10 @@
export
GOOGLE_APPLICATION_CREDENTIALS=$(pwd)/gcsfs/tests/fake-secret.json
py.test -vv gcsfs
- - name: Run pre-commit hooks
-shell: bash -l {0}
-run: |
- pip install pre-commit
- pre-commit run --all-file
+ lint:
+name: lint
+runs-on: ubuntu-latest
+steps:
+- uses: actions/checkout@v2
+- uses: actions/setup-python@v2
+- uses: pre-commit/action@v2.0.0
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.8.2/docs/source/changelog.rst
new/gcsfs-2022.10.0/docs/source/changelog.rst
--- old/gcsfs-2022.8.2/docs/source/changelog.rst2022-09-01
03:12:31.0 +0200
+++ new/gcsfs-2022.10.0/docs/source/changelog.rst 2022-10-19
18:54:45.0 +0200
@@ -1,6 +1,11 @@
Changelog
=
+2022.10.0
+-
+
+* bump fsspec to 2022.10.0 (#503)
+
2022.8.1
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.8.2/gcsfs/_version.py
new/gcsfs-2022.10.0/gcsfs/_version.py
--- old/gcsfs-2022.8.2/gcsfs/_version.py2022-09-01 03:12:31.0
+0200
+++ new/gcsfs-2022.10.0/gcsfs/_version.py 2022-10-19 18:54:45.0
+0200
@@ -22,9 +22,9 @@
# setup.py/versioneer.py will grep for the variable names, so they must
# each be defined on a line of their own. _version.py will just call
# get_keywords().
-git_refnames = "2022.8.2"
-git_full = "7108ade1639af9616843fa906a3e7060bf95e37e"
-git_date = "2022-08-31 21:12:31 -0400"
+git_refnames = "2022.10.0"
+git_full = "1d34b2ef2305dd4f328e3cac527a437582226e12"
+git_date = "2022-10-19 12:54:45 -0400"
keywords = {"refnames": git_refnames, "full": git_full, "date": git_date}
return keywords
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.8.2/gcsfs/core.py
new/gcsfs-2022.10.0/gcsfs/core.py
--- old/gcsfs-2022.8.2/gcsfs/core.py2022-09-01 03:12:31.0 +0200
+++ new/gcsfs-2022.10.0/gcsfs/core.py 2022-10-19 18:54:45.0 +0200
@@ -22,6 +22,7 @@
from .checkers import get_consistency_checker
from .credentials import GoogleCredentials
from . import __version__ as version
+from
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2022-10-17 14:57:25
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.2275 (New)
Package is "python-gcsfs"
Mon Oct 17 14:57:25 2022 rev:12 rq:1009270 version:2022.8.2
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2022-07-04 11:32:50.764020334 +0200
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.2275/python-gcsfs.changes
2022-10-17 14:57:28.806067398 +0200
@@ -1,0 +2,6 @@
+Sun Oct 9 09:33:42 UTC 2022 - Ben Greiner
+
+- Update to 2022.8.2
+ * Try cloud auth by default (#479)
+
+---
Old:
gcsfs-2022.5.0-gh.tar.gz
New:
gcsfs-2022.8.2-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.QTaMbq/_old 2022-10-17 14:57:29.390068519 +0200
+++ /var/tmp/diff_new_pack.QTaMbq/_new 2022-10-17 14:57:29.394068527 +0200
@@ -16,10 +16,8 @@
#
-%{?!python_module:%define python_module() python3-%{**}}
-%define skip_python2 1
Name: python-gcsfs
-Version:2022.5.0
+Version:2022.8.2
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
@@ -27,6 +25,7 @@
URL:https://github.com/fsspec/gcsfs
# Use the GitHub tarball for test data
Source:
https://github.com/fsspec/gcsfs/archive/refs/tags/%{version}.tar.gz#/gcsfs-%{version}-gh.tar.gz
+BuildRequires: %{python_module base >= 3.7}
BuildRequires: %{python_module setuptools}
BuildRequires: fdupes
BuildRequires: python-rpm-macros
++ gcsfs-2022.5.0-gh.tar.gz -> gcsfs-2022.8.2-gh.tar.gz ++
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.5.0/.github/workflows/ci.yml
new/gcsfs-2022.8.2/.github/workflows/ci.yml
--- old/gcsfs-2022.5.0/.github/workflows/ci.yml 2022-05-20 16:37:06.0
+0200
+++ new/gcsfs-2022.8.2/.github/workflows/ci.yml 2022-09-01 03:12:31.0
+0200
@@ -26,7 +26,7 @@
- name: Install dependencies
shell: bash -l {0}
run: |
- conda install -c conda-forge pytest ujson requests decorator
google-auth vcrpy aiohttp google-auth-oauthlib flake8 black google-cloud-core
google-api-core google-api-python-client -y
+ conda install -c conda-forge pytest ujson requests decorator
google-auth aiohttp google-auth-oauthlib flake8 black google-cloud-core
google-api-core google-api-python-client -y
pip install git+https://github.com/fsspec/filesystem_spec --no-deps
conda list
conda --version
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.5.0/docs/source/changelog.rst
new/gcsfs-2022.8.2/docs/source/changelog.rst
--- old/gcsfs-2022.5.0/docs/source/changelog.rst2022-05-20
16:37:06.0 +0200
+++ new/gcsfs-2022.8.2/docs/source/changelog.rst2022-09-01
03:12:31.0 +0200
@@ -1,6 +1,16 @@
Changelog
=
+2022.8.1
+
+
+* don't install prerelease aiohttp (#490)
+
+2022.7.1
+
+
+* Try cloud auth by default (#479)
+
2022.5.0
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.5.0/docs/source/index.rst
new/gcsfs-2022.8.2/docs/source/index.rst
--- old/gcsfs-2022.5.0/docs/source/index.rst2022-05-20 16:37:06.0
+0200
+++ new/gcsfs-2022.8.2/docs/source/index.rst2022-09-01 03:12:31.0
+0200
@@ -163,6 +163,22 @@
works, but you might find the implementation interesting.
+Proxy
+-
+
+``gcsfs`` uses ``aiohttp`` for calls to the storage api, which by default
+ignores ``HTTP_PROXY/HTTPS_PROXY`` environment variables. To read
+proxy settings from the environment provide ``session_kwargs`` as follows:
+
+.. code-block:: python
+
+ fs = GCSFileSystem(project='my-google-project',
session_kwargs={'trust_env': True})
+
+For further reference check `aiohttp proxy support`_.
+
+.. _aiohttp proxy support:
https://docs.aiohttp.org/en/stable/client_advanced.html?highlight=proxy#proxy-support
+
+
Contents
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.5.0/gcsfs/_version.py
new/gcsfs-2022.8.2/gcsfs/_version.py
--- old/gcsfs-2022.5.0/gcsfs/_version.py2022-05-20 16:37:06.0
+0200
+++ new/gcsfs-2022.8.2/gcsfs/_version.py2022-09-01 03:12:31.0
+0200
@@ -22,9 +22,9 @@
# setup.py/versioneer.py will grep for the variable names, so they must
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2022-07-04 11:32:45
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.1548 (New)
Package is "python-gcsfs"
Mon Jul 4 11:32:45 2022 rev:11 rq:986479 version:2022.5.0
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2022-04-28 23:07:49.636678292 +0200
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.1548/python-gcsfs.changes
2022-07-04 11:32:50.764020334 +0200
@@ -1,0 +2,12 @@
+Sat Jul 2 18:49:11 UTC 2022 - Ben Greiner
+
+- Enable the test suite with fake-gcs-server running
+
+---
+Wed Jun 29 10:18:06 UTC 2022 - Ben Greiner
+
+- Update to 2022.5.0
+ * invalidate listings cache for simple put/pipe (#474)
+ * conform _mkdir and _cat_file to upstream (#471)
+
+---
Old:
gcsfs-2022.3.0-gh.tar.gz
New:
gcsfs-2022.5.0-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.D5WsI7/_old 2022-07-04 11:32:51.688021822 +0200
+++ /var/tmp/diff_new_pack.D5WsI7/_new 2022-07-04 11:32:51.696021835 +0200
@@ -17,11 +17,9 @@
%{?!python_module:%define python_module() python3-%{**}}
-# the test suite moved to a docker simulator which we cannot run inside an obs
environment
-%bcond_with fulltest
%define skip_python2 1
Name: python-gcsfs
-Version:2022.3.0
+Version:2022.5.0
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
@@ -44,9 +42,7 @@
Suggests: python-crcmod
BuildArch: noarch
# SECTION test requirements
-# always import in order to detect dependency breakages at build time
BuildRequires: %{python_module aiohttp}
-BuildRequires: %{python_module black}
BuildRequires: %{python_module click}
BuildRequires: %{python_module decorator > 4.1.2}
BuildRequires: %{python_module fsspec == %{version}}
@@ -56,8 +52,10 @@
BuildRequires: %{python_module google-auth >= 1.2}
BuildRequires: %{python_module google-auth-oauthlib}
BuildRequires: %{python_module google-cloud-storage}
+BuildRequires: %{python_module pytest-timeout}
BuildRequires: %{python_module pytest}
BuildRequires: %{python_module requests}
+BuildRequires: fake-gcs-server
# /SECTION
%python_subpackages
@@ -87,33 +85,21 @@
%python_expand %fdupes %{buildroot}%{$python_sitelib}
%check
-## # Tests test_map_simple, test_map_with_data and test_map_clear_empty
require a network connection
-## %%pytest -k "not network" gcsfs/tests
-## # export GCSFS_RECORD_MODE=none
-## # export GOOGLE_APPLICATION_CREDENTIALS=$(pwd)/gcsfs/tests/fake-secret.json
-## # pytest -rfEs
-##
-## - name: Install dependencies
-## shell: bash -l {0}
-## run: |
-## pip install git+https://github.com/fsspec/filesystem_spec
--no-deps
-## conda list
-## conda --version
-## - name: Install
-## shell: bash -l {0}
-## run: pip install .[crc]
-##
-## - name: Run Tests
-## shell: bash -l {0}
-## run: |
-## export
GOOGLE_APPLICATION_CREDENTIALS=$(pwd)/gcsfs/tests/fake-secret.json
-## py.test -vv gcsfs
+# https://github.com/fsspec/gcsfs/blob/main/docs/source/developer.rst
+fake-gcs-server \
+ -backend memory \
+ -scheme http \
+ -public-host http://localhost:4443 \
+ -external-url http://localhost:4443 \
+ >$PWD/fake-gcs-server.stdout 2>$PWD/fake-gcs-server.stderr &
+trap "jobs; kill %1 || true" EXIT
+export STORAGE_EMULATOR_HOST=http://localhost:4443
export GOOGLE_APPLICATION_CREDENTIALS=$(pwd)/gcsfs/tests/fake-secret.json
-%if %{with fulltest}
-%pytest -rfEs
-%else
-%pytest -rfEs -k test_checkers
-%endif
+# Don't test fuse, it hangs on mounting inside obs
+donttest="test_fuse"
+# finds an existing path on the non-first multiflavor test runs"
+donttest+=" or test_mkdir_with_path"
+%pytest -rfEs -k "not ($donttest)"
%files %{python_files}
%doc README.rst
++ gcsfs-2022.3.0-gh.tar.gz -> gcsfs-2022.5.0-gh.tar.gz ++
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.3.0/docs/source/changelog.rst
new/gcsfs-2022.5.0/docs/source/changelog.rst
--- old/gcsfs-2022.3.0/docs/source/changelog.rst2022-04-04
16:36:39.0 +0200
+++ new/gcsfs-2022.5.0/docs/source/changelog.rst2022-05-20
16:37:06.0 +0200
@@ -1,6 +1,12 @@
Changelog
=
+2022.5.0
+
+
+* invalidate listings cache for simple put/pipe
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2022-04-28 23:07:47
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.1538 (New)
Package is "python-gcsfs"
Thu Apr 28 23:07:47 2022 rev:10 rq:973297 version:2022.3.0
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2022-02-24 18:24:05.206648580 +0100
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.1538/python-gcsfs.changes
2022-04-28 23:07:49.636678292 +0200
@@ -1,0 +2,11 @@
+Wed Apr 27 21:15:17 UTC 2022 - Ben Greiner
+
+- Update to 2022.3.0
+ * bucket exists workaround (#464)
+ * dirmarkers (#459)
+ * check connection (#457)
+ * browser connection now uses local server (#456)
+ * bucket location (#455)
+ * ensure auth is closed (#452)
+
+---
Old:
gcsfs-2022.02.0-gh.tar.gz
New:
gcsfs-2022.3.0-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.ywAV4N/_old 2022-04-28 23:07:50.120678819 +0200
+++ /var/tmp/diff_new_pack.ywAV4N/_new 2022-04-28 23:07:50.124678824 +0200
@@ -20,16 +20,15 @@
# the test suite moved to a docker simulator which we cannot run inside an obs
environment
%bcond_with fulltest
%define skip_python2 1
-%define ghversiontag 2022.02.0
Name: python-gcsfs
-Version:2022.2.0
+Version:2022.3.0
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
Group: Development/Languages/Python
URL:https://github.com/fsspec/gcsfs
# Use the GitHub tarball for test data
-Source:
https://github.com/fsspec/gcsfs/archive/refs/tags/%{ghversiontag}.tar.gz#/gcsfs-%{ghversiontag}-gh.tar.gz
+Source:
https://github.com/fsspec/gcsfs/archive/refs/tags/%{version}.tar.gz#/gcsfs-%{version}-gh.tar.gz
BuildRequires: %{python_module setuptools}
BuildRequires: fdupes
BuildRequires: python-rpm-macros
@@ -77,7 +76,7 @@
This package provides the optional FUSE interface.
%prep
-%autosetup -p1 -n gcsfs-%{ghversiontag}
+%autosetup -p1 -n gcsfs-%{version}
sed -i 's/--color=yes//' setup.cfg
%build
++ gcsfs-2022.02.0-gh.tar.gz -> gcsfs-2022.3.0-gh.tar.gz ++
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.02.0/.pre-commit-config.yaml
new/gcsfs-2022.3.0/.pre-commit-config.yaml
--- old/gcsfs-2022.02.0/.pre-commit-config.yaml 2022-02-22 18:57:08.0
+0100
+++ new/gcsfs-2022.3.0/.pre-commit-config.yaml 2022-04-04 16:36:39.0
+0200
@@ -7,7 +7,7 @@
- id: trailing-whitespace
- id: end-of-file-fixer
- repo: https://github.com/ambv/black
-rev: 20.8b1
+rev: 22.3.0
hooks:
- id: black
- repo: https://gitlab.com/pycqa/flake8
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.02.0/docs/source/changelog.rst
new/gcsfs-2022.3.0/docs/source/changelog.rst
--- old/gcsfs-2022.02.0/docs/source/changelog.rst 2022-02-22
18:57:08.0 +0100
+++ new/gcsfs-2022.3.0/docs/source/changelog.rst2022-04-04
16:36:39.0 +0200
@@ -1,6 +1,19 @@
Changelog
=
+2022.3.0
+
+
+(note that this release happened in 2022.4, but we label as 2022.3 to match
+fsspec)
+
+* bucket exists workaround (#464)
+* dirmarkers (#459)
+* check connection (#457)
+* browser connection now uses local server (#456)
+* bucket location (#455)
+* ensure auth is closed (#452)
+
2022.02.0
-
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.02.0/gcsfs/_version.py
new/gcsfs-2022.3.0/gcsfs/_version.py
--- old/gcsfs-2022.02.0/gcsfs/_version.py 2022-02-22 18:57:08.0
+0100
+++ new/gcsfs-2022.3.0/gcsfs/_version.py2022-04-04 16:36:39.0
+0200
@@ -22,9 +22,9 @@
# setup.py/versioneer.py will grep for the variable names, so they must
# each be defined on a line of their own. _version.py will just call
# get_keywords().
-git_refnames = "2022.02.0"
-git_full = "cf2b3e4bfa10bfcbda03830986beb8cc56ffdcb7"
-git_date = "2022-02-22 12:57:08 -0500"
+git_refnames = "2022.3.0"
+git_full = "e4c16db7f59e0f243965f015e95996f9e7fe9665"
+git_date = "2022-04-04 10:36:39 -0400"
keywords = {"refnames": git_refnames, "full": git_full, "date": git_date}
return keywords
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.02.0/gcsfs/cli/gcsfuse.py
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2022-02-24 18:20:45
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.1958 (New)
Package is "python-gcsfs"
Thu Feb 24 18:20:45 2022 rev:9 rq:957041 version:2022.2.0
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2022-02-01 14:03:11.611975468 +0100
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.1958/python-gcsfs.changes
2022-02-24 18:24:05.206648580 +0100
@@ -1,0 +2,7 @@
+Tue Feb 22 22:47:16 UTC 2022 - Matej Cepl
+
+- Update to 2022.02.0:
+ - fix list_buckets without cache
+ - drop py36
+
+---
Old:
gcsfs-2022.01.0-gh.tar.gz
New:
gcsfs-2022.02.0-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.zJT3PO/_old 2022-02-24 18:24:05.690648454 +0100
+++ /var/tmp/diff_new_pack.zJT3PO/_new 2022-02-24 18:24:05.694648454 +0100
@@ -20,9 +20,9 @@
# the test suite moved to a docker simulator which we cannot run inside an obs
environment
%bcond_with fulltest
%define skip_python2 1
-%define ghversiontag 2022.01.0
+%define ghversiontag 2022.02.0
Name: python-gcsfs
-Version:2022.1.0
+Version:2022.2.0
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
@@ -35,7 +35,7 @@
BuildRequires: python-rpm-macros
Requires: python-aiohttp
Requires: python-decorator > 4.1.2
-Requires: python-fsspec == %{version}
+Requires: python-fsspec = %{version}
Requires: python-google-auth >= 1.2
Requires: python-google-auth-oauthlib
Requires: python-google-cloud-storage
@@ -47,10 +47,13 @@
# SECTION test requirements
# always import in order to detect dependency breakages at build time
BuildRequires: %{python_module aiohttp}
+BuildRequires: %{python_module black}
BuildRequires: %{python_module click}
BuildRequires: %{python_module decorator > 4.1.2}
BuildRequires: %{python_module fsspec == %{version}}
BuildRequires: %{python_module fusepy}
+BuildRequires: %{python_module google-api-core}
+BuildRequires: %{python_module google-api-python-client}
BuildRequires: %{python_module google-auth >= 1.2}
BuildRequires: %{python_module google-auth-oauthlib}
BuildRequires: %{python_module google-cloud-storage}
@@ -85,6 +88,27 @@
%python_expand %fdupes %{buildroot}%{$python_sitelib}
%check
+## # Tests test_map_simple, test_map_with_data and test_map_clear_empty
require a network connection
+## %%pytest -k "not network" gcsfs/tests
+## # export GCSFS_RECORD_MODE=none
+## # export GOOGLE_APPLICATION_CREDENTIALS=$(pwd)/gcsfs/tests/fake-secret.json
+## # pytest -rfEs
+##
+## - name: Install dependencies
+## shell: bash -l {0}
+## run: |
+## pip install git+https://github.com/fsspec/filesystem_spec
--no-deps
+## conda list
+## conda --version
+## - name: Install
+## shell: bash -l {0}
+## run: pip install .[crc]
+##
+## - name: Run Tests
+## shell: bash -l {0}
+## run: |
+## export
GOOGLE_APPLICATION_CREDENTIALS=$(pwd)/gcsfs/tests/fake-secret.json
+## py.test -vv gcsfs
export GOOGLE_APPLICATION_CREDENTIALS=$(pwd)/gcsfs/tests/fake-secret.json
%if %{with fulltest}
%pytest -rfEs
++ gcsfs-2022.01.0-gh.tar.gz -> gcsfs-2022.02.0-gh.tar.gz ++
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.01.0/docs/source/changelog.rst
new/gcsfs-2022.02.0/docs/source/changelog.rst
--- old/gcsfs-2022.01.0/docs/source/changelog.rst 2022-01-12
16:43:26.0 +0100
+++ new/gcsfs-2022.02.0/docs/source/changelog.rst 2022-02-22
18:57:08.0 +0100
@@ -1,6 +1,12 @@
Changelog
=
+2022.02.0
+-
+
+* fix list_buckets without cache (#449)
+* drop py36 (#445)
+
2022.01.0
-
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2022.01.0/gcsfs/_version.py
new/gcsfs-2022.02.0/gcsfs/_version.py
--- old/gcsfs-2022.01.0/gcsfs/_version.py 2022-01-12 16:43:26.0
+0100
+++ new/gcsfs-2022.02.0/gcsfs/_version.py 2022-02-22 18:57:08.0
+0100
@@ -22,9 +22,9 @@
# setup.py/versioneer.py will grep for the variable names, so they must
# each be defined on a line of their own. _version.py will just call
# get_keywords().
-git_refnames = "2022.01.0"
-git_full =
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2022-02-01 14:02:45
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.1898 (New)
Package is "python-gcsfs"
Tue Feb 1 14:02:45 2022 rev:8 rq:948798 version:2022.1.0
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2022-01-09 00:48:06.908527087 +0100
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.1898/python-gcsfs.changes
2022-02-01 14:03:11.611975468 +0100
@@ -1,0 +2,6 @@
+Mon Jan 24 17:20:26 UTC 2022 - Ben Greiner
+
+- Update to 2022.01.0
+ * update refname for versions (#442)
+
+---
Old:
gcsfs-2021.11.1-gh.tar.gz
New:
gcsfs-2022.01.0-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.S4TOrT/_old 2022-02-01 14:03:12.139971848 +0100
+++ /var/tmp/diff_new_pack.S4TOrT/_new 2022-02-01 14:03:12.147971793 +0100
@@ -16,21 +16,20 @@
#
-%{?!python_module:%define python_module() python-%{**} python3-%{**}}
+%{?!python_module:%define python_module() python3-%{**}}
# the test suite moved to a docker simulator which we cannot run inside an obs
environment
%bcond_with fulltest
%define skip_python2 1
-%define skip_python36 1
-%define ghversiontag 2021.11.1
+%define ghversiontag 2022.01.0
Name: python-gcsfs
-Version:2021.11.1
+Version:2022.1.0
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
Group: Development/Languages/Python
URL:https://github.com/fsspec/gcsfs
# Use the GitHub tarball for test data
-Source:
https://github.com/fsspec/gcsfs/archive/refs/tags/%{ghversiontag}.tar.gz#/gcsfs-%{version}-gh.tar.gz
+Source:
https://github.com/fsspec/gcsfs/archive/refs/tags/%{ghversiontag}.tar.gz#/gcsfs-%{ghversiontag}-gh.tar.gz
BuildRequires: %{python_module setuptools}
BuildRequires: fdupes
BuildRequires: python-rpm-macros
@@ -96,7 +95,7 @@
%files %{python_files}
%doc README.rst
%license LICENSE.txt
-%{python_sitelib}/gcsfs-%{version}-*-info
+%{python_sitelib}/gcsfs-%{version}*-info
%{python_sitelib}/gcsfs/
%exclude %{python_sitelib}/gcsfs/cli/
++ gcsfs-2021.11.1-gh.tar.gz -> gcsfs-2022.01.0-gh.tar.gz ++
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2021.11.1/docs/source/changelog.rst
new/gcsfs-2022.01.0/docs/source/changelog.rst
--- old/gcsfs-2021.11.1/docs/source/changelog.rst 2021-11-26
22:32:48.0 +0100
+++ new/gcsfs-2022.01.0/docs/source/changelog.rst 2022-01-12
16:43:26.0 +0100
@@ -1,6 +1,11 @@
Changelog
=
+2022.01.0
+-
+
+* update refname for versions (#442)
+
2021.11.1
-
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2021.11.1/gcsfs/_version.py
new/gcsfs-2022.01.0/gcsfs/_version.py
--- old/gcsfs-2021.11.1/gcsfs/_version.py 2021-11-26 22:32:48.0
+0100
+++ new/gcsfs-2022.01.0/gcsfs/_version.py 2022-01-12 16:43:26.0
+0100
@@ -22,9 +22,9 @@
# setup.py/versioneer.py will grep for the variable names, so they must
# each be defined on a line of their own. _version.py will just call
# get_keywords().
-git_refnames = " (HEAD -> main, tag: 2021.11.1)"
-git_full = "85e2ee2abfa429f3c10cc08dcda8ed30db8ab3b5"
-git_date = "2021-11-26 16:32:48 -0500"
+git_refnames = "2022.01.0"
+git_full = "fd67c7d1b6ca9db83a0deadd1557470c37b0836a"
+git_date = "2022-01-12 10:43:26 -0500"
keywords = {"refnames": git_refnames, "full": git_full, "date": git_date}
return keywords
diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn'
'--exclude=.svnignore' old/gcsfs-2021.11.1/requirements.txt
new/gcsfs-2022.01.0/requirements.txt
--- old/gcsfs-2021.11.1/requirements.txt2021-11-26 22:32:48.0
+0100
+++ new/gcsfs-2022.01.0/requirements.txt2022-01-12 16:43:26.0
+0100
@@ -3,5 +3,5 @@
google-cloud-storage
requests
decorator>4.1.2
-fsspec==2021.11.1
+fsspec==2022.01.0
aiohttp<4
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2022-01-09 00:48:06
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.1892 (New)
Package is "python-gcsfs"
Sun Jan 9 00:48:06 2022 rev:7 rq:944563 version:2021.11.1
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2021-08-19 10:02:11.855177969 +0200
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.1892/python-gcsfs.changes
2022-01-09 00:48:06.908527087 +0100
@@ -1,0 +2,26 @@
+Thu Jan 6 20:44:59 UTC 2022 - Ben Greiner
+
+- Update to 2021.11.1
+ * don't touch cache when doing find with a prefix (#437)
+- Release 2021.11.0
+ * move to fsspec org
+ * add support for google fixed_key_metadata (#429)
+ * deprecate content_encoding parameter of setxattrs method (#429)
+ * use emulator for resting instead of vcrpy (#424)
+- Release 2021.10.1
+ * url signing (#411)
+ * default callback (#422)
+- Release 2021.10.0
+ * min version for decorator
+ * default callback in get (#422)
+- Release 2021.09.0
+ * correctly recognise 404 (#419)
+ * fix for .details due to upstream (#417)
+ * callbacks in get/put (#416)
+ * "%" in paths (#415)
+- Release 2021.08.1
+ * don't retry 404s (#406)
+- Disable most of the testsuite because the setup moved from vcrpy
+ to a docker based simulator
+
+---
Old:
gcsfs-2021.7.0-gh.tar.gz
New:
gcsfs-2021.11.1-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.NYJ04A/_old 2022-01-09 00:48:07.368527364 +0100
+++ /var/tmp/diff_new_pack.NYJ04A/_new 2022-01-09 00:48:07.376527369 +0100
@@ -1,7 +1,7 @@
#
# spec file for package python-gcsfs
#
-# Copyright (c) 2021 SUSE LLC
+# Copyright (c) 2022 SUSE LLC
#
# All modifications and additions to the file contributed by third parties
# remain the property of their copyright owners, unless otherwise agreed
@@ -17,42 +17,46 @@
%{?!python_module:%define python_module() python-%{**} python3-%{**}}
+# the test suite moved to a docker simulator which we cannot run inside an obs
environment
+%bcond_with fulltest
%define skip_python2 1
%define skip_python36 1
-%define ghversiontag 2021.07.0
+%define ghversiontag 2021.11.1
Name: python-gcsfs
-Version:2021.7.0
+Version:2021.11.1
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
Group: Development/Languages/Python
-URL:https://github.com/dask/gcsfs
-# Use the GitHub tarball: It contains the VCR recordings (test data to mock
network requests)
-Source:
https://github.com/dask/gcsfs/archive/refs/tags/%{ghversiontag}.tar.gz#/gcsfs-%{version}-gh.tar.gz
+URL:https://github.com/fsspec/gcsfs
+# Use the GitHub tarball for test data
+Source:
https://github.com/fsspec/gcsfs/archive/refs/tags/%{ghversiontag}.tar.gz#/gcsfs-%{version}-gh.tar.gz
BuildRequires: %{python_module setuptools}
BuildRequires: fdupes
BuildRequires: python-rpm-macros
Requires: python-aiohttp
-Requires: python-decorator
-Requires: python-fsspec >= 2021.07.0
+Requires: python-decorator > 4.1.2
+Requires: python-fsspec == %{version}
Requires: python-google-auth >= 1.2
Requires: python-google-auth-oauthlib
+Requires: python-google-cloud-storage
Requires: python-requests
Recommends: dask
Recommends: python-gcsfs-fuse = %{version}
Suggests: python-crcmod
BuildArch: noarch
# SECTION test requirements
+# always import in order to detect dependency breakages at build time
BuildRequires: %{python_module aiohttp}
BuildRequires: %{python_module click}
-BuildRequires: %{python_module decorator}
-BuildRequires: %{python_module fsspec >= 2021.07.0}
+BuildRequires: %{python_module decorator > 4.1.2}
+BuildRequires: %{python_module fsspec == %{version}}
BuildRequires: %{python_module fusepy}
BuildRequires: %{python_module google-auth >= 1.2}
BuildRequires: %{python_module google-auth-oauthlib}
+BuildRequires: %{python_module google-cloud-storage}
BuildRequires: %{python_module pytest}
BuildRequires: %{python_module requests}
-BuildRequires: %{python_module vcrpy}
# /SECTION
%python_subpackages
@@ -72,6 +76,7 @@
%prep
%autosetup -p1 -n gcsfs-%{ghversiontag}
+sed -i 's/--color=yes//' setup.cfg
%build
%python_build
@@ -81,9 +86,12 @@
%python_expand %fdupes %{buildroot}%{$python_sitelib}
%check
-export GCSFS_RECORD_MODE=none
export
commit python-gcsfs for openSUSE:Factory
Script 'mail_helper' called by obssrc
Hello community,
here is the log from the commit of package python-gcsfs for openSUSE:Factory
checked in at 2021-08-19 10:01:10
Comparing /work/SRC/openSUSE:Factory/python-gcsfs (Old)
and /work/SRC/openSUSE:Factory/.python-gcsfs.new.1899 (New)
Package is "python-gcsfs"
Thu Aug 19 10:01:10 2021 rev:6 rq:912913 version:2021.7.0
Changes:
--- /work/SRC/openSUSE:Factory/python-gcsfs/python-gcsfs.changes
2021-06-12 20:07:54.304913418 +0200
+++ /work/SRC/openSUSE:Factory/.python-gcsfs.new.1899/python-gcsfs.changes
2021-08-19 10:02:11.855177969 +0200
@@ -1,0 +2,27 @@
+Wed Aug 18 10:29:33 UTC 2021 - Ben Greiner
+
+- Update to 2021.07.0
+ * fix find/glob with a prefix (#399)
+- Release notes between 0.7.1 and 2021.06.0
+ * kwargs to aiohttpClient session
+ * graceful timeout when disconnecting at finalise (#397)
+ * negative ranges in cat_file (#394)
+ * no credentials bug fix (#390)
+ * use googleapis.com (#388)
+ * more retries (#387, 385, 380)
+ * Code cleanup (#381)
+ * license to match stated one (#378)
+ * deps updated (#376)
+ * switch to calver and fsspec pin
+ * keep up with fsspec 0.9.0 async
+ * one-shot find
+ * consistency checkers
+ * retries for intermittent issues
+ * timeouts
+ * partial cat
+ * http error status
+- Fix running the testsuite -- gh#dask/gcsfs#292
+ * drop avoid_network_tests.patch
+ * use the GitHub archive for VCR recordings
+
+---
Old:
avoid_network_tests.patch
gcsfs-0.7.1.tar.gz
New:
gcsfs-2021.7.0-gh.tar.gz
Other differences:
--
++ python-gcsfs.spec ++
--- /var/tmp/diff_new_pack.Gd4Y94/_old 2021-08-19 10:02:12.283177448 +0200
+++ /var/tmp/diff_new_pack.Gd4Y94/_new 2021-08-19 10:02:12.283177448 +0200
@@ -19,41 +19,40 @@
%{?!python_module:%define python_module() python-%{**} python3-%{**}}
%define skip_python2 1
%define skip_python36 1
+%define ghversiontag 2021.07.0
Name: python-gcsfs
-Version:0.7.1
+Version:2021.7.0
Release:0
Summary:Filesystem interface over GCS
License:BSD-3-Clause
Group: Development/Languages/Python
URL:https://github.com/dask/gcsfs
-Source:
https://files.pythonhosted.org/packages/source/g/gcsfs/gcsfs-%{version}.tar.gz
-# PATCH-FIX-UPSTREAM avoid_network_tests.patch gh#dask/gcsfs#292 mc...@suse.com
-# skip tests which require network connection
-Patch0: avoid_network_tests.patch
+# Use the GitHub tarball: It contains the VCR recordings (test data to mock
network requests)
+Source:
https://github.com/dask/gcsfs/archive/refs/tags/%{ghversiontag}.tar.gz#/gcsfs-%{version}-gh.tar.gz
BuildRequires: %{python_module setuptools}
BuildRequires: fdupes
BuildRequires: python-rpm-macros
Requires: python-aiohttp
Requires: python-decorator
-Requires: python-fsspec >= 0.8.0
+Requires: python-fsspec >= 2021.07.0
Requires: python-google-auth >= 1.2
Requires: python-google-auth-oauthlib
Requires: python-requests
Recommends: dask
Recommends: python-gcsfs-fuse = %{version}
+Suggests: python-crcmod
BuildArch: noarch
# SECTION test requirements
BuildRequires: %{python_module aiohttp}
BuildRequires: %{python_module click}
BuildRequires: %{python_module decorator}
-BuildRequires: %{python_module fsspec >= 0.8.0}
+BuildRequires: %{python_module fsspec >= 2021.07.0}
BuildRequires: %{python_module fusepy}
BuildRequires: %{python_module google-auth >= 1.2}
BuildRequires: %{python_module google-auth-oauthlib}
BuildRequires: %{python_module pytest}
BuildRequires: %{python_module requests}
BuildRequires: %{python_module vcrpy}
-BuildRequires: libfuse2
# /SECTION
%python_subpackages
@@ -63,10 +62,8 @@
%packagefuse
Summary:Filesystem interface over GCS - FUSE interface
Group: Development/Languages/Python
-Requires: libfuse2
Requires: python-click
Requires: python-fusepy
-Requires: python-pandas
%descriptionfuse
File-system interface for Google Cloud Storage.
@@ -74,8 +71,7 @@
This package provides the optional FUSE interface.
%prep
-%setup -q -n gcsfs-%{version}
-%autopatch -p1
+%autosetup -p1 -n gcsfs-%{ghversiontag}
%build
%python_build
@@ -85,13 +81,14 @@
%python_expand %fdupes %{buildroot}%{$python_sitelib}
%check
-# Tests test_map_simple, test_map_with_data and test_map_clear_empty require a
network connection
-%pytest -k "not network" gcsfs/tests
+export GCSFS_RECORD_MODE=none
+export GOOGLE_APPLICATION_CREDENTIALS=$(pwd)/gcsfs/tests/fake-secret.json
+%pytest -rfEs
