On Saturday, March 14, 2015 at 5:20:18 PM UTC-4, Joseff Betancourt wrote:
>
> On Saturday, March 14, 2015 at 5:07:31 PM UTC-4, Nikolaus Rath wrote:
>>
>> On Mar 14 2015, Joseff Betancourt <[email protected]> wrote:
>> > I downloaded all 450GB to my
>> > hard drive locally with the idea to do a local://backend-folder, but
>> this
>> > seems to not be able to do.
>>
>> Yeah, this is never going to work. That way you're loosing all the
>> metadata, and the local backend uses a different file format.
>>
>> > Rackspace backend (2.12):
>> > - I cannot upgrade.
>> > - I can download metadata.
>> > - I can mount into list only. Cannot read/copy any object (what a tease
>> > here lol).
>>
>> In my last email, I asked if you could fsck.s3ql.
>>
>> > Rackspace backend (2.13):
>> > - I can upgrade, but it would error at a specific file missing, which I
>> may
>> > have fixed with a meta-download and feck (it deleted the spurious
>> > object :)
>>
>> What do you mean with "may"? Did you fix it, or did you not? Or did you
>> mean "caused" rather than "fixed"?
>>
>> > - I can't mount.
>>
>> You mean, the upgrade completed successfully but you cannot mount? Or
>> are you trying to mount even though the upgrade did not complete? That
>> cannot possibly work.
>>
>> > Again, I really am only looking for a temporary solution (2.12 OR 2.14
>> OR
>> > custom) to pull the files to move to a new raid solution for image
>> hosting
>> > (we've given up on cloud hosting for files due to Rack Space's
>> > inconsistency since their hypervisor upgrades last week).
>>
>> This sounds as if you are looking for contrib/clone_fs.py.
>>
>> Best,
>> -Nikolaus
>>
>> --
>> GPG encrypted emails preferred. Key id: 0xD113FCAC3C4E599F
>> Fingerprint: ED31 791B 2C5C 1613 AF38 8B8A D113 FCAC 3C4E 599F
>>
>> »Time flies like an arrow, fruit flies like a Banana.«
>>
>
> Hi Nikolaus,
>
>
> >>Yeah, this is never going to work. That way you're loosing all the
> metadata, and the local backend uses a different file format.
>
> That sucks. :(
>
> >>In my last email, I asked if you could fsck.s3ql.
>
> Yes I did mention that I can fsck using the 2.12 client, didn't I (sorry
> if I didn't -- many things on mind at moment)?
>
> >>What do you mean with "may"? Did you fix it, or did you not? Or did you
> mean "caused" rather than "fixed"?
>
> The Upgrade previously failed at 33.2%; this new upgrade, after fscking
> and removing the file it didn't like, is still running and I won't know if
> the removal of the spurious file in the db has worked yet.
>
> >>This sounds as if you are looking for contrib/clone_fs.py.
>
> Please tell me how to use this to extract whole files? If this can work I
> wouldn't mind putting together a emergency recovery doc for the wiki.
>
>
Hi Nikolaus,
Seems the upgrade died again, even after this specific file was deleted for
being spurious in the fsck.
2015-03-14 18:01:20.117 7661 MainThread root.excepthook: Uncaught top-level
exception:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/common.py", line 549, in wrapper
return fn(*a, **kw)
File "/usr/lib/s3ql/s3ql/adm.py", line 433, in update_obj_metadata
t.join_and_raise()
File "/usr/lib/s3ql/s3ql/common.py", line 503, in join_and_raise
raise EmbeddedException(exc_info, self.name)
s3ql.common.EmbeddedException: caused by an exception in thread Thread-2.
Original/inner traceback (most recent call last):
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/backends/swift.py", line 306, in lookup
resp = self._do_request('HEAD', '/%s%s' % (self.prefix, key))
File "/usr/lib/s3ql/s3ql/backends/swift.py", line 249, in _do_request
raise HTTPError(resp.status, resp.reason, resp.headers)
s3ql.backends.s3c.HTTPError: 404 Not Found
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/common.py", line 482, in run
self.run_protected()
File "/usr/lib/s3ql/s3ql/common.py", line 533, in run_protected
self.target(*self.args, **self.kwargs)
File "/usr/lib/s3ql/s3ql/adm.py", line 464, in upgrade_loop
meta = plain_backend.lookup(obj_id)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 52, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/swift.py", line 310, in lookup
raise NoSuchObject(key)
s3ql.backends.common.NoSuchObject: Backend does not have anything stored
under key 's3ql_data_580910'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.4/contextlib.py", line 321, in __exit__
if cb(*exc_details):
File "/usr/lib/python3.4/contextlib.py", line 237, in _exit_wrapper
return cm_exit(cm, *exc_details)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 211, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 329, in close
self.backend.close()
File "/usr/lib/s3ql/s3ql/backends/swift.py", line 501, in close
self.conn.disconnect()
File "/usr/local/lib/python3.4/dist-packages/dugong/__init__.py", line
1330, in disconnect
self._sock.close()
AttributeError: 'NoneType' object has no attribute 'close'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.4/contextlib.py", line 321, in __exit__
if cb(*exc_details):
File "/usr/lib/python3.4/contextlib.py", line 237, in _exit_wrapper
return cm_exit(cm, *exc_details)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 211, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 329, in close
self.backend.close()
File "/usr/lib/s3ql/s3ql/backends/swift.py", line 501, in close
self.conn.disconnect()
File "/usr/local/lib/python3.4/dist-packages/dugong/__init__.py", line
1330, in disconnect
self._sock.close()
AttributeError: 'NoneType' object has no attribute 'close'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.4/contextlib.py", line 321, in __exit__
if cb(*exc_details):
File "/usr/lib/python3.4/contextlib.py", line 237, in _exit_wrapper
return cm_exit(cm, *exc_details)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 211, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 329, in close
self.backend.close()
File "/usr/lib/s3ql/s3ql/backends/swift.py", line 501, in close
self.conn.disconnect()
File "/usr/local/lib/python3.4/dist-packages/dugong/__init__.py", line
1330, in disconnect
self._sock.close()
AttributeError: 'NoneType' object has no attribute 'close'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/python3.4/contextlib.py", line 321, in __exit__
if cb(*exc_details):
File "/usr/lib/python3.4/contextlib.py", line 237, in _exit_wrapper
return cm_exit(cm, *exc_details)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 211, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 329, in close
self.backend.close()
File "/usr/lib/s3ql/s3ql/backends/swift.py", line 501, in close
self.conn.disconnect()
File "/usr/local/lib/python3.4/dist-packages/dugong/__init__.py", line
1330, in disconnect
self._sock.close()
AttributeError: 'NoneType' object has no attribute 'close'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/bin/s3qladm", line 9, in <module>
load_entry_point('s3ql==2.13', 'console_scripts', 's3qladm')()
File "/usr/lib/s3ql/s3ql/adm.py", line 94, in main
return upgrade(options)
File "/usr/lib/s3ql/s3ql/common.py", line 549, in wrapper
return fn(*a, **kw)
File "/usr/lib/s3ql/s3ql/adm.py", line 339, in upgrade
update_obj_metadata(backend, backend_factory, db, options.threads)
File "/usr/lib/s3ql/s3ql/common.py", line 549, in wrapper
return fn(*a, **kw)
File "/usr/lib/python3.4/contextlib.py", line 336, in __exit__
raise exc_details[1]
File "/usr/lib/python3.4/contextlib.py", line 321, in __exit__
if cb(*exc_details):
File "/usr/lib/python3.4/contextlib.py", line 237, in _exit_wrapper
return cm_exit(cm, *exc_details)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 211, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 329, in close
self.backend.close()
File "/usr/lib/s3ql/s3ql/backends/swift.py", line 501, in close
self.conn.disconnect()
File "/usr/local/lib/python3.4/dist-packages/dugong/__init__.py", line
1330, in disconnect
self._sock.close()
AttributeError: 'NoneType' object has no attribute 'close'
2015-03-14 18:01:20.117 7661 Thread-4 s3ql.backends.swift._do_request:
started with 'HEAD', '/s3ql_data_581236', None, None, None, None
2015-03-14 18:01:20.127 7661 Thread-4
s3ql.backends.swift._do_request_inner: started with HEAD
/v1/MossoCloudFS_931072/s3ql_images/s3ql_data_581236
--
You received this message because you are subscribed to the Google Groups
"s3ql" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
