Skip to content Skip to sidebar Skip to footer

Appengine Cloud Storage Python Library Timeout Issue

I am trying to migrate a fairly large amount of data from GCS to AppEngine via the task queue and 20 backend instances. The issue is that the new Cloud Storage library does not see

Solution 1:

This is a bug in gcs client library. It will be fixed soon. Thanks!

You hack will work. But if it still times out frequently, you can try to do fp.read(size=some_size). If you files are large, with a 32 MB response (URLfetch response size limit) and 90 seconds deadline, we assume a transfer rate of 364KB/s.

Post a Comment for "Appengine Cloud Storage Python Library Timeout Issue"