Comment

Anonymous

Thanks for this code. I have something similar based on it running in production and I hit a wall.
Decompressing archives containing 65688 files will result to be very very slow.

To have a significant speed boost you can try something similar to this https://github.com/ITISFoundation/osparc-simcore/blob/cd9640c0072fcd2536a0ae11cd602e7b7a9ea3ee/packages/service-library/src/servicelib/archiving_utils.py#L45

It basically avoids reading the entire file list from the zipfile inside the background process!