Lots of images result in time out

[AaronBenDaniel]

Stories with massive amounts of images cause the downloader to time out when behind Cloudflare, and an internal server error when accessed directly.

Example story: https://www.wattpad.com/story/103549716-truyện-tranh-kinh-dị-1

[TheOnlyWayUp]

I can replicate this for EPUBs and PDFs. Images aren't cached at all so repeated downloads will keep failing.

A possible solution would be to cache images for a few minutes to help with repeated downloads.

The problem is multifaceted, on one hand, we have the time it takes to download. On the other, #41 - PDF Downloads are super slow for anything large.

[TheOnlyWayUp]

CF is off on the new domain, I'll recheck this issue.

[TheOnlyWayUp]

Tried downloading the example story as an epub, Nginx gateway timeout occurs instead. Caching images for a few minutes might be our best option here. I'd rather not implement a polling system or store the file on-server to distribute.

[TheOnlyWayUp]

Fixed on new version, I don't see a way to fix this for this version.
As,

1. I don't want to remove the gateway timeout entirely, and there's no upper bound on how long downloads can take
2. The new version fixes it, so implementing a code-heavy fix is not needed.

However, this can be reduced by image compression, which is something I've been thinking of as of late. Lossless jpg compression on the saved images, and maybe an option for lossy compression.

Leaving this issue open till the new version is out.

[AaronBenDaniel]

I'm definitely in support of image compression. It'll be harder on the CPU, but it's probably worth it. We also might want to look into transcoding into other formats beyond JPEG. I'm a big fan of WEBP, although we'd need to see how common WEBP support is on EPUB readers.