Skip to content

LSTM #7

Description

The LSTM code is based on this tutorial and this github repo.

An attempt to bring the tutorial libraries up to date was not fruitful, and caused the network to train more quickly and significantly less well, with large white sections. The exact source of the issue was not identified, so the old library versions were used.

The network struggles with image sharpness, giving blurry predictions for both the MNIST dataset in the tutorial, and our own Cyclone data. In our own data, the output is usually a somewhat blurrier copy of the most recent input.

The performance does not drop significantly loss-wise when moving from one-hourly to three-hourly steps. The loss fell below 0.005, so it may be worth attempting to introduce a different/additional loss heuristic in the future.

Overall, this approach was not the most promising so was not investigated in much greater depth, and we stuck with 64x64 pixels.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions