Feature/update cloud example#345
Merged
Merged
Conversation
There was a problem hiding this comment.
Pull request overview
Updates the “Cloud Environment with Re-imaging” example notebook to reflect the updated observation/action space and demonstrates new greedy heuristics plus a custom token/attention-based actor-critic architecture for RLlib PPO. Also documents the update in the v1.3.0 release notes.
Changes:
- Refresh the environment configuration (observations/actions/lookahead) and reward logic in
cloud_environment_with_reimaging.ipynb. - Add greedy heuristic baselines (re-imaging and single-picture) and a custom RLlib
RLModulewith attention-based actor/critic definitions. - Add a release note entry indicating the example has been updated.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 6 comments.
| File | Description |
|---|---|
| examples/cloud_environment_with_reimaging.ipynb | Updates the cloud re-imaging tutorial with new observation/action definitions, heuristics, and custom actor-critic/RLModule code. |
| docs/source/release_notes.rst | Adds a release note entry referencing the updated example notebook. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
LorenzzoQM
force-pushed
the
feature/update_cloud_example
branch
from
July 13, 2026 14:57
552e14c to
ddd4323
Compare
LorenzzoQM
force-pushed
the
feature/update_cloud_example
branch
2 times, most recently
from
July 13, 2026 22:11
0fcd701 to
a41a458
Compare
Yume27
reviewed
Jul 14, 2026
Yume27
reviewed
Jul 14, 2026
Yume27
reviewed
Jul 14, 2026
Yume27
reviewed
Jul 15, 2026
LorenzzoQM
force-pushed
the
feature/update_cloud_example
branch
from
July 17, 2026 20:07
a41a458 to
9da53ac
Compare
LorenzzoQM
force-pushed
the
feature/update_cloud_example
branch
from
July 17, 2026 20:12
9da53ac to
baf361b
Compare
Yume27
approved these changes
Jul 17, 2026
Yume27
left a comment
Contributor
There was a problem hiding this comment.
Great example and show the new structure! Maybe good to think about splitting the code into two later, but good for now. And passed the tests and ran correctly.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Closes #342
Updates the cloud with reimaging example script to incorporate recent changes and new actor-critic network architecture.
Type of change
How should this pull request be reviewed?
Future Work
Update with the related publication information once available.
Checklist