Visualization

[nastaran78]

Add on-demand optimization visualizations

Enrich the optimization process with visualizations that can be generated either automatically after each trial update or explicitly via API.

API

• Add a flag to neps.run() to enable visualization updates.
• Provide a separate API to generate/update plots on demand.

Initial plots

1. Pareto Frontier

   • Support multi-objective optimization.
   • Include evaluation cost/time as an additional objective to visualize the trade-off between optimization loss and user-exposed evaluation cost.

2. Incumbent

   • Show anytime performance over the optimization process.