This document contains install/upgrade summary and specific instructions for users and administrators.
The latest release contains improvements, new features, bug fixes, and sometimes security strengthening. Upgrade is recommended for all WebObs administrators. For known issues, please take a look to github.com/IPGP/webobs/issues and do not hesitate to submit any problem with this release.
Sections with !! prefix must be carefully read in case of upgrade. It usually means that the upgrade could change some behavior from previous release installations (i.e., not a bug fix). An appropriate configuration to keep the former behavior is usually proposed.
If you have any question which is not answered in the user manual, do not hesitate to write to developpers through the mailing list webobs-devs@services.cnrs.fr, or start a public discussion thread at github.com/IPGP/webobs/discussions.
-
New grids FORM: manual databases (formerly dedicated forms) are now fully integrated as a grid type along with PROCs and VIEWs. A FORM is then associated to a DOMAIN and some NODES, appears in the GRIDs table and has its own page with description, nodes table list, map location, and events. FORM is based on the new GENFORM user-defined manual database tool (introduced in the previous release): a freely configurazble SQLite database managed through a GUI form (for entering new data, editing and deleting), a table data display with options and filters, data export as CSV file or as raw data source for PROCs. Creating a FORM becomes as simple as creating a PROC or VIEW, by selecting a template (a dozen are available), if necessary modifying it partially or completely, associating a DOMAIN, associating or creating NODES, and editing the configuration file to set the database structure (inputs and outputs) and the form layout. GENFORM is able to store numerical values, checkboxes, lists, text strings, images, and mathematical output formulas. It aims to replace spreadsheets files for (potentially) any structured scientific data. See the user manual for more details.
!!Update note: This new feature replaces definitively all the previous forms (EAUX, GAZ, EXTENSO, FISSURO, DISTANCE, BOJAP, RIVERS, SOILSOLUTIONS, and RAINWATER) for which an automatic migration is made during the setup/update. PROCS using the legacy forms databases will be adapted to use new FORM which become a RAWFORMAT/RAWDATA attribute instead of hard link to legacy form. Each PROC will have its own FORM with the same grid name and the same associated nodes. Former configuration filesCONF/FORMSandCONF/GRIDS2FORMSwill be moved inCONF/LEGACY_FORMS/directory, and old data filesDATA/DB/*.DATwill be moved toDATA/BACKUP_LEGACY_FORMS/. All these files are not necessary anymore and might be removed/backuped anywhere outside the WebObs architecture. Corresponding legacy scriptsCODE/cgi-bin/{form,post,show}FORMNAME.plhave been removed from this release. Any link/URL (for example in the WebObs menu) pointing to these scripts must be modified as follows:showFORMNAME.pl=>showGENFORM.pl?form=PROCNAMEshowFORMNAME.pl?node={PROCNAME}=>showGENFORM.pl?form=PROCNAMEshowFORMNAME.pl?node=NODEID=>showGENFORM.pl?form=PROCNAME&node=NODEIDformFORMNAME.pl=>formGENFORM.pl?form=PROCNAME
where FORMNAME is the legacy form name, and PROCNAME is the associated PROC which becomes also the new FORM name. Note that previous link
showFORMNAME.plwithout argument, when legacy form was associated to more than one PROC (for instance theEAUXdatabase), has no strict equivalent in the new structure; it must be replaced by as many links as there are procs associated to this form. -
GeoJSON: shapes (polygons, lines, and points) can be associated to a NODE or a GRID using the OSM.pl link (map marker pin icon), using import of a shapefile (.zip archive) or manual drawing. Resulting shapes will be saved to a .geojson file, and displayed on maps (gridmaps and locastat).
-
GNSS superproc: new summary plot STRAINMAP to plot baseline pairs and associated strain map. To activate it, add
STRAINMAPin theSUMMARYLISTlist. Parameters are:
STRAINMAP_TITLE|{\fontsize{14}{\bf$name - Baselines} ($timescale)}
STRAINMAP_NODEPAIRS|
STRAINMAP_EXCLUDED_FROM_TARGET_KM|
STRAINMAP_EXCLUDED_NODELIST|
STRAINMAP_INCLUDED_NODELIST|
STRAINMAP_TOL_DAYS|1
STRAINMAP_HORIZONTAL_ONLY|NO
STRAINMAP_LINESTYLE|.
STRAINMAP_MOVING_AVERAGE|30
STRAINMAP_PAIRS_OFFSET_M|
STRAINMAP_PAIRS_SORT|YES
STRAINMAP_WINDOW_DAYS|
STRAINMAP_DEM_OPT|'watermark',1.5,'saturation',0,'interp','hlegend','cartesian'
STRAINMAP_LINEWIDTH|.5,4
# map baseline pairs color reference: strain for signed colormap, or timeseries (default)
STRAINMAP_COLORREF|strain
STRAINMAP_COLORMAP|ryb(256)
STRAINMAP_FONTSIZE|10
If node pairs are not defined, it computes pairs using Delaunay triangle from all nodes of the network, or selected using exclude/include options (`STRAINMAP_EXCLUDED_FROM_TARGET_KM`, `STRAINMAP_EXCLUDE_NODELIST`, `STRAINMAP_INLUDED_NODELIST`). An additional option `STRAINMAP_PAIRS_SORT` allows automatic sorting of pairs for the timeseries graph (using velocity). The summary plot computes some linear trend paramters: velocity (mm/yr), total displacement (mm), and total deformation (µstrain) from the entire window or a sub-window defined by `STRAINMAP_WINDOW_DAYS`. Baselines are computed when the time reference is the same for the two timeseries of station pair, considering a tolerance of `STRAINMAP_TOL_DAYS`. Other options are similar to the BASELINES summary plot. A map of stations is also plotted with a basemap using proc's DEM ans options `STRAINMAP_DEM_OPT` (see dem.m function). Baselines are plotted with constant linewidth of proportional to absolute strain (`STRAINMAP_LINEWIDTH` with 1 or 2 values, respectively) and color identical to timeseries (one per station) or using strain colormap (`STRAINMAP_COLORREF` and `STRAINMAP_COLORMAP`).
- GNSS superproc: active fault slip/open can be set as a priori correction on displacement data, using the Okada (1985) model, as rectangular fault in elastic medium:
FAULT_ACTIVATE|N
FAULT_CENTROID_LATLONDEP|
FAULT_LENGTH_WIDTH_KM|
FAULT_STRIKE_DIP_RAKE_DEG|
FAULT_SLIP_OPEN_M|0,0
FAULT_DISLOCATION_TLIM|
FAULT_DISLOCATION_TIME_MODEL|linear
FAULT_WITH_TOPOGRAPHY|Y
FAULT_PLOT|Y
FAULT_PLOT_COLOR|lightgray
Fault geometry is defined by `FAULT_CENTROID_LATLONDEP` with centroid coordinates as latitude (degree), longitude (degree) and depth (km>0 below sea level), `FAULT_LENGTH_WIDTH_KM` as fault length in the strike direction, and width in the dip direction (both in km), and `FAULT_STRIKE_DIP_RAKE_DEG` the fault trace azimuth/strike (0 to 360° from North clockwise) defined so that the fault dips to the right side of the trace, dip angle (0 to 90°) from horizontal plane, and rake direction as the hanging wall moves during rupture measured relative to the fault strike (-180 to 180°). `FAULT_SLIP_OPEN_M` defines the slip dislocation in rake direction, and open dislocation in the tensile component (both in m).
The dislocation occurs at a date/time or between two date/time if `FAULT_DISLOCATION_TLIM` contains one or two values, respectively. `FAULT_DISLOCATION_TIME_MODEL` is presently only linear. `FAULT_WITH_TOPOGRAPHY` set to `Y` will use station's elevation to approximately correct topography effect. `FAULT_PLOT` will plot the fault limits on graphs, using `FAULT_PLOT_COLOR` for line.
- GNSS superproc: trend unit (velocity) is now configurable with two new parameters:
TREND_FACTOR|365.25*1e3
TREND_UNIT|mm/yr
where `TREND_FACTOR` is a dimensionless factor applied to the trend value initially in m/day, and `TREND_UNIT` is the resulting unit string (for display purposes) for individual node timeseries and VECTORS graph. Also, the `VECTORS` summary map now have a displacement scale below the velocity scale.
-
New CSS!
-
!!setup will now check all Perl modules dependancies, and stop if any of them fails. -
!!if the auto-registration mode is enabled (SQL_DB_USERS_AUTOREGISTER), when a registration form is sent the new line added to/opt/webobs.d/htpasswdapache file is now commented. Administrator must uncomment it to fully activate the user access. -
!!HYPOMAP superproc: MAP_*_DEPLIM now filters the data (was only for marker scale color). Caution: comments in proc's .conf files need to be updated to avoid misunderstanding -
!!in order to use only the MultiMarkDown format in contents, the former 'wiki' format will be progressively abandonned. The following option is recommanded in WEBOBS.rc:WIKI_MMD|YESand admins are encouraged to use the ">MMD" button in editors.
-
!!shell scripts for GNSS data processing, formerly inCODE/shells/gnss/have been removed and are now available at a new repository IPGP/gnssposflow. -
!!seismic event creation triggering in SeisComP is now compatible with all SeisComP versions and does not rely anymore on SeisComP compiled with ipgp-addons. Now it uses the postboard to trigger the injection script of the event on the SeisComP server.- variables removed from
MC3.conf:
WO2SC3_HOSTNAME|localhost WO2SC3_PORT|30003 WO2SC3_MOD_ID|1 WO2SC3_MOD_TYPE|1- variables added to
MC3.conf:
# Dispatch new MC entry into SeisComP # SeisComP hostname, user, ssh key and dispatch script WO2SC_HOSTNAME| WO2SC_USER| WO2SC_SSH_KEY| # Dispatch script for SC3 : wo_mc_origin_to_sc.sh -3 # Dispatch script for SC4 and above : wo_mc_origin_to_sc.sh WO2SC_DISPATCH_SCRIPT_PATH| # Default event coordinates when creating origin from MainCourante in SeisComP WO2SC_EVTLON| WO2SC_EVTLAT| # Notification ID in postboard WO2SC_NOTIFY_EVENT|wo2sc. # QML temporary file WO2SC_QML_TEMP_FILE|$WEBOBS{SEFRAN_ROOT}/wo2sc.xml - variables removed from
-
Few improvements in the MC3 form:
- multiple selection of event types is now possible,
- size of the statistics graph can be changed. In
MC3.conf, two new variables to set the width and height in pixels:
GRAPH_WIDTH_PX|900 GRAPH_HEIGHT_PX|250These values can be overwritten in
mc3.plURL with options&grw=and&grh=.- new button (lower left of graph) to save graph and legend as a .png image on disk (screenshot),
- new button (lower left of graph) to show/hide lines around bar graphs,
- new column *NoGraph for event types (MC3_Codes.conf) to ignore it in the graph, e.g., for a comment type.
-
Few improvements in Jerk superproc:
- automatic filtering to avoid outliers in raw signals,
- improves graph rendering and add a legend.
-
In showOUTG.pl the proc outputs of event type (tremblemaps, helicorder, ...) have now navigation buttons to access directly to previous/next image, and year, month, day selection accross available images and events.
!!Fix a potential security issue with Apache logins when the corresponding user does not exist in the users' db. The setup will fix any abnormal situation by editing the htpasswd file (deleting unknown users and commenting invalid users). In addition, setting the validity flag through the User Manager GUI will now comment/uncomment the corresponding login line in htpasswd file.!!Fix an issue giving edit button for any grid (view/proc/form) for users with only Edit level.- Fix an issue with hypomap proc when
EVENTTYPE_EXCLUDED_LISTandEVENTSTATUS_EXCLUDED_LISTare empty. - Add forgotten keys in tremblemaps superproc template, and fix an issue when updating procs with setup (new keys not added).
- Fix display of non-geolocated nodes as neighbours (as lat=lon=0).
- Fix issue with empty location code for fdsnws-dataselect format.
- Fix an issue with alignment of MC events on the sefran3 main page (hourly thumbnails).
!!Fix an issue with error filtering strategy in gnss superproc. To avoid NaNs, check thatENU_MIN_ERROR_Mcombined withORBIT_ERROR_RATIOhas lower values thanFILTER_MAX_ERROR_M.!!Fix an issue with relative mode in gnss superproc: theVECTORS_RELATIVE_HORIZONTAL_ONLYwas not applied whenVECTORS_VELOCITY_REFcontains a station or list of stations.
!!remove cedit.pl and fedit.pl. Replace former links with nedit.pl and formGENFORM.pl, respectively.
- Python library for WebObs PROC development: This is the first beta release of our new Python library, designed to ease the development of custom procedures for WebObs.
- Write procs directly in Python, benefiting from the language’s readability and powerful ecosystem.
- This release includes a ready-to-use example that replicates the GENPLOT functionality. You can use it as a template for your own projects.
- Generic forms: see section Under development below.
- Nodes:
- Links between node's feature now display a table of full children's feature content, including possible link to grandchildren. A toggle icon allows to switch hidden/displayed of this table.
- With admin level on a grid, it is possible to duplicate a node configuration (small icon on the right of node's title): all the configuration fields will be copied, including the node's ID that must be modified to become valid. Note that calibration file, feature's content and events will not be copied.
- In the tremblemaps procs (felt earthquakes), GSE message can be replaced by a JSON file with basic information about the event, with two new variables:
GSE_EXPORT|N
JSON_EXPORT|Y
Each B3 report (felt earthquake) can be sent by email through a new form with all fields automatically filled and still editable by the operator before sending. Access to this form needs an Admin level authorization on the proc. The form is associated with new variables:
MUTT_OPTIONS|-e "set from='WebObs <webobs>'"
TRIGGER_EMAIL|
TRIGGER_SUBJECT|SÉISME RESSENTI
TRIGGER_DEPARTMENT|
TRIGGER_AGENCY|
REPORT_EMAIL|
REPORT_SUBJECT|[OVS-IPGP] Séisme ressenti
REPORT_FOOTNOTE|Si vous avez ressenti ce séisme, merci de témoigner sur le site du BCSF à l'adresse suivante : www.franceseisme.fr
The MUTT_OPTIONS is used to set the "From:" address (instead of Apache user who is the real sender), but other options can be added if needed (see mutt manual). TRIGGER_EMAIL and TRIGGER_SUBJECT is used to send the data to BCSF. It will use JSON file (if exists), or GSE file otherwise. The REPORT_EMAIL, REPORT_SUBJECT, and REPORT_FOOTNOTE are used to send the B3 report with a detailed text message on the event and potential macroseismic intensities. The PDF file of full report will be attached to the mail. Note that email will be sent to the operator and destination address will be in "Bcc:".
!!The format of the calibration files has been changed. Data are now handled with a hash. This provides greater flexibility to add new variables.- In the proc request form, all keys are now available for edition, sorted alphabetically, following the
REQUEST_KEYLIST. - Search node events form accepts negative pattern (beginning with a
!). - Mat-file raw format allows import of any variable names as t, d, and e matrix (
FID_T,FID_D,FID_E). - DSV generic raw format has new option
FID_DECIMAL_COMMAto read data files using decimal comma (not decimal point). - Better check of the consistency of node start/end dates when editing the configuration.
- Exported list of geolocated nodes as KML file has now extended data (start/end dates, active flag).
- Metadata can now be uploaded to the Theia|OZCAR data portal. A checkbox has been added to select and save channels to be uploaded.
- New GNSS solutions data formats:
spotgins-ipppandgamit-pos.
!!WebObs Perl modules have been moved from CODE/cgi-bin/WebObs to CODE/perl/lib. The system-wide installation MUST be executed when upgrading (answer Y to the appropriate question during setup) in order to make all CGI working.!!non-CGI Perl scripts have been moved from CODE/cgi-bin/ to new directory CODE/perl/. The scheduler and postboard MUST be restarted when upgrading. Deployments that usefdsnws-event2mc3.plorseiscomp2mc3.plthrough external script or crontab must update the path.!CGI-Perl authentication has been improved against potential nasty use from invalid or unauthorized users.!User manager form: now only the WebObs Owner is allowed to delete a user, edit any user UID, or modify authorizations for the WebObs Owner himself. Admin level on the resource user allows everything else except these. As a reminder, modification/deletion of any user UID is not recommended since it might result in WebObs data corruption (grid or node events, manual data banks, Gazette, ...).- Fix an issue to display attached photos in grid events.
- Fix the issue producing a black background for PDF image thumbnails.
- Fix an issue with the
DECIMATEparameter in superproc gnss. - Fix some graphical issues in sefran3 with messy data packets in miniseed.
- Fix an issue with proc name that uses the word "PROC".
- Fix an issue with data files Campbell binary format TOB1 that contain no data but a header.
- Fix an issue in gridmaps with inactive nodes plotted over active ones.
- Fix a possible issue with scevtlog-xml data format (ignoring events created late after origin time).
- Fix forgotten binaries for Arclink rawformat.
- Generic forms: it is now possible to create any user-defined manual database associated to a form (for entering new data and editing), a table display, and CSV export of data, using SQLite database. This new feature will replace all the actuel forms (EAUX, GAZ, EXTENSO, FISSURO, DISTANCE, SOILSOLUTIONS, and RAINWATER) in future release, with an automatic migration tool. Creating and using the new forms is functional, but reading the data from PROCS is not yet implemented. See the user manual documentation for details.
- When editing or creating a NODE, if a shapefile is associated to the NODE, a GEOJSON file is now created in
/opt/webobs/DATA/NODES/NODEName/, and will contain all the metadata of the GEOJSON, so it could be re-used elsewhere.
-
The metadatabase has been separated from the THEIA|Ozcar pivot model summary table. From now on, when a NODE is created or edited, the datasets table is filled with the metadata concerning the NODE. Moreover, for each PROC, It is necessary to fill the
THEIA_SELECTED_NODESIDandTHEIA_SELECTED_TSfields which respectively correspond to the NODEs associated to the given PROC and the timescale on which the given PROC produces the data, in order to send the data and metadata associated with the PROC.NODES and the selected timescale. Thus, the THEIA|Ozcar pivot model summary table only show the selected data producer, PROC.NODEs and PROC.NODE_CHANNELs that will be send to the pivot model. Finally, a JSON file is produced and a text file is created for each PROC.NODE_CHANNELs containing the data, included in the associated timescale, which will be send to the pivot model with the metadata. The JSON file contains only the metadata, and the text files the data. For each PROC.NODE, all the PROC.NODE_CHANNEL text files are compressed in a zip file named producerId_DAT_PROC.NODE.zip, and the the text files contained are named after producerId_PROC.NODE_CHANNEL.txt. At the end, a zip file containing the datasets zip files and the JSON metadata file is made and uploaded on the user computer. -
In the seismic bulletin Main Courante, graph has now a 28-day moving sum, an Y-axis label, and the plot size has been extended.
-
When creating a new node, the Start date is now blank (previously it was current date), as the End date. Also, entering a Start date posterior to End date gives an error message (previously it was allowed).
- Fix an issue with author names in search node events (no result were found when search was made on a common part of multiple names).
- Fix an issue with meteo superproc (error when no data are available)
- Fix a possible issue with proc requests when default cleanreq job is activated
- Fix a possible issue with events node plot in procs (when sensor outcome is checked)
- Fix an issue with events plot in proc graphs (time zone is now correctly taken into account)
- Fix an issue with markitup shortcuts in file edition (nedit.pl, gedit.pl, vedit.pl)
- An interface has been created between WebObs and the Theia|OZCAR data portal. An Admin who needs to transfer metadata towards Theia can now produce a JSON file with WebObs metadata by filling some forms. The first form is located in the WebObs Grids Manager. The others are respectively the NODE forms and CLB forms. When a producer/NODE/new row in a CLB file is created, WebObs fills a metadata database which stores the metadata in order to write them in a JSON file, ready-to-send to the Theia data portal.
-
All procs: new experimental flag option
SVGOUTPUTto produce a vector file in SVG format for all graphs, allowing rescaling of the plot using browser facilities. This option is also available in the proc request form. -
Gridmaps: new variable
GRIDMAPS_DEM_OPTthat can be set in any grid (view and proc) to overwrite the default background map options (defined in GRIDMAPS.rc configuration file). The variable must contain option list compatible with the dem.m function. Example:GRIDMAPS_DEM_OPT|'grayscale','watermark',2 -
In superproc gnss, new options to select/exclude nodes in summary graphs BASELINES, MOTION, and VECTORS:
BASELINES_EXCLUDED_FROM_TARGET_KM| BASELINES_INCLUDED_NODELIST| MOTION_EXCLUDED_FROM_TARGET_KM| MOTION_INCLUDED_NODELIST| VECTORS_EXCLUDED_FROM_TARGET_KM| VECTORS_INCLUDED_NODELIST|These variables come in addition to basic
_EXCLUDED_NODELISToptions. The filter works like forMODELLING:*_EXCLUDED_FROM_TARGET_KM: exclude nodes at greater distance from target (defined byGNSS_TARGET_LATLON), or at lower distance if the value is negative;*_EXCLUDED_NODELIST: exclude some nodes;*_INCLUDED_NODELIST: force to include some nodes (overwriting possible excluded nodes by other filter).
-
In superproc tremblemaps, new option
CITIES_RADIUS_KMto define a radius around cities (default is 1 km, the minimum recommanded value). Also, the uncertainties on earthquake magnitude and location depth are now taken into account to compute the maximum acceleration. -
In the Scheduler Runs:
- possibility to select a job ID and to sort any column in the job runs table.
!!access is now submitted to authorization rights. Resource is scheduler in the misc table. Admin level (4) is needed to delete a log date or kill a running job.
-
In the NODE form:
- possibility to locate yourself through different possibility on an interactive map : by clicking on the map, or by using the HTML geolocation (beware: approximate position based on your computer IP address).
- possibility to import a shapefile in the interactive map
- EXPERIMENTAL: automatic geographical positioning using a KML feed is possible by selecting auto KML feed in positioning type. It uses a new node's variable
POS_RAWKMLcontaining a URL that returns a KML content. Latitude, longitude, altitude and positioning date will be filled and updated from Placemark/TimeStamp/when and Placemark/Point/coordinates tags.!!The local data configuration CONF/POSITIONtypes.conf pointed byFILE_POSvariable in NODE.rc is now obsolete and unused. It is replaced by the read-only file CODE/etc/postypes.conf. If some administrators have modified the original template by adding new positioning types, please open an issue or contact the dev team.
-
!!Campbell data formats (cr10xasc,toa5andtob1) now use proc/nodeRAWDATAstring as full path/filename using bash wildcard facilities and explicit subvariables$FIDand$yyyy. This allows import of data stored in non-standard architectures and file naming. Configuration of existing procs or nodes using these formats must be updated by modifying theRAWDATAcontent values as follows:cr10xasc: former_rawdata_path/$FID/$yyyy/*.DATtoa5andtob1: former_rawdata_path/$FID/$yyyy/$FID*.dat
-
All procs node calibration file: undocumented but functional possibility to compute any arithmetic function in the calib. factor field in calibration file, using
xas raw data.
-
Fix an issue with user account end date of validity
-
Fix some issues (search in comments) in the Node Search Events tool.
-
We started to improve GNU Octave compatibility of the Matlab code. Since Octave has a less permissive grammar, it lead to a better writing and sometimes hidden bug fixes. See the associated discussion thread.
-
Fix potential security problems with jquery (version 1.8 updated to 3.7)
-
Fix a potential issue with Sefran3 display front page when there is too much MC events in the last days.
-
In the superproc gnss, new functionality available to apply a harmonic sine+cosine correction on the signal for each component (E,N,U). This can be used to remove a priori periodic signal like atmospheric or ocean loading. New parameters are:
HARMONIC_ORIGIN_DATEfor the date/time of phase origin for all sine and cosine,HARMONIC_PERIOD_DAYlist of harmonic periods, coma separated values, in days (example:365.25,182.625for 1 year and 6 months),HARMONIC_EAST_SINCOS_MM,HARMONIC_NORTH_SINCOS_MM,HARMONIC_UP_SINCOS_MMcontain pairs of sine,cosine amplitudes for each period, in mm. To activate the correction, all parameters must be valid and number of pairs must be consistent with the number of periods for all components.
-
Also in superproc gnss, new options for velocity trends:
VECTORS_AMPLITUDE_COMPONENTSdefines the used components to compute velocity amplitudes and plot the amplitude vs distance plot (summary graph VECTORS). Default is1,2for horizontal components only. Set this option to3to use only the vertical component.TREND_MIN_PERCENTsets a minimum threshold of time period with data to compute a trend. Default is 50%.
-
GNSS thing again, new shell script
gnss_make_rinexand its config filegnss_make_rinex.rcto build rinex files from different formats of raw data and sitelog files. -
In the superproc genplot, per node graph can plot several moving averages using
MOVING_AVERAGE_SAMPLESwith coma separated values of samples. A shading color scale will be used. -
In addition to map location node, a list of active neighbour nodes is automatically displayed, sorted by decreasing distances and indicating direction and elevation gain. A link to each neighbour nodes is available, with a warning icon when a project is associated to this node. Two new parameters are added to NODES.rc configuration file:
NEIGHBOUR_NODES_ACTIVE_ONLY(default isY) andNEIGHBOUR_NODES_MAX(default is 15) to limit the number of displayed nodes. -
Former Google Maps API for grids and nodes has been replaced by OpenStreetMap free mapping (layers taken from https://leaflet-extras.github.io/leaflet-providers/preview/):
- ESRI World Imagery: mix of satellite images
- OpenTopoMap: topography with contour lines and roads
- OpenStreetMap: the collaborative project world map
- Stamen Terrain: hill shading and natural vegetation colors
- Stamen Watercolor: just for fun... The new GUI uses https://leafletjs.com javascript application.
-
Any grid or node's page shows a QRcode containing URL address of the page. The code can be printed in a new window with associated logos defined in WEBOBS.rc
QRCODE_LOGOSvariable.QRCODE_SIZEdefines the code module size (in pixels, default is 2, empty or zero to disable the display). This function needs the installation of qrencode utility on the server (sudo apt install qrencode). -
Node-feature-node association can be edited using the node configuration form: each feature can be associated to another node or list of nodes, creating a parent-children link through this feature. This functionality was already existing but only editable by administrator. If the list of features is modified, a refresh icon allows to update the list of feature/node association text forms. The interface still requires to enter the node ID codes. The former link to edit the node2node.rc global file has been removed. It can be added in the +ADMIN menu, as a new entry like
<li><a href="/cgi-bin/xedit.pl?fs=CONF_NODES(FILE_NODES2NODES)">node2node.rc</a></li>. -
In Sefran/MC, keyboard shortcuts can be defined by administrator to select the event type and amplitude during phase picking, as an alternative to menu list mouse selection. The key must be a single character, case sensitive, defined in the MC3_Codes.conf file as a new column with name
KBcodein the header line=key|.... Example:=key|Name|Color|BgColor|Md|asVT|asRF|Location|WO2SC3|KBcode UNKNOWN|Unknown event|\#535353|\#FFFFFF|-1|0|0|1|1| VOLCTECT|Volcano-Tectonic|\#FA8072|\#FFFFFF|0|1|0|1|1|V VOLCLP|Volcanic Long-Periode|\#DC143C|\#FFFFFF|0|0|0|1|1|L ...to set key
V(uppercase) for event type VOLCTECT and keyLfor event type VOLCLP. For amplitudes, the format is similar but without the functional=keyheader:# Key|Name|Value|KBcode WEAK|Weak|0|1 AVERAGE|Average|500|2 STRONG|Strong|1000|3 OVERSCALE|Overscale|2000|4to set numbers 1 to 4 for amplitudes WEAK to OVERSCALE, respectively. Note that letters
e,r,t,sandSare already assigned to functions (show/hide MC events and spectrogram control). TheEnterkey submit the form. -
Node's events are shown as background areas in graphs (per node only, not in summary graphs). New variables in NODES.rc:
EVENTNODE_PLOT_COLORto set the color (default isSilver),EVENTNODE_PLOT_LINEWIDTHto set the line width for "instant" events (default is 1), andEVENTNODE_PLOT_OUTCOME_ONLYto select only events having the flag 'sensor/data outcome' ON (default isYES). Presently this functionality is available for superprocs genplot, afm, gnss, tilt, jerk, rsam, and meteo.
-
In nodes event editing, the date and time formats are now checked. When editing an existing event, it is now possible to move the event to another node (you must know the target's node ID).
-
It's now possible to directly download proc requests results in .tgz file at results page, and a link to the scheduler run log is available.
-
New options in the Search node events tool:
- grids column is now optional (checkbox) and desactivated by default,
- full node name can be displayed (checkbox),
- a link allows to download a .csv file of the results,
- a wait icon appears during the search.
-
Proc request form proposes the last user's date intervals as preset dates (will fill-up the date/time fields).
-
All nodes have a time zone parameter associated to lifetime dates and events date/time. Default (undefined) time zone will be considered as GMT. Any node configuration edit will propose the time zone of the server.
-
Improves the form behaviour in node configuration edit:
- features former delimiters (escaped characters like , or |) are replaced by coma,
- negative latitude or longitude is allowed in node geographic location. A negative value will automatically switch the N/S or E/W selection.
-
!!Event mail notification now contains the full message. It is possible to keep the former behavior (event's title only) by setting the new WEBOBS.rc variableEVENTS_NOTIFY_FULL_MESSAGEtoNO.
-
The search event fonction is now working with grid's name.
-
Some fixes in proc request results display.
-
Improves boolean parameters reading in Perl scripts (accepts case insentitive 0/N/NO or 1,Y,YES).
-
Users list in grid/node event editor is now sorted in alphabetic order of UID (previously it was based on the login name, case sensitive).
-
Other minor fixes.
-
An automatic classification of seismic event type in the Sefran/MC has been implemented. It uses the code Automatic Analysis Architecture by M. Malfante, J. Mars, and M. Dalla Mura
. Installation procedure, configuration and usage are described in pse_configuration.md readme file.
-
Two new forms have been created: SOILSOLUTION (soil solution chemical analysis) and RAINWATER (rain water chemical analysis). Databanks can be created using specific editor forms, display table and graphs (presently the genplot). When upgrading, the
setupwill copy the templates in the local CONF directory.
-
superproc hypomap has a new variable to select events
EVENTCOMMENT_INCLUDED_REGEXPcontaining a regular expression applied to each event comment string. It can be used to select type(s) of event from MC3, since the comment field contains the event type full name from associated MC3. Example:EVENTCOMMENT_INCLUDED_REGEXP|Volcano-Tectonic\|Long PeriodTo select events of types Volcano-Tectonic and Long Period. Note the pipe
|must be escaped with a backslash\|. -
superproc gnss has new features for summary graph MODELTIME:
- a new variable
MODELTIME_SOURCE_TYPEnow allowing the pCDM source in model time series. An additional graph will be made with name MODELTIME_pCDM. Useisotropic,pcdmvalue to compute both types of sources (separated graphs). Warning: the computation of pCDM source can be very long: about a minute for a single 2,5 million points model, so detailed model time series on several periods may take hours of computation. UseMODELTIME_MAX_MODELSto limit the computation (time step will be adjusted automatically, overwriting theMODELTIME_SAMPLING_DAYvalue). - a new variable to fix Y-axis of plots:
MODELTIME_FLIMcontaining min,max values for source flow rate (in m3/s) or volume variation (in m3), depending on theMODELTIME_FLOWRATEoption. Empty value stands for automatic scale which is the default and former behaviour. - a new variable
DISP_YSCALE_Mto fix the displacement Y-scale on some graph (in meter). Default is automatic.
- a new variable
-
!!Any sefran3 is now managed as a new type of GRID, beside VIEW and PROC.- It can be associated to a DOMAIN and will be displayed in the table of grids, with optional type/owner and links to SEFRAN3 main page and associated MC3.
- A new sefran can be created from templates using the create/edit GRID form. A specific page of configuration allows edition of the main configuration files:
SEFRAN3.confandchannels.confwhich are stored in a specific directory in the new$WEBOBS{PATH_SEFRANS}/*structure. - When upgrading, existing sefrans must be manually associated to a domain to appear in the grid table (use the Domain manager).
setupwill NOT move existing configuration files from the original CONF directory; only symbolic links will be created. - The variable
CHANNEL_CONFremains operational for backward compatibility, pointing to any channels' configuration file, but it is recommended to remove/comment it so sefran will use implicitly the uniquechannels.conffile. - Authorization for a sefran is managed using the procs auth table and sefran name as resource. The generic
MCresource name remains functional for all sefrans.
-
!!Still for sefran3, former configuration fileSEFRAN3_TimeIntervals.confand corresponding variableTIME_INTERVALS_CONFbecome obsolete and might be deleted; they are replaced by a new variableTIME_INTERVALS_LISTinSEFRAN3.conf(coma-separated list of time intervals in hours, 0 stands for "Last MC events"), with default list of values that might be edited if necessary:TIME_INTERVALS_LIST|0,6,12,24,48,168 -
!!Directory of proc's binaries has been moved from${ROOT_CODE}/matlab/binto${ROOT_CODE}/bin. This affects only the distributed package since binaries are ignored by git. Symbolic links have been created to preserve existing configuration when upgrading, but administrators are encouraged to editWEBOBS.rcand remove thematlab/sub-directory in the MCC path variable, for example in the case of linux-64 architecture, it should be like:PATH_MCC|${ROOT_CODE}/bin/linux-64 -
User's have now two new attributes for account administration (editabled through the User Manager GUI):
- an expiry date of validity in the format
YYYY-MM-DDas the last effective day of the account activity (reference is the WebObs server local time). Let this field empty for potentially never-ending accounts. Combined with a validity flagY, if the expiry date is passed the user will be still considered as invalid. A validity flagNalways invalidates the account whatever the expiry date is. - a comment field (free string) to add any useful information about the account (only seen by admins). When a new user has auto-registered, this field is used to add the date and time of registering.
- an expiry date of validity in the format
- sefran3: There was a problem with the last binary with seedlink and fdsnws-dataselect protocols if one or more data channels are missing (error). Also the variable
NAMEwas not used (still former obsoleteTITRE) - mc3: It was impossible to select a time period within the last day of the month.
!!SRTM tiles for mapping: Following the fix in 2.3.3, an USGS mirror site has been restored to continue the benefits of downloading automatically new SRTM3 global topographic data without the need to register at the NASA/EarthDATA center. Nevertheless, the authentication is still needed for SRTM1 tiles download (optionDEM_SRTM1|Y). As a reminder, downloaded tiles are stored locally in thePATH_DATA_DEM_SRTMdirectory (in WEBOBS.rc, default is/opt/webobs/DATA/DEM/SRTM), and used to update maps without requiring new download from the internet. Thus, a possible alternative to registering at EarthDATA is to place here all the needed tiles manually (must be in the.hgtformat, filename in the form[N|S]yy[E|W]xxx.hgt[.zip]for LAT yy and LON xx at lower-left corner of the tile).- all maps: an uggly artifact might appended on coast lines with
ETOPO_SRTM_MERGE|Y. - fix an issue in events display for grids with an underscore in the name.
-
!!TheLD_LIBRARY_PATHenvironment variable is now automatically reset for commands run from a Matlab process to allow commands to be run in a normal system environment. This means that administrators do not need to reset this variable inPRGM_*variables defined inWEBOBS.rclike it was previously required in most environments (these variables should now simply include the command name, using either their short name or an absolute path). In particular, the value ofPRGM_CONVERTadvised in the release notes for version 2.2.0 will not work with this version: if you upgrade from 2.2.0, please make surePRGM_CONVERTonly points to the convert command like this :PRGM_CONVERT|convert(using a value of
export LD_LIBRARY_PATH='' && convertwill NOT work, but the previous default value ofenv LD_LIBRARY_PATH='' /usr/bin/convertwill work, althought redefiningLD_LIBRARY_PATHis not required any more.) -
A new script
SETUP/compress-sefran-parallelis provided to replace the previous scriptSETUP/compress-SEFRANdescribed in the release notes for version 2.2.0 below to compress the existing PNG images produced by the Sefran, while retaining the tags in the images.- Run
SETUP/compress-sefran-parallel -hto learn about available options and to get help on the different ways to use the script. - This script can provide the same functionality as
SETUP/compress-SEFRAN, but it will not show the percentage of the progression. It will however (by default) show the names of the processed files. - If the
parallelcommand is installed on the system, compressions will be executed in parallel (2 by default, but this can be changed using the-joption if more than 2 CPU are available and your system is not overloaded); - This script can also be used by advanced users to export the minimalistic bash function
run_pngquantinto the current shell that can then be manually fed with a list of files to compress. This functionality can be useful to compress fewer files at a time to not overload the system for too long (e.g. to process a limited number of sefran images during nighttime). It can also be used to compress images exported on a different system not running WebObs (the system will still needimagemagick,pngquant, and optionnallyparallelinstalled). Run the script with the-hoption to learn more about this functionality. An example of such advanced use to only process one month of images with 4 concurrent compressions would be (note that the use ofsortis only useful to visually control the progression of the compressions from the dates in the names of the files being compressed):$ . /opt/webobs/WebObs-2.3.0/SETUP/compress-sefran-parallel load_env $ find /srv/sefran/201901* -name '*.png' | sort | parallel -j 4 run_pngquant
- Run
-
The GNSS superproc has new features for the summary graph MODELLING:
MODELLING_SOURCE_TYPEnow accepts a list of coma-separated models, i.e., presently onlyisotropicandpCDM. If two models are defined, both will be computed and available through menu links MODELLING and MODELLING_pCDM, respectively.MODELLING_EXCLUDED_FROM_TARGET_KMnow accepts negative value to exclude nodes at distance lower than the absolute value, i.e.,-5will exclude stations up to 5 km from the target. As a reminder, a positive value will exclude nodes at distance greater than the value.MODELLING_INCLUDED_NODELISTallows to include node(s) that have been (eventually) excluded by the previous parameter or byMODELLING_EXCLUDED_NODELIST.!!MODELLING_ENU_ERROR_RATIOis a list of 3 factors applied to the velocity trend components E, N, and U, respectively, before the modelling process. The default is1,1,2to multiply by 2 the vertical component errors, which is more consistent with the usual GNSS data errors. Set to1,1,1to keep the previous behavior and results.
-
The GNSS superproc has new summary graph MODELNET, which analyses the network sensitivity as capacity to estimate source volume variation at depth. The graph shows horizontal slices of minimum volume variations detectable by a minimum number of stations simultaneously, giving a minimum displacement for each component E,N,U. The calculation will consider only stations that are active within the graph time scale. New parameters are:
MODELNET_EXCLUDED_NODELIST,MODELNET_EXCLUDED_FROM_TARGET_KM,MODELNET_INCLUDED_NODELISTto select the stations (same rules as for MODELLING).MODELNET_MIN_DISP_MMdefines the minimum displacements as an error ellipsoid semi-axis vector of E,N,U components in mm (default is 1 mm for horizontal components, and 2 mm for vertical component).MODELNET_MIN_STATIONsets the minimum number of stations (default is 2).MODELNET_DEPTH_SLICEis the vector of depth slices (default is 5 slices from 0 to 8 km depth).MODELNET_BORDERSsets additional border (in m) around the stations to define the grid map (default is 1 km).MODELNET_TARGET_INCLUDEDwhen set toYincludes targetGNSS_TARGET_LATLONin the grid.MODELNET_GRID_SIZEsets the grid size (default is 100 pixels).MODELNET_VIEW_AZELsets the 3D view parameters as azimuth,elevation in degree (default is 40° azimuth, 10° elevation).MODELNET_DVLIMsets the volume variation colorbar limits as dVmin,dVmax in m3 (default is automatic).MODELNET_COLORMAPsets the colormap (default is scientific colormap roma from F. Crameri).MODELNET_MARKERsets the plot parameters for station markers (default is white triangle).MODELNET_TITLEsets the graph title.
When upgrading, these lines will be added to any existing gnss procs:
MODELNET_EXCLUDED_NODELIST| MODELNET_EXCLUDED_FROM_TARGET_KM| MODELNET_INCLUDED_NODELIST| MODELNET_MIN_DISP_MM|1,1,2 MODELNET_MIN_STATION|2 MODELNET_DEPTH_SLICE|0:2000:8000 MODELNET_BORDERS|1000 MODELNET_TARGET_INCLUDED|Y MODELNET_GRID_SIZE|100 MODELNET_VIEW_AZEL|40,10 MODELNET_DVLIM| MODELNET_COLORMAP|roma(256) MODELNET_MARKER|'^k','MarkerSize',6,'MarkerFaceColor',.99*ones(1,3) MODELNET_TITLE|{\fontsize{14}{\bf${NAME} - Network sensitivity}} -
Node calibration file is now associated to procs, and not unique anymore. Each proc will use its own calibration table for a given node. For backwards compatibility, the following behavior is adopted:
- any existing calibration file (created before this release 2.3.0) will continue to apply to any proc associated to the node, as a default.
- when edited through a particular proc, the former calibration file is duplicated and the edited version will remain specific to the corresponding proc and not affect others that will continue to use the former version of the calibration file, until it is edited.
- when creating a new calibration file, it will be uniquely associated to the proc under which it is created, and only visible and used by this proc. Other procs will still consider there is no calibration file for the node, until it is created.
-
The raw data format dsv (text delimiter separated values) does not require anymore a calibration file for each node. In case of missing calibration file, a default name will be given to each data channel. Also, it has new possible parameters (editable through node's configuration):
FID_DATACOLSis an index vector of the file columns that contain the imported data. The default, and former behavior, is an automatic detection of the data (all but the date and time columns).FID_ERRORCOLSis an index vector of the file columns defining the data errors in the same order as data. It must have the same length as data vector. Use 0 to skip a column if no error is associated to it. Default (empty) won't associate any error with the data. Columns of errors are ignored in the data automatic detection mode.
-
New CSS classes have been created to allow presenting graphs in nice frames on the welcome page, but it can be used anywhere in WebObs pages. Refer to the Welcome_news.txt default file for a sample use of these classes.
-
!!To continue the benefits of downloading automatically new SRTM3 global topographic data, WebObs administrator must now register to NASA/EarthDATA center at https://urs.earthdata.nasa.gov (free). A single valid login (userusrand passwordpwd) must be obtained then stored in one of the following:WEBOBS.rcconfiguration file as variable:EARTHDATA_LOGIN|usr,pwd- or in the WebObs owner user's home (default is wo), adding the 3 lines in
/home/wo/.netrc(auto-login process):machine urs.earthdata.nasa.gov login usr password pwd
This authentication will be used for both SRTM3 and SRTM1 1°x1° tiles download. As a reminder, downloaded tiles are stored locally in the
PATH_DATA_DEM_SRTMdirectory (default is/opt/webobs/DATA/DEM/SRTM), and used to update maps without requiring new download from the internet. Thus, a possible alternative to registering at EarthDATA is to place here all the needed tiles manually (must be in the.hgtformat). -
When using Firefox 79+ (and potentially recent versions of other browsers), the temporary tab was not automatically closed and the event log not refreshed after editing an event in the event log / main courante.
-
In the GNSS superproc, there was a mistake in the name of parameter to adjust velocity scale manually in VECTORS graph: the correct name is
VECTORS_VELOCITY_SCALEand defines the velocity in mm/yr corresponding to 25% of the graph width. -
The wpage.pl script that shows the content of
WikiandHTMLpages now correctly detects and displays HTML-only content (it was previously resulting in an invisible content, which was still editable though). -
Fix in dsv rawdata format (was not able to read the last column).
-
First try to include Winston format in Sefran3 data source (was missing)
-
!!Sefran3 includes a continuous spectrogram, which is activated by default. To disable this feature you must setSGRAM_ACTIVE|NOin all your Sefran3. Since the feature uses new Perl, JavaScript and CSS, if you notice any strange display you must clear your browser cache, this will solve the problem definitively.New variables are:
PATH_IMAGES_SGRAM|sgram SGRAM_ACTIVE|Y SGRAM_FILTER|hpbu6,0.1 SGRAM_PARAMS|0.5,0,50,lin SGRAM_EXPONENT|0.5 SGRAM_COLORMAP|spectral(256) SGRAM_CLIM|0,2 SGRAM_OPACITY|0.7 PNGQUANT_NCOLORS|16 SGRAM_PNGQUANT_NCOLORS|32
Default values are optimized for 100 Hz sampling rate:
SGRAM_FILTER: signal filtering, same syntax as forSEFRAN3_CHANNELSfile (default ishpbu6,0.1for a highpass Butterworth 6th-order 0.1 Hz cut-off frequency filter);SGRAM_PARAMS: 4-element vector of coma separated values, as:- W = time step window for FFT (in seconds, default is 0.5 s),
- Fmin = minimum frequency (in Hz, default is 0 Hz),
- Fmax = maximum frequency (in Hz, default is 50 Hz),
- Yscale =
linfor linear (default) orlog(logarithmic);
SGRAM_EXPONENT: power spectrum amplitude exponent (default is 0.5);SGRAM_COLORMAP: colormap (default is spectral);SGRAM_CLIM: 2-element vector as minimum, maximum values for colormap limits (default is 0-2, which corresponds to a saturation of the spectrogram colors when the signal is also saturated on the waveforms);SGRAM_OPACITY: initial opacity of spectrogram over waveform image (default is 0.5).
When the spectrogram is activated, minute and hourly images are made at low and high speed simultaneously with classical waveform images, and updated following broom wagon rules. The additional computing time is not significant. But, a spectrogram image are about 1.5 times bigger than waveform's images (low+high speed total). For that reason, we introduced a better compression of all PNG images using open-source program pngquant, with a gain of about 70% in size (see next section for details). Final result is a reduction of Sefran3 storage size after activating the spectrogram! ;-)
For visualization, there is several possibilities:
-
a new icon is available in the main page menu or in the upper-left control panel to toggle waveform/spectrogram view;
-
the control panel includes also a manual slide range button to control opacity of the spectrogram;
-
hot key 'S' can be press anytime to toggle waveform/spectrogram view at default or current opacity value;
-
hot key 'Shift-S' forces the spectrogram view at maximum opacity (no transparency);
-
hot keys 'R' to lower transparency by 1/10 step (increases opacity), and 'T' to increase by 1/10 (decreases opacity);
-
hot keys 'E' or 'e' have been added to toggle MC event tags display.
Hot keys are disabled when editing the event form; you must click outside the field inputs to reactivate them.
- Another sefran3 improvement: PNG images are now compressed using the external program pngquant, which optimizes the colormap. Gain of size on Sefran3 images is about 70%. It is strongly recommended to install the utility (
apt install pngquant), which is set in a new WEBOBS.rc variablePRGM_PNGQUANT. If the program exists, it will automatically compress the new images (waveforms and spectrograms). Two additionnal variables in SEFRAN3.conf are:PNGQUANT_NCOLORS|16 SGRAM_PNGQUANT_NCOLORS|32
where PNGQUANT_NCOLORS is the number of colors for waveform compression (default is 16), and SGRAM_PNGQUANT_NCOLORS the number of colors for spectrogram compression (default is 32). These values can be reduced to make smaller files, but this might produce unwanted solarization effects, especially visible on the spectrogram.
A known issue is an error in sefran3 using convert program, due to missing dynamic library. This might be solved in this version 2.2.0 by the following WEBOBS.rc variable:
PRGM_CONVERT|export LD_LIBRARY_PATH=''; /usr/bin/convert
Attention: this value of
PRGM_CONVERTis specific to WebObs version 2.2.0 and will not work in versions >= 2.3.0, where a more general approach was implemented. Please refer to the release notes of 2.3.0 for more details.
We also propose a bash script SETUP/compress-SEFRAN to compress existing sefran3 archives. A basic benchmark shows that a single full year of sefran3 archive may take over a day of processing on a standard computer, but a reduction of about 70% of the total size of archive. Administrators who want to make their own compression must be aware that unfortunately, pngquant ignores user's tag header written in the original PNG file. To rewrite the Sefran3 tags in compressed files (needed by broom wagon and display of data statistics), you might use the program identify to export tags from the original file first, then convert to rewrite them in the compressed file:
tag=$(identify -format %[sefran3*] $INPUT | sed -e 's/sefran3/ -set sefran3/g;s/=/ /g' | tr -d '\n')
cat $INPUT | pngquant 16 | convert - $tag $OUTPUT
These two lines make the core of compress-SEFRAN script.
- Proc's main page (cgi-bin/showGRID.pl) displays two additional tables in the Specification section:
- one table of main available proc's output page links sorted by time scales (Overview and Summary plots);
- one table of time scale parameters as defined in the configuration. This may help to check if some parameters are undefined.
-
!!Superproc GNSS has new variable to adjust errors on data for different orbits:ORBIT_ERROR_RATIOwhich contains a vector of ratios associated to orbit values 0 (final), 1 (rapid), and 2 (ultra), respectively. The default setting of the new variable is:ORBIT_ERROR_RATIO|1,2and will multiply by 1 final-orbit errors (orbit = 0), and by 2 any non-final orbits (orbit > 0). Set this variable empty, or 1 to keep previous behavior.
-
Since 2020, there no more free access website where SRTM1 tiles can be downloaded anonymously. If you have already used SRTM1 data in your procs, the tiles have been stored in your
PATH_DATA_DEM_SRTM1and are still available offline for mapping on the corresponding areas. But to download new tiles or at first install, you now need to register at earthdata.nasa.gov (free). User and password login must be specified in a new variableEARTHDATA_LOGINinWEBOBS.rc:EARTHDATA_LOGIN|user,passwordIf this login is not defined, SRTM3 tiles will be used whatever
DEM_SRTM1value is. -
Superproc TILT has two new parameters for modelling:
MODELLING_MISFITNORM|L1 MODELLING_APRIORI_HSTD_KM|as for the GNSS superproc modelling,
MODELLING_MISFITNORMallows L1 (default) or L2 norm to compute misfit.MODELLING_APRIORI_HSTD_KMwill apply a gaussian function on the global misfit based on the distance from target defined inTILT_TARGET_LATLON. -
Mapping benefits the new feature of dem.m function: the color saturation. Superprocs GNSS, HYPOMAP, TILT and TREMBLEMAPS can include the option in their respective
*DEM_OPTvariables as'Saturation',0.7for example, to reduce saturation by 30%. For the superproc GRIDMAPS, a new variable has been added toGRIDMAPS.rc:COLOR_SATURATION|0.7Tip: maps are usually used as a background to highlight other elements (stations, vectors, ...). The mapping concept in WebObs is to keep plain colors for these elements, and attenuate the background colors using two parameters: a watermark effect (set to a factor of 1.5 by default) and now the saturation effect (set to 0.5 by default).
-
Two new scientific colormaps are available:
rybandspectral.rybis a diverging colormap where luminance is highest at the midpoint, and decreases towards differently-colored endpoints (Red-Yellow-Blue). It is set as new default for GNSS modelling probability graphs.spectralis a Red-Orange-Yellow-Green-Blue colormapjetbut less saturated/agressive and with constant luminance. It has been set as default for most of the procs and the Sefran3 spectrogram.
-
Due to a discrepancy in data class between
sefran3.mandrdmseed.m, sefran3 was not able to use data input other than standard Steim1/2 coding. This has been fixed. -
In GNSS/GispyX data format, station code is now case insensitive. In fact, station code in
.tdpfiles is written upper case, so lower case FID were not properly found in the GipsyX solutions. This has been fixed. -
The Codemirror javascript library (used to colorize the textareas used to edit configuration file for procs and nodes) embedded in WebObs has been updated to address the security issue described in CVE-2020-7760.
-
The Scheduler now listens for control commands throught UDP on the
127.0.0.1local address by default. This will restrict control of the Scheduler to local users only. If you really want to allow other users on the network to access this interface, set theLISTEN_ADDRconfiguration variable to another configured IP address or corresponding hostname in the Scheduler configuration file (by defaultscheduler.rc). In this case, it is advised to limit access to specific hosts using local firewall rules. -
A new option
MERGE_JOB_LOGSin the scheduler configuration file (by defaultscheduler.rc) allows to merge the standard output and standard error outputs of the jobs to a common file using the name set in thelogpathfield of the job definition, suffixed by.log. IfMERGE_JOB_LOGSisy,yes, (case insensitive) or1, the output will be merged, otherwise the scheduler follows the historical behaviour and will write the outputs to files respectively suffixed by.stdoutand.stderr. -
The
setupscript now checks if your system uses the system and service manager systemd, and will propose to install or update the service definition fileswoscheduler.serviceandwopostboard.serviceif necessary, adapting the provided templates to your environment as needed. The templates files for these systemd services have also been updated. For further details about WebOBs systemd integration, please refer to the new section4.4 Postboard and Scheduler system integrationof the WebObs manual. -
The HTML interface in the Scheduler Manager and the User Manager now uses checkboxes to control the validity field in the job, user, and notifications forms. If you experience some abnormal behaviour (e.g. if the 'validity' checkbox isn't checked when it should), try clearing your browser cache (the javascript and CSS files might not correctly be refreshed).
-
Some bug and security issues were fixed in the Scheduler Runs and Scheduler Manager CGI scripts. It is advised to update your WebObs installation with this release.
-
For users using systemd, the commands
systemctl stop woschedulerandsystemctl stop wopostboardno longer mark the related service as failed aspostboard.plandscheduler.plnow report a clean exit when stopped through a TERM signal. (Note that the commandsudo systemctl stop woschedulerwill cleanly stop the Scheduler, but running jobs will be killed. If you want to stop the Scheduler after waiting for all the jobs to finish, use the command/opt/webobs/CODE/shell/scheduler stop. The systemd service will stop normally when the process exits.) -
The
schedulerhelper script was not able to start or control the Scheduler on systems where thenetstatcommand is missing (on newer systems it is by default replaced byssfrom theiproutetoolbox). -
The postboard and its helper function
WebObs::Config::notifywere rejecting notifications having an empty 4th field (messagefield), although action notifications should rightfully be accepted with no parameters, and therefore with an emptymessagefield. -
When specifying the email address of a webobs user as Envelope From address in a mailing notification submitted to the postboard, the full name of the user and its email address were mistakenly inverted, using something like
john.doe@example.com <John Doe>instead ofJohn Doe <john.doe@example.com>as theFrom:field. -
When editing a node from an associated view, if this node was also associated with procs, the parameters (FID, FNDS network, etc.) were lost.
-
An issue using the 'replay mode' in Sefran/MC when not using the default sefran3.
-
Grid's configuration uses a VIM editor with syntax highlighting. New WEBOBS.rc keys:
JS_EDITOR_EDIT_THEME|default JS_EDITOR_BROWSING_THEME|neat JS_EDITOR_AUTO_VIM_MODE|no -
Sefran now uses full functionality of
DATASOURCEvariable (Seedlink, Arclink, FDSNWS) -
MC can handle multiple associated images for each event (still undocumented)
-
GNSS modelling has additional node exclusion filter (distance from target, if defined by
GNSS_TARGET_LATLON), and fixed scale capability for vectors plot. New keys are:MODELLING_EXCLUDED_FROM_TARGET_KM| MODELLING_VMAX_MM|0 MODELLING_VMAX_RATIO|.25 MODELLING_VECTORS_CLIP|NO -
Proc request form now includes a "verbose logs" option (debug mode)
-
sefran3.pl now accepts a 'hideloc' CGI parameter similar to the 'hideloc' parameter of mc3.pl. If its value is 1, event locations will not be shown in the popovers of events in the hourly thumbnail view (which allows the page to load faster, especially when using FDSNWS). If not present, its value defaults to the inverted value of
MC3_EVENT_DISPLAY_LOCfrom the Sefran configuration. -
The MC now includes a calculation of energy in joules, shown for each event in a popover in the 'Magnitude' column. The total energy of selected events is also shown in the top section of the MC, and two new graphs are available: one shows the energy in joules featuring each type of event, the other only plots the total energy of all event types.
-
Several improvements in the form EAUX: the list of nodes now uses a fixed order, and the entry filters are kept after adding/modifying a new entry to ease the entry/modification of new data.
-
all procs: cannot change default colormap (Matlab and .cpt file) with
*_COLORMAPkeys -
all procs: fdsnws-event data format failed in associating MC3 event types
-
gridmaps: secondary maps crashed with inactive nodes in grid
-
mc3stats: improper default values
-
some issues with grid associated to more than one domain
-
!!scripts showOUTG.pl and showOUTR.pl did not use proper configuration variables. Added inWEBOBS.rc:URN_OUTG|/OUTG URN_OUTR|/OUTR!!A new alias/OUTRmust be added in the Apache configuration:Alias /OUTR /opt/webobs/OUTRor, for non default configurations,
URN_OUTGpointing toROOT_OUTR. -
sefran3 new event window did not close after validation with the latest version of some web browsers (Firefox, Safari).
-
Properly hide trashed events from the Sefran hour view for admin users when the 'trash' checkbox is unchecked in the Sefran hour thumbnail page.
-
Fix redirection error when creating or deleting a folder in the 'wiki' pages.
-
Fix two bugs in the miniseed output of seismic events (available from the MC or the Sefran pages) when using FDSNWS. Also fix the error page display when the miniseed file could not be fetched.
See github commits for details.
In the event editing window, two new buttons in the control left upper menu allow to scroll back or forward the signal window of one minute.
-
New summary graph
MOTIONthat can be added toSUMMARYLISTshowing the displacement particles in a 4-D plot. New variables are:MOTION_EXCLUDED_NODELIST| MOTION_MAFILTER|10 MOTION_SCALE_MM|0 MOTION_MIN_SIZE_KM|10 MOTION_COLORMAP|jet(256) MOTION_DEM_OPT|'colormap',.5*ones(64,3),'watermark',2,'interp' MOTION_TITLE|{\fontsize{14}{\bf${NAME} - Motion} ($timescale)} MOTION_TARGET_INCLUDED|YMAFILTERis a moving-average filter with default 10 samples.MOTION_SCALE_MMcan be used to fix the displacement scale corresponding to 30% of the map width (default0is automatic). -
The target (defined by
GNSS_TARGET_LATLONcoordinates) is systematically included in the summary graphsMODELLINGandMODELTIME. It is possible to add it intoVECTORSandMOTIONsummary graphs with new variables:VECTORS_TARGET_INCLUDED|Y MOTION_TARGET_INCLUDED|Y -
The graphs per node can include a principal component analysis subplot by setting a negative value for key:
PERNODE_TIMEZOOM|-1with some options:
PERNODE_PCA_COLOR|0.3,0.6,0 PERNODE_PCA_MAFILTER|10
Component azimuth from calibration file are now taken into account. Pernode graphs are still showing original components, but summary graphs are using projected components in an orthogonal NS-EW referential.
New summary graph MOTION showing spatial time evolution of tilt at each station. Associated variables are:
SUMMARYLIST|MOTION
MOTION_EXCLUDED_NODELIST|
MOTION_MAFILTER|
MOTION_SCALE_RAD|
MOTION_MIN_SIZE_KM|
MOTION_COLORMAP|
MOTION_DEM_OPT|
MOTION_TITLE|
New default behavior for multiple grid maps: node aliases located into submaps defined by MAP1_XYLIM, MAP2_XYLIM, ... are not shown in the main map and any previous submap. This can be used to avoid text overlap with node swarms. Former behavior can be retrieved using following variable in the grid's configuration:
NODE_SUBMAP_ALIAS|Y
A new option "Anonymous" is available to remove the subtitle with user's name in the produced graphs.
A bug has been fixed in the request results table to show correctly the job status (wait..., ok or error).
-
User's form now allows edition of associated group(s). Associated users in group edition form is still allowed.
-
New tool to edit domains: creation, edition, and grid association.
-
new default option in .rc to force delta antenna to zero (avoid offsets when rinex headers are not consistent)
-
raw2rinexnow manages any gzipped data files (.gz)
This release introduces important improvements in CGI security, in particular register.pl which is not protected by password, but also other scripts now checking input parameters to avoid irregular/unwanted actions.
NODE's location maps now include an altitude value from DEM interpolation, written in the map's comment that may be compared to NODE's altitude given in the configuration.
Sub-menu of seismic bulletin MC3 page now have link(s) to any Sefran3 associated to the displayed MC3. Formerly, it was only a link to the default Sefran3.
Fixed an issue when event seconds are out of range (<0 or >=60).
In the Sefran hourly thumbnails page, added a new checkbox to display/hide trash events, available for Edit/Admin level users only.
The SEFRAN3 configuration key PATH_TMP (in SEFRAN3.conf) is now obsolete. Each sefran will use temporary path defined as $PATH_TMP_WEBOBS/sefran3/SEFRAN3_NAME where $PATH_TMP_WEBOBS is general temporary path defined in WEBOBS.rc and SEFRAN3_NAME is the unique name of the Sefran.
!! Export "Events bulletin" CSV file now have the following colums:
#YYYYmmdd HHMMSS.ss;Nb(#);Duration;Amplitude;Magnitude;Longitude;Latitude;Depth;Type;File;LocMode;LocType;Projection;Operator;Timestamp;ID
The former Valid column (0 = automatic, 1 = manual) has been replaced by columns:
- LocMode: concatenating
manualorautomaticwith optional(confirmed)information from SC3, - LocType: located event type (like
earthquakeornot locatablefrom SC3).
-
Improvements of MODELTIME summary graph:
- source volume variation is now expressed as a flux rate in m^3/s
- additional map with profiles show time evolution of the best sources in space for any subset of time periods
- source models are not computed if there is no data for the most recent time of integration period
-
Improvement of VECTORS summary graph: a subplot shows vector amplitude vs. distance from target (if defined).
-
Improvement of MODELLING summary graph:
- depth and volume variation are displayed as best value +/- uncertainty if
MODELLING_PLOTBESTis true; if not, it displays only interval values that contain ±MODELLING_SIGMASof the best models; - flow rate (in m3/s) is calculated in addition to volume variation;
- volume variation unit is adjusted automatically (m3 or Mm3);
- pCDM source type is now about a hundred times faster than previous versions.
- depth and volume variation are displayed as best value +/- uncertainty if
Some other bug fixes and minor improvements.
!! Default behavior does not show anymore a confirm 'alert' window if the action has succeed. For example, when editing a NODE or GRID configuration. If administrator wants the former behavior, he must set this new key:
CGI_CONFIRM_SUCCESSFUL|YES
All maps using SRTM DEM is now able to merge bathymetry data from ETOPO. Since this might require a minimum of RAM it is possible to disable it with the following key in WEBOBS.rc :
ETOPO_SRTM_MERGE|N
Also, to avoid memory issues with maps, a new key is defined:
DEM_MAX_WIDTH|1201
to automatically decimate any DEM before a plot. The parameter defines the square root of maximum total number of pixels (default corresponds to 1 SRTM3 tile).
Fix and improve of active group functionality in the Gazette (introduced in v2.0.0) and propagate to GRIDS and NODES events.
!! In order to limit the long list of users (that might include non-valid users) when creating a new event, new keys in Gazette.rc:
ACTIVE_GID|+ADMIN,+DUTY
and in WEBOBS.rc:
EVENTS_ACTIVE_GID|+ADMIN,+DUTY
will display only users in the +ADMIN or +DUTY groups (valid or not), for new event in the gazette and in grids/nodes, respectively. Comment or empty these keys to keep the former behavior, i.e., display only the valid users.
As a reminder, once an event is created, editing it will allow selection of all existing users (list of valid first followed by invalid).
!! Default additional menus will be added at upgrade if they do not exist yet for groups +ADMIN, +DUTY, +OBSERVER and +VISITOR. They contain useful links for specific management. A menu is visible only by users associated to the corresponding group. Each menu can be modified or even removed by emptying it at edition.
New form tool to search/display/edit information in the node's events.
The tool link appears as a small magnifying glass icon in the upper
menu of listGRIDS.pl page.
Configuration includes following new keys in NODES.rc:
EVENT_SEARCH_CATEGORY_LIST|grid,alias,feature,author,remote,startdate,title,comment,notebook,outcome
EVENT_SEARCH_MAXDISPLAY_LIST|15,50,75,100
EVENT_SEARCH_DEFAULT|alias
EVENT_SEARCH_DEFAULT2|comment
where
EVENT_SEARCH_CATEGORY_LISTis a list of preset categories to search in,EVENT_SEARCH_MAXDISPLAY_LISTsets the list of maximum events per page,EVENT_SEARCH_DEFAULTandEVENT_SEARCH_DEFAULT2are the default category for first and second search criteria, respectively.
Result table includes links to edit event (if the user has the correct rights to the associated grid), to display the grid or the node's page.
-
PROC page now offers a link to edit events file(s) if defined in configuration. If you experience error like permission denied you might have to change the file rights for Apache user.
-
Fix a bug making any proc crashes when there was only 1 single data sample in a timescale.
-
NODE alias that contains an underscore character is now written normally in the graphs title or label (no TeX interpretation as subscribe position for the next character). TeX formatting is still possible in the graph title, any channel, NODE or PROC names. To display an underscore character in these strings, you must escape it (
\_). -
Calibration file configuration has been moved from local config to the code distribution. The following are not used anymore and can be deleted:
- file
CONF/CLB.conf, - file
CONF/CLBFields.conf, - key parameter
CLB_CONFinWEBOBS.rc, - file
formule_calibration.htmlin the HTML contents.
- file
-
Multiple logos can be defined using coma-separated filenames in
LOGO_FILEandLOGO2_FILEparameters. Logos with be horizontally appended with same height.
Dumping data bulletin and opening miniseed files now open a new empty window or tab in the browser.
In the MC table, a new View icon indicates now that user can only view an event and not modifying it. Only editable events show the Edit icon.
!! Dump .csv bulletin file now includes one additional column with event
ID as "yyyy-mm#id" in the last column.
!! Users with Edit-level authorization are now able to edit any event
of the reserved type AUTO. They are still NOT allowed to modify other
types of event, excepted if they own the event itself.
This new alpha-version superproc reads seismic catalogs from Main Courante and plot some elaborated statistics. The PROC must be associated to a catalog NODE with FID as MC3_NAME. Undocumented yet.
-
!!SUMMARYLISTmust now contain the keywordSUMMARYin the list of summary graphs to make the synthetic all node time series graph. In the former behavior, this summary graph was always made by default. -
New GNSS data format
gipsyxto read outputs from GipsyX 3rd party software (see also next section). -
!!New key to select the misfit L-norm:
MODELLING_MISFITNORM|L1
which is L1-norm by default. To preserve the previous L2-norm in active
proc, this must be changed to L2.
!!New key to limit numerical effects:
MODELLING_MINERROR_PERCENT|1
which set a minimum relative error of 1% (default) for each data before
computing the inverse problem. This is especially useful when there is
a large number of stations (more than 10) and/or for long period of time
(more than 1 year). To get the exact previous behavior, this must be changed to 0.
- New keys to configure improved rendering of summary, pernode and baselines graphs:
COMPONENT_NAMELIST|Relative Eastern,Relative Northern,Relative Vertical
PERNODE_COMPONENT_OFFSET_M|0.01
PERNODE_TIMEZOOM|
SUMMARY_STATION_OFFSET_M|0.01
SUMMARY_COMPONENT_OFFSET_M|0.01
SUMMARY_TIMEZOOM|
BASELINES_REF_OFFSET_M|0.01
BASELINES_TIMEZOOM|
The _TIMEZOOM keys might contain a fraction number (between 0 and 1) which will produce a secondary subplot with a time zoom on the most recent data. For example, set 0.1 will make a zoom on the last 10% of data.
- New key to configure the background basemap options for vectors:
VECTORS_DEM_OPT|'watermark',3,'interp','legend'
The list of options can be any valid parameters for CODE/matlab/dem.m function, such as changing the colormap and lighting effects.
- Some fixes and improved modelling graphic outputs.
For consistency, two updates have been made in genplot superproc configuration, that might require administrators attention when upgrading.
!!The keyNODE_CHANNELShas been renamedPERNODE_CHANNELSfor consistency. Automatic update of any proc configuration will add the following:
PERNODE_CHANNELS|${NODE_CHANNELS}
so the former configuration should be kept. A good administrator practice is to replace the value manually and delete the obsolete NODE_CHANNELS key.
!!The keySUMMARYLISTmust now be set to:
SUMMARYLIST|SUMMARY
to make the summary graph. Empty or commented parameter will lead to no summary graph. The former behavior was to activate the summary graph as the SUMMARYLIST key existed, even empty.
New bash shell scripts and configuration file gnss_run_gipsyx and raw2rinex that use 3rd party programs JPL/GipsyX and Unavco/teqc to process GNSS rawdata
and to produce PPP daily solutions in readable files architecture and names
for the new WebObs gipsyx data format and superproc gnss.
Presently the raw formats accepted are Leica, Trimble and Rinex (standard or Hatanaka), eventually zipped, as daily or hourly files in subdirectories of any architecture using a combination of year, month, day, doy and station code. Multiple files for one day are concatenated.
!!New default color scheme for modelling plots
MODELLING_COLORREF|volpdf
combining the source volume sign and probability using a mirror shading of splitted colormap, for example with default jet colormap, it splits into cold and warm colors (both increasing probability):
- deflation is white-green-violet-blue-dark blue
- inflation is white-yellow-orange-red-dark red
As reminder, the previous default pdf mode uses full colormap from low
to high probability, no volume indication excepted for best model. To reuse the former color scale set the new variable to pdf.
- modelling data error To avoid numerical problems in modelling, there is now a minimum error on absolute displacements with a new key:
MODELLING_MINERROR_MM|5
-
Fix an issue with mseedreq.pl (miniSEED file request) with data source new format configuration in
SEFRAN3.conf(DATASOURCE). -
For MC display and catalogue dump, signal amplitude filter now can use
=(equality, default and former behavior),≤(less or equal to) or≥(greater or equal to) relative to one of the values set inMC3_Amplitudes.conf. -
For web-service MC3 dump function
/cgi-bin/mseedreq.pl, it is possible to add a new argument&tsnew=to request only events that have been modified after a specific timestamp. Full format isyyyymmddTHHMMSSzzzzbut can be truncated anywhere from the right. This function will work only for events that have been edited after this release update.!!Note this functionality uses a new MC data format, mostly backward- compatible: there is no additional column, but column of UID operator is now UID/timestamp when the event is edited. This is totally transparent for sefran3 and MC user interfaces, but if you have third party tools that reads directly the MC files, you might have to adapt them.!!Dump.csvbulletin file now includes two additionnal columns:- Amplitude (inserted after Duration)
- Timestamp (inserted after Operator)
Solves a problem with scevtlog-xml format when some data don't have
preferred magnitude. This affects all quake-compatible superprocs, in
particular hypomap and tremblemaps.
Multiple fixes and improvements in installation.
Fix register security issues and add possibility to change password.
-
New filtering possibility for individual channels, lowpass, highpass or bandpass. See
SETUP/CONF/SEFRAN3_Channels.conffor syntax. -
New key in SEFRAN3.conf file:
FILTER_EXTRA_SECONDS|0
fixes the number of added seconds of signal before the minute beginning to avoid filter border effects.
- Statistic data computed on last minute signals are now integrated in the image metadata itself. Temporary external file defined by the key in SEFRAN3.conf:
CHANNEL_STAT|sefran_chan.dat
is now obsolete and can be deleted.
New parameters for node's events:
- end date & time of the event;
- selected feature (from the node's feature list);
- sensor/data outcome flag (will become functional in the future for associated procs);
- channel (from calibration file if exists, displayed only for node associated with a proc, also possibly functional);
- notebook number (optional);
- notebook forward flag (optional).
End date and time parameters will appear in the Gazette (if
EVENTS_TO_GAZETTE is activated in WEBOBS.rc). Other parameters appear
only in the node's page.
The two optional notebook parameters can be activated by a new NODES.rc
key:
EVENTNODE_NOTEBOOK|YES
Also, new events can have the notify flag checked by default, using
new NODES.rc key:
EVENTNODE_NOTIFY_DEFAULT|YES
When upgrading WebObs, the vimdiff of configuration files has been replaced by a smarter tool: it detects automatically new keys between templates and existing configuration and proposes to add new keys with comment into each files and to edit each of them for double-check.
These operations can be refused by admin. In any case, the SETUP.CONF.README
file will contain the list of all new keys with explicit headers.
-
New kill job command
Add a new command to kill a running job: in the CODE/cgi-bin/schedulerRuns.pl page interface, click on the delete icon on the left of job runs table and confirm. The icon appears only for running jobs.
Also possible using the command line: CODE/shell/scheduler killjob kid=PID
Note that scheduler will use a simple "kill PID" command. No further check.
-
Default values for new job
When creating a new job, default values will apply for some fields:
xeq1 $WEBOBS{JOB_MCC} genplot
interval 3600
maxsysload 0.8
valid N
Possibility to activate an auto-registering for new users, in WEBOBS.rc:
SQL_DB_USERS_AUTOREGISTER|Y
If the user login does not already exists, any new registration will automatically:
- add a new line to /opt/webobs.d/htpasswd apache file,
- add a new user in the WebObs user database with validity 'N' and without any associated group. UID is made from initials of the full name, if necessary adding suffix number.
The new registered user won't have access to WebObs until the WebObs user has been validated by an administrator.
!! Note that /etc/webobs.d/htpasswd file must be writable by Apache user.
Reminder: to delete a webobs user, the corresponding login in htpasswd
file must be deleted first. Any valid login in htpasswd without a
corresponding WebObs user will give a direct access with user Guest.
-
New behavior for NODE's FID_x keys
FID_xkeys are now predefined for each data format (seeCODE/etc/rawformats.conf). The GUI node editor will display and allow edition of all available keys for a given data format.User with admin rights still has possibility to define extra
FID_xkey using the "Parameters" link in NODE's page ("Proc" table cell), and edit the .cnf file manually. -
Improved 'delimiter-separated-values' (dsv) data format
Format
asciidata format has been renamed in 'dsv' and improved using an external gawk preprocessor. See readfmtdata_dsv.m. -
New Campbell Scientific TOB1 data format
New
tob1format to read binary data files. Seereadfmtdata_campbell.m. -
Bug fixes
!!Bug fix with some 'globkval' format data files.!!Bug fix in data export files combined with decimation. -
SVG export
New experimental export of images in SVG format. Set to any proc:
SVGOUTPUT|Y
-
Bug fixes
!!Bug fix with export filenames for baselines. Minor bug fix for linewidth value in baseline (LINEWIDTHLIST). -
Local referential
Possibility to apply a local referential relative to ITRF using a linear velocity vector E,N,U (mm/yr) as a constant trend substracted to all data before any other processing:
VELOCITY_REF|0,0,0
VELOCITY_REF_ORIGIN_DATE|2000-01-01
Origin date is necessary to compute absolute positions, but it will not affect velocities.
-
Residual trends per node
!!When using relative mode (VECTORS_RELATIVE|Y), the per node graphs will show raw positions (blue) together with relative positions (red), i.e., corrected from a global velocity trend. The velocity trend (dashed line) displayed now correspond to the residual trend of the node. -
Baselines pairs
New baselines configuration available to set any pairs of nodes:
BASELINES_NODEPAIRS|
defining a list of reference node and their target nodes, in the format:
reference1,target1a[,target1b,...];reference2,target2a[,target2b,...] reference and target list are node's ALIAS coma separated, graphs are
semicolon separated.
Former behavior of baselines is still supported if `BASELINES_NODEPAIRS` is not
defined: as a reminder, all possible pairs of nodes are plotted, with optional node(s) exclusion list and/or optional node(s) reference list:
BASELINES_EXCLUDED_NODELIST|
BASELINES_REF_NODELIST|
-
Relative vectors (trend)
A new option
VECTORS_RELATIVE_HORIZONTAL_ONLY|Y
setting that default is relative for horizontal components only when
relative mode is active (VECTORS_RELATIVE|Y) in auto mode (VECTORS_VELOCITY_REF is void). It was the default behavior for previous releases.
-
Date selection with local time (but only that)
Possibility to add a local time zone for date/hour selection (for display and statistics) in MC3. But the data and graphs always remain in UTC ! New keys to add in any
MC3.conf:
SELECT_LOCAL_TZ|-4
DEFAULT_SELECT_LOCAL|N
-
Specific authorization resource
Access authorizations to seismic bulletin MC3 and associated Sefran3 are now managed by the following resource names for users/groups:
MCremains default for any existing MC3/Sefran3,MC3_NAMEstands for a specific MC3 with code/name 'MC3_NAME'.
-
New external catalog visit
New key defining the full html link code for external catalog event check when editing an event in MC3:
VISIT_LINK|<A href="http://www.emsc-csem.org/Earthquake/" target="_blank"><B>EMSC</B></A>
which might replace the former USGS_URL key. Note that USGS catalog must be accessed by https:// now:
USGS_URL|https://earthquake.usgs.gov/earthquakes/map
New filter (in addition to event type and status) applying on the 'comment'
field of event which corresponds to MC3 type if the catalog NODE has been
associated to an MC3 buletin (using FID_MC3):
EVENTCOMMENT_EXCLUDED_REGEXP|AUTOMATIC
The filter is using case-insensitive regular expression pattern. Empty or unset value won't filter any event.
In order to limit the long list of users (that might include unvalid users) when creating a new event, a new key in Gazette.rc:
ACTIVE_GID|+DUTY
will display only users in the +DUTY group (valid or not).
!! To keep the former behavior (i.e., display only the valid users), you must comment or empty this key.
!! NOTE: This functionality has been fixed in v2.1.2a.