Change log

You are here: / / Change log

Change log

  • Added additional detail on observed data file names, which now include the location of the observation (gauge name/identifier for BOM, latitude & longitude for SILO).
  • Added additional detail on observed data file headers, which now include location and unit for the value column.
  • Added max temperature data type for SILO.
  • Added depth as an intermediate output on the Riffle model (both methods).
  • Added limit on Riffle model where if modelled depth exceeds maximum possible depth (based on cross section, or width/10 for width roughness) no result is returned for the day. This is because the model is not designed for analysing very high flow days and any result for flows exceeding the channel will not be accurate.

Added Riffles model to Eco Risk Projector

Added a duration parameter to the spawning component of the Australian Bass model. The salinity and temperature range must be met for the duration required, a duration of 1 will produce the same results as previous. This change is based on feedback from real world use of the model.

Added spell analysis to the waterhole persistence model. This change simply adds additional intermediate results, with no change to model assessment results (which are still based on the daily modelled depth). This is to simplify the identification of drying events and provide summary statistics for these events.

Updated spell analysis result field names to always include the term ‘spell’. This will be important as spell analysis functionality is further incorporated into other models.

Updated the default settings of the bulk import tool. Default settings are now location_data_scenario.

Improved the model explore page to only load the data of selected scenarios. This is especially important for the intermediate results view, and vastly improves loading performance for models with many scenarios.

Improved the integration of automatically fetched observed data in the tool by adding observed data setup functionality into existing data file upload locations. Select ‘use observed data’ within a system, model site, or model optimisation to open the observed data tool.

Available sources are:

BOM – Based on gauge (search from available gauge’s by name or identifier)

  • Flow
  • Depth
  • Rainfall
  • Temperature
  • Salinity

SILO – Based on latitude / longitude

  • Rainfall
  • Evaporation

Both sources allow you to optionally specify the start/end year, to only fetch a subset of the available data.

Added a new preselect tab in the model explore scene, to assist in selecting which scenarios to explore on models with 5+ scenarios.

The preselect tab shows the risk change for each scenario with simple charts, where you can then select the scenarios of interest for further examination in the following explore tabs.

A variety of extensive computation improvements to improve the performance, reliability and scalability of the computation service. This was completed to enable climate change scenario modelling, where model runs exceed 100,000,000+ days of analysis. This was completed by moving the computation out of the API and into an individual, highly scalable service. This computation service is triggered by placing tasks into a queue, where the service scales out to many instances in order to handle the load in the queue.

To accompany this change, model runs have been separated out into individual scenario runs. This allows each individual scenario to be computed independently in a massively parallel fashion. Additionally, scenarios now have a pending state (in the queue, but not being computed) along with a progress value (% of locations completed).

This release also includes additional minor changes:

  • Additional spell analysis intermediate result (total number of spells)
  • Change model download settings default values
  • Fix issue on model explore charts when the number of scenarios exceeds 6
  • Fix model explore risk summary table to correctly show all % change values

Added settings to the model results download screen, to customise the format of downloaded files. Added settings are:

  • Use full download names
  • Include daily results in bulk downloads
  • Seperate daily results by node
  • Create combined results

Optimised how the model explore page loads data, to improve the usability on very large models (> 30 locations). Main changes to achieve this are:

  • Defer loading results until they are required. This significantly speeds up the initial load times on large models.
  • Prevent loading results from blocking interaction with the page. This means that whilst waiting for results to load you can still navigate to the other explore tabs and view previously loaded results/downloads.

Added a bulk import feature to improve system setup. Access this tool by clicking the ‘Bulk Import’ button from within a system. Simply drag and drop your files matching the defined naming convention and the tool will create all scenarios, locations and data. This vastly simplifies the process of creating large systems.

Added additional download options for system data:

  • Right click on a location to download all location data
  • Right click on a scenario to download all scenario data
  • Click the ‘Download All’ button to download all system data

Added an Enable/Disable all toggle for model scenarios in the run menu.

Long text (scenario names, location names, data file names, etc.) that is truncated will now show the full text on hover.

Fixed an issue where the season settings for a model in the computation run settings log would be output incorrectly.

Fixed an issue where the Australian Bass model would provide an incorrect failure reason.

Updated how the computation stores in-progress results to vastly reduce memory use and improve memory usage characteristics.

This allows for very large (>30 locations) runs to compute successfully.

Moved the computation timeout from an overall timeout for the whole run to an individual node timeout (5 minutes).

This is required due to increasing run sizes (many nodes and scenarios) exceeding the 20 minute timeout limit.

Added a distinct error when the timeout is exceeded, that is reported in the interface as the reason for failure.

  • Added a data type selector (select the data type to calculate statistics on)
  • Added ARI options to the whole record field (1.5, 2, 5 and 10)
  • Updated the result file format
  • Fix an issue in spell analysis/ simultaneous spell analysis where events in the event log that cover multiple seasons are split into seasons
  • Add summary results that includes statistics calculated with all identified events. See the model documentation for more info.
  • Updated the Catfish (Tandanus) model to include a depth duration parameter, and to assess the flow and depth requirements sequentially, instead of concurrently. See the model documentation page for updated details on the function of this model.
  • Added summary results for the Baseflow separation model. These results are the mean of each indicator (baseflow_index, quickflow_index, baseflow_mean, quickflow_mean) across all years in the data. See the model documentation page for updated details on the function of this model.

The run period of a model is now saved when a model is run. When you re-open the model it will still be present in the run tool.

Modified the default behaviour of the computation to raise an error when invalid data is found. Most common reasons for invalid data are:

  • Missing a date in the timeseries
  • Invalid value on a date
  • Invalid/unrecognisable date

Added an ‘Attempt to run with incomplete data’ option, along with an infill method (infill with no value, or infill with previous valid value). Select this option to force the computation to infill the bad data and still attempt to run the tool. This selection is saved.

The computation will now raise an error if there is no data available to run analysis on. I.E. there is no overlap between the timeseries provided for different data types, or there is no data at all within the provided files. Previously the tool would still attempt to run, producing empty results.

A number of minor improvements to make the tool more robust and intuitive.

  • Renamed comp to compliance in lowflow, freshes and multi-year freshes plugin results. To be consistent with the interface naming.
  • Added compliance lag component to lowflow, freshes and multi-year freshes to allow the user to specify lag in compliance data.
  • Updated the season picker component to better show how a season will be defined by the plugin, and to give the user more control. Date based seasons now include a ‘Analyse incomplete seasons’ checkbox to determine if the computation should run analysis on all years, even if we only have half a season worth of data for a particular year. Temperature based seasons now have a comparison (>=/<=) select, along with the option to use a moving average instead of a daily value for defining a temperature season.
  • Updated the waterhole calibration timeseries charts to maintain the selected legends even when re-loaded after a new run.

The computation service has been reviewed and refactored to improve usability and robustness. The largest resulting change is that the computation now only runs for the period which contains data for all types required.

For instance, if a plugin requires flow and rainfall data and is run with:

  • 10 years of flow from 1/1/2000 to 31/12/2010
  • 5 years of rainfall from 1/1/2000 to 31/12/2005.

Then the analysis will be run from the 1/1/2000 to 31/12/2005 (The longest period where all data is present).

Previously, the computation would run for the period of the main data type (usually flow or depth, depending on the plugin), without considering the periods of the other data provided. This could often cause errors when running, as the computation would attempt to access a data type that didn’t exist. In the example provided above, the computation would previously run for the period of flow data and need to handle missing depth from 1/1/2006 onwards (this could potentially cause un-expected results or errors).

Additionally, the computation now performs more data validation on provided data. This includes:

  • Check for missing days in provided data and infill these days with null values for the missing data types in the combined timeseries
  • Sort provided timeseries by date before running analysis
  • Check more potential date formats when parsing dates

Added a new tab in the model explore screen for intermediate results. Select this tab and you can view visualisations of the intermediate results produced by the model.

This tool dynamically analyses the intermediate results to find all available result types (success, in_season, flow_threshold_met, etc.), along with time scales available (daily or yearly).

Daily results are visualised via a heat map, with days in the x-axis and years on the y-axis. The colour of each day reflects the value for that day, as shown in the legend at the top of the screen. Mouse over the chart and you can find the exact date and value of each day. Additionally, you can adjust the number of days/years shown in the charts via the sliders at the top of the page.

Yearly results are visualised via a timeseries chart, with year on the x-axis and value on the y-axis. You can interact with these charts in the same way as all other timeseries charts in the tool.

Added the ability to preview all system data through a series of visualisations. You can find the ‘preview’ button on the system screen, click it to open the data preview tool.

From within the data preview tool, you can view each data type in a range of combinations, including by scenario (across all locations) and by location (across all scenarios). The tool contains 2 charts:

  • Timeseries (view the provided data)
  • Magnitude duration (calculated in the tool from the provided data)

Both charts support linear/log axis types as well as zooming, panning and saving as an image. Additionally, charts persist both the zoom and legend state when changing your selection, so you can easily compare different data combinations for the same period.

Re-worked the class boundary methods available in the Colwells Index plugin. Available methods are now:

  • Transform
  • Equal
  • Log
  • Weighted Log
  • Gan

See the model documentation here for details of these methods.

Fixed a computation issue where an error would occur whilst running the Baseflow separation plugin, if the period being analysed had 0 total flow (no flow at all in the period)

Added 3 new models:

Added salinity data type

Made some minor styling changes on the explore page

  • Removed upper limit on evaporation scaling % parameter (new range is 0-inf)
  • Removed upper limit on evaporation scaling % in genetic algorithm (model can now potentially optimise evaporation scaling to values > 100%)
  • Added validation on groundwater inflow % and loss to deep drainage % parameters (inflow + loss <= 100%)

Added additional intermediate results on:

  • Simultaneous spell analysis
  • Northern snake-necked turtle
  • Low flow spawning fish

Added

  • Added the spell analysis plugin, incorporating above threshold, below threshold, and range spells analysis methods into a single plugin
  • Added the simultaneous spell analysis plugin, with the ability to consider simultaneous spells across multiple locations with lag.
  • Added a run settings log file, which is generated every time the computation is run. Any and all runs of the Eco Risk Projector computation will now include a run settings log of all parameters, including parameters calculated by the computation (For example; ARI threshold or median flow value).

Changed

  • Improved tool tips, units, and labels for better user experience.
  • Updated combined results, split daily results, scenario level download, and across-scenario level download options.
  • Revisited and revised the computation for the Northern Snake Neck turtle.
  • Major updates to waterhole calibration processes, including:
    • Split calibration screen into 2 different modals; calibration and run to empty
    • Added a number of additional predictors
    • Allow saving of optimisation parameters
    • Allow uploading of data for optimisation only

Added

  • Added a maximum inundation threshold for recruitment success on Mary River turtles. This feature also provides inundation percentage and risk level as an intermediate result.
  • Added intermediate results to most plugins.
  • Added waterhole calibration feature.

Changed

  • Improved clarity on optional field groups such as ARI vs Threshold.
  • Enabled the use of default scenario flow data for ARI calculation.
  • Updated ARI Algorithm to use a peak-over-threshold approach instead of the previous annual maximums approach.
  • Renamed all plugins to more informative names, including scientific names.
  • Split the Across Years Assessment algorithm into two sections: one for binary yearly results and another to convert results from unbounded yearly results.

Fixed

  • Fixed an issue where the Explore Opportunities tooltip was showing an incorrect year range.
  • Updated the Across Years Assessment algorithm to not give results when there aren’t enough years to satisfy the rule.

Removed

  • Removed non-variable Lowflow, Freshes, Oversupply, and Multiyear Freshes plugins.

Eco Risk Projector is official alive and presented at a training workshop to the Queensland Department of Environment and Science.

Support and feedback

If you need some support, find any bugs or odd behaviour, or would like to give us some feedback about Eco Risk Projector please feel free to contact us.

Contact

Truii-logo-reverse-no clear space

Eco Risk Projector is a Truii product.

If you are interested in learning more about Truii and viewing their full range of data-driven web applications, follow the link below.

Find out more about Truii >>