Release Notes

v1.4.37 (2019-07-05)

Added:
  • SpectX UI: last login time to users table in Users tab under “Admin - Users & Groups” menu
  • Possibility to disable authentication for particular containers in SourceAgent
  • SourceAgent and SpectX - possibility to configure startup at boot in Linux (with Systemd/SysV-style init/Upstart init systems)
  • Filter(ES_QUERY()) support for ElasticSearch 5.6.*
Changed:
  • SourceAgent and SpectX - Linux/OSX startup scripts spectx-init.d.sh and sa-init.d.sh renamed to spectx.sh and sa.sh correspondingly. Helper scripts spectx.common.* removed.

v1.4.36 (2019-06-13)

Added:
  • IWA authenticator: configurable LDAP group name transformation and possibility to abandon group membership information retrieval with user information LDAP query.
  • IWA authenticator: fallback to basic authentication which allows users from machines not joined to Active Directory domain to log in to SpectX with their domain username and password
  • SourceAgent: per-container authentication support
  • SpectX default environment setup script for linux/osx platforms sets umask to 0077.
  • JRE-bundled packages with SpectX, SourceAgent and Compression utility for Arch Linux ARM 64bit (aarch64)
  • UI: Chart supports multiple x-axes to visualize two sets of superimposed value ranges
  • Parsing JSON objects now allows exporting selected members directly to resultset columns using JSON{...}(flat=true) config parameter
  • User Defined Functions can now include multiple statements.
  • New functions: GZIP(), GUNZIP()
Changed:
  • Improved listing operations optimisation in cloud (Amazon/Azure/Google) data stores.
  • SourceAgent audit logs format has been changed: a new field (#6) has been added to log records. The filed indicates properties of an authentication key used in requests.
  • Blobs disallowed from reading by blob Read ACL are not displayed in data browser and get not included in listing result by default; new settings for both data browser and listing can be used to configure the behavior correspondingly
Fixed:
  • Globbed blob read ACLs with exact match for gzip files in SA/SAS datastores deny processing of these files if these get indexed on SourceAgent side.
  • In Firefox 67+ submenus of menu ‘Save’ > ‘Result As’ do not work
  • Chart legend does not respond to resize when many columns are displayed

v1.4.35 (2019-04-23)

Added:
  • IWA authenticator: support for multiple search bases in user and group LDAP query filter expressions
  • Elasticsearch support: indexes & structure listing, native search using Query String
  • DataAccess/S3: support for path-style access to buckets
Changed:
  • Elasticsearch support: enhanced control over large responses from Elasticsearch, optimized search predicate delegation by object subfields
Fixed:
  • UI: Incorrect group list rendering in user properties window in case of list sizes greater than 40.

v1.4.34 (2019-04-01)

Fixed:
  • Elasticsearch support: connectivity issues to 6.6+ clusters

v1.4.33 (2019-03-29)

Added:
  • UI:
    • Update download progress indication and cancelling possibility in SpectX Update dialog.
    • Data Store editor: glob patterns can be used in data store Read ACL definitions, in addition to prefixed uri paths.
    • Resource tree filter. Defaults to filename filter, c:<string> searches for files containing ‘string’, and t:<hour/day/week> searches for files modified last hour/day/week.
    • Result set _raw_text column contents exportable to file from ‘Save’ and right click context menus
    • Query filter creation from resultset selection supports time ranges for timestamp columns
  • Support for reading data from ZIP archives. See more at Working With Zip Archives.
  • UserAdmin role.
Changed:
  • Engine:
    • Increased processing speed of Bzip2 files on Intel-based 64 bit OSX and Linux platforms by 20%.
  • UI:
    • Improved editor auto-completion in nested function calls
    • Data Store Editor: ‘.’ symbol is allowed in store name
Fixed:
  • UI:
    • Map feature properties popup displays correct values for tuple type columns
    • Export of chart with column names containing non-ASCII characters

v1.4.31 (2019-02-22)

Changed:
  • SpectX configuration keys engine.fs_access and engine.fs_unmanaged_access are deprecated. Instead, new configuration keys engine.da.protocol.<protocol> can be used to define usage permissions for each data access protocol separately.

v1.4.30 (2019-02-11)

Added:
  • DataAccess/HDFS: High availability clusters accessibility support

v1.4.29 (2019-02-08)

Added:
  • Functions: INDEXOF, ROT13, ESCAPE_OCTAL
Changed:
  • OpenJDK 8 HotSpot Java Runtime Environment is now supported (see more at Installation)
  • DataAccess/HDFS: improved accessing secure HDFS clusters with multiple Kerberos authentication realms configured
Fixed:
  • On Windows, Data Browser started by pressing Browse button in data store configuration editor window for previously stored configuration, fails to connect to the data store.

v1.4.28 (2019-01-10)

This release contains bug fixes, a few new features and some improvements.

Added:
Changed:
  • Reading data from relational databases: refactored input stream commands
  • UI:
    • Data Store editor: the browse-button uses real-time values in the editor form to connect to the data store. Browsing is restricted to the currently editable store only.
    • DataBrowser: keyboard navigation improved. Arrow, Pg Down/Up, Enter and Backspace keys can be used for navigation in all views.
    • “Admin - Users & Groups” menu: added descriptive text to the User/Group/ExtGroupMapping deletion dialogs.
    • “System status” menu: remastered Effective Settings view.
    • Script and Pattern editors: removed ctrl - shift - arrow tab navigation, text of displayed error messages made selectable.
    • The full name of a logged in user (if set) is used instead of a username in the rightmost menu at the top bar
    • Background version checker: connection exception logging with debug log level (previously: error log level).
  • Engine:
    • Improved processing performance of concatenated GZ/ZZ/PiGZ/PiZZ files.
    • Increased processing speed of GZ/ZZ/PiGZ/PiZZ files on Intel-based 64 bit OSX and Linux platforms by 20%.
Fixed:
  • Listing queries for cloud (Amazon/Azure/Google cloud) targets with the ‘includeContainers’:true argument.
  • Removed unnecessary creation of the folder “users” under the path specified by the config parameter sx.user_data.dir.
  • Failure to attempt to create own log directory on the very first run fixed in both SpectX and SourceAgent startup Windows scripts.