TSTool AWS Plugin / Release Notes
Release notes are available for the core TSTool product and plugin. The core software and plugins are maintained separately and may be updated at different times. See the TSTool release notes.
Plugin release notes are listed below. The repository issue for release note item is shown where applicable.
- Version 1.5.6
- Version 1.5.5
- Version 1.5.4
- Version 1.5.3
- Version 1.5.2
- Version 1.5.1
- Version 1.5.0
- Version 1.4.2
- Version 1.4.1
- Version 1.4.0
- Version 1.3.0
- Version 1.2.0
- Version 1.1.1
- Version 1.1.0
- Version 1.0.0
Version 1.5.6
Maintenance release to improve the AwsS3
command for versions and tags.
- Update the
AwsS3
command:- [#53] The
ListObjects
command now properly sets the output table for discovery mode when a property is used in the table name. This allows other command editors to see the table name with unexpanded property. - [#54] Add features to tag objects and handle versions:
- Add the
TagObjects
S3 command withTags
andTagMode
parameters to allow tagging existing objects. - Update the
UploadObjects
S3 command with newUploadTags
andUploadTagMode
parameters to allow tagging objects as they are uploaded. - Update the
ListObjects
S3 command with newListVersions
parameter so that versioned objects can be listed andOutputObjectTags
parameter to control whether tags are output. - Update the command to show progress in cases where the number of operations is known, such as uploading and tagging files.
- Update the
ListBuckets
S3 command to allow selecting a specific bucket or*
for all buckets. All other S3 commands operate on a single selected bucket. This functionality may be expanded in the future to other S3 commands. - Improve command editor error checking to make sure that specified parameters are only used with the S3 command being run.
- Add the
- [#53] The
Version 1.5.5
Maintenance release to improve the AwsS3
command.
- Update the
AwsS3
command:- [#52] Missing local files now do not stop the upload. Other errors in input will cause the command to not run.
Version 1.5.4
Maintenance release to improve the AwsBilling
command.
- Update the
AwsBilling
command:- [#50] Fix VPN connection and Elastic IP service properties table output to show tags.
Version 1.5.3
Maintenance release to improve the AwsBilling
command.
- Update the
AwsBilling
command:- [#50] Add VPN connection and Elastic IP services to the service properties table.
- [#50] Add public and private IP and DNS name output to the service properties table.
Version 1.5.2
Maintenance release to improve the AwsBilling
command.
- Update the
AwsBilling
command:- [#51] Grouped data or total data can be read, but not both with one command. This change reflects the features of the AWS API. Command parameter names were renamed to be more explicit.
- [#48] New parameters are available to output service properties,
useful to check that tags are defined as expected:
EBSSnapshotsTableID
- lists EBS snapshotsEC2PropertiesTableID
- lists EC2 and related service propertiesEC2ImagesTableID
- lists EC2 images (Amazon Machine Images, AMI)
Version 1.5.1
Maintenance release to fix CloudFront invalidation issue.
- [#46] Update the
AwsS3
command:- Paths that are invalidated previously had
*
automatically appended. This resulted in hitting the limit of 15 paths with wildcards. The wildcard is no longer automatically added. If necessary, use theAwsCloudFront
command for more control of invalidations.
- Paths that are invalidated previously had
Version 1.5.0
Feature release to add AwsBilling
command.
- [#43] Add the
AwsBilling
command:- Query AWS Cost Explorer costs in tabular form.
- Create time series for cost records.
Version 1.4.2
Maintenence release to improve workflow integration.
- [#41] Update the
AwsCloudFront
command:- Add the
Tags
command parameter to specify the CloudFront distribution using tag(s).
- Add the
- [#41] Update the
AwsS3
command:- Add the
CloudFrontTags
command parameter to specify the CloudFront distribution using tag(s).
- Add the
- [#41] Update the
AwsS3LandingPage
command:- Add the
CloudFrontTags
command parameter to specify the CloudFront distribution using tag(s).
- Add the
Version 1.4.1
Maintenence release to refresh data when new profile is selected in command editors.
- [1.4.1] Fix the root URL to command help pages.
- [1.4.1] Update the
AwsCloudFront
command:- Fix bug where changing the AWS profile did not update the distribution ID choices.
- [1.4.1] Update the
AwsCloudFront
command:- Fix bug where changing the AWS profile did not refresh the bucket choices.
- [1.4.1] Update the
AwsCloudFront
command:- Fix bug where changing the AWS profile did not refresh the bucket choices.
Version 1.4.0
Feature release to improve creation of landing pages.
- [1.4.0] Fix bug in the
AwsS3LandingPage
command:- An
UploadFiles
parameter with wildcard was causing the first S3 file to be overwritten with each local file. This has been fixed.
- An
- [1.4.0] Update the
AwsS3LandingPage
command:- Change the
DatasetIndexHeadFile
parameter toDatasetIndexHeadInsertTopFiles
to provide more clarity and flexibility. - Change the
DatasetIndexBodyFile
parameter toDatasetIndexBodyInsertTopFiles
to provide more clarity and flexibility. - Change the
DatasetIndexFooterFile
parameter toDatasetIndexBodyInsertBottomFiles
to provide more clarity and flexibility. - The above command parameters are automatically migrated when the command file is read.
- Change the
Version 1.3.0
Feature release to add command indentation, compatible with TSTool 14.6.0.
- [1.3.0] Update the plugin commands to implement command indentation compatible with TSTool 14.6.0 command indentation features.
Version 1.2.0
Feature release to add the S3 Browser application and significant cleanup of all commands for consistency and to simplify use.
- [1.2.0] Update the
AwsS3
command with the following general changes:- ** Significant changes to command parameters have been made. Old command files will need to be updated to use the new syntax.**
- In general, use "folder" rather than "directory" in terminology and command parameters.
For eample,
DownloadDirectories
has been replaced withDownloadFolders
. - Emphasize "files" and "folders" where appropriate rather than using "keys".
For example
DeleteKey
has been replaced withDeleteFiles
andDeleteFolders
. - Where possible, allow multiple files and folders to be processed in one command in order to streamline workflows. Command parameter editors have been improved to provide editing tools for comma-separated lists and dictionary maps.
- Constraints for folders have been tightened,
including requiring
/
at the end of folder S3 object keys to clearly identify folders compared to files. This allows for more explicit error handling. - Treat folder keys that start with
/
similar to other keys, although S3 bucket objects typically don't use/
at the root level. - Enhance the documentation to be more detailed.
- Implement automated tests for all S3 commands to verify functionality and link to the automated tests for examples.
- More extensive error handling has been added to detect input errors.
- Add the
AppendOutput
parameter to Output tab parameters to allow multiple S3ListBuckets
andListObjects
commands to append output in the table and file. - Add the CloudFront tab parameters to allow new or changed S3 objects to automatically
be invalidated for the CloudFront distribution associated with the S3 bucket.
Consequently, a separate
AwsCloudFront
command can be avoided in many cases.
- [1.2.0] Update the
AwsS3
CopyObjects
command:- The command now allows copying multiple objects.
The previous
CopyObject
S3 command has been changed toCopyObjects
(plural). - The previous
CopySourceKey
andCopyDestKey
parameters are no longer supported. - The
CopyFiles
,CopyBucket
(for destination bucket), andCopyObjectsCountProperty
parameters have been added. - Copying folders is not currently supported but may be added in the future.
- The command now allows copying multiple objects.
The previous
- [1.2.0] Update the
AwsS3
DeleteObjects
command:- The command has been changed from
DeleteObject
toDeleteObjects
(plural). - The command now allows deleting multiple files and folders. Deleting a folder automatically lists the folder contents and then deletes the file objects.
- The
DeleteFiles
andDeleteFolders
parameters have been added to specify the objects to delete. - The
DeleteFoldersMinDepth
parameter has been added to guard against deleting high-level files and folders. - The
DeleteFoldersScope
parameter has been added to control whether only files in a folder, or the folder and all of its contents are deleted.
- The command has been changed from
- [1.2.0] Update the
AwsS3
DownloadObjects
command:- The
DownloadDirectories
parameter has been changed toDownloadFolders
. - Added support for
*
wildcard in local file names when downloading files.
- The
- [1.2.0] Update the
AwsS3
ListBuckets
command:- Added the
ListBucketsRegEx
parameter to filter bucket output. - Added the
ListBucketsCountProperty
parameter to set a processor property to the list size, which is useful for error checks and automated tests.
- Added the
- [1.2.0] Update the
AwsS3
ListObjects
command:- Changed the command from
ListBucketObjects
toListObjects
consistent with other command names. - Add the
ListObjectsScope
parameter to indicate whether only files in a folder or all files and subfolder contents will be listed. - Add the
Prefix
parameter to filter the object list. - Add the
Delimiter
parameter to allow specifying a folder delimiter other than the default (/
). - Add the
ListObjectsRegEx
parameter to filter the object list. - Add the
ListFiles
andListFolders
parameters to filter by object type. - Add the
ListObjectsCountProperty
parameter to set a processor property to the list size, which is useful for error checks and automated tests.
- Changed the command from
- [1.2.0] Update the
AwsS3
UploadObjects
command:- The
UploadDirectories
parameter has been changed toUploadFolders
.
- The
- [1.2.0] Update the
AwsCloudFront
command:- Enhance the documentation to be more detailed.
- Implement automated tests for all CloudFront commands to verify functionality and link to the automated tests for examples.
- Add the form for editing the invalidation paths.
- Add the
ListDistributionsCountProperty
andListInvalidationsCountProperty
parameters to set to the count of the output list. - Add the
InvalidationStatus
parameter when listing invalidations to allow filtering on the status. - Enable output to a file.
- [1.2.0] Split the previous
AwsS3Catalog
command to add the newAwsS3LandingPage
command to simplify the functionality of each command. Previous command files that used theAwsS3Catalog
command need to be updated to use theAwsS3LandingPage
command. TheAwsS3LandingPage
command has been modified from the previoius as follows:- The command editor dialog has been updated to provide more information explaining the parameters.
- The AWS S3 tab has been added to the editor and includes parameters related to the AWS S3 connection.
- The command now focuses only on creating dataset landing pages and features to create a dataset catalog (list of datasets) have been removed.
- The
StartingPrefix
parameter has been renamed toStartingFolder
. - The
ProcessSubdirectories
parameter has been renamed toProcessSubfolders
. - The
UploadDatasetFiles
parameter has been renamed toUploadFiles
. - The HTML Inserts tab has been added to the command editor for HTML-related landing page insert files.
- The Markdown Inserts tab has been added to the command editor for Markdown-related landing page insert files.
- The Output tab has been removed from the command editor since these features were used with the catalog landing page.
- The CloudFront tab has been added to the command editor with parameters similar to the
AwsS3
command to automate CloudFront invalidations. The previousDistributionId
has been renamed toCloudFrontDistributionId
for consistency.
- [1.2.0] Add the Browse S3 button to command editors, which starts a separate S3 Browser application to browse S3 objects. This application will be enhanced over time to improve integration of the plugin with S3 and to minimize the need to use the AWS console. For example, use the S3 Browser to determine the keys to use for file and folder objects to use in command parameters.
Version 1.1.1
Maintenance release to add more error handling and improve usability.
- [1.1.1] Update the
AwsS3
command:- Display default values for the profile and region.
- Add warning messages if the AWS user configuration file does not exist.
- Better handle default values for profile and region and don't allow a default bucket.
- Show the correct editor tab based on the S3 command.
- [1.1.1] Update the
AwsS3Catalog
:- Display default values for the profile and region.
- Add warning messages if the AWS user configuration file does not exist.
- Better handle default values for profile and region.
- Add support for generating Markdown landing page.
- Add the
ProcessSubdirectories
parameter to control whether subdirectories should be processed, which provides flexibility to process main dataset landing page without recursively processing child folders.
- [1.1.1] Update the
AwsCloudFront
command:- Display default values for the profile and region.
- Add warning messages if the AWS user configuration file does not exist.
- Better handle default values for profile and region.
- Show the correct editor tab based on the CloudFront command.
- [1.1.1] Update the AWS SDK library:
- The
software.amazon.aswssdk
libraries fors3
,cloudfront
, ands3-transfer-manager
have been updated from version 2.17.198 to 2.18.19. - The
software.amazon.aswssdk.crt
library foraws-crt
has been updated from version 0.16.13 to 0.19.10.
- The
Version 1.1.0
Feature release to add the AwsS3Catalog
command.
- [1.1.0] Update the
AwsCloudFront
command:- Fix issue where waiting for invalidation to complete was not occurring.
- [1.1.0] Add the
AwsS3Catalog
command to generate landing pages for S3 datasets. - [1.1.0] Update the
AwsS3
command:- Allow the file pattern for upload to contain wildcards.
Version 1.0.0
Initial release.
- [1.0.0] The initial release includes the following commands: