TSTool AWS Plugin / Release Notes
Release notes are available for the core TSTool product and plugin. The core software and plugins are maintained separately and may be updated at different times. See the TSTool release notes.
Plugin release notes are listed below. The repository issue for release note item is shown where applicable.
- Version 1.5.2
- Version 1.5.1
- Version 1.5.0
- Version 1.4.2
- Version 1.4.1
- Version 1.4.0
- Version 1.3.0
- Version 1.2.0
- Version 1.1.1
- Version 1.1.0
- Version 1.0.0
Version 1.5.3
Maintenance release to improve the AwsBilling command.
Update the AwsBillingcommand:- [#50] Add VPN and Elastic IP services to the service properties table.
- [#50] Add public and private IP and DNS name output to the service properties table.
Version 1.5.2
Maintenance release to improve the AwsBilling command.
Update the AwsBillingcommand:- [#51] Grouped data or total data can be read, but not both with one command. This change reflects the features of the AWS API. Command parameter names were renamed to be more explicit.
- [#48] New parameters are available to output service properties,
useful to check that tags are defined as expected:
EBSSnapshotsTableID- lists EBS snapshotsEC2PropertiesTableID- lists EC2 and related service propertiesEC2ImagesTableID- lists EC2 images (Amazon Machine Images, AMI)
Version 1.5.1
Maintenance release to fix CloudFront invalidation issue.
[#46] Update the AwsS3command:- Paths that are invalidated previously had
*automatically appended. This resulted in hitting the limit of 15 paths with wildcards. The wildcard is no longer automatically added. If necessary, use theAwsCloudFrontcommand for more control of invalidations.
- Paths that are invalidated previously had
Version 1.5.0
Feature release to add AwsBilling command.
[#43] Add the AwsBillingcommand:- Query AWS Cost Explorer costs in tabular form.
- Create time series for cost records.
Version 1.4.2
Maintenence release to improve workflow integration.
[#41] Update the AwsCloudFrontcommand:- Add the
Tagscommand parameter to specify the CloudFront distribution using tag(s).
- Add the
[#41] Update the AwsS3command:- Add the
CloudFrontTagscommand parameter to specify the CloudFront distribution using tag(s).
- Add the
[#41] Update the AwsS3LandingPagecommand:- Add the
CloudFrontTagscommand parameter to specify the CloudFront distribution using tag(s).
- Add the
Version 1.4.1
Maintenence release to refresh data when new profile is selected in command editors.
[1.4.1] Fix the root URL to command help pages.
[1.4.1] Update the AwsCloudFrontcommand:- Fix bug where changing the AWS profile did not update the distribution ID choices.
[1.4.1] Update the AwsCloudFrontcommand:- Fix bug where changing the AWS profile did not refresh the bucket choices.
[1.4.1] Update the AwsCloudFrontcommand:- Fix bug where changing the AWS profile did not refresh the bucket choices.
Version 1.4.0
Feature release to improve creation of landing pages.
[1.4.0] Fix bug in the AwsS3LandingPagecommand:- An
UploadFilesparameter with wildcard was causing the first S3 file to be overwritten with each local file. This has been fixed.
- An
[1.4.0] Update the AwsS3LandingPagecommand:- Change the
DatasetIndexHeadFileparameter toDatasetIndexHeadInsertTopFilesto provide more clarity and flexibility. - Change the
DatasetIndexBodyFileparameter toDatasetIndexBodyInsertTopFilesto provide more clarity and flexibility. - Change the
DatasetIndexFooterFileparameter toDatasetIndexBodyInsertBottomFilesto provide more clarity and flexibility. - The above command parameters are automatically migrated when the command file is read.
- Change the
Version 1.3.0
Feature release to add command indentation, compatible with TSTool 14.6.0.
[1.3.0] Update the plugin commands to implement command indentation
compatible with TSTool 14.6.0 command indentation features.
Version 1.2.0
Feature release to add the S3 Browser application and significant cleanup of all commands for consistency and to simplify use.
[1.2.0] Update the AwsS3command with the following general changes:- ** Significant changes to command parameters have been made. Old command files will need to be updated to use the new syntax.**
- In general, use "folder" rather than "directory" in terminology and command parameters.
For eample,
DownloadDirectorieshas been replaced withDownloadFolders. - Emphasize "files" and "folders" where appropriate rather than using "keys".
For example
DeleteKeyhas been replaced withDeleteFilesandDeleteFolders. - Where possible, allow multiple files and folders to be processed in one command in order to streamline workflows. Command parameter editors have been improved to provide editing tools for comma-separated lists and dictionary maps.
- Constraints for folders have been tightened,
including requiring
/at the end of folder S3 object keys to clearly identify folders compared to files. This allows for more explicit error handling. - Treat folder keys that start with
/similar to other keys, although S3 bucket objects typically don't use/at the root level. - Enhance the documentation to be more detailed.
- Implement automated tests for all S3 commands to verify functionality and link to the automated tests for examples.
- More extensive error handling has been added to detect input errors.
- Add the
AppendOutputparameter to Output tab parameters to allow multiple S3ListBucketsandListObjectscommands to append output in the table and file. - Add the CloudFront tab parameters to allow new or changed S3 objects to automatically
be invalidated for the CloudFront distribution associated with the S3 bucket.
Consequently, a separate
AwsCloudFrontcommand can be avoided in many cases.
[1.2.0] Update the AwsS3CopyObjectscommand:- The command now allows copying multiple objects.
The previous
CopyObjectS3 command has been changed toCopyObjects(plural). - The previous
CopySourceKeyandCopyDestKeyparameters are no longer supported. - The
CopyFiles,CopyBucket(for destination bucket), andCopyObjectsCountPropertyparameters have been added. - Copying folders is not currently supported but may be added in the future.
- The command now allows copying multiple objects.
The previous
[1.2.0] Update the AwsS3DeleteObjectscommand:- The command has been changed from
DeleteObjecttoDeleteObjects(plural). - The command now allows deleting multiple files and folders. Deleting a folder automatically lists the folder contents and then deletes the file objects.
- The
DeleteFilesandDeleteFoldersparameters have been added to specify the objects to delete. - The
DeleteFoldersMinDepthparameter has been added to guard against deleting high-level files and folders. - The
DeleteFoldersScopeparameter has been added to control whether only files in a folder, or the folder and all of its contents are deleted.
- The command has been changed from
[1.2.0] Update the AwsS3DownloadObjectscommand:- The
DownloadDirectoriesparameter has been changed toDownloadFolders. - Added support for
*wildcard in local file names when downloading files.
- The
[1.2.0] Update the AwsS3ListBucketscommand:- Added the
ListBucketsRegExparameter to filter bucket output. - Added the
ListBucketsCountPropertyparameter to set a processor property to the list size, which is useful for error checks and automated tests.
- Added the
[1.2.0] Update the AwsS3ListObjectscommand:- Changed the command from
ListBucketObjectstoListObjectsconsistent with other command names. - Add the
ListObjectsScopeparameter to indicate whether only files in a folder or all files and subfolder contents will be listed. - Add the
Prefixparameter to filter the object list. - Add the
Delimiterparameter to allow specifying a folder delimiter other than the default (/). - Add the
ListObjectsRegExparameter to filter the object list. - Add the
ListFilesandListFoldersparameters to filter by object type. - Add the
ListObjectsCountPropertyparameter to set a processor property to the list size, which is useful for error checks and automated tests.
- Changed the command from
[1.2.0] Update the AwsS3UploadObjectscommand:- The
UploadDirectoriesparameter has been changed toUploadFolders.
- The
[1.2.0] Update the AwsCloudFrontcommand:- Enhance the documentation to be more detailed.
- Implement automated tests for all CloudFront commands to verify functionality and link to the automated tests for examples.
- Add the form for editing the invalidation paths.
- Add the
ListDistributionsCountPropertyandListInvalidationsCountPropertyparameters to set to the count of the output list. - Add the
InvalidationStatusparameter when listing invalidations to allow filtering on the status. - Enable output to a file.
[1.2.0] Split the previous AwsS3Catalogcommand to add the newAwsS3LandingPagecommand to simplify the functionality of each command. Previous command files that used theAwsS3Catalogcommand need to be updated to use theAwsS3LandingPagecommand. TheAwsS3LandingPagecommand has been modified from the previoius as follows:- The command editor dialog has been updated to provide more information explaining the parameters.
- The AWS S3 tab has been added to the editor and includes parameters related to the AWS S3 connection.
- The command now focuses only on creating dataset landing pages and features to create a dataset catalog (list of datasets) have been removed.
- The
StartingPrefixparameter has been renamed toStartingFolder. - The
ProcessSubdirectoriesparameter has been renamed toProcessSubfolders. - The
UploadDatasetFilesparameter has been renamed toUploadFiles. - The HTML Inserts tab has been added to the command editor for HTML-related landing page insert files.
- The Markdown Inserts tab has been added to the command editor for Markdown-related landing page insert files.
- The Output tab has been removed from the command editor since these features were used with the catalog landing page.
- The CloudFront tab has been added to the command editor with parameters similar to the
AwsS3command to automate CloudFront invalidations. The previousDistributionIdhas been renamed toCloudFrontDistributionIdfor consistency.
[1.2.0] Add the Browse S3 button to command editors,
which starts a separate S3 Browser application to browse S3 objects.
This application will be enhanced over time to improve integration of the plugin with S3
and to minimize the need to use the AWS console.
For example, use the S3 Browser to determine the keys to use for file and folder objects to use in command parameters.
Version 1.1.1
Maintenance release to add more error handling and improve usability.
[1.1.1] Update the AwsS3command:- Display default values for the profile and region.
- Add warning messages if the AWS user configuration file does not exist.
- Better handle default values for profile and region and don't allow a default bucket.
- Show the correct editor tab based on the S3 command.
[1.1.1] Update the AwsS3Catalog:- Display default values for the profile and region.
- Add warning messages if the AWS user configuration file does not exist.
- Better handle default values for profile and region.
- Add support for generating Markdown landing page.
- Add the
ProcessSubdirectoriesparameter to control whether subdirectories should be processed, which provides flexibility to process main dataset landing page without recursively processing child folders.
[1.1.1] Update the AwsCloudFrontcommand:- Display default values for the profile and region.
- Add warning messages if the AWS user configuration file does not exist.
- Better handle default values for profile and region.
- Show the correct editor tab based on the CloudFront command.
[1.1.1] Update the AWS SDK library:- The
software.amazon.aswssdklibraries fors3,cloudfront, ands3-transfer-managerhave been updated from version 2.17.198 to 2.18.19. - The
software.amazon.aswssdk.crtlibrary foraws-crthas been updated from version 0.16.13 to 0.19.10.
- The
Version 1.1.0
Feature release to add the AwsS3Catalog command.
[1.1.0] Update the AwsCloudFrontcommand:- Fix issue where waiting for invalidation to complete was not occurring.
[1.1.0] Add the AwsS3Catalogcommand to generate landing pages for S3 datasets.
[1.1.0] Update the AwsS3command:- Allow the file pattern for upload to contain wildcards.
Version 1.0.0
Initial release.
[1.0.0] The initial release includes the following commands: