If you’re curious about the largest items in an AWS S3 bucket, you can use the CLI to print out a list sorted by size. This can help you locate unusually large objects in the bucket which may be taking up space.
Listing and Sorting Items with the S3 CLI
S3 provides some built in sorting options in the menus, so if you’re just looking for the largest item in a folder, you can simply sort that folder. However, if you want to search for all items regardless of key, you’ll need to do so from the AWS CLI. If you don’t have that installed, you can refer to our guide on configuring it to set it up.
The command for listing objects is pretty simple:
This query can take a while to evaluate, since it’s downloading a master list of all objects and their metadata, but you’ll get a JSON array containing an entry for each item, like the following:
To parse and sort this, you can use jq — a fantastic utility for working with JSON on the command line. You can download it from apt, though binaries are also available:
This makes the final command the following, which will still take a while to evaluate, but will print out the largest 100 items in the bucket:
If you want more or less items, you can change the input parameter to the head command, which trims all but the first N lines.
