AWS CLI error with delete objects recursively using include, exclude

Question

I have various sub-directories inside my s3 bucket which contain 2 files, namely:

I wish to delete only the files named as Intermediate_Part1_output.gpkg, leaving the pavement_suitability_final_result.gpkg intact.

I tried the below commands, with no success:

aws s3 rm s3://aitl-data-bucket-backup/4_8_2_processed/ --recursive --exclude "pavement_suitability_final_result.gpkg" --include "Intermediate_Part1_output.gpkg" --dryrun This deletes both the files ignoring my exclude command.
aws s3 rm s3://aitl-data-bucket-backup/4_8_2_processed/ --recursive --exclude "*" --include "Intermediate_Part1_output.gpkg" --dryrun This also deletes both the files ignoring my include command.

Tried various other combinations, but to no avail.

I suspect that it looks at the provided name as the full path of the object rather than just the 'filename' portion. Try something like: --exclude "*" --include "*/Intermediate_Part1_output.gpkg" to allow it to work in subdirectories too. — John Rotenstein, Commented Mar 29 at 0:12
@JohnRotenstein Thank you very much, it worked! Earlier, I had tried using --include "/Intermediate_Part1_output.gpkg" but guess it needed the * too. If you could post your comment as an answer, I would be happy to mark it as accepted. — Swathi Venkatesh, Commented Mar 31 at 9:44

John Rotenstein · Accepted Answer · 2025-04-01 00:04:19Z

0

I suspect that it looks at the provided name as the full path of the object rather than just the 'filename' portion.

Try something like:

--exclude "*" --include "*/Intermediate_Part1_output.gpkg"

This will look for that filename in subdirectories too.

answered Apr 1 at 0:04

John Rotenstein

271k28 gold badges448 silver badges532 bronze badges

Add a comment |

1 Answer 1