Skip to main content

Duplicate Object Storage Finder

Many teams manage storage improperly and fail to follow data lifecycle best practices. As a result, CI/CD pipelines replicate artefacts across multiple buckets, backups are duplicated, and cloud storage costs accumulate. Over time, you end up paying to store the same bytes multiple times across different containers. The Duplicate Object Storage Finder identifies this.

Key features​

  • Cross-environment scanning — Scans your entire environment and identifies duplicate objects even when they are stored in different cloud regions or bucket locations.
  • Content-based matching — Compares file content, not just names or paths. Identical objects are flagged with total accuracy, even when duplicates have different names or live in different directories.
  • Speed and efficiency — The scanning process is optimized to analyze storage quickly without long wait times.

What you'll learn​

This step-by-step guide walks you through:

  1. Getting to the Duplicate Object Storage Finder
  2. Using the page and check history
  3. Running a new check
  4. Understanding the check detail view

Want to learn more? Check out this post — How to find duplicate objects in AWS S3