Audio Dataset Backup

Audio-Dataset-Backup is a Python-based utility designed to gather, snapshot, and package Hugging Face audio datasets into self-contained, version-controlled archives. By pinning datasets to specific revisions and generating comprehensive checksums, the tool ensures data integrity for long-term storage, including support for optical media like M-DISCs. It automatically detects audio content across specified accounts, handles multi-volume splitting for large datasets, and provides both Python-based and shell-scripted restoration methods.

The project streamlines the archival workflow by implementing a multi-stage pipeline that includes discovery, snapshotting, packaging, and verification. It utilizes custom volume presets—such as DVD, BD25, and BD50—to manage storage constraints while maintaining metadata consistency across discs. This tool is intended for developers and researchers who require reliable, offline, and immutable backups of their remote audio data collections.