大文件版本控制,bfsync 0.3.3 發布
bfsync 是一個為大文件提供 git 風格的版本控制的程序,文件內容使用 bfsync 管理,使用 git 資料庫來完成版本控制,資料庫只存儲數據文件的哈希值。
Bfsync所能實現的功能:
- synchronize a collection of big files between many machines, where the collection is changed independently on different machines
- offline commits, so you can change files and commit on your laptop and resynchronize as soon as you have network connectivity again
- file-level deduplication, so storing a file twice under different names will not use more space than storing it once - also renames or removing a file and re-adding it will not retransfer the data, if the repository already has it
- storing all attributes, bfsync stores everything a normal filesystem would store, like user/group settings, permissions, symlinks, hard links, devices, ... (this is useful for backups)
- storing each file only once: many version control systems store files two times on the users machines, once internally and a second time as "checkout"; especially for huge files (mp3s, photos, videos) this is not convenient. bfsync stores each file only once, and provides a view on the data in the FuSE filesystem; it uses copy-on-write if a file is modified
- old versions remain available: bfsync keeps all files and all versions available in each checkout; within the filesystem there is a .bfsync/commits/N directory for all commits, so you can look at all old versions from within the filesystem
- rate-limiting: since big files take extremely long to transfer, bfsync allows to limit the bandwidth used for file transfer, so it can run in background without disturbing your normal work
- 管理海量文件: since bfsync can be used for backups, the algorithms that are required for this use case have been optimized for speed and memory usage; other algorithms (like the merge algorithm) are not so optimized - if you have really lots of files (like 5.000.000 files), you can use bfsync to manage them, but some features like merging will not be usable
bfsync 0.3.3 版本降低對 clone/pull 的內存消耗,提升了性能,修復了 bfsyncfs umount 程序崩潰的問題。
本文由用戶 jopen 自行上傳分享,僅供網友學習交流。所有權歸原作者,若您的權利被侵害,請聯系管理員。
轉載本站原創文章,請注明出處,并保留原始鏈接、圖片水印。
本站是一個以用戶分享為主的開源技術平臺,歡迎各類分享!