scy,
@scy@chaos.social avatar

Turns out, #LVM #RAID-1 with #dmintegrity over two separate physical disks and then putting a #dmcrypt device on top of the RAID is really slow. As in, it's estimating to take a week to do the initial sync on the two 12TB WD Red drives on SATA. (For comparison, zeroing out one of these disks should take 8 hours or something.)

Apparently it's a somewhat-known problem with dm-integrity, related to its journal.

How would you build something bitrot-safe & encrypted with that hardware? #Debian 12.

ToshInMacc,

@scy
Has to be ZFS.

zekjur,
@zekjur@mas.to avatar

@scy I’m using Ubuntu Server with ZFS for this use-case

vollplatsch,

@scy it is better when you put the check sums on a different drive. Has the additional benefit that you can mount it without dm-integrity too.

Worked well for me. I have switched to zfs now though

jwalzer,

@scy

Using btrfs and raid1 in btrfs

jwalzer,

@scy
... and of course, luks encryption below the btrfs

scy,
@scy@chaos.social avatar

@jwalzer But that means I’d encrypt twice, once per disk.

schmittlauch,
@schmittlauch@toot.matereal.eu avatar

@scy @jwalzer Yes, but with aes-ni that should be barely noticeable.
To make use of btrfs features, you need it to be the top-most layer.

jwalzer,

@scy

If you want to avoid that, you could put ecryptfs on top of btrfs, and loose some btrfs features and potentially leak metadata.

You can do a cryptsetup benchmark to see how fast your kernel would encrypt the data stream, and then compare that to the 100ish mb/s your HDDs deliver ... if your not on an rpi then you should have support for aesni or a fast enough CPU to handle all the HDDs you want, performance wise ...

ranlvor,

@scy I'd use ZFS. It has RAID, checksums and encryption built in.

(edit: and creation of the pool is very fast, because it only needs to sync data that is actually allocated)

  • All
  • Subscribed
  • Moderated
  • Favorites
  • debian
  • DreamBathrooms
  • everett
  • osvaldo12
  • magazineikmin
  • thenastyranch
  • rosin
  • tester
  • Youngstown
  • Durango
  • slotface
  • ngwrru68w68
  • kavyap
  • mdbf
  • InstantRegret
  • JUstTest
  • ethstaker
  • GTA5RPClips
  • tacticalgear
  • normalnudes
  • Leos
  • modclub
  • khanakhh
  • cubers
  • cisconetworking
  • anitta
  • provamag3
  • megavids
  • lostlight
  • All magazines