Honestly it largely depends on your main PC specs, but like you are hearing from others. It probably isn’t a good idea.

I don’t for a pretty simple reason. I have a wife, if something ever happened to me then she could end up a creek without a paddle. So by not having it encrypted then, anyone kinda technical can just pull data off the drive.