I believe there must be "signer" app that would be very simple and auditable, you would run it in your computer, and would just sign transactions.
All sites out there would just generated transactions and either communicate directly with that service you're running or give you the generated XDR and expect the signed transaction back.