Optionally load users directly from secrets