UPDATE
I have found that if right after opening SSMS I run a select query that references the linked server, it runs and returns results. Then if I try to expand the linked server node, everything works fine.
If I try to expand the linked server node before doing the select query, it locks up.