Data point - The line for the Holocaust Museum was all the way to Independence - at 915a, on a Tuesday.
As dbh says, look for places that charge admission. Or if you can, come in winter. It's so nice in the winter.
Best thing in DC to me - the Hockney installation at the Portrait Gallery. I can sit there for an hour (and have, several times).
Bookmarks