Highly highly recommend you hire someone with experience in MidAtlantic conditioning specifics, it's a very unique climate, especially when you get into low load houses like you're describing with very high quality enclosures I na humid environment.

Some very smart outfits worth contacting so you don't DIY yourself into a partial load / humidity mess:
John Semmelhack or other in Charlottesville: https://www.comfortsquad.us/home
Alison Bailes' group in Decatur: https://www.energyvanguard.com/hvac-design/

Alison even wrote a book recently that is great for what you're thinking about: https://www.energyvanguard.com/book-...he-or-does-it/
Also this book is also really really excellent, a bit cold climate centric, but it gets pretty cold up on the ridge: https://www.tauntonstore.com/pretty-good-house
https://www.prettygoodhouse.org
Matt Risinger's The Build Show on YouTube also talks a lot about modern high performance construction & HVAC.

Always an ERV in houses like yours, and almost always dedicated de-humidification in your climate. Then fill in the rest with air source heat pumps only is where almost everyone ends up.