"but if you tax millionaires then they'll all leave!" The tax is not on primary residences, so if they're paying the tax then they've already left.