If Portland could do that without giving up CJ, I think you have to seriously consider it. Plums will likely be gone next year anyhow unless there is some type of trade because the Blazers simply don't have the Cap/Lux room to pay him even though it goes up a bit this next summer.
Wings are a dime-a-dozen compared to legit, dominant big men. If it were something like Plums, Crabbe, Aminu, 1st round pick, even though that is 2 starters and your 6th man, that is still something you can build around with Dame/CJ/Hassan.