I thought they were just changing it so he was already at Riverrun instead of the Vale of Arryn. Granted, that's just what I heard from my friend, and he could have been assuming for all I know.
And yeah, not having him in Book 4 is kinda screwy.
--
"One toot on this whistle will take you to a far away land."
-Toad, SMB3