You asked for all rooms in Openfire.
Maybe ask your question in the Smack Users forum.
Nevertheless here are my thoughts:
If the user is offline, he's not in any room.
From a XMPP perspective you can only ask for all occupants in a room (i.e. people who are currently online and IN the room).