But if you provided your own Smack interface for Xml parsing, wouldn't it have the same performance issue?
No, because it's just an interface not an implementation. If used on Android, the implementation provided by dalvik would be used, which is better then the same implementaiton provided as jar.