The problem using a regular XDM holster for the Elites is the ambi slide release and as stated above, the slide serrations are different. (Not sure if serrations is a real issue or not.)
Tulster for example specifically states their holster is not compatible with Elite. This quote is copied...