Ok found where the problem happens.
It's when I merge the object. It removes the scale, your right it has nothing to do with serialized objects.
Object3D.mergeObjects(ground, model);
How do I keep the scale when I merge? There is no scaleMesh method that I can see.