[TF-M] Simplify the veneers of library model