[TF-M] Changes to CI for python dependencies