The reason this applies only to Nazir, Beis Hamikdash and Pesach.
Source Sheet: https://res.cloudinary.com/ouinternal/image/upload/outorah pdf/is0zmxklttsxk75hvvnn.pdf
