any point setting processor affinity in a daw?

Which is a valid reason NOT to set CPU affinity on a single VM?