Revert "fix(rfdetr): use cpu torch for cpu builds (#6129)" This reverts commit fec8a36b36.
fec8a36b36