Can students take courses for credit at other universities such as Princeton and NYU?

Yes, as part of the Inter-College Doctoral Consortium (IUDC), Columbia PhD students can enroll in courses at participating universities. For more information, see link here.