The ATR3350 does not require phantom power. It has its own battery. It is also unbalanced. If you're using a 3.5-to-XLR adapter, the adapter is probably shorting pins 1 and 3 on the XLR connector. That screws up phantom power, which has to be disabled on the XLR jack into which the 3350 is plugged.

The 1/4" input jack on the Scarlett is probably line input rather than microphone input level. It will not have enough gain for a microphone.