Will adding the SDK slow down my app or affect performance?

No. The Quantcast iOS SDK and Android SDK have been designed to have minimal impact on size, speed and device battery life.