In your project policies, under Application Settings, you can block a multitude of applications from running within your Kiosk modes. One of these programs is the Google Play Store. 

If you have the Google Play Store box checked here, it will prevent the device from being able to install the applications from the Play Store.

This will not come into effect if you are only loading private APKs.