No, you don’t need the controller just to open the Skydio app. On your iPad Mini 4, it should launch and let you check settings or media without it.
If it keeps closing, make sure your iPad has iOS 14 or newer and the latest Skydio app installed. The Mini 4 is a bit old, so some versions might...