Use flags to make test suite on stackage easy to maintain

Created by: lwm

https://github.com/fpco/stackage/issues/3293#issuecomment-388232398

Tracking here since we'll be blocked on forth coming nightly builds.