This. AWS Budgets to get notifications when they reach certain spend thresholds will be a must. Also you should probably setup an AWS organization and have them operate in a sub-account if you go this route.
If you prefer imperative infrastructure creation to declarative then I think you're doing something wrong. Both Terraform and CloudFormation are quite easy to manage compared to writing and managing scripts (bash or otherwise).