I have already tried these Speed up WooCommerce store tips and implemented all of the steps that I mentioned below:
WebPageTest
PageSpeed Insights
Pingdom Tools
Limit the Number of Extensions
Limit/Disable WordPress Revisions
Clean up the Database
Limit External Resources
Widget and Sharing...
You can set it up by creating a subdomain or by integrating CDN service. Use this guide here for further information https://www.cloudways.com/blog/serve-static-content-from-a-cookieless-domain-guide/