Most website hosting providers these days support WordPress, but there are often little details with the way servers are configured that cause annoying problems for some WordPress sites or plugins.
We recommend that you use a Host Provider that uses servers that are based in the country you are trying to target and that is optimised for WordPress.
In a Day Hosting or Webconsulting WordPress Hosting both offer specialised WordPress Hosting on Australian based (Sydney) hosting that is optimised for WordPress for around $100 per year…. Great Value and a Great option for most business websites.