The basics
Most tax bills are predictable, which makes a revolving facility a reasonable way to meet them. VAT is generally due one month and seven days after each quarter ends, PAYE and National Insurance are normally due on the 22nd for employers paying electronically, and corporation tax is usually due nine months and a day after the year end for most companies (large companies pay in instalments). With a facility in place, you draw on the due date, pay HMRC in full and repay across the following weeks as receipts arrive. HMRC is paid on time and the bank balance does not take one large hit.
The catch is timing. A facility has to be in place before the bill falls due, because a lender will want accounts and bank statements before agreeing a limit. Arranging one in the week a VAT payment is due is likely to be too late. The limit also needs room: if it is already used for stock or wages, nothing may be left for HMRC. Lenders assess it as they would any facility, so a business that is up to date with HMRC and has a steady cash pattern is better placed than one with arrears.

