Answer
The confidence level is the complement of sampling risk—e.g., 95% confidence means a 5% sampling risk of a wrong conclusion. Higher required confidence (lower acceptable sampling risk) increases the sample size. The auditor sets confidence based on how much assurance the sample must provide given other evidence and assessed risk.
Real-world example Requiring 95% rather than 90% confidence for a high-risk area increases the needed sample size.