We show estimates for the distribution of $k$-free numbers in short intervals and arithmetic progressions that, in certain ranges, agree with a conjecture by Montgomery.