The exact sampling distributions of estimators of structural parameters of econometric models are unknown except for a few simple cases. In this situation two alternative approaches towards evaluating finite sample properties of various estimators have been adopted in the literature: (i) Monte Carlo experiments, and (ii) the approach pioneered by Nagar and his students in which the sampling error of an estimator is expressed as the sum of an infinite series of random variables, successive terms of which are of decreasing order of sample size in probability. It is claimed that the small sample properties of the estimator under consideration can be approximated by those of the first few terms of such an infinite series. This paper shows through examples that the Nagar approach can be misleading in the sense that it can yield an estimate for finite sample bias that differs from the true finite sample bias to the same order of sample size. And it can yield estimates of bias which are finite (infinite) while the true bias is infinite (finite). The paper also draws attention to some of the pitfalls to be avoided in studying the properties of an infinite sequence of random variables.