Recently, Mendelian Randomization (MR) has gained in popularity as a concept to assess the causal relationship between phenotypes in genetic association studies. An extension of standard MR methodology, the MR Steiger approach, has recently been developed to infer the causal direction between two phenotypes in prospective studies. Through simulation studies, we examined and quantified the ability of the MR Steiger approach to determine the causal direction between two phenotypes (i.e., effect direction). Through simulation studies, our results show that the MR Steiger approach may fail to correctly identify the direction of causality. This is true, especially in the presence of pleiotropy. We also applied the MR Steiger method to the COPDGene study, a case-control study of chronic obstructive pulmonary disease (COPD) in current and former smokers, to examine the role of smoking on lung function. We have created an R package on Github called reverseDirection which runs simulations for user-specified scenarios to examine when the MR Steiger approach can correctly determine the causal direction between two phenotypes in any user specified scenario. In summary, our results emphasize the importance of caution when the MR Steiger approach is used in to infer the direction of causality.