The magnitude and nature of the Near Infrared Background has received a great deal of recent attention. There have been claims of an excess in the background at 1.4 microns and for evidence of high redshift sources, possibly the ones that participated in the reionization of the universe. This work indicates that there is no excess in the background over the normal galaxies observed in the near infrared. In addition, residual spatial fluctuations in the near infrared background after the subtraction of all known sources have also been attributed to high redshift sources. Our analysis of the color of the residual fluctuations indicates that the fluctuations come from faint low redshift sources below the detection limit of the NICMOS and Spitzer observations. The basic conclusion is that the nature of the near infrared background does not require the presence of very high redshift sources to account for its currently observed properties, although a faint, yet undetected, high redshift component is almost certainly there.