Two different macrophage populations contribute to CNS neuroinflammation: CNS‐resident microglia and CNS‐infiltrating peripheral macrophages. Markers distinguishing these two populations in tissue sections have not been identified. Therefore, we compared gene expression between LPS (lipopolysaccharide)/interferon (IFN)γ‐treated microglia from neonatal mixed glial cultures and similarly treated peritoneal macrophages. Fifteen molecules were identified by quantative PCR (qPCR) as being enriched from 2‐fold to 250‐fold in cultured neonatal microglia when compared with peritoneal macrophages. Only three of these molecules (C1qA, Trem2, and CXCL14) were found by qPCR to be also enriched in adult microglia isolated from LPS/IFNγ‐injected CNS when compared with infiltrating peripheral macrophages from the same CNS. The discrepancy between the in vitro and in vivo qPCR data sets was primarily because of induced expression of the ‘microglial’ molecules (such as the tolerance associated transcript, Tmem176b) in CNS‐infiltrating macrophages. Bioinformatic analysis of the ∼19000 mRNAs detected by TOGA gene profiling confirmed that LPS/IFNγ‐activated microglia isolated from adult CNS displayed greater similarity in total gene expression to CNS‐infiltrating macrophages than to microglia isolated from unmanipulated healthy adult CNS. In situ hybridization analysis revealed that nearly all microglia expressed high levels of C1qA, while subsets of microglia expressed Trem2 and CXCL14. Expression of C1qA and Trem2 was limited to microglia, while large numbers of GABA+ neurons expressed CXCL14. These data suggest that (i) CNS‐resident microglia are heterogeneous and thus a universal microglia‐specific marker may not exist; (ii) the CNS micro‐environment plays significant roles in determining the phenotypes of both CNS‐resident microglia and CNS‐infiltrating macrophages; (iii) the CNS microenvironment may contribute to immune privilege by inducing macrophage expression of anti‐inflammatory molecules.