Solid-state lithium batteries (SSLBs) have been identified as one kind of the most promising energy conversion and storage devices because of their safety, high energy density, and long cycling life. The development of solid-state electrolyte is vital to commercialize SSLBs. Composite polymer electrolyte (CPE), derived by compositing inorganic particles into solid polymer electrolyte has become the most practical species for SSLBs because it inherits the advantages of polymer electrolyte and simultaneously achieves enhanced ionic conductivity and mechanical properties. The characteristics of inorganic particles and their interaction with polymers strongly impact the performance of CPE, improving its ionic conductivity, mechanical properties, thermal and electrochemical stability, as well as interface compatibility with both electrodes. In this review, the effects of particle characteristics including its species, size, proportion, morphology on the ionic conductivity and mechanical properties of CPE are reviewed. Meanwhile, some novel composite strategies are also introduced including surface modification, hybridization, and alignment of particles in polymer matrices, as well as some new preparation methods of CPE. The interactions between particles and other components in CPE including polymer matrices or lithium salt are particularly focused herein to reveal the lithium conductive mechanism. Finally, a perspective on the direction of future CPE development for SSLBs is presented.