In the theme editor I see lots of Google fonts available under Typography, but when I am editing a page with a Rich Text module, I only see a limited number of fonts. See image.
How can I get all the fonts to show up inside the Rich Text module?
You can’t. The Rich Text WYSIWYG is completely separate from the theme fonts and only has the limited list. You could submit something to the Ideas forum asking to add Google fonts to Rich Text but I don’t really see that working since Google fonts needs to be imported into the site. Having it in the theme options is feasible since it’s easier to import one or two fonts on a whole site basis where as importing fonts on a page by page basis could be more difficult and really slow down the site depending on how many different fonts a user ends up using.