Find Ancestors

My Great Great Grandmother was illegitimate. This has taken ages to confirm as family whispers always had her husband as the illegitimate one. We know FOR SURE that he was not, and that is all now happily settled.
However, I now have her Birth Certificate. I've never come across illegitimacy in the family before so I am finding my way on this one. Dob: 16.12.1841 (no first name) in Brighton (birth registered by the Master of the Workhouse); christened Frances on 29.12.41 at St. Nicholas', Brighton with only mother's name of Jane Moon listed. Mother is listed as Jane Moon and that name stacks up. So far, so good. Lots of family photos and other memorabilia, etc., etc.

However, on Frances' birth certificate the name of the father is given as Walter SELLEY, Tailor.
And on her marriage certificate in 1861 (same church), she states that her father's name is James MOON, Butler.

I cannot find either of these two gentlemen in 1841 census, 1851 census or 1861 census.

I do know that mother Jane Moon went on to marry a Mr. White and has at least one son whom she called James (White). I've often wondered whether Frances 'made up' her father and reinvented him as her half-brother for the sake of decency!

Is there a sleuth out there who can find either Walter Selley and/or James Moon in 1841, PLEASE?

Thank you