I dont have any animals, however in the last 24 hours i found 2 fleas on my leg..can they infest w/o animals?

it has been raining for the last 2 days...and there are some neighborhood strays..have not been in my house...i have 2 infant boys and i cant really use chemicals..why are there fleas in my house, and should i worry about it?