I'm on a hormone free kick myself.
You can use a hormone free IUD, but that might make you bleed for a while, and then finally cut out periods altogether.
He can get a vasectomy, but that's considered permanent.
This is for your consideration, this woman wrote an ebook on hormone free bc
MySpace.com - petyamarina - 41 - Female - UK - www.myspace.com/pettcorby
but it covers some of what you already mentioned.
Your guy should do his research, too. If you two are careful, (don't have sex while drunk, etc) the rhythm method is a good option. He doesn't trust it right now because he lacks information. This shouldn't all be on you.
The ovulation kit is a good idea. I use this site, it's very handy!
Ovulation Calendar
Consider ways to satisfy each other sexually without penis/vagina penetration, mix it up.
Finally, you can experiment with different latex free condoms and find one that works for you.