Going green (getting off the grid)

So I have always secretly wanted a roof covered in solar panels, a power generating windmill, and an organic garden. (Don't we all?) But I am not sure where one would get started with this sort of thing. Is it possible to start small? I have a fig tree (that has never produced fruit). Does that count? We struggle to keep our yard alive. I wouldn't even pretend to know how to start a garden. I remember we planted one with my mom when I was around 10 or 11. It was really cool! I do have memories of it being a lot of work too, and remember quite a bit of hoe-ing (what is the proper term for that?). I am pretty sure my mom did much more work than we did. Even the work we did seemed like a lot though. Also I am pretty sure solar panels would not be approved by the HOA. I guess the first step would be to ask though. If they said no then I guess the next step would be to move out to the country somewhere first. I have a secret fantasy to live completely off the grid though I like being plugged in and close to everything too. I just have a little bug in my ear saying quit being so wasteful, stop the madness, be part of the solution not the problem, blahh blahh blahh. Do all of us have that or is that just me and my inability to quite that incurable optimist. Oh another problem I may have is that my husband may not have dreams of living off the grid. Though I know he is open to trying it and I think he could get excited about making our own power.