I'm in Trouble Now... Or am I?

So... I decided to do a little organizing the other day. Gathered up all the random bags of yarn from around the downstairs and put them all in the closet along with some fabric and what not. I rearranged some photos did some dusting, took all my husbands random papers and shoved them in a desk drawer and put away all the UFOs laying around. Yes I have lost my knitting monogamy but that is another story. So when my husband came home he noticed the lovely (deceptively) organized state of the house and decided to do a little extra cleaning of his own. We went upstairs and he was taking his clothes into the closet! Uh oh! I was desperately trying to tell him I'd put his clothes away. But he walked into the closet and I hear "Oh my God how much yarn do you have!" Now you have to understand I didn't put all that much more on the piles just a couple grocery bags full but my husband doesn't go in the closet much. It's true he has more clothes hanging in there than I do but he doesn't wear any of them. He has a uniform for work and then he comes home and he has about 4 favorite outfits and pjs so that is what he wears and I just keep that stuff washed and in easy reach for him.

He comes out with his clothes still in his hands puts them down on the chair looks at me and says "If you have all that yarn how come you haven't made me a sweater?" Priceless.
I reply "Well if you want a pair of socks I'm all set to make you some if you don't mind blues and pinks otherwise I'll have to buy more yarn. Besides your so picky about what you wear you would never wear it because it won't be exactly the way you want it."
Hubby proceeds to tell me it wouldn't be that hard to make a sweater with the exact collar he wants with sleeve cuffs exactly the right length that aren't too tight and blah blah blah.
I tell him I've never made a sweater before so I doubted it would be so specific and he tells me that I should start practicing.

Now to me that sounded like a free license to now go and buy not hats and felted bags worth of yarn but whole sweaters worth of yarn at a time. What do you think did he just give me a get out of jail free card on future purchases of yarn. as long as they are enough to make a sweater?