The reason for specialized clothing is to keep the rider safe from numbing cold and or wet. Hand guards like the dirt riders use are very helpful to break the wind blast off your hands. A few years ago there was a comparison between the BMW 650 GS and the Kawasaki KLR650. The BMW came with heated grips, the KLR came with hand guards. The upshot is that in the cold weather the hand guards were more protection and help than the heated grips of the BMW.
I think it is wise to purchase some "over pants" that you can get into and out of easily without removing your footwear. This makes riding in cooler weather much more enjoyable. At one time years ago I had a snowmobile suit, designed for easy on/off with zippers up the outside of the legs from the cuff to the waist. This feature made getting in or out of the suit very easy. I still have the suit but the zippers have given up their best some years ago. Now they may open without the aid of the "handle". That was a one piece suit, now the trend is for two piece suits with bib pants and a jacket.
I also have a couple fairly nice riding jackets and pants (sort of hand-me-downs). I did buy one good jacket, a "First Gear" Kilimanjaro jacket. It's a bit much in warm weather, even with it's vents, but the rest of the year it keeps the cold and most of the rain out. It pays to watch for sales on specific items and get them when they are available on sale. It took me almost a year to find my helmet, HJC RPHA Max, selected for head shape and size. I didn't get a choice of colors as this model was the only model I found at the low price, (about $305. delivered to my door for at the time a nearly $500. helmet.)
Your equipment must fit you or it can become more of a liability than an asset in time of need.