Back in the 1700s and 1800s rye was quite common and popular, corn came on later which are the bourbons. Bourbon whiskies are usually sweeter and sometimes smoother, rye is a little fruitier, sometimes spicier and usually drier.
Since you said you liked white whiskey I figured you had come across some made the old fashioned way. Rye seems to be making a comeback and there are some good ones out there, you should try one sometime. Next time I go to Kentucky I plan on stopping at the Buffalo Trace Distillery, taking the tour and buying some of their White Dog Rye Mash Whiskey (125 proof).