Maybe try to find a combo amp + turntable in a yard sale / goodwill store or on craiglist, that's the cheapest way to see if you like it.
Buying records can become expensive really fast, i buy between 10 and 15 records each month it cost me around 200euros with shipping rates, if you like old records you can find nice deals in yardsales or in your local goodwill, like 2eu a record, sometimes less. The other bad sides about records are the space needed to store them and their fragility ( it's not that fragile but you have to wash your hands and be a bit careful ) The good sides are the nice cover art, the fact that you can resell those that you don't like anymore, sometimes way more than the price you paid if you are lucky, the sound quality can be better for the albums / ep came around a time when vinyl was still the best medium avaiable. Plus it's the funniest way to dj if you're interested in that.
Tldr: it's annoying as fuark but once you get into it you can't get enough
You can try getting into buying vinyls, but bear in mind that its quality will degrade pretty quickly, regardless of how high-end your playing turntable will be, so the first thing to do after purchase is to digitize the contents in good quality (44KHz/16bit/stereo is perfectly sufficient for vinyl records, contrary to what some pseudoaudiophiles like to force everywhere they can)
>>4341 Yard sales / Goodwill etc aren't really good places to look anymore. The turntables and stuff there are snatched up by hipsters so fast these days, it's hardly worth looking.
As for the fragility and degradation issues mentioned, in my experience it's not as bad as people say if you respect them. Most of the first CDs I bought stopped working a long time ago but I have LPs that are much older that still play. They have to be stored upright though. Stacking them horizontally is a great way to destroy them for some reason. But I've known vinyl even to survive floods, so long as the records were removed from the jackets and allowed to dry before mold set in.