Next, you can get a quiet practice pad. On a pad, you have more time to practice since it is low volume, and it will encourage you to focus on learning how to read notation and rudiments, and develop your hand control and coordination. I suggest getting either the Vic Firth Pad or HQ Percussion Pad:
Next, a metronome is a device that not only helps you keep time and understand how various notes relate to the pulse, but it also serves as a great gauge for your hand technique and rudimental progress:
Now, let us discuss books. I would start with 2 types of beginner books: 1) a book to learn how to read notation and develop your rudiments and 2) a beginning drumset book that is comprehensive and simple to follow.
Snare Drum/Reading Book: Drum Class Method, Vol 1
This book not only presents the basic material in an incremental, easy-to-follow fashion, but covers many important topics.
I've seen tons of drumming books over many years. I wrote Drumopedia with the beginner student and teacher in mind. I designed it so that it not only covers so many traditional and modern drumming topics, but does so in an encouraging, easy-to-use way. I also deliberately made the notation and text bigger so drummers can read it when it is place on a music stand.
Now for the part you have been waiting for so you can let loose and bang some drums right away! First of all, if you live in an apartment, or you are going to set up your drums in a place where you have to keep the volume down, I would recommend getting an electronic kit. Most electronic drum kits also have the added value of having a built-in metronome, tons of songs to play with, and tons of sounds to choose from!
Albeit electronic drums have advantages and so many options, there is nothing quite like the natural feel and sound of an acoustic drumset. The Ludwig Accent drumset is affordable. If your drumset does not come with the basic cymbal setup (i.e., hi-hat, crash, ride), some stores and/or companies offer certain cymbal package deals.