Another important thing to start with your puppy is flea and tick preventative. Every dog and cat should be on a flea and tick preventative, regardless of lifestyle, age, or breed. Luckily, these preventatives come in tasty chewables that dogs will take just like treats or collars that can be work for months at a time. Preventing fleas and ticks stops your dog from getting diseases (such as Lyme's disease in ticks or an infectation of Dipylidium caninum from fleas). I will link an article about the importance of flea and tick preventative.
An inclusive checklist for bringing home a new puppy (straight from the mouth of a dog bather, vet tech student, and dog lover all in one). I linked many informational articles as to why you need these things, and what considerations you should make when choosing your new puppy supplies.