In my personal experience, it's better to train puppies to relieve within the house than outside. What if you're not available to take him out for walk due to health or other reasons? The pupp will have no option but to relieve at home. You can choose any space in your house which you think will be easily accessible to the dog and easy to clean. Or, perhaps, you can choose the roof of your house where you can take him to. We, for instance, chose space in the staires. We covered that space with newpapers. Right from the second day, we would take him there as frequently as every 15 minutes. You can place a urine soaked cloth on the newspapers and take him there as frequently as possible. The smell of urine will drive him into peeing there. When your puppy pees at the right space, reward him with a good treat and use words like 'good boy'. We used clicker to encourage this behaviour.
There may be instances when your puppy may not pee at the right spot, but you'll have to continue the training.
Once your puppy gets the jist of where he has to pee, he'll gradually stop peeing anywhere. Also, he'll also start peeing out of the house as he would know that he shouldn't pee in the rooms.
Also, can you clean the 'usual place' ( as mentioned on the question ) with vinegar as this will neuteralise the urine smell which drives your pup to pee again and again. I used to use Urine Off spray as it's a lot easy to use and effective.