I have a new male kitten pooing and peeing everywhere else bar the kitty litter tray - help?

What can I spray/put down to deter him from going in the other spots? I have cleaned up with citrus products to no avail. I have an adult female cat whom doesn't like him much. His litter tray is not hear his food. Thanks.