All I can say is keep trying. Is he totallly quiet around you at 11:00pm? Perhaps you need to go a little later or before sunrise. Leave something with your scent on it where you last saw him and some food for him. If he still is "afraid" then get a humane trap and hopefully that will work. Good luck and keep us posted.