Maybe you can convince him that you know him? The best move would be to continue talking to him and show him things you know about him. So you accept.
During the "date" you order his favorite food and try to tell childhood stories to him. The food only makes him think you have a lot in common and he doesn't remember the stories, but they clearly make him laugh...
As he gets closer to you, you only can agree that your plan backfired...