For sure he will follow soon! It was him, who brought us here to begin with! We shall produce a statue for his ceremonial arrival. This quest requires to build a Dwarven statue. There is no option to decline yet I see no where to build this statue.