If Kumquats aren't appealing, try candied orange zest using the same method. Or omit them entirely. The apple filling is fine on its own. Another idea is adding cranberries or more mainstream fruit if you want something just a step off the beaten path.
Keyword apple, Brandy, Candied, Grand marnier, Kumquat, Pie