The history buffer was defaulting to a normal GtkTextTagTable which was breaking stuff. This wasn't noticed before as a TalkatuTagTable is usually set up via glade.