Docsite search: Test different chunking strategies

[hanna-paasivirta]

          So this splits the chunk at the first line that goes over the limit?

Is the cutoff chunk now going to be massively out of context?

I don't think we need to solve this today but maybe we should raise out an issue for it.

My instinct is that there are all sorts of heuristics we can apply here: cutting out whole HTML elements (section/detail) for example, or splitting out code blocks, or tip boxouts.

Originally posted by @josephjclark in #176 (comment)