Later on down it says that Mixtral has a context length of 32k which isn't shabby. That's interesting and probably would work for my needs.