Wednesday, June 22, 2011

Ngrams with coroutines in Python

This is how I define ngrams with coroutines

I need to filter text before generating ngrams and also, I want to process ngrams (in this case count bigrams)

I combine my coroutines together

Full source can be found in my fork of rrenaud's gibberish detector.

No comments: