Debugging patterns (1)

Why does this pattern not match the tokens "Silicon Valley" in the doc?

pattern = [{'LOWER': 'silicon'}, {'TEXT': ' '}, {'LOWER': 'valley'}]

doc = nlp("Can Silicon Valley workers rein in big tech from within?")

You can try it out in your IPython shell. The matcher with the added pattern and the doc are already created.

The tokens "Silicon" and "Valley" are not lowercase, so the 'LOWER' attribute won't match.

The tokenizer doesn't create tokens for single spaces, so there's no token with the value ' ' in between.

The tokens are missing an operator 'OP' to indicate that they should be matched exactly once.

Exercise