gh-153569: Add tokenizer source and cursor primitives#153587

pablogsal wants to merge 3 commits into

python:mainpython/cpython:mainfrom

pablogsal:gh-153569-tokenizer-offset-apipablogsal/cpython:gh-153569-tokenizer-offset-apiCopy head branch name to clipboard