Artificial intelligent assistant

Pythonの字句解析結果を取得する方法について python > Python (parser) (lexical analyzer) (token) (lexical analyzer) def function(foo): print(foo) "def","function","(","foo",")",":","print","(","foo",")"

`tokenize`?

<

xcX3v84RxoQ-4GxG32940ukFUIEgYdPy 2ff613f4787f8a90d767047acc1c70c8