Function setTokensProvider
setTokensProvider(
languageId: string,
provider:
| TokensProvider
| EncodedTokensProvider
| Thenable<TokensProvider | EncodedTokensProvider>,
): IDisposablesetTokensProvider(
languageId: string,
provider:
| TokensProvider
| EncodedTokensProvider
| Thenable<TokensProvider | EncodedTokensProvider>,
): IDisposable
Set the tokens provider for a language (manual implementation). This tokenizer will be exclusive with a tokenizer created using
setMonarchTokensProvider, or withregisterTokensProviderFactory, but will work together with a tokens provider set usingregisterDocumentSemanticTokensProviderorregisterDocumentRangeSemanticTokensProvider.