Uses of Interface
antlr.TokenStream
Packages that use TokenStream
Package
Description
-
Uses of TokenStream in antlr
Classes in antlr that implement TokenStreamModifier and TypeClassDescriptionclassclassclassclassThis object is a TokenStream that passes through all tokens except for those that you tell it to discard.classThis object filters a token stream coming from a lexer or another TokenStream so that only certain token channels get transmitted to the parser.classThis token stream tracks the *entire* token stream coming from a lexer, but does not pass on the whitespace (or whatever else you want to discard) to the parser.classA token stream MUX (multiplexor) knows about n token streams and can multiplex them onto the same channel for use by token stream consumer like a parser.Fields in antlr declared as TokenStreamModifier and TypeFieldDescriptionprotected TokenStreamTokenBuffer.inputprotected TokenStreamTokenStreamBasicFilter.inputThe input streamprotected TokenStreamTokenStreamSelector.inputThe currently-selected token stream inputprotected TokenStreamTokenStreamRewriteEngine.streamWho do we suck tokens from?Methods in antlr that return TokenStreamModifier and TypeMethodDescriptionTokenStreamSelector.getCurrentStream()Return the stream from tokens are being pulled at the moment.TokenBuffer.getInput()return the Tokenizer (needed by ParseView)TokenStreamSelector.pop()Methods in antlr with parameters of type TokenStreamModifier and TypeMethodDescriptionvoidTokenStreamSelector.addInputStream(TokenStream stream, String key) protected voidParser.defaultDebuggingSetup(TokenStream lexer, TokenBuffer tokBuf) voidTokenStreamSelector.push(TokenStream stream) voidTokenStreamSelector.select(TokenStream stream) Set the stream without pushing old streamConstructors in antlr with parameters of type TokenStreamModifierConstructorDescriptionANTLRParser(TokenStream lexer) protectedANTLRParser(TokenStream lexer, int k) ANTLRTokdefParser(TokenStream lexer) protectedANTLRTokdefParser(TokenStream lexer, int k) LLkParser(TokenStream lexer, int k_) TokenBuffer(TokenStream input_) Create a token bufferTokenStreamRewriteEngine(TokenStream upstream) TokenStreamRewriteEngine(TokenStream upstream, int initialSize) -
Uses of TokenStream in antlr.actions.cpp
Classes in antlr.actions.cpp that implement TokenStreamModifier and TypeClassDescriptionclassPerform the following translations: AST related translations ## -> currentRule_AST #(x,y,z) -> codeGenerator.getASTCreateString(vector-of(x,y,z)) #[x] -> codeGenerator.getASTCreateString(x) #x -> codeGenerator.mapTreeId(x) Inside context of #(...), you can ref (x,y,z), [x], and x as shortcuts. -
Uses of TokenStream in antlr.actions.csharp
Classes in antlr.actions.csharp that implement TokenStreamModifier and TypeClassDescriptionclassPerform the following translations: AST related translations ## -> currentRule_AST #(x,y,z) -> codeGenerator.getASTCreateString(vector-of(x,y,z)) #[x] -> codeGenerator.getASTCreateString(x) #x -> codeGenerator.mapTreeId(x) Inside context of #(...), you can ref (x,y,z), [x], and x as shortcuts. -
Uses of TokenStream in antlr.actions.java
Classes in antlr.actions.java that implement TokenStreamModifier and TypeClassDescriptionclassPerform the following translations: AST related translations ## -> currentRule_AST #(x,y,z) -> codeGenerator.getASTCreateString(vector-of(x,y,z)) #[x] -> codeGenerator.getASTCreateString(x) #x -> codeGenerator.mapTreeId(x) Inside context of #(...), you can ref (x,y,z), [x], and x as shortcuts. -
Uses of TokenStream in antlr.actions.python
Classes in antlr.actions.python that implement TokenStreamModifier and TypeClassDescriptionclassPerform the following translations: AST related translations ## -> currentRule_AST #(x,y,z) -> codeGenerator.getASTCreateString(vector-of(x,y,z)) #[x] -> codeGenerator.getASTCreateString(x) #x -> codeGenerator.mapTreeId(x) Inside context of #(...), you can ref (x,y,z), [x], and x as shortcuts.class -
Uses of TokenStream in antlr.ASdebug
Methods in antlr.ASdebug with parameters of type TokenStreamModifier and TypeMethodDescriptionstatic StringASDebugStream.getEntireText(TokenStream stream) static TokenOffsetInfoASDebugStream.getOffsetInfo(TokenStream stream, Token token) -
Uses of TokenStream in antlr.debug
Classes in antlr.debug that implement TokenStreamMethods in antlr.debug with parameters of type TokenStreamModifier and TypeMethodDescriptionvoidLLkDebuggingParser.setupDebugging(TokenStream lexer) protected voidLLkDebuggingParser.setupDebugging(TokenStream lexer, TokenBuffer tokenBuf) User can override to do their own debuggingConstructors in antlr.debug with parameters of type TokenStreamModifierConstructorDescriptionLLkDebuggingParser(TokenStream lexer, int k_) ParseTreeDebugParser(TokenStream lexer, int k_) -
Uses of TokenStream in antlr.preprocessor
Classes in antlr.preprocessor that implement TokenStreamConstructors in antlr.preprocessor with parameters of type TokenStreamModifierConstructorDescriptionPreprocessor(TokenStream lexer) protectedPreprocessor(TokenStream lexer, int k)