1 /* Generated By:JavaCC: Do not edit this line. Token.java Version 5.0 */
2 /* JavaCCOptions:TOKEN_EXTENDS=,KEEP_LINE_COL=null,SUPPORT_CLASS_VISIBILITY_PUBLIC=true */
3 package org.simantics.spreadsheet.graph.parser;
6 * Describes the input token stream.
9 public class Token implements java.io.Serializable {
12 * The version identifier for this Serializable class.
13 * Increment only if the <i>serialized</i> form of the
16 private static final long serialVersionUID = 1L;
19 * An integer that describes the kind of this token. This numbering
20 * system is determined by JavaCCParser, and a table of these numbers is
21 * stored in the file ...Constants.java.
25 /** The line number of the first character of this Token. */
27 /** The column number of the first character of this Token. */
28 public int beginColumn;
29 /** The line number of the last character of this Token. */
31 /** The column number of the last character of this Token. */
35 * The string image of the token.
40 * A reference to the next regular (non-special) token from the input
41 * stream. If this is the last token from the input stream, or if the
42 * token manager has not read tokens beyond this one, this field is
43 * set to null. This is true only if this token is also a regular
44 * token. Otherwise, see below for a description of the contents of
50 * This field is used to access special tokens that occur prior to this
51 * token, but after the immediately preceding regular (non-special) token.
52 * If there are no such special tokens, this field is set to null.
53 * When there are more than one such special token, this field refers
54 * to the last of these special tokens, which in turn refers to the next
55 * previous special token through its specialToken field, and so on
56 * until the first special token (whose specialToken field is null).
57 * The next fields of special tokens refer to other special tokens that
58 * immediately follow it (without an intervening regular token). If there
59 * is no such token, this field is null.
61 public Token specialToken;
64 * An optional attribute value of the Token.
65 * Tokens which are not used as syntactic sugar will often contain
66 * meaningful values that will be used later on by the compiler or
67 * interpreter. This attribute value is often different from the image.
68 * Any subclass of Token that actually wants to return a non-null value can
69 * override this method as appropriate.
71 public Object getValue() {
76 * No-argument constructor
81 * Constructs a new token for the specified Image.
83 public Token(int kind)
89 * Constructs a new token for the specified Image and Kind.
91 public Token(int kind, String image)
100 public String toString()
106 * Returns a new Token object, by default. However, if you want, you
107 * can create and return subclass objects based on the value of ofKind.
108 * Simply add the cases to the switch for all those special cases.
109 * For example, if you have a subclass of Token called IDToken that
110 * you want to create if ofKind is ID, simply add something like :
112 * case MyParserConstants.ID : return new IDToken(ofKind, image);
114 * to the following switch statement. Then you can cast matchedToken
115 * variable to the appropriate type and use sit in your lexical actions.
117 public static Token newToken(int ofKind, String image)
121 default : return new Token(ofKind, image);
125 public static Token newToken(int ofKind)
127 return newToken(ofKind, null);
131 /* JavaCC - OriginalChecksum=11e98d1eb599f4fc5c1c4ee8c0097a6c (do not edit this line) */