Starting April 29, 2025, Gemini 1.5 Pro and Gemini 1.5 Flash models are not available in projects that have no prior usage of these models, including new projects. For details, see
Model versions and lifecycle .
Send feedback
Class SpeculativeDecodingSpec.NgramSpeculation (1.20.1)
Stay organized with collections
Save and categorize content based on your preferences.
public static final class SpeculativeDecodingSpec . NgramSpeculation extends GeneratedMessageV3 implements SpeculativeDecodingSpec . NgramSpeculationOrBuilder
N-Gram speculation works by trying to find matching tokens in the
previous prompt sequence and use those as speculation for generating
new tokens.
Protobuf type google.cloud.vertexai.v1.SpeculativeDecodingSpec.NgramSpeculation
Inherited Members
com.google.protobuf.GeneratedMessageV3.<ListT>makeMutableCopy(ListT)
com.google.protobuf.GeneratedMessageV3.<ListT>makeMutableCopy(ListT,int)
com.google.protobuf.GeneratedMessageV3.<T>emptyList(java.lang.Class<T>)
com.google.protobuf.GeneratedMessageV3.internalGetMapFieldReflection(int)
Static Fields
NGRAM_SIZE_FIELD_NUMBER
public static final int NGRAM_SIZE_FIELD_NUMBER
Field Value
Type Description
int
Static Methods
getDefaultInstance()
public static SpeculativeDecodingSpec . NgramSpeculation getDefaultInstance ()
getDescriptor()
public static final Descriptors . Descriptor getDescriptor ()
newBuilder()
public static SpeculativeDecodingSpec . NgramSpeculation . Builder newBuilder ()
newBuilder(SpeculativeDecodingSpec.NgramSpeculation prototype)
public static SpeculativeDecodingSpec . NgramSpeculation . Builder newBuilder ( SpeculativeDecodingSpec . NgramSpeculation prototype )
public static SpeculativeDecodingSpec . NgramSpeculation parseDelimitedFrom ( InputStream input )
public static SpeculativeDecodingSpec . NgramSpeculation parseDelimitedFrom ( InputStream input , ExtensionRegistryLite extensionRegistry )
parseFrom(byte[] data)
public static SpeculativeDecodingSpec . NgramSpeculation parseFrom ( byte [] data )
Parameter
Name Description
databyte []
parseFrom(byte[] data, ExtensionRegistryLite extensionRegistry)
public static SpeculativeDecodingSpec . NgramSpeculation parseFrom ( byte [] data , ExtensionRegistryLite extensionRegistry )
parseFrom(ByteString data)
public static SpeculativeDecodingSpec . NgramSpeculation parseFrom ( ByteString data )
parseFrom(ByteString data, ExtensionRegistryLite extensionRegistry)
public static SpeculativeDecodingSpec . NgramSpeculation parseFrom ( ByteString data , ExtensionRegistryLite extensionRegistry )
public static SpeculativeDecodingSpec . NgramSpeculation parseFrom ( CodedInputStream input )
public static SpeculativeDecodingSpec . NgramSpeculation parseFrom ( CodedInputStream input , ExtensionRegistryLite extensionRegistry )
public static SpeculativeDecodingSpec . NgramSpeculation parseFrom ( InputStream input )
public static SpeculativeDecodingSpec . NgramSpeculation parseFrom ( InputStream input , ExtensionRegistryLite extensionRegistry )
parseFrom(ByteBuffer data)
public static SpeculativeDecodingSpec . NgramSpeculation parseFrom ( ByteBuffer data )
parseFrom(ByteBuffer data, ExtensionRegistryLite extensionRegistry)
public static SpeculativeDecodingSpec . NgramSpeculation parseFrom ( ByteBuffer data , ExtensionRegistryLite extensionRegistry )
parser()
public static Parser<SpeculativeDecodingSpec . NgramSpeculation > parser ()
Methods
equals(Object obj)
public boolean equals ( Object obj )
Parameter
Name Description
objObject
Overrides
getDefaultInstanceForType()
public SpeculativeDecodingSpec . NgramSpeculation getDefaultInstanceForType ()
getNgramSize()
public int getNgramSize ()
The number of last N input tokens used as ngram to search/match
against the previous prompt sequence.
This is equal to the N in N-Gram.
The default value is 3 if not specified.
int32 ngram_size = 1;
Returns
Type Description
int The ngramSize.
getParserForType()
public Parser<SpeculativeDecodingSpec . NgramSpeculation > getParserForType ()
Overrides
getSerializedSize()
public int getSerializedSize ()
Returns
Type Description
int
Overrides
hashCode()
Returns
Type Description
int
Overrides
internalGetFieldAccessorTable()
protected GeneratedMessageV3 . FieldAccessorTable internalGetFieldAccessorTable ()
Overrides
isInitialized()
public final boolean isInitialized ()
Overrides
newBuilderForType()
public SpeculativeDecodingSpec . NgramSpeculation . Builder newBuilderForType ()
newBuilderForType(GeneratedMessageV3.BuilderParent parent)
protected SpeculativeDecodingSpec . NgramSpeculation . Builder newBuilderForType ( GeneratedMessageV3 . BuilderParent parent )
Overrides
newInstance(GeneratedMessageV3.UnusedPrivateParameter unused)
protected Object newInstance ( GeneratedMessageV3 . UnusedPrivateParameter unused )
Returns
Type Description
Object
Overrides
toBuilder()
public SpeculativeDecodingSpec . NgramSpeculation . Builder toBuilder ()
writeTo(CodedOutputStream output)
public void writeTo ( CodedOutputStream output )
Overrides
Send feedback
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License , and code samples are licensed under the Apache 2.0 License . For details, see the Google Developers Site Policies . Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2025-04-28 UTC.
Need to tell us more?
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-04-28 UTC."],[],[]]
