Create a collection (Go)
Creates a new collection in a database.
|
Ready to write code? See the examples for this method to get started. If you are new to the Data API, check out the quickstart. |
Result
Creates a collection with the specified parameters.
Returns a Collection object.
You can use this object to work with documents in the collection.
Parameters
|
You cannot edit a collection’s definition after you create the collection. |
Use the CreateCollection method, which belongs to the Db type.
Method signature
func (d *Db) CreateCollection(
ctx context.Context,
name string,
opts ...options.CreateCollectionOption
) (*Collection, error)
| Name | Type | Summary |
|---|---|---|
|
|
The context for the operation. |
|
|
The name of the new collection. Collection names must follow these rules:
|
|
Optional. The options for this method. See Methods of the |
| Method | Summary |
|---|---|
|
Optional. The vector configuration for the collection. This includes things like the vector dimension, similarity metric, and source model. This also includes settings for server-side embedding generation if you want your collection to have vectorize enabled. Required for vector search and hybrid search. For examples, see Create a collection that can automatically generate vector embeddings and Create a collection that can store vector embeddings. The
|
|
Optional. The reranker configuration for the collection. Only collections in databases in the AWS The
For examples, see Create a collection that supports hybrid search. Default: Rerank is enabled and uses the NVIDIA llama-3.2-nv-rerankqa-1b-v2 reranking model. |
|
Optional. The lexical search configuration for the collection. Only collections in databases in the AWS The
For examples, see Create a collection that supports lexicographical matching. Default: Lexical search is enabled and uses the standard Apache Lucene™ analyzer. |
|
Optional.
Specifies the default ID type for documents in the collection.
This is used when you insert a document without an Supported ID types:
For examples, see Create a collection and specify the default ID format. For more information, see Document IDs (Go). Default: Each autogenerated |
|
Optional. The selective indexing configuration for the collection. You must use For examples, see Create a collection and specify which fields to index and Create a collection and specify which fields shouldn’t be indexed. Default: All fields of all documents. |
|
Optional. The keyspace in which to create the collection. For an example, see Create a collection and specify the keyspace. Default: The working keyspace for the database.
This is |
|
Optional. This only applies to collections with a vectorize embedding provider integration. Use this option to provide the embedding provider API key directly with headers instead of using an API key in the Astra DB KMS. The API key is sent to the Data API for every operation on the collection. It is useful when a vectorize integration is configured but no credentials are stored, or when you want to override the stored credentials. For more information, see Manage embedding provider integrations for vectorize. If you use an AWS embedding provider, you must use |
|
Optional. General API options for this operation, including the timeout. |
Examples
The following examples demonstrate how to create a collection.
Create a collection that is not vector-enabled
package main
import (
"context"
"log"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Get an existing database
client := astra.NewClient()
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
_, err := database.CreateCollection(
ctx,
"COLLECTION_NAME",
)
if err != nil {
log.Fatal(err)
}
}
Create a collection that can store vector embeddings
Collections that are vector-enabled can store vector embeddings in the reserved $vector field and work with vector search.
For optimal vector search results, you should specify the dimension, metric, and source model of your vector embeddings.
All vector embeddings in a collection should be generated by the same model with the same dimensions.
The source model can be one of: ada002, bert, cohere-v3, gecko, nv-qa-4, openai-v3-large, openai-v3-small, other.
package main
import (
"context"
"log"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Get an existing database
client := astra.NewClient()
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
_, err := database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().
UpdateVector(options.Vector().
SetDimension(1024).
SetMetric(options.MetricCosine).
SetSourceModel("nv-qa-4")),
)
if err != nil {
log.Fatal(err)
}
}
Create a collection that can automatically generate vector embeddings
If you want to automatically generate vector embeddings, create a vector-enabled collection and configure an embedding provider integration for the collection.
The configuration depends on the embedding provider.
Configure Azure OpenAI as the embedding provider
For more detailed instructions, see Integrate Azure OpenAI as an embedding provider.
package main
import (
"context"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Instantiate the client
client := astra.NewClient()
// Connect to a database
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().
UpdateVector(options.Vector().
SetDimension(MODEL_DIMENSIONS).
SetMetric("SIMILARITY_METRIC").
UpdateService(
options.VectorService().
SetProvider("azureOpenAI").
SetModelName("MODEL_NAME").
SetAuthentication(
map[string]any{"providerKey": "API_KEY_NAME"}
).
SetParameters(map[string]any{
"resourceName": "RESOURCE_NAME",
"deploymentId": "DEPLOYMENT_ID"
}),
)),
)
}
Replace the following:
-
COLLECTION_NAME: The name for your collection. -
SIMILARITY_METRIC: The method you want to use to calculate vector similarity scores. The available metrics are Cosine (default), Dot Product, and Euclidean. -
API_KEY_NAME: The name of the Azure OpenAI API key that you want to use. Must be the name of an existing Azure OpenAI API key in the Astra Portal. For more information, see Embedding provider authentication.Alternatively, you can omit this parameter and instead provide the authentication key with the
SetEmbeddingAPIKeymethod of the options builder when you instantiate aCollectionobject with the commands to create a collection or get a collection. The client will send thex-embedding-api-keyheader with the specified key to any underlying HTTP request that requires vectorize authentication. Header authentication overrides theAPI_KEY_NAMEparameter if you set both. If you use the header instead of specifying theAPI_KEY_NAMEparameter, you must include the header in every command that uses vectorize, including writes and vector search. -
MODEL_NAME: The model that you want to use to generate embeddings. The available models are:text-embedding-3-small,text-embedding-3-large,text-embedding-ada-002.For Azure OpenAI, you must select the model that matches the one deployed to your
DEPLOYMENT_IDin Azure. -
MODEL_DIMENSIONS: The number of dimensions that you want the generated vectors to have. Your chosen embedding model must support the specified number of dimensions.If you omit the dimension, Astra DB can use a default dimension value. However, some models don’t have default dimensions. You can use the Data API to find supported embedding providers and their configuration parameters, including dimensions ranges and default dimensions.
-
RESOURCE_NAME: The name of your Azure OpenAI Service resource, as defined in the resource’s Instance details. For more information, see the Azure OpenAI documentation. -
DEPLOYMENT_ID: Your Azure OpenAI resource’s Deployment name. For more information, see the Azure OpenAI documentation.
Configure Hugging Face (Dedicated) as the embedding provider
For more detailed instructions, see Integrate Hugging Face Dedicated as an embedding provider.
package main
import (
"context"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Instantiate the client
client := astra.NewClient()
// Connect to a database
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().
UpdateVector(options.Vector().
SetDimension(MODEL_DIMENSIONS).
SetMetric("SIMILARITY_METRIC").
UpdateService(
options.VectorService().
SetProvider("huggingfaceDedicated").
SetModelName("MODEL_NAME").
SetAuthentication(
map[string]any{"providerKey": "API_KEY_NAME"}
).
SetParameters(map[string]any{
"endpointName": "ENDPOINT_NAME",
"regionName": "REGION",
"cloudName": "CLOUD_PROVIDER"
}),
)),
)
}
Replace the following:
-
COLLECTION_NAME: The name for your collection. -
SIMILARITY_METRIC: The method you want to use to calculate vector similarity scores. The available metrics are Cosine (default), Dot Product, and Euclidean. -
API_KEY_NAME: The name of the Hugging Face Dedicated user access token that you want to use. Must be the name of an existing Hugging Face Dedicated user access token in the Astra Portal. For more information, see Embedding provider authentication.Alternatively, you can omit this parameter and instead provide the authentication key in the
EmbeddingAPIKeyproperty ofCreateCollectionOptionsorGetCollectionOptionswhen you instantiate aCollectionobject with the commands to create a collection or get a collection. The client will send thex-embedding-api-keyheader with the specified key to any underlying HTTP request that requires vectorize authentication. Header authentication overrides theAPI_KEY_NAMEparameter if you set both. If you use the header instead of specifying theAPI_KEY_NAMEparameter, you must include the header in every command that uses vectorize, including writes and vector search. -
MODEL_NAME: The model that you want to use to generate embeddings. The available models are:endpoint-defined-model.For Hugging Face Dedicated, you must deploy the model as a text embeddings inference (TEI) container.
You must set
MODEL_NAMEtoendpoint-defined-modelbecause this integration uses the model specified in your dedicated endpoint configuration. -
MODEL_DIMENSIONS: The number of dimensions that you want the generated vectors to have. Your chosen embedding model must support the specified number of dimensions.If you omit the dimension, Astra DB can use a default dimension value. However, some models don’t have default dimensions. You can use the Data API to find supported embedding providers and their configuration parameters, including dimensions ranges and default dimensions.
-
ENDPOINT_NAME: The programmatically-generated name of your Hugging Face Dedicated endpoint. This is the first part of the endpoint URL. For example, if your endpoint URL ishttps://mtp1x7muf6qyn3yh.us-east-2.aws.endpoints.huggingface.cloud, the endpoint name ismtp1x7muf6qyn3yh. -
REGION: The cloud provider region your Hugging Face Dedicated endpoint is deployed to. For example,us-east-2. -
CLOUD_PROVIDER: The cloud provider your Hugging Face Dedicated endpoint is deployed to. For example,aws.
Configure Hugging Face (Serverless) as the embedding provider
For more detailed instructions, see Integrate Hugging Face Serverless as an embedding provider.
package main
import (
"context"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Instantiate the client
client := astra.NewClient()
// Connect to a database
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().
UpdateVector(options.Vector().
SetDimension(MODEL_DIMENSIONS).
SetMetric("SIMILARITY_METRIC").
UpdateService(
options.VectorService().
SetProvider("huggingface").
SetModelName("MODEL_NAME").
SetAuthentication(map[string]any{
"providerKey": "API_KEY_NAME"
}),
)),
)
}
Replace the following:
-
COLLECTION_NAME: The name for your collection. -
SIMILARITY_METRIC: The method you want to use to calculate vector similarity scores. The available metrics are Cosine (default), Dot Product, and Euclidean. -
API_KEY_NAME: The name of the Hugging Face Serverless user access token that you want to use. Must be the name of an existing Hugging Face Serverless user access token in the Astra Portal. For more information, see Embedding provider authentication.Alternatively, you can omit this parameter and instead provide the authentication key in the
EmbeddingAPIKeyproperty ofCreateCollectionOptionsorGetCollectionOptionswhen you instantiate aCollectionobject with the commands to create a collection or get a collection. The client will send thex-embedding-api-keyheader with the specified key to any underlying HTTP request that requires vectorize authentication. Header authentication overrides theAPI_KEY_NAMEparameter if you set both. If you use the header instead of specifying theAPI_KEY_NAMEparameter, you must include the header in every command that uses vectorize, including writes and vector search. -
MODEL_NAME: The model that you want to use to generate embeddings. The available models are:sentence-transformers/all-MiniLM-L6-v2,intfloat/multilingual-e5-large,intfloat/multilingual-e5-large-instruct,BAAI/bge-small-en-v1.5,BAAI/bge-base-en-v1.5,BAAI/bge-large-en-v1.5. -
MODEL_DIMENSIONS: The number of dimensions that you want the generated vectors to have. Your chosen embedding model must support the specified number of dimensions.If you omit the dimension, Astra DB can use a default dimension value. However, some models don’t have default dimensions. You can use the Data API to find supported embedding providers and their configuration parameters, including dimensions ranges and default dimensions.
Configure Jina AI as the embedding provider
For more detailed instructions, see Integrate Jina AI as an embedding provider.
package main
import (
"context"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Instantiate the client
client := astra.NewClient()
// Connect to a database
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().
UpdateVector(options.Vector().
SetDimension(MODEL_DIMENSIONS).
SetMetric("SIMILARITY_METRIC").
UpdateService(
options.VectorService().
SetProvider("jinaAI").
SetModelName("MODEL_NAME").
SetAuthentication(map[string]any{
"providerKey": "API_KEY_NAME"
}),
)),
)
}
Replace the following:
-
COLLECTION_NAME: The name for your collection. -
SIMILARITY_METRIC: The method you want to use to calculate vector similarity scores. The available metrics are Cosine (default), Dot Product, and Euclidean. -
API_KEY_NAME: The name of the Jina AI API key that you want to use. Must be the name of an existing Jina AI API key in the Astra Portal. For more information, see Embedding provider authentication.Alternatively, you can omit this parameter and instead provide the authentication key in the
EmbeddingAPIKeyproperty ofCreateCollectionOptionsorGetCollectionOptionswhen you instantiate aCollectionobject with the commands to create a collection or get a collection. The client will send thex-embedding-api-keyheader with the specified key to any underlying HTTP request that requires vectorize authentication. Header authentication overrides theAPI_KEY_NAMEparameter if you set both. If you use the header instead of specifying theAPI_KEY_NAMEparameter, you must include the header in every command that uses vectorize, including writes and vector search. -
MODEL_NAME: The model that you want to use to generate embeddings. The available models are:jina-embeddings-v2-base-en,jina-embeddings-v2-base-de,jina-embeddings-v2-base-es,jina-embeddings-v2-base-code,jina-embeddings-v2-base-zh. -
MODEL_DIMENSIONS: The number of dimensions that you want the generated vectors to have. Your chosen embedding model must support the specified number of dimensions.If you omit the dimension, Astra DB can use a default dimension value. However, some models don’t have default dimensions. You can use the Data API to find supported embedding providers and their configuration parameters, including dimensions ranges and default dimensions.
Configure Mistral AI as the embedding provider
For more detailed instructions, see Integrate Mistral AI as an embedding provider.
package main
import (
"context"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Instantiate the client
client := astra.NewClient()
// Connect to a database
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().
UpdateVector(options.Vector().
SetDimension(MODEL_DIMENSIONS).
SetMetric("SIMILARITY_METRIC").
UpdateService(
options.VectorService().
SetProvider("mistral").
SetModelName("MODEL_NAME").
SetAuthentication(map[string]any{
"providerKey": "API_KEY_NAME"
}),
)),
)
}
Replace the following:
-
COLLECTION_NAME: The name for your collection. -
SIMILARITY_METRIC: The method you want to use to calculate vector similarity scores. The available metrics are Cosine (default), Dot Product, and Euclidean. -
API_KEY_NAME: The name of the Mistral AI API key that you want to use. Must be the name of an existing Mistral AI API key in the Astra Portal. For more information, see Embedding provider authentication.Alternatively, you can omit this parameter and instead provide the authentication key in the
EmbeddingAPIKeyproperty ofCreateCollectionOptionsorGetCollectionOptionswhen you instantiate aCollectionobject with the commands to create a collection or get a collection. The client will send thex-embedding-api-keyheader with the specified key to any underlying HTTP request that requires vectorize authentication. Header authentication overrides theAPI_KEY_NAMEparameter if you set both. If you use the header instead of specifying theAPI_KEY_NAMEparameter, you must include the header in every command that uses vectorize, including writes and vector search. -
MODEL_NAME: The model that you want to use to generate embeddings. The available models are:mistral-embed. -
MODEL_DIMENSIONS: The number of dimensions that you want the generated vectors to have. Your chosen embedding model must support the specified number of dimensions.If you omit the dimension, Astra DB can use a default dimension value. However, some models don’t have default dimensions. You can use the Data API to find supported embedding providers and their configuration parameters, including dimensions ranges and default dimensions.
Configure NVIDIA as the embedding provider
For more detailed instructions, see Integrate NVIDIA as an embedding provider. Your database must be in a supported region.
package main
import (
"context"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Instantiate the client
client := astra.NewClient()
// Connect to a database
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().
UpdateVector(options.Vector().
SetMetric(options.MetricCosine).
UpdateService(
options.VectorService().
SetProvider("nvidia").
SetModelName("nvidia/nv-embedqa-e5-v5"),
)),
)
}
Configure OpenAI as the embedding provider
For more detailed instructions, see Integrate OpenAI as an embedding provider.
package main
import (
"context"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Instantiate the client
client := astra.NewClient()
// Connect to a database
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().
UpdateVector(options.Vector().
SetDimension(MODEL_DIMENSIONS).
SetMetric("SIMILARITY_METRIC").
UpdateService(
options.VectorService().
SetProvider("openai").
SetModelName("MODEL_NAME").
SetAuthentication(
map[string]any{"providerKey": "API_KEY_NAME"}
).
SetParameters(map[string]any{
"organizationId": "ORGANIZATION_ID",
"projectId": "PROJECT_ID"
}),
)),
)
}
Replace the following:
-
COLLECTION_NAME: The name for your collection. -
SIMILARITY_METRIC: The method you want to use to calculate vector similarity scores. The available metrics are Cosine (default), Dot Product, and Euclidean. -
API_KEY_NAME: The name of the OpenAI API key that you want to use. Must be the name of an existing OpenAI API key in the Astra Portal. For more information, see Embedding provider authentication.Alternatively, you can omit this parameter and instead provide the authentication key in the
EmbeddingAPIKeyproperty ofCreateCollectionOptionsorGetCollectionOptionswhen you instantiate aCollectionobject with the commands to create a collection or get a collection. The client will send thex-embedding-api-keyheader with the specified key to any underlying HTTP request that requires vectorize authentication. Header authentication overrides theAPI_KEY_NAMEparameter if you set both. If you use the header instead of specifying theAPI_KEY_NAMEparameter, you must include the header in every command that uses vectorize, including writes and vector search. -
MODEL_NAME: The model that you want to use to generate embeddings. The available models are:text-embedding-3-small,text-embedding-3-large,text-embedding-ada-002. -
MODEL_DIMENSIONS: The number of dimensions that you want the generated vectors to have. Your chosen embedding model must support the specified number of dimensions.If you omit the dimension, Astra DB can use a default dimension value. However, some models don’t have default dimensions. You can use the Data API to find supported embedding providers and their configuration parameters, including dimensions ranges and default dimensions.
-
ORGANIZATION_ID: Optional. The ID of the OpenAI organization that owns the API key. Only required if your OpenAI account belongs to multiple organizations or if you are using a legacy user API key to access projects. For more information about organization IDs, see the OpenAI API reference. -
PROJECT_ID: Optional. The ID of the OpenAI project that owns the API key. This cannot use the default project. Only required if your OpenAI account belongs to multiple organizations or if you are using a legacy user API key to access projects. For more information about project IDs, see the OpenAI API reference.
Configure Upstage as the embedding provider
For more detailed instructions, see Integrate Upstage as an embedding provider.
package main
import (
"context"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Instantiate the client
client := astra.NewClient()
// Connect to a database
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().
UpdateVector(options.Vector().
SetDimension(MODEL_DIMENSIONS).
SetMetric("SIMILARITY_METRIC").
UpdateService(
options.VectorService().
SetProvider("upstageAI").
SetModelName("MODEL_NAME").
SetAuthentication(map[string]any{
"providerKey": "API_KEY_NAME"
}),
)),
)
}
Replace the following:
-
COLLECTION_NAME: The name for your collection. -
SIMILARITY_METRIC: The method you want to use to calculate vector similarity scores. The available metrics are Cosine (default), Dot Product, and Euclidean. -
API_KEY_NAME: The name of the Upstage API key that you want to use. Must be the name of an existing Upstage API key in the Astra Portal. For more information, see Embedding provider authentication.Alternatively, you can omit this parameter and instead provide the authentication key in the
EmbeddingAPIKeyproperty ofCreateCollectionOptionsorGetCollectionOptionswhen you instantiate aCollectionobject with the commands to create a collection or get a collection. The client will send thex-embedding-api-keyheader with the specified key to any underlying HTTP request that requires vectorize authentication. Header authentication overrides theAPI_KEY_NAMEparameter if you set both. If you use the header instead of specifying theAPI_KEY_NAMEparameter, you must include the header in every command that uses vectorize, including writes and vector search. -
MODEL_NAME: The model that you want to use to generate embeddings. The available models are:solar-embedding-1-large. -
MODEL_DIMENSIONS: The number of dimensions that you want the generated vectors to have. Your chosen embedding model must support the specified number of dimensions.If you omit the dimension, Astra DB can use a default dimension value. However, some models don’t have default dimensions. You can use the Data API to find supported embedding providers and their configuration parameters, including dimensions ranges and default dimensions.
Configure Voyage AI as the embedding provider
For more detailed instructions, see Integrate Voyage AI as an embedding provider.
package main
import (
"context"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Instantiate the client
client := astra.NewClient()
// Connect to a database
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().
UpdateVector(options.Vector().
SetDimension(MODEL_DIMENSIONS).
SetMetric("SIMILARITY_METRIC").
UpdateService(
options.VectorService().
SetProvider("voyageAI").
SetModelName("MODEL_NAME").
SetAuthentication(map[string]any{
"providerKey": "API_KEY_NAME"
}),
)),
)
}
Replace the following:
-
COLLECTION_NAME: The name for your collection. -
SIMILARITY_METRIC: The method you want to use to calculate vector similarity scores. The available metrics are Cosine (default), Dot Product, and Euclidean. -
API_KEY_NAME: The name of the Voyage AI API key that you want to use. Must be the name of an existing Voyage AI API key in the Astra Portal. For more information, see Embedding provider authentication.Alternatively, you can omit this parameter and instead provide the authentication key in the
EmbeddingAPIKeyproperty ofCreateCollectionOptionsorGetCollectionOptionswhen you instantiate aCollectionobject with the commands to create a collection or get a collection. The client will send thex-embedding-api-keyheader with the specified key to any underlying HTTP request that requires vectorize authentication. Header authentication overrides theAPI_KEY_NAMEparameter if you set both. If you use the header instead of specifying theAPI_KEY_NAMEparameter, you must include the header in every command that uses vectorize, including writes and vector search. -
MODEL_NAME: The model that you want to use to generate embeddings. The available models are:voyage-2,voyage-code-2,voyage-finance-2,voyage-large-2,voyage-large-2-instruct,voyage-law-2,voyage-multilingual-2. -
MODEL_DIMENSIONS: The number of dimensions that you want the generated vectors to have. Your chosen embedding model must support the specified number of dimensions.If you omit the dimension, Astra DB can use a default dimension value. However, some models don’t have default dimensions. You can use the Data API to find supported embedding providers and their configuration parameters, including dimensions ranges and default dimensions.
Create a collection that supports hybrid search
If you want to perform hybrid search on your collection, you must create a collection that has vector, lexical, and rerank enabled.
Your collection must also be in a database in the AWS us-east-2 region.
Lexical and rerank are enabled by default when you create a collection in a database in the AWS us-east-2 region, but you can optionally configure the lexical analyzer and the reranker model.
For configuration details about the lexical analyzer, see Find data with CQL analyzers. The following example uses a configuration suitable for English text.
For configuration details about the reranker model, inspect the available reranker models. Only the NVIDIA llama-3.2-nv-rerankqa-1b-v2 reranking model reranker model is supported.
For configuration details about vector, see Create a collection that can store vector embeddings and Create a collection that can automatically generate vector embeddings.
package main
import (
"context"
"log"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Get an existing database
client := astra.NewClient()
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
_, err := database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().
UpdateVector(options.Vector().
SetDimension(1024).
SetMetric(options.MetricCosine).
UpdateService(
options.VectorService().
SetProvider("nvidia").
SetModelName("nvidia/nv-embedqa-e5-v5"))).
UpdateLexical(options.Lexical().
SetEnabled(true).
SetCustomAnalyzer(map[string]any{
"tokenizer": map[string]any{
"name": "standard",
"args": map[string]any{},
},
"filters": []map[string]any{
{"name": "lowercase"},
{"name": "stop"},
{"name": "porterstem"},
{"name": "asciifolding"},
},
"charFilters": []map[string]any{},
})).
UpdateRerank(options.Rerank().
SetEnabled(true).
UpdateService(
options.RerankService().
SetProvider("nvidia").
SetModelName("nvidia/llama-3.2-nv-rerankqa-1b-v2"),
)),
)
if err != nil {
log.Fatal(err)
}
}
Create a collection that supports lexicographical matching
If you want to use lexicographical matching to find documents in your collection, you must create a collection that has lexical enabled.
Your collection must also be in a database in the AWS us-east-2 region.
Lexical is enabled by default when you create a collection in a database in the AWS us-east-2 region, but you can optionally configure the lexical analyzer.
For configuration details about the lexical analyzer, see Find data with CQL analyzers. The following example uses a configuration suitable for English text.
package main
import (
"context"
"log"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Get an existing database
client := astra.NewClient()
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
_, err := database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().
UpdateLexical(options.Lexical().
SetEnabled(true).
SetCustomAnalyzer(map[string]any{
"tokenizer": map[string]any{
"name": "standard",
"args": map[string]any{},
},
"filters": []map[string]any{
{"name": "lowercase"},
{"name": "stop"},
{"name": "porterstem"},
{"name": "asciifolding"},
},
"charFilters": []map[string]any{},
})),
)
if err != nil {
log.Fatal(err)
}
}
Create a collection and specify the default ID format
For more information about the default ID format, see Document IDs (Go). For allowed values, see the Parameters.
package main
import (
"context"
"log"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Get an existing database
client := astra.NewClient()
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
_, err := database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().
SetDefaultIdType(options.CollectionIdTypeObjectId),
)
if err != nil {
log.Fatal(err)
}
}
Create a collection and specify which fields to index
For more information about selective indexing, see Indexes in collections (Go).
package main
import (
"context"
"log"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Get an existing database
client := astra.NewClient()
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
_, err := database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().SetIndexingAllow("city", "country"),
)
if err != nil {
log.Fatal(err)
}
}
Create a collection and specify which fields shouldn’t be indexed
For more information about selective indexing, see Indexes in collections (Go).
package main
import (
"context"
"log"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Get an existing database
client := astra.NewClient()
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
_, err := database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().SetIndexingDeny("city", "country"),
)
if err != nil {
log.Fatal(err)
}
}
Create a collection and specify the keyspace
package main
import (
"context"
"log"
"github.com/datastax/astra-db-go/v2/astra"
"github.com/datastax/astra-db-go/v2/astra/options"
)
func main() {
ctx := context.Background()
// Get an existing database
client := astra.NewClient()
database := client.Database(
"API_ENDPOINT",
options.API().SetToken("APPLICATION_TOKEN"),
)
// Create a collection
_, err := database.CreateCollection(
ctx,
"COLLECTION_NAME",
options.CreateCollection().SetKeyspace("KEYSPACE_NAME"),
)
if err != nil {
log.Fatal(err)
}
}
Client reference
For more information, see the client reference.