Integrate AWS Lambda with Astra DB Serverless
AWS Lambda is a functions-as-a-service (FaaS) offering that provides a serverless execution environment for your code. Lambda functions consist of function code and dependencies bundled into a deployment package.
You can use AWS Lambda with Astra DB for additional data processing capabilities, such as aggregating, summarizing, and validating data, and to connect Astra DB with other cloud services in data pipelines, among other use cases.
If you are new to AWS Lambda, practice creating a simple function. |
This guide explains how to create, deploy, and test functions that use the DataStax Python and Java drivers to connect to your Astra DB database.
Prerequisites
-
An active Astra account
-
An active Serverless (Vector) database
-
An application token with the Database Administrator role
-
The database’s Secure Connect Bundle (SCB)
-
Python 3.8 or later
-
pip 23.0 or later
Create a Python driver function
This function’s deployment package includes the DataStax Python driver library, a Python script that connects to your Astra DB database, and your database’s Secure Connect Bundle, which is used for authentication.
-
Create a directory for your Python project:
mkdir lambda-astra-db-project cd lambda-astra-db-project
-
Move your database’s SCB zip file into the project directory.
-
Create a Python script file that contains the following code:
from cassandra.cluster import Cluster from cassandra.auth import PlainTextAuthProvider import os ASTRA_DB_CLIENT_ID = os.environ.get('ASTRA_DB_CLIENT_ID') ASTRA_DB_CLIENT_SECRET = os.environ.get('ASTRA_DB_CLIENT_SECRET') cloud_config = { 'secure_connect_bundle': 'SCB_FILE_NAME.zip', 'use_default_tempdir': True } auth_provider = PlainTextAuthProvider(ASTRA_DB_CLIENT_ID, ASTRA_DB_CLIENT_SECRET) cluster = Cluster(cloud=cloud_config, auth_provider=auth_provider, protocol_version=4) session = cluster.connect() def lambda_handler(event, context): row = session.execute("SELECT cql_version FROM system.local WHERE key = 'local';").one() cql_version = row[0] print(cql_version) print('Success') return cql_version
Replace
SCB_FILE_NAME
with the SCB file name, such assecure-connect-DATABASE_NAME.zip
. -
Install the Python
cassandra-driver
library in the project directory:pip install --target . cassandra-driver
-
Create a zip file archive deployment package from your project directory, including the SCB, Python script, and
cassandra-driver
library:zip -r lambda-astra-db-deployment-package.zip .
-
In the AWS Lambda console, go to Functions, and then click Create function.
-
Click Author from scratch.
-
Enter a function name, select a Python runtime, select an architecture, and then click Create function.
-
On the Code tab, in the Code source section, click Upload from, and then select your Python function deployment package.
For more information, see Deploying Lambda functions as zip file archives.
-
On the Configuration tab, set the following environment variables:
-
ASTRA_DB_CLIENT_ID
:token
(the literal, all-lowercase stringtoken
) -
ASTRA_DB_CLIENT_SECRET
: Your application token.-
To increase security, store sensitive values in AWS Secret Manager.
-
To optimize function performance, consider configuring reserved and provisioned concurrency.
-
-
-
On the Test tab, test your function in the Lambda console.
A successful result includes the CQL version, such as
3.4.5
, and a200 OK
status code.
Create a Java driver function
This function’s deployment package includes the function’s dependencies, a Java script that connects to your Astra DB database, and your database’s Secure Connect Bundle, which is used for authentication.
The dependencies include the DataStax Java driver library and aws-lambda-java-core
.
This example uses Apache Maven™ to create the project and build the deployment package.
-
Use Maven to create a Java project:
mvn archetype:generate -DgroupId=com.example -DartifactId=AstraDBFunction -DinteractiveMode=false
-
Rename
App.java
toAstraDBFunction.java
, and then replace the content with the following code:package com.example; import com.amazonaws.services.lambda.runtime.Context; import com.amazonaws.services.lambda.runtime.RequestHandler; import com.amazonaws.services.lambda.runtime.LambdaLogger; import com.datastax.oss.driver.api.core.CqlSession; import com.datastax.oss.driver.api.core.cql.ResultSet; import com.datastax.oss.driver.api.core.cql.Row; import java.nio.file.Paths; import java.util.Map; public class AstraDBFunction implements RequestHandler<Map<String,String>, String>{ private static final String ASTRA_DB_CLIENT_ID = System.getenv("ASTRA_DB_CLIENT_ID"); private static final String ASTRA_DB_CLIENT_SECRET = System.getenv("ASTRA_DB_CLIENT_SECRET"); private static CqlSession session = CqlSession.builder() .withCloudSecureConnectBundle(Paths.get("SCB_FILE_NAME.zip")) .withAuthCredentials(ASTRA_DB_CLIENT_ID,ASTRA_DB_CLIENT_SECRET) .build(); public String handleRequest(Map<String,String> event, Context context) { LambdaLogger logger = context.getLogger(); ResultSet rs = session.execute("SELECT cql_version FROM system.local WHERE key = 'local';"); Row row = rs.one(); String response = row.getString("cql_version"); logger.log(response + " Success \n"); return response; } }
Replace
SCB_FILE_NAME
with the SCB file name, such assecure-connect-DATABASE_NAME.zip
. -
In the project directory, create a
resources
directory in/src/main
. -
Move your database’s SCB zip file into the
resources
directory. -
Make sure that your project has the following directory structure:
AstraDBFunction ├── src │ ├── main │ │ ├── java │ │ │ └── com │ │ │ └── example │ │ │ └── AstraDBFunction.java │ │ └── resources │ │ └── secure-connect-DATABASE_NAME.zip │ └── test └── pom.xml
-
Add the AWS Lambda and Java driver dependencies to your
pom.xml
file:<dependency> <groupId>com.amazonaws</groupId> <artifactId>aws-lambda-java-core</artifactId> <!-- Use the latest version from https://central.sonatype.dev/artifact/com.amazonaws/aws-lambda-java-core/1.2.2/versions --> <version>VERSION</version> </dependency> <dependency> <groupId>com.amazonaws</groupId> <artifactId>aws-lambda-java-events</artifactId> <!-- Use the latest version from https://central.sonatype.dev/artifact/com.amazonaws/aws-lambda-java-events/3.11.0/versions --> <version>VERSION</version> </dependency> <dependency> <groupId>com.amazonaws</groupId> <artifactId>aws-lambda-java-log4j2</artifactId> <!-- Use the latest version from https://central.sonatype.dev/artifact/com.amazonaws/aws-lambda-java-log4j2/1.5.1/versions --> <version>VERSION</version> </dependency> <dependency> <groupId>com.datastax.oss</groupId> <artifactId>java-driver-core</artifactId> <!-- Use the latest version from https://search.maven.org/artifact/com.datastax.oss/java-driver-core --> <version>VERSION</version> </dependency>
-
Add or replace the
pom.xml
file’sbuild
section with the following code:<build> <plugins> <plugin> <artifactId>maven-surefire-plugin</artifactId> <version>2.22.2</version> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-shade-plugin</artifactId> <version>3.2.2</version> <configuration> <createDependencyReducedPom>false</createDependencyReducedPom> <filters> <filter> <artifact>*:*</artifact> <excludes> <exclude>**/Log4j2Plugins.dat</exclude> </excludes> </filter> </filters> </configuration> <executions> <execution> <phase>package</phase> <goals> <goal>shade</goal> </goals> </execution> </executions> </plugin> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-compiler-plugin</artifactId> <version>3.8.1</version> <configuration> <source>11</source> <target>11</target> </configuration> </plugin> </plugins> </build>
-
Use Maven to compile the project into a JAR file:
mvn clean compile package
The JAR file is your Java function deployment package. You can find the deployment package, such as
AstraDBFunction-1.0-SNAPSHOT.jar
, in the project’starget
directory:AstraDBFunction ├── src │ ├── main │ │ ├── java │ │ │ └── com │ │ │ └── example │ │ │ └── AstraDBFunction.java │ │ └── resources │ │ └── secure-connect-database-name.zip │ └── test ├── target │ ├── AstraDBFunction-1.0-SNAPSHOT.jar │ ├── original-AstraDBFunction-1.0-SNAPSHOT.jar │ ├── maven-archiver │ ├── surefire-reports │ ├── test-classes │ ├── generated-test-sources │ ├── maven-status │ ├── generated-sources │ └── classes └── pom.xml
-
In the AWS Lambda console, go to Functions, and then click Create function.
-
Click Author from scratch.
-
Enter a function name, select a Java runtime, select an architecture, and then click Create function.
-
On the Code tab, in the Code source section, click Upload from, and then select your Java function deployment package.
For more information, see Deploying Lambda functions as zip file archives.
-
In the Runtime settings section, set Handler to
com.example.AstraDBFunction::handleRequest
. -
On the Configuration tab, set the following environment variables:
-
ASTRA_DB_CLIENT_ID
:token
(the literal, all-lowercase stringtoken
) -
ASTRA_DB_CLIENT_SECRET
: Your application token.-
To increase security, store sensitive values in AWS Secret Manager.
-
To optimize function performance, consider configuring reserved and provisioned concurrency.
-
-
-
On the Test tab, test your function in the Lambda console.
A successful result includes the CQL version, such as
3.4.5
, and a200 OK
status code.