Installation topologies
This page describes recommended starting points for Pulsar deployments.
-
SANDBOX (or Pulsar Standalone) is an all-in-one single-node deployment that is useful for taking Pulsar for a test drive.
-
DEVELOPMENT is a 3-node deployment that is not highly available, but able to maintain parity with the TESTING environment.
-
SINGLE REGION TESTING ENVIRONMENT is a highly-available 3/3/3 deployment.
-
HIGH-AVAILABILITY PRODUCTION ENVIRONMENT is a highly-available deployment replicated across 3 zones in 1 region.
The number of nodes in a highly available cluster depends on the number of zones in the region. We recommend aligning the replication factor with the AZ count, so in this example, 3 zones and a replication factor of 3. |
Environment | Server Component | Node Count | Note |
---|---|---|---|
SANDBOX (STANDALONE) |
(combined) Zookeeper, Broker, and Bookie |
1 |
|
DEVELOPMENT (1 region, 1 zone) |
Zookeeper |
1 |
|
Broker |
1 |
||
Bookie |
1 |
||
SINGLE REGION TESTING ENVIRONMENT (1 region, 1 zone) |
Zookeeper |
3 |
|
Broker |
3 |
||
Bookie |
3 |
||
Pulsar proxy |
3 |
||
(Dedicated) Function Worker |
3 |
||
HIGH-AVAILABILITY PRODUCTION ENVIRONMENT (1 region, 3 zones) |
Zookeeper |
5 |
2/2/1 nodes* |
Broker |
3 |
1 nodes per AZ* |
|
(Dedicated) Function Worker |
3 |
1 node per AZ* |
|
Bookie |
6 |
2 nodes per AZ* |
|
Pulsar proxy |
3 |
1 node per AZ* |
|
Autorecovery |
3 |
1 per AZ* |
*Assuming a replication factor of 3.
Hardware sizing
The following table lists the minimum hardware requirements for a Pulsar cluster.
Environment | Server Component | Hardware Spec | Note |
---|---|---|---|
DEVELOPMENT |
Zookeeper, Broker, and Bookkeeper |
|
Data disks are shared by: |
TEST |
Zookeeper |
|
|
Broker and Function Worker |
|
No data disk |
|
Bookie |
|
||
Pulsar Proxy, Function Worker |
|
||
PRODUCTION |
Zookeeper |
|
|
Broker |
|
||
Bookie |
|
Ledger disk capacity can be beyond 1TB. |
|
Pulsar Proxy, Autorecovery |
|
||
Dedicated Function Worker |
|
What’s next
For more on cluster sizing, see Production Cluster Sizing.