2.3 System Sizing for High Availability

This section helps you in determining whether your environment might meets the requirements for a high availability environment. It provides guidance for hardware requirements and tuning the performance.

2.3.1 System Sizing for High Availability

Master Node

Category

Requirement

Master nodes

3

CPU cores (per node)

4

RAM (per node)

16 GB

Disks (per node)

2

Hard disk

350 GB

Worker Node

Category

Requirement for Small Workloads

Requirement for Medium Workloads

Requirement for Large Workloads

Worker nodes

2

2

2

CPU cores (per node)

8

8

12

RAM (per node)

32 GB

48 GB

64 GB

Disks (per node)

2

2

2

Storage per day (1x)

350 MB

950 MB

10 GB

Total disk space (365 days)

500 GB

1 TB

3 TB

External NFS Server

Category

Requirement

CPU cores

4

RAM

4 GB

Hard disk

300 GB

2.3.2 Database Resource Pools Tuning for High Availability

Based on the workload, see the relevant (small, medium, large) workload distribution section.

2.3.3 Transformation Hub Tuning for High Availability

Property

Quantity

# of Kafka broker nodes in the Kafka cluster

3

# of ZooKeeper nodes in the ZooKeeper cluster

3

# of Partitions assigned to each Kafka Topic

6

# of replicas assigned to each Kafka Topic

2

# of message replicas for the __consumer_offsets Topic

3

Schema Registry nodes in the cluster

3

Kafka nodes required to run Schema Registry

3

# of CEF-to-Avro Stream Processor instances to start

1