You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 11 Next »

References

CPS-1298 - Getting issue details... STATUS

Kafka Topic Configurations for Confluent Platform | Confluent Documentation

Assumptions

#

Assumption

Notes

1

Partition count and Replica count are been configured at the cluster level.
AS explained by Fiachra Corcoran 

Partitions : 10

Replicas : 3

Issues & Decisions ( ncmp-events )

  • We publish the Lifecycle Management Events to this topic whenever there is change in the CmHandleState.

#

Issue

Notes 

Decision

Comments
1What is the ThroughputNumber of messages produced in a certain amount of timeNot NeededNo longer need to know as dimension is done at deployment and runtime
2Retention TimeHow long to keep the messages in the kafka topic before(deleting/compacting it)?2hrsSince some other teams will be consuming these messages so we will give them some time to consume.
3Segment Bytes

Segment file size ie. Max. total topic size

Default 1Gi (1073741824)

Not set in CPS Helm

Fiachra Corcoran advised us to just set Retention time

4Access ControlWhich user has access to Read , Write from the topic?

cps-kafka-user

already defined in the OOM charts.
5Consumer GroupsDoes CPS team define the consumer group name or the consuming application.Yes: ncmp-groupAlready defined in the application.yml config

Issues & Decisions ( ncmp-async-m2m )

  • This topic is currently used for the async communication. (update more details)


#

Issue

Notes 

Decision

Comments
1What is the ThroughputNumber of messages produced in a certain amount of timeNot NeededNo longer need to know as dimension is done at deployment and runtime
2Retention TimeHow long to keep the messages in the kafka topic before(deleting/compacting it)?10mins (allow dor restart)Machine to machine communication between cps and dmi.
3Segment Bytes

Segment file size ie. Max. total topic size

Default 1Gi (1073741824)

Not set in CPS Helm

Fiachra Corcoran advised us to just set Retention time

4Access ControlWhich user has access to Read , Write from the topic?

cps-kafka-user

already defined in the OOM charts.
5Consumer GroupsDoes CPS team define the consumer group name or the consuming application.Yes: ncmp-groupAlready defined in the application.yml config
  • No labels