[pulsar document] concepts and architecture

Catalog

One 、 summary /Overview

Two 、 news /Messaging

3、 ... and 、 framework /Architecture

Four 、 client /Clients

5、 ... and 、 Regional replication /Geo Replication

6、 ... and 、 multi-tenancy /Multi Tenancy

7、 ... and 、 Authentication and Authorization /Authentication and Authorization

8、 ... and 、 Theme compression /Topic Compaction

Nine 、 Agent support and SNI route /Proxy support with SNI routing

Ten 、 Multiple broadcast listeners /Multiple advertised listeners

---

One 、 summary /Overview

Pulsar It's a multi tenant 、 High performance server to server messaging solutions .Originally developed by Yahoo, Pulsar is under the stewardship of the Apache Software Foundation.

Key features of Pulsar are listed below:

• Support multiple clusters （multiple clusters in a Pulsar instance）, Seamless message regional replication across clusters
• Extremely low publishing and end-to-end latency （end-to-end latency）
• Seamlessly expand to millions of topics （million topics）
• Easy to use client API,A simple client API with bindings for Java, Go, Python and C++.
• Multiple subscription types ,Multiple subscription types (exclusive, shared, and failover) for topics.
• from Apache BookKeeper Ensure the delivery of persistent messages .
• Provides a lightweight computing framework without servers Pulsar Functions, Can process stream data （stream-native data）.
• Provide a server free connector framework  Pulsar IO,Pulsar IO stay Pulsar Functions Build on , Data can be moved in and out more easily Apache Pulsar.
• Hierarchical storage （Tiered Storage）, When data ages , Tiered storage moves data from hot storage to cold storage （ Such as S3 and GCS）.

Two 、 news /Messaging

1、 news Messaging

2、 producer Producers

3、 consumer Consumers

4、 The theme Topics

5、 Namespace  Namespaces

6、 News subscription  Subscriptions

7、 Multi topic subscription  Multi-topic subscriptions

8、 Theme partition  Partitioned topics

9、 Non persistent themes  Non-persistent topics

10、 System theme  System topic

11、 The messaging Message redelivery

12、 Message retention and expiration  Message retention and expiry

13、 The news is heavy  Message deduplication

14、 Message delay delivery

// If the connection fails , Please find the corresponding article in this column

3、 ... and 、 framework /Architecture

pulsar Architecture Overview Architecture Overview

Four 、 client /Clients

Pulsar client （Clients）

5、 ... and 、 Regional replication /Geo Replication

Regional replication /Geo Replication

6、 ... and 、 multi-tenancy /Multi Tenancy

Pulsar multi-tenancy

7、 ... and 、 Authentication and Authorization /Authentication and Authorization

Pulsar Support pluggable Authentication Mechanism , This mechanism can be found in proxy and/or the broker On the configuration .Pulsar It also supports pluggable to grant authorization Mechanism . These mechanisms are jointly identified client  And client  On the subject 、 Namespace and tenant access .

// Java client API 

8、 ... and 、 Theme compression /Topic Compaction

Theme compression /Topic Compaction

Nine 、 Agent support and SNI route /Proxy support with SNI routing

Agent support and SNI route /Proxy support with SNI routing

Ten 、 Multiple broadcast listeners /Multiple advertised listeners

Pulsar Multicast listener