Struct KafkaSourceConfig 

pub struct KafkaSourceConfig {
    pub brokers: String,
    pub topic: String,
    pub group_id: String,
    pub commit_interval: Duration,
    pub startup_timeout: Duration,
    pub statistics_interval: Duration,
    pub rdkafka: BTreeMap<String, String>,
}

Configuration of a KafkaSource, deserialized from the pipeline’s opaque source: { kafka: ... } section.

Fields

brokers: String

Comma-separated bootstrap servers.

topic: String

The topic to consume. One topic per pipeline: the framework’s PartitionId is the Kafka partition number, which is only unique within a single topic.

group_id: String

Consumer group id.

commit_interval: Duration

How often stored offsets are auto-committed (librdkafka auto.commit.interval.ms).

startup_timeout: Duration

How long to wait for the first partition assignment before the source reports a fatal startup error.

statistics_interval: Duration

Statistics emission interval feeding lag metrics. Zero disables statistics.

rdkafka: BTreeMap<String, String>

Raw librdkafka properties, applied verbatim after validation. Framework-owned properties (see crate docs) are rejected; prefetch backstops (queued.min.messages, queued.max.messages.kbytes) may be tuned here.

Implementations

impl KafkaSourceConfig

pub fn from_component_config( section: &ComponentConfig, ) -> Result<Self, ConfigError>

Deserialize and validate from the pipeline’s opaque component section.

pub fn validate(&self) -> Result<(), ConfigError>

Cross-field validation, including the passthrough denylist.

Trait Implementations

impl Clone for KafkaSourceConfig

fn clone(&self) -> KafkaSourceConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for KafkaSourceConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for KafkaSourceConfig

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for KafkaSourceConfig

fn eq(&self, other: &KafkaSourceConfig) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for KafkaSourceConfig