Re: A Question about KafkaAppender

"Piotr P. Karwasz" <[email protected]> Mon, 27 Jan 2025 21:49:54 +0100
Newsgroups gmane.comp.jakarta.log4j.user
Message-ID <[email protected]>
--------------JhdOdqRe2pduso0Arjw8T0dK
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit

Hi Volkan,

On 27.01.2025 20:20, Volkan Yazıcı wrote:
> Have you considered the async. appender
> <https://logging.apache.org/log4j/2.x/manual/appenders/delegating.html#AsyncAppender>?
> It can be configured to drop to requests if the buffer is full, i.e., Kafka
> is not keeping up.

IIRC the Kafka Appender and asynchronous components don't like each 
other. The Kafka client library uses asynchronous calls and the Kafka 
asynchronous thread also generates log events. This can end up in 
problems like #2893[1].

When it comes to the Kafka Appender, I think a big rewrite is needed.

Piotr

[1] https://github.com/apache/logging-log4j2/issues/2893
--------------JhdOdqRe2pduso0Arjw8T0dK--