Skip to content

Configurable exportPeriod for disk buffering related PeriodicExporter #1823

Description

@bencehornak

Problem

Currently, the PeriodicExporter is statically configured to wake up every 10 seconds and to check if there is anything to export from the disk:

internal class PeriodicExporter(
private val delegate: SignalFromDiskExporter,
private val exportPeriod: Duration = 10.seconds,
) : PeriodicRunnable {

I have overridden the defaults for the disk buffering to write the files for at least 15 minutes to reduce the number of calls on my backend (I have tens of thousands of devices producing logs around the clock, so the number of requests would incur extreme amount of costs with the default disk buffering config). However, I'm unable to reduce the frequency of the PeriodicExporter to check the buffers less frequently, so it is checking the buffers 90 times more frequently than necessary.

Proposal

Use the DiskBufferingConfig.minFileAgeForReadMillis property for PeriodicExporter.exportPeriod? (I'm open for better suggestions)

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requesthelp wantedExtra attention is needed

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions