Data Format¶
Info
Understanding the design of Loggie's internal data format can help us configure appropriate log processing and log format conversion.
Structure¶
Log data inside Loggie, including:
- body: The raw data received by the source. For example, a line of log data in a log file collected using file source.
- header: Fields used by the user. For example, the "fields" field that the user adds to the source, the fields obtained after log is splits, etc.
- meta: The built-in meta information of the Loggie system, which will not be sent to the downstream by default.
Format Conversion¶
If the above format does not meet your needs, you can refer to:
Log Segmentation¶
For the segmentation and processing of raw log data, please use normalize interceptor. Refer to: