六花踏雪

六花踏雪

HomeArchives

Logstash将数据推送到Loki

31
AI-generated summary
This document outlines the steps to push data from Logstash to Loki using Docker. 1. **Run Logstash**: A Docker Compose configuration is provided to set up a Logstash container with specific settings, including environment variables and volume mappings for configuration files. 2. **Install Logstash Output Plugin**: Inside the Logstash container, the `logstash-output-loki` plugin is installed. 3. **Configure Logstash**: The `logstash.conf` file is modified to set up an input for TCP on port 8065 and an output to Loki's API. 4. **Restart Logstash**: After making configuration changes, Logstash is restarted. 5. **Run Loki**: A Docker Compose configuration is also provided to set up a Loki container. 6. **Run Grafana**: Another Docker Compose configuration sets up a Grafana container. 7. **Configure Grafana**: In Grafana, the Loki data source is added by entering the Loki address. 8. **Query Logs**: Users can explore and query logs through the Grafana interface. References are provided for further information on setting up and troubleshooting the integration.

logstash 推送数据到 loki#

运行 logstash#

# logstash
version: '3'
services:
  logstash:
    image: docker.elastic.co/logstash/logstash:8.12.0
    container_name: logstash_server
    restart: always
    ports:
      - 8065:8065
    environment:
      - LS_JAVA_OPTS=-Xmx1024m -Xms1024m
    volumes:
      - ./config/logstash.conf:/etc/logstash/conf.d/logstash.conf # 读取宿主机配置
    entrypoint:
      - logstash
      - -f
      - /etc/logstash/conf.d/logstash.conf
    logging:
      driver: "json-file"
      options:
        max-size: "200m"
        max-file: "3"

logstash 运行后进入容器#

# 安装logstash-output-loki插件
logstash-plugin install logstash-output-loki

修改 logstash 配置#

// logstash.conf
input {
  tcp {
      port=> 8065
      codec => "json"
  }
}

output {
     loki{
      url => "http://loki:3100/loki/api/v1/push"
  }
}

重启 logstash

运行 loki#

# loki
version: '3'
services:
  loki:
    image: grafana/loki
    container_name: loki
    restart: always
    ports:
      - "3100:3100"
    command: -config.file=/etc/loki/local-config.yaml

运行 grafana#

version: '3'
services:
    grafana:
      image: grafana/grafana
      container_name: grafana
      hostname: grafana
      restart: always
      ports:
          - "3000:3000"

进入 grafana, 打开左侧菜单，点击 Administration

Untitled

点击 Plugin，搜索 loki

Untitled 1

进入选项后点击 Add new data source

Untitled 2

输入 loki 地址，http://localhost:3100

Untitled 3

Untitled 4

配置成功

查询日志#

左侧菜单，explore，选择过滤条件后，Run query 进行查询

Untitled 5

参考

https://github.com/grafana/loki/issues/9755

https://grafana.com/docs/loki/latest/send-data/logstash/

https://github.com/grafana/loki/issues/2886

Loading...
Ownership of this post data is guaranteed by blockchain and smart contracts to the creator alone.