Log collection is connected to Alibaba Cloud Log Service

This article mainly explains how to use the Alibaba Cloud log collection plug-in to connect with the Alibaba Cloud log service, and collect and send the logs generated by the components on the Rainbond platform to the Alibaba Cloud log service through the plug-in.

Reference video

Preconditions

• There is a defaultAlibaba Cloud log service collection pluginin the team.
• A runnable component that persists logs to log files.
• An available Alibaba Cloud account.

Plug-in installation and activation

On the My Plugins page in the team view, selectCloud Log Service Collection Plugin, and click Install. After the installation is complete, the component can use the plugin.

After the installation is complete, on the plug-in page of the component management page, in the list ofnot activated, findAlibaba Cloud Log Service Collection Plug-in, click the buttonto activateon the right to activate the plug-in.After that, the plugin will appear in the list ofopened and.

parameter configuration

You can click theView Configurationbutton on the right side of the plug-in to view the configuration parameter information of the plug-in.

parameter name	Defaults	illustrate
ALIYUN_LOGTAIL_USER_ID	none	Alibaba Cloud user ID, you can refer toto configure user IDfor configuration.
ALIYUN_LOGTAIL_USER_DEFINED_ID	none	The user-defined ID of the machine group can be configured by referring toto create a user-defined ID machine group.
ALIYUN_LOGTAIL_CONFIG	${cn-huhehaote}	The configuration parameters of the Logtail collection service vary according to the location of the log service project and the network type.
ALIYUN_LOG_ENV_TAGS	`pod_name	pod_ip

ALIYUN_LOGTAIL_CONFIG It needs to be set according to the memory network type where the log service project is located. Users need to know the area where their Rainbond platform is deployed in Alibaba Cloud and what type of network is used. If it is a public network, the format is：region-internet, for example,：East China 1 (Hangzhou) is cn-hangzhou-Internet.If it is the Alibaba Cloud intranet, the format is region.For example,：East China 1 (Hangzhou) is cn-hangzhou.

After the configuration is complete, click Update Configuration, you need to update and restart the component to make it take effect.

shared storage

The plugin needs to share the log file directory of the component to collect logs, and the log file directory of the component needs to be shared with the plugin.This can be achieved by mounting storage.

On the storage page of the component management page, addtemporary storagetypes of storage, and fill in the mount path to the path where the component will generate the log file.Such as /var/log/nginx.

After hanging on the storage, you need to update and restart the component to make it take effect.

Alibaba Cloud Log Service Configuration

On Alibaba Cloud Log Service Homepage, in the Access Data section, selectSingle Line - Log Textto enter the configuration process of the Log Service.

• Select log space

  • Create a Project or use an existing Project.It is necessary to pay attention to the selection of the project area, which should be consistent with the area where Rainbond is located.
  • Create a log store LogStore or use an existing log store LogStore.

• Create a machine group

  Here select the self-built machine group.The reason is that the custom configuration of the self-built machine group is used to identify the log collection work of different projects, so as to realize the isolation of log collection.

  • After selecting the self any installation operation.
  • Fill in the machine group name, machine group topic information and user-defined identifier.

Select for self-built machine group, and the machine group ID must select User-defined ID Moreover, the user-defined ID configuration should be consistent with the value of the _ALIYUNLOGTAIL_USER_DEFINED_ID` parameter in the plugin configuration.

• Machine group configuration

  Select the machine group created in the previous step and move it from the source machine group to the application machine group list.

  There will be a reminder ofthat there is no machine configuration in the currently selected machine group, whether to force skip, which can be ignored, just click skip.

• Logtail configuration

  This step configures the log paths to collect and some advanced configuration.

  It should be noted that the log path configured here needs to be consistent with the path of the component shared storage mount.Otherwise, no logs can be collected.

• Query Analysis Configuration

  As a verification step of log collection, this step will provide a module withpreview data andfor users to determine whether the log collection is correct.If configured correctly, there will be a list of logs that were present at that time.If there is no log preview data for a long time, please check whether the operation is correct.

At this point, the log collection has ended in the Alibaba Cloud Log Service. You can see that the logs have been collected into the Alibaba Cloud Log Service platform normally, and you can perform more complex analysis logic on the collected data.

common problem

• Plug-in parameter configuration error prevents log collection

  You can check the plug-in parameter configuration to confirm whether ALIYUN_LOGTAIL_USER_DEFINED_ID is consistent with the ID set by the Alibaba Cloud machine group, and confirm whether the ALIYUN_LOGTAIL_CONFIG parameters are consistent with the Alibaba Cloud region where the Rainbond platform runs.

• Failed to collect logs due to unconfigured shared storage

  You can addtemporary storagetypes of storage on the storage page of the component management page, and make it effective after re-updating.

• The configuration is correct, and it is hung in the storage, but no logs can be collected

  You can try restarting the component to confirm that all configurations have taken effect, and then confirm whether the logs are collected successfully.