Cloudlytics currently support following types of log processing for System and Application log
General system logs
Apache access logs
Apache error logs
NGINX access logs
NGINX error logs
In order to configure any of the above logs for processing , please go through the following steps :
Create a Stream with Cloudlytics ( SSH Stream , System Stream etc)
Refer the table below and fire the command as it is for the type of log you want to configure and for one which you have created Stream
Insert Stream token ( configured in Step 1 ) when asked by the command
Check for the Configuration done ouput
Log Type Command
System wget https://s3.amazonaws.com/tableaublazeclan/Cloudlytics_2.0/Rsyslog_Deployment/Testing_Production/Scripts/systemlog.sh;sudo chmod 777 ./systemlog.sh;./systemlog.sh;rm ./systemlog.sh;sudo service rsyslog restart
SSH wget https://s3.amazonaws.com/tableaublazeclan/Cloudlytics_2.0/Rsyslog_Deployment/Testing_Production/Scripts/sshlog.sh;sudo chmod 777 ./sshlog.sh;./sshlog.sh;rm ./sshlog.sh;sudo service rsyslog restart
NGINX wget https://s3.amazonaws.com/tableaublazeclan/Cloudlytics_2.0/Rsyslog_Deployment/Testing_Production/Scripts/nginxlog.sh;sudo chmod 777 ./nginxlog.sh;./nginxlog.sh;rm ./nginxlog.sh;sudo service rsyslog restart
Apache wget https://s3.amazonaws.com/tableaublazeclan/Cloudlytics_2.0/Rsyslog_Deployment/Testing_Production/Scripts/apachelog.sh;sudo chmod 777 ./apachelog.sh;./apachelog.sh;rm ./apachelog.sh;sudo service rsyslog restart
Please make sure that you provide correct token ( Stream token ) for the correct log type configured, else you will not get any error but the data will be pushed to wrong Stream and it will not be processed.You will observe raw data as it is.
Example : If you created a Stream for SSH and you run the command for System log and then provide SSH token , in that case configuration will be done successfully , but the data will be pushed to System log Stream and it will not be processed . You will able to see your data ( raw data ) as it is.
By default NGINX and Apache configurations will configure for both access and error log . Please make sure you provide correct token for access and error log , while executing the above command.
In case of any queries or doubts with respect to configurations. Please contact email@example.com.