版权声明:本文为博主原创学习笔记,如需转载请注明来源: https://blog.csdn.net/wugenqiang/article/details/81355633
1.输入命令:
[root@master ~]# crontab -e
2.添加:
*/5 * * * * /usr/share/nginx/spark_run_nginx_log.sh 2>&1 >> /usr/share/nginx/crontab_spark_run_nginx.log
3.等待验证:
[root@master ~]# cd /usr/share/nginx/
[root@master nginx]# ls
crontab_spark_run_nginx.log metastore_db run_log.sh
derby.log modules spark_run_nginx_log.sh
html nginx_log.py test_log_records_add.sh
[root@master nginx]# cat crontab_spark_run_nginx.log
2018年 08月 02日 星期四 11:25:01 CST job start...
--- rm hdfs output_nginx ---
--- rm url information ---
Deleted /user/flume/nginx_log_output_need/url/20180802
--- rm url information ok---
--- rm ip404 information ---
Deleted /user/flume/nginx_log_output_need/ip404/20180802
--- rm ip404 information ok---
--- rm hdfs output_nginx Done ---
--- spark-submit ---
--- spark-submit Done ---
--- copy file from hdfs to local file : url.txt ---
--- copy file from hdfs to local file : url.txt Done ---
--- copy file from hdfs to local file : ip404.txt ---
--- copy file from hdfs to local file : ip404.txt Done ---
All Done !!!
2018年 08月 02日 星期四 11:28:28 CST job end
------- - - - OK - - - -----------