使用supervisord管理进程

Posted on Edited on In , Disqus:

supervisord install & config

  • 初始化环境

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16

    # 假设使用公共用户app，运行程序
    sudo mkdir -p /opt/app/logs
    sudo mkdir -p /opt/app/super
    #修改权限
    sudo chown app -R /opt/app

    #supervisor install
    # 指定为用户安装可以使用pip install supervisord --user
    # 遇到 connection 或者 supervisord 找不到，请价差pip.conf 或者pip source 配置
    sudo pip install supervisor
    sudo su - root -c " echo_supervisord_conf > /opt/app/supervisord.conf "

    #修改文件权限
     sudo chown app:users /opt/app/supervisord.conf

  • 设置supervisord 配置

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    19
    20
    21
    22
    23
    24
    25
    26
    27
    28
    29
    30
    31
    32
    33
    34
    35
    36
    # 切换用户
    sudo su - app

    # 配置service
    cat << EOF > /opt/app/supervisord.conf
    [unix_http_server]
    file=/opt/app/super/supervisor.sock   ; (the path to the socket file)
     
     
    [inet_http_server]         ; inet (TCP) server disabled by default
    port=127.0.0.1:9001        ; (ip_address:port specifier, *:port for all iface)
     
     
    [supervisord]
    logfile=/opt/app/super/supervisord.log ; (main log file;default /supervisord.log)
    logfile_maxbytes=50MB        ; (max main logfile bytes b4 rotation;default 50MB)
    logfile_backups=10           ; (num of main logfile rotation backups;default 10)
    loglevel=info                ; (log level;default info; others: debug,warn,trace)
    pidfile=/opt/app/super/supervisord.pid ; (supervisord pidfile;default supervisord.pid)
    nodaemon=false               ; (start in foreground if true;default false)
    minfds=1024                  ; (min. avail startup file descriptors;default 1024)
    minprocs=200                 ; (min. avail process descriptors;default 200)
     
     
    [rpcinterface:supervisor]
    supervisor.rpcinterface_factory = supervisor.rpcinterface:make_main_rpcinterface
     
     
    [supervisorctl]
    serverurl=unix:///opt/app/super/supervisor.sock ; use a unix:// URL  for a unix socket


    [include]
    files=/opt/app/super/*.conf ; config file dir
     
    EOF

  • 注册supervisord 为系统的service

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    19
    20
    21
    22
    23
    24
    25
    26
    27
    28
    #切换用户 
    sudo su - root
    # 或者使用 root 执行
    # sudo su - -c " commond " 
    #

    # 开机启动
    cat << EOF > /usr/lib/systemd/system/supervisord.service
    [Unit]
    Description=Supervisor process control system for UNIX
    Documentation=http://supervisord.org
    After=network.target
     
    [Service]
    EnvironmentFile=/etc/hbase/conf/hbase-env.sh
    ExecStart=/bin/bash -a -c "source /home/app/.bash_profile && /usr/bin/supervisord -n -c /opt/app/supervisord.conf"
    ExecStop=/usr/bin/supervisorctl $OPTIONS shutdown
    ExecReload=/usr/bin/supervisorctl -c /opt/app/supervisord.conf $OPTIONS reload
    KillMode=process
    Restart=on-failure
    RestartSec=50s
    Restart=always
    User=app
    Group=users
     
    [Install]
    WantedBy=multi-user.target
    EOF

    *注： 这里设置了User=app可能造成环境变量未能加载，需要在启动程序时手动加载一次，systemctl参数

  • 启动supervisord.service

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    #开机启动
    sudo systemctl enable supervisord.service

    # start
    sudo systemctl start supervisord.service
    sudo systemctl status supervisord.service

    # 查看启动异常信息
    sudo journalctl -u supervisord.service -b

    # reload service file 
    sudo systemctl daemon-reload

配置服务和启动程序

  • 设置program conf配置文件

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16

    vim /opt/app/super/app.conf

    [program:app-service]
    command=java -XX:+UseG1GC -Xms4g -Xmx4g  -Dlogging.config=./log4j2.xml -jar test-app.jar --spring.profiles.active=pro
    directory=/opt/app/app-service
    priority=1
    numprocs=1
    autostart=true
    autorestart=true
    startretries=10
    stopsignal=INT
    stopwaitsecs=60
    redirect_stderr=true
    stdout_logfile=/opt/app/logs/app-service.out.log

  • 将配置的程序reload & start

    1
    2
    3
    4
    5
    6
    supervisorctl  -c ./supervisord.conf
    # 加载未load的program
    supervisor> reload 
    # 查看program状态
    supervisor> status

  • 其它命令

    1
    2
    3
    4
    5
    6
    7
    8
    9
    # 重启
     supervisorctl  -c ./supervisord.conf restart app-service 

    # 重新读取program conf(不会重启进程）
    supervisorctl  -c ./supervisord.conf restart app-service

    # 更新conf，并进行重启(谨慎操作）
    supervisorctl  -c ./supervisord.conf update

$PATH环境变量异常

  • 解决方法-Environment 错误信息：

    1
    2
    3
    supervisorctl -c ./supervisord.conf restart app-service

    supervisorctl> can't find command 'java'

    初步确定是systemctl 启动进程后PATH环境变量未能读取，解决方法： 使用Environment手动配置PATH:

    1
    sudo vim /usr/lib/systemd/system/supervisord.service

    添加

    1
    Environment="PATH=/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/java/default/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin"

    这里需要注意Environment 不支持$PATH的表达式方法，所以把echo $PATH中全局配置的信息拷贝出来，新的service文件内容如下：

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    19
    20
    [Unit]
    Description=Supervisor process control system for UNIX
    Documentation=http://supervisord.org
    After=network.target

    [Service]
    Environment="PATH=/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/java/default/bin:/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin"
    ExecStart=/usr/bin/supervisord -n -c /opt/app/supervisord.conf
    ExecStop=/usr/bin/supervisorctl  shutdown
    ExecReload=/usr/bin/supervisorctl -c /opt/app/supervisord.conf  reload
    KillMode=process
    Restart=on-failure
    RestartSec=50s
    Restart=always
    User=app
    Group=users

    [Install]
    WantedBy=multi-user.target

    重新reload:

    1
    sudo systemctl daemon-reload

    重启:

    1
    sudo systemctl restart supervisord.service

    查看启动信息：

    1
    sudo journalctl -u supervisord.service -b

    启动正常。

  • 另一种解决方法-ExecStart 在service文件中配置：

    1
    ExecStart=/bin/bash -c "PATH=/home/someUser/bin:$PATH exec /usr/bin/php /some/path/to/a/script.php"

拓展

可以结合ansible 和 CI工具,进行自动化部署和重启。

参考