Docker Build and Publish – 永夜

两个项目，前后端合并至一个镜像、一个容器，以端口进行区分的实现流程

永夜 — Wed, 24 Feb 2021 02:23:26 +0000

浏览量： 99

1、两个项目，前后端，两个镜像，两个容器。如图1

图1

2、前端构建目录结构。如图2

图2

3、接口构建目录结构。如图3

图3

4、前端构建的相关配置。如图4

图4

5、接口构建的相关配置。如图5

图5

6、调整前端的构建目录结构。将 build 重合名为 dist。将 build_docker 重合名为 build。将 build_docker/c_files/config/init/config0.sh 重命名为 build/c_files/config/init/config_front0.sh。删除 Dockerfile。如图6

图6

7、调整接口的构建目录中的 Dockerfile。如图7

图7

8、在 Jenkins 的配置中，Source Code Management – Multiple SCMs 。添加 2 个 Git 仓库。分别为接口与前端。如图8

图8

9、在 Jenkins 的配置中，Build – Docker Build and Publish 。Tag：pcsfront_dev_65e60624dcbc98445056a602d27c2552e58532df_pcsapi_dev_$GIT_COMMIT。前端的提交 ID，需要每一次手动更改。接口的提交 ID，可以自动读取。如图9

图9

10、查看容器中的目录结构，前端与接口皆存在。且分别可以正常访问。符合预期。如图10

图10



[root@api-5db464c777-fp9gk /]# cd /etc/nginx/conf.d/
[root@api-5db464c777-fp9gk conf.d]# ls -l
total 8
-rwxrwxr-x 1 root root 1109 Feb 23 15:33 pcs_api.conf
-rwxrwxr-x 1 root root  928 Feb 23 15:33 pcs_front.conf
[root@api-5db464c777-fp9gk conf.d]# cd /mcloud/www/
[root@api-5db464c777-fp9gk www]# ls -l
total 16
drwxrwxr-x 1 nginx nginx 4096 Feb 23 15:33 pcs_api
drwxrwxr-x 1 nginx nginx 4096 Feb 23 15:11 pcs_front
[root@api-5db464c777-fp9gk www]# curl http://api.pcs:82/api.txt
api
[root@api-5db464c777-fp9gk www]# curl http://api.pcs/front.txt
front
[root@api-5db464c777-fp9gk www]# curl http://pcsapi.dev.chinamcloud.cn/api.txt
api
[root@api-5db464c777-fp9gk www]# curl http://pcsfront.dev.chinamcloud.cn/front.txt
front
[root@api-5db464c777-fp9gk www]#

将 /vendor 加入至 Git 仓库后，Docker 部署，升级失败的分析解决

永夜 — Mon, 11 May 2020 12:03:38 +0000

浏览量： 215

1、编辑 .gitignore，将 /vendor 加入至 Git 仓库，如图1

图1


# composer vendor dir
# /vendor

2、在 Jenkins 中构建失败，查看 Console Output。如图2

图2


[0mThe command '/bin/sh -c chown -R nginx:nginx /mcloud/www/ &&     rm -rf /etc/nginx/conf.d/status.conf &&     chmod +x /usr/local/bin/composer &&     composer config -g repo.packagist composer https://mirrors.aliyun.com/composer/ &&     cd /mcloud/www/pcs-api &&     composer install' returned a non-zero code: 1
Build step 'Docker Build and Publish' marked build as failure
Finished: FAILURE

3、Docker 部署，删除 composer install。编辑 Dockerfile。如图3

图3


RUN chown -R nginx:nginx /mcloud/www/ && \
    rm -rf /etc/nginx/conf.d/status.conf && \
    chmod +x /usr/local/bin/composer && \
    composer config -g repo.packagist composer https://mirrors.aliyun.com/composer/ && \
    cd /mcloud/www/pcs-api && \
    composer install


RUN chown -R nginx:nginx /mcloud/www/ && \
    rm -rf /etc/nginx/conf.d/status.conf

4、在 Jenkins 中构建成功。如图4

图4

5、在 Rancher 中启动失败，查看日志。如图5

图5


2020/5/8 下午2:48:45
2020/5/8 下午2:48:45  ... initialization completed.
2020/5/8 下午2:48:45
2020/5/8 下午2:48:45 PCS_API_CFG_MIGRATE=true

6、编辑 build/c_files/config/init/console_init.sh。删除 $PCS_API_CFG_MIGRATE == “true” 的相关命令。如图6

图6

7、在 Rancher 中启动成功，查看日志。如图7

图7


2020/5/8 下午2:48:45
2020/5/8 下午2:48:45  ... initialization completed.
2020/5/8 下午2:48:45
2020/5/8 下午2:48:45 PCS_API_CFG_MIGRATE=true

8、进入容器，手动执行 $PCS_API_CFG_MIGRATE == “true” 的相关命令。未成功运行，因为无相应输出。如图8

图8

9、进入将 /vendor 加入至 Git 仓库前的容器。手动执行 $PCS_API_CFG_MIGRATE == “true” 的相关命令。成功运行，因为有相应输出。如图9

图9

10、在本地环境中全新部署，手动执行 $PCS_API_CFG_MIGRATE == “true” 的相关命令。未成功运行，报错。如图10

图10


PS E:\wwwroot\pcs-api-develop> ./yii migrate --migrationPath=@yii/log/migrations/ --interactive=0
PHP Warning:  require(E:\wwwroot\pcs-api-develop\vendor\composer/../codeception/verify/src/Codeception/function.php): fa
iled to open stream: No such file or directory in E:\wwwroot\pcs-api-develop\vendor\composer\autoload_real.php on line 6
6

Warning: require(E:\wwwroot\pcs-api-develop\vendor\composer/../codeception/verify/src/Codeception/function.php): failed
to open stream: No such file or directory in E:\wwwroot\pcs-api-develop\vendor\composer\autoload_real.php on line 66
PHP Fatal error:  require(): Failed opening required 'E:\wwwroot\pcs-api-develop\vendor\composer/../codeception/verify/s
rc/Codeception/function.php' (include_path='.;C:\php\pear') in E:\wwwroot\pcs-api-develop\vendor\composer\autoload_real.
php on line 66

Fatal error: require(): Failed opening required 'E:\wwwroot\pcs-api-develop\vendor\composer/../codeception/verify/src/Co
deception/function.php' (include_path='.;C:\php\pear') in E:\wwwroot\pcs-api-develop\vendor\composer\autoload_real.php o
n line 66

11、文件 E:\wwwroot\pcs-api-develop\vendor\composer/../codeception/verify/src/Codeception/function.php 不存在，如图11

图11

12、进入将 /vendor 加入至 Git 仓库前的容器。文件 \vendor\composer/../codeception/verify/src/Codeception/function.php 存在。如图12

图12

13、查看 E:\wwwroot\pcs-api\vendor\codeception\verify，其目录下存在相应的文件。且 Git 显示是已经提交至仓库。如图13

图13

14、进入将 /vendor 加入至 Git 仓库前的本地环境。发现 \vendor\codeception\verify 已经存在于 Git 中。只不过是 master 分支。如图14

图14

15、最终决定切换至 master 分支，合并 develop 分支的代码。再推送至远程的 master 分支。在远程仓库中文件：\vendor\composer/../codeception/verify/src/Codeception/function.php 仍然不存在。如图15

图15

16、删除目录：E:\wwwroot\pcs-api\vendor\codeception\verify\.git，将未显示已经提交至仓库的文件，添加至仓库。如图16、17

图16

图17

17、在本地环境中全新部署，手动执行 $PCS_API_CFG_MIGRATE == “true” 的相关命令。未成功运行，报错，但是 /codeception/verify 相应的错误已经得到解决。参考步骤 16 同样处理。后续在运行命令的过程中报错的类似问题，皆可以如此处理。


PS E:\wwwroot\pcs-api-develop> ./yii migrate --migrationPath=@yii/log/migrations/ --interactive=0
PHP Warning:  require(E:\wwwroot\pcs-api-develop\vendor\composer/../myclabs/deep-copy/src/DeepCopy/deep_copy.php): faile
d to open stream: No such file or directory in E:\wwwroot\pcs-api-develop\vendor\composer\autoload_real.php on line 66

Warning: require(E:\wwwroot\pcs-api-develop\vendor\composer/../myclabs/deep-copy/src/DeepCopy/deep_copy.php): failed to
open stream: No such file or directory in E:\wwwroot\pcs-api-develop\vendor\composer\autoload_real.php on line 66
PHP Fatal error:  require(): Failed opening required 'E:\wwwroot\pcs-api-develop\vendor\composer/../myclabs/deep-copy/sr
c/DeepCopy/deep_copy.php' (include_path='.;C:\php\pear') in E:\wwwroot\pcs-api-develop\vendor\composer\autoload_real.php
 on line 66

Fatal error: require(): Failed opening required 'E:\wwwroot\pcs-api-develop\vendor\composer/../myclabs/deep-copy/src/Dee
pCopy/deep_copy.php' (include_path='.;C:\php\pear') in E:\wwwroot\pcs-api-develop\vendor\composer\autoload_real.php on l
ine 66

18、在本地环境中全新部署，手动执行 $PCS_API_CFG_MIGRATE == “true” 的相关命令。成功运行。如图18

图18

19、进入将 /vendor 加入至 Git 仓库前的本地环境。执行命令：composer install。成功运行。如图19

图19


PS E:\wwwroot\pcs-api-feature-plan-tonglian> composer install
Loading composer repositories with package information
Installing dependencies (including require-dev) from lock file
Nothing to install or update
Generating autoload files

20、在本地环境中全新部署，执行命令：composer install。未成功运行。如图20

图20


PS E:\wwwroot\pcs-api-develop> composer install
Loading composer repositories with package information
Installing dependencies (including require-dev) from lock file
Nothing to install or update
Generating autoload files


  [RuntimeException]
  Could not scan for classes inside "E:\wwwroot\pcs-api-develop\vendor/sebastian/object-enumerator/src/" which does n
  ot appear to be a file nor a folder


install [--prefer-source] [--prefer-dist] [--dry-run] [--dev] [--no-dev] [--no-custom-installers] [--no-autoloader] [--n
o-scripts] [--no-progress] [--no-suggest] [-v|vv|vvv|--verbose] [-o|--optimize-autoloader] [-a|--classmap-authoritative]
 [--apcu-autoloader] [--ignore-platform-reqs] [--] []...

21、实际上，第 16、17 步骤，可以通过执行命令：composer require codeception/verify myclabs/deep-copy 来解决，而无需一定要将这 2 个包提交至 Git 仓库中。不过，即使采用此方案，仍然会存在第 20 步骤中所存在的问题。而且还会改变 /vendor/composer 中的其他文件。此方案不太可取。如图21

图21

22、最终决定，先删除掉 /vendor ，提交至 Git 仓库，执行命令：composer install –no-dev。–no-dev：跳过 require-dev 字段中列出的包。再将 /vendor 提交至 Git 仓库。因为，已经确定，–dev：安装 require-dev 字段中列出的包 ( 这是一个默认值 )。提交至 Git 仓库仅能够提交空目录。如图22

图22

23、执行命令：composer install。安装 require-dev 字段中列出的包。再将 /vendor 提交至 Git 仓库。如图23

图23

24、在本地环境中全新部署，手动执行 $PCS_API_CFG_MIGRATE == “true” 的相关命令。成功运行。不符合预期。如图24

图24

25、查看全新部署的文件，目录：\codeception\verify、\vendor\myclabs\deep-copy 皆存在。如图25

图25

26、在 /vendor 目录中搜索：.git，不存在相应的目录。而之前执行命令：composer install。未成功运行。在 /vendor 目录中搜索：.git，存在相应的目录。如图26

图26

27、编辑 build/c_files/config/init/console_init.sh。恢复 $PCS_API_CFG_MIGRATE == “true” 的相关命令。在 Rancher 中启动成功，查看日志。如图27

图27

28、在另一个产品中，在 /vendor 目录中搜索：.git，存在相应的目录。如图28

图28

29、在 Rancher 中启动失败，查看日志。如图29

图29


2020/5/9 下午7:01:07 PHP Fatal Error 'yii\base\ErrorException' with message 'Class 'wartron\yii2uuid\behaviors\UUIDBehavior' not found'
2020/5/9 下午7:01:07
2020/5/9 下午7:01:07 in /mcloud/www/channel-pub-api/common/behaviors/UUIDBehavior.php:7
2020/5/9 下午7:01:07
2020/5/9 下午7:01:07 Stack trace:
2020/5/9 下午7:01:07 #0 [internal function]: yii\base\ErrorHandler->handleFatalError()
2020/5/9 下午7:01:07 #1 {main}

30、由于仅有一个目录：.git，决定采用第 16、17 步骤的方案。在 Rancher 中启动成功，查看日志。如图30

图30

31、在 Jenkins 中构建时间的前后对比，分别为：13分钟、43秒。如图31

图31

Docker 部署，将目录 sobey 修改为 mcloud，构建镜像时，报错：composer install returned a non-zero code: 255 的分析解决

永夜 — Tue, 23 Jul 2019 09:42:15 +0000

浏览量： 132

1、Docker 部署，在 Jenkins 上构建镜像时，报错：composer install returned a non-zero code: 255，如图1

图1



Step 7 : RUN chown -R nginx:nginx /mcloud/www/ &&     rm -rf /etc/nginx/conf.d/status.conf &&     composer config -g repo.packagist composer https://mirrors.aliyun.com/composer/ &&     cd /mcloud/www/pcs-api &&     composer install
 ---> Running in a73905f2bdbc
[91mDo not run Composer as root/super user! See https://getcomposer.org/root for details
[0mThe command '/bin/sh -c chown -R nginx:nginx /mcloud/www/ &&     rm -rf /etc/nginx/conf.d/status.conf &&     composer config -g repo.packagist composer https://mirrors.aliyun.com/composer/ &&     cd /mcloud/www/pcs-api &&     composer install' returned a non-zero code: 255
Build step 'Docker Build and Publish' marked build as failure
Finished: FAILURE

2、Dockerfile 执行命令失败的代码如下



FROM registry-vpc.cn-beijing.aliyuncs.com/cmc/centos-nginx112-php72:0.1.12

MAINTAINER wangqiang@chinamcloud.com

RUN sed -i 's/open_basedir = .\/:\/mcloud:\/tmp:\/data:\/webtv/;open_basedir = .\/:\/mcloud:\/tmp:\/data:\/webtv:\/usr\/local\/php/g' /usr/local/php/etc/php.ini && \
    sed -i 's/allow_url_fopen = Off/allow_url_fopen = On/g' /usr/local/php/etc/php.ini && \
    sed -i 's/disable_functions = exec,system,passthru,shell_exec,escapeshellarg,escapeshellcmd,proc_close,proc_open,dl,popen,show/disable_functions = system,shell_exec,escapeshellarg,escapeshellcmd,dl,popen,show/g' /usr/local/php/etc/php.ini

COPY code /mcloud/www/pcs-api
COPY code/build/c_files/ /

RUN chown -R nginx:nginx /mcloud/www/ && \
    rm -rf /etc/nginx/conf.d/status.conf && \
    chmod +x /usr/local/bin/composer && \
    composer config -g repo.packagist composer https://mirrors.aliyun.com/composer/ && \
    cd /mcloud/www/pcs-api && \
    composer install

3、编辑 Dockerfile，构建成功，可见失败的原因在于：composer install



RUN chown -R nginx:nginx /mcloud/www/ && \
    rm -rf /etc/nginx/conf.d/status.conf && \
    chmod +x /usr/local/bin/composer && \
    composer config -g repo.packagist composer https://mirrors.aliyun.com/composer/ && \
    cd /mcloud/www/pcs-api

4、编辑 Dockerfile，查看 composer 的版本信息与全局配置选项的列表



RUN chown -R nginx:nginx /mcloud/www/ && \
    rm -rf /etc/nginx/conf.d/status.conf && \
    chmod +x /usr/local/bin/composer && \
    composer config -g repo.packagist composer https://mirrors.aliyun.com/composer/ && \
    cd /mcloud/www/pcs-api && \
    composer --version && \
    composer config --global --list

5、在 Jenkins 上构建镜像时，仍然报错：composer install returned a non-zero code: 255，可见，composer 相关的命令是执行不了的，不仅是 composer install，如图2

图2

6、编辑 Dockerfile，下载 Composer 的可执行文件，局部安装



RUN chown -R nginx:nginx /mcloud/www/ && \
    rm -rf /etc/nginx/conf.d/status.conf && \
    cd /mcloud/www/pcs-api && \
    curl -sS https://getcomposer.org/installer | php && \
    php composer.phar install

7、在 Jenkins 上构建镜像时，报错：php composer.phar install returned a non-zero code: 1，如图3

图3



RUN chown -R nginx:nginx /mcloud/www/ &&     rm -rf /etc/nginx/conf.d/status.conf &&     cd /mcloud/www/pcs-api &&     curl -sS https://getcomposer.org/installer | php &&     php composer.phar install
 ---> Running in 28a2ad979c18
All settings correct for using Composer

Warning: is_dir(): open_basedir restriction in effect. File(/root/.composer) is not within the allowed path(s): (./:/sobey:/tmp:/data:/webtv:/var/log:/mcloud) in Standard input code on line 495

Warning: is_dir(): open_basedir restriction in effect. File(/root/.composer) is not within the allowed path(s): (./:/sobey:/tmp:/data:/webtv:/var/log:/mcloud) in Standard input code on line 685
Unable to create Composer home directory "/root/.composer": mkdir(): open_basedir restriction in effect. File(/root/.composer) is not within the allowed path(s): (./:/sobey:/tmp:/data:/webtv:/var/log:/mcloud)
The command '/bin/sh -c chown -R nginx:nginx /mcloud/www/ &&     rm -rf /etc/nginx/conf.d/status.conf &&     cd /mcloud/www/pcs-api &&     curl -sS https://getcomposer.org/installer | php &&     php composer.phar install' returned a non-zero code: 1
Build step 'Docker Build and Publish' marked build as failure
Finished: FAILURE

8、醒悟过来，原因在于 Dockerfile 文件，之前执行了批量替换，将 sobey 批量替换为 mcloud，决定仅替换其中的 3 处，其余 2 处的 mcloud 还原为 sobey，如图4

图4



FROM registry-vpc.cn-beijing.aliyuncs.com/cmc/centos-nginx112-php72:0.1.12

MAINTAINER wangqiang@chinamcloud.com

RUN sed -i 's/open_basedir = .\/:\/sobey:\/tmp:\/data:\/webtv/;open_basedir = .\/:\/sobey:\/tmp:\/data:\/webtv:\/usr\/local\/php/g' /usr/local/php/etc/php.ini && \
    sed -i 's/allow_url_fopen = Off/allow_url_fopen = On/g' /usr/local/php/etc/php.ini && \
    sed -i 's/disable_functions = exec,system,passthru,shell_exec,escapeshellarg,escapeshellcmd,proc_close,proc_open,dl,popen,show/disable_functions = system,shell_exec,escapeshellarg,escapeshellcmd,dl,popen,show/g' /usr/local/php/etc/php.ini

COPY code /mcloud/www/pcs-api
COPY code/build/c_files/ /

RUN chown -R nginx:nginx /mcloud/www/ && \
    rm -rf /etc/nginx/conf.d/status.conf && \
    chmod +x /usr/local/bin/composer && \
    composer config -g repo.packagist composer https://mirrors.aliyun.com/composer/ && \
    cd /mcloud/www/pcs-api && \
    composer install

9、Docker 部署，在 Jenkins 上构建镜像成功，后续有待于基础镜像升级之后，才能够全部执行替换了的。如图5

图5