-- Logs begin at Fri 2021-09-03 18:35:47 UTC, end at Fri 2021-09-03 19:45:46 UTC. -- Sep 03 19:08:36.049956 dv-cinder-760178-9-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 19:08:36.059478 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 19:08:36.061552 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 19:08:36 2021] *** Sep 03 19:08:36.061552 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 19:08:36.061552 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 19:08:36.061552 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: nodename: dv-cinder-760178-9-iscsi Sep 03 19:08:36.061552 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: machine: x86_64 Sep 03 19:08:36.061552 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: clock source: unix Sep 03 19:08:36.061552 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: pcre jit disabled Sep 03 19:08:36.061552 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: detected number of CPU cores: 4 Sep 03 19:08:36.061552 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: current working directory: / Sep 03 19:08:36.061552 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: detected binary path: /usr/bin/uwsgi-core Sep 03 19:08:36.061552 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: your processes number limit is 47680 Sep 03 19:08:36.061552 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: your memory page size is 4096 bytes Sep 03 19:08:36.062299 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: detected max file descriptor number: 2048 Sep 03 19:08:36.062299 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: lock engine: pthread robust mutexes Sep 03 19:08:36.062299 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: thunder lock: enabled Sep 03 19:08:36.062299 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 19:08:36.062299 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 19:08:36.109422 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: Python main interpreter initialized at 0x55e3815229c0 Sep 03 19:08:36.109422 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: python threads support enabled Sep 03 19:08:36.109422 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: your server socket listen backlog is limited to 100 connections Sep 03 19:08:36.109422 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: your mercy for graceful operations on workers is 90 seconds Sep 03 19:08:36.109902 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 19:08:36.109902 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: *** Operational MODE: preforking *** Sep 03 19:08:36.110169 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: *** uWSGI is running in multiple interpreter mode *** Sep 03 19:08:36.110169 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: spawned uWSGI master process (pid: 100832) Sep 03 19:08:36.110378 dv-cinder-760178-9-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 19:08:36.116295 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: spawned uWSGI worker 1 (pid: 100845, cores: 1) Sep 03 19:08:36.116295 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: spawned uWSGI worker 2 (pid: 100846, cores: 1) Sep 03 19:08:36.116295 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 19:08:37.557253 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: Traceback (most recent call last): Sep 03 19:08:37.557253 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 19:08:37.557874 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: from cinder.wsgi.wsgi import initialize_application Sep 03 19:08:37.557874 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 19:08:37.557874 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: from cinder.common import config Sep 03 19:08:37.557874 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 19:08:37.557874 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 19:08:37.557874 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 19:08:37.557874 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: from cinder import policies Sep 03 19:08:37.557874 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 42, in Sep 03 19:08:37.557874 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: from cinder.policies import snapshots Sep 03 19:08:37.557874 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: File "/opt/stack/cinder/cinder/policies/snapshots.py", line 29, in Sep 03 19:08:37.558541 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: deprecated_get_all_snapshots = policy.CinderDeprecatedRule( Sep 03 19:08:37.558541 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: AttributeError: module 'oslo_policy.policy' has no attribute 'CinderDeprecatedRule' Sep 03 19:08:37.558541 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 19:08:37.558541 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: *** no app loaded. going in full dynamic mode *** Sep 03 19:08:37.558541 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: --- no python application found, check your startup logs for errors --- Sep 03 19:08:37.558541 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: [pid: 100845|app: -1|req: -1/1] 10.222.0.26 () {50 vars in 776 bytes} [Fri Sep 3 19:08:37 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 19:08:37.572559 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: Traceback (most recent call last): Sep 03 19:08:37.572559 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 19:08:37.573142 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: from cinder.wsgi.wsgi import initialize_application Sep 03 19:08:37.573142 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 19:08:37.573142 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: from cinder.common import config Sep 03 19:08:37.573142 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 19:08:37.573142 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 19:08:37.573142 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 19:08:37.573142 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: from cinder import policies Sep 03 19:08:37.573142 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 42, in Sep 03 19:08:37.573575 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: from cinder.policies import snapshots Sep 03 19:08:37.573575 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: File "/opt/stack/cinder/cinder/policies/snapshots.py", line 29, in Sep 03 19:08:37.573575 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: deprecated_get_all_snapshots = policy.CinderDeprecatedRule( Sep 03 19:08:37.573575 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: AttributeError: module 'oslo_policy.policy' has no attribute 'CinderDeprecatedRule' Sep 03 19:08:37.573575 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 19:08:37.573575 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: *** no app loaded. going in full dynamic mode *** Sep 03 19:08:41.379856 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: --- no python application found, check your startup logs for errors --- Sep 03 19:08:41.379856 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: [pid: 100845|app: -1|req: -1/2] 10.222.0.26 () {60 vars in 1238 bytes} [Fri Sep 3 19:08:41 2021] POST /volume/v3/a270527cf3974dfca846530da8b9db9c/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 19:09:26.480071 dv-cinder-760178-9-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 19:09:26.480368 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: Fri Sep 3 19:09:26 2021 - graceful shutdown triggered... Sep 03 19:09:26.480842 dv-cinder-760178-9-iscsi devstack@c-api.service[100845]: Gracefully killing worker 1 (pid: 100845)... Sep 03 19:09:26.481191 dv-cinder-760178-9-iscsi devstack@c-api.service[100846]: Gracefully killing worker 2 (pid: 100846)... Sep 03 19:09:27.481755 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: worker 1 buried after 1 seconds Sep 03 19:09:27.482305 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: worker 2 buried after 1 seconds Sep 03 19:09:27.482305 dv-cinder-760178-9-iscsi devstack@c-api.service[100832]: goodbye to uWSGI. Sep 03 19:09:27.483272 dv-cinder-760178-9-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 19:09:27.483814 dv-cinder-760178-9-iscsi systemd[1]: Stopped Devstack devstack@c-api.service. Sep 03 19:21:04.021523 dv-cinder-760178-9-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 19:21:04.031683 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 19:21:04.033733 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 19:21:04 2021] *** Sep 03 19:21:04.033733 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 19:21:04.033733 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 19:21:04.033733 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: nodename: dv-cinder-760178-9-iscsi Sep 03 19:21:04.033733 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: machine: x86_64 Sep 03 19:21:04.033733 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: clock source: unix Sep 03 19:21:04.033733 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: pcre jit disabled Sep 03 19:21:04.033733 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: detected number of CPU cores: 4 Sep 03 19:21:04.033733 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: current working directory: / Sep 03 19:21:04.033733 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: detected binary path: /usr/bin/uwsgi-core Sep 03 19:21:04.033733 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: your processes number limit is 47680 Sep 03 19:21:04.033733 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: your memory page size is 4096 bytes Sep 03 19:21:04.034522 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: detected max file descriptor number: 2048 Sep 03 19:21:04.034522 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: lock engine: pthread robust mutexes Sep 03 19:21:04.034522 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: thunder lock: enabled Sep 03 19:21:04.034522 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 19:21:04.034522 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 19:21:04.083218 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: Python main interpreter initialized at 0x55bfcc9af9c0 Sep 03 19:21:04.083218 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: python threads support enabled Sep 03 19:21:04.083218 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: your server socket listen backlog is limited to 100 connections Sep 03 19:21:04.083218 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: your mercy for graceful operations on workers is 90 seconds Sep 03 19:21:04.083617 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 19:21:04.083681 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: *** Operational MODE: preforking *** Sep 03 19:21:04.083930 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: *** uWSGI is running in multiple interpreter mode *** Sep 03 19:21:04.083930 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: spawned uWSGI master process (pid: 161024) Sep 03 19:21:04.084150 dv-cinder-760178-9-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 19:21:04.087096 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: spawned uWSGI worker 1 (pid: 161037, cores: 1) Sep 03 19:21:04.087096 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: spawned uWSGI worker 2 (pid: 161038, cores: 1) Sep 03 19:21:04.087096 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 19:21:05.509469 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: Traceback (most recent call last): Sep 03 19:21:05.509469 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 19:21:05.510134 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: from cinder.wsgi.wsgi import initialize_application Sep 03 19:21:05.510134 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 19:21:05.510134 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: from cinder.common import config Sep 03 19:21:05.510134 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 19:21:05.510134 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 19:21:05.510134 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 19:21:05.510134 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: from cinder import policies Sep 03 19:21:05.510134 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 42, in Sep 03 19:21:05.510134 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: from cinder.policies import snapshots Sep 03 19:21:05.510134 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: File "/opt/stack/cinder/cinder/policies/snapshots.py", line 29, in Sep 03 19:21:05.513237 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: deprecated_get_all_snapshots = policy.CinderDeprecatedRule( Sep 03 19:21:05.513237 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: AttributeError: module 'oslo_policy.policy' has no attribute 'CinderDeprecatedRule' Sep 03 19:21:05.513237 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 19:21:05.513237 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: *** no app loaded. going in full dynamic mode *** Sep 03 19:21:05.513237 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: --- no python application found, check your startup logs for errors --- Sep 03 19:21:05.513237 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: [pid: 161037|app: -1|req: -1/1] 10.222.0.26 () {50 vars in 776 bytes} [Fri Sep 3 19:21:05 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 19:21:05.554723 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: Traceback (most recent call last): Sep 03 19:21:05.554723 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 19:21:05.555379 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: from cinder.wsgi.wsgi import initialize_application Sep 03 19:21:05.555379 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 19:21:05.555379 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: from cinder.common import config Sep 03 19:21:05.555379 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 19:21:05.555379 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 19:21:05.555379 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 19:21:05.555379 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: from cinder import policies Sep 03 19:21:05.555379 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 42, in Sep 03 19:21:05.555379 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: from cinder.policies import snapshots Sep 03 19:21:05.555379 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: File "/opt/stack/cinder/cinder/policies/snapshots.py", line 29, in Sep 03 19:21:05.556015 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: deprecated_get_all_snapshots = policy.CinderDeprecatedRule( Sep 03 19:21:05.556015 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: AttributeError: module 'oslo_policy.policy' has no attribute 'CinderDeprecatedRule' Sep 03 19:21:05.556015 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 19:21:05.556015 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: *** no app loaded. going in full dynamic mode *** Sep 03 19:21:09.399849 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: --- no python application found, check your startup logs for errors --- Sep 03 19:21:09.399849 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: [pid: 161037|app: -1|req: -1/2] 10.222.0.26 () {60 vars in 1238 bytes} [Fri Sep 3 19:21:09 2021] POST /volume/v3/a094baf2f50d40e9a7917849252f2e17/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 19:21:54.529931 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: Fri Sep 3 19:21:54 2021 - graceful shutdown triggered... Sep 03 19:21:54.530063 dv-cinder-760178-9-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 19:21:54.530945 dv-cinder-760178-9-iscsi devstack@c-api.service[161037]: Gracefully killing worker 1 (pid: 161037)... Sep 03 19:21:54.531362 dv-cinder-760178-9-iscsi devstack@c-api.service[161038]: Gracefully killing worker 2 (pid: 161038)... Sep 03 19:21:55.531988 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: worker 1 buried after 1 seconds Sep 03 19:21:55.531988 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: worker 2 buried after 1 seconds Sep 03 19:21:55.531988 dv-cinder-760178-9-iscsi devstack@c-api.service[161024]: goodbye to uWSGI. Sep 03 19:21:55.533551 dv-cinder-760178-9-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 19:21:55.534104 dv-cinder-760178-9-iscsi systemd[1]: Stopped Devstack devstack@c-api.service. Sep 03 19:33:35.264558 dv-cinder-760178-9-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 19:33:35.272055 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 19:33:35 2021] *** Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: nodename: dv-cinder-760178-9-iscsi Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: machine: x86_64 Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: clock source: unix Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: pcre jit disabled Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: detected number of CPU cores: 4 Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: current working directory: / Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: detected binary path: /usr/bin/uwsgi-core Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: your processes number limit is 47680 Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: your memory page size is 4096 bytes Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: detected max file descriptor number: 2048 Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: lock engine: pthread robust mutexes Sep 03 19:33:35.274897 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: thunder lock: enabled Sep 03 19:33:35.275788 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 19:33:35.275788 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 19:33:35.320812 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: Python main interpreter initialized at 0x559ea30e59c0 Sep 03 19:33:35.320812 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: python threads support enabled Sep 03 19:33:35.320812 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: your server socket listen backlog is limited to 100 connections Sep 03 19:33:35.320812 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: your mercy for graceful operations on workers is 90 seconds Sep 03 19:33:35.321286 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 19:33:35.321286 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: *** Operational MODE: preforking *** Sep 03 19:33:35.321569 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: *** uWSGI is running in multiple interpreter mode *** Sep 03 19:33:35.321569 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: spawned uWSGI master process (pid: 227868) Sep 03 19:33:35.324800 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: spawned uWSGI worker 1 (pid: 227873, cores: 1) Sep 03 19:33:35.324800 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: spawned uWSGI worker 2 (pid: 227874, cores: 1) Sep 03 19:33:35.324800 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 19:33:35.321770 dv-cinder-760178-9-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 19:33:36.753986 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: Traceback (most recent call last): Sep 03 19:33:36.753986 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 19:33:36.754661 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: from cinder.wsgi.wsgi import initialize_application Sep 03 19:33:36.754661 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 19:33:36.754661 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: from cinder.common import config Sep 03 19:33:36.754661 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 19:33:36.754661 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 19:33:36.754661 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 19:33:36.754661 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: from cinder import policies Sep 03 19:33:36.754661 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 42, in Sep 03 19:33:36.754661 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: from cinder.policies import snapshots Sep 03 19:33:36.754661 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: File "/opt/stack/cinder/cinder/policies/snapshots.py", line 29, in Sep 03 19:33:36.757734 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: deprecated_get_all_snapshots = policy.CinderDeprecatedRule( Sep 03 19:33:36.757734 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: AttributeError: module 'oslo_policy.policy' has no attribute 'CinderDeprecatedRule' Sep 03 19:33:36.757734 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 19:33:36.757734 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: *** no app loaded. going in full dynamic mode *** Sep 03 19:33:36.757734 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: --- no python application found, check your startup logs for errors --- Sep 03 19:33:36.757734 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: [pid: 227874|app: -1|req: -1/1] 10.222.0.26 () {50 vars in 776 bytes} [Fri Sep 3 19:33:36 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: Traceback (most recent call last): Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: from cinder.wsgi.wsgi import initialize_application Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: from cinder.common import config Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: from cinder import policies Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 42, in Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: from cinder.policies import snapshots Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: File "/opt/stack/cinder/cinder/policies/snapshots.py", line 29, in Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: deprecated_get_all_snapshots = policy.CinderDeprecatedRule( Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: AttributeError: module 'oslo_policy.policy' has no attribute 'CinderDeprecatedRule' Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 19:33:36.758081 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: *** no app loaded. going in full dynamic mode *** Sep 03 19:33:40.637518 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: --- no python application found, check your startup logs for errors --- Sep 03 19:33:40.638013 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: [pid: 227874|app: -1|req: -1/2] 10.222.0.26 () {60 vars in 1238 bytes} [Fri Sep 3 19:33:40 2021] POST /volume/v3/676ed26c4e594f6099f368014b2c9d3d/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 19:34:25.816590 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: Fri Sep 3 19:34:25 2021 - graceful shutdown triggered... Sep 03 19:34:25.817092 dv-cinder-760178-9-iscsi devstack@c-api.service[227873]: Gracefully killing worker 1 (pid: 227873)... Sep 03 19:34:25.817290 dv-cinder-760178-9-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 19:34:25.817728 dv-cinder-760178-9-iscsi devstack@c-api.service[227874]: Gracefully killing worker 2 (pid: 227874)... Sep 03 19:34:26.817720 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: worker 1 buried after 1 seconds Sep 03 19:34:26.817720 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: worker 2 buried after 1 seconds Sep 03 19:34:26.817720 dv-cinder-760178-9-iscsi devstack@c-api.service[227868]: goodbye to uWSGI. Sep 03 19:34:26.819245 dv-cinder-760178-9-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 19:34:26.819789 dv-cinder-760178-9-iscsi systemd[1]: Stopped Devstack devstack@c-api.service.