-- Logs begin at Fri 2021-09-03 14:34:31 UTC, end at Fri 2021-09-03 17:35:37 UTC. -- Sep 03 15:06:02.731429 dv-cinder-759961-8-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 15:06:02.741892 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 15:06:02 2021] *** Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: nodename: dv-cinder-759961-8-iscsi Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: machine: x86_64 Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: clock source: unix Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: pcre jit disabled Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: detected number of CPU cores: 4 Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: current working directory: / Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: detected binary path: /usr/bin/uwsgi-core Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: your processes number limit is 47680 Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: your memory page size is 4096 bytes Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: detected max file descriptor number: 2048 Sep 03 15:06:02.742792 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: lock engine: pthread robust mutexes Sep 03 15:06:02.744445 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: thunder lock: enabled Sep 03 15:06:02.744445 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 15:06:02.744445 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 15:06:02.795888 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: Python main interpreter initialized at 0x561db8f8a9c0 Sep 03 15:06:02.795888 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: python threads support enabled Sep 03 15:06:02.795888 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: your server socket listen backlog is limited to 100 connections Sep 03 15:06:02.795888 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: your mercy for graceful operations on workers is 90 seconds Sep 03 15:06:02.796319 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 15:06:02.796319 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: *** Operational MODE: preforking *** Sep 03 15:06:02.796624 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: *** uWSGI is running in multiple interpreter mode *** Sep 03 15:06:02.796624 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: spawned uWSGI master process (pid: 100855) Sep 03 15:06:02.796832 dv-cinder-759961-8-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 15:06:02.797399 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: spawned uWSGI worker 1 (pid: 100859, cores: 1) Sep 03 15:06:02.798306 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: spawned uWSGI worker 2 (pid: 100860, cores: 1) Sep 03 15:06:02.798306 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 15:06:04.257087 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: Traceback (most recent call last): Sep 03 15:06:04.257087 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 15:06:04.257780 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: from cinder.wsgi.wsgi import initialize_application Sep 03 15:06:04.257780 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 15:06:04.257780 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: from cinder.common import config Sep 03 15:06:04.257780 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 15:06:04.257780 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 15:06:04.257780 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 15:06:04.257780 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: from cinder import policies Sep 03 15:06:04.257780 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 15:06:04.257780 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: from cinder.policies import group_snapshots Sep 03 15:06:04.257780 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 15:06:04.260842 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: check_str=base.PROJECT_MEMBER, Sep 03 15:06:04.260842 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 15:06:04.260842 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 15:06:04.260842 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: *** no app loaded. going in full dynamic mode *** Sep 03 15:06:04.260842 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: --- no python application found, check your startup logs for errors --- Sep 03 15:06:04.260842 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: [pid: 100859|app: -1|req: -1/1] 10.222.0.38 () {50 vars in 776 bytes} [Fri Sep 3 15:06:04 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 15:06:04.298593 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: Traceback (most recent call last): Sep 03 15:06:04.298593 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 15:06:04.299216 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: from cinder.wsgi.wsgi import initialize_application Sep 03 15:06:04.299216 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 15:06:04.299216 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: from cinder.common import config Sep 03 15:06:04.299216 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 15:06:04.299216 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 15:06:04.299216 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 15:06:04.299216 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: from cinder import policies Sep 03 15:06:04.299216 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 15:06:04.299781 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: from cinder.policies import group_snapshots Sep 03 15:06:04.299781 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 15:06:04.299781 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: check_str=base.PROJECT_MEMBER, Sep 03 15:06:04.299781 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 15:06:04.299781 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 15:06:04.299781 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: *** no app loaded. going in full dynamic mode *** Sep 03 15:06:08.156209 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: --- no python application found, check your startup logs for errors --- Sep 03 15:06:08.156209 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: [pid: 100859|app: -1|req: -1/2] 10.222.0.38 () {60 vars in 1238 bytes} [Fri Sep 3 15:06:08 2021] POST /volume/v3/deba673be96c49bb95f2f31987ff30cd/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 15:06:53.580787 dv-cinder-759961-8-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 15:06:53.581066 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: Fri Sep 3 15:06:53 2021 - graceful shutdown triggered... Sep 03 15:06:53.581527 dv-cinder-759961-8-iscsi devstack@c-api.service[100859]: Gracefully killing worker 1 (pid: 100859)... Sep 03 15:06:53.581891 dv-cinder-759961-8-iscsi devstack@c-api.service[100860]: Gracefully killing worker 2 (pid: 100860)... Sep 03 15:06:54.581319 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: worker 1 buried after 1 seconds Sep 03 15:06:54.581780 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: worker 2 buried after 1 seconds Sep 03 15:06:54.581780 dv-cinder-759961-8-iscsi devstack@c-api.service[100855]: goodbye to uWSGI. Sep 03 15:06:54.582828 dv-cinder-759961-8-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 15:06:54.583370 dv-cinder-759961-8-iscsi systemd[1]: Stopped Devstack devstack@c-api.service. Sep 03 15:18:37.282786 dv-cinder-759961-8-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 15:18:37.291304 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 15:18:37.295238 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 15:18:37 2021] *** Sep 03 15:18:37.295505 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 15:18:37.295687 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 15:18:37.295859 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: nodename: dv-cinder-759961-8-iscsi Sep 03 15:18:37.296027 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: machine: x86_64 Sep 03 15:18:37.296199 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: clock source: unix Sep 03 15:18:37.296408 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: pcre jit disabled Sep 03 15:18:37.296577 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: detected number of CPU cores: 4 Sep 03 15:18:37.296782 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: current working directory: / Sep 03 15:18:37.296960 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: detected binary path: /usr/bin/uwsgi-core Sep 03 15:18:37.297136 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: your processes number limit is 47680 Sep 03 15:18:37.297303 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: your memory page size is 4096 bytes Sep 03 15:18:37.297469 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: detected max file descriptor number: 2048 Sep 03 15:18:37.297645 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: lock engine: pthread robust mutexes Sep 03 15:18:37.298066 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: thunder lock: enabled Sep 03 15:18:37.298688 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 15:18:37.299096 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 15:18:37.345741 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: Python main interpreter initialized at 0x55b1ff56f9c0 Sep 03 15:18:37.345741 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: python threads support enabled Sep 03 15:18:37.345741 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: your server socket listen backlog is limited to 100 connections Sep 03 15:18:37.345741 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: your mercy for graceful operations on workers is 90 seconds Sep 03 15:18:37.346174 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 15:18:37.346174 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: *** Operational MODE: preforking *** Sep 03 15:18:37.346433 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: *** uWSGI is running in multiple interpreter mode *** Sep 03 15:18:37.346433 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: spawned uWSGI master process (pid: 161021) Sep 03 15:18:37.346642 dv-cinder-759961-8-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 15:18:37.348941 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: spawned uWSGI worker 1 (pid: 161035, cores: 1) Sep 03 15:18:37.348941 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: spawned uWSGI worker 2 (pid: 161036, cores: 1) Sep 03 15:18:37.349642 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 15:18:38.771773 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: Traceback (most recent call last): Sep 03 15:18:38.771773 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 15:18:38.772510 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: from cinder.wsgi.wsgi import initialize_application Sep 03 15:18:38.772510 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 15:18:38.772510 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: from cinder.common import config Sep 03 15:18:38.772510 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 15:18:38.772510 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 15:18:38.772510 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 15:18:38.772969 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: from cinder import policies Sep 03 15:18:38.772969 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 15:18:38.773181 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: from cinder.policies import group_snapshots Sep 03 15:18:38.773181 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 15:18:38.773473 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: check_str=base.PROJECT_MEMBER, Sep 03 15:18:38.773473 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 15:18:38.773631 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 15:18:38.773631 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: *** no app loaded. going in full dynamic mode *** Sep 03 15:18:38.774092 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: --- no python application found, check your startup logs for errors --- Sep 03 15:18:38.775422 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: [pid: 161036|app: -1|req: -1/1] 10.222.0.38 () {50 vars in 776 bytes} [Fri Sep 3 15:18:38 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 15:18:38.777703 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: Traceback (most recent call last): Sep 03 15:18:38.777703 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 15:18:38.777703 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: from cinder.wsgi.wsgi import initialize_application Sep 03 15:18:38.777703 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 15:18:38.777703 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: from cinder.common import config Sep 03 15:18:38.777703 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 15:18:38.777703 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 15:18:38.777703 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 15:18:38.778585 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: from cinder import policies Sep 03 15:18:38.778585 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 15:18:38.778585 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: from cinder.policies import group_snapshots Sep 03 15:18:38.778585 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 15:18:38.778585 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: check_str=base.PROJECT_MEMBER, Sep 03 15:18:38.778585 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 15:18:38.778585 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 15:18:38.778585 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: *** no app loaded. going in full dynamic mode *** Sep 03 15:18:42.742442 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: --- no python application found, check your startup logs for errors --- Sep 03 15:18:42.742442 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: [pid: 161036|app: -1|req: -1/2] 10.222.0.38 () {60 vars in 1238 bytes} [Fri Sep 3 15:18:42 2021] POST /volume/v3/07b32f4828464947ad667decd94b211a/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 15:19:27.304349 dv-cinder-759961-8-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 15:19:27.304799 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: Fri Sep 3 15:19:27 2021 - graceful shutdown triggered... Sep 03 15:19:27.305275 dv-cinder-759961-8-iscsi devstack@c-api.service[161035]: Gracefully killing worker 1 (pid: 161035)... Sep 03 15:19:27.306510 dv-cinder-759961-8-iscsi devstack@c-api.service[161036]: Gracefully killing worker 2 (pid: 161036)... Sep 03 15:19:28.314082 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: worker 1 buried after 1 seconds Sep 03 15:19:28.314082 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: worker 2 buried after 1 seconds Sep 03 15:19:28.314082 dv-cinder-759961-8-iscsi devstack@c-api.service[161021]: goodbye to uWSGI. Sep 03 15:19:28.316451 dv-cinder-759961-8-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 15:19:28.317130 dv-cinder-759961-8-iscsi systemd[1]: Stopped Devstack devstack@c-api.service. Sep 03 15:31:19.568617 dv-cinder-759961-8-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 15:31:19.578490 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 15:31:19.581062 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 15:31:19 2021] *** Sep 03 15:31:19.581197 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 15:31:19.581325 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 15:31:19.581325 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: nodename: dv-cinder-759961-8-iscsi Sep 03 15:31:19.581325 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: machine: x86_64 Sep 03 15:31:19.581325 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: clock source: unix Sep 03 15:31:19.581325 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: pcre jit disabled Sep 03 15:31:19.581325 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: detected number of CPU cores: 4 Sep 03 15:31:19.581325 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: current working directory: / Sep 03 15:31:19.581325 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: detected binary path: /usr/bin/uwsgi-core Sep 03 15:31:19.581325 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: your processes number limit is 47680 Sep 03 15:31:19.581325 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: your memory page size is 4096 bytes Sep 03 15:31:19.581325 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: detected max file descriptor number: 2048 Sep 03 15:31:19.582046 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: lock engine: pthread robust mutexes Sep 03 15:31:19.582046 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: thunder lock: enabled Sep 03 15:31:19.582046 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 15:31:19.582046 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 15:31:19.627280 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: Python main interpreter initialized at 0x55a3935219c0 Sep 03 15:31:19.627280 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: python threads support enabled Sep 03 15:31:19.627280 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: your server socket listen backlog is limited to 100 connections Sep 03 15:31:19.627280 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: your mercy for graceful operations on workers is 90 seconds Sep 03 15:31:19.627612 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 15:31:19.627723 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: *** Operational MODE: preforking *** Sep 03 15:31:19.628018 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: *** uWSGI is running in multiple interpreter mode *** Sep 03 15:31:19.628018 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: spawned uWSGI master process (pid: 227922) Sep 03 15:31:19.628204 dv-cinder-759961-8-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 15:31:19.628826 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: spawned uWSGI worker 1 (pid: 227924, cores: 1) Sep 03 15:31:19.629194 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: spawned uWSGI worker 2 (pid: 227925, cores: 1) Sep 03 15:31:19.629362 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 15:31:21.069989 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: Traceback (most recent call last): Sep 03 15:31:21.069989 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 15:31:21.070670 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: from cinder.wsgi.wsgi import initialize_application Sep 03 15:31:21.070670 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 15:31:21.070670 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: from cinder.common import config Sep 03 15:31:21.070670 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 15:31:21.070670 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 15:31:21.070670 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 15:31:21.070670 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: from cinder import policies Sep 03 15:31:21.070670 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 15:31:21.070670 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: from cinder.policies import group_snapshots Sep 03 15:31:21.070670 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 15:31:21.071270 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: check_str=base.PROJECT_MEMBER, Sep 03 15:31:21.071270 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 15:31:21.071270 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 15:31:21.071270 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: *** no app loaded. going in full dynamic mode *** Sep 03 15:31:21.071270 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: --- no python application found, check your startup logs for errors --- Sep 03 15:31:21.073223 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: [pid: 227924|app: -1|req: -1/1] 10.222.0.38 () {50 vars in 776 bytes} [Fri Sep 3 15:31:21 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 15:31:21.091030 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: Traceback (most recent call last): Sep 03 15:31:21.091030 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 15:31:21.091655 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: from cinder.wsgi.wsgi import initialize_application Sep 03 15:31:21.091655 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 15:31:21.091655 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: from cinder.common import config Sep 03 15:31:21.091655 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 15:31:21.091655 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 15:31:21.091655 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 15:31:21.091655 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: from cinder import policies Sep 03 15:31:21.091655 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 15:31:21.092845 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: from cinder.policies import group_snapshots Sep 03 15:31:21.092845 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 15:31:21.092845 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: check_str=base.PROJECT_MEMBER, Sep 03 15:31:21.092845 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 15:31:21.092845 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 15:31:21.092845 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: *** no app loaded. going in full dynamic mode *** Sep 03 15:31:25.009468 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: --- no python application found, check your startup logs for errors --- Sep 03 15:31:25.009880 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: [pid: 227924|app: -1|req: -1/2] 10.222.0.38 () {60 vars in 1238 bytes} [Fri Sep 3 15:31:25 2021] POST /volume/v3/81cfce1a6abc41a8a38fde9af8b17b2e/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (1 switches on core 0) Sep 03 15:32:10.018613 dv-cinder-759961-8-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 15:32:10.020615 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: Fri Sep 3 15:32:10 2021 - graceful shutdown triggered... Sep 03 15:32:10.021124 dv-cinder-759961-8-iscsi devstack@c-api.service[227924]: Gracefully killing worker 1 (pid: 227924)... Sep 03 15:32:10.021584 dv-cinder-759961-8-iscsi devstack@c-api.service[227925]: Gracefully killing worker 2 (pid: 227925)... Sep 03 15:32:11.020019 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: worker 1 buried after 1 seconds Sep 03 15:32:11.020019 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: worker 2 buried after 1 seconds Sep 03 15:32:11.020019 dv-cinder-759961-8-iscsi devstack@c-api.service[227922]: goodbye to uWSGI. Sep 03 15:32:11.021523 dv-cinder-759961-8-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 15:32:11.022072 dv-cinder-759961-8-iscsi systemd[1]: Stopped Devstack devstack@c-api.service. Sep 03 15:43:52.076625 dv-cinder-759961-8-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 15:43:52.084856 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 15:43:52.088386 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 15:43:52 2021] *** Sep 03 15:43:52.088549 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 15:43:52.088677 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 15:43:52.088793 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: nodename: dv-cinder-759961-8-iscsi Sep 03 15:43:52.088908 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: machine: x86_64 Sep 03 15:43:52.089042 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: clock source: unix Sep 03 15:43:52.089160 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: pcre jit disabled Sep 03 15:43:52.089273 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: detected number of CPU cores: 4 Sep 03 15:43:52.089396 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: current working directory: / Sep 03 15:43:52.089396 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: detected binary path: /usr/bin/uwsgi-core Sep 03 15:43:52.089396 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: your processes number limit is 47680 Sep 03 15:43:52.089396 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: your memory page size is 4096 bytes Sep 03 15:43:52.089396 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: detected max file descriptor number: 2048 Sep 03 15:43:52.089396 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: lock engine: pthread robust mutexes Sep 03 15:43:52.089948 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: thunder lock: enabled Sep 03 15:43:52.089948 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 15:43:52.089948 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 15:43:52.134239 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: Python main interpreter initialized at 0x556eedb379c0 Sep 03 15:43:52.134239 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: python threads support enabled Sep 03 15:43:52.134239 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: your server socket listen backlog is limited to 100 connections Sep 03 15:43:52.134239 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: your mercy for graceful operations on workers is 90 seconds Sep 03 15:43:52.134726 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 15:43:52.134726 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: *** Operational MODE: preforking *** Sep 03 15:43:52.134919 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: *** uWSGI is running in multiple interpreter mode *** Sep 03 15:43:52.134919 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: spawned uWSGI master process (pid: 298534) Sep 03 15:43:52.139001 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: spawned uWSGI worker 1 (pid: 298535, cores: 1) Sep 03 15:43:52.139001 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: spawned uWSGI worker 2 (pid: 298536, cores: 1) Sep 03 15:43:52.139001 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 15:43:52.135146 dv-cinder-759961-8-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 15:43:53.573120 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: Traceback (most recent call last): Sep 03 15:43:53.573120 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 15:43:53.573809 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: from cinder.wsgi.wsgi import initialize_application Sep 03 15:43:53.573809 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 15:43:53.573809 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: from cinder.common import config Sep 03 15:43:53.573809 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 15:43:53.573809 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 15:43:53.573809 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 15:43:53.573809 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: from cinder import policies Sep 03 15:43:53.573809 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 15:43:53.574483 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: from cinder.policies import group_snapshots Sep 03 15:43:53.574483 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 15:43:53.574791 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: check_str=base.PROJECT_MEMBER, Sep 03 15:43:53.574791 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 15:43:53.574967 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 15:43:53.574967 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: *** no app loaded. going in full dynamic mode *** Sep 03 15:43:53.575603 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: --- no python application found, check your startup logs for errors --- Sep 03 15:43:53.575603 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: [pid: 298536|app: -1|req: -1/1] 10.222.0.38 () {50 vars in 776 bytes} [Fri Sep 3 15:43:53 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 15:43:53.595410 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: Traceback (most recent call last): Sep 03 15:43:53.595410 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 15:43:53.596069 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: from cinder.wsgi.wsgi import initialize_application Sep 03 15:43:53.596069 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 15:43:53.596069 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: from cinder.common import config Sep 03 15:43:53.596069 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 15:43:53.596069 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 15:43:53.596069 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 15:43:53.596069 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: from cinder import policies Sep 03 15:43:53.596069 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 15:43:53.596069 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: from cinder.policies import group_snapshots Sep 03 15:43:53.596069 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 15:43:53.596809 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: check_str=base.PROJECT_MEMBER, Sep 03 15:43:53.596809 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 15:43:53.596809 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 15:43:53.596809 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: *** no app loaded. going in full dynamic mode *** Sep 03 15:43:57.536710 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: --- no python application found, check your startup logs for errors --- Sep 03 15:43:57.536710 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: [pid: 298536|app: -1|req: -1/2] 10.222.0.38 () {60 vars in 1238 bytes} [Fri Sep 3 15:43:57 2021] POST /volume/v3/c2b00371637f427e8b6eeb8ffd827a55/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 15:44:42.226739 dv-cinder-759961-8-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 15:44:42.227309 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: Fri Sep 3 15:44:42 2021 - graceful shutdown triggered... Sep 03 15:44:42.227787 dv-cinder-759961-8-iscsi devstack@c-api.service[298535]: Gracefully killing worker 1 (pid: 298535)... Sep 03 15:44:42.228771 dv-cinder-759961-8-iscsi devstack@c-api.service[298536]: Gracefully killing worker 2 (pid: 298536)... Sep 03 15:44:43.228840 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: worker 1 buried after 1 seconds Sep 03 15:44:43.228840 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: worker 2 buried after 1 seconds Sep 03 15:44:43.228840 dv-cinder-759961-8-iscsi devstack@c-api.service[298534]: goodbye to uWSGI. Sep 03 15:44:43.230457 dv-cinder-759961-8-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 15:44:43.231009 dv-cinder-759961-8-iscsi systemd[1]: Stopped Devstack devstack@c-api.service. Sep 03 16:00:08.203720 dv-cinder-759961-8-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 16:00:08.216972 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 16:00:08 2021] *** Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: nodename: dv-cinder-759961-8-iscsi Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: machine: x86_64 Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: clock source: unix Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: pcre jit disabled Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: detected number of CPU cores: 4 Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: current working directory: / Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: detected binary path: /usr/bin/uwsgi-core Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: your processes number limit is 47680 Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: your memory page size is 4096 bytes Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: detected max file descriptor number: 2048 Sep 03 16:00:08.219010 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: lock engine: pthread robust mutexes Sep 03 16:00:08.220005 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: thunder lock: enabled Sep 03 16:00:08.220005 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 16:00:08.220005 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 16:00:08.265170 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: Python main interpreter initialized at 0x55d2dd0029c0 Sep 03 16:00:08.265170 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: python threads support enabled Sep 03 16:00:08.265170 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: your server socket listen backlog is limited to 100 connections Sep 03 16:00:08.265170 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: your mercy for graceful operations on workers is 90 seconds Sep 03 16:00:08.265685 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 16:00:08.265685 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: *** Operational MODE: preforking *** Sep 03 16:00:08.266114 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: *** uWSGI is running in multiple interpreter mode *** Sep 03 16:00:08.266114 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: spawned uWSGI master process (pid: 364719) Sep 03 16:00:08.266341 dv-cinder-759961-8-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 16:00:08.266897 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: spawned uWSGI worker 1 (pid: 364732, cores: 1) Sep 03 16:00:08.268238 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: spawned uWSGI worker 2 (pid: 364733, cores: 1) Sep 03 16:00:08.270516 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 16:00:09.709125 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: Traceback (most recent call last): Sep 03 16:00:09.709125 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 16:00:09.709888 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: from cinder.wsgi.wsgi import initialize_application Sep 03 16:00:09.709888 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 16:00:09.709888 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: from cinder.common import config Sep 03 16:00:09.709888 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 16:00:09.709888 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 16:00:09.709888 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 16:00:09.710450 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: from cinder import policies Sep 03 16:00:09.710450 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 16:00:09.710450 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: from cinder.policies import group_snapshots Sep 03 16:00:09.710723 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 16:00:09.710865 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: check_str=base.PROJECT_MEMBER, Sep 03 16:00:09.710865 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 16:00:09.711062 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 16:00:09.711062 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: *** no app loaded. going in full dynamic mode *** Sep 03 16:00:09.711280 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: --- no python application found, check your startup logs for errors --- Sep 03 16:00:09.711391 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: [pid: 364732|app: -1|req: -1/1] 10.222.0.38 () {50 vars in 776 bytes} [Fri Sep 3 16:00:09 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: Traceback (most recent call last): Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: from cinder.wsgi.wsgi import initialize_application Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: from cinder.common import config Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: from cinder import policies Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: from cinder.policies import group_snapshots Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: check_str=base.PROJECT_MEMBER, Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 16:00:09.712933 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: *** no app loaded. going in full dynamic mode *** Sep 03 16:00:13.684264 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: --- no python application found, check your startup logs for errors --- Sep 03 16:00:13.684264 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: [pid: 364732|app: -1|req: -1/2] 10.222.0.38 () {60 vars in 1238 bytes} [Fri Sep 3 16:00:13 2021] POST /volume/v3/d902e13f6c674efaa152141dea5c8004/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 16:00:58.760639 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: Fri Sep 3 16:00:58 2021 - graceful shutdown triggered... Sep 03 16:00:58.761141 dv-cinder-759961-8-iscsi devstack@c-api.service[364732]: Gracefully killing worker 1 (pid: 364732)... Sep 03 16:00:58.761517 dv-cinder-759961-8-iscsi devstack@c-api.service[364733]: Gracefully killing worker 2 (pid: 364733)... Sep 03 16:00:58.762256 dv-cinder-759961-8-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 16:00:59.761769 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: worker 1 buried after 1 seconds Sep 03 16:00:59.761769 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: worker 2 buried after 1 seconds Sep 03 16:00:59.761769 dv-cinder-759961-8-iscsi devstack@c-api.service[364719]: goodbye to uWSGI. Sep 03 16:00:59.763359 dv-cinder-759961-8-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 16:00:59.763921 dv-cinder-759961-8-iscsi systemd[1]: Stopped Devstack devstack@c-api.service. Sep 03 16:12:18.858467 dv-cinder-759961-8-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 16:12:18.866278 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 16:12:18.868298 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 16:12:18 2021] *** Sep 03 16:12:18.868298 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 16:12:18.868298 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 16:12:18.868298 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: nodename: dv-cinder-759961-8-iscsi Sep 03 16:12:18.868298 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: machine: x86_64 Sep 03 16:12:18.868298 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: clock source: unix Sep 03 16:12:18.868298 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: pcre jit disabled Sep 03 16:12:18.868298 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: detected number of CPU cores: 4 Sep 03 16:12:18.868298 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: current working directory: / Sep 03 16:12:18.868854 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: detected binary path: /usr/bin/uwsgi-core Sep 03 16:12:18.868854 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: your processes number limit is 47680 Sep 03 16:12:18.868854 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: your memory page size is 4096 bytes Sep 03 16:12:18.868854 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: detected max file descriptor number: 2048 Sep 03 16:12:18.868854 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: lock engine: pthread robust mutexes Sep 03 16:12:18.869607 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: thunder lock: enabled Sep 03 16:12:18.869801 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 16:12:18.869883 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 16:12:18.915428 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: Python main interpreter initialized at 0x55d249bee9c0 Sep 03 16:12:18.915428 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: python threads support enabled Sep 03 16:12:18.915428 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: your server socket listen backlog is limited to 100 connections Sep 03 16:12:18.915428 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: your mercy for graceful operations on workers is 90 seconds Sep 03 16:12:18.915752 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 16:12:18.915878 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: *** Operational MODE: preforking *** Sep 03 16:12:18.916145 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: *** uWSGI is running in multiple interpreter mode *** Sep 03 16:12:18.916145 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: spawned uWSGI master process (pid: 424889) Sep 03 16:12:18.916387 dv-cinder-759961-8-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 16:12:18.917343 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: spawned uWSGI worker 1 (pid: 424899, cores: 1) Sep 03 16:12:18.917343 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: spawned uWSGI worker 2 (pid: 424900, cores: 1) Sep 03 16:12:18.917502 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 16:12:20.379899 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: Traceback (most recent call last): Sep 03 16:12:20.379899 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 16:12:20.380570 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: from cinder.wsgi.wsgi import initialize_application Sep 03 16:12:20.380570 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 16:12:20.380570 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: from cinder.common import config Sep 03 16:12:20.380570 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 16:12:20.380570 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 16:12:20.380570 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 16:12:20.380570 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: from cinder import policies Sep 03 16:12:20.380570 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 16:12:20.380570 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: from cinder.policies import group_snapshots Sep 03 16:12:20.383471 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 16:12:20.383471 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: check_str=base.PROJECT_MEMBER, Sep 03 16:12:20.383471 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 16:12:20.383471 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 16:12:20.383471 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: *** no app loaded. going in full dynamic mode *** Sep 03 16:12:20.383471 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: --- no python application found, check your startup logs for errors --- Sep 03 16:12:20.383471 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: [pid: 424900|app: -1|req: -1/1] 10.222.0.38 () {50 vars in 776 bytes} [Fri Sep 3 16:12:20 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: Traceback (most recent call last): Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: from cinder.wsgi.wsgi import initialize_application Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: from cinder.common import config Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: from cinder import policies Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: from cinder.policies import group_snapshots Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: check_str=base.PROJECT_MEMBER, Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 16:12:20.383930 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: *** no app loaded. going in full dynamic mode *** Sep 03 16:12:24.284108 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: --- no python application found, check your startup logs for errors --- Sep 03 16:12:24.284108 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: [pid: 424900|app: -1|req: -1/2] 10.222.0.38 () {60 vars in 1238 bytes} [Fri Sep 3 16:12:24 2021] POST /volume/v3/0a9b671563594d2d8ae6e5c1ba305ed1/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (1 switches on core 0) Sep 03 16:13:08.947902 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: Fri Sep 3 16:13:08 2021 - graceful shutdown triggered... Sep 03 16:13:08.948345 dv-cinder-759961-8-iscsi devstack@c-api.service[424899]: Gracefully killing worker 1 (pid: 424899)... Sep 03 16:13:08.948728 dv-cinder-759961-8-iscsi devstack@c-api.service[424900]: Gracefully killing worker 2 (pid: 424900)... Sep 03 16:13:08.952758 dv-cinder-759961-8-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 16:13:09.949029 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: worker 1 buried after 1 seconds Sep 03 16:13:09.949029 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: worker 2 buried after 1 seconds Sep 03 16:13:09.949481 dv-cinder-759961-8-iscsi devstack@c-api.service[424889]: goodbye to uWSGI. Sep 03 16:13:09.950557 dv-cinder-759961-8-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 16:13:09.951100 dv-cinder-759961-8-iscsi systemd[1]: Stopped Devstack devstack@c-api.service. Sep 03 16:24:58.737302 dv-cinder-759961-8-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 16:24:58.751805 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 16:24:58 2021] *** Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: nodename: dv-cinder-759961-8-iscsi Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: machine: x86_64 Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: clock source: unix Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: pcre jit disabled Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: detected number of CPU cores: 4 Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: current working directory: / Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: detected binary path: /usr/bin/uwsgi-core Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: your processes number limit is 47680 Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: your memory page size is 4096 bytes Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: detected max file descriptor number: 2048 Sep 03 16:24:58.754749 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: lock engine: pthread robust mutexes Sep 03 16:24:58.755708 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: thunder lock: enabled Sep 03 16:24:58.755708 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 16:24:58.755708 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 16:24:58.804117 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: Python main interpreter initialized at 0x5557e18749d0 Sep 03 16:24:58.804117 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: python threads support enabled Sep 03 16:24:58.804117 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: your server socket listen backlog is limited to 100 connections Sep 03 16:24:58.804117 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: your mercy for graceful operations on workers is 90 seconds Sep 03 16:24:58.804888 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 16:24:58.804888 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: *** Operational MODE: preforking *** Sep 03 16:24:58.804888 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: *** uWSGI is running in multiple interpreter mode *** Sep 03 16:24:58.804888 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: spawned uWSGI master process (pid: 485114) Sep 03 16:24:58.805104 dv-cinder-759961-8-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 16:24:58.812564 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: spawned uWSGI worker 1 (pid: 485127, cores: 1) Sep 03 16:24:58.812564 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: spawned uWSGI worker 2 (pid: 485128, cores: 1) Sep 03 16:24:58.812564 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 16:25:00.341990 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: Traceback (most recent call last): Sep 03 16:25:00.341990 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 16:25:00.342694 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: from cinder.wsgi.wsgi import initialize_application Sep 03 16:25:00.342694 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 16:25:00.342694 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: from cinder.common import config Sep 03 16:25:00.342694 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 16:25:00.342694 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 16:25:00.342694 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 16:25:00.343075 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: from cinder import policies Sep 03 16:25:00.343075 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 16:25:00.343075 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: from cinder.policies import group_snapshots Sep 03 16:25:00.343075 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 16:25:00.343317 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: check_str=base.PROJECT_MEMBER, Sep 03 16:25:00.343317 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 16:25:00.343317 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 16:25:00.343317 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: *** no app loaded. going in full dynamic mode *** Sep 03 16:25:00.343608 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: --- no python application found, check your startup logs for errors --- Sep 03 16:25:00.343608 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: [pid: 485128|app: -1|req: -1/1] 10.222.0.38 () {50 vars in 776 bytes} [Fri Sep 3 16:25:00 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 16:25:00.421093 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: Traceback (most recent call last): Sep 03 16:25:00.421093 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 16:25:00.421755 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: from cinder.wsgi.wsgi import initialize_application Sep 03 16:25:00.421755 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 16:25:00.421755 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: from cinder.common import config Sep 03 16:25:00.421755 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 16:25:00.421755 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 16:25:00.421755 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 16:25:00.421755 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: from cinder import policies Sep 03 16:25:00.421755 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 16:25:00.421755 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: from cinder.policies import group_snapshots Sep 03 16:25:00.421755 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 16:25:00.422300 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: check_str=base.PROJECT_MEMBER, Sep 03 16:25:00.422300 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 16:25:00.422300 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 16:25:00.422300 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: *** no app loaded. going in full dynamic mode *** Sep 03 16:25:04.560878 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: --- no python application found, check your startup logs for errors --- Sep 03 16:25:04.560878 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: [pid: 485128|app: -1|req: -1/2] 10.222.0.38 () {60 vars in 1238 bytes} [Fri Sep 3 16:25:04 2021] POST /volume/v3/0be99a3bdd534198b46a0ddd814aa385/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 16:25:48.622292 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: Fri Sep 3 16:25:48 2021 - graceful shutdown triggered... Sep 03 16:25:48.622783 dv-cinder-759961-8-iscsi devstack@c-api.service[485127]: Gracefully killing worker 1 (pid: 485127)... Sep 03 16:25:48.622497 dv-cinder-759961-8-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 16:25:48.623546 dv-cinder-759961-8-iscsi devstack@c-api.service[485128]: Gracefully killing worker 2 (pid: 485128)... Sep 03 16:25:49.623511 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: worker 1 buried after 1 seconds Sep 03 16:25:49.623511 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: worker 2 buried after 1 seconds Sep 03 16:25:49.623511 dv-cinder-759961-8-iscsi devstack@c-api.service[485114]: goodbye to uWSGI. Sep 03 16:25:49.625042 dv-cinder-759961-8-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 16:25:49.625598 dv-cinder-759961-8-iscsi systemd[1]: Stopped Devstack devstack@c-api.service. Sep 03 16:37:38.897998 dv-cinder-759961-8-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 16:37:38.907275 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 16:37:38.908999 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 16:37:38 2021] *** Sep 03 16:37:38.908999 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 16:37:38.908999 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 16:37:38.908999 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: nodename: dv-cinder-759961-8-iscsi Sep 03 16:37:38.908999 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: machine: x86_64 Sep 03 16:37:38.908999 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: clock source: unix Sep 03 16:37:38.908999 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: pcre jit disabled Sep 03 16:37:38.908999 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: detected number of CPU cores: 4 Sep 03 16:37:38.908999 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: current working directory: / Sep 03 16:37:38.908999 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: detected binary path: /usr/bin/uwsgi-core Sep 03 16:37:38.908999 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: your processes number limit is 47680 Sep 03 16:37:38.908999 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: your memory page size is 4096 bytes Sep 03 16:37:38.908999 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: detected max file descriptor number: 2048 Sep 03 16:37:38.909942 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: lock engine: pthread robust mutexes Sep 03 16:37:38.909942 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: thunder lock: enabled Sep 03 16:37:38.909942 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 16:37:38.909942 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 16:37:38.954081 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: Python main interpreter initialized at 0x55deceaf59d0 Sep 03 16:37:38.954081 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: python threads support enabled Sep 03 16:37:38.954081 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: your server socket listen backlog is limited to 100 connections Sep 03 16:37:38.954081 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: your mercy for graceful operations on workers is 90 seconds Sep 03 16:37:38.954530 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 16:37:38.954612 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: *** Operational MODE: preforking *** Sep 03 16:37:38.954874 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: *** uWSGI is running in multiple interpreter mode *** Sep 03 16:37:38.954874 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: spawned uWSGI master process (pid: 545759) Sep 03 16:37:38.955079 dv-cinder-759961-8-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 16:37:38.956492 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: spawned uWSGI worker 1 (pid: 545760, cores: 1) Sep 03 16:37:38.956492 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: spawned uWSGI worker 2 (pid: 545761, cores: 1) Sep 03 16:37:38.956492 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 16:37:40.402809 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: Traceback (most recent call last): Sep 03 16:37:40.402809 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 16:37:40.403442 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: from cinder.wsgi.wsgi import initialize_application Sep 03 16:37:40.403442 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 16:37:40.403442 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: from cinder.common import config Sep 03 16:37:40.403442 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 16:37:40.403442 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 16:37:40.403442 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 16:37:40.403442 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: from cinder import policies Sep 03 16:37:40.403442 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 16:37:40.403442 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: from cinder.policies import group_snapshots Sep 03 16:37:40.403442 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 16:37:40.406990 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: check_str=base.PROJECT_MEMBER, Sep 03 16:37:40.406990 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 16:37:40.406990 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 16:37:40.406990 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: *** no app loaded. going in full dynamic mode *** Sep 03 16:37:40.406990 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: --- no python application found, check your startup logs for errors --- Sep 03 16:37:40.406990 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: [pid: 545761|app: -1|req: -1/1] 10.222.0.38 () {50 vars in 776 bytes} [Fri Sep 3 16:37:40 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 16:37:40.407873 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: Traceback (most recent call last): Sep 03 16:37:40.407873 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 16:37:40.408443 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: from cinder.wsgi.wsgi import initialize_application Sep 03 16:37:40.408443 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 16:37:40.408443 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: from cinder.common import config Sep 03 16:37:40.408443 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 16:37:40.408443 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 16:37:40.408443 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 16:37:40.408443 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: from cinder import policies Sep 03 16:37:40.408443 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 16:37:40.408902 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: from cinder.policies import group_snapshots Sep 03 16:37:40.408902 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 16:37:40.408902 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: check_str=base.PROJECT_MEMBER, Sep 03 16:37:40.408902 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 16:37:40.408902 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 16:37:40.408902 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: *** no app loaded. going in full dynamic mode *** Sep 03 16:37:44.322506 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: --- no python application found, check your startup logs for errors --- Sep 03 16:37:44.322506 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: [pid: 545761|app: -1|req: -1/2] 10.222.0.38 () {60 vars in 1238 bytes} [Fri Sep 3 16:37:44 2021] POST /volume/v3/f10bb032e19e48328e4a452dcee21253/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 16:38:29.133583 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: Fri Sep 3 16:38:29 2021 - graceful shutdown triggered... Sep 03 16:38:29.134064 dv-cinder-759961-8-iscsi devstack@c-api.service[545760]: Gracefully killing worker 1 (pid: 545760)... Sep 03 16:38:29.133717 dv-cinder-759961-8-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 16:38:29.135000 dv-cinder-759961-8-iscsi devstack@c-api.service[545761]: Gracefully killing worker 2 (pid: 545761)... Sep 03 16:38:30.134718 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: worker 1 buried after 1 seconds Sep 03 16:38:30.134718 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: worker 2 buried after 1 seconds Sep 03 16:38:30.134718 dv-cinder-759961-8-iscsi devstack@c-api.service[545759]: goodbye to uWSGI. Sep 03 16:38:30.136238 dv-cinder-759961-8-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 16:38:30.136815 dv-cinder-759961-8-iscsi systemd[1]: Stopped Devstack devstack@c-api.service. Sep 03 16:53:14.990757 dv-cinder-759961-8-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 16:53:14.998235 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 16:53:14 2021] *** Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: nodename: dv-cinder-759961-8-iscsi Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: machine: x86_64 Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: clock source: unix Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: pcre jit disabled Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: detected number of CPU cores: 4 Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: current working directory: / Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: detected binary path: /usr/bin/uwsgi-core Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: your processes number limit is 47680 Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: your memory page size is 4096 bytes Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: detected max file descriptor number: 2048 Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: lock engine: pthread robust mutexes Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: thunder lock: enabled Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 16:53:15.003559 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 16:53:15.052346 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: Python main interpreter initialized at 0x564ac2abf9d0 Sep 03 16:53:15.052346 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: python threads support enabled Sep 03 16:53:15.052346 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: your server socket listen backlog is limited to 100 connections Sep 03 16:53:15.052346 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: your mercy for graceful operations on workers is 90 seconds Sep 03 16:53:15.054437 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 16:53:15.054437 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: *** Operational MODE: preforking *** Sep 03 16:53:15.054437 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: *** uWSGI is running in multiple interpreter mode *** Sep 03 16:53:15.054437 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: spawned uWSGI master process (pid: 611541) Sep 03 16:53:15.054437 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: spawned uWSGI worker 1 (pid: 611545, cores: 1) Sep 03 16:53:15.054437 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: spawned uWSGI worker 2 (pid: 611546, cores: 1) Sep 03 16:53:15.054437 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 16:53:15.053275 dv-cinder-759961-8-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 16:53:16.513795 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: Traceback (most recent call last): Sep 03 16:53:16.513795 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 16:53:16.514538 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: from cinder.wsgi.wsgi import initialize_application Sep 03 16:53:16.514538 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 16:53:16.514538 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: from cinder.common import config Sep 03 16:53:16.514538 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 16:53:16.514538 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 16:53:16.514538 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 16:53:16.514538 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: from cinder import policies Sep 03 16:53:16.514538 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 16:53:16.514538 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: from cinder.policies import group_snapshots Sep 03 16:53:16.514538 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 16:53:16.515247 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: check_str=base.PROJECT_MEMBER, Sep 03 16:53:16.515247 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 16:53:16.515247 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 16:53:16.515247 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: *** no app loaded. going in full dynamic mode *** Sep 03 16:53:16.515247 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: --- no python application found, check your startup logs for errors --- Sep 03 16:53:16.515247 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: [pid: 611545|app: -1|req: -1/1] 10.222.0.38 () {50 vars in 776 bytes} [Fri Sep 3 16:53:16 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 16:53:16.529630 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: Traceback (most recent call last): Sep 03 16:53:16.529630 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 16:53:16.530830 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: from cinder.wsgi.wsgi import initialize_application Sep 03 16:53:16.530830 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 16:53:16.530830 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: from cinder.common import config Sep 03 16:53:16.530830 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 16:53:16.530830 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 16:53:16.530830 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 16:53:16.530830 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: from cinder import policies Sep 03 16:53:16.530830 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 16:53:16.530830 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: from cinder.policies import group_snapshots Sep 03 16:53:16.530830 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 16:53:16.531444 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: check_str=base.PROJECT_MEMBER, Sep 03 16:53:16.531444 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 16:53:16.531444 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 16:53:16.531444 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: *** no app loaded. going in full dynamic mode *** Sep 03 16:53:20.427579 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: --- no python application found, check your startup logs for errors --- Sep 03 16:53:20.427579 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: [pid: 611545|app: -1|req: -1/2] 10.222.0.38 () {60 vars in 1238 bytes} [Fri Sep 3 16:53:20 2021] POST /volume/v3/03d83963d55c416d9054b8840f9bfbf8/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 16:54:05.496513 dv-cinder-759961-8-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 16:54:05.497105 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: Fri Sep 3 16:54:05 2021 - graceful shutdown triggered... Sep 03 16:54:05.497664 dv-cinder-759961-8-iscsi devstack@c-api.service[611545]: Gracefully killing worker 1 (pid: 611545)... Sep 03 16:54:05.498052 dv-cinder-759961-8-iscsi devstack@c-api.service[611546]: Gracefully killing worker 2 (pid: 611546)... Sep 03 16:54:06.498164 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: worker 1 buried after 1 seconds Sep 03 16:54:06.498164 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: worker 2 buried after 1 seconds Sep 03 16:54:06.498164 dv-cinder-759961-8-iscsi devstack@c-api.service[611541]: goodbye to uWSGI. Sep 03 16:54:06.499711 dv-cinder-759961-8-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 16:54:06.500269 dv-cinder-759961-8-iscsi systemd[1]: Stopped Devstack devstack@c-api.service. Sep 03 17:05:51.455038 dv-cinder-759961-8-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 17:05:51.468508 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 17:05:51 2021] *** Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: nodename: dv-cinder-759961-8-iscsi Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: machine: x86_64 Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: clock source: unix Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: pcre jit disabled Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: detected number of CPU cores: 4 Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: current working directory: / Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: detected binary path: /usr/bin/uwsgi-core Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: your processes number limit is 47680 Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: your memory page size is 4096 bytes Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: detected max file descriptor number: 2048 Sep 03 17:05:51.469279 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: lock engine: pthread robust mutexes Sep 03 17:05:51.470256 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: thunder lock: enabled Sep 03 17:05:51.470256 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 17:05:51.470256 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 17:05:51.516079 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: Python main interpreter initialized at 0x55b65d4a09d0 Sep 03 17:05:51.516079 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: python threads support enabled Sep 03 17:05:51.516079 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: your server socket listen backlog is limited to 100 connections Sep 03 17:05:51.516079 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: your mercy for graceful operations on workers is 90 seconds Sep 03 17:05:51.516596 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 17:05:51.516596 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: *** Operational MODE: preforking *** Sep 03 17:05:51.516864 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: *** uWSGI is running in multiple interpreter mode *** Sep 03 17:05:51.516864 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: spawned uWSGI master process (pid: 672096) Sep 03 17:05:51.517032 dv-cinder-759961-8-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 17:05:51.518036 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: spawned uWSGI worker 1 (pid: 672110, cores: 1) Sep 03 17:05:51.518036 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: spawned uWSGI worker 2 (pid: 672111, cores: 1) Sep 03 17:05:51.518249 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 17:05:52.989622 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: Traceback (most recent call last): Sep 03 17:05:52.989622 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 17:05:52.990364 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: from cinder.wsgi.wsgi import initialize_application Sep 03 17:05:52.990364 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 17:05:52.990364 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: from cinder.common import config Sep 03 17:05:52.990364 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 17:05:52.990364 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 17:05:52.990364 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 17:05:52.990364 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: from cinder import policies Sep 03 17:05:52.990364 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 17:05:52.990364 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: from cinder.policies import group_snapshots Sep 03 17:05:52.990364 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 17:05:52.991050 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: check_str=base.PROJECT_MEMBER, Sep 03 17:05:52.991050 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 17:05:52.991050 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 17:05:52.991050 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: *** no app loaded. going in full dynamic mode *** Sep 03 17:05:52.991050 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: --- no python application found, check your startup logs for errors --- Sep 03 17:05:52.991050 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: [pid: 672111|app: -1|req: -1/1] 10.222.0.38 () {50 vars in 776 bytes} [Fri Sep 3 17:05:52 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 17:05:53.055542 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: Traceback (most recent call last): Sep 03 17:05:53.055542 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 17:05:53.056219 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: from cinder.wsgi.wsgi import initialize_application Sep 03 17:05:53.056219 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 17:05:53.056219 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: from cinder.common import config Sep 03 17:05:53.056219 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 17:05:53.056219 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 17:05:53.056219 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 17:05:53.056219 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: from cinder import policies Sep 03 17:05:53.056219 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 17:05:53.056219 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: from cinder.policies import group_snapshots Sep 03 17:05:53.056219 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 17:05:53.056999 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: check_str=base.PROJECT_MEMBER, Sep 03 17:05:53.056999 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 17:05:53.056999 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 17:05:53.056999 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: *** no app loaded. going in full dynamic mode *** Sep 03 17:05:56.949968 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: --- no python application found, check your startup logs for errors --- Sep 03 17:05:56.950508 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: [pid: 672111|app: -1|req: -1/2] 10.222.0.38 () {60 vars in 1238 bytes} [Fri Sep 3 17:05:56 2021] POST /volume/v3/48eb57f3ed0c4e0fba7126fed0ca1c6a/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 17:06:41.833454 dv-cinder-759961-8-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 17:06:41.834273 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: Fri Sep 3 17:06:41 2021 - graceful shutdown triggered... Sep 03 17:06:41.834769 dv-cinder-759961-8-iscsi devstack@c-api.service[672110]: Gracefully killing worker 1 (pid: 672110)... Sep 03 17:06:41.835162 dv-cinder-759961-8-iscsi devstack@c-api.service[672111]: Gracefully killing worker 2 (pid: 672111)... Sep 03 17:06:42.835528 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: worker 1 buried after 1 seconds Sep 03 17:06:42.835528 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: worker 2 buried after 1 seconds Sep 03 17:06:42.835528 dv-cinder-759961-8-iscsi devstack@c-api.service[672096]: goodbye to uWSGI. Sep 03 17:06:42.837004 dv-cinder-759961-8-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 17:06:42.837554 dv-cinder-759961-8-iscsi systemd[1]: Stopped Devstack devstack@c-api.service. Sep 03 17:18:29.379006 dv-cinder-759961-8-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 17:18:29.392045 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 17:18:29.394526 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 17:18:29 2021] *** Sep 03 17:18:29.394526 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 17:18:29.394526 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 17:18:29.394526 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: nodename: dv-cinder-759961-8-iscsi Sep 03 17:18:29.394526 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: machine: x86_64 Sep 03 17:18:29.394526 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: clock source: unix Sep 03 17:18:29.394526 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: pcre jit disabled Sep 03 17:18:29.394526 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: detected number of CPU cores: 4 Sep 03 17:18:29.394526 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: current working directory: / Sep 03 17:18:29.394526 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: detected binary path: /usr/bin/uwsgi-core Sep 03 17:18:29.394526 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: your processes number limit is 47680 Sep 03 17:18:29.395219 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: your memory page size is 4096 bytes Sep 03 17:18:29.395219 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: detected max file descriptor number: 2048 Sep 03 17:18:29.395219 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: lock engine: pthread robust mutexes Sep 03 17:18:29.395219 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: thunder lock: enabled Sep 03 17:18:29.395219 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 17:18:29.395219 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 17:18:29.440384 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: Python main interpreter initialized at 0x55c45fa179d0 Sep 03 17:18:29.440384 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: python threads support enabled Sep 03 17:18:29.440384 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: your server socket listen backlog is limited to 100 connections Sep 03 17:18:29.440384 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: your mercy for graceful operations on workers is 90 seconds Sep 03 17:18:29.440792 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 17:18:29.440792 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: *** Operational MODE: preforking *** Sep 03 17:18:29.441090 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: *** uWSGI is running in multiple interpreter mode *** Sep 03 17:18:29.441090 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: spawned uWSGI master process (pid: 732300) Sep 03 17:18:29.441305 dv-cinder-759961-8-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 17:18:29.442267 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: spawned uWSGI worker 1 (pid: 732312, cores: 1) Sep 03 17:18:29.442267 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: spawned uWSGI worker 2 (pid: 732313, cores: 1) Sep 03 17:18:29.442441 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 17:18:30.888380 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: Traceback (most recent call last): Sep 03 17:18:30.888380 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 17:18:30.889055 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: from cinder.wsgi.wsgi import initialize_application Sep 03 17:18:30.889055 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 17:18:30.889055 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: from cinder.common import config Sep 03 17:18:30.889055 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 17:18:30.889055 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 17:18:30.889055 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 17:18:30.889055 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: from cinder import policies Sep 03 17:18:30.889055 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 17:18:30.889608 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: from cinder.policies import group_snapshots Sep 03 17:18:30.889608 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 17:18:30.889608 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: check_str=base.PROJECT_MEMBER, Sep 03 17:18:30.889608 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 17:18:30.889608 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 17:18:30.889923 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: *** no app loaded. going in full dynamic mode *** Sep 03 17:18:30.889923 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: --- no python application found, check your startup logs for errors --- Sep 03 17:18:30.889923 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: [pid: 732313|app: -1|req: -1/1] 10.222.0.38 () {50 vars in 776 bytes} [Fri Sep 3 17:18:30 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 17:18:30.891417 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: Traceback (most recent call last): Sep 03 17:18:30.891417 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 17:18:30.891963 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: from cinder.wsgi.wsgi import initialize_application Sep 03 17:18:30.891963 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 17:18:30.891963 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: from cinder.common import config Sep 03 17:18:30.891963 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 17:18:30.891963 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 17:18:30.891963 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 17:18:30.891963 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: from cinder import policies Sep 03 17:18:30.891963 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 17:18:30.892956 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: from cinder.policies import group_snapshots Sep 03 17:18:30.892956 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 17:18:30.892956 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: check_str=base.PROJECT_MEMBER, Sep 03 17:18:30.892956 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 17:18:30.892956 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 17:18:30.892956 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: *** no app loaded. going in full dynamic mode *** Sep 03 17:18:34.778626 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: --- no python application found, check your startup logs for errors --- Sep 03 17:18:34.778626 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: [pid: 732313|app: -1|req: -1/2] 10.222.0.38 () {60 vars in 1238 bytes} [Fri Sep 3 17:18:34 2021] POST /volume/v3/aa6f285679e5431db9cf3f6cff0e7254/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 17:19:19.942083 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: Fri Sep 3 17:19:19 2021 - graceful shutdown triggered... Sep 03 17:19:19.942581 dv-cinder-759961-8-iscsi devstack@c-api.service[732312]: Gracefully killing worker 1 (pid: 732312)... Sep 03 17:19:19.942187 dv-cinder-759961-8-iscsi systemd[1]: Stopping Devstack devstack@c-api.service... Sep 03 17:19:19.943116 dv-cinder-759961-8-iscsi devstack@c-api.service[732313]: Gracefully killing worker 2 (pid: 732313)... Sep 03 17:19:20.943200 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: worker 1 buried after 1 seconds Sep 03 17:19:20.943200 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: worker 2 buried after 1 seconds Sep 03 17:19:20.943200 dv-cinder-759961-8-iscsi devstack@c-api.service[732300]: goodbye to uWSGI. Sep 03 17:19:20.944815 dv-cinder-759961-8-iscsi systemd[1]: devstack@c-api.service: Succeeded. Sep 03 17:19:20.945367 dv-cinder-759961-8-iscsi systemd[1]: Stopped Devstack devstack@c-api.service. Sep 03 17:31:08.888116 dv-cinder-759961-8-iscsi systemd[1]: Starting Devstack devstack@c-api.service... Sep 03 17:31:08.897395 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: [uWSGI] getting INI configuration from /etc/cinder/cinder-api-uwsgi.ini Sep 03 17:31:08.899615 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 3 17:31:08 2021] *** Sep 03 17:31:08.899615 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 17:31:08.899615 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 17:31:08.899615 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: nodename: dv-cinder-759961-8-iscsi Sep 03 17:31:08.899615 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: machine: x86_64 Sep 03 17:31:08.899615 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: clock source: unix Sep 03 17:31:08.899615 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: pcre jit disabled Sep 03 17:31:08.899615 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: detected number of CPU cores: 4 Sep 03 17:31:08.899615 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: current working directory: / Sep 03 17:31:08.899615 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: detected binary path: /usr/bin/uwsgi-core Sep 03 17:31:08.899615 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: your processes number limit is 47680 Sep 03 17:31:08.899615 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: your memory page size is 4096 bytes Sep 03 17:31:08.900372 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: detected max file descriptor number: 2048 Sep 03 17:31:08.900372 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: lock engine: pthread robust mutexes Sep 03 17:31:08.900372 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: thunder lock: enabled Sep 03 17:31:08.900372 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/cinder-wsgi.socket fd 4 Sep 03 17:31:08.900372 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 03 17:31:08.944235 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: Python main interpreter initialized at 0x55a0b7fda9d0 Sep 03 17:31:08.944235 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: python threads support enabled Sep 03 17:31:08.944235 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: your server socket listen backlog is limited to 100 connections Sep 03 17:31:08.944235 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: your mercy for graceful operations on workers is 90 seconds Sep 03 17:31:08.945274 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 17:31:08.945357 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: *** Operational MODE: preforking *** Sep 03 17:31:08.945622 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: *** uWSGI is running in multiple interpreter mode *** Sep 03 17:31:08.945622 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: spawned uWSGI master process (pid: 792922) Sep 03 17:31:08.945823 dv-cinder-759961-8-iscsi systemd[1]: Started Devstack devstack@c-api.service. Sep 03 17:31:08.946421 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: spawned uWSGI worker 1 (pid: 792923, cores: 1) Sep 03 17:31:08.946797 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: spawned uWSGI worker 2 (pid: 792924, cores: 1) Sep 03 17:31:08.946968 dv-cinder-759961-8-iscsi devstack@c-api.service[792922]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 17:31:10.423165 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: Traceback (most recent call last): Sep 03 17:31:10.423165 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 17:31:10.423801 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: from cinder.wsgi.wsgi import initialize_application Sep 03 17:31:10.423801 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 17:31:10.423801 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: from cinder.common import config Sep 03 17:31:10.423801 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 17:31:10.423801 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 17:31:10.423801 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 17:31:10.423801 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: from cinder import policies Sep 03 17:31:10.423801 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 17:31:10.423801 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: from cinder.policies import group_snapshots Sep 03 17:31:10.423801 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 17:31:10.424435 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: check_str=base.PROJECT_MEMBER, Sep 03 17:31:10.424435 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 17:31:10.424435 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 17:31:10.424435 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: *** no app loaded. going in full dynamic mode *** Sep 03 17:31:10.424435 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: --- no python application found, check your startup logs for errors --- Sep 03 17:31:10.424813 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: [pid: 792923|app: -1|req: -1/1] 10.222.0.38 () {50 vars in 776 bytes} [Fri Sep 3 17:31:10 2021] GET /volume/v3 => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0) Sep 03 17:31:10.518866 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: Traceback (most recent call last): Sep 03 17:31:10.518866 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: File "/usr/local/bin/cinder-wsgi", line 6, in Sep 03 17:31:10.519539 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: from cinder.wsgi.wsgi import initialize_application Sep 03 17:31:10.519539 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: File "/opt/stack/cinder/cinder/wsgi/wsgi.py", line 27, in Sep 03 17:31:10.519539 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: from cinder.common import config Sep 03 17:31:10.519539 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: File "/opt/stack/cinder/cinder/common/config.py", line 36, in Sep 03 17:31:10.519539 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: from cinder.policy import DEFAULT_POLICY_FILENAME Sep 03 17:31:10.519539 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: File "/opt/stack/cinder/cinder/policy.py", line 27, in Sep 03 17:31:10.519539 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: from cinder import policies Sep 03 17:31:10.519539 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: File "/opt/stack/cinder/cinder/policies/__init__.py", line 27, in Sep 03 17:31:10.519539 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: from cinder.policies import group_snapshots Sep 03 17:31:10.519539 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: File "/opt/stack/cinder/cinder/policies/group_snapshots.py", line 82, in Sep 03 17:31:10.520221 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: check_str=base.PROJECT_MEMBER, Sep 03 17:31:10.520221 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: AttributeError: module 'cinder.policies.base' has no attribute 'PROJECT_MEMBER' Sep 03 17:31:10.520221 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: unable to load app 0 (mountpoint='') (callable not found or import error) Sep 03 17:31:10.520221 dv-cinder-759961-8-iscsi devstack@c-api.service[792924]: *** no app loaded. going in full dynamic mode *** Sep 03 17:31:14.654780 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: --- no python application found, check your startup logs for errors --- Sep 03 17:31:14.654780 dv-cinder-759961-8-iscsi devstack@c-api.service[792923]: [pid: 792923|app: -1|req: -1/2] 10.222.0.38 () {60 vars in 1238 bytes} [Fri Sep 3 17:31:14 2021] POST /volume/v3/8d356c58ba4841d7b078e2e9c793bded/types => generated 21 bytes in 0 msecs (HTTP/1.1 500) 3 headers in 102 bytes (0 switches on core 0)